2024-05-08T23:26:27.736 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T23:26:27.736 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187 --verbose -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187/orig.config.yaml 2024-05-08T23:26:27.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T23:26:27.872 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698187' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific ' name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ88oxdjFKYvoFSgfLcXR8jYUucC672HGvLJ9M7pPCidmv4nfjqonm1CHBG4XKfx5py+1sMNK8eDOpcGeeNakYs= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlnESZI3rqST/q7HcdgMbCRomLZGFCGVwHxxIkeObh7F9wVTTEqJXhnbr261KqFvUM7Q7LwpNP6f8CrT49ZDFY= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: pacific exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: pacific cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:pacific roleless: true - print: '**** done end installing pacific cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/pdonnell/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20240508.150423-reef/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-05-08T23:26:27.872 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T23:26:27.873 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T23:26:27.873 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T23:26:27.874 INFO:teuthology.task.internal:Checking packages... 2024-05-08T23:26:27.901 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T23:26:27.902 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:26:27.902 INFO:teuthology.packaging:ref: None 2024-05-08T23:26:27.902 INFO:teuthology.packaging:tag: None 2024-05-08T23:26:27.902 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T23:26:27.902 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:26:27.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T23:26:28.127 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322.gd21e4f96 2024-05-08T23:26:28.129 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T23:26:28.135 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T23:26:28.135 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T23:26:28.182 INFO:teuthology.task.internal:Saving configuration 2024-05-08T23:26:28.202 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T23:26:28.215 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T23:26:28.241 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 23:21:29.703063', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ88oxdjFKYvoFSgfLcXR8jYUucC672HGvLJ9M7pPCidmv4nfjqonm1CHBG4XKfx5py+1sMNK8eDOpcGeeNakYs='} 2024-05-08T23:26:28.261 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 23:21:29.701690', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlnESZI3rqST/q7HcdgMbCRomLZGFCGVwHxxIkeObh7F9wVTTEqJXhnbr261KqFvUM7Q7LwpNP6f8CrT49ZDFY='} 2024-05-08T23:26:28.262 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T23:26:28.268 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-05-08T23:26:28.268 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-05-08T23:26:28.268 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T23:26:28.362 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f74f1354160>, signals=[15]) 2024-05-08T23:26:28.363 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T23:26:28.368 INFO:teuthology.task.internal:Opening connections... 2024-05-08T23:26:28.368 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-05-08T23:26:28.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:26:28.447 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:26:28.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:26:28.522 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T23:26:28.528 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-05-08T23:26:28.552 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-05-08T23:26:28.552 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-05-08T23:26:28.613 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T23:26:28.614 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T23:26:28.615 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T23:26:28.615 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-05-08T23:26:28.642 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-05-08T23:26:28.664 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-05-08T23:26:28.665 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-05-08T23:26:28.726 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-05-08T23:26:28.727 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-05-08T23:26:28.727 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T23:26:28.727 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T23:26:28.727 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T23:26:28.727 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-05-08T23:26:28.749 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T23:26:28.758 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T23:26:28.799 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T23:26:28.799 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-05-08T23:26:28.802 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-05-08T23:26:28.822 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T23:26:28.849 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T23:26:28.849 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-05-08T23:26:28.864 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-05-08T23:26:28.897 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T23:26:28.953 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T23:26:28.967 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T23:26:28.967 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T23:26:28.967 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T23:26:28.968 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T23:26:28.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:26:28.988 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-08T23:26:28.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:26:28.989 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-05-08T23:26:29.050 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-489.el8.x86_64 2024-05-08T23:26:29.050 INFO:teuthology.task.kernel:Running kernel on smithi135: 4.18.0-489.el8.x86_64 2024-05-08T23:26:29.050 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-05-08T23:26:29.052 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-489.el8.x86_64 2024-05-08T23:26:29.052 INFO:teuthology.task.kernel:Running kernel on smithi026: 4.18.0-489.el8.x86_64 2024-05-08T23:26:29.052 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2024-05-08T23:26:33.352 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - AppStream 16 MB/s | 28 MB 00:01 2024-05-08T23:26:33.619 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - AppStream 16 MB/s | 28 MB 00:01 2024-05-08T23:27:49.128 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - BaseOS 151 kB/s | 10 MB 01:10 2024-05-08T23:27:51.029 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - Extras 68 kB/s | 18 kB 00:00 2024-05-08T23:27:51.334 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - BaseOS 146 kB/s | 10 MB 01:12 2024-05-08T23:27:51.579 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 7.7 kB 00:00 2024-05-08T23:27:51.856 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-05-08T23:27:53.393 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2024-05-08T23:27:53.943 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 7.7 kB 00:00 2024-05-08T23:27:54.051 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 16 MB 00:02 2024-05-08T23:27:54.187 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-05-08T23:27:55.006 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2024-05-08T23:27:57.841 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 433 kB/s | 24 kB 00:00 2024-05-08T23:27:58.995 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 444 kB/s | 24 kB 00:00 2024-05-08T23:28:00.905 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-05-08T23:28:00.905 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-05-08T23:28:01.028 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:28:01.029 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:28:01.029 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:28:01.029 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:28:01.029 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 4.18.0-552.1.1.el8 baseos 10 M 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 4.18.0-552.1.1.el8 baseos 44 M 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 4.18.0-552.1.1.el8 baseos 36 M 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout:Install 3 Packages 2024-05-08T23:28:01.030 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:28:01.031 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 90 M 2024-05-08T23:28:01.031 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 96 M 2024-05-08T23:28:01.031 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:28:02.192 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-05-08T23:28:02.192 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-05-08T23:28:02.319 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:28:02.320 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:28:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:28:02.320 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:28:02.320 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 4.18.0-552.1.1.el8 baseos 10 M 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core x86_64 4.18.0-552.1.1.el8 baseos 44 M 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules x86_64 4.18.0-552.1.1.el8 baseos 36 M 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout:Install 3 Packages 2024-05-08T23:28:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:28:02.322 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 90 M 2024-05-08T23:28:02.322 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 96 M 2024-05-08T23:28:02.322 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:29:59.624 INFO:teuthology.orchestra.run.smithi026.stdout:(1/3): kernel-4.18.0-552.1.1.el8.x86_64.rpm 92 kB/s | 10 MB 01:55 2024-05-08T23:30:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:(1/3): kernel-4.18.0-552.1.1.el8.x86_64.rpm 83 kB/s | 10 MB 02:07 2024-05-08T23:34:40.388 INFO:teuthology.orchestra.run.smithi135.stdout:(2/3): kernel-modules-4.18.0-552.1.1.el8.x86_64 93 kB/s | 36 MB 06:39 2024-05-08T23:35:10.720 INFO:teuthology.orchestra.run.smithi026.stdout:(2/3): kernel-modules-4.18.0-552.1.1.el8.x86_64 88 kB/s | 36 MB 07:06 2024-05-08T23:36:14.140 INFO:teuthology.orchestra.run.smithi135.stdout:(3/3): kernel-core-4.18.0-552.1.1.el8.x86_64.rp 91 kB/s | 44 MB 08:12 2024-05-08T23:36:14.141 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:36:14.141 INFO:teuthology.orchestra.run.smithi135.stdout:Total 188 kB/s | 90 MB 08:13 2024-05-08T23:36:14.821 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:36:15.258 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:36:15.258 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:36:16.514 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:36:16.540 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:36:19.380 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:36:19.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-4.18.0-552.1.1.el8.x86_64 1/3 2024-05-08T23:36:23.563 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-4.18.0-552.1.1.el8.x86_64 1/3 2024-05-08T23:36:23.981 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-4.18.0-552.1.1.el8.x86_64 2/3 2024-05-08T23:36:27.428 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-4.18.0-552.1.1.el8.x86_64 2/3 2024-05-08T23:36:27.746 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:36:36.191 INFO:teuthology.orchestra.run.smithi026.stdout:(3/3): kernel-core-4.18.0-552.1.1.el8.x86_64.rp 87 kB/s | 44 MB 08:31 2024-05-08T23:36:36.191 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:36:36.191 INFO:teuthology.orchestra.run.smithi026.stdout:Total 180 kB/s | 90 MB 08:33 2024-05-08T23:36:36.905 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:36:37.359 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:36:37.359 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:36:38.661 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:36:38.693 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:36:41.662 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:36:42.222 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-core-4.18.0-552.1.1.el8.x86_64 1/3 2024-05-08T23:36:45.986 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-4.18.0-552.1.1.el8.x86_64 1/3 2024-05-08T23:36:46.362 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-modules-4.18.0-552.1.1.el8.x86_64 2/3 2024-05-08T23:36:49.683 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:36:49.707 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:36:50.053 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-4.18.0-552.1.1.el8.x86_64 2/3 2024-05-08T23:36:50.341 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:36:50.394 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:36:50.394 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-4.18.0-552.1.1.el8.x86_64 1/3 2024-05-08T23:36:50.394 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-4.18.0-552.1.1.el8.x86_64 2/3 2024-05-08T23:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:36:51.044 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T23:36:51.259 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:51.259 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:51.259 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:51.259 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T23:36:51.259 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T23:36:51.260 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-05-08T23:36:51.260 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T23:36:51.260 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T23:36:51.472 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:51.473 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:51.473 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-05-08T23:36:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-05-08T23:36:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.02 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 129.el8 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Group : System Environment/Base 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 9265586 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : kbuilder.bsys.centos.org 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Relocations : (not relocatable) 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : CentOS BuildSystem 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-05-08T23:36:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:36:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T23:36:51.509 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T23:36:51.509 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:51.509 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T23:36:53.027 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-05-08T23:36:55.037 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-05-08T23:36:55.039 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-05-08T23:36:55.074 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.advzD0YFVI 2024-05-08T23:36:55.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.advzD0YFVI 2024-05-08T23:36:55.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.advzD0YFVI 2024-05-08T23:36:55.301 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.advzD0YFVI is 6KB 2024-05-08T23:36:55.348 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.advzD0YFVI 2024-05-08T23:36:55.366 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T23:36:55.444 INFO:teuthology.orchestra.run.smithi135.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-05-08T23:36:55.444 INFO:teuthology.orchestra.run.smithi135.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-05-08T23:36:55.444 INFO:teuthology.orchestra.run.smithi135.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-05-08T23:36:55.444 INFO:teuthology.orchestra.run.smithi135.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.1.1.el8.x86_64.conf 2024-05-08T23:36:55.445 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:36:55.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-05-08T23:37:13.604 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:37:13.627 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:37:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:37:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-4.18.0-552.1.1.el8.x86_64 1/3 2024-05-08T23:37:14.025 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-core-4.18.0-552.1.1.el8.x86_64 2/3 2024-05-08T23:37:15.541 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-modules-4.18.0-552.1.1.el8.x86_64 3/3 2024-05-08T23:37:15.542 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:37:15.542 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:37:15.542 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:15.542 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:15.542 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:15.542 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:37:15.542 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:37:15.692 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T23:37:15.920 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:15.920 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:15.920 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:15.920 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T23:37:15.920 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T23:37:15.921 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-05-08T23:37:15.921 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T23:37:15.921 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T23:37:16.142 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:16.142 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:16.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -qi grub2-tools 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:Name : grub2-tools 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:Epoch : 1 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:Version : 2.02 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:Release : 129.el8 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: x86_64 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:Group : System Environment/Base 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:Size : 9265586 2024-05-08T23:37:16.178 INFO:teuthology.orchestra.run.smithi026.stdout:License : GPLv3+ 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Build Host : kbuilder.bsys.centos.org 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Relocations : (not relocatable) 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Packager : CentOS BuildSystem 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Vendor : CentOS 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Summary : Support tools for GRUB. 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:Description : 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T23:37:16.179 INFO:teuthology.orchestra.run.smithi026.stdout:hardware devices. 2024-05-08T23:37:16.180 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:37:16.180 INFO:teuthology.orchestra.run.smithi026.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T23:37:16.180 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T23:37:16.180 INFO:teuthology.task.kernel:Updating grub on smithi026 to boot 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:16.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T23:37:17.330 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2024-05-08T23:37:19.160 INFO:teuthology.orchestra.run.smithi026.stderr:done 2024-05-08T23:37:19.161 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-05-08T23:37:19.194 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.bwc3mkfxmp 2024-05-08T23:37:19.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bwc3mkfxmp 2024-05-08T23:37:19.266 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.bwc3mkfxmp 2024-05-08T23:37:19.410 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.bwc3mkfxmp is 6KB 2024-05-08T23:37:19.458 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.bwc3mkfxmp 2024-05-08T23:37:19.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T23:37:19.548 INFO:teuthology.orchestra.run.smithi026.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-05-08T23:37:19.548 INFO:teuthology.orchestra.run.smithi026.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-05-08T23:37:19.548 INFO:teuthology.orchestra.run.smithi026.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-05-08T23:37:19.548 INFO:teuthology.orchestra.run.smithi026.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.1.1.el8.x86_64.conf 2024-05-08T23:37:19.549 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.1.1.el8.x86_64 2024-05-08T23:37:19.687 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2024-05-08T23:37:25.586 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-05-08T23:37:25.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T23:37:25.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:37:43.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-08T23:37:49.695 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-05-08T23:37:49.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-05-08T23:37:49.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:37:52.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T23:37:52.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:37:56.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-08T23:38:08.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-05-08T23:38:08.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T23:38:08.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:38:17.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-05-08T23:38:17.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:38:35.427 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-05-08T23:38:40.348 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-08T23:38:41.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T23:38:41.740 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-552.1.1.el8.x86_64"... 2024-05-08T23:38:41.741 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-08T23:38:41.868 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-552.1.1.el8.x86_64 2024-05-08T23:38:41.868 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.1.1.el8.x86_64 vs 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:38:41.868 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T23:38:41.868 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T23:38:42.869 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-05-08T23:38:42.869 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T23:38:42.936 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-05-08T23:38:42.949 DEBUG:teuthology.parallel:result is None 2024-05-08T23:38:47.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-05-08T23:38:47.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:38:47.891 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-05-08T23:38:48.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-05-08T23:38:48.101 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-552.1.1.el8.x86_64"... 2024-05-08T23:38:48.101 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-05-08T23:38:48.119 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-552.1.1.el8.x86_64 2024-05-08T23:38:48.119 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.1.1.el8.x86_64 vs 4.18.0-552.1.1.el8.x86_64 2024-05-08T23:38:48.119 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T23:38:48.119 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T23:38:49.120 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-05-08T23:38:49.121 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T23:38:49.191 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2024-05-08T23:38:49.209 DEBUG:teuthology.parallel:result is None 2024-05-08T23:38:49.210 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T23:38:49.217 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T23:38:49.217 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T23:38:49.219 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T23:38:49.241 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T23:38:49.292 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T23:38:49.330 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T23:38:49.331 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T23:38:49.333 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T23:38:49.371 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T23:38:49.377 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T23:38:49.378 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T23:38:49.393 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T23:38:49.421 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:38:49.431 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:38:49.443 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:38:49.454 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:38:49.456 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T23:38:49.463 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T23:38:49.463 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T23:38:49.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T23:38:49.526 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T23:38:49.535 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T23:38:49.536 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T23:38:49.543 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T23:38:49.585 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:38:49.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:38:49.694 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:38:49.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:38:49.821 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:38:49.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T23:38:49.890 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:38:49.940 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:38:50.003 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:38:50.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:38:50.093 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:38:50.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T23:38:50.162 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-05-08T23:38:50.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-05-08T23:38:50.232 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:38:50.281 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:38:50.352 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T23:38:50.359 INFO:teuthology.task.internal:Starting timer... 2024-05-08T23:38:50.360 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T23:38:50.392 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T23:38:50.441 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-05-08T23:38:50.441 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2024-05-08T23:38:50.523 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2024-05-08T23:38:50.524 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-05-08T23:38:50.612 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-05-08T23:38:50.614 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T23:38:50.614 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2024-05-08T23:38:50.638 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2024-05-08T23:38:50.639 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-05-08T23:38:50.665 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-05-08T23:38:50.665 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-05-08T23:38:50.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T23:38:50.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:38:50.711 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T23:38:50.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:38:50.738 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T23:38:50.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2024-05-08T23:38:50.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-05-08T23:38:50.812 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T23:38:50.822 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T23:38:50.840 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T23:38:50.841 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T23:44:53.601 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-05-08T23:44:53.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-05-08T23:44:53.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:44:53.683 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-05-08T23:44:53.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-05-08T23:44:53.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T23:44:53.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:44:53.830 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-08T23:44:53.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T23:44:53.900 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T23:44:53.911 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T23:44:53.911 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T23:44:53.912 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:44:53.914 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T23:44:53.914 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:44:53.946 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T23:44:53.960 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T23:44:53.971 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T23:44:53.985 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T23:44:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2024-05-08T23:44:54.047 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2024-05-08T23:44:54.051 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-05-08T23:44:54.062 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T23:44:54.062 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-05-08T23:44:54.075 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T23:44:54.076 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T23:44:54.089 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T23:44:54.145 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2024-05-08T23:44:54.147 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2024-05-08T23:44:54.148 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:44:54.148 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-05-08T23:44:54.149 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:44:54.149 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:44:54.149 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:44:54.149 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:44:54.150 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:44:54.150 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-08T23:44:54.151 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:44:54.151 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:44:54.151 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:44:54.151 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:44:54.152 INFO:teuthology.run_tasks:Running task pexec... 2024-05-08T23:44:54.162 INFO:teuthology.task.pexec:Executing custom commands... 2024-05-08T23:44:54.163 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi026.front.sepia.ceph.com 2024-05-08T23:44:54.163 DEBUG:teuthology.orchestra.run.smithi026:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T23:44:54.163 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T23:44:54.163 DEBUG:teuthology.orchestra.run.smithi135:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T23:44:54.944 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:27 ago on Wed 08 May 2024 11:43:27 PM UTC. 2024-05-08T23:44:54.974 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:23 ago on Wed 08 May 2024 11:43:31 PM UTC. 2024-05-08T23:44:57.116 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout:Resetting modules: 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:44:57.117 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:44:57.287 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout:Resetting modules: 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:44:57.289 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:44:57.392 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:44:57.584 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:44:58.173 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:31 ago on Wed 08 May 2024 11:43:27 PM UTC. 2024-05-08T23:44:58.404 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:27 ago on Wed 08 May 2024 11:43:31 PM UTC. 2024-05-08T23:45:00.345 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:45:00.382 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:45:00.382 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout:Installing group/module packages: 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-05-08T23:45:00.383 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout:Installing module profiles: 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools/common 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools rhel8 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout:Install 13 Packages 2024-05-08T23:45:00.384 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:45:00.385 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 27 M 2024-05-08T23:45:00.385 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 91 M 2024-05-08T23:45:00.385 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:45:00.620 INFO:teuthology.orchestra.run.smithi135.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 3.9 MB/s | 689 kB 00:00 2024-05-08T23:45:00.654 INFO:teuthology.orchestra.run.smithi135.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 4.8 MB/s | 1.0 MB 00:00 2024-05-08T23:45:00.671 INFO:teuthology.orchestra.run.smithi135.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 750 kB/s | 38 kB 00:00 2024-05-08T23:45:00.696 INFO:teuthology.orchestra.run.smithi135.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 6.0 MB/s | 258 kB 00:00 2024-05-08T23:45:00.718 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:45:00.746 INFO:teuthology.orchestra.run.smithi135.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 3.5 MB/s | 180 kB 00:00 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout:Installing group/module packages: 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-05-08T23:45:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout:Installing module profiles: 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools/common 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:45:00.761 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling module streams: 2024-05-08T23:45:00.762 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools rhel8 2024-05-08T23:45:00.762 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:45:00.762 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:45:00.762 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:45:00.762 INFO:teuthology.orchestra.run.smithi026.stdout:Install 13 Packages 2024-05-08T23:45:00.762 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:45:00.762 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 27 M 2024-05-08T23:45:00.763 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 91 M 2024-05-08T23:45:00.763 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:45:00.780 INFO:teuthology.orchestra.run.smithi135.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 744 kB/s | 25 kB 00:00 2024-05-08T23:45:00.822 INFO:teuthology.orchestra.run.smithi135.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 2.2 MB/s | 94 kB 00:00 2024-05-08T23:45:00.948 INFO:teuthology.orchestra.run.smithi135.stdout:(8/13): netavark-1.10.3-1.module_el8+951+32019c 15 MB/s | 4.1 MB 00:00 2024-05-08T23:45:01.022 INFO:teuthology.orchestra.run.smithi026.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 3.4 MB/s | 689 kB 00:00 2024-05-08T23:45:01.066 INFO:teuthology.orchestra.run.smithi026.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 4.1 MB/s | 1.0 MB 00:00 2024-05-08T23:45:01.073 INFO:teuthology.orchestra.run.smithi135.stdout:(9/13): buildah-1.33.6-2.module_el8+976+1136073 15 MB/s | 9.6 MB 00:00 2024-05-08T23:45:01.091 INFO:teuthology.orchestra.run.smithi026.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 555 kB/s | 38 kB 00:00 2024-05-08T23:45:01.116 INFO:teuthology.orchestra.run.smithi026.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 5.0 MB/s | 258 kB 00:00 2024-05-08T23:45:01.157 INFO:teuthology.orchestra.run.smithi135.stdout:(10/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 12 MB/s | 2.5 MB 00:00 2024-05-08T23:45:01.158 INFO:teuthology.orchestra.run.smithi026.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 4.2 MB/s | 180 kB 00:00 2024-05-08T23:45:01.173 INFO:teuthology.orchestra.run.smithi135.stdout:(11/13): udica-0.2.6-20.module_el8+804+f131391c 526 kB/s | 53 kB 00:00 2024-05-08T23:45:01.192 INFO:teuthology.orchestra.run.smithi026.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 747 kB/s | 25 kB 00:00 2024-05-08T23:45:01.215 INFO:teuthology.orchestra.run.smithi135.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 700 kB/s | 41 kB 00:00 2024-05-08T23:45:01.234 INFO:teuthology.orchestra.run.smithi026.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 2.2 MB/s | 94 kB 00:00 2024-05-08T23:45:01.292 INFO:teuthology.orchestra.run.smithi026.stdout:(8/13): netavark-1.10.3-1.module_el8+951+32019c 20 MB/s | 4.1 MB 00:00 2024-05-08T23:45:01.366 INFO:teuthology.orchestra.run.smithi135.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 16 MB/s | 8.8 MB 00:00 2024-05-08T23:45:01.366 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:45:01.366 INFO:teuthology.orchestra.run.smithi135.stdout:Total 28 MB/s | 27 MB 00:00 2024-05-08T23:45:01.426 INFO:teuthology.orchestra.run.smithi026.stdout:(9/13): buildah-1.33.6-2.module_el8+976+1136073 16 MB/s | 9.6 MB 00:00 2024-05-08T23:45:01.485 INFO:teuthology.orchestra.run.smithi026.stdout:(10/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 13 MB/s | 2.5 MB 00:00 2024-05-08T23:45:01.501 INFO:teuthology.orchestra.run.smithi026.stdout:(11/13): udica-0.2.6-20.module_el8+804+f131391c 701 kB/s | 53 kB 00:00 2024-05-08T23:45:01.518 INFO:teuthology.orchestra.run.smithi026.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 1.2 MB/s | 41 kB 00:00 2024-05-08T23:45:01.635 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:45:01.656 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:45:01.656 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:45:01.752 INFO:teuthology.orchestra.run.smithi026.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 17 MB/s | 8.8 MB 00:00 2024-05-08T23:45:01.752 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:45:01.753 INFO:teuthology.orchestra.run.smithi026.stdout:Total 28 MB/s | 27 MB 00:00 2024-05-08T23:45:01.923 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:45:01.927 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:45:02.034 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:45:02.057 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:45:02.057 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:45:02.332 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:45:02.335 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:45:02.569 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:45:02.939 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:45:03.574 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-05-08T23:45:03.828 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-05-08T23:45:03.918 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-05-08T23:45:04.032 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-05-08T23:45:04.125 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-05-08T23:45:04.216 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-05-08T23:45:04.294 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-05-08T23:45:04.476 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-05-08T23:45:04.502 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-05-08T23:45:04.727 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-05-08T23:45:05.025 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-05-08T23:45:05.278 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-05-08T23:45:06.012 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-05-08T23:45:06.296 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-05-08T23:45:06.319 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-05-08T23:45:06.503 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-05-08T23:45:06.590 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-05-08T23:45:06.700 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-05-08T23:45:07.073 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-05-08T23:45:07.193 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-05-08T23:45:07.310 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-05-08T23:45:07.427 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-05-08T23:45:07.536 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-05-08T23:45:07.625 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-05-08T23:45:07.772 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-05-08T23:45:07.810 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-05-08T23:45:08.196 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-05-08T23:45:08.196 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-05-08T23:45:08.196 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-05-08T23:45:08.196 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-05-08T23:45:08.196 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-05-08T23:45:08.196 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-05-08T23:45:08.196 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-05-08T23:45:08.196 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-05-08T23:45:08.197 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-05-08T23:45:08.197 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-05-08T23:45:08.197 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-05-08T23:45:08.197 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-05-08T23:45:08.197 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-05-08T23:45:08.257 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-05-08T23:45:08.258 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-05-08T23:45:08.744 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-05-08T23:45:08.745 INFO:teuthology.orchestra.run.smithi026.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-05-08T23:45:08.746 INFO:teuthology.orchestra.run.smithi026.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T23:45:08.746 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:45:08.746 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:45:08.760 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-05-08T23:45:08.760 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:45:08.760 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:45:08.760 INFO:teuthology.orchestra.run.smithi135.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T23:45:08.761 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:45:08.762 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:45:09.036 DEBUG:teuthology.parallel:result is None 2024-05-08T23:45:09.093 DEBUG:teuthology.parallel:result is None 2024-05-08T23:45:09.094 INFO:teuthology.run_tasks:Running task install... 2024-05-08T23:45:09.103 DEBUG:teuthology.task.install:project ceph 2024-05-08T23:45:09.103 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T23:45:09.103 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T23:45:09.103 INFO:teuthology.task.install:Using flavor: default 2024-05-08T23:45:09.111 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T23:45:09.111 INFO:teuthology.task.install:extra packages: [] 2024-05-08T23:45:09.111 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T23:45:09.111 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:45:09.111 INFO:teuthology.packaging:ref: None 2024-05-08T23:45:09.111 INFO:teuthology.packaging:tag: None 2024-05-08T23:45:09.111 INFO:teuthology.packaging:branch: pacific 2024-05-08T23:45:09.111 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:45:09.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-05-08T23:45:09.113 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T23:45:09.113 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:45:09.114 INFO:teuthology.packaging:ref: None 2024-05-08T23:45:09.114 INFO:teuthology.packaging:tag: None 2024-05-08T23:45:09.114 INFO:teuthology.packaging:branch: pacific 2024-05-08T23:45:09.114 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:45:09.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-05-08T23:45:09.447 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/ 2024-05-08T23:45:09.447 INFO:teuthology.task.install.rpm:Package version is 16.2.15-0 2024-05-08T23:45:09.463 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/ 2024-05-08T23:45:09.464 INFO:teuthology.task.install.rpm:Package version is 16.2.15-0 2024-05-08T23:45:09.487 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T23:45:09.488 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:45:09.488 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T23:45:09.516 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/618f440892089921c3e944a991122ddc44e60516/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T23:45:09.517 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:45:09.517 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T23:45:09.518 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T23:45:09.518 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:45:09.518 INFO:teuthology.packaging:ref: None 2024-05-08T23:45:09.518 INFO:teuthology.packaging:tag: None 2024-05-08T23:45:09.519 INFO:teuthology.packaging:branch: pacific 2024-05-08T23:45:09.519 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:45:09.519 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T23:45:09.550 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T23:45:09.550 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:45:09.550 INFO:teuthology.packaging:ref: None 2024-05-08T23:45:09.550 INFO:teuthology.packaging:tag: None 2024-05-08T23:45:09.550 INFO:teuthology.packaging:branch: pacific 2024-05-08T23:45:09.550 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:45:09.550 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T23:45:09.587 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T23:45:09.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T23:45:09.664 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T23:45:09.700 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T23:45:09.730 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-05-08T23:45:09.731 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-05-08T23:45:09.768 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2024-05-08T23:45:09.769 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2024-05-08T23:45:10.002 INFO:teuthology.orchestra.run.smithi135.stdout:78 files removed 2024-05-08T23:45:10.030 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw 2024-05-08T23:45:10.048 INFO:teuthology.orchestra.run.smithi026.stdout:78 files removed 2024-05-08T23:45:10.077 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw 2024-05-08T23:45:10.576 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 558 kB/s | 76 kB 00:00 2024-05-08T23:45:10.577 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 1.0 MB/s | 76 kB 00:00 2024-05-08T23:45:10.701 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 176 kB/s | 15 kB 00:00 2024-05-08T23:45:10.736 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 129 kB/s | 15 kB 00:00 2024-05-08T23:45:10.837 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 25 kB/s | 1.7 kB 00:00 2024-05-08T23:45:10.852 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 14 kB/s | 1.7 kB 00:00 2024-05-08T23:45:12.046 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - AppStream 24 MB/s | 28 MB 00:01 2024-05-08T23:45:12.086 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - AppStream 23 MB/s | 28 MB 00:01 2024-05-08T23:45:18.388 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - BaseOS 9.5 MB/s | 10 MB 00:01 2024-05-08T23:45:18.530 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - BaseOS 9.1 MB/s | 10 MB 00:01 2024-05-08T23:45:20.413 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2024-05-08T23:45:20.572 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras 51 kB/s | 18 kB 00:00 2024-05-08T23:53:41.574 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - Extras common packages 16 B/s | 7.7 kB 08:21 2024-05-08T23:53:42.841 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 8 - PowerTools 4.2 MB/s | 5.0 MB 00:01 2024-05-08T23:53:43.968 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2024-05-08T23:53:45.385 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-05-08T23:53:49.185 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 254 kB/s | 24 kB 00:00 2024-05-08T23:53:52.846 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:16.2.15-0.el8 ceph 12 M 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:16.2.15-0.el8 ceph 4.2 M 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:53:52.849 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:16.2.15-0.el8 ceph 6.1 M 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:16.2.15-0.el8 ceph 24 M 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:16.2.15-0.el8 ceph 26 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:16.2.15-0.el8 ceph 825 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:16.2.15-0.el8 ceph 494 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:16.2.15-0.el8 ceph 3.8 M 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-05-08T23:53:52.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:16.2.15-0.el8 ceph 45 k 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:16.2.15-0.el8 ceph 99 k 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:16.2.15-0.el8 ceph 215 k 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:16.2.15-0.el8 ceph 389 k 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:16.2.15-0.el8 ceph 369 k 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:16.2.15-0.el8 ceph 114 k 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout:Install 21 Packages 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2024-05-08T23:53:52.851 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:53:52.852 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 58 M 2024-05-08T23:53:52.852 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:53:53.387 INFO:teuthology.orchestra.run.smithi135.stdout:(1/23): ceph-base-16.2.15-0.el8.x86_64.rpm 42 MB/s | 6.1 MB 00:00 2024-05-08T23:53:53.454 INFO:teuthology.orchestra.run.smithi135.stdout:(2/23): ceph-selinux-16.2.15-0.el8.x86_64.rpm 383 kB/s | 26 kB 00:00 2024-05-08T23:53:53.495 INFO:teuthology.orchestra.run.smithi135.stdout:(3/23): libcephfs2-16.2.15-0.el8.x86_64.rpm 20 MB/s | 825 kB 00:00 2024-05-08T23:53:53.537 INFO:teuthology.orchestra.run.smithi135.stdout:(4/23): libradosstriper1-16.2.15-0.el8.x86_64.r 12 MB/s | 494 kB 00:00 2024-05-08T23:53:53.629 INFO:teuthology.orchestra.run.smithi135.stdout:(5/23): librgw2-16.2.15-0.el8.x86_64.rpm 41 MB/s | 3.8 MB 00:00 2024-05-08T23:53:53.654 INFO:teuthology.orchestra.run.smithi135.stdout:(6/23): python3-ceph-argparse-16.2.15-0.el8.x86 1.8 MB/s | 45 kB 00:00 2024-05-08T23:53:53.680 INFO:teuthology.orchestra.run.smithi135.stdout:(7/23): python3-ceph-common-16.2.15-0.el8.x86_6 3.9 MB/s | 99 kB 00:00 2024-05-08T23:53:53.705 INFO:teuthology.orchestra.run.smithi135.stdout:(8/23): python3-cephfs-16.2.15-0.el8.x86_64.rpm 8.4 MB/s | 215 kB 00:00 2024-05-08T23:53:53.780 INFO:teuthology.orchestra.run.smithi135.stdout:(9/23): python3-rados-16.2.15-0.el8.x86_64.rpm 5.1 MB/s | 389 kB 00:00 2024-05-08T23:53:53.814 INFO:teuthology.orchestra.run.smithi135.stdout:(10/23): python3-rbd-16.2.15-0.el8.x86_64.rpm 11 MB/s | 369 kB 00:00 2024-05-08T23:53:53.839 INFO:teuthology.orchestra.run.smithi135.stdout:(11/23): python3-rgw-16.2.15-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2024-05-08T23:53:53.973 INFO:teuthology.orchestra.run.smithi135.stdout:(12/23): ceph-radosgw-16.2.15-0.el8.x86_64.rpm 16 MB/s | 12 MB 00:00 2024-05-08T23:53:54.274 INFO:teuthology.orchestra.run.smithi135.stdout:(13/23): ceph-common-16.2.15-0.el8.x86_64.rpm 24 MB/s | 24 MB 00:01 2024-05-08T23:53:54.316 INFO:teuthology.orchestra.run.smithi135.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 759 kB/s | 259 kB 00:00 2024-05-08T23:53:54.391 INFO:teuthology.orchestra.run.smithi135.stdout:(15/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.2 MB/s | 677 kB 00:00 2024-05-08T23:53:54.407 INFO:teuthology.orchestra.run.smithi135.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 329 kB/s | 44 kB 00:00 2024-05-08T23:53:54.517 INFO:teuthology.orchestra.run.smithi135.stdout:(17/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 234 kB/s | 47 kB 00:00 2024-05-08T23:53:54.825 INFO:teuthology.orchestra.run.smithi135.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 433 kB/s | 181 kB 00:00 2024-05-08T23:53:54.926 INFO:teuthology.orchestra.run.smithi135.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 573 kB/s | 306 kB 00:00 2024-05-08T23:53:55.001 INFO:teuthology.orchestra.run.smithi135.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 428 kB/s | 75 kB 00:00 2024-05-08T23:53:55.076 INFO:teuthology.orchestra.run.smithi135.stdout:(21/23): librados2-16.2.15-0.el8.x86_64.rpm 25 MB/s | 3.7 MB 00:00 2024-05-08T23:53:55.143 INFO:teuthology.orchestra.run.smithi135.stdout:(22/23): librbd1-16.2.15-0.el8.x86_64.rpm 29 MB/s | 4.2 MB 00:00 2024-05-08T23:53:55.768 INFO:teuthology.orchestra.run.smithi135.stdout:(23/23): liboath-2.6.2-3.el8.x86_64.rpm 47 kB/s | 59 kB 00:01 2024-05-08T23:53:55.773 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:53:55.773 INFO:teuthology.orchestra.run.smithi135.stdout:Total 20 MB/s | 58 MB 00:02 2024-05-08T23:53:55.817 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:53:55.865 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:53:55.865 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:53:56.237 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:53:56.240 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:53:57.291 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:53:57.524 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-05-08T23:53:57.749 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-05-08T23:53:58.142 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-05-08T23:53:58.401 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:16.2.15-0.el8.x86_64 3/25 2024-05-08T23:53:58.492 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.15-0.el8.x86_64 3/25 2024-05-08T23:53:58.776 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:16.2.15-0.el8.x86_64 4/25 2024-05-08T23:53:59.001 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-05-08T23:53:59.417 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-05-08T23:53:59.643 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:16.2.15-0.el8.x86_64 6/25 2024-05-08T23:53:59.707 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64 6/25 2024-05-08T23:53:59.894 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-05-08T23:53:59.916 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - Extras common packages 15 B/s | 7.7 kB 08:39 2024-05-08T23:54:00.384 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-05-08T23:54:00.593 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:16.2.15-0.el8.x86_64 9/25 2024-05-08T23:54:00.672 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64 9/25 2024-05-08T23:54:00.898 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-05-08T23:54:01.073 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 11/25 2024-05-08T23:54:01.183 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 8 - PowerTools 4.3 MB/s | 5.0 MB 00:01 2024-05-08T23:54:01.304 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:16.2.15-0.el8.x86_64 12/25 2024-05-08T23:54:01.543 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:16.2.15-0.el8.x86_64 13/25 2024-05-08T23:54:01.751 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:16.2.15-0.el8.x86_64 14/25 2024-05-08T23:54:01.909 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:16.2.15-0.el8.x86_64 15/25 2024-05-08T23:54:01.967 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64 15/25 2024-05-08T23:54:02.226 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-05-08T23:54:02.334 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-05-08T23:54:02.459 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-05-08T23:54:02.638 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-05-08T23:54:02.868 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:16.2.15-0.el8.x86_64 19/25 2024-05-08T23:54:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-05-08T23:54:05.676 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-05-08T23:54:06.389 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-05-08T23:54:06.750 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:16.2.15-0.el8.x86_64 21/25 2024-05-08T23:54:06.861 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64 21/25 2024-05-08T23:54:07.042 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:16.2.15-0.el8.x86_64 22/25 2024-05-08T23:54:12.884 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 1.6 MB/s | 16 MB 00:10 2024-05-08T23:54:16.900 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 376 kB/s | 24 kB 00:00 2024-05-08T23:54:20.831 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:54:20.833 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:54:20.833 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:16.2.15-0.el8 ceph 12 M 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:16.2.15-0.el8 ceph 4.2 M 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:16.2.15-0.el8 ceph 6.1 M 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:16.2.15-0.el8 ceph 24 M 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:16.2.15-0.el8 ceph 26 k 2024-05-08T23:54:20.834 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:16.2.15-0.el8 ceph 825 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:16.2.15-0.el8 ceph 494 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:16.2.15-0.el8 ceph 3.8 M 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:16.2.15-0.el8 ceph 45 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:16.2.15-0.el8 ceph 99 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:16.2.15-0.el8 ceph 215 k 2024-05-08T23:54:20.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:16.2.15-0.el8 ceph 389 k 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:16.2.15-0.el8 ceph 369 k 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:16.2.15-0.el8 ceph 114 k 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout:Install 21 Packages 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 2 Packages 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:54:20.836 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 58 M 2024-05-08T23:54:20.837 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:54:21.360 INFO:teuthology.orchestra.run.smithi026.stdout:(1/23): ceph-base-16.2.15-0.el8.x86_64.rpm 40 MB/s | 6.1 MB 00:00 2024-05-08T23:54:21.385 INFO:teuthology.orchestra.run.smithi026.stdout:(2/23): ceph-selinux-16.2.15-0.el8.x86_64.rpm 1.0 MB/s | 26 kB 00:00 2024-05-08T23:54:21.427 INFO:teuthology.orchestra.run.smithi026.stdout:(3/23): libcephfs2-16.2.15-0.el8.x86_64.rpm 19 MB/s | 825 kB 00:00 2024-05-08T23:54:21.461 INFO:teuthology.orchestra.run.smithi026.stdout:(4/23): libradosstriper1-16.2.15-0.el8.x86_64.r 15 MB/s | 494 kB 00:00 2024-05-08T23:54:21.553 INFO:teuthology.orchestra.run.smithi026.stdout:(5/23): librgw2-16.2.15-0.el8.x86_64.rpm 42 MB/s | 3.8 MB 00:00 2024-05-08T23:54:21.578 INFO:teuthology.orchestra.run.smithi026.stdout:(6/23): python3-ceph-argparse-16.2.15-0.el8.x86 1.8 MB/s | 45 kB 00:00 2024-05-08T23:54:21.603 INFO:teuthology.orchestra.run.smithi026.stdout:(7/23): python3-ceph-common-16.2.15-0.el8.x86_6 3.9 MB/s | 99 kB 00:00 2024-05-08T23:54:21.662 INFO:teuthology.orchestra.run.smithi026.stdout:(8/23): python3-cephfs-16.2.15-0.el8.x86_64.rpm 3.6 MB/s | 215 kB 00:00 2024-05-08T23:54:21.695 INFO:teuthology.orchestra.run.smithi026.stdout:(9/23): python3-rados-16.2.15-0.el8.x86_64.rpm 11 MB/s | 389 kB 00:00 2024-05-08T23:54:21.729 INFO:teuthology.orchestra.run.smithi026.stdout:(10/23): python3-rbd-16.2.15-0.el8.x86_64.rpm 11 MB/s | 369 kB 00:00 2024-05-08T23:54:21.846 INFO:teuthology.orchestra.run.smithi026.stdout:(11/23): ceph-radosgw-16.2.15-0.el8.x86_64.rpm 18 MB/s | 12 MB 00:00 2024-05-08T23:54:21.871 INFO:teuthology.orchestra.run.smithi026.stdout:(12/23): python3-rgw-16.2.15-0.el8.x86_64.rpm 806 kB/s | 114 kB 00:00 2024-05-08T23:54:22.155 INFO:teuthology.orchestra.run.smithi026.stdout:(13/23): ceph-common-16.2.15-0.el8.x86_64.rpm 26 MB/s | 24 MB 00:00 2024-05-08T23:54:22.181 INFO:teuthology.orchestra.run.smithi026.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 841 kB/s | 259 kB 00:00 2024-05-08T23:54:22.239 INFO:teuthology.orchestra.run.smithi026.stdout:(15/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.7 MB/s | 677 kB 00:00 2024-05-08T23:54:22.264 INFO:teuthology.orchestra.run.smithi026.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 404 kB/s | 44 kB 00:00 2024-05-08T23:54:22.356 INFO:teuthology.orchestra.run.smithi026.stdout:(17/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 268 kB/s | 47 kB 00:00 2024-05-08T23:54:22.398 INFO:teuthology.orchestra.run.smithi026.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 1.3 MB/s | 181 kB 00:00 2024-05-08T23:54:22.440 INFO:teuthology.orchestra.run.smithi026.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2024-05-08T23:54:22.466 INFO:teuthology.orchestra.run.smithi026.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2024-05-08T23:54:22.483 INFO:teuthology.orchestra.run.smithi026.stdout:(21/23): liboath-2.6.2-3.el8.x86_64.rpm 467 kB/s | 59 kB 00:00 2024-05-08T23:54:22.558 INFO:teuthology.orchestra.run.smithi026.stdout:(22/23): librados2-16.2.15-0.el8.x86_64.rpm 32 MB/s | 3.7 MB 00:00 2024-05-08T23:54:22.616 INFO:teuthology.orchestra.run.smithi026.stdout:(23/23): librbd1-16.2.15-0.el8.x86_64.rpm 28 MB/s | 4.2 MB 00:00 2024-05-08T23:54:22.618 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:54:22.619 INFO:teuthology.orchestra.run.smithi026.stdout:Total 32 MB/s | 58 MB 00:01 2024-05-08T23:54:22.663 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:54:22.715 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:54:22.715 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:54:23.082 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:54:23.085 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:54:24.109 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:54:24.311 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-05-08T23:54:24.478 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-05-08T23:54:24.906 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-05-08T23:54:25.111 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:16.2.15-0.el8.x86_64 3/25 2024-05-08T23:54:25.209 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.15-0.el8.x86_64 3/25 2024-05-08T23:54:25.434 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:16.2.15-0.el8.x86_64 4/25 2024-05-08T23:54:25.595 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-05-08T23:54:26.059 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-05-08T23:54:26.278 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:16.2.15-0.el8.x86_64 6/25 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64 22/25 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-05-08T23:54:26.320 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-05-08T23:54:26.321 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2024-05-08T23:54:26.321 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:26.347 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.15-0.el8.x86_64 6/25 2024-05-08T23:54:26.533 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-05-08T23:54:27.014 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-05-08T23:54:27.161 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:16.2.15-0.el8.x86_64 9/25 2024-05-08T23:54:27.228 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:16.2.15-0.el8.x86_64 9/25 2024-05-08T23:54:27.434 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-05-08T23:54:27.580 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:16.2.15-0.el8.x86_64 23/25 2024-05-08T23:54:27.601 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 11/25 2024-05-08T23:54:27.644 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64 23/25 2024-05-08T23:54:27.645 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-05-08T23:54:27.774 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:16.2.15-0.el8.x86_64 12/25 2024-05-08T23:54:27.891 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-05-08T23:54:27.891 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-05-08T23:54:27.965 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:16.2.15-0.el8.x86_64 13/25 2024-05-08T23:54:28.172 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:16.2.15-0.el8.x86_64 14/25 2024-05-08T23:54:28.303 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:16.2.15-0.el8.x86_64 15/25 2024-05-08T23:54:28.375 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:16.2.15-0.el8.x86_64 15/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:16.2.15-0.el8.x86_64 1/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:16.2.15-0.el8.x86_64 2/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:16.2.15-0.el8.x86_64 3/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:16.2.15-0.el8.x86_64 4/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:16.2.15-0.el8.x86_64 6/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:16.2.15-0.el8.x86_64 7/25 2024-05-08T23:54:28.602 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 8/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:16.2.15-0.el8.x86_64 9/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:16.2.15-0.el8.x86_64 10/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:16.2.15-0.el8.x86_64 11/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:16.2.15-0.el8.x86_64 12/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:16.2.15-0.el8.x86_64 13/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-05-08T23:54:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-05-08T23:54:28.604 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-05-08T23:54:28.604 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.15-0.el8.x86_64 22/25 2024-05-08T23:54:28.604 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-05-08T23:54:28.604 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.15-0.el8.x86_64 24/25 2024-05-08T23:54:28.625 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-05-08T23:54:28.796 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-05-08T23:54:28.971 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-05-08T23:54:29.195 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:16.2.15-0.el8.x86_64 19/25 2024-05-08T23:54:29.524 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-05-08T23:54:29.524 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:29.524 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-05-08T23:54:29.524 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:16.2.15-0.el8.x86_64 librbd1-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.524 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:54:29.524 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.524 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: leveldb-1.22-1.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.525 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.526 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.526 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T23:54:29.526 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.526 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.526 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:29.526 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:29.526 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:54:29.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-test 2024-05-08T23:54:30.604 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:41 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:54:31.866 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-05-08T23:54:32.136 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-05-08T23:54:32.269 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:16.2.15-0.el8 ceph 52 M 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:16.2.15-0.el8 ceph 174 k 2024-05-08T23:54:32.270 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-05-08T23:54:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-05-08T23:54:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-05-08T23:54:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:32.271 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:54:32.271 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:54:32.271 INFO:teuthology.orchestra.run.smithi135.stdout:Install 6 Packages 2024-05-08T23:54:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:32.271 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 53 M 2024-05-08T23:54:32.272 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 197 M 2024-05-08T23:54:32.272 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:54:32.394 INFO:teuthology.orchestra.run.smithi135.stdout:(1/6): libcephsqlite-16.2.15-0.el8.x86_64.rpm 2.7 MB/s | 174 kB 00:00 2024-05-08T23:54:32.470 INFO:teuthology.orchestra.run.smithi135.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 1.4 MB/s | 203 kB 00:00 2024-05-08T23:54:32.503 INFO:teuthology.orchestra.run.smithi135.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-08T23:54:32.529 INFO:teuthology.orchestra.run.smithi135.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-05-08T23:54:32.554 INFO:teuthology.orchestra.run.smithi135.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-05-08T23:54:32.893 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:16.2.15-0.el8.x86_64 20/25 2024-05-08T23:54:33.206 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:16.2.15-0.el8.x86_64 21/25 2024-05-08T23:54:33.221 INFO:teuthology.orchestra.run.smithi135.stdout:(6/6): ceph-test-16.2.15-0.el8.x86_64.rpm 59 MB/s | 52 MB 00:00 2024-05-08T23:54:33.223 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:54:33.223 INFO:teuthology.orchestra.run.smithi135.stdout:Total 56 MB/s | 53 MB 00:00 2024-05-08T23:54:33.264 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:54:33.285 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:54:33.285 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:54:33.311 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:16.2.15-0.el8.x86_64 21/25 2024-05-08T23:54:33.444 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:16.2.15-0.el8.x86_64 22/25 2024-05-08T23:54:33.591 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:54:33.594 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:54:34.116 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:54:34.340 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-05-08T23:54:34.549 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-05-08T23:54:34.754 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-05-08T23:54:34.834 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-05-08T23:54:35.061 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-05-08T23:54:35.229 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:16.2.15-0.el8.x86_64 5/6 2024-05-08T23:54:39.909 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64 5/6 2024-05-08T23:54:40.185 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:16.2.15-0.el8.x86_64 6/6 2024-05-08T23:54:40.525 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-test-2:16.2.15-0.el8.x86_64 6/6 2024-05-08T23:54:40.525 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:16.2.15-0.el8.x86_64 1/6 2024-05-08T23:54:40.525 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:16.2.15-0.el8.x86_64 2/6 2024-05-08T23:54:40.525 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-05-08T23:54:40.525 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-05-08T23:54:40.525 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-05-08T23:54:40.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-05-08T23:54:40.993 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:40.993 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:54:40.993 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:16.2.15-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-05-08T23:54:40.993 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:16.2.15-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-05-08T23:54:40.993 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T23:54:40.994 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:40.994 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:54:41.202 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph 2024-05-08T23:54:41.932 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:52 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:54:43.598 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:16.2.15-0.el8 ceph 6.3 k 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:16.2.15-0.el8 ceph 2.4 M 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:16.2.15-0.el8 ceph 1.6 M 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:16.2.15-0.el8 ceph-noarch 245 k 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:16.2.15-0.el8 ceph 5.2 M 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:16.2.15-0.el8 ceph 19 M 2024-05-08T23:54:43.602 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T23:54:43.603 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-05-08T23:54:43.604 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-05-08T23:54:43.604 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-05-08T23:54:43.604 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T23:54:43.604 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T23:54:43.604 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T23:54:43.604 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T23:54:43.604 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T23:54:43.606 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T23:54:43.606 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T23:54:43.606 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-05-08T23:54:43.606 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T23:54:43.606 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:43.606 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:54:43.606 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:54:43.607 INFO:teuthology.orchestra.run.smithi135.stdout:Install 32 Packages 2024-05-08T23:54:43.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:43.607 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 32 M 2024-05-08T23:54:43.607 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 104 M 2024-05-08T23:54:43.608 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:54:44.025 INFO:teuthology.orchestra.run.smithi135.stdout:(1/32): ceph-16.2.15-0.el8.x86_64.rpm 108 kB/s | 6.3 kB 00:00 2024-05-08T23:54:44.075 INFO:teuthology.orchestra.run.smithi135.stdout:(2/32): ceph-mgr-16.2.15-0.el8.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-08T23:54:44.125 INFO:teuthology.orchestra.run.smithi135.stdout:(3/32): ceph-mds-16.2.15-0.el8.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-05-08T23:54:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:(4/32): ceph-mgr-modules-core-16.2.15-0.el8.noa 7.2 MB/s | 245 kB 00:00 2024-05-08T23:54:44.276 INFO:teuthology.orchestra.run.smithi135.stdout:(5/32): ceph-mon-16.2.15-0.el8.x86_64.rpm 21 MB/s | 5.2 MB 00:00 2024-05-08T23:54:44.351 INFO:teuthology.orchestra.run.smithi135.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 519 kB/s | 39 kB 00:00 2024-05-08T23:54:44.376 INFO:teuthology.orchestra.run.smithi135.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 723 kB/s | 157 kB 00:00 2024-05-08T23:54:44.410 INFO:teuthology.orchestra.run.smithi135.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.7 MB/s | 103 kB 00:00 2024-05-08T23:54:44.427 INFO:teuthology.orchestra.run.smithi135.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2024-05-08T23:54:44.636 INFO:teuthology.orchestra.run.smithi135.stdout:(10/32): ceph-osd-16.2.15-0.el8.x86_64.rpm 33 MB/s | 19 MB 00:00 2024-05-08T23:54:44.661 INFO:teuthology.orchestra.run.smithi135.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.8 MB/s | 457 kB 00:00 2024-05-08T23:54:44.862 INFO:teuthology.orchestra.run.smithi135.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 545 kB/s | 109 kB 00:00 2024-05-08T23:54:44.928 INFO:teuthology.orchestra.run.smithi135.stdout:(13/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 497 kB/s | 249 kB 00:00 2024-05-08T23:54:44.971 INFO:teuthology.orchestra.run.smithi135.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 1.9 MB/s | 641 kB 00:00 2024-05-08T23:54:45.113 INFO:teuthology.orchestra.run.smithi135.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 174 kB/s | 44 kB 00:00 2024-05-08T23:54:45.172 INFO:teuthology.orchestra.run.smithi135.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 763 kB/s | 185 kB 00:00 2024-05-08T23:54:45.243 INFO:teuthology.orchestra.run.smithi135.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 635 kB/s | 173 kB 00:00 2024-05-08T23:54:45.280 INFO:teuthology.orchestra.run.smithi135.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-05-08T23:54:45.306 INFO:teuthology.orchestra.run.smithi135.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 283 kB/s | 18 kB 00:00 2024-05-08T23:54:45.331 INFO:teuthology.orchestra.run.smithi135.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.7 MB/s | 384 kB 00:00 2024-05-08T23:54:45.356 INFO:teuthology.orchestra.run.smithi135.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 646 kB/s | 49 kB 00:00 2024-05-08T23:54:45.373 INFO:teuthology.orchestra.run.smithi135.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 872 kB/s | 59 kB 00:00 2024-05-08T23:54:45.415 INFO:teuthology.orchestra.run.smithi135.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2024-05-08T23:54:45.432 INFO:teuthology.orchestra.run.smithi135.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2024-05-08T23:54:45.457 INFO:teuthology.orchestra.run.smithi135.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2024-05-08T23:54:45.483 INFO:teuthology.orchestra.run.smithi135.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 355 kB/s | 24 kB 00:00 2024-05-08T23:54:45.550 INFO:teuthology.orchestra.run.smithi135.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 249 kB/s | 29 kB 00:00 2024-05-08T23:54:45.583 INFO:teuthology.orchestra.run.smithi135.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 219 kB/s | 27 kB 00:00 2024-05-08T23:54:45.609 INFO:teuthology.orchestra.run.smithi135.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.0 MB/s | 255 kB 00:00 2024-05-08T23:54:45.642 INFO:teuthology.orchestra.run.smithi135.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.7 MB/s | 251 kB 00:00 2024-05-08T23:54:45.668 INFO:teuthology.orchestra.run.smithi135.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 392 kB/s | 23 kB 00:00 2024-05-08T23:54:45.693 INFO:teuthology.orchestra.run.smithi135.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 784 kB/s | 85 kB 00:00 2024-05-08T23:54:45.694 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:54:45.694 INFO:teuthology.orchestra.run.smithi135.stdout:Total 15 MB/s | 32 MB 00:02 2024-05-08T23:54:45.776 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:54:45.814 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:54:45.814 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:54:46.148 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:54:46.151 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:54:47.395 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:54:47.616 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-05-08T23:54:47.868 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-05-08T23:54:48.152 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-05-08T23:54:48.400 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-05-08T23:54:48.609 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-05-08T23:54:48.770 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-05-08T23:54:49.013 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-05-08T23:54:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-05-08T23:54:49.418 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-05-08T23:54:49.713 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-05-08T23:54:50.009 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-05-08T23:54:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-05-08T23:54:50.647 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-05-08T23:54:50.921 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-05-08T23:54:51.101 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-05-08T23:54:51.402 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-05-08T23:54:51.661 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-05-08T23:54:52.061 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-05-08T23:54:52.307 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-05-08T23:54:52.512 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-05-08T23:54:52.723 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-05-08T23:54:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-05-08T23:54:53.219 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-05-08T23:54:53.392 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:16.2.15-0.el8.x86_64 22/25 2024-05-08T23:54:53.392 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2024-05-08T23:54:53.392 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2024-05-08T23:54:53.392 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2024-05-08T23:54:53.392 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /run 2024-05-08T23:54:53.392 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2024-05-08T23:54:53.392 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2024-05-08T23:54:53.393 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2024-05-08T23:54:53.393 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2024-05-08T23:54:53.393 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2024-05-08T23:54:53.393 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:54:53.464 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-05-08T23:54:53.837 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-05-08T23:54:54.213 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-05-08T23:54:54.604 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 27/32 2024-05-08T23:54:54.678 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:16.2.15-0.el8.x86_64 23/25 2024-05-08T23:54:54.740 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-0.el8.x86_64 23/25 2024-05-08T23:54:54.740 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-05-08T23:54:54.868 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:16.2.15-0.el8.x86_64 28/32 2024-05-08T23:54:54.926 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-05-08T23:54:54.926 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-05-08T23:54:55.661 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:16.2.15-0.el8.x86_64 1/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:16.2.15-0.el8.x86_64 2/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:16.2.15-0.el8.x86_64 3/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:16.2.15-0.el8.x86_64 4/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:16.2.15-0.el8.x86_64 5/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:16.2.15-0.el8.x86_64 6/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:16.2.15-0.el8.x86_64 7/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:16.2.15-0.el8.x86_64 8/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:16.2.15-0.el8.x86_64 9/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:16.2.15-0.el8.x86_64 10/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:16.2.15-0.el8.x86_64 11/25 2024-05-08T23:54:55.662 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:16.2.15-0.el8.x86_64 12/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:16.2.15-0.el8.x86_64 13/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.15-0.el8.x86_64 22/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-05-08T23:54:55.663 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.15-0.el8.x86_64 24/25 2024-05-08T23:54:56.395 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64 28/32 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:16.2.15-0.el8.x86_64 librbd1-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T23:54:56.493 INFO:teuthology.orchestra.run.smithi026.stdout: leveldb-1.22-1.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.494 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.495 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:56.495 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:54:56.495 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:54:56.568 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:16.2.15-0.el8.x86_64 29/32 2024-05-08T23:54:56.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-test 2024-05-08T23:54:57.010 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64 29/32 2024-05-08T23:54:57.193 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:16.2.15-0.el8.x86_64 30/32 2024-05-08T23:54:57.409 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64 30/32 2024-05-08T23:54:57.533 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:41 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:54:57.660 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:16.2.15-0.el8.x86_64 31/32 2024-05-08T23:54:57.677 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64 31/32 2024-05-08T23:54:57.809 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:16.2.15-0.el8.x86_64 32/32 2024-05-08T23:54:58.249 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-2:16.2.15-0.el8.x86_64 32/32 2024-05-08T23:54:58.281 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:16.2.15-0.el8.x86_64 1/32 2024-05-08T23:54:58.281 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:16.2.15-0.el8.x86_64 2/32 2024-05-08T23:54:58.281 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:16.2.15-0.el8.x86_64 3/32 2024-05-08T23:54:58.281 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:16.2.15-0.el8.x86_64 4/32 2024-05-08T23:54:58.281 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:16.2.15-0.el8.x86_64 5/32 2024-05-08T23:54:58.282 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 6/32 2024-05-08T23:54:58.282 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-05-08T23:54:58.282 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-05-08T23:54:58.282 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-05-08T23:54:58.282 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-05-08T23:54:58.282 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-05-08T23:54:58.282 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-05-08T23:54:58.282 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-05-08T23:54:58.283 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-05-08T23:54:58.284 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-05-08T23:54:58.284 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-05-08T23:54:58.284 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-05-08T23:54:59.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-05-08T23:54:59.124 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:59.124 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:54:59.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:59.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:59.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:59.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 2024-05-08T23:54:59.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:16.2.15-0.el8.x86_64 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T23:54:59.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T23:54:59.126 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:54:59.127 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:54:59.301 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:54:59.302 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:16.2.15-0.el8 ceph 52 M 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:16.2.15-0.el8 ceph 174 k 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2024-05-08T23:54:59.303 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:54:59.304 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 53 M 2024-05-08T23:54:59.304 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 197 M 2024-05-08T23:54:59.304 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:54:59.438 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-base 2024-05-08T23:54:59.439 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): libcephsqlite-16.2.15-0.el8.x86_64.rpm 3.0 MB/s | 174 kB 00:00 2024-05-08T23:54:59.506 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 1.6 MB/s | 203 kB 00:00 2024-05-08T23:54:59.548 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-08T23:54:59.573 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2024-05-08T23:54:59.598 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-05-08T23:55:00.194 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:11 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:00.207 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): ceph-test-16.2.15-0.el8.x86_64.rpm 63 MB/s | 52 MB 00:00 2024-05-08T23:55:00.209 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:00.209 INFO:teuthology.orchestra.run.smithi026.stdout:Total 59 MB/s | 53 MB 00:00 2024-05-08T23:55:00.254 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:55:00.277 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:55:00.277 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:55:00.588 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:55:00.591 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:55:01.076 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:55:01.284 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-05-08T23:55:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-05-08T23:55:01.631 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-05-08T23:55:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-05-08T23:55:01.788 INFO:teuthology.orchestra.run.smithi135.stdout:Package ceph-base-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:55:01.839 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:01.839 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:55:01.839 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-05-08T23:55:01.959 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install cephadm 2024-05-08T23:55:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:16.2.15-0.el8.x86_64 5/6 2024-05-08T23:55:02.705 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:13 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:04.341 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:16.2.15-0.el8 ceph-noarch 85 k 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 85 k 2024-05-08T23:55:04.342 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 352 k 2024-05-08T23:55:04.343 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:55:04.395 INFO:teuthology.orchestra.run.smithi135.stdout:cephadm-16.2.15-0.el8.noarch.rpm 1.6 MB/s | 85 kB 00:00 2024-05-08T23:55:04.396 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:04.396 INFO:teuthology.orchestra.run.smithi135.stdout:Total 1.6 MB/s | 85 kB 00:00 2024-05-08T23:55:04.396 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:55:04.402 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:55:04.402 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:55:04.404 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:55:04.407 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:55:04.498 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:55:04.982 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:16.2.15-0.el8.noarch 1/1 2024-05-08T23:55:05.204 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:16.2.15-0.el8.noarch 1/1 2024-05-08T23:55:05.439 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:16.2.15-0.el8.noarch 1/1 2024-05-08T23:55:05.839 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:16.2.15-0.el8.noarch 1/1 2024-05-08T23:55:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:05.840 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:55:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:16.2.15-0.el8.noarch 2024-05-08T23:55:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:05.840 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:06.116 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T23:55:06.886 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:17 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:07.032 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:16.2.15-0.el8.x86_64 5/6 2024-05-08T23:55:07.295 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:16.2.15-0.el8.x86_64 6/6 2024-05-08T23:55:07.593 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-test-2:16.2.15-0.el8.x86_64 6/6 2024-05-08T23:55:07.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:16.2.15-0.el8.x86_64 1/6 2024-05-08T23:55:07.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:16.2.15-0.el8.x86_64 2/6 2024-05-08T23:55:07.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-05-08T23:55:07.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-05-08T23:55:07.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-05-08T23:55:08.019 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-05-08T23:55:08.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:08.020 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:55:08.020 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:16.2.15-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-05-08T23:55:08.020 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:16.2.15-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-05-08T23:55:08.020 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T23:55:08.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:08.020 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:55:08.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph 2024-05-08T23:55:08.554 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:08.555 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:08.555 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-05-08T23:55:08.555 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:08.555 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:55:08.555 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:16.2.15-0.el8 ceph 161 k 2024-05-08T23:55:08.555 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:08.555 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:55:08.556 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:08.556 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-08T23:55:08.556 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:08.556 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 161 k 2024-05-08T23:55:08.556 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 470 k 2024-05-08T23:55:08.556 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:55:08.617 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-immutable-object-cache-16.2.15-0.el8.x86_6 2.6 MB/s | 161 kB 00:00 2024-05-08T23:55:08.618 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:08.618 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.5 MB/s | 161 kB 00:00 2024-05-08T23:55:08.618 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:55:08.629 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:55:08.629 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:55:08.676 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:55:08.679 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:55:08.822 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:55:09.008 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:09.008 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:53 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:55:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:09.857 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:09.857 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:09.857 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:55:09.857 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 2024-05-08T23:55:09.857 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:09.857 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:10.080 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr 2024-05-08T23:55:10.789 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:16.2.15-0.el8 ceph 6.3 k 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:16.2.15-0.el8 ceph 2.4 M 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:16.2.15-0.el8 ceph 1.6 M 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:16.2.15-0.el8 ceph-noarch 245 k 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:16.2.15-0.el8 ceph 5.2 M 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:16.2.15-0.el8 ceph 19 M 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T23:55:10.793 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T23:55:10.794 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:10.795 INFO:teuthology.orchestra.run.smithi026.stdout:Install 32 Packages 2024-05-08T23:55:10.796 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:10.796 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 32 M 2024-05-08T23:55:10.796 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 104 M 2024-05-08T23:55:10.796 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:55:10.836 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:21 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:11.225 INFO:teuthology.orchestra.run.smithi026.stdout:(1/32): ceph-16.2.15-0.el8.x86_64.rpm 120 kB/s | 6.3 kB 00:00 2024-05-08T23:55:11.303 INFO:teuthology.orchestra.run.smithi026.stdout:(2/32): ceph-mgr-16.2.15-0.el8.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-08T23:55:11.368 INFO:teuthology.orchestra.run.smithi026.stdout:(3/32): ceph-mds-16.2.15-0.el8.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-05-08T23:55:11.393 INFO:teuthology.orchestra.run.smithi026.stdout:(4/32): ceph-mgr-modules-core-16.2.15-0.el8.noa 9.6 MB/s | 245 kB 00:00 2024-05-08T23:55:11.477 INFO:teuthology.orchestra.run.smithi026.stdout:(5/32): ceph-mon-16.2.15-0.el8.x86_64.rpm 21 MB/s | 5.2 MB 00:00 2024-05-08T23:55:11.504 INFO:teuthology.orchestra.run.smithi026.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2024-05-08T23:55:11.546 INFO:teuthology.orchestra.run.smithi026.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.4 MB/s | 103 kB 00:00 2024-05-08T23:55:11.572 INFO:teuthology.orchestra.run.smithi026.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 411 kB/s | 39 kB 00:00 2024-05-08T23:55:11.597 INFO:teuthology.orchestra.run.smithi026.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2024-05-08T23:55:11.664 INFO:teuthology.orchestra.run.smithi026.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 4.9 MB/s | 457 kB 00:00 2024-05-08T23:55:11.882 INFO:teuthology.orchestra.run.smithi026.stdout:(11/32): ceph-osd-16.2.15-0.el8.x86_64.rpm 32 MB/s | 19 MB 00:00 2024-05-08T23:55:11.948 INFO:teuthology.orchestra.run.smithi026.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 709 kB/s | 249 kB 00:00 2024-05-08T23:55:12.056 INFO:teuthology.orchestra.run.smithi026.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 403 kB/s | 44 kB 00:00 2024-05-08T23:55:12.107 INFO:teuthology.orchestra.run.smithi026.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 487 kB/s | 109 kB 00:00 2024-05-08T23:55:12.132 INFO:teuthology.orchestra.run.smithi026.stdout:(15/32): python3-cryptography-3.2.1-7.el8.x86_6 1.3 MB/s | 641 kB 00:00 2024-05-08T23:55:12.175 INFO:teuthology.orchestra.run.smithi026.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.5 MB/s | 185 kB 00:00 2024-05-08T23:55:12.224 INFO:teuthology.orchestra.run.smithi026.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2024-05-08T23:55:12.250 INFO:teuthology.orchestra.run.smithi026.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2024-05-08T23:55:12.275 INFO:teuthology.orchestra.run.smithi026.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 349 kB/s | 18 kB 00:00 2024-05-08T23:55:12.300 INFO:teuthology.orchestra.run.smithi026.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 972 kB/s | 49 kB 00:00 2024-05-08T23:55:12.325 INFO:teuthology.orchestra.run.smithi026.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2024-05-08T23:55:12.350 INFO:teuthology.orchestra.run.smithi026.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.7 MB/s | 384 kB 00:00 2024-05-08T23:55:12.376 INFO:teuthology.orchestra.run.smithi026.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2024-05-08T23:55:12.401 INFO:teuthology.orchestra.run.smithi026.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2024-05-08T23:55:12.435 INFO:teuthology.orchestra.run.smithi135.stdout:Package ceph-mgr-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:55:12.455 INFO:teuthology.orchestra.run.smithi026.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 180 kB/s | 19 kB 00:00 2024-05-08T23:55:12.484 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:12.485 INFO:teuthology.orchestra.run.smithi026.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 220 kB/s | 24 kB 00:00 2024-05-08T23:55:12.485 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:55:12.485 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:12.510 INFO:teuthology.orchestra.run.smithi026.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 268 kB/s | 29 kB 00:00 2024-05-08T23:55:12.536 INFO:teuthology.orchestra.run.smithi026.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 342 kB/s | 27 kB 00:00 2024-05-08T23:55:12.561 INFO:teuthology.orchestra.run.smithi026.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2024-05-08T23:55:12.594 INFO:teuthology.orchestra.run.smithi026.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2024-05-08T23:55:12.628 INFO:teuthology.orchestra.run.smithi026.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 344 kB/s | 23 kB 00:00 2024-05-08T23:55:12.653 INFO:teuthology.orchestra.run.smithi026.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.7 MB/s | 251 kB 00:00 2024-05-08T23:55:12.655 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:12.655 INFO:teuthology.orchestra.run.smithi026.stdout:Total 17 MB/s | 32 MB 00:01 2024-05-08T23:55:12.740 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:55:12.782 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:55:12.783 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:55:12.819 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T23:55:13.119 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:55:13.122 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:55:13.578 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:24 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:14.260 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:55:14.471 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-05-08T23:55:14.687 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-05-08T23:55:14.992 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-05-08T23:55:15.202 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-05-08T23:55:15.225 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:15.226 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:15.226 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:55:15.226 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:16.2.15-0.el8 ceph-noarch 3.1 M 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:16.2.15-0.el8 ceph-noarch 24 k 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:16.2.15-0.el8 ceph-noarch 15 k 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout:Install 6 Packages 2024-05-08T23:55:15.227 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 3.4 M 2024-05-08T23:55:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 22 M 2024-05-08T23:55:15.228 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:55:15.417 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-05-08T23:55:15.512 INFO:teuthology.orchestra.run.smithi135.stdout:(1/6): ceph-grafana-dashboards-16.2.15-0.el8.no 435 kB/s | 24 kB 00:00 2024-05-08T23:55:15.529 INFO:teuthology.orchestra.run.smithi135.stdout:(2/6): ceph-prometheus-alerts-16.2.15-0.el8.noa 203 kB/s | 15 kB 00:00 2024-05-08T23:55:15.574 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-05-08T23:55:15.596 INFO:teuthology.orchestra.run.smithi135.stdout:(3/6): ceph-mgr-dashboard-16.2.15-0.el8.noarch. 22 MB/s | 3.1 MB 00:00 2024-05-08T23:55:15.705 INFO:teuthology.orchestra.run.smithi135.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 222 kB/s | 43 kB 00:00 2024-05-08T23:55:15.757 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-05-08T23:55:15.763 INFO:teuthology.orchestra.run.smithi135.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 144 kB/s | 34 kB 00:00 2024-05-08T23:55:15.880 INFO:teuthology.orchestra.run.smithi135.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 693 kB/s | 196 kB 00:00 2024-05-08T23:55:15.882 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:15.882 INFO:teuthology.orchestra.run.smithi135.stdout:Total 5.2 MB/s | 3.4 MB 00:00 2024-05-08T23:55:15.892 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:55:15.902 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:55:15.902 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:55:15.960 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-05-08T23:55:16.052 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:55:16.055 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:55:16.163 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-05-08T23:55:16.357 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:55:16.399 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-05-08T23:55:16.571 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-05-08T23:55:16.662 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-05-08T23:55:16.858 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-05-08T23:55:16.887 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-05-08T23:55:17.109 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-05-08T23:55:17.222 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 4/6 2024-05-08T23:55:17.288 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-05-08T23:55:17.515 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-05-08T23:55:17.720 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-05-08T23:55:17.974 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-05-08T23:55:18.172 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-05-08T23:55:18.292 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 5/6 2024-05-08T23:55:18.540 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-05-08T23:55:18.640 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 6/6 2024-05-08T23:55:18.735 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-05-08T23:55:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 6/6 2024-05-08T23:55:18.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 1/6 2024-05-08T23:55:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2/6 2024-05-08T23:55:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 3/6 2024-05-08T23:55:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-05-08T23:55:18.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-05-08T23:55:19.049 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-05-08T23:55:19.184 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-05-08T23:55:19.348 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-05-08T23:55:19.348 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:19.348 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:55:19.348 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 2024-05-08T23:55:19.348 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2024-05-08T23:55:19.348 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 2024-05-08T23:55:19.348 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T23:55:19.348 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T23:55:19.349 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T23:55:19.349 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:19.349 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:19.473 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T23:55:19.489 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-05-08T23:55:19.680 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-05-08T23:55:19.913 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-05-08T23:55:20.220 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:31 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:20.264 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-05-08T23:55:20.621 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-05-08T23:55:20.977 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 27/32 2024-05-08T23:55:21.206 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:16.2.15-0.el8.x86_64 28/32 2024-05-08T23:55:21.879 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.15-0.el8 ceph-noarch 8.6 M 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:21.882 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:55:21.882 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================ 2024-05-08T23:55:21.882 INFO:teuthology.orchestra.run.smithi135.stdout:Install 8 Packages 2024-05-08T23:55:21.882 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:21.882 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 37 M 2024-05-08T23:55:21.882 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 210 M 2024-05-08T23:55:21.882 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:55:22.163 INFO:teuthology.orchestra.run.smithi135.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.15-0. 53 MB/s | 8.6 MB 00:00 2024-05-08T23:55:22.363 INFO:teuthology.orchestra.run.smithi135.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2024-05-08T23:55:22.438 INFO:teuthology.orchestra.run.smithi135.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.9 MB 00:00 2024-05-08T23:55:22.463 INFO:teuthology.orchestra.run.smithi135.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.2 MB/s | 225 kB 00:00 2024-05-08T23:55:22.572 INFO:teuthology.orchestra.run.smithi135.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 9.1 MB/s | 3.7 MB 00:00 2024-05-08T23:55:22.820 INFO:teuthology.orchestra.run.smithi135.stdout:(6/8): libquadmath-8.5.0-22.el8.x86_64.rpm 699 kB/s | 172 kB 00:00 2024-05-08T23:55:22.829 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:16.2.15-0.el8.x86_64 28/32 2024-05-08T23:55:22.864 INFO:teuthology.orchestra.run.smithi135.stdout:(7/8): libgfortran-8.5.0-22.el8.x86_64.rpm 1.6 MB/s | 645 kB 00:00 2024-05-08T23:55:22.994 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:16.2.15-0.el8.x86_64 29/32 2024-05-08T23:55:23.248 INFO:teuthology.orchestra.run.smithi135.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 18 MB/s | 14 MB 00:00 2024-05-08T23:55:23.248 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:23.249 INFO:teuthology.orchestra.run.smithi135.stdout:Total 27 MB/s | 37 MB 00:01 2024-05-08T23:55:23.465 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:16.2.15-0.el8.x86_64 29/32 2024-05-08T23:55:23.480 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:55:23.498 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:55:23.499 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:55:23.644 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:16.2.15-0.el8.x86_64 30/32 2024-05-08T23:55:23.854 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:55:23.857 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:55:23.874 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:16.2.15-0.el8.x86_64 30/32 2024-05-08T23:55:24.111 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:16.2.15-0.el8.x86_64 31/32 2024-05-08T23:55:24.130 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:16.2.15-0.el8.x86_64 31/32 2024-05-08T23:55:24.261 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:16.2.15-0.el8.x86_64 32/32 2024-05-08T23:55:24.695 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-2:16.2.15-0.el8.x86_64 32/32 2024-05-08T23:55:24.695 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:16.2.15-0.el8.x86_64 1/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:16.2.15-0.el8.x86_64 2/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:16.2.15-0.el8.x86_64 3/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:16.2.15-0.el8.x86_64 4/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:16.2.15-0.el8.x86_64 5/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 6/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-05-08T23:55:24.696 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-05-08T23:55:24.697 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-05-08T23:55:24.698 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-05-08T23:55:25.308 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:55:25.455 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 1/8 2024-05-08T23:55:25.618 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 1/8 2024-05-08T23:55:25.644 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-05-08T23:55:25.644 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:25.644 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:16.2.15-0.el8.x86_64 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:16.2.15-0.el8.x86_64 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:16.2.15-0.el8.x86_64 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:16.2.15-0.el8.noarch 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:16.2.15-0.el8.x86_64 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:16.2.15-0.el8.x86_64 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T23:55:25.645 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T23:55:25.646 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T23:55:25.647 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T23:55:25.647 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T23:55:25.647 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T23:55:25.647 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T23:55:25.647 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:25.647 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:55:25.772 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 2/8 2024-05-08T23:55:25.939 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-base 2024-05-08T23:55:26.395 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 2/8 2024-05-08T23:55:26.613 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-05-08T23:55:26.724 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:10 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:55:27.208 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-05-08T23:55:27.386 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-05-08T23:55:28.099 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-05-08T23:55:28.443 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-base-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:55:28.458 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-05-08T23:55:28.496 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:55:28.498 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:55:28.498 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:55:28.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install cephadm 2024-05-08T23:55:28.755 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-05-08T23:55:29.467 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:13 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:55:30.498 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-05-08T23:55:31.229 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:55:31.229 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:31.229 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:55:31.229 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:31.229 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:55:31.230 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:16.2.15-0.el8 ceph-noarch 85 k 2024-05-08T23:55:31.230 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:31.230 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:55:31.230 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:31.230 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-05-08T23:55:31.230 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:31.230 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 85 k 2024-05-08T23:55:31.231 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 352 k 2024-05-08T23:55:31.231 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:55:31.271 INFO:teuthology.orchestra.run.smithi026.stdout:cephadm-16.2.15-0.el8.noarch.rpm 2.1 MB/s | 85 kB 00:00 2024-05-08T23:55:31.271 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:31.271 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.0 MB/s | 85 kB 00:00 2024-05-08T23:55:31.271 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:55:31.279 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:55:31.279 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:55:31.281 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:55:31.284 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:55:31.328 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:55:31.853 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:16.2.15-0.el8.noarch 1/1 2024-05-08T23:55:31.951 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-05-08T23:55:32.060 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:16.2.15-0.el8.noarch 1/1 2024-05-08T23:55:32.204 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 8/8 2024-05-08T23:55:32.295 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:16.2.15-0.el8.noarch 1/1 2024-05-08T23:55:32.516 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 8/8 2024-05-08T23:55:32.517 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 1/8 2024-05-08T23:55:32.517 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-05-08T23:55:32.517 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-05-08T23:55:32.517 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-05-08T23:55:32.517 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-05-08T23:55:32.517 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-05-08T23:55:32.517 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 7/8 2024-05-08T23:55:32.723 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:16.2.15-0.el8.noarch 1/1 2024-05-08T23:55:32.723 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:32.723 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:55:32.723 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:16.2.15-0.el8.noarch 2024-05-08T23:55:32.723 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:32.723 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:55:32.931 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 8/8 2024-05-08T23:55:32.931 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:32.931 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.15-4.el8.x86_64 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:32.932 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:32.948 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T23:55:33.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-rook 2024-05-08T23:55:33.734 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:17 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:55:33.849 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:44 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:35.491 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:35.493 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:55:35.493 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:35.493 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:55:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:16.2.15-0.el8 ceph-noarch 27 k 2024-05-08T23:55:35.493 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:55:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T23:55:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:35.494 INFO:teuthology.orchestra.run.smithi135.stdout:Install 13 Packages 2024-05-08T23:55:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:35.495 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 1.9 M 2024-05-08T23:55:35.495 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 24 M 2024-05-08T23:55:35.495 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:55:35.502 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:16.2.15-0.el8 ceph 161 k 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-05-08T23:55:35.503 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:35.504 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 161 k 2024-05-08T23:55:35.504 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 470 k 2024-05-08T23:55:35.504 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:55:35.576 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-immutable-object-cache-16.2.15-0.el8.x86_6 2.2 MB/s | 161 kB 00:00 2024-05-08T23:55:35.577 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:35.577 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.1 MB/s | 161 kB 00:00 2024-05-08T23:55:35.577 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:55:35.589 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:55:35.589 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:55:35.640 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:55:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:55:35.682 INFO:teuthology.orchestra.run.smithi135.stdout:(1/13): ceph-mgr-rook-16.2.15-0.el8.noarch.rpm 750 kB/s | 27 kB 00:00 2024-05-08T23:55:35.750 INFO:teuthology.orchestra.run.smithi135.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 257 kB/s | 27 kB 00:00 2024-05-08T23:55:35.765 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:55:35.775 INFO:teuthology.orchestra.run.smithi135.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 155 kB/s | 20 kB 00:00 2024-05-08T23:55:35.792 INFO:teuthology.orchestra.run.smithi135.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2024-05-08T23:55:35.817 INFO:teuthology.orchestra.run.smithi135.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.6 MB/s | 110 kB 00:00 2024-05-08T23:55:35.942 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:35.943 INFO:teuthology.orchestra.run.smithi135.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 283 kB/s | 43 kB 00:00 2024-05-08T23:55:36.042 INFO:teuthology.orchestra.run.smithi135.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 581 kB/s | 155 kB 00:00 2024-05-08T23:55:36.185 INFO:teuthology.orchestra.run.smithi135.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 90 kB/s | 33 kB 00:00 2024-05-08T23:55:36.302 INFO:teuthology.orchestra.run.smithi135.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 45 kB/s | 16 kB 00:00 2024-05-08T23:55:36.364 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:36.486 INFO:teuthology.orchestra.run.smithi135.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 185 kB/s | 81 kB 00:00 2024-05-08T23:55:36.511 INFO:teuthology.orchestra.run.smithi135.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 308 kB/s | 64 kB 00:00 2024-05-08T23:55:36.655 INFO:teuthology.orchestra.run.smithi135.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 362 kB/s | 61 kB 00:00 2024-05-08T23:55:36.695 INFO:teuthology.orchestra.run.smithi135.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.3 MB/s | 1.2 MB 00:00 2024-05-08T23:55:36.697 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:36.697 INFO:teuthology.orchestra.run.smithi135.stdout:Total 1.6 MB/s | 1.9 MB 00:01 2024-05-08T23:55:36.750 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:55:36.765 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:55:36.765 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:55:36.814 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:36.815 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:36.815 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:55:36.815 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:16.2.15-0.el8.x86_64 2024-05-08T23:55:36.815 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:36.815 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:55:36.851 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:55:36.854 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:55:37.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr 2024-05-08T23:55:37.437 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:55:37.698 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-05-08T23:55:37.810 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:21 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:55:37.869 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-05-08T23:55:38.139 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-05-08T23:55:38.376 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-05-08T23:55:38.634 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-05-08T23:55:38.899 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-05-08T23:55:39.244 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-05-08T23:55:39.522 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-mgr-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:55:39.526 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-05-08T23:55:39.574 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:55:39.575 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:55:39.576 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:55:39.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T23:55:40.474 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:24 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:55:40.586 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-05-08T23:55:40.901 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-05-08T23:55:41.202 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-05-08T23:55:41.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-05-08T23:55:41.611 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:16.2.15-0.el8.noarch 13/13 2024-05-08T23:55:41.903 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-0.el8.noarch 13/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:16.2.15-0.el8.noarch 1/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-05-08T23:55:41.904 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-05-08T23:55:42.259 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:55:42.260 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:42.260 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-05-08T23:55:42.260 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:42.260 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:55:42.260 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:16.2.15-0.el8 ceph-noarch 3.1 M 2024-05-08T23:55:42.260 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:55:42.260 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:16.2.15-0.el8 ceph-noarch 24 k 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:16.2.15-0.el8 ceph-noarch 15 k 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2024-05-08T23:55:42.261 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:42.262 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 3.4 M 2024-05-08T23:55:42.262 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 22 M 2024-05-08T23:55:42.262 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:55:42.397 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-05-08T23:55:42.397 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:42.397 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:55:42.397 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:16.2.15-0.el8.noarch 2024-05-08T23:55:42.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T23:55:42.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:42.398 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:42.423 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): ceph-grafana-dashboards-16.2.15-0.el8.no 630 kB/s | 24 kB 00:00 2024-05-08T23:55:42.447 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): ceph-prometheus-alerts-16.2.15-0.el8.noa 232 kB/s | 15 kB 00:00 2024-05-08T23:55:42.531 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): ceph-mgr-dashboard-16.2.15-0.el8.noarch. 21 MB/s | 3.1 MB 00:00 2024-05-08T23:55:42.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T23:55:42.648 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 168 kB/s | 34 kB 00:00 2024-05-08T23:55:42.673 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 170 kB/s | 43 kB 00:00 2024-05-08T23:55:42.731 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 981 kB/s | 196 kB 00:00 2024-05-08T23:55:42.733 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:42.734 INFO:teuthology.orchestra.run.smithi026.stdout:Total 7.3 MB/s | 3.4 MB 00:00 2024-05-08T23:55:42.744 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:55:42.754 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:55:42.754 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:55:42.911 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:55:42.914 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:55:43.184 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:55:43.288 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:54 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:43.374 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-05-08T23:55:43.618 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-05-08T23:55:43.835 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-05-08T23:55:43.957 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 4/6 2024-05-08T23:55:44.944 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:16.2.15-0.el8 ceph-noarch 116 k 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-05-08T23:55:44.945 INFO:teuthology.orchestra.run.smithi135.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-05-08T23:55:44.946 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-05-08T23:55:44.946 INFO:teuthology.orchestra.run.smithi135.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-05-08T23:55:44.946 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:44.946 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:55:44.946 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:44.946 INFO:teuthology.orchestra.run.smithi135.stdout:Install 6 Packages 2024-05-08T23:55:44.946 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:44.946 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 5.9 M 2024-05-08T23:55:44.947 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 24 M 2024-05-08T23:55:44.947 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:55:45.056 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 5/6 2024-05-08T23:55:45.112 INFO:teuthology.orchestra.run.smithi135.stdout:(1/6): ceph-mgr-cephadm-16.2.15-0.el8.noarch.rp 2.2 MB/s | 116 kB 00:00 2024-05-08T23:55:45.246 INFO:teuthology.orchestra.run.smithi135.stdout:(2/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 3.1 MB/s | 578 kB 00:00 2024-05-08T23:55:45.310 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 6/6 2024-05-08T23:55:45.323 INFO:teuthology.orchestra.run.smithi135.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 100 kB/s | 21 kB 00:00 2024-05-08T23:55:45.413 INFO:teuthology.orchestra.run.smithi135.stdout:(4/6): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2024-05-08T23:55:45.438 INFO:teuthology.orchestra.run.smithi135.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 444 kB/s | 49 kB 00:00 2024-05-08T23:55:45.593 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 6/6 2024-05-08T23:55:45.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 1/6 2024-05-08T23:55:45.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2/6 2024-05-08T23:55:45.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 3/6 2024-05-08T23:55:45.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-05-08T23:55:45.593 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-05-08T23:55:45.655 INFO:teuthology.orchestra.run.smithi135.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 869 kB/s | 355 kB 00:00 2024-05-08T23:55:45.656 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:45.657 INFO:teuthology.orchestra.run.smithi135.stdout:Total 8.3 MB/s | 5.9 MB 00:00 2024-05-08T23:55:45.708 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:55:45.717 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:55:45.717 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:55:45.827 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:55:45.831 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:55:46.006 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-05-08T23:55:46.006 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:46.006 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:55:46.006 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:16.2.15-0.el8.noarch 2024-05-08T23:55:46.006 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:16.2.15-0.el8.noarch 2024-05-08T23:55:46.007 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:16.2.15-0.el8.noarch 2024-05-08T23:55:46.007 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T23:55:46.007 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T23:55:46.007 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T23:55:46.007 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:46.007 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:55:46.145 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:55:46.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T23:55:46.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-05-08T23:55:46.754 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-05-08T23:55:47.036 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:31 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:55:47.711 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-05-08T23:55:48.088 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-05-08T23:55:48.360 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-05-08T23:55:48.593 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 6/6 2024-05-08T23:55:48.805 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:55:48.806 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================ 2024-05-08T23:55:48.806 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-05-08T23:55:48.806 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================ 2024-05-08T23:55:48.806 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:55:48.806 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.15-0.el8 ceph-noarch 8.6 M 2024-05-08T23:55:48.807 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:55:48.807 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-05-08T23:55:48.807 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-05-08T23:55:48.807 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-05-08T23:55:48.807 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-05-08T23:55:48.807 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-05-08T23:55:48.807 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-05-08T23:55:48.808 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-05-08T23:55:48.808 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:48.808 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:55:48.808 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================ 2024-05-08T23:55:48.808 INFO:teuthology.orchestra.run.smithi026.stdout:Install 8 Packages 2024-05-08T23:55:48.808 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:48.808 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 37 M 2024-05-08T23:55:48.809 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 210 M 2024-05-08T23:55:48.809 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:55:48.879 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 6/6 2024-05-08T23:55:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 1/6 2024-05-08T23:55:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-05-08T23:55:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-05-08T23:55:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-05-08T23:55:48.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-05-08T23:55:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-05-08T23:55:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:49.279 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:55:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:16.2.15-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2024-05-08T23:55:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2024-05-08T23:55:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-4.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2024-05-08T23:55:49.279 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:49.279 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:49.345 INFO:teuthology.orchestra.run.smithi026.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.15-0. 54 MB/s | 8.6 MB 00:00 2024-05-08T23:55:49.457 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-fuse 2024-05-08T23:55:49.528 INFO:teuthology.orchestra.run.smithi026.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-05-08T23:55:49.587 INFO:teuthology.orchestra.run.smithi026.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2024-05-08T23:55:49.612 INFO:teuthology.orchestra.run.smithi026.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.6 MB/s | 225 kB 00:00 2024-05-08T23:55:49.721 INFO:teuthology.orchestra.run.smithi026.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 9.9 MB/s | 3.7 MB 00:00 2024-05-08T23:55:49.896 INFO:teuthology.orchestra.run.smithi026.stdout:(6/8): libgfortran-8.5.0-22.el8.x86_64.rpm 2.2 MB/s | 645 kB 00:00 2024-05-08T23:55:50.071 INFO:teuthology.orchestra.run.smithi026.stdout:(7/8): python3-scipy-1.0.0-21.module_el8+762+77 29 MB/s | 14 MB 00:00 2024-05-08T23:55:50.097 INFO:teuthology.orchestra.run.smithi026.stdout:(8/8): libquadmath-8.5.0-22.el8.x86_64.rpm 459 kB/s | 172 kB 00:00 2024-05-08T23:55:50.097 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:50.097 INFO:teuthology.orchestra.run.smithi026.stdout:Total 29 MB/s | 37 MB 00:01 2024-05-08T23:55:50.210 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:01 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:50.336 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:55:50.354 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:55:50.354 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:55:50.701 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:55:50.703 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:55:51.341 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:55:51.623 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 1/8 2024-05-08T23:55:51.746 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 1/8 2024-05-08T23:55:51.856 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:51.856 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:51.856 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:55:51.856 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:51.856 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:55:51.856 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:16.2.15-0.el8 ceph 911 k 2024-05-08T23:55:51.857 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T23:55:51.857 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-05-08T23:55:51.857 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:51.857 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:55:51.857 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:51.857 INFO:teuthology.orchestra.run.smithi135.stdout:Install 2 Packages 2024-05-08T23:55:51.857 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:51.857 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 994 k 2024-05-08T23:55:51.858 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 2.8 M 2024-05-08T23:55:51.858 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:55:51.914 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 2/8 2024-05-08T23:55:51.975 INFO:teuthology.orchestra.run.smithi135.stdout:(1/2): ceph-fuse-16.2.15-0.el8.x86_64.rpm 15 MB/s | 911 kB 00:00 2024-05-08T23:55:52.167 INFO:teuthology.orchestra.run.smithi135.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 332 kB/s | 83 kB 00:00 2024-05-08T23:55:52.167 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:52.168 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.1 MB/s | 994 kB 00:00 2024-05-08T23:55:52.178 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:55:52.198 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:55:52.199 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:55:52.285 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:55:52.287 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:55:52.450 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:55:52.531 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 2/8 2024-05-08T23:55:52.689 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-05-08T23:55:52.708 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-05-08T23:55:52.918 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:16.2.15-0.el8.x86_64 2/2 2024-05-08T23:55:53.312 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-fuse-2:16.2.15-0.el8.x86_64 2/2 2024-05-08T23:55:53.312 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:16.2.15-0.el8.x86_64 1/2 2024-05-08T23:55:53.326 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-05-08T23:55:53.497 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:16.2.15-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:53.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librados-devel 2024-05-08T23:55:54.227 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-05-08T23:55:54.565 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-05-08T23:55:54.737 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:05 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:54.822 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-05-08T23:55:56.381 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:55:56.382 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:56.382 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:55:56.382 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:56.383 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:55:56.383 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:16.2.15-0.el8 ceph 131 k 2024-05-08T23:55:56.383 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:56.383 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:55:56.383 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:55:56.383 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-08T23:55:56.384 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:56.384 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 131 k 2024-05-08T23:55:56.384 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 432 k 2024-05-08T23:55:56.384 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:55:56.455 INFO:teuthology.orchestra.run.smithi135.stdout:librados-devel-16.2.15-0.el8.x86_64.rpm 1.8 MB/s | 131 kB 00:00 2024-05-08T23:55:56.456 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:56.456 INFO:teuthology.orchestra.run.smithi135.stdout:Total 1.7 MB/s | 131 kB 00:00 2024-05-08T23:55:56.456 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:55:56.462 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:55:56.462 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:55:56.512 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:55:56.515 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:55:56.703 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:55:57.808 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:58.160 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:58.659 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:55:58.659 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:55:58.659 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:16.2.15-0.el8.x86_64 2024-05-08T23:55:58.659 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:55:58.659 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:55:58.660 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-05-08T23:55:58.830 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 8/8 2024-05-08T23:55:58.889 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs2 2024-05-08T23:55:59.171 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 8/8 2024-05-08T23:55:59.171 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 1/8 2024-05-08T23:55:59.171 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-05-08T23:55:59.172 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-05-08T23:55:59.172 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-05-08T23:55:59.172 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-05-08T23:55:59.172 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-05-08T23:55:59.172 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 7/8 2024-05-08T23:55:59.631 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 8/8 2024-05-08T23:55:59.631 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:59.631 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:16.2.15-0.el8.noarch 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.15-4.el8.x86_64 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:55:59.632 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:55:59.653 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:10 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:55:59.757 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-rook 2024-05-08T23:56:00.553 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:44 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:01.242 INFO:teuthology.orchestra.run.smithi135.stdout:Package libcephfs2-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:01.291 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:01.292 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:56:01.292 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:01.410 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs-devel 2024-05-08T23:56:02.168 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:13 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:02.351 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:16.2.15-0.el8 ceph-noarch 27 k 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-05-08T23:56:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout:Install 13 Packages 2024-05-08T23:56:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:02.355 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 1.9 M 2024-05-08T23:56:02.355 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 24 M 2024-05-08T23:56:02.355 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:56:02.813 INFO:teuthology.orchestra.run.smithi026.stdout:(1/13): ceph-mgr-rook-16.2.15-0.el8.noarch.rpm 786 kB/s | 27 kB 00:00 2024-05-08T23:56:02.872 INFO:teuthology.orchestra.run.smithi026.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 284 kB/s | 27 kB 00:00 2024-05-08T23:56:02.897 INFO:teuthology.orchestra.run.smithi026.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 168 kB/s | 20 kB 00:00 2024-05-08T23:56:02.922 INFO:teuthology.orchestra.run.smithi026.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2024-05-08T23:56:02.973 INFO:teuthology.orchestra.run.smithi026.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.4 MB/s | 110 kB 00:00 2024-05-08T23:56:03.098 INFO:teuthology.orchestra.run.smithi026.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 243 kB/s | 43 kB 00:00 2024-05-08T23:56:03.123 INFO:teuthology.orchestra.run.smithi026.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 219 kB/s | 33 kB 00:00 2024-05-08T23:56:03.165 INFO:teuthology.orchestra.run.smithi026.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 578 kB/s | 155 kB 00:00 2024-05-08T23:56:03.207 INFO:teuthology.orchestra.run.smithi026.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 1.0 MB/s | 81 kB 00:00 2024-05-08T23:56:03.316 INFO:teuthology.orchestra.run.smithi026.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 621 kB/s | 64 kB 00:00 2024-05-08T23:56:03.350 INFO:teuthology.orchestra.run.smithi026.stdout:(11/13): python3-certifi-2018.10.15-7.el8.noarc 65 kB/s | 16 kB 00:00 2024-05-08T23:56:03.383 INFO:teuthology.orchestra.run.smithi026.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 913 kB/s | 61 kB 00:00 2024-05-08T23:56:03.475 INFO:teuthology.orchestra.run.smithi026.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 3.8 MB/s | 1.2 MB 00:00 2024-05-08T23:56:03.478 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:03.478 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.7 MB/s | 1.9 MB 00:01 2024-05-08T23:56:03.540 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:56:03.558 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:56:03.558 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:56:03.652 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:56:03.655 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:56:03.824 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:03.824 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:03.824 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:03.824 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:56:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:16.2.15-0.el8 ceph 25 k 2024-05-08T23:56:03.825 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:03.825 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:56:03.825 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:03.825 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-08T23:56:03.825 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:03.825 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 25 k 2024-05-08T23:56:03.825 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 107 k 2024-05-08T23:56:03.826 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:56:04.013 INFO:teuthology.orchestra.run.smithi135.stdout:libcephfs-devel-16.2.15-0.el8.x86_64.rpm 136 kB/s | 25 kB 00:00 2024-05-08T23:56:04.014 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:04.014 INFO:teuthology.orchestra.run.smithi135.stdout:Total 135 kB/s | 25 kB 00:00 2024-05-08T23:56:04.014 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:56:04.017 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:56:04.017 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:56:04.019 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:56:04.022 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:56:04.076 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:56:04.168 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:56:04.314 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:04.367 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-05-08T23:56:04.581 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-05-08T23:56:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:04.800 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-05-08T23:56:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:04.932 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:56:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:16.2.15-0.el8.x86_64 2024-05-08T23:56:04.932 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:04.932 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:05.052 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librados2 2024-05-08T23:56:05.053 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-05-08T23:56:05.271 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-05-08T23:56:05.481 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-05-08T23:56:05.800 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-05-08T23:56:05.810 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:16 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:06.036 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-05-08T23:56:07.149 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-05-08T23:56:07.404 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:07.452 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:07.453 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:56:07.453 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:07.460 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-05-08T23:56:07.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librbd1 2024-05-08T23:56:08.121 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-05-08T23:56:08.304 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-05-08T23:56:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:19 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:08.461 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:16.2.15-0.el8.noarch 13/13 2024-05-08T23:56:08.781 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-0.el8.noarch 13/13 2024-05-08T23:56:08.781 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:16.2.15-0.el8.noarch 1/13 2024-05-08T23:56:08.781 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-05-08T23:56:08.781 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-05-08T23:56:08.782 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:16.2.15-0.el8.noarch 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T23:56:09.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T23:56:09.283 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T23:56:09.283 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T23:56:09.283 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T23:56:09.283 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T23:56:09.283 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:09.283 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:09.412 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T23:56:09.940 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:09.989 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:09.990 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:56:09.990 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:10.114 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rados 2024-05-08T23:56:10.200 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:54 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:10.869 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:21 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:11.968 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:11.969 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:11.969 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-05-08T23:56:11.969 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:11.969 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:16.2.15-0.el8 ceph-noarch 116 k 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2024-05-08T23:56:11.970 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:11.971 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 5.9 M 2024-05-08T23:56:11.971 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 24 M 2024-05-08T23:56:11.971 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:56:12.350 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): ceph-mgr-cephadm-16.2.15-0.el8.noarch.rp 2.2 MB/s | 116 kB 00:00 2024-05-08T23:56:12.408 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 364 kB/s | 21 kB 00:00 2024-05-08T23:56:12.473 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rados-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:12.475 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 3.2 MB/s | 578 kB 00:00 2024-05-08T23:56:12.500 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 3.8 MB/s | 355 kB 00:00 2024-05-08T23:56:12.521 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:12.522 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:56:12.522 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:12.559 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 585 kB/s | 49 kB 00:00 2024-05-08T23:56:12.627 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rgw 2024-05-08T23:56:12.668 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2024-05-08T23:56:12.668 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:12.668 INFO:teuthology.orchestra.run.smithi026.stdout:Total 8.4 MB/s | 5.9 MB 00:00 2024-05-08T23:56:12.723 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:56:12.733 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:56:12.734 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:56:12.842 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:56:12.845 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:56:13.139 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:56:13.381 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:24 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:13.432 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-05-08T23:56:13.700 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-05-08T23:56:14.740 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-05-08T23:56:15.004 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rgw-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:15.053 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:56:15.054 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:15.114 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-05-08T23:56:15.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-cephfs 2024-05-08T23:56:15.362 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-05-08T23:56:15.610 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 6/6 2024-05-08T23:56:15.913 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 6/6 2024-05-08T23:56:15.913 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:16.2.15-0.el8.noarch 1/6 2024-05-08T23:56:15.913 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-05-08T23:56:15.913 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-05-08T23:56:15.913 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-05-08T23:56:15.913 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-05-08T23:56:15.920 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:26 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:16.338 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-05-08T23:56:16.338 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:16.338 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:56:16.339 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:16.2.15-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2024-05-08T23:56:16.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2024-05-08T23:56:16.339 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.10.1-4.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2024-05-08T23:56:16.339 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:16.339 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:16.466 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-fuse 2024-05-08T23:56:17.255 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:01 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:17.524 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-cephfs-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:17.572 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:17.573 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:56:17.574 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:17.692 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rbd 2024-05-08T23:56:18.453 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:29 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:19.042 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:16.2.15-0.el8 ceph 911 k 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:56:19.043 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:19.044 INFO:teuthology.orchestra.run.smithi026.stdout:Install 2 Packages 2024-05-08T23:56:19.044 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:19.044 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 994 k 2024-05-08T23:56:19.044 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 2.8 M 2024-05-08T23:56:19.044 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:56:19.154 INFO:teuthology.orchestra.run.smithi026.stdout:(1/2): ceph-fuse-16.2.15-0.el8.x86_64.rpm 18 MB/s | 911 kB 00:00 2024-05-08T23:56:19.304 INFO:teuthology.orchestra.run.smithi026.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 416 kB/s | 83 kB 00:00 2024-05-08T23:56:19.305 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:19.305 INFO:teuthology.orchestra.run.smithi026.stdout:Total 3.7 MB/s | 994 kB 00:00 2024-05-08T23:56:19.315 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:56:19.337 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:56:19.337 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:56:19.430 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:56:19.433 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:56:19.604 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:56:19.863 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-05-08T23:56:20.035 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:16.2.15-0.el8.x86_64 2/2 2024-05-08T23:56:20.060 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rbd-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:20.110 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:20.111 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T23:56:20.111 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:20.235 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-fuse 2024-05-08T23:56:20.497 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:16.2.15-0.el8.x86_64 2/2 2024-05-08T23:56:20.498 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:16.2.15-0.el8.x86_64 1/2 2024-05-08T23:56:20.908 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-05-08T23:56:20.908 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:20.908 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:56:20.908 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:16.2.15-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-05-08T23:56:20.908 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:20.908 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:21.079 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:32 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:21.124 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librados-devel 2024-05-08T23:56:21.914 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:05 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:22.718 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:22.718 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:22.718 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:22.719 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:22.719 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:56:22.719 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:16.2.15-0.el8 ceph 88 k 2024-05-08T23:56:22.719 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:22.719 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:56:22.719 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:22.719 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-08T23:56:22.719 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:22.720 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 88 k 2024-05-08T23:56:22.720 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 240 k 2024-05-08T23:56:22.720 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:56:22.803 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-fuse-16.2.15-0.el8.x86_64.rpm 1.0 MB/s | 88 kB 00:00 2024-05-08T23:56:22.804 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:22.804 INFO:teuthology.orchestra.run.smithi135.stdout:Total 1.0 MB/s | 88 kB 00:00 2024-05-08T23:56:22.804 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:56:22.814 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:56:22.814 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:56:22.864 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:56:22.867 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:56:22.992 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:56:23.220 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:23.508 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:23.700 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:16.2.15-0.el8 ceph 131 k 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-05-08T23:56:23.701 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:23.702 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 131 k 2024-05-08T23:56:23.702 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 432 k 2024-05-08T23:56:23.702 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:56:23.751 INFO:teuthology.orchestra.run.smithi026.stdout:librados-devel-16.2.15-0.el8.x86_64.rpm 2.7 MB/s | 131 kB 00:00 2024-05-08T23:56:23.751 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:23.751 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.6 MB/s | 131 kB 00:00 2024-05-08T23:56:23.752 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:56:23.757 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:56:23.757 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:56:23.810 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:56:23.814 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:56:23.897 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:23.898 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:56:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:16.2.15-0.el8.x86_64 2024-05-08T23:56:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:23.898 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:23.927 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:56:24.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-mirror 2024-05-08T23:56:24.927 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:35 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:24.984 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:25.291 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:25.691 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:25.691 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:25.691 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:56:25.691 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:16.2.15-0.el8.x86_64 2024-05-08T23:56:25.691 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:25.691 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:25.923 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs2 2024-05-08T23:56:26.585 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:26.585 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-08T23:56:26.586 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:26.587 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 3.7 M 2024-05-08T23:56:26.587 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 15 M 2024-05-08T23:56:26.587 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:56:26.682 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-mirror-16.2.15-0.el8.x86_64.rpm 39 MB/s | 3.7 MB 00:00 2024-05-08T23:56:26.683 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:26.683 INFO:teuthology.orchestra.run.smithi135.stdout:Total 38 MB/s | 3.7 MB 00:00 2024-05-08T23:56:26.684 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:56:26.695 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:56:26.695 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:56:26.712 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:10 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:26.757 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:56:26.760 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:56:27.232 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:56:27.517 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:27.935 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:28.310 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:28.310 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:28.310 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:56:28.310 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:16.2.15-0.el8.x86_64 2024-05-08T23:56:28.310 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:28.310 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:28.444 INFO:teuthology.orchestra.run.smithi026.stdout:Package libcephfs2-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:28.496 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:28.498 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:56:28.498 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:28.588 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-nbd 2024-05-08T23:56:28.604 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs-devel 2024-05-08T23:56:29.353 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:40 ago on Wed 08 May 2024 11:53:49 PM UTC. 2024-05-08T23:56:29.393 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:13 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:30.993 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:16.2.15-0.el8 ceph 175 k 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-08T23:56:30.994 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:30.995 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 175 k 2024-05-08T23:56:30.995 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 523 k 2024-05-08T23:56:30.995 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T23:56:31.053 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-nbd-16.2.15-0.el8.x86_64.rpm 2.9 MB/s | 175 kB 00:00 2024-05-08T23:56:31.054 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:31.054 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.8 MB/s | 175 kB 00:00 2024-05-08T23:56:31.054 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T23:56:31.064 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T23:56:31.064 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T23:56:31.114 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T23:56:31.117 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T23:56:31.180 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:31.180 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:31.180 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:31.180 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:31.180 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:56:31.180 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:16.2.15-0.el8 ceph 25 k 2024-05-08T23:56:31.181 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:56:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-05-08T23:56:31.181 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 25 k 2024-05-08T23:56:31.181 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 107 k 2024-05-08T23:56:31.182 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:56:31.233 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T23:56:31.258 INFO:teuthology.orchestra.run.smithi026.stdout:libcephfs-devel-16.2.15-0.el8.x86_64.rpm 335 kB/s | 25 kB 00:00 2024-05-08T23:56:31.258 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:31.258 INFO:teuthology.orchestra.run.smithi026.stdout:Total 330 kB/s | 25 kB 00:00 2024-05-08T23:56:31.259 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:56:31.262 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:56:31.262 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:56:31.265 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:56:31.268 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:56:31.323 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:56:31.469 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:31.499 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:31.759 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:31.778 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:32.170 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:32.171 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:32.171 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:56:32.171 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:16.2.15-0.el8.x86_64 2024-05-08T23:56:32.171 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:32.171 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:32.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:32.185 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:32.185 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T23:56:32.185 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:16.2.15-0.el8.x86_64 2024-05-08T23:56:32.185 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:56:32.185 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T23:56:32.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librados2 2024-05-08T23:56:32.451 DEBUG:teuthology.parallel:result is None 2024-05-08T23:56:33.090 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:17 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:34.817 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:34.869 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:34.871 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:56:34.871 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:35.103 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librbd1 2024-05-08T23:56:35.886 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:19 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:37.607 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:37.660 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:37.661 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:56:37.662 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:37.775 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rados 2024-05-08T23:56:38.574 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:22 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:40.284 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rados-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:40.336 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:40.337 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:56:40.337 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:40.453 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rgw 2024-05-08T23:56:41.242 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:25 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:42.956 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rgw-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:43.008 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:43.009 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:56:43.009 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:43.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-cephfs 2024-05-08T23:56:43.900 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:27 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:45.651 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-cephfs-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:45.704 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:45.706 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:56:45.706 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:45.820 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rbd 2024-05-08T23:56:46.623 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:30 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:48.335 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rbd-2:16.2.15-0.el8.x86_64 is already installed. 2024-05-08T23:56:48.387 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:48.389 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-05-08T23:56:48.389 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:48.503 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-fuse 2024-05-08T23:56:49.291 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:33 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:51.074 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:51.074 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:51.075 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:51.075 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:51.075 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:56:51.075 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:16.2.15-0.el8 ceph 88 k 2024-05-08T23:56:51.075 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:51.075 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:56:51.075 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:51.075 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-05-08T23:56:51.076 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:51.076 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 88 k 2024-05-08T23:56:51.077 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 240 k 2024-05-08T23:56:51.077 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:56:51.106 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-fuse-16.2.15-0.el8.x86_64.rpm 2.8 MB/s | 88 kB 00:00 2024-05-08T23:56:51.107 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:51.107 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.7 MB/s | 88 kB 00:00 2024-05-08T23:56:51.107 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:56:51.118 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:56:51.118 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:56:51.170 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:56:51.173 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:56:51.283 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:56:51.488 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:51.778 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:52.162 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:52.162 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:52.162 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:56:52.162 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:16.2.15-0.el8.x86_64 2024-05-08T23:56:52.162 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:52.162 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:52.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-mirror 2024-05-08T23:56:53.173 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:37 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:54.937 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:54.937 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:54.937 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:54.937 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:54.937 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:56:54.937 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:16.2.15-0.el8 ceph 3.7 M 2024-05-08T23:56:54.938 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:54.938 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:56:54.938 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:54.938 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-05-08T23:56:54.938 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:54.939 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 3.7 M 2024-05-08T23:56:54.939 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 15 M 2024-05-08T23:56:54.939 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:56:55.026 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-mirror-16.2.15-0.el8.x86_64.rpm 42 MB/s | 3.7 MB 00:00 2024-05-08T23:56:55.027 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:55.027 INFO:teuthology.orchestra.run.smithi026.stdout:Total 41 MB/s | 3.7 MB 00:00 2024-05-08T23:56:55.027 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:56:55.040 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:56:55.040 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:56:55.108 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:56:55.111 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:56:55.578 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:56:55.778 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:56.224 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:56.611 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:56:56.611 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:56.611 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:56:56.611 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:16.2.15-0.el8.x86_64 2024-05-08T23:56:56.611 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:56.611 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:56:56.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-nbd 2024-05-08T23:56:57.660 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:41 ago on Wed 08 May 2024 11:54:16 PM UTC. 2024-05-08T23:56:59.444 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-05-08T23:56:59.444 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:59.444 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-05-08T23:56:59.445 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:59.445 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-05-08T23:56:59.445 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:16.2.15-0.el8 ceph 175 k 2024-05-08T23:56:59.445 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:59.445 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-05-08T23:56:59.445 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-05-08T23:56:59.445 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-05-08T23:56:59.445 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:56:59.446 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 175 k 2024-05-08T23:56:59.446 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 523 k 2024-05-08T23:56:59.446 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-05-08T23:56:59.489 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-nbd-16.2.15-0.el8.x86_64.rpm 4.0 MB/s | 175 kB 00:00 2024-05-08T23:56:59.489 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:56:59.489 INFO:teuthology.orchestra.run.smithi026.stdout:Total 3.9 MB/s | 175 kB 00:00 2024-05-08T23:56:59.490 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-05-08T23:56:59.501 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-05-08T23:56:59.501 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-05-08T23:56:59.558 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-05-08T23:56:59.560 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-05-08T23:56:59.677 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-05-08T23:57:00.003 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:57:00.314 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:57:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:16.2.15-0.el8.x86_64 1/1 2024-05-08T23:57:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:57:00.760 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-05-08T23:57:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:16.2.15-0.el8.x86_64 2024-05-08T23:57:00.760 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:57:00.760 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-05-08T23:57:00.972 DEBUG:teuthology.parallel:result is None 2024-05-08T23:57:00.972 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:57:00.972 INFO:teuthology.packaging:ref: None 2024-05-08T23:57:00.972 INFO:teuthology.packaging:tag: None 2024-05-08T23:57:00.972 INFO:teuthology.packaging:branch: pacific 2024-05-08T23:57:00.972 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:57:00.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-05-08T23:57:01.278 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T23:57:01.303 INFO:teuthology.orchestra.run.smithi026.stdout:16.2.15-0.el8 2024-05-08T23:57:01.303 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-0.el8 2024-05-08T23:57:01.304 INFO:teuthology.task.install:The correct ceph version 16.2.15-0 is installed. 2024-05-08T23:57:01.305 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:57:01.305 INFO:teuthology.packaging:ref: None 2024-05-08T23:57:01.305 INFO:teuthology.packaging:tag: None 2024-05-08T23:57:01.305 INFO:teuthology.packaging:branch: pacific 2024-05-08T23:57:01.305 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:57:01.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-05-08T23:57:01.595 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T23:57:01.622 INFO:teuthology.orchestra.run.smithi135.stdout:16.2.15-0.el8 2024-05-08T23:57:01.623 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-0.el8 2024-05-08T23:57:01.623 INFO:teuthology.task.install:The correct ceph version 16.2.15-0 is installed. 2024-05-08T23:57:01.624 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T23:57:01.625 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:57:01.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T23:57:01.658 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:57:01.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T23:57:01.695 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T23:57:01.695 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:57:01.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T23:57:01.729 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T23:57:01.800 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:57:01.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T23:57:01.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T23:57:01.904 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T23:57:01.904 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:57:01.904 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T23:57:01.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T23:57:02.004 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:57:02.004 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T23:57:02.034 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T23:57:02.104 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T23:57:02.105 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:57:02.105 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T23:57:02.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T23:57:02.204 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:57:02.204 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T23:57:02.234 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T23:57:02.305 INFO:teuthology.run_tasks:Running task print... 2024-05-08T23:57:02.314 INFO:teuthology.task.print:**** done install task... 2024-05-08T23:57:02.315 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-08T23:57:02.450 INFO:tasks.cephadm:Config: {'cephadm_branch': 'pacific', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:pacific', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T23:57:02.450 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:pacific 2024-05-08T23:57:02.451 INFO:tasks.cephadm:Cluster fsid is aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:02.451 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-08T23:57:02.451 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-05-08T23:57:02.451 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi026': '172.21.15.26', 'mon.smithi135': '172.21.15.135'} 2024-05-08T23:57:02.451 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-08T23:57:02.452 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname $(hostname -s) 2024-05-08T23:57:02.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-05-08T23:57:02.513 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref pacific)... 2024-05-08T23:57:02.514 DEBUG:teuthology.orchestra.run.smithi026:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T23:57:02.784 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 May 8 23:57 /home/ubuntu/cephtest/cephadm 2024-05-08T23:57:02.784 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T23:57:02.944 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 May 8 23:57 /home/ubuntu/cephtest/cephadm 2024-05-08T23:57:02.944 DEBUG:teuthology.orchestra.run.smithi026:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T23:57:02.968 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T23:57:03.035 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:pacific on all hosts... 2024-05-08T23:57:03.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull 2024-05-08T23:57:03.038 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull 2024-05-08T23:57:04.187 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-05-08T23:57:04.249 INFO:teuthology.orchestra.run.smithi026.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-05-08T23:57:28.177 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-08T23:57:28.177 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)", 2024-05-08T23:57:28.177 INFO:teuthology.orchestra.run.smithi026.stdout: "image_id": "727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0", 2024-05-08T23:57:28.177 INFO:teuthology.orchestra.run.smithi026.stdout: "repo_digests": [ 2024-05-08T23:57:28.177 INFO:teuthology.orchestra.run.smithi026.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a917adc3f5c2fb88f02feae5d8f667631e1c7fa0b341817d32f1d6fd5cd1bec1" 2024-05-08T23:57:28.177 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2024-05-08T23:57:28.177 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-08T23:57:35.894 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T23:57:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)", 2024-05-08T23:57:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0", 2024-05-08T23:57:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-05-08T23:57:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a917adc3f5c2fb88f02feae5d8f667631e1c7fa0b341817d32f1d6fd5cd1bec1" 2024-05-08T23:57:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-05-08T23:57:35.895 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T23:57:35.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph 2024-05-08T23:57:35.955 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-05-08T23:57:35.986 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /etc/ceph 2024-05-08T23:57:36.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-05-08T23:57:36.054 INFO:tasks.cephadm:Writing seed config... 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-08T23:57:36.055 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-05-08T23:57:36.056 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-08T23:57:36.057 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-08T23:57:36.058 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:57:36.058 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-08T23:57:36.088 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = aa42787e-0d96-11ef-bc97-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-08T23:57:36.088 DEBUG:teuthology.orchestra.run.smithi026:mon.smithi026> sudo journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi026.service 2024-05-08T23:57:36.131 INFO:tasks.cephadm:Bootstrapping... 2024-05-08T23:57:36.131 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific -v bootstrap --fsid aa42787e-0d96-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.26 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:36.162 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:-- Logs begin at Wed 2024-05-08 23:38:32 UTC. -- 2024-05-08T23:57:36.351 INFO:teuthology.orchestra.run.smithi026.stderr:-------------------------------------------------------------------------------- 2024-05-08T23:57:36.351 INFO:teuthology.orchestra.run.smithi026.stderr:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:pacific', '-v', 'bootstrap', '--fsid', 'aa42787e-0d96-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.26', '--skip-admin-label'] 2024-05-08T23:57:36.373 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: 4.9.4-dev 2024-05-08T23:57:36.388 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying podman|docker is present... 2024-05-08T23:57:36.409 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: 4.9.4-dev 2024-05-08T23:57:36.421 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying lvm2 is present... 2024-05-08T23:57:36.421 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying time synchronization is in place... 2024-05-08T23:57:36.428 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T23:57:36.434 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2024-05-08T23:57:36.440 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: enabled 2024-05-08T23:57:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: active 2024-05-08T23:57:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:Unit chronyd.service is enabled and running 2024-05-08T23:57:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:Repeating the final host check... 2024-05-08T23:57:36.467 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: 4.9.4-dev 2024-05-08T23:57:36.483 INFO:teuthology.orchestra.run.smithi026.stderr:podman (/bin/podman) version 4.9.4 is present 2024-05-08T23:57:36.484 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl is present 2024-05-08T23:57:36.484 INFO:teuthology.orchestra.run.smithi026.stderr:lvcreate is present 2024-05-08T23:57:36.489 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T23:57:36.494 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2024-05-08T23:57:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: enabled 2024-05-08T23:57:36.506 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: active 2024-05-08T23:57:36.507 INFO:teuthology.orchestra.run.smithi026.stderr:Unit chronyd.service is enabled and running 2024-05-08T23:57:36.507 INFO:teuthology.orchestra.run.smithi026.stderr:Host looks OK 2024-05-08T23:57:36.507 INFO:teuthology.orchestra.run.smithi026.stderr:Cluster fsid: aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:36.507 INFO:teuthology.orchestra.run.smithi026.stderr:Acquiring lock 139757381171688 on /run/cephadm/aa42787e-0d96-11ef-bc97-c7b262605968.lock 2024-05-08T23:57:36.507 INFO:teuthology.orchestra.run.smithi026.stderr:Lock 139757381171688 acquired on /run/cephadm/aa42787e-0d96-11ef-bc97-c7b262605968.lock 2024-05-08T23:57:36.507 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying IP 172.21.15.26 port 3300 ... 2024-05-08T23:57:36.508 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying IP 172.21.15.26 port 6789 ... 2024-05-08T23:57:36.508 INFO:teuthology.orchestra.run.smithi026.stderr:Base mon IP(s) is [172.21.15.26:3300, 172.21.15.26:6789], mon addrv is [v2:172.21.15.26:3300,v1:172.21.15.26:6789] 2024-05-08T23:57:36.511 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.26 metric 100 2024-05-08T23:57:36.511 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.26 metric 100 2024-05-08T23:57:36.514 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-05-08T23:57:36.514 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-05-08T23:57:36.514 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1785sec hoplimit 64 pref medium 2024-05-08T23:57:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-08T23:57:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-05-08T23:57:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-05-08T23:57:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: 3: ens1f0: mtu 1500 state UP qlen 1000 2024-05-08T23:57:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2024-05-08T23:57:36.517 INFO:teuthology.orchestra.run.smithi026.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-05-08T23:57:36.518 INFO:teuthology.orchestra.run.smithi026.stderr:Mon IP `172.21.15.26` is in CIDR network `172.21.0.0/20` 2024-05-08T23:57:36.518 INFO:teuthology.orchestra.run.smithi026.stderr:Mon IP `172.21.15.26` is in CIDR network `172.21.0.0/20` 2024-05-08T23:57:36.518 INFO:teuthology.orchestra.run.smithi026.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-08T23:57:36.519 INFO:teuthology.orchestra.run.smithi026.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-08T23:57:36.520 INFO:teuthology.orchestra.run.smithi026.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-05-08T23:57:36.599 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Trying to pull quay.ceph.io/ceph-ci/ceph:pacific... 2024-05-08T23:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Getting image source signatures 2024-05-08T23:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Copying blob sha256:efbf2990d792dd99354c95f0e06c6d4330413e38e584cb30666e2a0d35649b94 2024-05-08T23:57:36.685 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-05-08T23:57:36.686 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Copying config sha256:727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0 2024-05-08T23:57:36.838 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: Writing manifest to image destination 2024-05-08T23:57:37.007 INFO:teuthology.orchestra.run.smithi026.stderr:/bin/podman: 727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0 2024-05-08T23:57:37.493 INFO:teuthology.orchestra.run.smithi026.stderr:ceph: ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable) 2024-05-08T23:57:38.020 INFO:teuthology.orchestra.run.smithi026.stderr:Ceph version: ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable) 2024-05-08T23:57:38.020 INFO:teuthology.orchestra.run.smithi026.stderr:Extracting ceph user uid/gid from container image... 2024-05-08T23:57:38.524 INFO:teuthology.orchestra.run.smithi026.stderr:stat: 167 167 2024-05-08T23:57:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:Creating initial keys... 2024-05-08T23:57:39.530 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-authtool: AQBzETxm7HcBGxAAtQnYrpDvI51aVQPbrGMZjQ== 2024-05-08T23:57:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-authtool: AQB0ETxmkkTQGhAAIVjSyewpGS1WFkb3GOzFIg== 2024-05-08T23:57:41.558 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-authtool: AQB1ETxmsNR3GxAAMj4VyCg7+ln24PKKJEL36g== 2024-05-08T23:57:42.126 INFO:teuthology.orchestra.run.smithi026.stderr:Creating initial monmap... 2024-05-08T23:57:42.661 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T23:57:42.661 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:42.662 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T23:57:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:monmaptool for smithi026 [v2:172.21.15.26:3300,v1:172.21.15.26:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T23:57:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: set fsid to aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T23:57:43.219 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:57:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:Creating mon... 2024-05-08T23:57:43.779 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.691+0000 7f7e77032880 0 set uid:gid to 167:167 (ceph:ceph) 2024-05-08T23:57:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.691+0000 7f7e77032880 1 imported monmap: 2024-05-08T23:57:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: epoch 0 2024-05-08T23:57:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: fsid aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:43.780 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: last_changed 2024-05-08T23:57:42.552068+0000 2024-05-08T23:57:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: created 2024-05-08T23:57:42.552068+0000 2024-05-08T23:57:43.782 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.smithi026 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.691+0000 7f7e77032880 0 /usr/bin/ceph-mon: set fsid to aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: RocksDB version: 6.8.1 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Compile date Mar 4 2024 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: DB SUMMARY 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi026/store.db dir, Total Num: 0, files: 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi026/store.db: 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.error_if_exists: 0 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.create_if_missing: 1 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.paranoid_checks: 1 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.env: 0x5634e1d70080 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.fs: Posix File System 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.info_log: 0x5634e31c3300 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_file_opening_threads: 16 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.statistics: (nil) 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.use_fsync: 0 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_log_file_size: 0 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.keep_log_file_num: 1000 2024-05-08T23:57:43.784 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.recycle_log_file_num: 0 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.allow_fallocate: 1 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.allow_mmap_reads: 0 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.allow_mmap_writes: 0 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.use_direct_reads: 0 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.create_missing_column_families: 0 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.db_log_dir: 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi026/store.db 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_subcompactions: 1 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_background_flushes: -1 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T23:57:43.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T23:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.advise_random_on_open: 1 2024-05-08T23:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.db_write_buffer_size: 0 2024-05-08T23:57:43.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.write_buffer_manager: 0x5634e31c9950 2024-05-08T23:57:43.808 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T23:57:43.808 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-05-08T23:57:43.808 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T23:57:43.808 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T23:57:43.808 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.rate_limiter: (nil) 2024-05-08T23:57:43.808 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T23:57:43.808 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.wal_recovery_mode: 2 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.enable_thread_tracking: 0 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.enable_pipelined_write: 0 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.unordered_write: 0 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.row_cache: None 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.wal_filter: None 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.allow_ingest_behind: 0 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.preserve_deletes: 0 2024-05-08T23:57:43.809 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.two_write_queues: 0 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.manual_wal_flush: 0 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.atomic_flush: 0 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.log_readahead_size: 0 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_background_jobs: 2 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_background_compactions: -1 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T23:57:43.810 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_total_wal_size: 0 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.max_open_files: -1 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.bytes_per_sync: 0 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Options.compaction_readahead_size: 0 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Compression algorithms supported: 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T23:57:43.811 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: kZSTD supported: 0 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: kXpressCompression supported: 0 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: kLZ4HCCompression supported: 1 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: kLZ4Compression supported: 1 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: kBZip2Compression supported: 0 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: kZlibCompression supported: 1 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: kSnappyCompression supported: 1 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.692+0000 7f7e77032880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000001 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.812 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.merge_operator: 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_filter: None 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_filter_factory: None 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5634e30d9d18) 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: index_type: 0 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-05-08T23:57:43.813 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: checksum: 1 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_cache: 0x5634e310ed10 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-05-08T23:57:43.814 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: format_version: 2 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: block_align: 0 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.write_buffer_size: 33554432 2024-05-08T23:57:43.815 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_write_buffer_number: 2 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compression: NoCompression 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.bottommost_compression: Disabled 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.prefix_extractor: nullptr 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.num_levels: 7 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T23:57:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:57:43.817 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T23:57:43.817 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T23:57:43.817 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compression_opts.level: 32767 2024-05-08T23:57:43.817 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compression_opts.strategy: 0 2024-05-08T23:57:43.817 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T23:57:43.817 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:57:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compression_opts.enabled: false 2024-05-08T23:57:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T23:57:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T23:57:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T23:57:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.target_file_size_base: 67108864 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T23:57:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.arena_block_size: 4194304 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.disable_auto_compactions: 0 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T23:57:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.table_properties_collectors: 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.inplace_update_support: 0 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.bloom_locality: 0 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.max_successive_merges: 0 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T23:57:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.paranoid_file_checks: 0 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.force_consistency_checks: 0 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.report_bg_io_stats: 0 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.ttl: 2592000 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.693+0000 7f7e77032880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.694+0000 7f7e77032880 4 rocksdb: DB pointer 0x5634e31d7800 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.694+0000 7f7e5fea5700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.694+0000 7f7e5fea5700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:57:43.822 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T23:57:43.823 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:57:43.823 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:57:43.823 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T23:57:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-05-08T23:57:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:57:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T23:57:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:57:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:57:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T23:57:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-05-08T23:57:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: 2024-05-08T23:57:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.696+0000 7f7e77032880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-05-08T23:57:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.696+0000 7f7e77032880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-05-08T23:57:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph-mon: debug 2024-05-08T23:57:43.696+0000 7f7e77032880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi026 for mon.smithi026 2024-05-08T23:57:44.313 INFO:teuthology.orchestra.run.smithi026.stderr:create mon.smithi026 on 2024-05-08T23:57:44.327 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-05-08T23:57:44.432 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-08T23:57:44.532 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-aa42787e-0d96-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-aa42787e-0d96-11ef-bc97-c7b262605968.target. 2024-05-08T23:57:44.532 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-aa42787e-0d96-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-aa42787e-0d96-11ef-bc97-c7b262605968.target. 2024-05-08T23:57:44.753 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Failed to reset failed state of unit ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi026.service: Unit ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi026.service not loaded. 2024-05-08T23:57:44.760 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/ceph-aa42787e-0d96-11ef-bc97-c7b262605968.target.wants/ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi026.service → /etc/systemd/system/ceph-aa42787e-0d96-11ef-bc97-c7b262605968@.service. 2024-05-08T23:57:44.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:44 smithi026 systemd[1]: Starting Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-08T23:57:45.867 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: cluster 2024-05-08T23:57:45.460776+0000 mon.smithi026 (mon.0) 0 : [INF] mkfs aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:45.867 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: cluster 2024-05-08T23:57:45.444236+0000 mon.smithi026 (mon.0) 1 : cluster [INF] mon.smithi026 is new leader, mons smithi026 in quorum (ranks 0) 2024-05-08T23:57:45.883 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: disabled 2024-05-08T23:57:45.893 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2024-05-08T23:57:45.893 INFO:teuthology.orchestra.run.smithi026.stderr:firewalld.service is not enabled 2024-05-08T23:57:45.893 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to enable service . firewalld.service is not available 2024-05-08T23:57:45.894 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mon to start... 2024-05-08T23:57:45.894 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mon... 2024-05-08T23:57:46.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:45 smithi026 bash[39521]: 921fe51db3434d0a569c11d2f8d5bfb0240ada31d1ba7919bdb19b2d5082d6f9 2024-05-08T23:57:46.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:45 smithi026 systemd[1]: Started Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:57:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: cluster 2024-05-08T23:57:45.459856+0000 mon.smithi026 (mon.0) 2 : cluster [INF] mon.smithi026 is new leader, mons smithi026 in quorum (ranks 0) 2024-05-08T23:57:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: cluster 2024-05-08T23:57:45.459987+0000 mon.smithi026 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0]} removed_ranks: {} 2024-05-08T23:57:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: cluster 2024-05-08T23:57:45.461924+0000 mon.smithi026 (mon.0) 4 : cluster [DBG] fsmap 2024-05-08T23:57:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: cluster 2024-05-08T23:57:45.463725+0000 mon.smithi026 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-05-08T23:57:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: cluster 2024-05-08T23:57:45.464101+0000 mon.smithi026 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-05-08T23:57:48.349 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.225+0000 7f8f36d2a700 1 Processor -- start 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.225+0000 7f8f36d2a700 1 -- start start 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.225+0000 7f8f36d2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f300ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.225+0000 7f8f36d2a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f30100120 con 0x7f8f30071c60 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.226+0000 7f8f34ac6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f300ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.226+0000 7f8f34ac6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f300ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46968/0 (socket says 172.21.15.26:46968) 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.226+0000 7f8f34ac6700 1 -- 172.21.15.26:0/2716833438 learned_addr learned my addr 172.21.15.26:0/2716833438 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.226+0000 7f8f34ac6700 1 -- 172.21.15.26:0/2716833438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30100260 con 0x7f8f30071c60 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f34ac6700 1 --2- 172.21.15.26:0/2716833438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f300ffc30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f8f24009730 tx=0x7f8f240090f0).ready entity=mon.0 client_cookie=ae75f7a8cbd7d1ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f2f7fe700 1 -- 172.21.15.26:0/2716833438 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f2400b6e0 con 0x7f8f30071c60 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f2f7fe700 1 -- 172.21.15.26:0/2716833438 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2400b840 con 0x7f8f30071c60 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f2f7fe700 1 -- 172.21.15.26:0/2716833438 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f2400bb10 con 0x7f8f30071c60 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2716833438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 msgr2=0x7f8f300ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f36d2a700 1 --2- 172.21.15.26:0/2716833438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f300ffc30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f8f24009730 tx=0x7f8f240090f0).stop 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2716833438 shutdown_connections 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f36d2a700 1 --2- 172.21.15.26:0/2716833438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f300ffc30 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2716833438 >> 172.21.15.26:0/2716833438 conn(0x7f8f300f76f0 msgr2=0x7f8f300f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2716833438 shutdown_connections 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.227+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2716833438 wait complete. 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.228+0000 7f8f36d2a700 1 Processor -- start 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.228+0000 7f8f36d2a700 1 -- start start 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.228+0000 7f8f36d2a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f3010b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.228+0000 7f8f36d2a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3010bab0 con 0x7f8f30071c60 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.228+0000 7f8f34ac6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f3010b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.228+0000 7f8f34ac6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f3010b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46974/0 (socket says 172.21.15.26:46974) 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.228+0000 7f8f34ac6700 1 -- 172.21.15.26:0/2591436065 learned_addr learned my addr 172.21.15.26:0/2591436065 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:57:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f34ac6700 1 -- 172.21.15.26:0/2591436065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24009370 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f34ac6700 1 --2- 172.21.15.26:0/2591436065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f3010b5c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f8f24000c00 tx=0x7f8f24017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f2dffb700 1 -- 172.21.15.26:0/2591436065 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f24011cc0 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f2dffb700 1 -- 172.21.15.26:0/2591436065 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24011e20 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3010bcb0 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f2dffb700 1 -- 172.21.15.26:0/2591436065 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f2401d590 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3010c0c0 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f2dffb700 1 -- 172.21.15.26:0/2591436065 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8f2401da20 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.229+0000 7f8f2dffb700 1 -- 172.21.15.26:0/2591436065 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8f24026b10 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.230+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f30046ce0 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.233+0000 7f8f2dffb700 1 -- 172.21.15.26:0/2591436065 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f8f24021030 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.303+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8f301051c0 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.303+0000 7f8f2dffb700 1 -- 172.21.15.26:0/2591436065 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+318 (secure 0 0 0) 0x7f8f2402f430 con 0x7f8f30071c60 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.304+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 msgr2=0x7f8f3010b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.304+0000 7f8f36d2a700 1 --2- 172.21.15.26:0/2591436065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f3010b5c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f8f24000c00 tx=0x7f8f24017000).stop 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.304+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 shutdown_connections 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.304+0000 7f8f36d2a700 1 --2- 172.21.15.26:0/2591436065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f30071c60 0x7f8f3010b5c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.304+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 >> 172.21.15.26:0/2591436065 conn(0x7f8f300f76f0 msgr2=0x7f8f300f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.304+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 shutdown_connections 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.304+0000 7f8f36d2a700 1 -- 172.21.15.26:0/2591436065 wait complete. 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: cluster: 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: id: aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: services: 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi026 (age 2s) 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mgr: no daemons active 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: data: 2024-05-08T23:57:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-05-08T23:57:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-05-08T23:57:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-05-08T23:57:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: pgs: 2024-05-08T23:57:48.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:48.628 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: audit 2024-05-08T23:57:48.303791+0000 mon.smithi026 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.26:0/2591436065' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-08T23:57:48.890 INFO:teuthology.orchestra.run.smithi026.stderr:mon is available 2024-05-08T23:57:48.890 INFO:teuthology.orchestra.run.smithi026.stderr:Assimilating anything we can from ceph.conf... 2024-05-08T23:57:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.401+0000 7f557afe9700 1 Processor -- start 2024-05-08T23:57:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.401+0000 7f557afe9700 1 -- start start 2024-05-08T23:57:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.401+0000 7f557afe9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f5574102070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:57:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.401+0000 7f557afe9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740fda60 con 0x7f5574071c20 2024-05-08T23:57:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.401+0000 7f5578d85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f5574102070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:57:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.401+0000 7f5578d85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f5574102070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46982/0 (socket says 172.21.15.26:46982) 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.401+0000 7f5578d85700 1 -- 172.21.15.26:0/21594769 learned_addr learned my addr 172.21.15.26:0/21594769 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.401+0000 7f5578d85700 1 -- 172.21.15.26:0/21594769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574102560 con 0x7f5574071c20 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f5578d85700 1 --2- 172.21.15.26:0/21594769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f5574102070 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f5568009730 tx=0x7f55680090f0).ready entity=mon.0 client_cookie=273d65ff42f1a442 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f55737fe700 1 -- 172.21.15.26:0/21594769 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f556800b770 con 0x7f5574071c20 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f55737fe700 1 -- 172.21.15.26:0/21594769 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556800b8d0 con 0x7f5574071c20 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f55737fe700 1 -- 172.21.15.26:0/21594769 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f556800bba0 con 0x7f5574071c20 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f557afe9700 1 -- 172.21.15.26:0/21594769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 msgr2=0x7f5574102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f557afe9700 1 --2- 172.21.15.26:0/21594769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f5574102070 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f5568009730 tx=0x7f55680090f0).stop 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f557afe9700 1 -- 172.21.15.26:0/21594769 shutdown_connections 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f557afe9700 1 --2- 172.21.15.26:0/21594769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f5574102070 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f557afe9700 1 -- 172.21.15.26:0/21594769 >> 172.21.15.26:0/21594769 conn(0x7f55740f76f0 msgr2=0x7f55740f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f557afe9700 1 -- 172.21.15.26:0/21594769 shutdown_connections 2024-05-08T23:57:49.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.402+0000 7f557afe9700 1 -- 172.21.15.26:0/21594769 wait complete. 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.403+0000 7f557afe9700 1 Processor -- start 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.403+0000 7f557afe9700 1 -- start start 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.403+0000 7f557afe9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f557410d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.403+0000 7f557afe9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557410dd10 con 0x7f5574071c20 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.403+0000 7f5578d85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f557410d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.403+0000 7f5578d85700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f557410d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46992/0 (socket says 172.21.15.26:46992) 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.403+0000 7f5578d85700 1 -- 172.21.15.26:0/3457332089 learned_addr learned my addr 172.21.15.26:0/3457332089 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.403+0000 7f5578d85700 1 -- 172.21.15.26:0/3457332089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568009370 con 0x7f5574071c20 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.404+0000 7f5578d85700 1 --2- 172.21.15.26:0/3457332089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f557410d820 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f5568009130 tx=0x7f5568017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.404+0000 7f5571ffb700 1 -- 172.21.15.26:0/3457332089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5568011d90 con 0x7f5574071c20 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.404+0000 7f5571ffb700 1 -- 172.21.15.26:0/3457332089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556801d430 con 0x7f5574071c20 2024-05-08T23:57:49.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.404+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557410df10 con 0x7f5574071c20 2024-05-08T23:57:49.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.404+0000 7f5571ffb700 1 -- 172.21.15.26:0/3457332089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f556801d700 con 0x7f5574071c20 2024-05-08T23:57:49.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.404+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557410e320 con 0x7f5574071c20 2024-05-08T23:57:49.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.404+0000 7f5571ffb700 1 -- 172.21.15.26:0/3457332089 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f556801db50 con 0x7f5574071c20 2024-05-08T23:57:49.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.404+0000 7f5571ffb700 1 -- 172.21.15.26:0/3457332089 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5568026b70 con 0x7f5574071c20 2024-05-08T23:57:49.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.405+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5574046ce0 con 0x7f5574071c20 2024-05-08T23:57:49.416 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.407+0000 7f5571ffb700 1 -- 172.21.15.26:0/3457332089 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f5568021030 con 0x7f5574071c20 2024-05-08T23:57:49.469 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.475+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5574102750 con 0x7f5574071c20 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.478+0000 7f5571ffb700 1 -- 172.21.15.26:0/3457332089 <== mon.0 v2:172.21.15.26:3300/0 7 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f5568026410 con 0x7f5574071c20 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.478+0000 7f5571ffb700 1 -- 172.21.15.26:0/3457332089 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+454 (secure 0 0 0) 0x7f5568036470 con 0x7f5574071c20 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [global] 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: fsid = aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: log_to_journald = false 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.26:3300,v1:172.21.15.26:6789] 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-05-08T23:57:49.475 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [mgr] 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [osd] 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.479+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 msgr2=0x7f557410d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.479+0000 7f557afe9700 1 --2- 172.21.15.26:0/3457332089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f557410d820 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f5568009130 tx=0x7f5568017000).stop 2024-05-08T23:57:49.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.479+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 shutdown_connections 2024-05-08T23:57:49.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.479+0000 7f557afe9700 1 --2- 172.21.15.26:0/3457332089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5574071c20 0x7f557410d820 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:57:49.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.479+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 >> 172.21.15.26:0/3457332089 conn(0x7f55740f76f0 msgr2=0x7f55740f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:49.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.479+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 shutdown_connections 2024-05-08T23:57:49.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:49.479+0000 7f557afe9700 1 -- 172.21.15.26:0/3457332089 wait complete. 2024-05-08T23:57:49.810 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: audit 2024-05-08T23:57:49.475746+0000 mon.smithi026 (mon.0) 8 : audit [INF] from='client.? 172.21.15.26:0/3457332089' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T23:57:49.810 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: audit 2024-05-08T23:57:49.478804+0000 mon.smithi026 (mon.0) 9 : audit [INF] from='client.? 172.21.15.26:0/3457332089' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-08T23:57:50.105 INFO:teuthology.orchestra.run.smithi026.stderr:Generating new minimal ceph.conf... 2024-05-08T23:57:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.673+0000 7f75e7b5b700 1 Processor -- start 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.673+0000 7f75e7b5b700 1 -- start start 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e7b5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e01020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e7b5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00fdaa0 con 0x7f75e0071be0 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e58f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e01020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e58f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e01020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47008/0 (socket says 172.21.15.26:47008) 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e58f7700 1 -- 172.21.15.26:0/4162683200 learned_addr learned my addr 172.21.15.26:0/4162683200 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e58f7700 1 -- 172.21.15.26:0/4162683200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e01025a0 con 0x7f75e0071be0 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e58f7700 1 --2- 172.21.15.26:0/4162683200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e01020b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f75d0009730 tx=0x7f75d00090f0).ready entity=mon.0 client_cookie=8251a3f572821509 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e48f5700 1 -- 172.21.15.26:0/4162683200 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75d000b6e0 con 0x7f75e0071be0 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e48f5700 1 -- 172.21.15.26:0/4162683200 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f75d000bc90 con 0x7f75e0071be0 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.674+0000 7f75e48f5700 1 -- 172.21.15.26:0/4162683200 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75d0011c70 con 0x7f75e0071be0 2024-05-08T23:57:50.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.675+0000 7f75e7b5b700 1 -- 172.21.15.26:0/4162683200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 msgr2=0x7f75e01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.675+0000 7f75e7b5b700 1 --2- 172.21.15.26:0/4162683200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e01020b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f75d0009730 tx=0x7f75d00090f0).stop 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.675+0000 7f75e7b5b700 1 -- 172.21.15.26:0/4162683200 shutdown_connections 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.675+0000 7f75e7b5b700 1 --2- 172.21.15.26:0/4162683200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e01020b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.675+0000 7f75e7b5b700 1 -- 172.21.15.26:0/4162683200 >> 172.21.15.26:0/4162683200 conn(0x7f75e00f76f0 msgr2=0x7f75e00f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.675+0000 7f75e7b5b700 1 -- 172.21.15.26:0/4162683200 shutdown_connections 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.675+0000 7f75e7b5b700 1 -- 172.21.15.26:0/4162683200 wait complete. 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e7b5b700 1 Processor -- start 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e7b5b700 1 -- start start 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e7b5b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e7b5b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e010e4b0 con 0x7f75e0071be0 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e58f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e58f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47010/0 (socket says 172.21.15.26:47010) 2024-05-08T23:57:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e58f7700 1 -- 172.21.15.26:0/2620345371 learned_addr learned my addr 172.21.15.26:0/2620345371 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e58f7700 1 -- 172.21.15.26:0/2620345371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d0009370 con 0x7f75e0071be0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.676+0000 7f75e58f7700 1 --2- 172.21.15.26:0/2620345371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e010dfc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f75d0000c00 tx=0x7f75d00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.677+0000 7f75d6ffd700 1 -- 172.21.15.26:0/2620345371 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75d001a610 con 0x7f75e0071be0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.677+0000 7f75d6ffd700 1 -- 172.21.15.26:0/2620345371 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f75d001abc0 con 0x7f75e0071be0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.677+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e010e6b0 con 0x7f75e0071be0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.677+0000 7f75d6ffd700 1 -- 172.21.15.26:0/2620345371 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75d0022a20 con 0x7f75e0071be0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.677+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e010eac0 con 0x7f75e0071be0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.677+0000 7f75d6ffd700 1 -- 172.21.15.26:0/2620345371 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f75d0023450 con 0x7f75e0071be0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.677+0000 7f75d6ffd700 1 -- 172.21.15.26:0/2620345371 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f75d0019390 con 0x7f75e0071be0 2024-05-08T23:57:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.678+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e0046ce0 con 0x7f75e0071be0 2024-05-08T23:57:50.676 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.680+0000 7f75d6ffd700 1 -- 172.21.15.26:0/2620345371 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f75d0028060 con 0x7f75e0071be0 2024-05-08T23:57:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.747+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f75e01032f0 con 0x7f75e0071be0 2024-05-08T23:57:50.742 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.747+0000 7f75d6ffd700 1 -- 172.21.15.26:0/2620345371 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f75d001e070 con 0x7f75e0071be0 2024-05-08T23:57:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.748+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 msgr2=0x7f75e010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.748+0000 7f75e7b5b700 1 --2- 172.21.15.26:0/2620345371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e010dfc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f75d0000c00 tx=0x7f75d00090f0).stop 2024-05-08T23:57:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.748+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 shutdown_connections 2024-05-08T23:57:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.748+0000 7f75e7b5b700 1 --2- 172.21.15.26:0/2620345371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0071be0 0x7f75e010dfc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:57:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.748+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 >> 172.21.15.26:0/2620345371 conn(0x7f75e00f76f0 msgr2=0x7f75e00f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.748+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 shutdown_connections 2024-05-08T23:57:50.744 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:50.748+0000 7f75e7b5b700 1 -- 172.21.15.26:0/2620345371 wait complete. 2024-05-08T23:57:51.109 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: audit 2024-05-08T23:57:50.749197+0000 mon.smithi026 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.26:0/2620345371' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:51.382 INFO:teuthology.orchestra.run.smithi026.stderr:Restarting the monitor... 2024-05-08T23:57:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:51 smithi026 systemd[1]: Stopping Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-08T23:57:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:51 smithi026 bash[39866]: Error: no container with name or ID "ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon.smithi026" found: no such container 2024-05-08T23:57:52.045 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: debug 2024-05-08T23:57:51.648+0000 7f07a4c40700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi026 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-05-08T23:57:52.045 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[39535]: debug 2024-05-08T23:57:51.648+0000 7f07a4c40700 -1 mon.smithi026@0(leader) e1 *** Got Signal Terminated *** 2024-05-08T23:57:52.338 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:52 smithi026 bash[39908]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026 2024-05-08T23:57:52.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:52 smithi026 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi026.service: Succeeded. 2024-05-08T23:57:52.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:52 smithi026 systemd[1]: Stopped Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:57:52.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:52 smithi026 systemd[1]: Starting Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-08T23:57:53.077 INFO:teuthology.orchestra.run.smithi026.stderr:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-08T23:57:53.293 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.040+0000 7f1fe39ef880 0 set uid:gid to 167:167 (ceph:ceph) 2024-05-08T23:57:53.293 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.040+0000 7f1fe39ef880 0 ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable), process ceph-mon, pid 7 2024-05-08T23:57:53.293 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.040+0000 7f1fe39ef880 0 pidfile_write: ignore empty --pid-file 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 0 load: jerasure load: lrc load: isa 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: RocksDB version: 6.8.1 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Compile date Mar 4 2024 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: DB SUMMARY 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: CURRENT file: CURRENT 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: IDENTITY file: IDENTITY 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.294 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi026/store.db dir, Total Num: 1, files: 000004.sst 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi026/store.db: 000006.log size: 103230 ; 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.error_if_exists: 0 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.create_if_missing: 0 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.paranoid_checks: 1 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.env: 0x5641e55da080 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.fs: Posix File System 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.info_log: 0x5641e6162560 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_file_opening_threads: 16 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.statistics: (nil) 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.use_fsync: 0 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_log_file_size: 0 2024-05-08T23:57:53.295 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.keep_log_file_num: 1000 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.recycle_log_file_num: 0 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.allow_fallocate: 1 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.allow_mmap_reads: 0 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.allow_mmap_writes: 0 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.use_direct_reads: 0 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.create_missing_column_families: 0 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.db_log_dir: 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi026/store.db 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_subcompactions: 1 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_background_flushes: -1 2024-05-08T23:57:53.296 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.advise_random_on_open: 1 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.db_write_buffer_size: 0 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.write_buffer_manager: 0x5641e6dd2450 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.rate_limiter: (nil) 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.wal_recovery_mode: 2 2024-05-08T23:57:53.297 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.enable_thread_tracking: 0 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.enable_pipelined_write: 0 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.unordered_write: 0 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.row_cache: None 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.wal_filter: None 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.allow_ingest_behind: 0 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.preserve_deletes: 0 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.two_write_queues: 0 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.manual_wal_flush: 0 2024-05-08T23:57:53.298 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.atomic_flush: 0 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.log_readahead_size: 0 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_background_jobs: 2 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_background_compactions: -1 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T23:57:53.299 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_total_wal_size: 0 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.max_open_files: -1 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.bytes_per_sync: 0 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Options.compaction_readahead_size: 0 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Compression algorithms supported: 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: kZSTD supported: 0 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: kXpressCompression supported: 0 2024-05-08T23:57:53.300 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: kLZ4HCCompression supported: 1 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: kLZ4Compression supported: 1 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: kBZip2Compression supported: 0 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: kZlibCompression supported: 1 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: kSnappyCompression supported: 1 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.045+0000 7f1fe39ef880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000005 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.merge_operator: 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_filter: None 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_filter_factory: None 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T23:57:53.301 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5641e6107d10) 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cache_index_and_filter_blocks: 1 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: pin_top_level_index_and_filter: 1 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: index_type: 0 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: data_block_index_type: 0 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: index_shortening: 1 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: data_block_hash_table_util_ratio: 0.750000 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: hash_index_allow_collision: 1 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: checksum: 1 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: no_block_cache: 0 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: block_cache: 0x5641e613cf10 2024-05-08T23:57:53.302 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: block_cache_name: BinnedLRUCache 2024-05-08T23:57:53.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: block_cache_options: 2024-05-08T23:57:53.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: capacity : 536870912 2024-05-08T23:57:53.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: num_shard_bits : 4 2024-05-08T23:57:53.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: strict_capacity_limit : 0 2024-05-08T23:57:53.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: high_pri_pool_ratio: 0.000 2024-05-08T23:57:53.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: block_cache_compressed: (nil) 2024-05-08T23:57:53.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: persistent_cache: (nil) 2024-05-08T23:57:53.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: block_size: 4096 2024-05-08T23:57:53.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: block_size_deviation: 10 2024-05-08T23:57:53.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: block_restart_interval: 16 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: index_block_restart_interval: 1 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: metadata_block_size: 4096 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: partition_filters: 0 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: use_delta_encoding: 1 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: filter_policy: rocksdb.BuiltinBloomFilter 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: whole_key_filtering: 1 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: verify_compression: 0 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: read_amp_bytes_per_bit: 0 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: format_version: 2 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: enable_index_compression: 1 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: block_align: 0 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.write_buffer_size: 33554432 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_write_buffer_number: 2 2024-05-08T23:57:53.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compression: NoCompression 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.bottommost_compression: Disabled 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.prefix_extractor: nullptr 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.num_levels: 7 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T23:57:53.306 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compression_opts.level: 32767 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compression_opts.strategy: 0 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compression_opts.enabled: false 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.target_file_size_base: 67108864 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T23:57:53.307 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.arena_block_size: 4194304 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.disable_auto_compactions: 0 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T23:57:53.308 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.table_properties_collectors: 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.inplace_update_support: 0 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.bloom_locality: 0 2024-05-08T23:57:53.309 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.max_successive_merges: 0 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.paranoid_file_checks: 0 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.force_consistency_checks: 0 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.report_bg_io_stats: 0 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.ttl: 2592000 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1715212673048187, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.046+0000 7f1fe39ef880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.047+0000 7f1fe39ef880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-05-08T23:57:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.047+0000 7f1fe39ef880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1715212673049113, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 98421, "table_properties": {"data_size": 96522, "index_size": 376, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12967, "raw_average_key_size": 49, "raw_value_size": 89382, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 263, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1715212673, "oldest_key_time": 3, "file_creation_time": 0}} 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.047+0000 7f1fe39ef880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.048+0000 7f1fe39ef880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1715212673049543, "job": 1, "event": "recovery_finished"} 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.048+0000 7f1fe39ef880 4 rocksdb: DB pointer 0x5641e6205800 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.048+0000 7f1fca7e1700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.048+0000 7f1fca7e1700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ** DB Stats ** 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:57:53.311 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ** Compaction Stats [default] ** 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: L0 2/0 97.81 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.0 0.00 0.00 1 0.001 0 0 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Sum 2/0 97.81 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.0 0.00 0.00 1 0.001 0 0 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.0 0.00 0.00 1 0.001 0 0 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ** Compaction Stats [default] ** 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 157.0 0.00 0.00 1 0.001 0 0 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T23:57:53.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: AddFile(Keys): cumulative 0, interval 0 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Cumulative compaction: 0.00 GB write, 33.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Interval compaction: 0.00 GB write, 33.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ** File Read Latency Histogram By Level [default] ** 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ** Compaction Stats [default] ** 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: L0 2/0 97.81 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.0 0.00 0.00 1 0.001 0 0 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Sum 2/0 97.81 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.0 0.00 0.00 1 0.001 0 0 2024-05-08T23:57:53.313 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ** Compaction Stats [default] ** 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 157.0 0.00 0.00 1 0.001 0 0 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: AddFile(Keys): cumulative 0, interval 0 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Cumulative compaction: 0.00 GB write, 32.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T23:57:53.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: ** File Read Latency Histogram By Level [default] ** 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.049+0000 7f1fe39ef880 0 starting mon.smithi026 rank 0 at public addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] at bind addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi026 fsid aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.050+0000 7f1fe39ef880 1 mon.smithi026@-1(???) e1 preinit fsid aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.050+0000 7f1fe39ef880 0 mon.smithi026@-1(???).mds e1 new map 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.050+0000 7f1fe39ef880 0 mon.smithi026@-1(???).mds e1 print_map 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: e1 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: legacy client fscid: -1 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: No filesystems configured 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.050+0000 7f1fe39ef880 0 mon.smithi026@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T23:57:53.315 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.050+0000 7f1fe39ef880 0 mon.smithi026@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.050+0000 7f1fe39ef880 0 mon.smithi026@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.050+0000 7f1fe39ef880 0 mon.smithi026@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:57:50.749197+0000 mon.smithi026 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.26:0/2620345371' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-08T23:57:53.050+0000 7f1fe39ef880 1 mon.smithi026@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 bash[40029]: 716d736ba3e040969f359902466b5d4431f62e0d929069fedd2eac44b92eb3f8 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 systemd[1]: Started Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:57:53.067219+0000 mon.smithi026 (mon.0) 1 : cluster [INF] mon.smithi026 is new leader, mons smithi026 in quorum (ranks 0) 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:57:53.067283+0000 mon.smithi026 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0]} removed_ranks: {} 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:57:53.067704+0000 mon.smithi026 (mon.0) 3 : cluster [DBG] fsmap 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:57:53.067748+0000 mon.smithi026 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-05-08T23:57:53.316 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:57:53.068096+0000 mon.smithi026 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-05-08T23:57:54.698 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.614+0000 7ff14bd99700 1 Processor -- start 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.614+0000 7ff14bd99700 1 -- start start 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.614+0000 7ff14bd99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff1440ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.614+0000 7ff14bd99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1441001a0 con 0x7ff144071be0 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.614+0000 7ff149b35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff1440ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.615+0000 7ff149b35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff1440ffcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60010/0 (socket says 172.21.15.26:60010) 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.615+0000 7ff149b35700 1 -- 172.21.15.26:0/423236352 learned_addr learned my addr 172.21.15.26:0/423236352 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.615+0000 7ff149b35700 1 -- 172.21.15.26:0/423236352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1441002e0 con 0x7ff144071be0 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.615+0000 7ff149b35700 1 --2- 172.21.15.26:0/423236352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff1440ffcb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff140009730 tx=0x7ff1400090f0).ready entity=mon.0 client_cookie=95f6e824b22c6f11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.615+0000 7ff148b33700 1 -- 172.21.15.26:0/423236352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff14000b6e0 con 0x7ff144071be0 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.615+0000 7ff148b33700 1 -- 172.21.15.26:0/423236352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff14000bc90 con 0x7ff144071be0 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.615+0000 7ff148b33700 1 -- 172.21.15.26:0/423236352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff140011c70 con 0x7ff144071be0 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.616+0000 7ff14bd99700 1 -- 172.21.15.26:0/423236352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 msgr2=0x7ff1440ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.616+0000 7ff14bd99700 1 --2- 172.21.15.26:0/423236352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff1440ffcb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff140009730 tx=0x7ff1400090f0).stop 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.616+0000 7ff14bd99700 1 -- 172.21.15.26:0/423236352 shutdown_connections 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.616+0000 7ff14bd99700 1 --2- 172.21.15.26:0/423236352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff1440ffcb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.616+0000 7ff14bd99700 1 -- 172.21.15.26:0/423236352 >> 172.21.15.26:0/423236352 conn(0x7ff1440f76f0 msgr2=0x7ff1440f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.616+0000 7ff14bd99700 1 -- 172.21.15.26:0/423236352 shutdown_connections 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.616+0000 7ff14bd99700 1 -- 172.21.15.26:0/423236352 wait complete. 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.616+0000 7ff14bd99700 1 Processor -- start 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff14bd99700 1 -- start start 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff14bd99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff14410be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff14bd99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14410c310 con 0x7ff144071be0 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff149b35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff14410be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff149b35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff14410be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60020/0 (socket says 172.21.15.26:60020) 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff149b35700 1 -- 172.21.15.26:0/3305269364 learned_addr learned my addr 172.21.15.26:0/3305269364 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff149b35700 1 -- 172.21.15.26:0/3305269364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff140009370 con 0x7ff144071be0 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff149b35700 1 --2- 172.21.15.26:0/3305269364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff14410be20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff14000c010 tx=0x7ff1400090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff13affd700 1 -- 172.21.15.26:0/3305269364 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff14001a610 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.617+0000 7ff13affd700 1 -- 172.21.15.26:0/3305269364 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff14001abc0 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.618+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14410c510 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.618+0000 7ff13affd700 1 -- 172.21.15.26:0/3305269364 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff140022a20 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.618+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14410c920 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.618+0000 7ff13affd700 1 -- 172.21.15.26:0/3305269364 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff140023450 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.618+0000 7ff13affd700 1 -- 172.21.15.26:0/3305269364 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff140019390 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.618+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff144046ce0 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.621+0000 7ff13affd700 1 -- 172.21.15.26:0/3305269364 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ff140028060 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.688+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7ff144100fa0 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.690+0000 7ff13affd700 1 -- 172.21.15.26:0/3305269364 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff14001e070 con 0x7ff144071be0 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.691+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 msgr2=0x7ff14410be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.691+0000 7ff14bd99700 1 --2- 172.21.15.26:0/3305269364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff14410be20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff14000c010 tx=0x7ff1400090f0).stop 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.691+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 shutdown_connections 2024-05-08T23:57:54.701 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.691+0000 7ff14bd99700 1 --2- 172.21.15.26:0/3305269364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff144071be0 0x7ff14410be20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:57:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.691+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 >> 172.21.15.26:0/3305269364 conn(0x7ff1440f76f0 msgr2=0x7ff1440f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.691+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 shutdown_connections 2024-05-08T23:57:54.702 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:57:53.691+0000 7ff14bd99700 1 -- 172.21.15.26:0/3305269364 wait complete. 2024-05-08T23:57:55.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:57:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:57:53.692192+0000 mon.smithi026 (mon.0) 6 : audit [INF] from='client.? 172.21.15.26:0/3305269364' entity='client.admin' 2024-05-08T23:57:59.067 INFO:teuthology.orchestra.run.smithi026.stderr:Wrote config to /etc/ceph/ceph.conf 2024-05-08T23:57:59.067 INFO:teuthology.orchestra.run.smithi026.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:59.067 INFO:teuthology.orchestra.run.smithi026.stderr:Creating mgr... 2024-05-08T23:57:59.067 INFO:teuthology.orchestra.run.smithi026.stderr:Verifying port 9283 ... 2024-05-08T23:57:59.220 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Failed to reset failed state of unit ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mgr.smithi026.brymfp.service: Unit ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mgr.smithi026.brymfp.service not loaded. 2024-05-08T23:57:59.227 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: Created symlink /etc/systemd/system/ceph-aa42787e-0d96-11ef-bc97-c7b262605968.target.wants/ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mgr.smithi026.brymfp.service → /etc/systemd/system/ceph-aa42787e-0d96-11ef-bc97-c7b262605968@.service. 2024-05-08T23:58:02.271 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: disabled 2024-05-08T23:58:02.280 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2024-05-08T23:58:02.281 INFO:teuthology.orchestra.run.smithi026.stderr:firewalld.service is not enabled 2024-05-08T23:58:02.281 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to enable service . firewalld.service is not available 2024-05-08T23:58:02.290 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: disabled 2024-05-08T23:58:02.298 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2024-05-08T23:58:02.299 INFO:teuthology.orchestra.run.smithi026.stderr:firewalld.service is not enabled 2024-05-08T23:58:02.299 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-05-08T23:58:02.299 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mgr to start... 2024-05-08T23:58:02.299 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mgr... 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.903+0000 7f2e457ee700 1 Processor -- start 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.903+0000 7f2e457ee700 1 -- start start 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.903+0000 7f2e457ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e400ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.903+0000 7f2e457ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40100120 con 0x7f2e40071c60 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.904+0000 7f2e3effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e400ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.904+0000 7f2e3effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e400ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35708/0 (socket says 172.21.15.26:35708) 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.904+0000 7f2e3effd700 1 -- 172.21.15.26:0/4103452625 learned_addr learned my addr 172.21.15.26:0/4103452625 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.904+0000 7f2e3effd700 1 -- 172.21.15.26:0/4103452625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40100260 con 0x7f2e40071c60 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.904+0000 7f2e3effd700 1 --2- 172.21.15.26:0/4103452625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e400ffc30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f2e30009730 tx=0x7f2e300090f0).ready entity=mon.0 client_cookie=56c38e1da641ce45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:02.901 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.904+0000 7f2e3dffb700 1 -- 172.21.15.26:0/4103452625 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e3000b6e0 con 0x7f2e40071c60 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e3dffb700 1 -- 172.21.15.26:0/4103452625 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f2e3000bc90 con 0x7f2e40071c60 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e3dffb700 1 -- 172.21.15.26:0/4103452625 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e30011c70 con 0x7f2e40071c60 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e457ee700 1 -- 172.21.15.26:0/4103452625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 msgr2=0x7f2e400ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e457ee700 1 --2- 172.21.15.26:0/4103452625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e400ffc30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f2e30009730 tx=0x7f2e300090f0).stop 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e457ee700 1 -- 172.21.15.26:0/4103452625 shutdown_connections 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e457ee700 1 --2- 172.21.15.26:0/4103452625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e400ffc30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e457ee700 1 -- 172.21.15.26:0/4103452625 >> 172.21.15.26:0/4103452625 conn(0x7f2e400f76f0 msgr2=0x7f2e400f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e457ee700 1 -- 172.21.15.26:0/4103452625 shutdown_connections 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.905+0000 7f2e457ee700 1 -- 172.21.15.26:0/4103452625 wait complete. 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.906+0000 7f2e457ee700 1 Processor -- start 2024-05-08T23:58:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.906+0000 7f2e457ee700 1 -- start start 2024-05-08T23:58:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.906+0000 7f2e457ee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e4010be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.906+0000 7f2e457ee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4010c2f0 con 0x7f2e40071c60 2024-05-08T23:58:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.906+0000 7f2e3effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e4010be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.906+0000 7f2e3effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e4010be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35722/0 (socket says 172.21.15.26:35722) 2024-05-08T23:58:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.906+0000 7f2e3effd700 1 -- 172.21.15.26:0/1150927976 learned_addr learned my addr 172.21.15.26:0/1150927976 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.907+0000 7f2e3effd700 1 -- 172.21.15.26:0/1150927976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e30009370 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.907+0000 7f2e3effd700 1 --2- 172.21.15.26:0/1150927976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e4010be00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f2e3000c010 tx=0x7f2e300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.907+0000 7f2e27fff700 1 -- 172.21.15.26:0/1150927976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e3001a610 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.907+0000 7f2e27fff700 1 -- 172.21.15.26:0/1150927976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f2e3001abc0 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.907+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4010c4f0 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.907+0000 7f2e27fff700 1 -- 172.21.15.26:0/1150927976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e30022a20 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.907+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4010c900 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.908+0000 7f2e27fff700 1 -- 172.21.15.26:0/1150927976 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2e3001a770 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.908+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e40046ce0 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.908+0000 7f2e27fff700 1 -- 172.21.15.26:0/1150927976 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2e300239d0 con 0x7f2e40071c60 2024-05-08T23:58:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.910+0000 7f2e27fff700 1 -- 172.21.15.26:0/1150927976 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f2e30028060 con 0x7f2e40071c60 2024-05-08T23:58:02.981 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.980+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2e40100f20 con 0x7f2e40071c60 2024-05-08T23:58:02.981 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.980+0000 7f2e27fff700 1 -- 172.21.15.26:0/1150927976 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f2e3001e070 con 0x7f2e40071c60 2024-05-08T23:58:02.981 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsid": "aa42787e-0d96-11ef-bc97-c7b262605968", 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "health": { 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "checks": {}, 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mutes": [] 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum": [ 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 0 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:02.982 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "smithi026" 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_age": 9, 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "monmap": { 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osdmap": { 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-08T23:58:02.983 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgmap": { 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsmap": { 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-08T23:58:02.984 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": false, 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modules": [ 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "iostat", 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "nfs", 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "restful" 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "servicemap": { 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modified": "2024-05-08T23:57:45.461167+0000", 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2024-05-08T23:58:02.985 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.982+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 msgr2=0x7f2e4010be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.982+0000 7f2e457ee700 1 --2- 172.21.15.26:0/1150927976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e4010be00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f2e3000c010 tx=0x7f2e300090f0).stop 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.982+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 shutdown_connections 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.982+0000 7f2e457ee700 1 --2- 172.21.15.26:0/1150927976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2e40071c60 0x7f2e4010be00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.982+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 >> 172.21.15.26:0/1150927976 conn(0x7f2e400f76f0 msgr2=0x7f2e400f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.982+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 shutdown_connections 2024-05-08T23:58:02.986 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:02.982+0000 7f2e457ee700 1 -- 172.21.15.26:0/1150927976 wait complete. 2024-05-08T23:58:03.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:02.981855+0000 mon.smithi026 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.26:0/1150927976' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:58:03.690 INFO:teuthology.orchestra.run.smithi026.stderr:mgr not available, waiting (1/15)... 2024-05-08T23:58:06.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.289+0000 7fc298f7e700 1 Processor -- start 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.289+0000 7fc298f7e700 1 -- start start 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.289+0000 7fc298f7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.289+0000 7fc298f7e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc294100120 con 0x7fc294071c60 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.289+0000 7fc29259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.290+0000 7fc29259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35730/0 (socket says 172.21.15.26:35730) 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.290+0000 7fc29259c700 1 -- 172.21.15.26:0/87083333 learned_addr learned my addr 172.21.15.26:0/87083333 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.290+0000 7fc29259c700 1 -- 172.21.15.26:0/87083333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc294100260 con 0x7fc294071c60 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.290+0000 7fc29259c700 1 --2- 172.21.15.26:0/87083333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940ffc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc284009730 tx=0x7fc2840090f0).ready entity=mon.0 client_cookie=3fa2968d180ab1fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:06.286 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.290+0000 7fc29159a700 1 -- 172.21.15.26:0/87083333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc28400b6e0 con 0x7fc294071c60 2024-05-08T23:58:06.287 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.290+0000 7fc29159a700 1 -- 172.21.15.26:0/87083333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fc28400bc90 con 0x7fc294071c60 2024-05-08T23:58:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.290+0000 7fc29159a700 1 -- 172.21.15.26:0/87083333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc284011c70 con 0x7fc294071c60 2024-05-08T23:58:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.291+0000 7fc298f7e700 1 -- 172.21.15.26:0/87083333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 msgr2=0x7fc2940ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:06.290 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.291+0000 7fc298f7e700 1 --2- 172.21.15.26:0/87083333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940ffc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc284009730 tx=0x7fc2840090f0).stop 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.291+0000 7fc298f7e700 1 -- 172.21.15.26:0/87083333 shutdown_connections 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.291+0000 7fc298f7e700 1 --2- 172.21.15.26:0/87083333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940ffc30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.291+0000 7fc298f7e700 1 -- 172.21.15.26:0/87083333 >> 172.21.15.26:0/87083333 conn(0x7fc2940f76f0 msgr2=0x7fc2940f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.291+0000 7fc298f7e700 1 -- 172.21.15.26:0/87083333 shutdown_connections 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.291+0000 7fc298f7e700 1 -- 172.21.15.26:0/87083333 wait complete. 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.292+0000 7fc298f7e700 1 Processor -- start 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.292+0000 7fc298f7e700 1 -- start start 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.292+0000 7fc298f7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.292+0000 7fc298f7e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940fbb30 con 0x7fc294071c60 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.292+0000 7fc29259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.292+0000 7fc29259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940fd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35740/0 (socket says 172.21.15.26:35740) 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.292+0000 7fc29259c700 1 -- 172.21.15.26:0/2290104874 learned_addr learned my addr 172.21.15.26:0/2290104874 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:06.291 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc29259c700 1 -- 172.21.15.26:0/2290104874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284009370 con 0x7fc294071c60 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc29259c700 1 --2- 172.21.15.26:0/2290104874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940fd6b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc284000c00 tx=0x7fc2840090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc2837fe700 1 -- 172.21.15.26:0/2290104874 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc28401a610 con 0x7fc294071c60 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc298f7e700 1 -- 172.21.15.26:0/2290104874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2940fbcd0 con 0x7fc294071c60 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc298f7e700 1 -- 172.21.15.26:0/2290104874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2940fc0e0 con 0x7fc294071c60 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc2837fe700 1 -- 172.21.15.26:0/2290104874 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fc28401abc0 con 0x7fc294071c60 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc2837fe700 1 -- 172.21.15.26:0/2290104874 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc284022a20 con 0x7fc294071c60 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc2837fe700 1 -- 172.21.15.26:0/2290104874 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fc284023450 con 0x7fc294071c60 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.293+0000 7fc2837fe700 1 -- 172.21.15.26:0/2290104874 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc284019390 con 0x7fc294071c60 2024-05-08T23:58:06.292 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.294+0000 7fc2817fa700 1 -- 172.21.15.26:0/2290104874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc278005120 con 0x7fc294071c60 2024-05-08T23:58:06.294 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.298+0000 7fc2837fe700 1 -- 172.21.15.26:0/2290104874 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fc284028060 con 0x7fc294071c60 2024-05-08T23:58:06.364 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.369+0000 7fc2817fa700 1 -- 172.21.15.26:0/2290104874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc278005ac0 con 0x7fc294071c60 2024-05-08T23:58:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.369+0000 7fc2837fe700 1 -- 172.21.15.26:0/2290104874 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1250 (secure 0 0 0) 0x7fc28401e070 con 0x7fc294071c60 2024-05-08T23:58:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.367 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsid": "aa42787e-0d96-11ef-bc97-c7b262605968", 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "health": { 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "checks": {}, 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mutes": [] 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum": [ 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 0 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "smithi026" 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_age": 13, 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "monmap": { 2024-05-08T23:58:06.368 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osdmap": { 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgmap": { 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-08T23:58:06.369 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-08T23:58:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-08T23:58:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-08T23:58:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-08T23:58:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-08T23:58:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-08T23:58:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-08T23:58:06.373 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsmap": { 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": false, 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modules": [ 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "iostat", 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "nfs", 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "restful" 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:06.374 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "servicemap": { 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modified": "2024-05-08T23:57:45.461167+0000", 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.370+0000 7fc2817fa700 1 -- 172.21.15.26:0/2290104874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 msgr2=0x7fc2940fd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.371+0000 7fc2817fa700 1 --2- 172.21.15.26:0/2290104874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940fd6b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc284000c00 tx=0x7fc2840090f0).stop 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.371+0000 7fc2817fa700 1 -- 172.21.15.26:0/2290104874 shutdown_connections 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.371+0000 7fc2817fa700 1 --2- 172.21.15.26:0/2290104874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc294071c60 0x7fc2940fd6b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.371+0000 7fc2817fa700 1 -- 172.21.15.26:0/2290104874 >> 172.21.15.26:0/2290104874 conn(0x7fc2940f76f0 msgr2=0x7fc2940f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.371+0000 7fc2817fa700 1 -- 172.21.15.26:0/2290104874 shutdown_connections 2024-05-08T23:58:06.375 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:06.371+0000 7fc2817fa700 1 -- 172.21.15.26:0/2290104874 wait complete. 2024-05-08T23:58:06.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:06.370759+0000 mon.smithi026 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.26:0/2290104874' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:58:06.990 INFO:teuthology.orchestra.run.smithi026.stderr:mgr not available, waiting (2/15)... 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:07.798356+0000 mon.smithi026 (mon.0) 9 : cluster [INF] Activating manager daemon smithi026.brymfp 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:07.800976+0000 mon.smithi026 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi026.brymfp(active, starting, since 0.00271553s) 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.802115+0000 mon.smithi026 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.802249+0000 mon.smithi026 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.802359+0000 mon.smithi026 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.802497+0000 mon.smithi026 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.802764+0000 mon.smithi026 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:07.816043+0000 mon.smithi026 (mon.0) 16 : cluster [INF] Manager daemon smithi026.brymfp is now available 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.824874+0000 mon.smithi026 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:08.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.830492+0000 mon.smithi026 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:58:08.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.833009+0000 mon.smithi026 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-08T23:58:08.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.835925+0000 mon.smithi026 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:08.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:07.837844+0000 mon.smithi026 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.26:0/1115316910' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.547+0000 7fe331f20700 1 Processor -- start 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.547+0000 7fe331f20700 1 -- start start 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe331f20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe331f20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c100120 con 0x7fe32c071c60 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe32b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe32b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35812/0 (socket says 172.21.15.26:35812) 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe32b7fe700 1 -- 172.21.15.26:0/4071725006 learned_addr learned my addr 172.21.15.26:0/4071725006 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe32b7fe700 1 -- 172.21.15.26:0/4071725006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c100260 con 0x7fe32c071c60 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe32b7fe700 1 --2- 172.21.15.26:0/4071725006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0ffc30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fe31c009730 tx=0x7fe31c0090f0).ready entity=mon.0 client_cookie=c1ed56cd020955ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe32a7fc700 1 -- 172.21.15.26:0/4071725006 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe31c00b6e0 con 0x7fe32c071c60 2024-05-08T23:58:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.548+0000 7fe32a7fc700 1 -- 172.21.15.26:0/4071725006 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fe31c00bc90 con 0x7fe32c071c60 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.549+0000 7fe32a7fc700 1 -- 172.21.15.26:0/4071725006 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe31c011c70 con 0x7fe32c071c60 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.549+0000 7fe331f20700 1 -- 172.21.15.26:0/4071725006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 msgr2=0x7fe32c0ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.549+0000 7fe331f20700 1 --2- 172.21.15.26:0/4071725006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0ffc30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fe31c009730 tx=0x7fe31c0090f0).stop 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.549+0000 7fe331f20700 1 -- 172.21.15.26:0/4071725006 shutdown_connections 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.549+0000 7fe331f20700 1 --2- 172.21.15.26:0/4071725006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0ffc30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.549+0000 7fe331f20700 1 -- 172.21.15.26:0/4071725006 >> 172.21.15.26:0/4071725006 conn(0x7fe32c0f76f0 msgr2=0x7fe32c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.549+0000 7fe331f20700 1 -- 172.21.15.26:0/4071725006 shutdown_connections 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.549+0000 7fe331f20700 1 -- 172.21.15.26:0/4071725006 wait complete. 2024-05-08T23:58:09.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.550+0000 7fe331f20700 1 Processor -- start 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.550+0000 7fe331f20700 1 -- start start 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.550+0000 7fe331f20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.550+0000 7fe331f20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0fbb30 con 0x7fe32c071c60 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe32b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe32b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0fd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35818/0 (socket says 172.21.15.26:35818) 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe32b7fe700 1 -- 172.21.15.26:0/1629867824 learned_addr learned my addr 172.21.15.26:0/1629867824 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe32b7fe700 1 -- 172.21.15.26:0/1629867824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c009370 con 0x7fe32c071c60 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe32b7fe700 1 --2- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0fd6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe31c00c010 tx=0x7fe31c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe328ff9700 1 -- 172.21.15.26:0/1629867824 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe31c01a610 con 0x7fe32c071c60 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe328ff9700 1 -- 172.21.15.26:0/1629867824 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fe31c01abc0 con 0x7fe32c071c60 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c0fbcd0 con 0x7fe32c071c60 2024-05-08T23:58:09.548 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe328ff9700 1 -- 172.21.15.26:0/1629867824 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe31c022a20 con 0x7fe32c071c60 2024-05-08T23:58:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.551+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c0fc0e0 con 0x7fe32c071c60 2024-05-08T23:58:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.552+0000 7fe328ff9700 1 -- 172.21.15.26:0/1629867824 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 3) v1 ==== 38515+0+0 (secure 0 0 0) 0x7fe31c022c90 con 0x7fe32c071c60 2024-05-08T23:58:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.552+0000 7fe328ff9700 1 --2- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fe3180324e0 0x7fe3180349a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.552+0000 7fe328ff9700 1 -- 172.21.15.26:0/1629867824 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe31c044530 con 0x7fe32c071c60 2024-05-08T23:58:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.552+0000 7fe32affd700 1 --2- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fe3180324e0 0x7fe3180349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.553+0000 7fe32affd700 1 --2- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fe3180324e0 0x7fe3180349a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fe314009780 tx=0x7fe314006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:09.549 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.553+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c05a310 con 0x7fe32c071c60 2024-05-08T23:58:09.553 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.558+0000 7fe328ff9700 1 -- 172.21.15.26:0/1629867824 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe31c01e070 con 0x7fe32c071c60 2024-05-08T23:58:09.793 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.795+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe32c100f20 con 0x7fe32c071c60 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.796+0000 7fe328ff9700 1 -- 172.21.15.26:0/1629867824 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7fe31c018970 con 0x7fe32c071c60 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsid": "aa42787e-0d96-11ef-bc97-c7b262605968", 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "health": { 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "checks": {}, 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mutes": [] 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum": [ 2024-05-08T23:58:09.794 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 0 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "smithi026" 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "quorum_age": 16, 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "monmap": { 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osdmap": { 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:09.795 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-08T23:58:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-08T23:58:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-08T23:58:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-08T23:58:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-08T23:58:09.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgmap": { 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "fsmap": { 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-08T23:58:09.801 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": true, 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modules": [ 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "iostat", 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "nfs", 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "restful" 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ], 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "servicemap": { 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "modified": "2024-05-08T23:57:45.461167+0000", 2024-05-08T23:58:09.802 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "services": {} 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: }, 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fe3180324e0 msgr2=0x7fe3180349a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 --2- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fe3180324e0 0x7fe3180349a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fe314009780 tx=0x7fe314006cc0).stop 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 msgr2=0x7fe32c0fd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 --2- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0fd6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe31c00c010 tx=0x7fe31c0090f0).stop 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 shutdown_connections 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 --2- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fe3180324e0 0x7fe3180349a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 --2- 172.21.15.26:0/1629867824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe32c071c60 0x7fe32c0fd6b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 >> 172.21.15.26:0/1629867824 conn(0x7fe32c0f76f0 msgr2=0x7fe32c0f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 shutdown_connections 2024-05-08T23:58:09.803 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:09.798+0000 7fe331f20700 1 -- 172.21.15.26:0/1629867824 wait complete. 2024-05-08T23:58:10.133 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:08.804759+0000 mon.smithi026 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi026.brymfp(active, since 1.0065s) 2024-05-08T23:58:10.133 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:09.797496+0000 mon.smithi026 (mon.0) 23 : audit [DBG] from='client.? 172.21.15.26:0/1629867824' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:58:10.386 INFO:teuthology.orchestra.run.smithi026.stderr:mgr is available 2024-05-08T23:58:10.954 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.958+0000 7fdc1b835700 1 Processor -- start 2024-05-08T23:58:10.954 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.959+0000 7fdc1b835700 1 -- start start 2024-05-08T23:58:10.954 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.959+0000 7fdc1b835700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:10.955 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.959+0000 7fdc1b835700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14100160 con 0x7fdc14071c20 2024-05-08T23:58:10.955 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.959+0000 7fdc195d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:10.955 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.959+0000 7fdc195d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35828/0 (socket says 172.21.15.26:35828) 2024-05-08T23:58:10.957 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.959+0000 7fdc195d1700 1 -- 172.21.15.26:0/2655836818 learned_addr learned my addr 172.21.15.26:0/2655836818 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:10.957 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.959+0000 7fdc195d1700 1 -- 172.21.15.26:0/2655836818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc141002a0 con 0x7fdc14071c20 2024-05-08T23:58:10.957 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc195d1700 1 --2- 172.21.15.26:0/2655836818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140ffc70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fdc10009730 tx=0x7fdc100090f0).ready entity=mon.0 client_cookie=698cfba2a78698fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:10.957 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc07fff700 1 -- 172.21.15.26:0/2655836818 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc1000b770 con 0x7fdc14071c20 2024-05-08T23:58:10.957 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc07fff700 1 -- 172.21.15.26:0/2655836818 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fdc1000bd20 con 0x7fdc14071c20 2024-05-08T23:58:10.957 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc07fff700 1 -- 172.21.15.26:0/2655836818 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc10011cc0 con 0x7fdc14071c20 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc1b835700 1 -- 172.21.15.26:0/2655836818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 msgr2=0x7fdc140ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc1b835700 1 --2- 172.21.15.26:0/2655836818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140ffc70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fdc10009730 tx=0x7fdc100090f0).stop 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc1b835700 1 -- 172.21.15.26:0/2655836818 shutdown_connections 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc1b835700 1 --2- 172.21.15.26:0/2655836818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140ffc70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.960+0000 7fdc1b835700 1 -- 172.21.15.26:0/2655836818 >> 172.21.15.26:0/2655836818 conn(0x7fdc140f76f0 msgr2=0x7fdc140f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.961+0000 7fdc1b835700 1 -- 172.21.15.26:0/2655836818 shutdown_connections 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.961+0000 7fdc1b835700 1 -- 172.21.15.26:0/2655836818 wait complete. 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.961+0000 7fdc1b835700 1 Processor -- start 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.961+0000 7fdc1b835700 1 -- start start 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.961+0000 7fdc1b835700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:10.958 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.961+0000 7fdc1b835700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140fbb70 con 0x7fdc14071c20 2024-05-08T23:58:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.961+0000 7fdc195d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc195d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35844/0 (socket says 172.21.15.26:35844) 2024-05-08T23:58:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc195d1700 1 -- 172.21.15.26:0/13461716 learned_addr learned my addr 172.21.15.26:0/13461716 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc195d1700 1 -- 172.21.15.26:0/13461716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10009370 con 0x7fdc14071c20 2024-05-08T23:58:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc195d1700 1 --2- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140fd6f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fdc10011630 tx=0x7fdc100090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc067fc700 1 -- 172.21.15.26:0/13461716 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc10011400 con 0x7fdc14071c20 2024-05-08T23:58:10.959 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc067fc700 1 -- 172.21.15.26:0/13461716 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fdc10010e70 con 0x7fdc14071c20 2024-05-08T23:58:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc140fbd10 con 0x7fdc14071c20 2024-05-08T23:58:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc067fc700 1 -- 172.21.15.26:0/13461716 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc1001ab90 con 0x7fdc14071c20 2024-05-08T23:58:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.962+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc140fc120 con 0x7fdc14071c20 2024-05-08T23:58:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.963+0000 7fdc067fc700 1 -- 172.21.15.26:0/13461716 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7fdc1001acf0 con 0x7fdc14071c20 2024-05-08T23:58:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.963+0000 7fdc067fc700 1 --2- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fdc000325e0 0x7fdc00034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:10.960 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.963+0000 7fdc067fc700 1 -- 172.21.15.26:0/13461716 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdc10044720 con 0x7fdc14071c20 2024-05-08T23:58:10.961 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.963+0000 7fdc18dd0700 1 --2- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fdc000325e0 0x7fdc00034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:10.961 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.964+0000 7fdc18dd0700 1 --2- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fdc000325e0 0x7fdc00034aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fdc08009780 tx=0x7fdc08006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:10.961 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.964+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1405a310 con 0x7fdc14071c20 2024-05-08T23:58:10.963 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:10.969+0000 7fdc067fc700 1 -- 172.21.15.26:0/13461716 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fdc1001e070 con 0x7fdc14071c20 2024-05-08T23:58:11.134 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.139+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdc14046ce0 con 0x7fdc14071c20 2024-05-08T23:58:11.137 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.140+0000 7fdc067fc700 1 -- 172.21.15.26:0/13461716 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+398 (secure 0 0 0) 0x7fdc10018970 con 0x7fdc14071c20 2024-05-08T23:58:11.137 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.137 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [global] 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: fsid = aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: log_to_journald = false 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [mgr] 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: [osd] 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-05-08T23:58:11.138 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fdc000325e0 msgr2=0x7fdc00034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 --2- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fdc000325e0 0x7fdc00034aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fdc08009780 tx=0x7fdc08006cc0).stop 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 msgr2=0x7fdc140fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 --2- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140fd6f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fdc10011630 tx=0x7fdc100090f0).stop 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 shutdown_connections 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 --2- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fdc000325e0 0x7fdc00034aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 --2- 172.21.15.26:0/13461716 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc14071c20 0x7fdc140fd6f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 >> 172.21.15.26:0/13461716 conn(0x7fdc140f76f0 msgr2=0x7fdc140f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 shutdown_connections 2024-05-08T23:58:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:11.142+0000 7fdc1b835700 1 -- 172.21.15.26:0/13461716 wait complete. 2024-05-08T23:58:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:Enabling cephadm module... 2024-05-08T23:58:12.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:10.804342+0000 mon.smithi026 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi026.brymfp(active, since 3s) 2024-05-08T23:58:12.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:11.141451+0000 mon.smithi026 (mon.0) 25 : audit [INF] from='client.? 172.21.15.26:0/13461716' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T23:58:12.209 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.209+0000 7fb605eaf700 1 Processor -- start 2024-05-08T23:58:12.209 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.209+0000 7fb605eaf700 1 -- start start 2024-05-08T23:58:12.209 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb605eaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb6000fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb605eaf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6000fd8d0 con 0x7fb6000fcfc0 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb5ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb6000fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb5ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb6000fd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54244/0 (socket says 172.21.15.26:54244) 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb5ff7fe700 1 -- 172.21.15.26:0/939728569 learned_addr learned my addr 172.21.15.26:0/939728569 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb5ff7fe700 1 -- 172.21.15.26:0/939728569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6000fda10 con 0x7fb6000fcfc0 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb5ff7fe700 1 --2- 172.21.15.26:0/939728569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb6000fd3e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb5f0009730 tx=0x7fb5f00090f0).ready entity=mon.0 client_cookie=827697e8661077 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb5fe7fc700 1 -- 172.21.15.26:0/939728569 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5f000b6e0 con 0x7fb6000fcfc0 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.210+0000 7fb5fe7fc700 1 -- 172.21.15.26:0/939728569 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb5f000bc90 con 0x7fb6000fcfc0 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.211+0000 7fb5fe7fc700 1 -- 172.21.15.26:0/939728569 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5f0011c70 con 0x7fb6000fcfc0 2024-05-08T23:58:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.211+0000 7fb605eaf700 1 -- 172.21.15.26:0/939728569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 msgr2=0x7fb6000fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.211+0000 7fb605eaf700 1 --2- 172.21.15.26:0/939728569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb6000fd3e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb5f0009730 tx=0x7fb5f00090f0).stop 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.211+0000 7fb605eaf700 1 -- 172.21.15.26:0/939728569 shutdown_connections 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.211+0000 7fb605eaf700 1 --2- 172.21.15.26:0/939728569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb6000fd3e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.211+0000 7fb605eaf700 1 -- 172.21.15.26:0/939728569 >> 172.21.15.26:0/939728569 conn(0x7fb6000f87a0 msgr2=0x7fb6000fabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.211+0000 7fb605eaf700 1 -- 172.21.15.26:0/939728569 shutdown_connections 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.211+0000 7fb605eaf700 1 -- 172.21.15.26:0/939728569 wait complete. 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.212+0000 7fb605eaf700 1 Processor -- start 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.212+0000 7fb605eaf700 1 -- start start 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.212+0000 7fb605eaf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb60010be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.212+0000 7fb605eaf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60010c310 con 0x7fb6000fcfc0 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.212+0000 7fb5ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb60010be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.212+0000 7fb5ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb60010be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54260/0 (socket says 172.21.15.26:54260) 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.212+0000 7fb5ff7fe700 1 -- 172.21.15.26:0/1334640868 learned_addr learned my addr 172.21.15.26:0/1334640868 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.212+0000 7fb5ff7fe700 1 -- 172.21.15.26:0/1334640868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0009370 con 0x7fb6000fcfc0 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.213+0000 7fb5ff7fe700 1 --2- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb60010be20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb5f00115c0 tx=0x7fb5f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.213+0000 7fb5fcff9700 1 -- 172.21.15.26:0/1334640868 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5f001a610 con 0x7fb6000fcfc0 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.213+0000 7fb5fcff9700 1 -- 172.21.15.26:0/1334640868 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb5f001abc0 con 0x7fb6000fcfc0 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.213+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60010c510 con 0x7fb6000fcfc0 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.213+0000 7fb5fcff9700 1 -- 172.21.15.26:0/1334640868 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5f0022a40 con 0x7fb6000fcfc0 2024-05-08T23:58:12.212 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.213+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60010c920 con 0x7fb6000fcfc0 2024-05-08T23:58:12.213 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.213+0000 7fb5fcff9700 1 -- 172.21.15.26:0/1334640868 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7fb5f0022d00 con 0x7fb6000fcfc0 2024-05-08T23:58:12.213 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.214+0000 7fb5fcff9700 1 --2- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fb5e8032590 0x7fb5e8034a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:12.213 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.214+0000 7fb5fcff9700 1 -- 172.21.15.26:0/1334640868 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb5f00455c0 con 0x7fb6000fcfc0 2024-05-08T23:58:12.213 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.214+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb600046ce0 con 0x7fb6000fcfc0 2024-05-08T23:58:12.213 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.214+0000 7fb5feffd700 1 --2- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fb5e8032590 0x7fb5e8034a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:12.213 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.214+0000 7fb5feffd700 1 --2- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fb5e8032590 0x7fb5e8034a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb5f4009780 tx=0x7fb5f4006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:12.214 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.219+0000 7fb5fcff9700 1 -- 172.21.15.26:0/1334640868 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb5f001e070 con 0x7fb6000fcfc0 2024-05-08T23:58:12.431 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.433+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fb600105c80 con 0x7fb6000fcfc0 2024-05-08T23:58:12.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.804+0000 7fb5fcff9700 1 -- 172.21.15.26:0/1334640868 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fb5f00198b0 con 0x7fb6000fcfc0 2024-05-08T23:58:12.800 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.805+0000 7fb5fcff9700 1 -- 172.21.15.26:0/1334640868 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fb5f001ec50 con 0x7fb6000fcfc0 2024-05-08T23:58:12.804 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.808+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fb5e8032590 msgr2=0x7fb5e8034a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:12.804 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.808+0000 7fb605eaf700 1 --2- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fb5e8032590 0x7fb5e8034a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb5f4009780 tx=0x7fb5f4006cc0).stop 2024-05-08T23:58:12.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.808+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 msgr2=0x7fb60010be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:12.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.808+0000 7fb605eaf700 1 --2- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb60010be20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fb5f00115c0 tx=0x7fb5f00090f0).stop 2024-05-08T23:58:12.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.808+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 shutdown_connections 2024-05-08T23:58:12.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.808+0000 7fb605eaf700 1 --2- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7fb5e8032590 0x7fb5e8034a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:12.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.808+0000 7fb605eaf700 1 --2- 172.21.15.26:0/1334640868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6000fcfc0 0x7fb60010be20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:12.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.808+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 >> 172.21.15.26:0/1334640868 conn(0x7fb6000f87a0 msgr2=0x7fb6000fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:12.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.809+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 shutdown_connections 2024-05-08T23:58:12.805 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:12.809+0000 7fb605eaf700 1 -- 172.21.15.26:0/1334640868 wait complete. 2024-05-08T23:58:13.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:12.435590+0000 mon.smithi026 (mon.0) 26 : audit [INF] from='client.? 172.21.15.26:0/1334640868' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-08T23:58:14.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.029+0000 7f8add9c1700 1 Processor -- start 2024-05-08T23:58:14.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.029+0000 7f8add9c1700 1 -- start start 2024-05-08T23:58:14.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8add9c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad81020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:14.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8add9c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80fdaa0 con 0x7f8ad8071be0 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8ad6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad81020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8ad6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad81020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54282/0 (socket says 172.21.15.26:54282) 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8ad6ffd700 1 -- 172.21.15.26:0/3658105385 learned_addr learned my addr 172.21.15.26:0/3658105385 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8ad6ffd700 1 -- 172.21.15.26:0/3658105385 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad81025a0 con 0x7f8ad8071be0 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8ad6ffd700 1 --2- 172.21.15.26:0/3658105385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad81020b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8ac8009730 tx=0x7f8ac80090f0).ready entity=mon.0 client_cookie=5049c284f3de25c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8ad5ffb700 1 -- 172.21.15.26:0/3658105385 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ac800b6e0 con 0x7f8ad8071be0 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8ad5ffb700 1 -- 172.21.15.26:0/3658105385 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8ac800bc90 con 0x7f8ad8071be0 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.030+0000 7f8ad5ffb700 1 -- 172.21.15.26:0/3658105385 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ac8011c70 con 0x7f8ad8071be0 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.031+0000 7f8add9c1700 1 -- 172.21.15.26:0/3658105385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 msgr2=0x7f8ad81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.031+0000 7f8add9c1700 1 --2- 172.21.15.26:0/3658105385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad81020b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8ac8009730 tx=0x7f8ac80090f0).stop 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.031+0000 7f8add9c1700 1 -- 172.21.15.26:0/3658105385 shutdown_connections 2024-05-08T23:58:14.038 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.031+0000 7f8add9c1700 1 --2- 172.21.15.26:0/3658105385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad81020b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.031+0000 7f8add9c1700 1 -- 172.21.15.26:0/3658105385 >> 172.21.15.26:0/3658105385 conn(0x7f8ad80f76f0 msgr2=0x7f8ad80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.031+0000 7f8add9c1700 1 -- 172.21.15.26:0/3658105385 shutdown_connections 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.031+0000 7f8add9c1700 1 -- 172.21.15.26:0/3658105385 wait complete. 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.031+0000 7f8add9c1700 1 Processor -- start 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8add9c1700 1 -- start start 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8add9c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8add9c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad810e4b0 con 0x7f8ad8071be0 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8ad6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8ad6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad810dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54284/0 (socket says 172.21.15.26:54284) 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8ad6ffd700 1 -- 172.21.15.26:0/1695427835 learned_addr learned my addr 172.21.15.26:0/1695427835 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8ad6ffd700 1 -- 172.21.15.26:0/1695427835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8009370 con 0x7f8ad8071be0 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8ad6ffd700 1 --2- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad810dfc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8ac800c010 tx=0x7f8ac80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.032+0000 7f8abffff700 1 -- 172.21.15.26:0/1695427835 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ac801a610 con 0x7f8ad8071be0 2024-05-08T23:58:14.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.033+0000 7f8abffff700 1 -- 172.21.15.26:0/1695427835 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8ac801abc0 con 0x7f8ad8071be0 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.033+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad810e6b0 con 0x7f8ad8071be0 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.033+0000 7f8abffff700 1 -- 172.21.15.26:0/1695427835 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ac8022a20 con 0x7f8ad8071be0 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.033+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad810eac0 con 0x7f8ad8071be0 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.033+0000 7f8abffff700 1 -- 172.21.15.26:0/1695427835 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f8ac8022ce0 con 0x7f8ad8071be0 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.033+0000 7f8abffff700 1 --2- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f8ac0032610 0x7f8ac0034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.034+0000 7f8abffff700 1 -- 172.21.15.26:0/1695427835 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8ac80455c0 con 0x7f8ad8071be0 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.034+0000 7f8ad67fc700 1 -- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f8ac0032610 msgr2=0x7f8ac0034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1390633078 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.034+0000 7f8ad67fc700 1 --2- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f8ac0032610 0x7f8ac0034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.034+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad805a310 con 0x7f8ad8071be0 2024-05-08T23:58:14.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.039+0000 7f8abffff700 1 -- 172.21.15.26:0/1695427835 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8ac801e080 con 0x7f8ad8071be0 2024-05-08T23:58:14.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:12.807297+0000 mon.smithi026 (mon.0) 27 : audit [INF] from='client.? 172.21.15.26:0/1334640868' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-08T23:58:14.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:12.807343+0000 mon.smithi026 (mon.0) 28 : cluster [DBG] mgrmap e5: smithi026.brymfp(active, since 5s) 2024-05-08T23:58:14.230 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.235+0000 7f8ad67fc700 1 -- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f8ac0032610 msgr2=0x7f8ac0034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1390633078 2024-05-08T23:58:14.230 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.235+0000 7f8ad67fc700 1 --2- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f8ac0032610 0x7f8ac0034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:58:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.299+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f8ad8107d60 con 0x7f8ad8071be0 2024-05-08T23:58:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.300+0000 7f8abffff700 1 -- 172.21.15.26:0/1695427835 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f8ac8018d80 con 0x7f8ad8071be0 2024-05-08T23:58:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2024-05-08T23:58:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 5, 2024-05-08T23:58:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": true, 2024-05-08T23:58:14.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "active_name": "smithi026.brymfp", 2024-05-08T23:58:14.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standby": 0 2024-05-08T23:58:14.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2024-05-08T23:58:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f8ac0032610 msgr2=0x7f8ac0034ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 --2- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f8ac0032610 0x7f8ac0034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 msgr2=0x7f8ad810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 --2- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad810dfc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8ac800c010 tx=0x7f8ac80090f0).stop 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 shutdown_connections 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 --2- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f8ac0032610 0x7f8ac0034ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 --2- 172.21.15.26:0/1695427835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ad8071be0 0x7f8ad810dfc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 >> 172.21.15.26:0/1695427835 conn(0x7f8ad80f76f0 msgr2=0x7f8ad80f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 shutdown_connections 2024-05-08T23:58:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:14.302+0000 7f8add9c1700 1 -- 172.21.15.26:0/1695427835 wait complete. 2024-05-08T23:58:14.905 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for the mgr to restart... 2024-05-08T23:58:14.905 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mgr epoch 5... 2024-05-08T23:58:15.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:14.301443+0000 mon.smithi026 (mon.0) 29 : audit [DBG] from='client.? 172.21.15.26:0/1695427835' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T23:58:15.519 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.523+0000 7f2988323700 1 Processor -- start 2024-05-08T23:58:15.519 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.523+0000 7f2988323700 1 -- start start 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.523+0000 7f2988323700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f29801020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.523+0000 7f2988323700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800fdaa0 con 0x7f2980071be0 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.523+0000 7f29860bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f29801020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.523+0000 7f29860bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f29801020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54298/0 (socket says 172.21.15.26:54298) 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.523+0000 7f29860bf700 1 -- 172.21.15.26:0/2173364647 learned_addr learned my addr 172.21.15.26:0/2173364647 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.524+0000 7f29860bf700 1 -- 172.21.15.26:0/2173364647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29801025a0 con 0x7f2980071be0 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.524+0000 7f29860bf700 1 --2- 172.21.15.26:0/2173364647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f29801020b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f297c009730 tx=0x7f297c0090f0).ready entity=mon.0 client_cookie=f4f258155124441b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.524+0000 7f29850bd700 1 -- 172.21.15.26:0/2173364647 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f297c00b6e0 con 0x7f2980071be0 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.524+0000 7f29850bd700 1 -- 172.21.15.26:0/2173364647 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f297c00bc90 con 0x7f2980071be0 2024-05-08T23:58:15.520 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.524+0000 7f29850bd700 1 -- 172.21.15.26:0/2173364647 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f297c011c70 con 0x7f2980071be0 2024-05-08T23:58:15.521 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 -- 172.21.15.26:0/2173364647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 msgr2=0x7f29801020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:15.523 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 --2- 172.21.15.26:0/2173364647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f29801020b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f297c009730 tx=0x7f297c0090f0).stop 2024-05-08T23:58:15.523 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 -- 172.21.15.26:0/2173364647 shutdown_connections 2024-05-08T23:58:15.523 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 --2- 172.21.15.26:0/2173364647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f29801020b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 -- 172.21.15.26:0/2173364647 >> 172.21.15.26:0/2173364647 conn(0x7f29800f76f0 msgr2=0x7f29800f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 -- 172.21.15.26:0/2173364647 shutdown_connections 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 -- 172.21.15.26:0/2173364647 wait complete. 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 Processor -- start 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.525+0000 7f2988323700 1 -- start start 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f2988323700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f298010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f2988323700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298010e4b0 con 0x7f2980071be0 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f29860bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f298010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f29860bf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f298010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54300/0 (socket says 172.21.15.26:54300) 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f29860bf700 1 -- 172.21.15.26:0/2734095962 learned_addr learned my addr 172.21.15.26:0/2734095962 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f29860bf700 1 -- 172.21.15.26:0/2734095962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c009370 con 0x7f2980071be0 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f29860bf700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f298010dfc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f297c000c00 tx=0x7f297c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:15.524 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f297c01a610 con 0x7f2980071be0 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298010e6b0 con 0x7f2980071be0 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f297c01abc0 con 0x7f2980071be0 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f297c022a20 con 0x7f2980071be0 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.526+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298010eac0 con 0x7f2980071be0 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.527+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f297c022cf0 con 0x7f2980071be0 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.528+0000 7f29777fe700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 0x7f296c034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.528+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 --> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f296c0351e0 con 0x7f296c032660 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.528+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f297c0447d0 con 0x7f2980071be0 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.528+0000 7f29858be700 1 -- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 msgr2=0x7f296c034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1390633078 2024-05-08T23:58:15.525 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.528+0000 7f29858be700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 0x7f296c034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:58:15.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.729+0000 7f29858be700 1 -- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 msgr2=0x7f296c034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1390633078 2024-05-08T23:58:15.724 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:15.729+0000 7f29858be700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 0x7f296c034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:58:16.125 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:16.130+0000 7f29858be700 1 -- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 msgr2=0x7f296c034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1390633078 2024-05-08T23:58:16.125 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:16.130+0000 7f29858be700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 0x7f296c034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-05-08T23:58:16.926 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:16.931+0000 7f29858be700 1 -- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 msgr2=0x7f296c034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/1390633078 2024-05-08T23:58:16.926 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:16.931+0000 7f29858be700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 0x7f296c034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-05-08T23:58:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:18.406+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mgrmap(e 6) v1 ==== 38456+0+0 (secure 0 0 0) 0x7f297c0198b0 con 0x7f2980071be0 2024-05-08T23:58:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:18.406+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 msgr2=0x7f296c034b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:58:18.401 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:18.406+0000 7f29777fe700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 0x7f296c034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:18.405288+0000 mon.smithi026 (mon.0) 30 : cluster [INF] Active manager daemon smithi026.brymfp restarted 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:18.405511+0000 mon.smithi026 (mon.0) 31 : cluster [INF] Activating manager daemon smithi026.brymfp 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:18.408413+0000 mon.smithi026 (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:18.408538+0000 mon.smithi026 (mon.0) 33 : cluster [DBG] mgrmap e6: smithi026.brymfp(active, starting, since 0.00311128s) 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.409266+0000 mon.smithi026 (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.409827+0000 mon.smithi026 (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.410474+0000 mon.smithi026 (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.410635+0000 mon.smithi026 (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.410762+0000 mon.smithi026 (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:18.425041+0000 mon.smithi026 (mon.0) 39 : cluster [INF] Manager daemon smithi026.brymfp is now available 2024-05-08T23:58:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.437609+0000 mon.smithi026 (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.407+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 7) v1 ==== 38526+0+0 (secure 0 0 0) 0x7f297c019390 con 0x7f2980071be0 2024-05-08T23:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.407+0000 7f29777fe700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f296c035fd0 0x7f296c0383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.407+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f296c0351e0 con 0x7f296c035fd0 2024-05-08T23:58:19.403 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.408+0000 7f29858be700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f296c035fd0 0x7f296c0383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:19.404 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.408+0000 7f29858be700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f296c035fd0 0x7f296c0383c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f2970003850 tx=0x7f2970006ea0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:19.404 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.409+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f296c0351e0 con 0x7f296c035fd0 2024-05-08T23:58:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.415+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f298005a310 con 0x7f296c035fd0 2024-05-08T23:58:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f29777fe700 1 -- 172.21.15.26:0/2734095962 <== mgr.14116 v2:172.21.15.26:6800/3965746041 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f298005a310 con 0x7f296c035fd0 2024-05-08T23:58:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2024-05-08T23:58:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-05-08T23:58:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "initialized": true 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f296c035fd0 msgr2=0x7f296c0383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f296c035fd0 0x7f296c0383c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f2970003850 tx=0x7f2970006ea0).stop 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 msgr2=0x7f298010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f298010dfc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f297c000c00 tx=0x7f297c0090f0).stop 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 shutdown_connections 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f296c035fd0 0x7f296c0383c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2980071be0 0x7f298010dfc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 --2- 172.21.15.26:0/2734095962 >> [v2:172.21.15.26:6800/1390633078,v1:172.21.15.26:6801/1390633078] conn(0x7f296c032660 0x7f296c034b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:58:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 >> 172.21.15.26:0/2734095962 conn(0x7f29800f76f0 msgr2=0x7f29800f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 shutdown_connections 2024-05-08T23:58:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:19.416+0000 7f2988323700 1 -- 172.21.15.26:0/2734095962 wait complete. 2024-05-08T23:58:19.810 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:18.434978+0000 mgr.smithi026.brymfp (mgr.14116) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-05-08T23:58:19.810 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.527681+0000 mon.smithi026 (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:19.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.528674+0000 mon.smithi026 (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:19.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.530553+0000 mon.smithi026 (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:19.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.532349+0000 mon.smithi026 (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:19.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.546438+0000 mon.smithi026 (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:58:19.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:18.549066+0000 mon.smithi026 (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-08T23:58:19.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:19.411362+0000 mon.smithi026 (mon.0) 47 : cluster [DBG] mgrmap e7: smithi026.brymfp(active, since 1.00593s) 2024-05-08T23:58:20.098 INFO:teuthology.orchestra.run.smithi026.stderr:mgr epoch 5 is available 2024-05-08T23:58:20.098 INFO:teuthology.orchestra.run.smithi026.stderr:Setting orchestrator backend to cephadm... 2024-05-08T23:58:20.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:19.410488+0000 mgr.smithi026.brymfp (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T23:58:20.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:19.417306+0000 mgr.smithi026.brymfp (mgr.14116) 3 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.663+0000 7fcfa31da700 1 Processor -- start 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.663+0000 7fcfa31da700 1 -- start start 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcfa31da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcfa31da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c100120 con 0x7fcf9c071c60 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcfa0f76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcfa0f76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54360/0 (socket says 172.21.15.26:54360) 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcfa0f76700 1 -- 172.21.15.26:0/3091754914 learned_addr learned my addr 172.21.15.26:0/3091754914 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcfa0f76700 1 -- 172.21.15.26:0/3091754914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c100260 con 0x7fcf9c071c60 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcfa0f76700 1 --2- 172.21.15.26:0/3091754914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0ffc30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcf90009730 tx=0x7fcf900090f0).ready entity=mon.0 client_cookie=eb5e173c2f1a2ee8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcf9b7fe700 1 -- 172.21.15.26:0/3091754914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf9000b6e0 con 0x7fcf9c071c60 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcf9b7fe700 1 -- 172.21.15.26:0/3091754914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fcf9000bc90 con 0x7fcf9c071c60 2024-05-08T23:58:20.660 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.664+0000 7fcf9b7fe700 1 -- 172.21.15.26:0/3091754914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf90011c70 con 0x7fcf9c071c60 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.665+0000 7fcfa31da700 1 -- 172.21.15.26:0/3091754914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 msgr2=0x7fcf9c0ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.665+0000 7fcfa31da700 1 --2- 172.21.15.26:0/3091754914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0ffc30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcf90009730 tx=0x7fcf900090f0).stop 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.665+0000 7fcfa31da700 1 -- 172.21.15.26:0/3091754914 shutdown_connections 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.665+0000 7fcfa31da700 1 --2- 172.21.15.26:0/3091754914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0ffc30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.665+0000 7fcfa31da700 1 -- 172.21.15.26:0/3091754914 >> 172.21.15.26:0/3091754914 conn(0x7fcf9c0f76f0 msgr2=0x7fcf9c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.665+0000 7fcfa31da700 1 -- 172.21.15.26:0/3091754914 shutdown_connections 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.665+0000 7fcfa31da700 1 -- 172.21.15.26:0/3091754914 wait complete. 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.666+0000 7fcfa31da700 1 Processor -- start 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.666+0000 7fcfa31da700 1 -- start start 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.666+0000 7fcfa31da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.666+0000 7fcfa31da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0fbb30 con 0x7fcf9c071c60 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcfa0f76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcfa0f76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0fd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54366/0 (socket says 172.21.15.26:54366) 2024-05-08T23:58:20.663 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcfa0f76700 1 -- 172.21.15.26:0/2926102675 learned_addr learned my addr 172.21.15.26:0/2926102675 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcfa0f76700 1 -- 172.21.15.26:0/2926102675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90009370 con 0x7fcf9c071c60 2024-05-08T23:58:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcfa0f76700 1 --2- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0fd6b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcf9000c010 tx=0x7fcf900090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcf99ffb700 1 -- 172.21.15.26:0/2926102675 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf9001a610 con 0x7fcf9c071c60 2024-05-08T23:58:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcf99ffb700 1 -- 172.21.15.26:0/2926102675 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fcf9001abc0 con 0x7fcf9c071c60 2024-05-08T23:58:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c0fbcd0 con 0x7fcf9c071c60 2024-05-08T23:58:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcf99ffb700 1 -- 172.21.15.26:0/2926102675 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf90022a20 con 0x7fcf9c071c60 2024-05-08T23:58:20.664 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.667+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c0fc0e0 con 0x7fcf9c071c60 2024-05-08T23:58:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.668+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c046ce0 con 0x7fcf9c071c60 2024-05-08T23:58:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.669+0000 7fcf99ffb700 1 -- 172.21.15.26:0/2926102675 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fcf90022c90 con 0x7fcf9c071c60 2024-05-08T23:58:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.669+0000 7fcf99ffb700 1 --2- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fcf8c032660 0x7fcf8c034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.669+0000 7fcf99ffb700 1 -- 172.21.15.26:0/2926102675 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fcf90044c20 con 0x7fcf9c071c60 2024-05-08T23:58:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.669+0000 7fcf9bfff700 1 --2- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fcf8c032660 0x7fcf8c034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:20.665 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.669+0000 7fcf9bfff700 1 --2- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fcf8c032660 0x7fcf8c034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fcf88009780 tx=0x7fcf88006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:20.668 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.674+0000 7fcf99ffb700 1 -- 172.21.15.26:0/2926102675 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcf9001a770 con 0x7fcf9c071c60 2024-05-08T23:58:20.854 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.859+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf9c105d20 con 0x7fcf8c032660 2024-05-08T23:58:20.859 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.864+0000 7fcf99ffb700 1 -- 172.21.15.26:0/2926102675 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcf9c105d20 con 0x7fcf8c032660 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fcf8c032660 msgr2=0x7fcf8c034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 --2- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fcf8c032660 0x7fcf8c034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fcf88009780 tx=0x7fcf88006cc0).stop 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 msgr2=0x7fcf9c0fd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 --2- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0fd6b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcf9000c010 tx=0x7fcf900090f0).stop 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 shutdown_connections 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 --2- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fcf8c032660 0x7fcf8c034b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 --2- 172.21.15.26:0/2926102675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf9c071c60 0x7fcf9c0fd6b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 >> 172.21.15.26:0/2926102675 conn(0x7fcf9c0f76f0 msgr2=0x7fcf9c0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 shutdown_connections 2024-05-08T23:58:20.862 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:20.866+0000 7fcfa31da700 1 -- 172.21.15.26:0/2926102675 wait complete. 2024-05-08T23:58:21.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:20.532162+0000 mon.smithi026 (mon.0) 48 : cluster [DBG] mgrmap e8: smithi026.brymfp(active, since 2s) 2024-05-08T23:58:21.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:20.865505+0000 mon.smithi026 (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:21.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:20.907238+0000 mon.smithi026 (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.942+0000 7f6eb12d7700 1 Processor -- start 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.942+0000 7f6eb12d7700 1 -- start start 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.942+0000 7f6eb12d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac0fd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.942+0000 7f6eb12d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0fdea0 con 0x7f6eac0fd590 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.942+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac0fd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.942+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac0fd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35686/0 (socket says 172.21.15.26:35686) 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.942+0000 7f6eaaffd700 1 -- 172.21.15.26:0/2395663619 learned_addr learned my addr 172.21.15.26:0/2395663619 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.942+0000 7f6eaaffd700 1 -- 172.21.15.26:0/2395663619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0fdfe0 con 0x7f6eac0fd590 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6eaaffd700 1 --2- 172.21.15.26:0/2395663619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac0fd9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6e9c009730 tx=0x7f6e9c0090f0).ready entity=mon.0 client_cookie=d2c5e6a6b23f4851 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6ea9ffb700 1 -- 172.21.15.26:0/2395663619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e9c00b6e0 con 0x7f6eac0fd590 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6ea9ffb700 1 -- 172.21.15.26:0/2395663619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6e9c00bc90 con 0x7f6eac0fd590 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6ea9ffb700 1 -- 172.21.15.26:0/2395663619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e9c011c70 con 0x7f6eac0fd590 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6eb12d7700 1 -- 172.21.15.26:0/2395663619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 msgr2=0x7f6eac0fd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6eb12d7700 1 --2- 172.21.15.26:0/2395663619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac0fd9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6e9c009730 tx=0x7f6e9c0090f0).stop 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6eb12d7700 1 -- 172.21.15.26:0/2395663619 shutdown_connections 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6eb12d7700 1 --2- 172.21.15.26:0/2395663619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac0fd9b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.943+0000 7f6eb12d7700 1 -- 172.21.15.26:0/2395663619 >> 172.21.15.26:0/2395663619 conn(0x7f6eac0f6e20 msgr2=0x7f6eac0f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.944+0000 7f6eb12d7700 1 -- 172.21.15.26:0/2395663619 shutdown_connections 2024-05-08T23:58:21.940 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.944+0000 7f6eb12d7700 1 -- 172.21.15.26:0/2395663619 wait complete. 2024-05-08T23:58:21.942 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.944+0000 7f6eb12d7700 1 Processor -- start 2024-05-08T23:58:21.942 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.944+0000 7f6eb12d7700 1 -- start start 2024-05-08T23:58:21.942 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eb12d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac10df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:21.942 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eb12d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac10e410 con 0x7f6eac0fd590 2024-05-08T23:58:21.942 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac10df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:21.942 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac10df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35694/0 (socket says 172.21.15.26:35694) 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eaaffd700 1 -- 172.21.15.26:0/417049230 learned_addr learned my addr 172.21.15.26:0/417049230 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eaaffd700 1 -- 172.21.15.26:0/417049230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c009370 con 0x7f6eac0fd590 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eaaffd700 1 --2- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac10df20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6e9c002f40 tx=0x7f6e9c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6e93fff700 1 -- 172.21.15.26:0/417049230 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e9c01a610 con 0x7f6eac0fd590 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6e93fff700 1 -- 172.21.15.26:0/417049230 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6e9c01abc0 con 0x7f6eac0fd590 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac10e610 con 0x7f6eac0fd590 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6e93fff700 1 -- 172.21.15.26:0/417049230 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e9c0229d0 con 0x7f6eac0fd590 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.945+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac10ea20 con 0x7f6eac0fd590 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.946+0000 7f6e93fff700 1 -- 172.21.15.26:0/417049230 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f6e9c022c90 con 0x7f6eac0fd590 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.946+0000 7f6e93fff700 1 --2- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6e94032610 0x7f6e94034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.946+0000 7f6e93fff700 1 -- 172.21.15.26:0/417049230 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f6e9c044bf0 con 0x7f6eac0fd590 2024-05-08T23:58:21.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.946+0000 7f6eaa7fc700 1 --2- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6e94032610 0x7f6e94034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:21.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.946+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac05a310 con 0x7f6eac0fd590 2024-05-08T23:58:21.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.947+0000 7f6eaa7fc700 1 --2- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6e94032610 0x7f6e94034ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f6ea0009780 tx=0x7f6ea0006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:21.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:21.951+0000 7f6e93fff700 1 -- 172.21.15.26:0/417049230 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6e9c01e070 con 0x7f6eac0fd590 2024-05-08T23:58:22.120 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.125+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eac107de0 con 0x7f6e94032610 2024-05-08T23:58:22.121 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.125+0000 7f6e93fff700 1 -- 172.21.15.26:0/417049230 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f6eac107de0 con 0x7f6e94032610 2024-05-08T23:58:22.121 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: value unchanged 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6e94032610 msgr2=0x7f6e94034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 --2- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6e94032610 0x7f6e94034ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f6ea0009780 tx=0x7f6ea0006cc0).stop 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 msgr2=0x7f6eac10df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 --2- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac10df20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6e9c002f40 tx=0x7f6e9c0090f0).stop 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 shutdown_connections 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 --2- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6e94032610 0x7f6e94034ad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 --2- 172.21.15.26:0/417049230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eac0fd590 0x7f6eac10df20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 >> 172.21.15.26:0/417049230 conn(0x7f6eac0f6e20 msgr2=0x7f6eac0f8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 shutdown_connections 2024-05-08T23:58:22.123 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:22.127+0000 7f6eb12d7700 1 -- 172.21.15.26:0/417049230 wait complete. 2024-05-08T23:58:22.768 INFO:teuthology.orchestra.run.smithi026.stderr:Generating ssh key... 2024-05-08T23:58:22.770 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:20.861406+0000 mgr.smithi026.brymfp (mgr.14116) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.313+0000 7f2c7a111700 1 Processor -- start 2024-05-08T23:58:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.313+0000 7f2c7a111700 1 -- start start 2024-05-08T23:58:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.313+0000 7f2c7a111700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.313+0000 7f2c7a111700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74100160 con 0x7f2c74071c20 2024-05-08T23:58:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.313+0000 7f2c737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.313+0000 7f2c737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35706/0 (socket says 172.21.15.26:35706) 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.313+0000 7f2c737fe700 1 -- 172.21.15.26:0/1213922144 learned_addr learned my addr 172.21.15.26:0/1213922144 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.314+0000 7f2c737fe700 1 -- 172.21.15.26:0/1213922144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c741002a0 con 0x7f2c74071c20 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.314+0000 7f2c737fe700 1 --2- 172.21.15.26:0/1213922144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740ffc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2c64009730 tx=0x7f2c640090f0).ready entity=mon.0 client_cookie=d3a6a17b72d0083 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.314+0000 7f2c727fc700 1 -- 172.21.15.26:0/1213922144 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c6400b770 con 0x7f2c74071c20 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.314+0000 7f2c727fc700 1 -- 172.21.15.26:0/1213922144 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f2c6400bd20 con 0x7f2c74071c20 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.314+0000 7f2c727fc700 1 -- 172.21.15.26:0/1213922144 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c64011cc0 con 0x7f2c74071c20 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.314+0000 7f2c7a111700 1 -- 172.21.15.26:0/1213922144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 msgr2=0x7f2c740ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.314+0000 7f2c7a111700 1 --2- 172.21.15.26:0/1213922144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740ffc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2c64009730 tx=0x7f2c640090f0).stop 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.314+0000 7f2c7a111700 1 -- 172.21.15.26:0/1213922144 shutdown_connections 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.315+0000 7f2c7a111700 1 --2- 172.21.15.26:0/1213922144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740ffc70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.315+0000 7f2c7a111700 1 -- 172.21.15.26:0/1213922144 >> 172.21.15.26:0/1213922144 conn(0x7f2c740f76f0 msgr2=0x7f2c740f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.315+0000 7f2c7a111700 1 -- 172.21.15.26:0/1213922144 shutdown_connections 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.315+0000 7f2c7a111700 1 -- 172.21.15.26:0/1213922144 wait complete. 2024-05-08T23:58:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.315+0000 7f2c7a111700 1 Processor -- start 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.315+0000 7f2c7a111700 1 -- start start 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.315+0000 7f2c7a111700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.315+0000 7f2c7a111700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740fbb70 con 0x7f2c74071c20 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35716/0 (socket says 172.21.15.26:35716) 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c737fe700 1 -- 172.21.15.26:0/2010812683 learned_addr learned my addr 172.21.15.26:0/2010812683 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c737fe700 1 -- 172.21.15.26:0/2010812683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64009370 con 0x7f2c74071c20 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c737fe700 1 --2- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740fd6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2c64011630 tx=0x7f2c640090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c70ff9700 1 -- 172.21.15.26:0/2010812683 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c64011ae0 con 0x7f2c74071c20 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c740fbd10 con 0x7f2c74071c20 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c70ff9700 1 -- 172.21.15.26:0/2010812683 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f2c6400be90 con 0x7f2c74071c20 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c70ff9700 1 -- 172.21.15.26:0/2010812683 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c6401aaf0 con 0x7f2c74071c20 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.316+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c740fc120 con 0x7f2c74071c20 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.317+0000 7f2c70ff9700 1 -- 172.21.15.26:0/2010812683 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f2c64023400 con 0x7f2c74071c20 2024-05-08T23:58:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.317+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c74046ce0 con 0x7f2c74071c20 2024-05-08T23:58:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.317+0000 7f2c70ff9700 1 --2- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2c60032610 0x7f2c60034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.317+0000 7f2c70ff9700 1 -- 172.21.15.26:0/2010812683 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f2c64044fc0 con 0x7f2c74071c20 2024-05-08T23:58:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.317+0000 7f2c72ffd700 1 --2- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2c60032610 0x7f2c60034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.318+0000 7f2c72ffd700 1 --2- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2c60032610 0x7f2c60034ad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2c5c009780 tx=0x7f2c5c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.322+0000 7f2c70ff9700 1 -- 172.21.15.26:0/2010812683 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2c64073f60 con 0x7f2c74071c20 2024-05-08T23:58:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.498+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c74105ce0 con 0x7f2c60032610 2024-05-08T23:58:23.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:22.127186+0000 mgr.smithi026.brymfp (mgr.14116) 5 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:23.994 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:23.999+0000 7f2c70ff9700 1 -- 172.21.15.26:0/2010812683 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2c74105ce0 con 0x7f2c60032610 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2c60032610 msgr2=0x7f2c60034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 --2- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2c60032610 0x7f2c60034ad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2c5c009780 tx=0x7f2c5c006cc0).stop 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 msgr2=0x7f2c740fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 --2- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740fd6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2c64011630 tx=0x7f2c640090f0).stop 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 shutdown_connections 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 --2- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2c60032610 0x7f2c60034ad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 --2- 172.21.15.26:0/2010812683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74071c20 0x7f2c740fd6f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 >> 172.21.15.26:0/2010812683 conn(0x7f2c740f76f0 msgr2=0x7f2c740f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 shutdown_connections 2024-05-08T23:58:23.997 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:24.001+0000 7f2c7a111700 1 -- 172.21.15.26:0/2010812683 wait complete. 2024-05-08T23:58:24.817 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:23.500261+0000 mgr.smithi026.brymfp (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:24.817 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:23.500494+0000 mgr.smithi026.brymfp (mgr.14116) 7 : cephadm [INF] Generating ssh key... 2024-05-08T23:58:24.818 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:23.998258+0000 mon.smithi026 (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:24.818 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:23.999925+0000 mon.smithi026 (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.155+0000 7ff683ded700 1 Processor -- start 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.155+0000 7ff683ded700 1 -- start start 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.156+0000 7ff683ded700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.156+0000 7ff683ded700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0fc7e0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.156+0000 7ff681b89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.156+0000 7ff681b89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c0fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35720/0 (socket says 172.21.15.26:35720) 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.156+0000 7ff681b89700 1 -- 172.21.15.26:0/321951460 learned_addr learned my addr 172.21.15.26:0/321951460 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.156+0000 7ff681b89700 1 -- 172.21.15.26:0/321951460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0fc920 con 0x7ff67c0fbed0 2024-05-08T23:58:25.152 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.156+0000 7ff681b89700 1 --2- 172.21.15.26:0/321951460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c0fc2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff678009730 tx=0x7ff6780090f0).ready entity=mon.0 client_cookie=bfe8cca01a0419f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff680b87700 1 -- 172.21.15.26:0/321951460 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff67800b6e0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff680b87700 1 -- 172.21.15.26:0/321951460 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff67800bc90 con 0x7ff67c0fbed0 2024-05-08T23:58:25.153 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff680b87700 1 -- 172.21.15.26:0/321951460 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff678011c70 con 0x7ff67c0fbed0 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff683ded700 1 -- 172.21.15.26:0/321951460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 msgr2=0x7ff67c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff683ded700 1 --2- 172.21.15.26:0/321951460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c0fc2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff678009730 tx=0x7ff6780090f0).stop 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff683ded700 1 -- 172.21.15.26:0/321951460 shutdown_connections 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff683ded700 1 --2- 172.21.15.26:0/321951460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c0fc2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff683ded700 1 -- 172.21.15.26:0/321951460 >> 172.21.15.26:0/321951460 conn(0x7ff67c0f76f0 msgr2=0x7ff67c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.157+0000 7ff683ded700 1 -- 172.21.15.26:0/321951460 shutdown_connections 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.158+0000 7ff683ded700 1 -- 172.21.15.26:0/321951460 wait complete. 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.158+0000 7ff683ded700 1 Processor -- start 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.158+0000 7ff683ded700 1 -- start start 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff683ded700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c10dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff683ded700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c10e4a0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff681b89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c10dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:25.156 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff681b89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c10dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35734/0 (socket says 172.21.15.26:35734) 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff681b89700 1 -- 172.21.15.26:0/3954789067 learned_addr learned my addr 172.21.15.26:0/3954789067 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff681b89700 1 -- 172.21.15.26:0/3954789067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff678009370 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff681b89700 1 --2- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c10dfb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff6780115c0 tx=0x7ff6780090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff66effd700 1 -- 172.21.15.26:0/3954789067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff67801a610 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff66effd700 1 -- 172.21.15.26:0/3954789067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7ff67801abc0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c10e6a0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff66effd700 1 -- 172.21.15.26:0/3954789067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff678022a40 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.159+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c10eab0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.160+0000 7ff66effd700 1 -- 172.21.15.26:0/3954789067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7ff678022cb0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.160+0000 7ff66effd700 1 --2- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff668032630 0x7ff668034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.160+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c046ce0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.160+0000 7ff66effd700 1 -- 172.21.15.26:0/3954789067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff678044dd0 con 0x7ff67c0fbed0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.160+0000 7ff681388700 1 --2- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff668032630 0x7ff668034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:25.157 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.161+0000 7ff681388700 1 --2- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff668032630 0x7ff668034af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff670009780 tx=0x7ff670006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:25.160 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.165+0000 7ff66effd700 1 -- 172.21.15.26:0/3954789067 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff678018970 con 0x7ff67c0fbed0 2024-05-08T23:58:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.337+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff67c10f390 con 0x7ff668032630 2024-05-08T23:58:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.338+0000 7ff66effd700 1 -- 172.21.15.26:0/3954789067 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7ff67c10f390 con 0x7ff668032630 2024-05-08T23:58:25.333 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa8AOz00TAMM5/csM044U12Z+SA+pQWxMca4J/qNQBbiqfXN4uqnpHIs+fOKvoLjxvpjWHKSVo2zBDpYY+L2JXLiMsW3SUO52mIURAyOe/SXr3BaEQvGTxtn7KNbJmA+e18RP72QUwv9OfI/503t/0etwRN4MSYAFKTl4OTKcu9Z84WwBlYBgskFkfbK8ouCYD2XK8oYPK19Xp/prvoY0xUMugdccH2+lczecpg2beAxfs3Pz9zgdg1BxrPuNCXTGQPBZBHVCTU2HjrxqQiCjnonb/9hS3fIH9zo63/9idSzGnYNFZrLbOwevD+VE35SMUpOBahmiqmM1sBz7uNgUuFIFOqbCvpQdMpV/fuJ3+aFdanhc5DXSaVO85TKWH8Gd1WuDKEcqQHBdnleudGmR5+6bsEoawMKPmJBcHWvXyVbdmgPg/RfWFRryDuBFx0ilHX42gTw2nszM2YktXFjvHNxVTSTbqdtfLi1CwwbYgq/qG8V9TGz/KZhRZt286z3c= ceph-aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:58:25.335 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff668032630 msgr2=0x7ff668034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 --2- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff668032630 0x7ff668034af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff670009780 tx=0x7ff670006cc0).stop 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 msgr2=0x7ff67c10dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 --2- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c10dfb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff6780115c0 tx=0x7ff6780090f0).stop 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 shutdown_connections 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 --2- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff668032630 0x7ff668034af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 --2- 172.21.15.26:0/3954789067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff67c0fbed0 0x7ff67c10dfb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 >> 172.21.15.26:0/3954789067 conn(0x7ff67c0f76f0 msgr2=0x7ff67c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 shutdown_connections 2024-05-08T23:58:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:25.340+0000 7ff683ded700 1 -- 172.21.15.26:0/3954789067 wait complete. 2024-05-08T23:58:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-08T23:58:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:Adding key to root@localhost authorized_keys... 2024-05-08T23:58:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:Adding host smithi026... 2024-05-08T23:58:26.097 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:25.339857+0000 mgr.smithi026.brymfp (mgr.14116) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:26.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.420+0000 7f541582d700 1 Processor -- start 2024-05-08T23:58:26.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.420+0000 7f541582d700 1 -- start start 2024-05-08T23:58:26.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.421+0000 7f541582d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f54100fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:26.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.421+0000 7f541582d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54100feeb0 con 0x7f54100fe5a0 2024-05-08T23:58:26.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.421+0000 7f540effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f54100fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:26.417 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.421+0000 7f540effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f54100fe9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35738/0 (socket says 172.21.15.26:35738) 2024-05-08T23:58:26.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.421+0000 7f540effd700 1 -- 172.21.15.26:0/1565772940 learned_addr learned my addr 172.21.15.26:0/1565772940 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:26.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.421+0000 7f540effd700 1 -- 172.21.15.26:0/1565772940 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54100feff0 con 0x7f54100fe5a0 2024-05-08T23:58:26.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.421+0000 7f540effd700 1 --2- 172.21.15.26:0/1565772940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f54100fe9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5400009730 tx=0x7f54000090f0).ready entity=mon.0 client_cookie=6f807e647bd3b12b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:26.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f540dffb700 1 -- 172.21.15.26:0/1565772940 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f540000b6e0 con 0x7f54100fe5a0 2024-05-08T23:58:26.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f540dffb700 1 -- 172.21.15.26:0/1565772940 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f540000bc90 con 0x7f54100fe5a0 2024-05-08T23:58:26.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f540dffb700 1 -- 172.21.15.26:0/1565772940 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5400011c70 con 0x7f54100fe5a0 2024-05-08T23:58:26.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f541582d700 1 -- 172.21.15.26:0/1565772940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 msgr2=0x7f54100fe9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:26.418 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f541582d700 1 --2- 172.21.15.26:0/1565772940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f54100fe9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5400009730 tx=0x7f54000090f0).stop 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f541582d700 1 -- 172.21.15.26:0/1565772940 shutdown_connections 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f541582d700 1 --2- 172.21.15.26:0/1565772940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f54100fe9c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f541582d700 1 -- 172.21.15.26:0/1565772940 >> 172.21.15.26:0/1565772940 conn(0x7f54100f6e20 msgr2=0x7f54100f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f541582d700 1 -- 172.21.15.26:0/1565772940 shutdown_connections 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.422+0000 7f541582d700 1 -- 172.21.15.26:0/1565772940 wait complete. 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.423+0000 7f541582d700 1 Processor -- start 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.423+0000 7f541582d700 1 -- start start 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.423+0000 7f541582d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f541010bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.423+0000 7f541582d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541010c280 con 0x7f54100fe5a0 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.423+0000 7f540effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f541010bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.423+0000 7f540effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f541010bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35742/0 (socket says 172.21.15.26:35742) 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.423+0000 7f540effd700 1 -- 172.21.15.26:0/1124695556 learned_addr learned my addr 172.21.15.26:0/1124695556 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:26.420 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.424+0000 7f540effd700 1 -- 172.21.15.26:0/1124695556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400009370 con 0x7f54100fe5a0 2024-05-08T23:58:26.421 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.424+0000 7f540effd700 1 --2- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f541010bd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5400002f40 tx=0x7f54000090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:26.421 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.424+0000 7f53f7fff700 1 -- 172.21.15.26:0/1124695556 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f540001a610 con 0x7f54100fe5a0 2024-05-08T23:58:26.421 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.424+0000 7f53f7fff700 1 -- 172.21.15.26:0/1124695556 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f540001abc0 con 0x7f54100fe5a0 2024-05-08T23:58:26.421 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.424+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541010c480 con 0x7f54100fe5a0 2024-05-08T23:58:26.421 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.424+0000 7f53f7fff700 1 -- 172.21.15.26:0/1124695556 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54000229d0 con 0x7f54100fe5a0 2024-05-08T23:58:26.421 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.424+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541010c890 con 0x7f54100fe5a0 2024-05-08T23:58:26.421 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.425+0000 7f53f7fff700 1 -- 172.21.15.26:0/1124695556 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f5400022c90 con 0x7f54100fe5a0 2024-05-08T23:58:26.422 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.425+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5410046ce0 con 0x7f54100fe5a0 2024-05-08T23:58:26.422 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.425+0000 7f53f7fff700 1 --2- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f53f8032610 0x7f53f8034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:26.422 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.425+0000 7f53f7fff700 1 -- 172.21.15.26:0/1124695556 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f5400044bd0 con 0x7f54100fe5a0 2024-05-08T23:58:26.422 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.425+0000 7f540e7fc700 1 --2- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f53f8032610 0x7f53f8034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:26.422 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.426+0000 7f540e7fc700 1 --2- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f53f8032610 0x7f53f8034ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f5404009780 tx=0x7f5404006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:26.425 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.430+0000 7f53f7fff700 1 -- 172.21.15.26:0/1124695556 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5400018d80 con 0x7f54100fe5a0 2024-05-08T23:58:26.600 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:26.605+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi026", "addr": "172.21.15.26", "target": ["mon-mgr", ""]}) v1 -- 0x7f541010d090 con 0x7f53f8032610 2024-05-08T23:58:27.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:26 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:26.607867+0000 mgr.smithi026.brymfp (mgr.14116) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi026", "addr": "172.21.15.26", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:27.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Added host 'smithi026' with addr '172.21.15.26' 2024-05-08T23:58:27.240 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.243+0000 7f53f7fff700 1 -- 172.21.15.26:0/1124695556 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f541010d090 con 0x7f53f8032610 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f53f8032610 msgr2=0x7f53f8034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 --2- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f53f8032610 0x7f53f8034ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f5404009780 tx=0x7f5404006cc0).stop 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 msgr2=0x7f541010bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 --2- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f541010bd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5400002f40 tx=0x7f54000090f0).stop 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 shutdown_connections 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 --2- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f53f8032610 0x7f53f8034ad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 --2- 172.21.15.26:0/1124695556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54100fe5a0 0x7f541010bd90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 >> 172.21.15.26:0/1124695556 conn(0x7f54100f6e20 msgr2=0x7f5410100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 shutdown_connections 2024-05-08T23:58:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:27.245+0000 7f541582d700 1 -- 172.21.15.26:0/1124695556 wait complete. 2024-05-08T23:58:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying mon service with default placement... 2024-05-08T23:58:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.374+0000 7f1cd7ca5700 1 Processor -- start 2024-05-08T23:58:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.374+0000 7f1cd7ca5700 1 -- start start 2024-05-08T23:58:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.374+0000 7f1cd7ca5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd00fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.374+0000 7f1cd7ca5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00fc7e0 con 0x7f1cd00fbed0 2024-05-08T23:58:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.375+0000 7f1cd5a41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd00fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.375+0000 7f1cd5a41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd00fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35758/0 (socket says 172.21.15.26:35758) 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.375+0000 7f1cd5a41700 1 -- 172.21.15.26:0/4084719010 learned_addr learned my addr 172.21.15.26:0/4084719010 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.375+0000 7f1cd5a41700 1 -- 172.21.15.26:0/4084719010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00fc920 con 0x7f1cd00fbed0 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.375+0000 7f1cd5a41700 1 --2- 172.21.15.26:0/4084719010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd00fc2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1cc0009730 tx=0x7f1cc00090f0).ready entity=mon.0 client_cookie=662d3873acf71cf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.375+0000 7f1cd4a3f700 1 -- 172.21.15.26:0/4084719010 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cc000b6e0 con 0x7f1cd00fbed0 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.375+0000 7f1cd4a3f700 1 -- 172.21.15.26:0/4084719010 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1cc000bc90 con 0x7f1cd00fbed0 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.375+0000 7f1cd4a3f700 1 -- 172.21.15.26:0/4084719010 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cc0011c70 con 0x7f1cd00fbed0 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/4084719010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 msgr2=0x7f1cd00fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 --2- 172.21.15.26:0/4084719010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd00fc2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1cc0009730 tx=0x7f1cc00090f0).stop 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/4084719010 shutdown_connections 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 --2- 172.21.15.26:0/4084719010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd00fc2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/4084719010 >> 172.21.15.26:0/4084719010 conn(0x7f1cd00f76f0 msgr2=0x7f1cd00f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/4084719010 shutdown_connections 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/4084719010 wait complete. 2024-05-08T23:58:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 Processor -- start 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.376+0000 7f1cd7ca5700 1 -- start start 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd7ca5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd010eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd7ca5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0071ca0 con 0x7f1cd00fbed0 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd5a41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd010eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd5a41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd010eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35760/0 (socket says 172.21.15.26:35760) 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd5a41700 1 -- 172.21.15.26:0/629529072 learned_addr learned my addr 172.21.15.26:0/629529072 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd5a41700 1 -- 172.21.15.26:0/629529072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0009370 con 0x7f1cd00fbed0 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd5a41700 1 --2- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd010eab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1cc0011870 tx=0x7f1cc00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cc6ffd700 1 -- 172.21.15.26:0/629529072 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cc001a610 con 0x7f1cd00fbed0 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd0071ea0 con 0x7f1cd00fbed0 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cc6ffd700 1 -- 172.21.15.26:0/629529072 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1cc001abc0 con 0x7f1cd00fbed0 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cc6ffd700 1 -- 172.21.15.26:0/629529072 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cc0022a30 con 0x7f1cd00fbed0 2024-05-08T23:58:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.377+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd010f160 con 0x7f1cd00fbed0 2024-05-08T23:58:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.378+0000 7f1cc6ffd700 1 -- 172.21.15.26:0/629529072 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f1cc0022cf0 con 0x7f1cd00fbed0 2024-05-08T23:58:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.378+0000 7f1cc6ffd700 1 --2- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1cbc032610 0x7f1cbc034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.378+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd0046ce0 con 0x7f1cd00fbed0 2024-05-08T23:58:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.378+0000 7f1cc6ffd700 1 -- 172.21.15.26:0/629529072 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f1cc0044c00 con 0x7f1cd00fbed0 2024-05-08T23:58:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.378+0000 7f1cd5240700 1 --2- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1cbc032610 0x7f1cbc034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.379+0000 7f1cd5240700 1 --2- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1cbc032610 0x7f1cbc034ad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f1ccc009780 tx=0x7f1ccc006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.384+0000 7f1cc6ffd700 1 -- 172.21.15.26:0/629529072 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1cc00223b0 con 0x7f1cd00fbed0 2024-05-08T23:58:28.562 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.567+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cd0059120 con 0x7f1cbc032610 2024-05-08T23:58:28.567 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.571+0000 7f1cc6ffd700 1 -- 172.21.15.26:0/629529072 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1cd0059120 con 0x7f1cbc032610 2024-05-08T23:58:28.567 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled mon update... 2024-05-08T23:58:28.569 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1cbc032610 msgr2=0x7f1cbc034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:28.569 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 --2- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1cbc032610 0x7f1cbc034ad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f1ccc009780 tx=0x7f1ccc006cc0).stop 2024-05-08T23:58:28.569 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 msgr2=0x7f1cd010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:28.570 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 --2- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd010eab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1cc0011870 tx=0x7f1cc00090f0).stop 2024-05-08T23:58:28.570 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 shutdown_connections 2024-05-08T23:58:28.570 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 --2- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1cbc032610 0x7f1cbc034ad0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:28.570 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 --2- 172.21.15.26:0/629529072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cd00fbed0 0x7f1cd010eab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:28.570 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 >> 172.21.15.26:0/629529072 conn(0x7f1cd00f76f0 msgr2=0x7f1cd00f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:28.570 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 shutdown_connections 2024-05-08T23:58:28.570 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:28.575+0000 7f1cd7ca5700 1 -- 172.21.15.26:0/629529072 wait complete. 2024-05-08T23:58:28.589 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:27.244145+0000 mon.smithi026 (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:28.589 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:27.244427+0000 mgr.smithi026.brymfp (mgr.14116) 10 : cephadm [INF] Added host smithi026 2024-05-08T23:58:28.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:27.284032+0000 mon.smithi026 (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:29.433 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying mgr service with default placement... 2024-05-08T23:58:29.688 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:28.569604+0000 mgr.smithi026.brymfp (mgr.14116) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:29.688 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:28.570728+0000 mgr.smithi026.brymfp (mgr.14116) 12 : cephadm [INF] Saving service mon spec with placement count:5 2024-05-08T23:58:29.688 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:28.573021+0000 mon.smithi026 (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1ee1efa700 1 Processor -- start 2024-05-08T23:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1ee1efa700 1 -- start start 2024-05-08T23:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1ee1efa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1ee1efa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc100120 con 0x7f1edc071c60 2024-05-08T23:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1edb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1edb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35764/0 (socket says 172.21.15.26:35764) 2024-05-08T23:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1edb7fe700 1 -- 172.21.15.26:0/1322941938 learned_addr learned my addr 172.21.15.26:0/1322941938 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:30.671 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1edb7fe700 1 -- 172.21.15.26:0/1322941938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc100260 con 0x7f1edc071c60 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.311+0000 7f1edb7fe700 1 --2- 172.21.15.26:0/1322941938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0ffc30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1ed0009730 tx=0x7f1ed00090f0).ready entity=mon.0 client_cookie=2f86683a043082d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1eda7fc700 1 -- 172.21.15.26:0/1322941938 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ed000b6e0 con 0x7f1edc071c60 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1eda7fc700 1 -- 172.21.15.26:0/1322941938 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1ed000bc90 con 0x7f1edc071c60 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1eda7fc700 1 -- 172.21.15.26:0/1322941938 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ed0011c70 con 0x7f1edc071c60 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1ee1efa700 1 -- 172.21.15.26:0/1322941938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 msgr2=0x7f1edc0ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1ee1efa700 1 --2- 172.21.15.26:0/1322941938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0ffc30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1ed0009730 tx=0x7f1ed00090f0).stop 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1ee1efa700 1 -- 172.21.15.26:0/1322941938 shutdown_connections 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1ee1efa700 1 --2- 172.21.15.26:0/1322941938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0ffc30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1ee1efa700 1 -- 172.21.15.26:0/1322941938 >> 172.21.15.26:0/1322941938 conn(0x7f1edc0f76f0 msgr2=0x7f1edc0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1ee1efa700 1 -- 172.21.15.26:0/1322941938 shutdown_connections 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.312+0000 7f1ee1efa700 1 -- 172.21.15.26:0/1322941938 wait complete. 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.313+0000 7f1ee1efa700 1 Processor -- start 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.313+0000 7f1ee1efa700 1 -- start start 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1ee1efa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:30.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1ee1efa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0fbb30 con 0x7f1edc071c60 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1edb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1edb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0fd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35774/0 (socket says 172.21.15.26:35774) 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1edb7fe700 1 -- 172.21.15.26:0/3858171337 learned_addr learned my addr 172.21.15.26:0/3858171337 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1edb7fe700 1 -- 172.21.15.26:0/3858171337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0009370 con 0x7f1edc071c60 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1edb7fe700 1 --2- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0fd6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1ed0000c00 tx=0x7f1ed00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1ed8ff9700 1 -- 172.21.15.26:0/3858171337 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ed001a610 con 0x7f1edc071c60 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1ed8ff9700 1 -- 172.21.15.26:0/3858171337 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1ed001abc0 con 0x7f1edc071c60 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc0fbcd0 con 0x7f1edc071c60 2024-05-08T23:58:30.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1ed8ff9700 1 -- 172.21.15.26:0/3858171337 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ed0022a20 con 0x7f1edc071c60 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.314+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc0fc0e0 con 0x7f1edc071c60 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.315+0000 7f1ed8ff9700 1 -- 172.21.15.26:0/3858171337 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f1ed0022c90 con 0x7f1edc071c60 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.315+0000 7f1ed8ff9700 1 --2- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1ec4032660 0x7f1ec4034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.315+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc046ce0 con 0x7f1edc071c60 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.315+0000 7f1ed8ff9700 1 -- 172.21.15.26:0/3858171337 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f1ed0044e20 con 0x7f1edc071c60 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.315+0000 7f1edaffd700 1 --2- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1ec4032660 0x7f1ec4034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.316+0000 7f1edaffd700 1 --2- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1ec4032660 0x7f1ec4034b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1ecc009780 tx=0x7f1ecc006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.320+0000 7f1ed8ff9700 1 -- 172.21.15.26:0/3858171337 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1ed0018d80 con 0x7f1edc071c60 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.500+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f1edc105cd0 con 0x7f1ec4032660 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.504+0000 7f1ed8ff9700 1 -- 172.21.15.26:0/3858171337 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1edc105cd0 con 0x7f1ec4032660 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1ec4032660 msgr2=0x7f1ec4034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 --2- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1ec4032660 0x7f1ec4034b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1ecc009780 tx=0x7f1ecc006cc0).stop 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 msgr2=0x7f1edc0fd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:30.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 --2- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0fd6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1ed0000c00 tx=0x7f1ed00090f0).stop 2024-05-08T23:58:30.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 shutdown_connections 2024-05-08T23:58:30.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 --2- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1ec4032660 0x7f1ec4034b20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:30.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 --2- 172.21.15.26:0/3858171337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1edc071c60 0x7f1edc0fd6b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:30.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 >> 172.21.15.26:0/3858171337 conn(0x7f1edc0f76f0 msgr2=0x7f1edc0f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:30.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.505+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 shutdown_connections 2024-05-08T23:58:30.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:30.506+0000 7f1ee1efa700 1 -- 172.21.15.26:0/3858171337 wait complete. 2024-05-08T23:58:30.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-05-08T23:58:31.319 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying crash service with default placement... 2024-05-08T23:58:31.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:30.501129+0000 mgr.smithi026.brymfp (mgr.14116) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:31.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:30.501928+0000 mgr.smithi026.brymfp (mgr.14116) 14 : cephadm [INF] Saving service mgr spec with placement count:2 2024-05-08T23:58:31.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:30.504123+0000 mon.smithi026 (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:31.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:30.544954+0000 mon.smithi026 (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:31.579 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:30.922352+0000 mon.smithi026 (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.826+0000 7f215832e700 1 Processor -- start 2024-05-08T23:58:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.826+0000 7f215832e700 1 -- start start 2024-05-08T23:58:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.826+0000 7f215832e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f21500ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.826+0000 7f215832e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150100160 con 0x7f2150071c20 2024-05-08T23:58:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.827+0000 7f21560ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f21500ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.827+0000 7f21560ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f21500ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36034/0 (socket says 172.21.15.26:36034) 2024-05-08T23:58:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.827+0000 7f21560ca700 1 -- 172.21.15.26:0/3017683166 learned_addr learned my addr 172.21.15.26:0/3017683166 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.827+0000 7f21560ca700 1 -- 172.21.15.26:0/3017683166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21501002a0 con 0x7f2150071c20 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.827+0000 7f21560ca700 1 --2- 172.21.15.26:0/3017683166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f21500ffc70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f214c009730 tx=0x7f214c0090f0).ready entity=mon.0 client_cookie=fd6bfd2403c46e7d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.827+0000 7f21550c8700 1 -- 172.21.15.26:0/3017683166 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c00b770 con 0x7f2150071c20 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.827+0000 7f21550c8700 1 -- 172.21.15.26:0/3017683166 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f214c00bd60 con 0x7f2150071c20 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.827+0000 7f21550c8700 1 -- 172.21.15.26:0/3017683166 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c011d90 con 0x7f2150071c20 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 -- 172.21.15.26:0/3017683166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 msgr2=0x7f21500ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 --2- 172.21.15.26:0/3017683166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f21500ffc70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f214c009730 tx=0x7f214c0090f0).stop 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 -- 172.21.15.26:0/3017683166 shutdown_connections 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 --2- 172.21.15.26:0/3017683166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f21500ffc70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 -- 172.21.15.26:0/3017683166 >> 172.21.15.26:0/3017683166 conn(0x7f21500f76f0 msgr2=0x7f21500f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 -- 172.21.15.26:0/3017683166 shutdown_connections 2024-05-08T23:58:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 -- 172.21.15.26:0/3017683166 wait complete. 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 Processor -- start 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.828+0000 7f215832e700 1 -- start start 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f215832e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f215010bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f215832e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215010c3c0 con 0x7f2150071c20 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f21560ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f215010bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f21560ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f215010bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36044/0 (socket says 172.21.15.26:36044) 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f21560ca700 1 -- 172.21.15.26:0/3422827179 learned_addr learned my addr 172.21.15.26:0/3422827179 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f21560ca700 1 -- 172.21.15.26:0/3422827179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c009370 con 0x7f2150071c20 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f21560ca700 1 --2- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f215010bed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f214c009f00 tx=0x7f214c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f21477fe700 1 -- 172.21.15.26:0/3422827179 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c011bb0 con 0x7f2150071c20 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f21477fe700 1 -- 172.21.15.26:0/3422827179 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f214c00bbc0 con 0x7f2150071c20 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f21477fe700 1 -- 172.21.15.26:0/3422827179 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c01ab20 con 0x7f2150071c20 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215010c5c0 con 0x7f2150071c20 2024-05-08T23:58:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.829+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215010c9d0 con 0x7f2150071c20 2024-05-08T23:58:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.830+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2150046ce0 con 0x7f2150071c20 2024-05-08T23:58:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.831+0000 7f21477fe700 1 -- 172.21.15.26:0/3422827179 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f214c0108b0 con 0x7f2150071c20 2024-05-08T23:58:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.831+0000 7f21477fe700 1 --2- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f213c032630 0x7f213c034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.831+0000 7f21477fe700 1 -- 172.21.15.26:0/3422827179 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f214c045260 con 0x7f2150071c20 2024-05-08T23:58:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.831+0000 7f21558c9700 1 --2- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f213c032630 0x7f213c034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.831+0000 7f21558c9700 1 --2- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f213c032630 0x7f213c034af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2140009780 tx=0x7f2140006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:31.835+0000 7f21477fe700 1 -- 172.21.15.26:0/3422827179 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f214c02b920 con 0x7f2150071c20 2024-05-08T23:58:32.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.024+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f215010d170 con 0x7f213c032630 2024-05-08T23:58:32.022 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.028+0000 7f21477fe700 1 -- 172.21.15.26:0/3422827179 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f215010d170 con 0x7f213c032630 2024-05-08T23:58:32.022 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled crash update... 2024-05-08T23:58:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f213c032630 msgr2=0x7f213c034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 --2- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f213c032630 0x7f213c034af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2140009780 tx=0x7f2140006cc0).stop 2024-05-08T23:58:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 msgr2=0x7f215010bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 --2- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f215010bed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f214c009f00 tx=0x7f214c0090f0).stop 2024-05-08T23:58:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 shutdown_connections 2024-05-08T23:58:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 --2- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f213c032630 0x7f213c034af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 --2- 172.21.15.26:0/3422827179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2150071c20 0x7f215010bed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:32.025 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 >> 172.21.15.26:0/3422827179 conn(0x7f21500f76f0 msgr2=0x7f21500f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 shutdown_connections 2024-05-08T23:58:32.026 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:32.030+0000 7f215832e700 1 -- 172.21.15.26:0/3422827179 wait complete. 2024-05-08T23:58:32.794 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying prometheus service with default placement... 2024-05-08T23:58:33.060 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:32.025939+0000 mgr.smithi026.brymfp (mgr.14116) 15 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:33.061 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:32.026886+0000 mgr.smithi026.brymfp (mgr.14116) 16 : cephadm [INF] Saving service crash spec with placement * 2024-05-08T23:58:33.061 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:32.028990+0000 mon.smithi026 (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:33.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.352+0000 7ff15d64d700 1 Processor -- start 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.352+0000 7ff15d64d700 1 -- start start 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.352+0000 7ff15d64d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff1580ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.352+0000 7ff15d64d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff158100180 con 0x7ff158071c00 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.353+0000 7ff156ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff1580ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.353+0000 7ff156ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff1580ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36056/0 (socket says 172.21.15.26:36056) 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.353+0000 7ff156ffd700 1 -- 172.21.15.26:0/3579811863 learned_addr learned my addr 172.21.15.26:0/3579811863 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.353+0000 7ff156ffd700 1 -- 172.21.15.26:0/3579811863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1581002c0 con 0x7ff158071c00 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.353+0000 7ff156ffd700 1 --2- 172.21.15.26:0/3579811863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff1580ffc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff14c009730 tx=0x7ff14c0090f0).ready entity=mon.0 client_cookie=729ae4ec63ecefaa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:33.353 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.353+0000 7ff155ffb700 1 -- 172.21.15.26:0/3579811863 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff14c00b6e0 con 0x7ff158071c00 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.353+0000 7ff155ffb700 1 -- 172.21.15.26:0/3579811863 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff14c00bcd0 con 0x7ff158071c00 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.353+0000 7ff155ffb700 1 -- 172.21.15.26:0/3579811863 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff14c011cb0 con 0x7ff158071c00 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.354+0000 7ff15d64d700 1 -- 172.21.15.26:0/3579811863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 msgr2=0x7ff1580ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.354+0000 7ff15d64d700 1 --2- 172.21.15.26:0/3579811863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff1580ffc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff14c009730 tx=0x7ff14c0090f0).stop 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.354+0000 7ff15d64d700 1 -- 172.21.15.26:0/3579811863 shutdown_connections 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.354+0000 7ff15d64d700 1 --2- 172.21.15.26:0/3579811863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff1580ffc90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.354+0000 7ff15d64d700 1 -- 172.21.15.26:0/3579811863 >> 172.21.15.26:0/3579811863 conn(0x7ff1580f76f0 msgr2=0x7ff1580f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.354+0000 7ff15d64d700 1 -- 172.21.15.26:0/3579811863 shutdown_connections 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.354+0000 7ff15d64d700 1 -- 172.21.15.26:0/3579811863 wait complete. 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.355+0000 7ff15d64d700 1 Processor -- start 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.355+0000 7ff15d64d700 1 -- start start 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.355+0000 7ff15d64d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff15810bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.355+0000 7ff15d64d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15810c3b0 con 0x7ff158071c00 2024-05-08T23:58:33.354 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.355+0000 7ff156ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff15810bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.355+0000 7ff156ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff15810bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36062/0 (socket says 172.21.15.26:36062) 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.355+0000 7ff156ffd700 1 -- 172.21.15.26:0/1253408742 learned_addr learned my addr 172.21.15.26:0/1253408742 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.356+0000 7ff156ffd700 1 -- 172.21.15.26:0/1253408742 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c009370 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.356+0000 7ff156ffd700 1 --2- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff15810bec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff14c000c00 tx=0x7ff14c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.356+0000 7ff13ffff700 1 -- 172.21.15.26:0/1253408742 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff14c01a640 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.356+0000 7ff13ffff700 1 -- 172.21.15.26:0/1253408742 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff14c01ac30 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.356+0000 7ff13ffff700 1 -- 172.21.15.26:0/1253408742 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff14c0239a0 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.356+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15810c5b0 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.356+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15810c9c0 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.357+0000 7ff13ffff700 1 -- 172.21.15.26:0/1253408742 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7ff14c023b40 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.357+0000 7ff13ffff700 1 --2- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff140032660 0x7ff140034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.357+0000 7ff13ffff700 1 -- 172.21.15.26:0/1253408742 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff14c044b90 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.357+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff158046ce0 con 0x7ff158071c00 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.357+0000 7ff1567fc700 1 --2- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff140032660 0x7ff140034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.357+0000 7ff1567fc700 1 --2- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff140032660 0x7ff140034b20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff148009780 tx=0x7ff148006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:33.356 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.362+0000 7ff13ffff700 1 -- 172.21.15.26:0/1253408742 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff14c01e070 con 0x7ff158071c00 2024-05-08T23:58:33.540 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.546+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7ff15810de70 con 0x7ff140032660 2024-05-08T23:58:33.543 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.550+0000 7ff13ffff700 1 -- 172.21.15.26:0/1253408742 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7ff15810de70 con 0x7ff140032660 2024-05-08T23:58:33.543 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled prometheus update... 2024-05-08T23:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.551+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff140032660 msgr2=0x7ff140034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.551+0000 7ff15d64d700 1 --2- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff140032660 0x7ff140034b20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff148009780 tx=0x7ff148006cc0).stop 2024-05-08T23:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.551+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 msgr2=0x7ff15810bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.551+0000 7ff15d64d700 1 --2- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff15810bec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff14c000c00 tx=0x7ff14c0090f0).stop 2024-05-08T23:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.551+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 shutdown_connections 2024-05-08T23:58:33.546 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.551+0000 7ff15d64d700 1 --2- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7ff140032660 0x7ff140034b20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:33.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.551+0000 7ff15d64d700 1 --2- 172.21.15.26:0/1253408742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158071c00 0x7ff15810bec0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:33.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.551+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 >> 172.21.15.26:0/1253408742 conn(0x7ff1580f76f0 msgr2=0x7ff1580f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:33.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.552+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 shutdown_connections 2024-05-08T23:58:33.547 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:33.552+0000 7ff15d64d700 1 -- 172.21.15.26:0/1253408742 wait complete. 2024-05-08T23:58:34.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:34 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:33.547056+0000 mgr.smithi026.brymfp (mgr.14116) 17 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:34.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:34 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:33.547868+0000 mgr.smithi026.brymfp (mgr.14116) 18 : cephadm [INF] Saving service prometheus spec with placement count:1 2024-05-08T23:58:34.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:34 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:33.550084+0000 mon.smithi026 (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:35.461 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying grafana service with default placement... 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.970+0000 7fccf5da7700 1 Processor -- start 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.970+0000 7fccf5da7700 1 -- start start 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.970+0000 7fccf5da7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf00ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.970+0000 7fccf5da7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0100160 con 0x7fccf0071c20 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.970+0000 7fccef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf00ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.971+0000 7fccef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf00ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36078/0 (socket says 172.21.15.26:36078) 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.971+0000 7fccef7fe700 1 -- 172.21.15.26:0/2560626397 learned_addr learned my addr 172.21.15.26:0/2560626397 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.971+0000 7fccef7fe700 1 -- 172.21.15.26:0/2560626397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf01002a0 con 0x7fccf0071c20 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.971+0000 7fccef7fe700 1 --2- 172.21.15.26:0/2560626397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf00ffc70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fcce0009730 tx=0x7fcce00090f0).ready entity=mon.0 client_cookie=724cb24f496bf6f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.971+0000 7fccee7fc700 1 -- 172.21.15.26:0/2560626397 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcce000b770 con 0x7fccf0071c20 2024-05-08T23:58:36.016 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.971+0000 7fccee7fc700 1 -- 172.21.15.26:0/2560626397 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcce000bd60 con 0x7fccf0071c20 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.971+0000 7fccee7fc700 1 -- 172.21.15.26:0/2560626397 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcce0011d90 con 0x7fccf0071c20 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 -- 172.21.15.26:0/2560626397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 msgr2=0x7fccf00ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 --2- 172.21.15.26:0/2560626397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf00ffc70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fcce0009730 tx=0x7fcce00090f0).stop 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 -- 172.21.15.26:0/2560626397 shutdown_connections 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 --2- 172.21.15.26:0/2560626397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf00ffc70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 -- 172.21.15.26:0/2560626397 >> 172.21.15.26:0/2560626397 conn(0x7fccf00f76f0 msgr2=0x7fccf00f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 -- 172.21.15.26:0/2560626397 shutdown_connections 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 -- 172.21.15.26:0/2560626397 wait complete. 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 Processor -- start 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.972+0000 7fccf5da7700 1 -- start start 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccf5da7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf010bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccf5da7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf010c3c0 con 0x7fccf0071c20 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf010bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf010bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36090/0 (socket says 172.21.15.26:36090) 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccef7fe700 1 -- 172.21.15.26:0/986717414 learned_addr learned my addr 172.21.15.26:0/986717414 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:36.017 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccef7fe700 1 -- 172.21.15.26:0/986717414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0009370 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccef7fe700 1 --2- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf010bed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fcce0009f00 tx=0x7fcce00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccecff9700 1 -- 172.21.15.26:0/986717414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcce0011bb0 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf010c5c0 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccecff9700 1 -- 172.21.15.26:0/986717414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcce000bbc0 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccecff9700 1 -- 172.21.15.26:0/986717414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcce001ab20 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.973+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf010c9d0 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.974+0000 7fccecff9700 1 -- 172.21.15.26:0/986717414 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fcce00108b0 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.974+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf0046ce0 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.974+0000 7fccecff9700 1 --2- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fccdc0325e0 0x7fccdc034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.974+0000 7fccecff9700 1 -- 172.21.15.26:0/986717414 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fcce0044ec0 con 0x7fccf0071c20 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.974+0000 7fcceeffd700 1 --2- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fccdc0325e0 0x7fccdc034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.975+0000 7fcceeffd700 1 --2- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fccdc0325e0 0x7fccdc034aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fccd8009780 tx=0x7fccd8006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:35.979+0000 7fccecff9700 1 -- 172.21.15.26:0/986717414 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcce0018500 con 0x7fccf0071c20 2024-05-08T23:58:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.164+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fccf010d170 con 0x7fccdc0325e0 2024-05-08T23:58:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.168+0000 7fccecff9700 1 -- 172.21.15.26:0/986717414 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fccf010d170 con 0x7fccdc0325e0 2024-05-08T23:58:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled grafana update... 2024-05-08T23:58:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fccdc0325e0 msgr2=0x7fccdc034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 --2- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fccdc0325e0 0x7fccdc034aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fccd8009780 tx=0x7fccd8006cc0).stop 2024-05-08T23:58:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 msgr2=0x7fccf010bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 --2- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf010bed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fcce0009f00 tx=0x7fcce00090f0).stop 2024-05-08T23:58:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 shutdown_connections 2024-05-08T23:58:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 --2- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fccdc0325e0 0x7fccdc034aa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 --2- 172.21.15.26:0/986717414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccf0071c20 0x7fccf010bed0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 >> 172.21.15.26:0/986717414 conn(0x7fccf00f76f0 msgr2=0x7fccf00f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 shutdown_connections 2024-05-08T23:58:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:36.170+0000 7fccf5da7700 1 -- 172.21.15.26:0/986717414 wait complete. 2024-05-08T23:58:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:35.024994+0000 mon.smithi026 (mon.0) 61 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:37.200 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:36.165671+0000 mgr.smithi026.brymfp (mgr.14116) 19 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:37.200 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:36.166502+0000 mgr.smithi026.brymfp (mgr.14116) 20 : cephadm [INF] Saving service grafana spec with placement count:1 2024-05-08T23:58:37.201 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:36.168776+0000 mon.smithi026 (mon.0) 62 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:37.725 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying node-exporter service with default placement... 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.235+0000 7fe2fefef700 1 Processor -- start 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.235+0000 7fe2fefef700 1 -- start start 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.235+0000 7fe2fefef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f80ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.235+0000 7fe2fefef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f8100180 con 0x7fe2f8071c00 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.235+0000 7fe2fcd8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f80ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.235+0000 7fe2fcd8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f80ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36102/0 (socket says 172.21.15.26:36102) 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.235+0000 7fe2fcd8b700 1 -- 172.21.15.26:0/3940821012 learned_addr learned my addr 172.21.15.26:0/3940821012 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.235+0000 7fe2fcd8b700 1 -- 172.21.15.26:0/3940821012 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f81002c0 con 0x7fe2f8071c00 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2fcd8b700 1 --2- 172.21.15.26:0/3940821012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f80ffc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe2ec009730 tx=0x7fe2ec0090f0).ready entity=mon.0 client_cookie=174e5298d0e884c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2f77fe700 1 -- 172.21.15.26:0/3940821012 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2ec00b6e0 con 0x7fe2f8071c00 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2f77fe700 1 -- 172.21.15.26:0/3940821012 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe2ec00bcd0 con 0x7fe2f8071c00 2024-05-08T23:58:38.237 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2f77fe700 1 -- 172.21.15.26:0/3940821012 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2ec011cb0 con 0x7fe2f8071c00 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2fefef700 1 -- 172.21.15.26:0/3940821012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 msgr2=0x7fe2f80ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2fefef700 1 --2- 172.21.15.26:0/3940821012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f80ffc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe2ec009730 tx=0x7fe2ec0090f0).stop 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2fefef700 1 -- 172.21.15.26:0/3940821012 shutdown_connections 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2fefef700 1 --2- 172.21.15.26:0/3940821012 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f80ffc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2fefef700 1 -- 172.21.15.26:0/3940821012 >> 172.21.15.26:0/3940821012 conn(0x7fe2f80f76f0 msgr2=0x7fe2f80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2fefef700 1 -- 172.21.15.26:0/3940821012 shutdown_connections 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.236+0000 7fe2fefef700 1 -- 172.21.15.26:0/3940821012 wait complete. 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.237+0000 7fe2fefef700 1 Processor -- start 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.237+0000 7fe2fefef700 1 -- start start 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.237+0000 7fe2fefef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f810bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.237+0000 7fe2fefef700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f810c3b0 con 0x7fe2f8071c00 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.237+0000 7fe2fcd8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f810bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.237+0000 7fe2fcd8b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f810bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36114/0 (socket says 172.21.15.26:36114) 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.237+0000 7fe2fcd8b700 1 -- 172.21.15.26:0/3085785977 learned_addr learned my addr 172.21.15.26:0/3085785977 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.237+0000 7fe2fcd8b700 1 -- 172.21.15.26:0/3085785977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec009370 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.238+0000 7fe2fcd8b700 1 --2- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f810bec0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe2ec0118b0 tx=0x7fe2ec0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.238+0000 7fe2f5ffb700 1 -- 172.21.15.26:0/3085785977 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2ec00be40 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.238+0000 7fe2f5ffb700 1 -- 172.21.15.26:0/3085785977 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe2ec01aad0 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.238+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f810c5b0 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.238+0000 7fe2f5ffb700 1 -- 172.21.15.26:0/3085785977 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2ec0239e0 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.238+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f810c9c0 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.239+0000 7fe2f5ffb700 1 -- 172.21.15.26:0/3085785977 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fe2ec023ca0 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.239+0000 7fe2f5ffb700 1 --2- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fe2e80325e0 0x7fe2e8034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.239+0000 7fe2f5ffb700 1 -- 172.21.15.26:0/3085785977 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fe2ec044880 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.239+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f8046ce0 con 0x7fe2f8071c00 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.239+0000 7fe2f7fff700 1 --2- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fe2e80325e0 0x7fe2e8034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:38.239 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.239+0000 7fe2f7fff700 1 --2- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fe2e80325e0 0x7fe2e8034aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fe2e4009780 tx=0x7fe2e4006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:38.240 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.244+0000 7fe2f5ffb700 1 -- 172.21.15.26:0/3085785977 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe2ec01e080 con 0x7fe2f8071c00 2024-05-08T23:58:38.421 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.427+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2f8105df0 con 0x7fe2e80325e0 2024-05-08T23:58:38.424 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.430+0000 7fe2f5ffb700 1 -- 172.21.15.26:0/3085785977 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fe2f8105df0 con 0x7fe2e80325e0 2024-05-08T23:58:38.424 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2024-05-08T23:58:38.427 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fe2e80325e0 msgr2=0x7fe2e8034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:38.427 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 --2- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fe2e80325e0 0x7fe2e8034aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fe2e4009780 tx=0x7fe2e4006cc0).stop 2024-05-08T23:58:38.427 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 msgr2=0x7fe2f810bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:38.427 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 --2- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f810bec0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe2ec0118b0 tx=0x7fe2ec0090f0).stop 2024-05-08T23:58:38.427 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 shutdown_connections 2024-05-08T23:58:38.427 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 --2- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fe2e80325e0 0x7fe2e8034aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:38.427 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 --2- 172.21.15.26:0/3085785977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8071c00 0x7fe2f810bec0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:38.427 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 >> 172.21.15.26:0/3085785977 conn(0x7fe2f80f76f0 msgr2=0x7fe2f80f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:38.428 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 shutdown_connections 2024-05-08T23:58:38.428 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:38.432+0000 7fe2fefef700 1 -- 172.21.15.26:0/3085785977 wait complete. 2024-05-08T23:58:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:Deploying alertmanager service with default placement... 2024-05-08T23:58:39.636 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.638+0000 7f9356fcd700 1 Processor -- start 2024-05-08T23:58:39.636 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.638+0000 7f9356fcd700 1 -- start start 2024-05-08T23:58:39.636 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.638+0000 7f9356fcd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f93500fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:39.636 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.638+0000 7f9356fcd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93500fc7e0 con 0x7f93500fbed0 2024-05-08T23:58:39.636 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.639+0000 7f9354d69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f93500fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.639+0000 7f9354d69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f93500fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36118/0 (socket says 172.21.15.26:36118) 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.639+0000 7f9354d69700 1 -- 172.21.15.26:0/2017416024 learned_addr learned my addr 172.21.15.26:0/2017416024 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.639+0000 7f9354d69700 1 -- 172.21.15.26:0/2017416024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500fc920 con 0x7f93500fbed0 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.639+0000 7f9354d69700 1 --2- 172.21.15.26:0/2017416024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f93500fc2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9344009730 tx=0x7f93440090f0).ready entity=mon.0 client_cookie=5f247c6f2c3a6eec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.639+0000 7f934f7fe700 1 -- 172.21.15.26:0/2017416024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934400b6e0 con 0x7f93500fbed0 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.639+0000 7f934f7fe700 1 -- 172.21.15.26:0/2017416024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f934400bcd0 con 0x7f93500fbed0 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.639+0000 7f934f7fe700 1 -- 172.21.15.26:0/2017416024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9344011cb0 con 0x7f93500fbed0 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.640+0000 7f9356fcd700 1 -- 172.21.15.26:0/2017416024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 msgr2=0x7f93500fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.640+0000 7f9356fcd700 1 --2- 172.21.15.26:0/2017416024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f93500fc2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9344009730 tx=0x7f93440090f0).stop 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.640+0000 7f9356fcd700 1 -- 172.21.15.26:0/2017416024 shutdown_connections 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.640+0000 7f9356fcd700 1 --2- 172.21.15.26:0/2017416024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f93500fc2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:39.637 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.640+0000 7f9356fcd700 1 -- 172.21.15.26:0/2017416024 >> 172.21.15.26:0/2017416024 conn(0x7f93500f76f0 msgr2=0x7f93500f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.640+0000 7f9356fcd700 1 -- 172.21.15.26:0/2017416024 shutdown_connections 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.640+0000 7f9356fcd700 1 -- 172.21.15.26:0/2017416024 wait complete. 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.641+0000 7f9356fcd700 1 Processor -- start 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.641+0000 7f9356fcd700 1 -- start start 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.641+0000 7f9356fcd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f9350110f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.641+0000 7f9356fcd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935010c920 con 0x7f93500fbed0 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.641+0000 7f9354d69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f9350110f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.641+0000 7f9354d69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f9350110f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36122/0 (socket says 172.21.15.26:36122) 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.641+0000 7f9354d69700 1 -- 172.21.15.26:0/1034793041 learned_addr learned my addr 172.21.15.26:0/1034793041 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.641+0000 7f9354d69700 1 -- 172.21.15.26:0/1034793041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344009370 con 0x7f93500fbed0 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.642+0000 7f9354d69700 1 --2- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f9350110f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f93440118b0 tx=0x7f93440090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.642+0000 7f934dffb700 1 -- 172.21.15.26:0/1034793041 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934400be40 con 0x7f93500fbed0 2024-05-08T23:58:39.638 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.642+0000 7f934dffb700 1 -- 172.21.15.26:0/1034793041 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f934400bad0 con 0x7f93500fbed0 2024-05-08T23:58:39.639 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.642+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9350071c80 con 0x7f93500fbed0 2024-05-08T23:58:39.639 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.642+0000 7f934dffb700 1 -- 172.21.15.26:0/1034793041 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934401aaa0 con 0x7f93500fbed0 2024-05-08T23:58:39.639 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.642+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9350111420 con 0x7f93500fbed0 2024-05-08T23:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.643+0000 7f934dffb700 1 -- 172.21.15.26:0/1034793041 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f934401ad10 con 0x7f93500fbed0 2024-05-08T23:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.643+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9350046ce0 con 0x7f93500fbed0 2024-05-08T23:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.643+0000 7f934dffb700 1 --2- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f9340032660 0x7f9340034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.643+0000 7f934dffb700 1 -- 172.21.15.26:0/1034793041 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f93440449b0 con 0x7f93500fbed0 2024-05-08T23:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.643+0000 7f934ffff700 1 --2- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f9340032660 0x7f9340034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:39.640 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.644+0000 7f934ffff700 1 --2- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f9340032660 0x7f9340034b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f933c009780 tx=0x7f933c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:39.642 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.648+0000 7f934dffb700 1 -- 172.21.15.26:0/1034793041 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f934402c3f0 con 0x7f93500fbed0 2024-05-08T23:58:39.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:38.411904+0000 mgr.smithi026.brymfp (mgr.14116) 21 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:58:39.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:38.428264+0000 mgr.smithi026.brymfp (mgr.14116) 22 : audit [DBG] from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:39.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:38.429127+0000 mgr.smithi026.brymfp (mgr.14116) 23 : cephadm [INF] Saving service node-exporter spec with placement * 2024-05-08T23:58:39.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:38.430991+0000 mon.smithi026 (mon.0) 63 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:39.823 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.829+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f9350059120 con 0x7f9340032660 2024-05-08T23:58:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.833+0000 7f934dffb700 1 -- 172.21.15.26:0/1034793041 <== mgr.14116 v2:172.21.15.26:6800/3965746041 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f9350059120 con 0x7f9340032660 2024-05-08T23:58:39.827 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f9340032660 msgr2=0x7f9340034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 --2- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f9340032660 0x7f9340034b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f933c009780 tx=0x7f933c006cc0).stop 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 msgr2=0x7f9350110f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 --2- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f9350110f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f93440118b0 tx=0x7f93440090f0).stop 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 shutdown_connections 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 --2- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f9340032660 0x7f9340034b20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 --2- 172.21.15.26:0/1034793041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93500fbed0 0x7f9350110f30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 >> 172.21.15.26:0/1034793041 conn(0x7f93500f76f0 msgr2=0x7f93500f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 shutdown_connections 2024-05-08T23:58:39.830 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:39.835+0000 7f9356fcd700 1 -- 172.21.15.26:0/1034793041 wait complete. 2024-05-08T23:58:41.083 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.087+0000 7f60e0772700 1 Processor -- start 2024-05-08T23:58:41.083 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.088+0000 7f60e0772700 1 -- start start 2024-05-08T23:58:41.083 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.088+0000 7f60e0772700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d8102110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.088+0000 7f60e0772700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80fdb00 con 0x7f60d8071bc0 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.088+0000 7f60de50e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d8102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.088+0000 7f60de50e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d8102110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36134/0 (socket says 172.21.15.26:36134) 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.088+0000 7f60de50e700 1 -- 172.21.15.26:0/3125615592 learned_addr learned my addr 172.21.15.26:0/3125615592 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.088+0000 7f60de50e700 1 -- 172.21.15.26:0/3125615592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8102600 con 0x7f60d8071bc0 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60de50e700 1 --2- 172.21.15.26:0/3125615592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d8102110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f60d4009730 tx=0x7f60d40090f0).ready entity=mon.0 client_cookie=dadc6f5810b5a86c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60dd50c700 1 -- 172.21.15.26:0/3125615592 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60d400b6e0 con 0x7f60d8071bc0 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60dd50c700 1 -- 172.21.15.26:0/3125615592 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f60d400bcd0 con 0x7f60d8071bc0 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60dd50c700 1 -- 172.21.15.26:0/3125615592 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60d4011cb0 con 0x7f60d8071bc0 2024-05-08T23:58:41.084 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60e0772700 1 -- 172.21.15.26:0/3125615592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 msgr2=0x7f60d8102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:41.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60e0772700 1 --2- 172.21.15.26:0/3125615592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d8102110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f60d4009730 tx=0x7f60d40090f0).stop 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60e0772700 1 -- 172.21.15.26:0/3125615592 shutdown_connections 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60e0772700 1 --2- 172.21.15.26:0/3125615592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d8102110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60e0772700 1 -- 172.21.15.26:0/3125615592 >> 172.21.15.26:0/3125615592 conn(0x7f60d80f7750 msgr2=0x7f60d80f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.089+0000 7f60e0772700 1 -- 172.21.15.26:0/3125615592 shutdown_connections 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.090+0000 7f60e0772700 1 -- 172.21.15.26:0/3125615592 wait complete. 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.090+0000 7f60e0772700 1 Processor -- start 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.090+0000 7f60e0772700 1 -- start start 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.090+0000 7f60e0772700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.090+0000 7f60e0772700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d810e4d0 con 0x7f60d8071bc0 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.090+0000 7f60de50e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.090+0000 7f60de50e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36144/0 (socket says 172.21.15.26:36144) 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.090+0000 7f60de50e700 1 -- 172.21.15.26:0/920321794 learned_addr learned my addr 172.21.15.26:0/920321794 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.091+0000 7f60de50e700 1 -- 172.21.15.26:0/920321794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4009370 con 0x7f60d8071bc0 2024-05-08T23:58:41.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.091+0000 7f60de50e700 1 --2- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d810dfe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f60d4006e30 tx=0x7f60d40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.091+0000 7f60cb7fe700 1 -- 172.21.15.26:0/920321794 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60d401a590 con 0x7f60d8071bc0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.091+0000 7f60cb7fe700 1 -- 172.21.15.26:0/920321794 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f60d401ab80 con 0x7f60d8071bc0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.091+0000 7f60cb7fe700 1 -- 172.21.15.26:0/920321794 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60d4022b30 con 0x7f60d8071bc0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.091+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d810e6d0 con 0x7f60d8071bc0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.091+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d810eae0 con 0x7f60d8071bc0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.092+0000 7f60cb7fe700 1 -- 172.21.15.26:0/920321794 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f60d4019390 con 0x7f60d8071bc0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.092+0000 7f60cb7fe700 1 --2- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f60c4032660 0x7f60c4034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.092+0000 7f60cb7fe700 1 -- 172.21.15.26:0/920321794 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f60d4044d40 con 0x7f60d8071bc0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.092+0000 7f60ddd0d700 1 --2- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f60c4032660 0x7f60c4034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.092+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d805a310 con 0x7f60d8071bc0 2024-05-08T23:58:41.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.092+0000 7f60ddd0d700 1 --2- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f60c4032660 0x7f60c4034b20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f60cc009780 tx=0x7f60cc006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.097+0000 7f60cb7fe700 1 -- 172.21.15.26:0/920321794 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f60d4019690 con 0x7f60d8071bc0 2024-05-08T23:58:41.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:39.830484+0000 mgr.smithi026.brymfp (mgr.14116) 24 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:41.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:58:39.831295+0000 mgr.smithi026.brymfp (mgr.14116) 25 : cephadm [INF] Saving service alertmanager spec with placement count:1 2024-05-08T23:58:41.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:39.833567+0000 mon.smithi026 (mon.0) 64 : audit [INF] from='mgr.14116 172.21.15.26:0/3330714957' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.269+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f60d8107de0 con 0x7f60d8071bc0 2024-05-08T23:58:41.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.272+0000 7f60cb7fe700 1 -- 172.21.15.26:0/920321794 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f60d4018b10 con 0x7f60d8071bc0 2024-05-08T23:58:41.268 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.273+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f60c4032660 msgr2=0x7f60c4034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:41.268 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.273+0000 7f60e0772700 1 --2- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f60c4032660 0x7f60c4034b20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f60cc009780 tx=0x7f60cc006cc0).stop 2024-05-08T23:58:41.268 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.273+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 msgr2=0x7f60d810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:41.269 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.274+0000 7f60e0772700 1 --2- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d810dfe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f60d4006e30 tx=0x7f60d40090f0).stop 2024-05-08T23:58:41.269 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.274+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 shutdown_connections 2024-05-08T23:58:41.269 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.274+0000 7f60e0772700 1 --2- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f60c4032660 0x7f60c4034b20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:41.269 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.274+0000 7f60e0772700 1 --2- 172.21.15.26:0/920321794 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60d8071bc0 0x7f60d810dfe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:41.269 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.274+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 >> 172.21.15.26:0/920321794 conn(0x7f60d80f7750 msgr2=0x7f60d80f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:41.269 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.274+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 shutdown_connections 2024-05-08T23:58:41.269 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:41.274+0000 7f60e0772700 1 -- 172.21.15.26:0/920321794 wait complete. 2024-05-08T23:58:41.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:40.412164+0000 mgr.smithi026.brymfp (mgr.14116) 26 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:58:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:41.272441+0000 mon.smithi026 (mon.0) 65 : audit [INF] from='client.? 172.21.15.26:0/920321794' entity='client.admin' 2024-05-08T23:58:42.510 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2faaad1700 1 Processor -- start 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2faaad1700 1 -- start start 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2faaad1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa41020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2faaad1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40fdaa0 con 0x7f2fa4071be0 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2fa886d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa41020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2fa886d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa41020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55860/0 (socket says 172.21.15.26:55860) 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2fa886d700 1 -- 172.21.15.26:0/2623517093 learned_addr learned my addr 172.21.15.26:0/2623517093 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2fa886d700 1 -- 172.21.15.26:0/2623517093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa41025a0 con 0x7f2fa4071be0 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.515+0000 7f2fa886d700 1 --2- 172.21.15.26:0/2623517093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa41020b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2f98009730 tx=0x7f2f980090f0).ready entity=mon.0 client_cookie=bc1a49a053493808 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2fa37fe700 1 -- 172.21.15.26:0/2623517093 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f9800b6e0 con 0x7f2fa4071be0 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2fa37fe700 1 -- 172.21.15.26:0/2623517093 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2f9800bcd0 con 0x7f2fa4071be0 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2fa37fe700 1 -- 172.21.15.26:0/2623517093 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f98011cb0 con 0x7f2fa4071be0 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2faaad1700 1 -- 172.21.15.26:0/2623517093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 msgr2=0x7f2fa41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:42.511 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2faaad1700 1 --2- 172.21.15.26:0/2623517093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa41020b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2f98009730 tx=0x7f2f980090f0).stop 2024-05-08T23:58:42.512 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2faaad1700 1 -- 172.21.15.26:0/2623517093 shutdown_connections 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2faaad1700 1 --2- 172.21.15.26:0/2623517093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa41020b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2faaad1700 1 -- 172.21.15.26:0/2623517093 >> 172.21.15.26:0/2623517093 conn(0x7f2fa40f76f0 msgr2=0x7f2fa40f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2faaad1700 1 -- 172.21.15.26:0/2623517093 shutdown_connections 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.516+0000 7f2faaad1700 1 -- 172.21.15.26:0/2623517093 wait complete. 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.517+0000 7f2faaad1700 1 Processor -- start 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.517+0000 7f2faaad1700 1 -- start start 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.517+0000 7f2faaad1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa410e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.517+0000 7f2faaad1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa410e500 con 0x7f2fa4071be0 2024-05-08T23:58:42.513 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.517+0000 7f2fa886d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa410e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.517+0000 7f2fa886d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa410e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55862/0 (socket says 172.21.15.26:55862) 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.517+0000 7f2fa886d700 1 -- 172.21.15.26:0/109961249 learned_addr learned my addr 172.21.15.26:0/109961249 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.517+0000 7f2fa886d700 1 -- 172.21.15.26:0/109961249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98009370 con 0x7f2fa4071be0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.518+0000 7f2fa886d700 1 --2- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa410e010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2f980118b0 tx=0x7f2f980090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.518+0000 7f2fa1f76700 1 -- 172.21.15.26:0/109961249 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f9800be40 con 0x7f2fa4071be0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.518+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa410e700 con 0x7f2fa4071be0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.518+0000 7f2fa1f76700 1 -- 172.21.15.26:0/109961249 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2f9801aad0 con 0x7f2fa4071be0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.518+0000 7f2fa1f76700 1 -- 172.21.15.26:0/109961249 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f98023a80 con 0x7f2fa4071be0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.518+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa410eb10 con 0x7f2fa4071be0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.519+0000 7f2fa1f76700 1 -- 172.21.15.26:0/109961249 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f2f98023cc0 con 0x7f2fa4071be0 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.519+0000 7f2fa1f76700 1 --2- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2f94032610 0x7f2f94034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:42.514 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.519+0000 7f2fa1f76700 1 -- 172.21.15.26:0/109961249 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f2f98044b10 con 0x7f2fa4071be0 2024-05-08T23:58:42.515 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.519+0000 7f2fa3fff700 1 --2- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2f94032610 0x7f2f94034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:42.515 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.519+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa405a310 con 0x7f2fa4071be0 2024-05-08T23:58:42.515 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.520+0000 7f2fa3fff700 1 --2- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2f94032610 0x7f2f94034ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f2f90009780 tx=0x7f2f90006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:42.518 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.524+0000 7f2fa1f76700 1 -- 172.21.15.26:0/109961249 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2f9801e070 con 0x7f2fa4071be0 2024-05-08T23:58:42.685 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.691+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f2fa4046ce0 con 0x7f2fa4071be0 2024-05-08T23:58:42.688 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.694+0000 7f2fa1f76700 1 -- 172.21.15.26:0/109961249 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f2f9801e020 con 0x7f2fa4071be0 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2f94032610 msgr2=0x7f2f94034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 --2- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2f94032610 0x7f2f94034ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f2f90009780 tx=0x7f2f90006cc0).stop 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 msgr2=0x7f2fa410e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 --2- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa410e010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2f980118b0 tx=0x7f2f980090f0).stop 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 shutdown_connections 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 --2- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f2f94032610 0x7f2f94034ad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 --2- 172.21.15.26:0/109961249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fa4071be0 0x7f2fa410e010 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 >> 172.21.15.26:0/109961249 conn(0x7f2fa40f76f0 msgr2=0x7f2fa40f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 shutdown_connections 2024-05-08T23:58:42.691 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:42.696+0000 7f2faaad1700 1 -- 172.21.15.26:0/109961249 wait complete. 2024-05-08T23:58:43.527 INFO:teuthology.orchestra.run.smithi026.stderr:Enabling the dashboard module... 2024-05-08T23:58:43.787 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:42.412515+0000 mgr.smithi026.brymfp (mgr.14116) 27 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:58:43.787 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:42.694536+0000 mon.smithi026 (mon.0) 66 : audit [INF] from='client.? 172.21.15.26:0/109961249' entity='client.admin' 2024-05-08T23:58:44.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.033+0000 7f159ffd8700 1 Processor -- start 2024-05-08T23:58:44.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.033+0000 7f159ffd8700 1 -- start start 2024-05-08T23:58:44.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.033+0000 7f159ffd8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:44.029 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.033+0000 7f159ffd8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15981001a0 con 0x7f1598071be0 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.033+0000 7f159dd74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.034+0000 7f159dd74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980ffcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55878/0 (socket says 172.21.15.26:55878) 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.034+0000 7f159dd74700 1 -- 172.21.15.26:0/4267234590 learned_addr learned my addr 172.21.15.26:0/4267234590 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.034+0000 7f159dd74700 1 -- 172.21.15.26:0/4267234590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15981002e0 con 0x7f1598071be0 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.034+0000 7f159dd74700 1 --2- 172.21.15.26:0/4267234590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980ffcb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1594009730 tx=0x7f15940090f0).ready entity=mon.0 client_cookie=9262ce82e03fe19 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.034+0000 7f159cd72700 1 -- 172.21.15.26:0/4267234590 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f159400b6e0 con 0x7f1598071be0 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.034+0000 7f159cd72700 1 -- 172.21.15.26:0/4267234590 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f159400bcd0 con 0x7f1598071be0 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.034+0000 7f159cd72700 1 -- 172.21.15.26:0/4267234590 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1594011cb0 con 0x7f1598071be0 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.035+0000 7f159ffd8700 1 -- 172.21.15.26:0/4267234590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 msgr2=0x7f15980ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.035+0000 7f159ffd8700 1 --2- 172.21.15.26:0/4267234590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980ffcb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1594009730 tx=0x7f15940090f0).stop 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.035+0000 7f159ffd8700 1 -- 172.21.15.26:0/4267234590 shutdown_connections 2024-05-08T23:58:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.035+0000 7f159ffd8700 1 --2- 172.21.15.26:0/4267234590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980ffcb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.035+0000 7f159ffd8700 1 -- 172.21.15.26:0/4267234590 >> 172.21.15.26:0/4267234590 conn(0x7f15980f76f0 msgr2=0x7f15980f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.035+0000 7f159ffd8700 1 -- 172.21.15.26:0/4267234590 shutdown_connections 2024-05-08T23:58:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.035+0000 7f159ffd8700 1 -- 172.21.15.26:0/4267234590 wait complete. 2024-05-08T23:58:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.036+0000 7f159ffd8700 1 Processor -- start 2024-05-08T23:58:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.036+0000 7f159ffd8700 1 -- start start 2024-05-08T23:58:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.036+0000 7f159ffd8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980fd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.036+0000 7f159ffd8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15980fbbb0 con 0x7f1598071be0 2024-05-08T23:58:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.036+0000 7f159dd74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.036+0000 7f159dd74700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980fd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55884/0 (socket says 172.21.15.26:55884) 2024-05-08T23:58:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.036+0000 7f159dd74700 1 -- 172.21.15.26:0/3525765902 learned_addr learned my addr 172.21.15.26:0/3525765902 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.036+0000 7f159dd74700 1 -- 172.21.15.26:0/3525765902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594009370 con 0x7f1598071be0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.037+0000 7f159dd74700 1 --2- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980fd730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f15940118b0 tx=0x7f15940090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.037+0000 7f158effd700 1 -- 172.21.15.26:0/3525765902 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f159400be40 con 0x7f1598071be0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.037+0000 7f159ffd8700 1 -- 172.21.15.26:0/3525765902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15980fbd50 con 0x7f1598071be0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.037+0000 7f158effd700 1 -- 172.21.15.26:0/3525765902 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f159401aad0 con 0x7f1598071be0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.037+0000 7f158effd700 1 -- 172.21.15.26:0/3525765902 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1594023a80 con 0x7f1598071be0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.037+0000 7f159ffd8700 1 -- 172.21.15.26:0/3525765902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15980fc160 con 0x7f1598071be0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.037+0000 7f158effd700 1 -- 172.21.15.26:0/3525765902 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f1594023cc0 con 0x7f1598071be0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.038+0000 7f158effd700 1 --2- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1584032610 0x7f1584034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.038+0000 7f158effd700 1 -- 172.21.15.26:0/3525765902 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f15940449c0 con 0x7f1598071be0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.038+0000 7f159d573700 1 --2- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1584032610 0x7f1584034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.038+0000 7f159d573700 1 --2- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1584032610 0x7f1584034ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1588009780 tx=0x7f1588006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:44.033 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.038+0000 7f158cff9700 1 -- 172.21.15.26:0/3525765902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1580005120 con 0x7f1598071be0 2024-05-08T23:58:44.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.043+0000 7f158effd700 1 -- 172.21.15.26:0/3525765902 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f159401e070 con 0x7f1598071be0 2024-05-08T23:58:44.252 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.258+0000 7f158cff9700 1 -- 172.21.15.26:0/3525765902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f15800057f0 con 0x7f1598071be0 2024-05-08T23:58:44.690 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.696+0000 7f158effd700 1 -- 172.21.15.26:0/3525765902 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f1594029d00 con 0x7f1598071be0 2024-05-08T23:58:44.692 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.698+0000 7f158effd700 1 -- 172.21.15.26:0/3525765902 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f1594010a30 con 0x7f1598071be0 2024-05-08T23:58:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 -- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1584032610 msgr2=0x7f1584034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 --2- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1584032610 0x7f1584034ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1588009780 tx=0x7f1588006cc0).stop 2024-05-08T23:58:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 -- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 msgr2=0x7f15980fd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:44.695 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 --2- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980fd730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f15940118b0 tx=0x7f15940090f0).stop 2024-05-08T23:58:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 -- 172.21.15.26:0/3525765902 shutdown_connections 2024-05-08T23:58:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 --2- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f1584032610 0x7f1584034ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 --2- 172.21.15.26:0/3525765902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1598071be0 0x7f15980fd730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 -- 172.21.15.26:0/3525765902 >> 172.21.15.26:0/3525765902 conn(0x7f15980f76f0 msgr2=0x7f15980f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 -- 172.21.15.26:0/3525765902 shutdown_connections 2024-05-08T23:58:44.696 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:44.700+0000 7f158cff9700 1 -- 172.21.15.26:0/3525765902 wait complete. 2024-05-08T23:58:44.941 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:44.259378+0000 mon.smithi026 (mon.0) 67 : audit [INF] from='client.? 172.21.15.26:0/3525765902' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-08T23:58:45.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:44.698378+0000 mon.smithi026 (mon.0) 68 : audit [INF] from='client.? 172.21.15.26:0/3525765902' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-08T23:58:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:44.698472+0000 mon.smithi026 (mon.0) 69 : cluster [DBG] mgrmap e9: smithi026.brymfp(active, since 26s) 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.040+0000 7fb36501f700 1 Processor -- start 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.040+0000 7fb36501f700 1 -- start start 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.041+0000 7fb36501f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb3600fc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.041+0000 7fb36501f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600fc800 con 0x7fb3600fbef0 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.041+0000 7fb35ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb3600fc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.041+0000 7fb35ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb3600fc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55930/0 (socket says 172.21.15.26:55930) 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.041+0000 7fb35ed9d700 1 -- 172.21.15.26:0/3810298280 learned_addr learned my addr 172.21.15.26:0/3810298280 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.041+0000 7fb35ed9d700 1 -- 172.21.15.26:0/3810298280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600fc940 con 0x7fb3600fbef0 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.041+0000 7fb35ed9d700 1 --2- 172.21.15.26:0/3810298280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb3600fc310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb350009730 tx=0x7fb3500090f0).ready entity=mon.0 client_cookie=d394ae853e4c2c9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:46.036 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb35dd9b700 1 -- 172.21.15.26:0/3810298280 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb35000b6e0 con 0x7fb3600fbef0 2024-05-08T23:58:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb35dd9b700 1 -- 172.21.15.26:0/3810298280 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb35000bcd0 con 0x7fb3600fbef0 2024-05-08T23:58:46.037 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb35dd9b700 1 -- 172.21.15.26:0/3810298280 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb350011cb0 con 0x7fb3600fbef0 2024-05-08T23:58:46.039 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb36501f700 1 -- 172.21.15.26:0/3810298280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 msgr2=0x7fb3600fc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb36501f700 1 --2- 172.21.15.26:0/3810298280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb3600fc310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb350009730 tx=0x7fb3500090f0).stop 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb36501f700 1 -- 172.21.15.26:0/3810298280 shutdown_connections 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb36501f700 1 --2- 172.21.15.26:0/3810298280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb3600fc310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb36501f700 1 -- 172.21.15.26:0/3810298280 >> 172.21.15.26:0/3810298280 conn(0x7fb3600f76f0 msgr2=0x7fb3600f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.042+0000 7fb36501f700 1 -- 172.21.15.26:0/3810298280 shutdown_connections 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.043+0000 7fb36501f700 1 -- 172.21.15.26:0/3810298280 wait complete. 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.043+0000 7fb36501f700 1 Processor -- start 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.043+0000 7fb36501f700 1 -- start start 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb36501f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb36010beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb36501f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36010c3a0 con 0x7fb3600fbef0 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb35ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb36010beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb35ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb36010beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55932/0 (socket says 172.21.15.26:55932) 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb35ed9d700 1 -- 172.21.15.26:0/2921504352 learned_addr learned my addr 172.21.15.26:0/2921504352 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:46.040 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb35ed9d700 1 -- 172.21.15.26:0/2921504352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350009370 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb35ed9d700 1 --2- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb36010beb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb350002f40 tx=0x7fb3500090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb357fff700 1 -- 172.21.15.26:0/2921504352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb35001a590 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb357fff700 1 -- 172.21.15.26:0/2921504352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb35001ab80 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36010c5a0 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb357fff700 1 -- 172.21.15.26:0/2921504352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb350022aa0 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.044+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36010c9b0 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.045+0000 7fb357fff700 1 -- 172.21.15.26:0/2921504352 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7fb350022d10 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.045+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb360046ce0 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.045+0000 7fb357fff700 1 --2- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fb34c0326b0 0x7fb34c034b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.046+0000 7fb357fff700 1 -- 172.21.15.26:0/2921504352 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fb350045a50 con 0x7fb3600fbef0 2024-05-08T23:58:46.041 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.046+0000 7fb35e59c700 1 -- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fb34c0326b0 msgr2=0x7fb34c034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3965746041 2024-05-08T23:58:46.042 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.046+0000 7fb35e59c700 1 --2- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fb34c0326b0 0x7fb34c034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:58:46.044 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.050+0000 7fb357fff700 1 -- 172.21.15.26:0/2921504352 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb350018d80 con 0x7fb3600fbef0 2024-05-08T23:58:46.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.247+0000 7fb35e59c700 1 -- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fb34c0326b0 msgr2=0x7fb34c034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3965746041 2024-05-08T23:58:46.241 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.247+0000 7fb35e59c700 1 --2- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fb34c0326b0 0x7fb34c034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:58:46.304 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.309+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb36010d980 con 0x7fb3600fbef0 2024-05-08T23:58:46.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.309+0000 7fb357fff700 1 -- 172.21.15.26:0/2921504352 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fb35001e020 con 0x7fb3600fbef0 2024-05-08T23:58:46.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2024-05-08T23:58:46.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "epoch": 9, 2024-05-08T23:58:46.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "available": true, 2024-05-08T23:58:46.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "active_name": "smithi026.brymfp", 2024-05-08T23:58:46.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "num_standby": 0 2024-05-08T23:58:46.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2024-05-08T23:58:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.311+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fb34c0326b0 msgr2=0x7fb34c034b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:58:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.311+0000 7fb36501f700 1 --2- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fb34c0326b0 0x7fb34c034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:58:46.308 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.311+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 msgr2=0x7fb36010beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.311+0000 7fb36501f700 1 --2- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb36010beb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb350002f40 tx=0x7fb3500090f0).stop 2024-05-08T23:58:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.311+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 shutdown_connections 2024-05-08T23:58:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.311+0000 7fb36501f700 1 --2- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7fb34c0326b0 0x7fb34c034b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:58:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.311+0000 7fb36501f700 1 --2- 172.21.15.26:0/2921504352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3600fbef0 0x7fb36010beb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.311+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 >> 172.21.15.26:0/2921504352 conn(0x7fb3600f76f0 msgr2=0x7fb3600718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.312+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 shutdown_connections 2024-05-08T23:58:46.309 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:46.312+0000 7fb36501f700 1 -- 172.21.15.26:0/2921504352 wait complete. 2024-05-08T23:58:47.042 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for the mgr to restart... 2024-05-08T23:58:47.042 INFO:teuthology.orchestra.run.smithi026.stderr:Waiting for mgr epoch 9... 2024-05-08T23:58:47.049 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:46.310115+0000 mon.smithi026 (mon.0) 70 : audit [DBG] from='client.? 172.21.15.26:0/2921504352' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T23:58:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.659+0000 7f6fc1d99700 1 Processor -- start 2024-05-08T23:58:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.659+0000 7f6fc1d99700 1 -- start start 2024-05-08T23:58:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fc1d99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc0ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fc1d99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc100120 con 0x7f6fbc071c60 2024-05-08T23:58:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fbb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc0ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fbb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc0ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55940/0 (socket says 172.21.15.26:55940) 2024-05-08T23:58:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fbb7fe700 1 -- 172.21.15.26:0/3708732864 learned_addr learned my addr 172.21.15.26:0/3708732864 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fbb7fe700 1 -- 172.21.15.26:0/3708732864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc100260 con 0x7f6fbc071c60 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fbb7fe700 1 --2- 172.21.15.26:0/3708732864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc0ffc30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f6fac009730 tx=0x7f6fac0090f0).ready entity=mon.0 client_cookie=d8d4f7b92856f707 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fba7fc700 1 -- 172.21.15.26:0/3708732864 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fac00b6e0 con 0x7f6fbc071c60 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fba7fc700 1 -- 172.21.15.26:0/3708732864 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f6fac00bcd0 con 0x7f6fbc071c60 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.660+0000 7f6fba7fc700 1 -- 172.21.15.26:0/3708732864 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fac011cb0 con 0x7f6fbc071c60 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.661+0000 7f6fc1d99700 1 -- 172.21.15.26:0/3708732864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 msgr2=0x7f6fbc0ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.661+0000 7f6fc1d99700 1 --2- 172.21.15.26:0/3708732864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc0ffc30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f6fac009730 tx=0x7f6fac0090f0).stop 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.661+0000 7f6fc1d99700 1 -- 172.21.15.26:0/3708732864 shutdown_connections 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.661+0000 7f6fc1d99700 1 --2- 172.21.15.26:0/3708732864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc0ffc30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.661+0000 7f6fc1d99700 1 -- 172.21.15.26:0/3708732864 >> 172.21.15.26:0/3708732864 conn(0x7f6fbc0f76f0 msgr2=0x7f6fbc0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.661+0000 7f6fc1d99700 1 -- 172.21.15.26:0/3708732864 shutdown_connections 2024-05-08T23:58:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.661+0000 7f6fc1d99700 1 -- 172.21.15.26:0/3708732864 wait complete. 2024-05-08T23:58:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.662+0000 7f6fc1d99700 1 Processor -- start 2024-05-08T23:58:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.662+0000 7f6fc1d99700 1 -- start start 2024-05-08T23:58:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.662+0000 7f6fc1d99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc10bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.662+0000 7f6fc1d99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc10c390 con 0x7f6fbc071c60 2024-05-08T23:58:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.662+0000 7f6fbb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc10bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:47.674 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.662+0000 7f6fbb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc10bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55942/0 (socket says 172.21.15.26:55942) 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.662+0000 7f6fbb7fe700 1 -- 172.21.15.26:0/1177558041 learned_addr learned my addr 172.21.15.26:0/1177558041 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.662+0000 7f6fbb7fe700 1 -- 172.21.15.26:0/1177558041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009370 con 0x7f6fbc071c60 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.663+0000 7f6fbb7fe700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc10bea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6fac0118b0 tx=0x7f6fac0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.663+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fac00be40 con 0x7f6fbc071c60 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.663+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f6fac01aad0 con 0x7f6fbc071c60 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.663+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc10c590 con 0x7f6fbc071c60 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.663+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fac023a80 con 0x7f6fbc071c60 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.663+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc10c9a0 con 0x7f6fbc071c60 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.663+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f6fac023cc0 con 0x7f6fbc071c60 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.664+0000 7f6fb8ff9700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 0x7f6fa4034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.664+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 --> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fbc05a310 con 0x7f6fa4032660 2024-05-08T23:58:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.664+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f6fac044880 con 0x7f6fbc071c60 2024-05-08T23:58:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.664+0000 7f6fbaffd700 1 -- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 msgr2=0x7f6fa4034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3965746041 2024-05-08T23:58:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.664+0000 7f6fbaffd700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 0x7f6fa4034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:58:47.859 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.865+0000 7f6fbaffd700 1 -- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 msgr2=0x7f6fa4034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3965746041 2024-05-08T23:58:47.859 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:47.865+0000 7f6fbaffd700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 0x7f6fa4034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:58:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:48.266+0000 7f6fbaffd700 1 -- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 msgr2=0x7f6fa4034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3965746041 2024-05-08T23:58:48.260 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:48.266+0000 7f6fbaffd700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 0x7f6fa4034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-05-08T23:58:49.061 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:49.067+0000 7f6fbaffd700 1 -- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 msgr2=0x7f6fa4034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/3965746041 2024-05-08T23:58:49.061 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:49.067+0000 7f6fbaffd700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 0x7f6fa4034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-05-08T23:58:50.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:50.300+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mgrmap(e 10) v1 ==== 38469+0+0 (secure 0 0 0) 0x7f6fac02cc90 con 0x7f6fbc071c60 2024-05-08T23:58:50.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:50.300+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 msgr2=0x7f6fa4034b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:58:50.295 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:50.300+0000 7f6fb8ff9700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 0x7f6fa4034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:50.299210+0000 mon.smithi026 (mon.0) 71 : cluster [INF] Active manager daemon smithi026.brymfp restarted 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:50.299424+0000 mon.smithi026 (mon.0) 72 : cluster [INF] Activating manager daemon smithi026.brymfp 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:50.302311+0000 mon.smithi026 (mon.0) 73 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:50.302422+0000 mon.smithi026 (mon.0) 74 : cluster [DBG] mgrmap e10: smithi026.brymfp(active, starting, since 0.00308378s) 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.303228+0000 mon.smithi026 (mon.0) 75 : audit [DBG] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.303816+0000 mon.smithi026 (mon.0) 76 : audit [DBG] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.304471+0000 mon.smithi026 (mon.0) 77 : audit [DBG] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.304686+0000 mon.smithi026 (mon.0) 78 : audit [DBG] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.304884+0000 mon.smithi026 (mon.0) 79 : audit [DBG] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:58:50.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:50.319026+0000 mon.smithi026 (mon.0) 80 : cluster [INF] Manager daemon smithi026.brymfp is now available 2024-05-08T23:58:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.301+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 11) v1 ==== 38539+0+0 (secure 0 0 0) 0x7f6fac01a640 con 0x7f6fbc071c60 2024-05-08T23:58:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.302+0000 7f6fb8ff9700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f6fa4035fb0 0x7f6fa40383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.302+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 --> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fbc05a310 con 0x7f6fa4035fb0 2024-05-08T23:58:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.302+0000 7f6fbaffd700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f6fa4035fb0 0x7f6fa40383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.303+0000 7f6fbaffd700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f6fa4035fb0 0x7f6fa40383a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f6fb0003850 tx=0x7f6fb0006e60).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.303+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mgr.14156 v2:172.21.15.26:6800/2916145691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f6fbc05a310 con 0x7f6fa4035fb0 2024-05-08T23:58:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.309+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 --> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6fbc046ce0 con 0x7f6fa4035fb0 2024-05-08T23:58:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fb8ff9700 1 -- 172.21.15.26:0/1177558041 <== mgr.14156 v2:172.21.15.26:6800/2916145691 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f6fbc046ce0 con 0x7f6fa4035fb0 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: { 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: "initialized": true 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: } 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f6fa4035fb0 msgr2=0x7f6fa40383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f6fa4035fb0 0x7f6fa40383a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f6fb0003850 tx=0x7f6fb0006e60).stop 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 msgr2=0x7f6fbc10bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc10bea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6fac0118b0 tx=0x7f6fac0090f0).stop 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 shutdown_connections 2024-05-08T23:58:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f6fa4035fb0 0x7f6fa40383a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fbc071c60 0x7f6fbc10bea0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 --2- 172.21.15.26:0/1177558041 >> [v2:172.21.15.26:6800/3965746041,v1:172.21.15.26:6801/3965746041] conn(0x7f6fa4032660 0x7f6fa4034b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:58:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 >> 172.21.15.26:0/1177558041 conn(0x7f6fbc0f76f0 msgr2=0x7f6fbc0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 shutdown_connections 2024-05-08T23:58:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:51.310+0000 7f6fc1d99700 1 -- 172.21.15.26:0/1177558041 wait complete. 2024-05-08T23:58:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.417744+0000 mon.smithi026 (mon.0) 81 : audit [DBG] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.419333+0000 mon.smithi026 (mon.0) 82 : audit [DBG] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.445755+0000 mon.smithi026 (mon.0) 83 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:58:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:50.448112+0000 mon.smithi026 (mon.0) 84 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-08T23:58:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:51.304292+0000 mon.smithi026 (mon.0) 85 : cluster [DBG] mgrmap e11: smithi026.brymfp(active, since 1.00495s) 2024-05-08T23:58:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:mgr epoch 9 is available 2024-05-08T23:58:52.348 INFO:teuthology.orchestra.run.smithi026.stderr:Generating a dashboard self-signed certificate... 2024-05-08T23:58:52.609 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:51.303715+0000 mgr.smithi026.brymfp (mgr.14156) 1 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T23:58:52.609 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:51.310298+0000 mgr.smithi026.brymfp (mgr.14156) 2 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T23:58:52.912 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.917+0000 7f533a77d700 1 Processor -- start 2024-05-08T23:58:52.912 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.917+0000 7f533a77d700 1 -- start start 2024-05-08T23:58:52.912 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.917+0000 7f533a77d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f53341020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:52.912 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.917+0000 7f533a77d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340fdaa0 con 0x7f5334071be0 2024-05-08T23:58:52.912 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.918+0000 7f5333fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f53341020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:52.912 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.918+0000 7f5333fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f53341020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48838/0 (socket says 172.21.15.26:48838) 2024-05-08T23:58:52.914 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.918+0000 7f5333fff700 1 -- 172.21.15.26:0/3727412005 learned_addr learned my addr 172.21.15.26:0/3727412005 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:52.914 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.918+0000 7f5333fff700 1 -- 172.21.15.26:0/3727412005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53341025a0 con 0x7f5334071be0 2024-05-08T23:58:52.914 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.918+0000 7f5333fff700 1 --2- 172.21.15.26:0/3727412005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f53341020b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5324009730 tx=0x7f53240090f0).ready entity=mon.0 client_cookie=551f60862977d6a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:52.914 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.918+0000 7f5332ffd700 1 -- 172.21.15.26:0/3727412005 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f532400b6e0 con 0x7f5334071be0 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.918+0000 7f5332ffd700 1 -- 172.21.15.26:0/3727412005 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f532400bcd0 con 0x7f5334071be0 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.918+0000 7f5332ffd700 1 -- 172.21.15.26:0/3727412005 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5324011cb0 con 0x7f5334071be0 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.919+0000 7f533a77d700 1 -- 172.21.15.26:0/3727412005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 msgr2=0x7f53341020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.919+0000 7f533a77d700 1 --2- 172.21.15.26:0/3727412005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f53341020b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5324009730 tx=0x7f53240090f0).stop 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.919+0000 7f533a77d700 1 -- 172.21.15.26:0/3727412005 shutdown_connections 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.919+0000 7f533a77d700 1 --2- 172.21.15.26:0/3727412005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f53341020b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.919+0000 7f533a77d700 1 -- 172.21.15.26:0/3727412005 >> 172.21.15.26:0/3727412005 conn(0x7f53340f76f0 msgr2=0x7f53340f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.919+0000 7f533a77d700 1 -- 172.21.15.26:0/3727412005 shutdown_connections 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.919+0000 7f533a77d700 1 -- 172.21.15.26:0/3727412005 wait complete. 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.920+0000 7f533a77d700 1 Processor -- start 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.920+0000 7f533a77d700 1 -- start start 2024-05-08T23:58:52.915 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.920+0000 7f533a77d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f533410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:52.916 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.920+0000 7f533a77d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533410e4c0 con 0x7f5334071be0 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.920+0000 7f5333fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f533410dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f5333fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f533410dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48840/0 (socket says 172.21.15.26:48840) 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f5333fff700 1 -- 172.21.15.26:0/1985125171 learned_addr learned my addr 172.21.15.26:0/1985125171 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f5333fff700 1 -- 172.21.15.26:0/1985125171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009370 con 0x7f5334071be0 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f5333fff700 1 --2- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f533410dfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f53240118b0 tx=0x7f53240090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f53317fa700 1 -- 172.21.15.26:0/1985125171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f532400be40 con 0x7f5334071be0 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533410e6c0 con 0x7f5334071be0 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f53317fa700 1 -- 172.21.15.26:0/1985125171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f532401aad0 con 0x7f5334071be0 2024-05-08T23:58:52.917 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f53317fa700 1 -- 172.21.15.26:0/1985125171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5324023a80 con 0x7f5334071be0 2024-05-08T23:58:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.921+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533410ead0 con 0x7f5334071be0 2024-05-08T23:58:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.922+0000 7f53317fa700 1 -- 172.21.15.26:0/1985125171 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f5324023cc0 con 0x7f5334071be0 2024-05-08T23:58:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.922+0000 7f53317fa700 1 --2- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f531c032660 0x7f531c034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.922+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5334046ce0 con 0x7f5334071be0 2024-05-08T23:58:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.922+0000 7f53317fa700 1 -- 172.21.15.26:0/1985125171 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f5324044c80 con 0x7f5334071be0 2024-05-08T23:58:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.923+0000 7f53337fe700 1 --2- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f531c032660 0x7f531c034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.923+0000 7f53337fe700 1 --2- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f531c032660 0x7f531c034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5328009780 tx=0x7f5328006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:52.927+0000 7f53317fa700 1 -- 172.21.15.26:0/1985125171 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f532401e070 con 0x7f5334071be0 2024-05-08T23:58:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.108+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 --> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f533410f3b0 con 0x7f531c032660 2024-05-08T23:58:53.233 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.239+0000 7f53317fa700 1 -- 172.21.15.26:0/1985125171 <== mgr.14156 v2:172.21.15.26:6800/2916145691 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f533410f3b0 con 0x7f531c032660 2024-05-08T23:58:53.234 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: Self-signed certificate created 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f531c032660 msgr2=0x7f531c034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 --2- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f531c032660 0x7f531c034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5328009780 tx=0x7f5328006cc0).stop 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 msgr2=0x7f533410dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 --2- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f533410dfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f53240118b0 tx=0x7f53240090f0).stop 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 shutdown_connections 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 --2- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f531c032660 0x7f531c034b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 --2- 172.21.15.26:0/1985125171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5334071be0 0x7f533410dfd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 >> 172.21.15.26:0/1985125171 conn(0x7f53340f76f0 msgr2=0x7f53340f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 shutdown_connections 2024-05-08T23:58:53.236 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:53.241+0000 7f533a77d700 1 -- 172.21.15.26:0/1985125171 wait complete. 2024-05-08T23:58:53.414 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:52.359172+0000 mon.smithi026 (mon.0) 86 : cluster [DBG] mgrmap e12: smithi026.brymfp(active, since 2s) 2024-05-08T23:58:53.414 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:52.414375+0000 mon.smithi026 (mon.0) 87 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:53.414 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:53.238145+0000 mon.smithi026 (mon.0) 88 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:53.414 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:53.239871+0000 mon.smithi026 (mon.0) 89 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:54.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:53.109426+0000 mgr.smithi026.brymfp (mgr.14156) 3 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:Creating initial admin user... 2024-05-08T23:58:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.345+0000 7f3b0d5f1700 1 Processor -- start 2024-05-08T23:58:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.345+0000 7f3b0d5f1700 1 -- start start 2024-05-08T23:58:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.345+0000 7f3b0d5f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b080fd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.345+0000 7f3b0d5f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080fdea0 con 0x7f3b080fd590 2024-05-08T23:58:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.346+0000 7f3b06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b080fd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.346+0000 7f3b06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b080fd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48852/0 (socket says 172.21.15.26:48852) 2024-05-08T23:58:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.346+0000 7f3b06ffd700 1 -- 172.21.15.26:0/321645062 learned_addr learned my addr 172.21.15.26:0/321645062 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.346+0000 7f3b06ffd700 1 -- 172.21.15.26:0/321645062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080fdfe0 con 0x7f3b080fd590 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.346+0000 7f3b06ffd700 1 --2- 172.21.15.26:0/321645062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b080fd9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f3af0009730 tx=0x7f3af00090f0).ready entity=mon.0 client_cookie=feabcd1907a12d3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.346+0000 7f3b05ffb700 1 -- 172.21.15.26:0/321645062 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3af000b6e0 con 0x7f3b080fd590 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.346+0000 7f3b05ffb700 1 -- 172.21.15.26:0/321645062 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3af000bcd0 con 0x7f3b080fd590 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.346+0000 7f3b05ffb700 1 -- 172.21.15.26:0/321645062 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3af0011cb0 con 0x7f3b080fd590 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.347+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/321645062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 msgr2=0x7f3b080fd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.347+0000 7f3b0d5f1700 1 --2- 172.21.15.26:0/321645062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b080fd9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f3af0009730 tx=0x7f3af00090f0).stop 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.347+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/321645062 shutdown_connections 2024-05-08T23:58:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.347+0000 7f3b0d5f1700 1 --2- 172.21.15.26:0/321645062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b080fd9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.347+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/321645062 >> 172.21.15.26:0/321645062 conn(0x7f3b080f6e20 msgr2=0x7f3b080f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.347+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/321645062 shutdown_connections 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.347+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/321645062 wait complete. 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.348+0000 7f3b0d5f1700 1 Processor -- start 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.348+0000 7f3b0d5f1700 1 -- start start 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.348+0000 7f3b0d5f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b0810df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.348+0000 7f3b0d5f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0810e430 con 0x7f3b080fd590 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.348+0000 7f3b06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b0810df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.348+0000 7f3b06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b0810df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48854/0 (socket says 172.21.15.26:48854) 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.348+0000 7f3b06ffd700 1 -- 172.21.15.26:0/4138039560 learned_addr learned my addr 172.21.15.26:0/4138039560 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.349+0000 7f3b06ffd700 1 -- 172.21.15.26:0/4138039560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0009370 con 0x7f3b080fd590 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.349+0000 7f3b06ffd700 1 --2- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b0810df40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3af0006ba0 tx=0x7f3af00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.349+0000 7f3afffff700 1 -- 172.21.15.26:0/4138039560 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3af001a640 con 0x7f3b080fd590 2024-05-08T23:58:55.347 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.349+0000 7f3afffff700 1 -- 172.21.15.26:0/4138039560 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3af001ac30 con 0x7f3b080fd590 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.349+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0810e630 con 0x7f3b080fd590 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.349+0000 7f3afffff700 1 -- 172.21.15.26:0/4138039560 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3af0022b60 con 0x7f3b080fd590 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.349+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0810ea40 con 0x7f3b080fd590 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.350+0000 7f3afffff700 1 -- 172.21.15.26:0/4138039560 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f3af0019390 con 0x7f3b080fd590 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.350+0000 7f3afffff700 1 --2- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3af4032660 0x7f3af4034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.350+0000 7f3afffff700 1 -- 172.21.15.26:0/4138039560 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f3af0044c30 con 0x7f3b080fd590 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.350+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b08046ce0 con 0x7f3b080fd590 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.350+0000 7f3b067fc700 1 --2- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3af4032660 0x7f3af4034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:55.348 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.351+0000 7f3b067fc700 1 --2- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3af4032660 0x7f3af4034b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3af8009780 tx=0x7f3af8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.355+0000 7f3afffff700 1 -- 172.21.15.26:0/4138039560 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3af001e070 con 0x7f3b080fd590 2024-05-08T23:58:55.537 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.543+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 --> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3b08103200 con 0x7f3af4032660 2024-05-08T23:58:55.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.788+0000 7f3afffff700 1 -- 172.21.15.26:0/4138039560 <== mgr.14156 v2:172.21.15.26:6800/2916145691 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f3b08103200 con 0x7f3af4032660 2024-05-08T23:58:55.783 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$UQsTNkicCk6ETFvEgzr3XePQ6l9LZZcjNmbnoviqvaMjEstncLSGS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715212735, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-08T23:58:55.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.790+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3af4032660 msgr2=0x7f3af4034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:55.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.790+0000 7f3b0d5f1700 1 --2- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3af4032660 0x7f3af4034b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3af8009780 tx=0x7f3af8006cc0).stop 2024-05-08T23:58:55.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.790+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 msgr2=0x7f3b0810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:55.785 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.790+0000 7f3b0d5f1700 1 --2- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b0810df40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3af0006ba0 tx=0x7f3af00090f0).stop 2024-05-08T23:58:55.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.791+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 shutdown_connections 2024-05-08T23:58:55.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.791+0000 7f3b0d5f1700 1 --2- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3af4032660 0x7f3af4034b20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:55.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.791+0000 7f3b0d5f1700 1 --2- 172.21.15.26:0/4138039560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b080fd590 0x7f3b0810df40 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0x7f3af0006ba0 tx=0x7f3af00090f0).stop 2024-05-08T23:58:55.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.791+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 >> 172.21.15.26:0/4138039560 conn(0x7f3b080f6e20 msgr2=0x7f3b080f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:55.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.791+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 shutdown_connections 2024-05-08T23:58:55.786 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:55.791+0000 7f3b0d5f1700 1 -- 172.21.15.26:0/4138039560 wait complete. 2024-05-08T23:58:56.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:55.544120+0000 mgr.smithi026.brymfp (mgr.14156) 4 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:56.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:55.788983+0000 mon.smithi026 (mon.0) 90 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:58:56.515 INFO:teuthology.orchestra.run.smithi026.stderr:Fetching dashboard port number... 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f08150f1700 1 Processor -- start 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f08150f1700 1 -- start start 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f08150f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f08100ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f08150f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810100180 con 0x7f0810071c00 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f080ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f08100ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f080ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f08100ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48870/0 (socket says 172.21.15.26:48870) 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f080ed9d700 1 -- 172.21.15.26:0/591259655 learned_addr learned my addr 172.21.15.26:0/591259655 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f080ed9d700 1 -- 172.21.15.26:0/591259655 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08101002c0 con 0x7f0810071c00 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.087+0000 7f080ed9d700 1 --2- 172.21.15.26:0/591259655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f08100ffc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0800009730 tx=0x7f08000090f0).ready entity=mon.0 client_cookie=e089d4bbefb72927 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f080dd9b700 1 -- 172.21.15.26:0/591259655 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f080000b6e0 con 0x7f0810071c00 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f080dd9b700 1 -- 172.21.15.26:0/591259655 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f080000bcd0 con 0x7f0810071c00 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f080dd9b700 1 -- 172.21.15.26:0/591259655 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0800011cb0 con 0x7f0810071c00 2024-05-08T23:58:57.085 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f08150f1700 1 -- 172.21.15.26:0/591259655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 msgr2=0x7f08100ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f08150f1700 1 --2- 172.21.15.26:0/591259655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f08100ffc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0800009730 tx=0x7f08000090f0).stop 2024-05-08T23:58:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f08150f1700 1 -- 172.21.15.26:0/591259655 shutdown_connections 2024-05-08T23:58:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f08150f1700 1 --2- 172.21.15.26:0/591259655 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f08100ffc90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f08150f1700 1 -- 172.21.15.26:0/591259655 >> 172.21.15.26:0/591259655 conn(0x7f08100f76f0 msgr2=0x7f08100f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f08150f1700 1 -- 172.21.15.26:0/591259655 shutdown_connections 2024-05-08T23:58:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.088+0000 7f08150f1700 1 -- 172.21.15.26:0/591259655 wait complete. 2024-05-08T23:58:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.089+0000 7f08150f1700 1 Processor -- start 2024-05-08T23:58:57.086 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.089+0000 7f08150f1700 1 -- start start 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f08150f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f081010e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f08150f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081010e550 con 0x7f0810071c00 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f080ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f081010e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f080ed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f081010e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48872/0 (socket says 172.21.15.26:48872) 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f080ed9d700 1 -- 172.21.15.26:0/2139137895 learned_addr learned my addr 172.21.15.26:0/2139137895 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f080ed9d700 1 -- 172.21.15.26:0/2139137895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009370 con 0x7f0810071c00 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f080ed9d700 1 --2- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f081010e060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f08000118b0 tx=0x7f08000090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f07f7fff700 1 -- 172.21.15.26:0/2139137895 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f080000be40 con 0x7f0810071c00 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081010e750 con 0x7f0810071c00 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f07f7fff700 1 -- 172.21.15.26:0/2139137895 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f080001aad0 con 0x7f0810071c00 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f07f7fff700 1 -- 172.21.15.26:0/2139137895 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08000239e0 con 0x7f0810071c00 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.090+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081010eb60 con 0x7f0810071c00 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.091+0000 7f07f7fff700 1 -- 172.21.15.26:0/2139137895 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f0800023ca0 con 0x7f0810071c00 2024-05-08T23:58:57.087 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.091+0000 7f07f7fff700 1 --2- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f07f80326d0 0x7f07f8034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:57.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.091+0000 7f07f7fff700 1 -- 172.21.15.26:0/2139137895 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f0800044d70 con 0x7f0810071c00 2024-05-08T23:58:57.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.092+0000 7f080e59c700 1 --2- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f07f80326d0 0x7f07f8034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:57.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.092+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081005a310 con 0x7f0810071c00 2024-05-08T23:58:57.088 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.092+0000 7f080e59c700 1 --2- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f07f80326d0 0x7f07f8034b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0804009780 tx=0x7f0804006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:57.090 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.096+0000 7f07f7fff700 1 -- 172.21.15.26:0/2139137895 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f080001e020 con 0x7f0810071c00 2024-05-08T23:58:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.266+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0810046ce0 con 0x7f0810071c00 2024-05-08T23:58:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.267+0000 7f07f7fff700 1 -- 172.21.15.26:0/2139137895 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f0800021320 con 0x7f0810071c00 2024-05-08T23:58:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 8443 2024-05-08T23:58:57.264 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f07f80326d0 msgr2=0x7f07f8034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 --2- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f07f80326d0 0x7f07f8034b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0804009780 tx=0x7f0804006cc0).stop 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 msgr2=0x7f081010e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 --2- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f081010e060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f08000118b0 tx=0x7f08000090f0).stop 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 shutdown_connections 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 --2- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f07f80326d0 0x7f07f8034b90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 --2- 172.21.15.26:0/2139137895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0810071c00 0x7f081010e060 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 >> 172.21.15.26:0/2139137895 conn(0x7f08100f76f0 msgr2=0x7f08100f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 shutdown_connections 2024-05-08T23:58:57.265 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:57.269+0000 7f08150f1700 1 -- 172.21.15.26:0/2139137895 wait complete. 2024-05-08T23:58:57.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:58:56.794221+0000 mon.smithi026 (mon.0) 91 : cluster [DBG] mgrmap e13: smithi026.brymfp(active, since 6s) 2024-05-08T23:58:57.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:58:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:58:57.267699+0000 mon.smithi026 (mon.0) 92 : audit [DBG] from='client.? 172.21.15.26:0/2139137895' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-08T23:58:57.916 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: disabled 2024-05-08T23:58:57.925 INFO:teuthology.orchestra.run.smithi026.stderr:systemctl: inactive 2024-05-08T23:58:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:firewalld.service is not enabled 2024-05-08T23:58:57.926 INFO:teuthology.orchestra.run.smithi026.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-08T23:58:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:Ceph Dashboard is now available at: 2024-05-08T23:58:57.930 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:58:57.930 INFO:teuthology.orchestra.run.smithi026.stderr: URL: https://smithi026.front.sepia.ceph.com:8443/ 2024-05-08T23:58:57.930 INFO:teuthology.orchestra.run.smithi026.stderr: User: admin 2024-05-08T23:58:57.930 INFO:teuthology.orchestra.run.smithi026.stderr: Password: vbme9phcm6 2024-05-08T23:58:57.930 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:58:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:Enabling autotune for osd_memory_target 2024-05-08T23:58:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.472+0000 7f0bfa20c700 1 Processor -- start 2024-05-08T23:58:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bfa20c700 1 -- start start 2024-05-08T23:58:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bfa20c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf40ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bfa20c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4100160 con 0x7f0bf4071c20 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bf37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf40ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bf37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf40ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48886/0 (socket says 172.21.15.26:48886) 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bf37fe700 1 -- 172.21.15.26:0/1610678090 learned_addr learned my addr 172.21.15.26:0/1610678090 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bf37fe700 1 -- 172.21.15.26:0/1610678090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf41002a0 con 0x7f0bf4071c20 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bf37fe700 1 --2- 172.21.15.26:0/1610678090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf40ffc70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0be4009730 tx=0x7f0be40090f0).ready entity=mon.0 client_cookie=4f15d5610881a8c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.473+0000 7f0bf27fc700 1 -- 172.21.15.26:0/1610678090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0be400b770 con 0x7f0bf4071c20 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bf27fc700 1 -- 172.21.15.26:0/1610678090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0be400bd60 con 0x7f0bf4071c20 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bf27fc700 1 -- 172.21.15.26:0/1610678090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0be4011d90 con 0x7f0bf4071c20 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bfa20c700 1 -- 172.21.15.26:0/1610678090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 msgr2=0x7f0bf40ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bfa20c700 1 --2- 172.21.15.26:0/1610678090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf40ffc70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0be4009730 tx=0x7f0be40090f0).stop 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bfa20c700 1 -- 172.21.15.26:0/1610678090 shutdown_connections 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bfa20c700 1 --2- 172.21.15.26:0/1610678090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf40ffc70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bfa20c700 1 -- 172.21.15.26:0/1610678090 >> 172.21.15.26:0/1610678090 conn(0x7f0bf40f76f0 msgr2=0x7f0bf40f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bfa20c700 1 -- 172.21.15.26:0/1610678090 shutdown_connections 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.474+0000 7f0bfa20c700 1 -- 172.21.15.26:0/1610678090 wait complete. 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.475+0000 7f0bfa20c700 1 Processor -- start 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.475+0000 7f0bfa20c700 1 -- start start 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.475+0000 7f0bfa20c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bfa20c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf410c3a0 con 0x7f0bf4071c20 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bf37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bf37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf410beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48896/0 (socket says 172.21.15.26:48896) 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bf37fe700 1 -- 172.21.15.26:0/3416383436 learned_addr learned my addr 172.21.15.26:0/3416383436 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bf37fe700 1 -- 172.21.15.26:0/3416383436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009370 con 0x7f0bf4071c20 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bf37fe700 1 --2- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf410beb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0be4009f00 tx=0x7f0be40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bf0ff9700 1 -- 172.21.15.26:0/3416383436 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0be4011bb0 con 0x7f0bf4071c20 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bf0ff9700 1 -- 172.21.15.26:0/3416383436 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0be400bbc0 con 0x7f0bf4071c20 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf410c5a0 con 0x7f0bf4071c20 2024-05-08T23:58:58.478 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bf0ff9700 1 -- 172.21.15.26:0/3416383436 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0be401ab20 con 0x7f0bf4071c20 2024-05-08T23:58:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.476+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf410c9b0 con 0x7f0bf4071c20 2024-05-08T23:58:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.477+0000 7f0bf0ff9700 1 -- 172.21.15.26:0/3416383436 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f0be40223b0 con 0x7f0bf4071c20 2024-05-08T23:58:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.477+0000 7f0bf0ff9700 1 --2- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0bdc0326d0 0x7f0bdc034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.477+0000 7f0bf0ff9700 1 -- 172.21.15.26:0/3416383436 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f0be4045040 con 0x7f0bf4071c20 2024-05-08T23:58:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.477+0000 7f0bf2ffd700 1 --2- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0bdc0326d0 0x7f0bdc034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.477+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf4046ce0 con 0x7f0bf4071c20 2024-05-08T23:58:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.478+0000 7f0bf2ffd700 1 --2- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0bdc0326d0 0x7f0bdc034b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0be8009780 tx=0x7f0be8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.482+0000 7f0bf0ff9700 1 -- 172.21.15.26:0/3416383436 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0be401e070 con 0x7f0bf4071c20 2024-05-08T23:58:58.648 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.653+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f0bf4105cf0 con 0x7f0bf4071c20 2024-05-08T23:58:58.648 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.654+0000 7f0bf0ff9700 1 -- 172.21.15.26:0/3416383436 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0be4022700 con 0x7f0bf4071c20 2024-05-08T23:58:58.651 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0bdc0326d0 msgr2=0x7f0bdc034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 --2- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0bdc0326d0 0x7f0bdc034b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0be8009780 tx=0x7f0be8006cc0).stop 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 msgr2=0x7f0bf410beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 --2- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf410beb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0be4009f00 tx=0x7f0be40090f0).stop 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 shutdown_connections 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 --2- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0bdc0326d0 0x7f0bdc034b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 --2- 172.21.15.26:0/3416383436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bf4071c20 0x7f0bf410beb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 >> 172.21.15.26:0/3416383436 conn(0x7f0bf40f76f0 msgr2=0x7f0bf40f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 shutdown_connections 2024-05-08T23:58:58.652 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:58.656+0000 7f0bfa20c700 1 -- 172.21.15.26:0/3416383436 wait complete. 2024-05-08T23:58:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.945+0000 7f7bcba45700 1 Processor -- start 2024-05-08T23:58:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.945+0000 7f7bcba45700 1 -- start start 2024-05-08T23:58:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.945+0000 7f7bcba45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc4102090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.945+0000 7f7bcba45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40fda80 con 0x7f7bc4071c00 2024-05-08T23:58:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.945+0000 7f7bc97e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc4102090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:59.943 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.945+0000 7f7bc97e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc4102090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48900/0 (socket says 172.21.15.26:48900) 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.945+0000 7f7bc97e1700 1 -- 172.21.15.26:0/1850485418 learned_addr learned my addr 172.21.15.26:0/1850485418 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.946+0000 7f7bc97e1700 1 -- 172.21.15.26:0/1850485418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4102580 con 0x7f7bc4071c00 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.946+0000 7f7bc97e1700 1 --2- 172.21.15.26:0/1850485418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc4102090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7bc0009730 tx=0x7f7bc00090f0).ready entity=mon.0 client_cookie=b758b81f65e26fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.946+0000 7f7bbbfff700 1 -- 172.21.15.26:0/1850485418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bc000b6e0 con 0x7f7bc4071c00 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.946+0000 7f7bbbfff700 1 -- 172.21.15.26:0/1850485418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7bc000bcd0 con 0x7f7bc4071c00 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.946+0000 7f7bbbfff700 1 -- 172.21.15.26:0/1850485418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bc0011cb0 con 0x7f7bc4071c00 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.946+0000 7f7bcba45700 1 -- 172.21.15.26:0/1850485418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 msgr2=0x7f7bc4102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.946+0000 7f7bcba45700 1 --2- 172.21.15.26:0/1850485418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc4102090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7bc0009730 tx=0x7f7bc00090f0).stop 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.947+0000 7f7bcba45700 1 -- 172.21.15.26:0/1850485418 shutdown_connections 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.947+0000 7f7bcba45700 1 --2- 172.21.15.26:0/1850485418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc4102090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.947+0000 7f7bcba45700 1 -- 172.21.15.26:0/1850485418 >> 172.21.15.26:0/1850485418 conn(0x7f7bc40f76f0 msgr2=0x7f7bc40f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.947+0000 7f7bcba45700 1 -- 172.21.15.26:0/1850485418 shutdown_connections 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.947+0000 7f7bcba45700 1 -- 172.21.15.26:0/1850485418 wait complete. 2024-05-08T23:58:59.944 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.947+0000 7f7bcba45700 1 Processor -- start 2024-05-08T23:58:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bcba45700 1 -- start start 2024-05-08T23:58:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bcba45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bcba45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc410e550 con 0x7f7bc4071c00 2024-05-08T23:58:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bc97e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bc97e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc410e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48904/0 (socket says 172.21.15.26:48904) 2024-05-08T23:58:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bc97e1700 1 -- 172.21.15.26:0/1995114353 learned_addr learned my addr 172.21.15.26:0/1995114353 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:58:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bc97e1700 1 -- 172.21.15.26:0/1995114353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0009370 con 0x7f7bc4071c00 2024-05-08T23:58:59.945 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bc97e1700 1 --2- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc410e060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7bc00118b0 tx=0x7f7bc00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bba7fc700 1 -- 172.21.15.26:0/1995114353 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bc000be40 con 0x7f7bc4071c00 2024-05-08T23:58:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bba7fc700 1 -- 172.21.15.26:0/1995114353 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7bc001aad0 con 0x7f7bc4071c00 2024-05-08T23:58:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.948+0000 7f7bba7fc700 1 -- 172.21.15.26:0/1995114353 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bc00239e0 con 0x7f7bc4071c00 2024-05-08T23:58:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.949+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc410e750 con 0x7f7bc4071c00 2024-05-08T23:58:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.949+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc410eb60 con 0x7f7bc4071c00 2024-05-08T23:58:59.946 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.949+0000 7f7bba7fc700 1 -- 172.21.15.26:0/1995114353 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f7bc001ac40 con 0x7f7bc4071c00 2024-05-08T23:58:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.950+0000 7f7bba7fc700 1 --2- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f7bb0032730 0x7f7bb0034bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:58:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.950+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc4046ce0 con 0x7f7bc4071c00 2024-05-08T23:58:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.950+0000 7f7bba7fc700 1 -- 172.21.15.26:0/1995114353 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f7bc0044d50 con 0x7f7bc4071c00 2024-05-08T23:58:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.950+0000 7f7bc8fe0700 1 --2- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f7bb0032730 0x7f7bb0034bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:58:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.950+0000 7f7bc8fe0700 1 --2- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f7bb0032730 0x7f7bb0034bf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f7bb4009780 tx=0x7f7bb4006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:58:59.954+0000 7f7bba7fc700 1 -- 172.21.15.26:0/1995114353 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7bc00199e0 con 0x7f7bc4071c00 2024-05-08T23:59:00.213 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.218+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f7bc4103180 con 0x7f7bc4071c00 2024-05-08T23:59:00.215 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.220+0000 7f7bba7fc700 1 -- 172.21.15.26:0/1995114353 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v29)=0 set mgr/dashboard/cluster/status v29) v1 ==== 153+0+0 (secure 0 0 0) 0x7f7bc0010e90 con 0x7f7bc4071c00 2024-05-08T23:59:00.218 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f7bb0032730 msgr2=0x7f7bb0034bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:00.218 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 --2- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f7bb0032730 0x7f7bb0034bf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f7bb4009780 tx=0x7f7bb4006cc0).stop 2024-05-08T23:59:00.218 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 msgr2=0x7f7bc410e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:00.218 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 --2- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc410e060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7bc00118b0 tx=0x7f7bc00090f0).stop 2024-05-08T23:59:00.218 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 shutdown_connections 2024-05-08T23:59:00.218 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 --2- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f7bb0032730 0x7f7bb0034bf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:00.219 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 --2- 172.21.15.26:0/1995114353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bc4071c00 0x7f7bc410e060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:00.219 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 >> 172.21.15.26:0/1995114353 conn(0x7f7bc40f76f0 msgr2=0x7f7bc40f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:00.219 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 shutdown_connections 2024-05-08T23:59:00.219 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: 2024-05-08T23:59:00.222+0000 7f7bcba45700 1 -- 172.21.15.26:0/1995114353 wait complete. 2024-05-08T23:59:00.219 INFO:teuthology.orchestra.run.smithi026.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr:Or, if you are only running a single cluster on this host: 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr:Please consider enabling telemetry to help improve Ceph: 2024-05-08T23:59:00.937 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:59:00.938 INFO:teuthology.orchestra.run.smithi026.stderr: ceph telemetry on 2024-05-08T23:59:00.938 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:59:00.938 INFO:teuthology.orchestra.run.smithi026.stderr:For more information see: 2024-05-08T23:59:00.938 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:59:00.938 INFO:teuthology.orchestra.run.smithi026.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2024-05-08T23:59:00.938 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-05-08T23:59:00.938 INFO:teuthology.orchestra.run.smithi026.stderr:Bootstrap complete. 2024-05-08T23:59:00.980 INFO:tasks.cephadm:Fetching config... 2024-05-08T23:59:00.980 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:59:00.980 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-08T23:59:01.039 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-08T23:59:01.040 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:59:01.040 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-08T23:59:01.101 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-08T23:59:01.101 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:59:01.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/keyring of=/dev/stdout 2024-05-08T23:59:01.172 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-08T23:59:01.172 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-08T23:59:01.172 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-08T23:59:01.232 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-08T23:59:01.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa8AOz00TAMM5/csM044U12Z+SA+pQWxMca4J/qNQBbiqfXN4uqnpHIs+fOKvoLjxvpjWHKSVo2zBDpYY+L2JXLiMsW3SUO52mIURAyOe/SXr3BaEQvGTxtn7KNbJmA+e18RP72QUwv9OfI/503t/0etwRN4MSYAFKTl4OTKcu9Z84WwBlYBgskFkfbK8ouCYD2XK8oYPK19Xp/prvoY0xUMugdccH2+lczecpg2beAxfs3Pz9zgdg1BxrPuNCXTGQPBZBHVCTU2HjrxqQiCjnonb/9hS3fIH9zo63/9idSzGnYNFZrLbOwevD+VE35SMUpOBahmiqmM1sBz7uNgUuFIFOqbCvpQdMpV/fuJ3+aFdanhc5DXSaVO85TKWH8Gd1WuDKEcqQHBdnleudGmR5+6bsEoawMKPmJBcHWvXyVbdmgPg/RfWFRryDuBFx0ilHX42gTw2nszM2YktXFjvHNxVTSTbqdtfLi1CwwbYgq/qG8V9TGz/KZhRZt286z3c= ceph-aa42787e-0d96-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T23:59:01.311 INFO:teuthology.orchestra.run.smithi026.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa8AOz00TAMM5/csM044U12Z+SA+pQWxMca4J/qNQBbiqfXN4uqnpHIs+fOKvoLjxvpjWHKSVo2zBDpYY+L2JXLiMsW3SUO52mIURAyOe/SXr3BaEQvGTxtn7KNbJmA+e18RP72QUwv9OfI/503t/0etwRN4MSYAFKTl4OTKcu9Z84WwBlYBgskFkfbK8ouCYD2XK8oYPK19Xp/prvoY0xUMugdccH2+lczecpg2beAxfs3Pz9zgdg1BxrPuNCXTGQPBZBHVCTU2HjrxqQiCjnonb/9hS3fIH9zo63/9idSzGnYNFZrLbOwevD+VE35SMUpOBahmiqmM1sBz7uNgUuFIFOqbCvpQdMpV/fuJ3+aFdanhc5DXSaVO85TKWH8Gd1WuDKEcqQHBdnleudGmR5+6bsEoawMKPmJBcHWvXyVbdmgPg/RfWFRryDuBFx0ilHX42gTw2nszM2YktXFjvHNxVTSTbqdtfLi1CwwbYgq/qG8V9TGz/KZhRZt286z3c= ceph-aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:59:01.322 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa8AOz00TAMM5/csM044U12Z+SA+pQWxMca4J/qNQBbiqfXN4uqnpHIs+fOKvoLjxvpjWHKSVo2zBDpYY+L2JXLiMsW3SUO52mIURAyOe/SXr3BaEQvGTxtn7KNbJmA+e18RP72QUwv9OfI/503t/0etwRN4MSYAFKTl4OTKcu9Z84WwBlYBgskFkfbK8ouCYD2XK8oYPK19Xp/prvoY0xUMugdccH2+lczecpg2beAxfs3Pz9zgdg1BxrPuNCXTGQPBZBHVCTU2HjrxqQiCjnonb/9hS3fIH9zo63/9idSzGnYNFZrLbOwevD+VE35SMUpOBahmiqmM1sBz7uNgUuFIFOqbCvpQdMpV/fuJ3+aFdanhc5DXSaVO85TKWH8Gd1WuDKEcqQHBdnleudGmR5+6bsEoawMKPmJBcHWvXyVbdmgPg/RfWFRryDuBFx0ilHX42gTw2nszM2YktXFjvHNxVTSTbqdtfLi1CwwbYgq/qG8V9TGz/KZhRZt286z3c= ceph-aa42787e-0d96-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T23:59:01.367 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa8AOz00TAMM5/csM044U12Z+SA+pQWxMca4J/qNQBbiqfXN4uqnpHIs+fOKvoLjxvpjWHKSVo2zBDpYY+L2JXLiMsW3SUO52mIURAyOe/SXr3BaEQvGTxtn7KNbJmA+e18RP72QUwv9OfI/503t/0etwRN4MSYAFKTl4OTKcu9Z84WwBlYBgskFkfbK8ouCYD2XK8oYPK19Xp/prvoY0xUMugdccH2+lczecpg2beAxfs3Pz9zgdg1BxrPuNCXTGQPBZBHVCTU2HjrxqQiCjnonb/9hS3fIH9zo63/9idSzGnYNFZrLbOwevD+VE35SMUpOBahmiqmM1sBz7uNgUuFIFOqbCvpQdMpV/fuJ3+aFdanhc5DXSaVO85TKWH8Gd1WuDKEcqQHBdnleudGmR5+6bsEoawMKPmJBcHWvXyVbdmgPg/RfWFRryDuBFx0ilHX42gTw2nszM2YktXFjvHNxVTSTbqdtfLi1CwwbYgq/qG8V9TGz/KZhRZt286z3c= ceph-aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-08T23:59:01.379 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-08T23:59:01.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:00.222207+0000 mon.smithi026 (mon.0) 93 : audit [INF] from='client.? 172.21.15.26:0/1995114353' entity='client.admin' 2024-05-08T23:59:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.197+0000 7fb665793700 1 -- 172.21.15.26:0/739362623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 msgr2=0x7fb6600f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.197+0000 7fb665793700 1 --2- 172.21.15.26:0/739362623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 0x7fb6600f5ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb648004770 tx=0x7fb648009cb0).stop 2024-05-08T23:59:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.197+0000 7fb665793700 1 -- 172.21.15.26:0/739362623 shutdown_connections 2024-05-08T23:59:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.197+0000 7fb665793700 1 --2- 172.21.15.26:0/739362623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 0x7fb6600f5ca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.197+0000 7fb665793700 1 -- 172.21.15.26:0/739362623 >> 172.21.15.26:0/739362623 conn(0x7fb6600f13a0 msgr2=0x7fb6600f37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:04.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.197+0000 7fb665793700 1 -- 172.21.15.26:0/739362623 shutdown_connections 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.197+0000 7fb665793700 1 -- 172.21.15.26:0/739362623 wait complete. 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.198+0000 7fb665793700 1 Processor -- start 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.198+0000 7fb665793700 1 -- start start 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.198+0000 7fb665793700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 0x7fb660107810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.198+0000 7fb665793700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb660107d00 con 0x7fb6600f5880 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.198+0000 7fb65effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 0x7fb660107810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.198+0000 7fb65effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 0x7fb660107810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47096/0 (socket says 172.21.15.26:47096) 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.198+0000 7fb65effd700 1 -- 172.21.15.26:0/462298608 learned_addr learned my addr 172.21.15.26:0/462298608 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.199+0000 7fb65effd700 1 -- 172.21.15.26:0/462298608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb648005040 con 0x7fb6600f5880 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.199+0000 7fb65effd700 1 --2- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 0x7fb660107810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb6480099b0 tx=0x7fb648009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.199+0000 7fb657fff700 1 -- 172.21.15.26:0/462298608 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb648018070 con 0x7fb6600f5880 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.199+0000 7fb657fff700 1 -- 172.21.15.26:0/462298608 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb648013730 con 0x7fb6600f5880 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.199+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb660107f00 con 0x7fb6600f5880 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.199+0000 7fb657fff700 1 -- 172.21.15.26:0/462298608 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb64801d460 con 0x7fb6600f5880 2024-05-08T23:59:04.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.199+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb660108390 con 0x7fb6600f5880 2024-05-08T23:59:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.200+0000 7fb657fff700 1 -- 172.21.15.26:0/462298608 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7fb6480125d0 con 0x7fb6600f5880 2024-05-08T23:59:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.200+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb660046ce0 con 0x7fb6600f5880 2024-05-08T23:59:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.200+0000 7fb657fff700 1 --2- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7fb64c0326d0 0x7fb64c034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.200+0000 7fb657fff700 1 -- 172.21.15.26:0/462298608 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fb648044000 con 0x7fb6600f5880 2024-05-08T23:59:04.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.200+0000 7fb65e7fc700 1 --2- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7fb64c0326d0 0x7fb64c034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:04.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.200+0000 7fb65e7fc700 1 --2- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7fb64c0326d0 0x7fb64c034b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb650009780 tx=0x7fb650006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:04.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.205+0000 7fb657fff700 1 -- 172.21.15.26:0/462298608 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb648025ca0 con 0x7fb6600f5880 2024-05-08T23:59:04.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.378+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fb6600fd0b0 con 0x7fb6600f5880 2024-05-08T23:59:04.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.381+0000 7fb657fff700 1 -- 172.21.15.26:0/462298608 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb64801a310 con 0x7fb6600f5880 2024-05-08T23:59:04.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7fb64c0326d0 msgr2=0x7fb64c034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:04.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 --2- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7fb64c0326d0 0x7fb64c034b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb650009780 tx=0x7fb650006cc0).stop 2024-05-08T23:59:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 msgr2=0x7fb660107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 --2- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 0x7fb660107810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb6480099b0 tx=0x7fb648009cb0).stop 2024-05-08T23:59:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 shutdown_connections 2024-05-08T23:59:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 --2- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7fb64c0326d0 0x7fb64c034b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 --2- 172.21.15.26:0/462298608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6600f5880 0x7fb660107810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 >> 172.21.15.26:0/462298608 conn(0x7fb6600f13a0 msgr2=0x7fb6600f1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 shutdown_connections 2024-05-08T23:59:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:04.383+0000 7fb665793700 1 -- 172.21.15.26:0/462298608 wait complete. 2024-05-08T23:59:05.161 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-08T23:59:05.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-08T23:59:05.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:04.382393+0000 mon.smithi026 (mon.0) 94 : audit [INF] from='client.? 172.21.15.26:0/462298608' entity='client.admin' 2024-05-08T23:59:07.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:06.077457+0000 mon.smithi026 (mon.0) 95 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:07.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:06.737171+0000 mon.smithi026 (mon.0) 96 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:07.270 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:06.740303+0000 mon.smithi026 (mon.0) 97 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:07.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.470+0000 7f8e93482700 1 -- 172.21.15.26:0/23127445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 msgr2=0x7f8e8c0fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:07.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.470+0000 7f8e93482700 1 --2- 172.21.15.26:0/23127445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 0x7f8e8c0fa190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8e7c004770 tx=0x7f8e7c009cb0).stop 2024-05-08T23:59:07.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.470+0000 7f8e93482700 1 -- 172.21.15.26:0/23127445 shutdown_connections 2024-05-08T23:59:07.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.470+0000 7f8e93482700 1 --2- 172.21.15.26:0/23127445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 0x7f8e8c0fa190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:07.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.470+0000 7f8e93482700 1 -- 172.21.15.26:0/23127445 >> 172.21.15.26:0/23127445 conn(0x7f8e8c0f1c10 msgr2=0x7f8e8c0f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:07.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.470+0000 7f8e93482700 1 -- 172.21.15.26:0/23127445 shutdown_connections 2024-05-08T23:59:07.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.470+0000 7f8e93482700 1 -- 172.21.15.26:0/23127445 wait complete. 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.471+0000 7f8e93482700 1 Processor -- start 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.471+0000 7f8e93482700 1 -- start start 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.471+0000 7f8e93482700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 0x7f8e8c109bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.471+0000 7f8e93482700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c10a0a0 con 0x7f8e8c0611f0 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.471+0000 7f8e9121e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 0x7f8e8c109bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.471+0000 7f8e9121e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 0x7f8e8c109bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47120/0 (socket says 172.21.15.26:47120) 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.471+0000 7f8e9121e700 1 -- 172.21.15.26:0/4288827605 learned_addr learned my addr 172.21.15.26:0/4288827605 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.472+0000 7f8e9121e700 1 -- 172.21.15.26:0/4288827605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c005040 con 0x7f8e8c0611f0 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.472+0000 7f8e9121e700 1 --2- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 0x7f8e8c109bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8e7c004740 tx=0x7f8e7c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.472+0000 7f8e827fc700 1 -- 172.21.15.26:0/4288827605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e7c018070 con 0x7f8e8c0611f0 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.472+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c10a2a0 con 0x7f8e8c0611f0 2024-05-08T23:59:07.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.472+0000 7f8e827fc700 1 -- 172.21.15.26:0/4288827605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8e7c013e30 con 0x7f8e8c0611f0 2024-05-08T23:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.472+0000 7f8e827fc700 1 -- 172.21.15.26:0/4288827605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e7c01d600 con 0x7f8e8c0611f0 2024-05-08T23:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.472+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c105770 con 0x7f8e8c0611f0 2024-05-08T23:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.473+0000 7f8e827fc700 1 -- 172.21.15.26:0/4288827605 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f8e7c01d830 con 0x7f8e8c0611f0 2024-05-08T23:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.473+0000 7f8e827fc700 1 --2- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f8e78032700 0x7f8e78034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.473+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c046ce0 con 0x7f8e8c0611f0 2024-05-08T23:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.473+0000 7f8e827fc700 1 -- 172.21.15.26:0/4288827605 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f8e7c0445b0 con 0x7f8e8c0611f0 2024-05-08T23:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.473+0000 7f8e90a1d700 1 --2- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f8e78032700 0x7f8e78034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:07.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.473+0000 7f8e90a1d700 1 --2- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f8e78032700 0x7f8e78034bc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f8e88009780 tx=0x7f8e88006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:07.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.477+0000 7f8e827fc700 1 -- 172.21.15.26:0/4288827605 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8e7c01bb60 con 0x7f8e8c0611f0 2024-05-08T23:59:07.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.672+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 --> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e8c105f90 con 0x7f8e78032700 2024-05-08T23:59:07.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.676+0000 7f8e827fc700 1 -- 172.21.15.26:0/4288827605 <== mgr.14156 v2:172.21.15.26:6800/2916145691 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8e8c105f90 con 0x7f8e78032700 2024-05-08T23:59:07.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.677+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f8e78032700 msgr2=0x7f8e78034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:07.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.677+0000 7f8e93482700 1 --2- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f8e78032700 0x7f8e78034bc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f8e88009780 tx=0x7f8e88006cc0).stop 2024-05-08T23:59:07.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.677+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 msgr2=0x7f8e8c109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:07.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.677+0000 7f8e93482700 1 --2- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 0x7f8e8c109bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8e7c004740 tx=0x7f8e7c009cb0).stop 2024-05-08T23:59:07.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.677+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 shutdown_connections 2024-05-08T23:59:07.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.677+0000 7f8e93482700 1 --2- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f8e78032700 0x7f8e78034bc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:07.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.677+0000 7f8e93482700 1 --2- 172.21.15.26:0/4288827605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e8c0611f0 0x7f8e8c109bb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:07.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.677+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 >> 172.21.15.26:0/4288827605 conn(0x7f8e8c0f1c10 msgr2=0x7f8e8c0f5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:07.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.678+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 shutdown_connections 2024-05-08T23:59:07.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:07.678+0000 7f8e93482700 1 -- 172.21.15.26:0/4288827605 wait complete. 2024-05-08T23:59:08.362 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2024-05-08T23:59:08.362 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:59:08.362 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2024-05-08T23:59:08.385 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T23:59:08.385 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:59:08.445 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2024-05-08T23:59:08.446 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch host add smithi135 2024-05-08T23:59:09.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:06.748554+0000 mgr.smithi026.brymfp (mgr.14156) 5 : cephadm [INF] Deploying daemon alertmanager.smithi026 on smithi026 2024-05-08T23:59:09.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:07.674701+0000 mgr.smithi026.brymfp (mgr.14156) 6 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:09.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:07.677111+0000 mon.smithi026 (mon.0) 98 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.471+0000 7f1ac40e3700 1 -- 172.21.15.26:0/1817656217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 msgr2=0x7f1abc0f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.471+0000 7f1ac40e3700 1 --2- 172.21.15.26:0/1817656217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 0x7f1abc0f68d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1ab8004770 tx=0x7f1ab8009cb0).stop 2024-05-08T23:59:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.471+0000 7f1ac40e3700 1 -- 172.21.15.26:0/1817656217 shutdown_connections 2024-05-08T23:59:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.471+0000 7f1ac40e3700 1 --2- 172.21.15.26:0/1817656217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 0x7f1abc0f68d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.471+0000 7f1ac40e3700 1 -- 172.21.15.26:0/1817656217 >> 172.21.15.26:0/1817656217 conn(0x7f1abc0f1c10 msgr2=0x7f1abc0f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.471+0000 7f1ac40e3700 1 -- 172.21.15.26:0/1817656217 shutdown_connections 2024-05-08T23:59:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.471+0000 7f1ac40e3700 1 -- 172.21.15.26:0/1817656217 wait complete. 2024-05-08T23:59:11.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.472+0000 7f1ac40e3700 1 Processor -- start 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.472+0000 7f1ac40e3700 1 -- start start 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.472+0000 7f1ac40e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 0x7f1abc107820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.472+0000 7f1ac40e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc107d10 con 0x7f1abc0f64b0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.472+0000 7f1ac1e7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 0x7f1abc107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.472+0000 7f1ac1e7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 0x7f1abc107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45874/0 (socket says 172.21.15.26:45874) 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.472+0000 7f1ac1e7f700 1 -- 172.21.15.26:0/2522072855 learned_addr learned my addr 172.21.15.26:0/2522072855 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.472+0000 7f1ac1e7f700 1 -- 172.21.15.26:0/2522072855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8005040 con 0x7f1abc0f64b0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.473+0000 7f1ac1e7f700 1 --2- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 0x7f1abc107820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1ab8009300 tx=0x7f1ab8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.473+0000 7f1ab2ffd700 1 -- 172.21.15.26:0/2522072855 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ab8018070 con 0x7f1abc0f64b0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.473+0000 7f1ab2ffd700 1 -- 172.21.15.26:0/2522072855 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1ab8009890 con 0x7f1abc0f64b0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.473+0000 7f1ab2ffd700 1 -- 172.21.15.26:0/2522072855 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ab801c400 con 0x7f1abc0f64b0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.473+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc107f10 con 0x7f1abc0f64b0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.473+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc1083a0 con 0x7f1abc0f64b0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.474+0000 7f1ab2ffd700 1 -- 172.21.15.26:0/2522072855 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f1ab801d420 con 0x7f1abc0f64b0 2024-05-08T23:59:11.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.474+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc046ce0 con 0x7f1abc0f64b0 2024-05-08T23:59:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.474+0000 7f1ab2ffd700 1 --2- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1aa8032700 0x7f1aa8034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.474+0000 7f1ab2ffd700 1 -- 172.21.15.26:0/2522072855 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f1ab80445b0 con 0x7f1abc0f64b0 2024-05-08T23:59:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.474+0000 7f1ac167e700 1 --2- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1aa8032700 0x7f1aa8034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.474+0000 7f1ac167e700 1 --2- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1aa8032700 0x7f1aa8034bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f1aac009780 tx=0x7f1aac006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:11.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.479+0000 7f1ab2ffd700 1 -- 172.21.15.26:0/2522072855 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1ab801b370 con 0x7f1abc0f64b0 2024-05-08T23:59:11.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:10.305987+0000 mgr.smithi026.brymfp (mgr.14156) 7 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:11.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:11.657+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 --> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}) v1 -- 0x7f1abc0f39f0 con 0x7f1aa8032700 2024-05-08T23:59:12.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.309+0000 7f1ab2ffd700 1 -- 172.21.15.26:0/2522072855 <== mgr.14156 v2:172.21.15.26:6800/2916145691 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1abc0f39f0 con 0x7f1aa8032700 2024-05-08T23:59:12.305 INFO:teuthology.orchestra.run.smithi026.stdout:Added host 'smithi135' with addr '172.21.15.135' 2024-05-08T23:59:12.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1aa8032700 msgr2=0x7f1aa8034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:12.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 --2- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1aa8032700 0x7f1aa8034bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f1aac009780 tx=0x7f1aac006cc0).stop 2024-05-08T23:59:12.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 msgr2=0x7f1abc107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:12.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 --2- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 0x7f1abc107820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1ab8009300 tx=0x7f1ab8009cb0).stop 2024-05-08T23:59:12.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 shutdown_connections 2024-05-08T23:59:12.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 --2- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1aa8032700 0x7f1aa8034bc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:12.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 --2- 172.21.15.26:0/2522072855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1abc0f64b0 0x7f1abc107820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:12.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 >> 172.21.15.26:0/2522072855 conn(0x7f1abc0f1c10 msgr2=0x7f1abc060d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:12.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.311+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 shutdown_connections 2024-05-08T23:59:12.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:12.312+0000 7f1ac40e3700 1 -- 172.21.15.26:0/2522072855 wait complete. 2024-05-08T23:59:12.638 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:11.659808+0000 mgr.smithi026.brymfp (mgr.14156) 8 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:12.638 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:12.310704+0000 mon.smithi026 (mon.0) 99 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:13.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:12.306423+0000 mgr.smithi026.brymfp (mgr.14156) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:13.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:12.311010+0000 mgr.smithi026.brymfp (mgr.14156) 10 : cephadm [INF] Added host smithi135 2024-05-08T23:59:14.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T23:59:15.618 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:14.306682+0000 mgr.smithi026.brymfp (mgr.14156) 11 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:17.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:16.306901+0000 mgr.smithi026.brymfp (mgr.14156) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:17.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:17.287536+0000 mon.smithi026 (mon.0) 100 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:17.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:17.289370+0000 mon.smithi026 (mon.0) 101 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-08T23:59:17.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:17.290956+0000 mon.smithi026 (mon.0) 102 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-08T23:59:17.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:17.291569+0000 mon.smithi026 (mon.0) 103 : audit [DBG] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:17.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.739+0000 7f300b050700 1 -- 172.21.15.26:0/2918357045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 msgr2=0x7f30040f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:17.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 --2- 172.21.15.26:0/2918357045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 0x7f30040f68d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2ffc009ae0 tx=0x7f2ffc004d10).stop 2024-05-08T23:59:17.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 -- 172.21.15.26:0/2918357045 shutdown_connections 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 --2- 172.21.15.26:0/2918357045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 0x7f30040f68d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 -- 172.21.15.26:0/2918357045 >> 172.21.15.26:0/2918357045 conn(0x7f30040f1c10 msgr2=0x7f30040f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 -- 172.21.15.26:0/2918357045 shutdown_connections 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 -- 172.21.15.26:0/2918357045 wait complete. 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 Processor -- start 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 -- start start 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 0x7f30040fe490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f300b050700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040fc910 con 0x7f30040f64b0 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.740+0000 7f3008dec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 0x7f30040fe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f3008dec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 0x7f30040fe490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45896/0 (socket says 172.21.15.26:45896) 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f3008dec700 1 -- 172.21.15.26:0/381575490 learned_addr learned my addr 172.21.15.26:0/381575490 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f3008dec700 1 -- 172.21.15.26:0/381575490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc0097c0 con 0x7f30040f64b0 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f3008dec700 1 --2- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 0x7f30040fe490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2ffc00b7e0 tx=0x7f2ffc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f3001ffb700 1 -- 172.21.15.26:0/381575490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ffc018070 con 0x7f30040f64b0 2024-05-08T23:59:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f3001ffb700 1 -- 172.21.15.26:0/381575490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2ffc007e50 con 0x7f30040f64b0 2024-05-08T23:59:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30040fcab0 con 0x7f30040f64b0 2024-05-08T23:59:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f3001ffb700 1 -- 172.21.15.26:0/381575490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ffc013420 con 0x7f30040f64b0 2024-05-08T23:59:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.741+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30040fcf40 con 0x7f30040f64b0 2024-05-08T23:59:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.742+0000 7f3001ffb700 1 -- 172.21.15.26:0/381575490 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f2ffc01d420 con 0x7f30040f64b0 2024-05-08T23:59:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.742+0000 7f3001ffb700 1 --2- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f2fec032750 0x7f2fec034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.742+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300405a310 con 0x7f30040f64b0 2024-05-08T23:59:17.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.742+0000 7f3001ffb700 1 -- 172.21.15.26:0/381575490 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f2ffc0447f0 con 0x7f30040f64b0 2024-05-08T23:59:17.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.743+0000 7f3003fff700 1 --2- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f2fec032750 0x7f2fec034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:17.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.743+0000 7f3003fff700 1 --2- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f2fec032750 0x7f2fec034c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f2ff8009780 tx=0x7f2ff8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.747+0000 7f3001ffb700 1 -- 172.21.15.26:0/381575490 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2ffc025b80 con 0x7f30040f64b0 2024-05-08T23:59:17.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.932+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 --> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30040fd790 con 0x7f2fec032750 2024-05-08T23:59:17.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.933+0000 7f3001ffb700 1 -- 172.21.15.26:0/381575490 <== mgr.14156 v2:172.21.15.26:6800/2916145691 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f30040fd790 con 0x7f2fec032750 2024-05-08T23:59:17.928 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-08T23:59:17.928 INFO:teuthology.orchestra.run.smithi026.stdout:[{"addr": "172.21.15.26", "hostname": "smithi026", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2024-05-08T23:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f2fec032750 msgr2=0x7f2fec034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 --2- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f2fec032750 0x7f2fec034c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f2ff8009780 tx=0x7f2ff8006cc0).stop 2024-05-08T23:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 msgr2=0x7f30040fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 --2- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 0x7f30040fe490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2ffc00b7e0 tx=0x7f2ffc004d10).stop 2024-05-08T23:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 shutdown_connections 2024-05-08T23:59:17.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 --2- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f2fec032750 0x7f2fec034c10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 --2- 172.21.15.26:0/381575490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30040f64b0 0x7f30040fe490 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 >> 172.21.15.26:0/381575490 conn(0x7f30040f1c10 msgr2=0x7f3004060d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 shutdown_connections 2024-05-08T23:59:17.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:17.935+0000 7f300b050700 1 -- 172.21.15.26:0/381575490 wait complete. 2024-05-08T23:59:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:17.292115+0000 mgr.smithi026.brymfp (mgr.14156) 13 : cephadm [INF] Deploying daemon crash.smithi026 on smithi026 2024-05-08T23:59:19.406 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-08T23:59:19.407 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-08T23:59:19.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:17.934224+0000 mgr.smithi026.brymfp (mgr.14156) 14 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:59:19.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:18.307173+0000 mgr.smithi026.brymfp (mgr.14156) 15 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:21.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:20.153625+0000 mon.smithi026 (mon.0) 104 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:21.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:20.231724+0000 mon.smithi026 (mon.0) 105 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:21.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:20.233525+0000 mon.smithi026 (mon.0) 106 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:21.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:20.234938+0000 mon.smithi026 (mon.0) 107 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-08T23:59:21.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:20.235280+0000 mgr.smithi026.brymfp (mgr.14156) 16 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-08T23:59:21.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:20.237594+0000 mon.smithi026 (mon.0) 108 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:21.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:20.243791+0000 mgr.smithi026.brymfp (mgr.14156) 17 : cephadm [INF] Deploying daemon grafana.smithi026 on smithi026 2024-05-08T23:59:21.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:20.307393+0000 mgr.smithi026.brymfp (mgr.14156) 18 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:21.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:20.444857+0000 mon.smithi026 (mon.0) 109 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:21.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.544+0000 7f88f9de1700 1 -- 172.21.15.26:0/2520242879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 msgr2=0x7f88f40fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:21.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.544+0000 7f88f9de1700 1 --2- 172.21.15.26:0/2520242879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 0x7f88f40fa190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f88e4004770 tx=0x7f88e4009cb0).stop 2024-05-08T23:59:21.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.544+0000 7f88f9de1700 1 -- 172.21.15.26:0/2520242879 shutdown_connections 2024-05-08T23:59:21.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.544+0000 7f88f9de1700 1 --2- 172.21.15.26:0/2520242879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 0x7f88f40fa190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:21.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.544+0000 7f88f9de1700 1 -- 172.21.15.26:0/2520242879 >> 172.21.15.26:0/2520242879 conn(0x7f88f40f1c10 msgr2=0x7f88f40f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:21.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.544+0000 7f88f9de1700 1 -- 172.21.15.26:0/2520242879 shutdown_connections 2024-05-08T23:59:21.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.544+0000 7f88f9de1700 1 -- 172.21.15.26:0/2520242879 wait complete. 2024-05-08T23:59:21.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.545+0000 7f88f9de1700 1 Processor -- start 2024-05-08T23:59:21.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.545+0000 7f88f9de1700 1 -- start start 2024-05-08T23:59:21.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f9de1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 0x7f88f41077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:21.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f9de1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f4107cc0 con 0x7f88f40611f0 2024-05-08T23:59:21.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 0x7f88f41077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:21.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 0x7f88f41077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55954/0 (socket says 172.21.15.26:55954) 2024-05-08T23:59:21.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f37fe700 1 -- 172.21.15.26:0/708062248 learned_addr learned my addr 172.21.15.26:0/708062248 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-08T23:59:21.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f37fe700 1 -- 172.21.15.26:0/708062248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4005040 con 0x7f88f40611f0 2024-05-08T23:59:21.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f37fe700 1 --2- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 0x7f88f41077d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f88e4004740 tx=0x7f88e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:21.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f0ff9700 1 -- 172.21.15.26:0/708062248 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e4018070 con 0x7f88f40611f0 2024-05-08T23:59:21.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f0ff9700 1 -- 172.21.15.26:0/708062248 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f88e4013e30 con 0x7f88f40611f0 2024-05-08T23:59:21.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f4107ec0 con 0x7f88f40611f0 2024-05-08T23:59:21.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f0ff9700 1 -- 172.21.15.26:0/708062248 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e401d600 con 0x7f88f40611f0 2024-05-08T23:59:21.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.546+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f4108350 con 0x7f88f40611f0 2024-05-08T23:59:21.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.547+0000 7f88f0ff9700 1 -- 172.21.15.26:0/708062248 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f88e401d830 con 0x7f88f40611f0 2024-05-08T23:59:21.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.547+0000 7f88f0ff9700 1 --2- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f88dc032700 0x7f88dc034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:21.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.547+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f4046ce0 con 0x7f88f40611f0 2024-05-08T23:59:21.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.547+0000 7f88f0ff9700 1 -- 172.21.15.26:0/708062248 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f88e4044860 con 0x7f88f40611f0 2024-05-08T23:59:21.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.547+0000 7f88f2ffd700 1 --2- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f88dc032700 0x7f88dc034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:21.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.548+0000 7f88f2ffd700 1 --2- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f88dc032700 0x7f88dc034bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f88e8009780 tx=0x7f88e8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:21.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.552+0000 7f88f0ff9700 1 -- 172.21.15.26:0/708062248 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f88e401b370 con 0x7f88f40611f0 2024-05-08T23:59:21.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:21.728+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f88f40fd180 con 0x7f88f40611f0 2024-05-08T23:59:22.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.239+0000 7f88f0ff9700 1 -- 172.21.15.26:0/708062248 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f88e401b370 con 0x7f88f40611f0 2024-05-08T23:59:22.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.240+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f88dc032700 msgr2=0x7f88dc034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.240+0000 7f88f9de1700 1 --2- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f88dc032700 0x7f88dc034bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f88e8009780 tx=0x7f88e8006cc0).stop 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.240+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 msgr2=0x7f88f41077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.240+0000 7f88f9de1700 1 --2- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 0x7f88f41077d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f88e4004740 tx=0x7f88e4009cb0).stop 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.240+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 shutdown_connections 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.240+0000 7f88f9de1700 1 --2- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f88dc032700 0x7f88dc034bc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.240+0000 7f88f9de1700 1 --2- 172.21.15.26:0/708062248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f40611f0 0x7f88f41077d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.241+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 >> 172.21.15.26:0/708062248 conn(0x7f88f40f1c10 msgr2=0x7f88f40f25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.241+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 shutdown_connections 2024-05-08T23:59:22.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-08T23:59:22.241+0000 7f88f9de1700 1 -- 172.21.15.26:0/708062248 wait complete. 2024-05-08T23:59:22.237 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2024-05-08T23:59:22.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:21.729799+0000 mon.smithi026 (mon.0) 110 : audit [INF] from='client.? 172.21.15.26:0/708062248' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T23:59:22.982 INFO:tasks.cephadm:Adding mon.smithi026 on smithi026 2024-05-08T23:59:22.983 INFO:tasks.cephadm:Adding mon.smithi135 on smithi135 2024-05-08T23:59:22.983 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch apply mon '2;smithi026:172.21.15.26=smithi026;smithi135:172.21.15.135=smithi135' 2024-05-08T23:59:23.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:22.240357+0000 mon.smithi026 (mon.0) 111 : audit [INF] from='client.? 172.21.15.26:0/708062248' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T23:59:23.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:22.240406+0000 mon.smithi026 (mon.0) 112 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:59:23.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:22.307644+0000 mgr.smithi026.brymfp (mgr.14156) 19 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:24.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 -- 172.21.15.135:0/1450092983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 msgr2=0x7ff1100f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 --2- 172.21.15.135:0/1450092983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 0x7ff1100f79e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff104004770 tx=0x7ff104009cb0).stop 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 -- 172.21.15.135:0/1450092983 shutdown_connections 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 --2- 172.21.15.135:0/1450092983 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 0x7ff1100f79e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 -- 172.21.15.135:0/1450092983 >> 172.21.15.135:0/1450092983 conn(0x7ff1100f2d40 msgr2=0x7ff1100f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 -- 172.21.15.135:0/1450092983 shutdown_connections 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 -- 172.21.15.135:0/1450092983 wait complete. 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 Processor -- start 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 -- start start 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 0x7ff110107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.815+0000 7ff116bf3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff110107d30 con 0x7ff1100f75c0 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff11498f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 0x7ff110107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff11498f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 0x7ff110107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:55118/0 (socket says 172.21.15.135:55118) 2024-05-08T23:59:24.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff11498f700 1 -- 172.21.15.135:0/2788275609 learned_addr learned my addr 172.21.15.135:0/2788275609 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff11498f700 1 -- 172.21.15.135:0/2788275609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104005040 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff11498f700 1 --2- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 0x7ff110107840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ff1040099b0 tx=0x7ff104009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff10dffb700 1 -- 172.21.15.135:0/2788275609 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff104018070 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff10dffb700 1 -- 172.21.15.135:0/2788275609 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff104013730 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff110107f30 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff10dffb700 1 -- 172.21.15.135:0/2788275609 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff10401d460 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.816+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1101083c0 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.817+0000 7ff10dffb700 1 -- 172.21.15.135:0/2788275609 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7ff10401d720 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.817+0000 7ff10dffb700 1 --2- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7ff100032730 0x7ff100034bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.817+0000 7ff10dffb700 1 -- 172.21.15.135:0/2788275609 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7ff104044050 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.817+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff110046ce0 con 0x7ff1100f75c0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.818+0000 7ff10ffff700 1 --2- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7ff100032730 0x7ff100034bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.818+0000 7ff10ffff700 1 --2- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7ff100032730 0x7ff100034bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff0fc009780 tx=0x7ff0fc006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:24.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.822+0000 7ff10dffb700 1 -- 172.21.15.135:0/2788275609 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff10401a960 con 0x7ff1100f75c0 2024-05-08T23:59:24.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.992+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 --> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi026:172.21.15.26=smithi026;smithi135:172.21.15.135=smithi135", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1100f3f50 con 0x7ff100032730 2024-05-08T23:59:24.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:24.999+0000 7ff10dffb700 1 -- 172.21.15.135:0/2788275609 <== mgr.14156 v2:172.21.15.26:6800/2916145691 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff1100f3f50 con 0x7ff100032730 2024-05-08T23:59:24.993 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mon update... 2024-05-08T23:59:24.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.000+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7ff100032730 msgr2=0x7ff100034bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.000+0000 7ff116bf3700 1 --2- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7ff100032730 0x7ff100034bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff0fc009780 tx=0x7ff0fc006cc0).stop 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.000+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 msgr2=0x7ff110107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.000+0000 7ff116bf3700 1 --2- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 0x7ff110107840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ff1040099b0 tx=0x7ff104009cb0).stop 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.000+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 shutdown_connections 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.000+0000 7ff116bf3700 1 --2- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7ff100032730 0x7ff100034bf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.000+0000 7ff116bf3700 1 --2- 172.21.15.135:0/2788275609 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1100f75c0 0x7ff110107840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.000+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 >> 172.21.15.135:0/2788275609 conn(0x7ff1100f2d40 msgr2=0x7ff1100f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.001+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 shutdown_connections 2024-05-08T23:59:24.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:25.001+0000 7ff116bf3700 1 -- 172.21.15.135:0/2788275609 wait complete. 2024-05-08T23:59:25.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:24.307871+0000 mgr.smithi026.brymfp (mgr.14156) 20 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:25.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:24.999844+0000 mon.smithi026 (mon.0) 113 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:25.667 DEBUG:teuthology.orchestra.run.smithi135:mon.smithi135> sudo journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi135.service 2024-05-08T23:59:25.669 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-08T23:59:25.669 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:59:25.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:-- Logs begin at Wed 2024-05-08 23:38:18 UTC. -- 2024-05-08T23:59:26.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:26 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:24.994714+0000 mgr.smithi026.brymfp (mgr.14156) 21 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi026:172.21.15.26=smithi026;smithi135:172.21.15.135=smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:26.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:26 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:24.997452+0000 mgr.smithi026.brymfp (mgr.14156) 22 : cephadm [INF] Saving service mon spec with placement smithi026:172.21.15.26=smithi026;smithi135:172.21.15.135=smithi135;count:2 2024-05-08T23:59:27.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:26.308071+0000 mgr.smithi026.brymfp (mgr.14156) 23 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.705+0000 7f83c5599700 1 -- 172.21.15.135:0/1624731662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 msgr2=0x7f83c00f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.705+0000 7f83c5599700 1 --2- 172.21.15.135:0/1624731662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 0x7f83c00f68e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f83a8004770 tx=0x7f83a8009cb0).stop 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.705+0000 7f83c5599700 1 -- 172.21.15.135:0/1624731662 shutdown_connections 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.705+0000 7f83c5599700 1 --2- 172.21.15.135:0/1624731662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 0x7f83c00f68e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.705+0000 7f83c5599700 1 -- 172.21.15.135:0/1624731662 >> 172.21.15.135:0/1624731662 conn(0x7f83c00f1ce0 msgr2=0x7f83c00f4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.705+0000 7f83c5599700 1 -- 172.21.15.135:0/1624731662 shutdown_connections 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.705+0000 7f83c5599700 1 -- 172.21.15.135:0/1624731662 wait complete. 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.706+0000 7f83c5599700 1 Processor -- start 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.706+0000 7f83c5599700 1 -- start start 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.706+0000 7f83c5599700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 0x7f83c010a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.706+0000 7f83c5599700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00612c0 con 0x7f83c00f64c0 2024-05-08T23:59:27.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83beffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 0x7f83c010a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83beffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 0x7f83c010a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:47880/0 (socket says 172.21.15.135:47880) 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83beffd700 1 -- 172.21.15.135:0/789215951 learned_addr learned my addr 172.21.15.135:0/789215951 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83beffd700 1 -- 172.21.15.135:0/789215951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8005040 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83beffd700 1 --2- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 0x7f83c010a4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f83a80099b0 tx=0x7f83a8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83b7fff700 1 -- 172.21.15.135:0/789215951 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83a8018070 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c00614c0 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83b7fff700 1 -- 172.21.15.135:0/789215951 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f83a8013730 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83b7fff700 1 -- 172.21.15.135:0/789215951 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83a801d440 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.707+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c010ac20 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.708+0000 7f83b7fff700 1 -- 172.21.15.135:0/789215951 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f83a801d6c0 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.708+0000 7f83b7fff700 1 --2- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f83ac032750 0x7f83ac034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.708+0000 7f83b7fff700 1 -- 172.21.15.135:0/789215951 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f83a8044750 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.708+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c0046ce0 con 0x7f83c00f64c0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.709+0000 7f83be7fc700 1 --2- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f83ac032750 0x7f83ac034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:27.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.709+0000 7f83be7fc700 1 --2- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f83ac032750 0x7f83ac034c10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f83b0009780 tx=0x7f83b0006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:27.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.716+0000 7f83b7fff700 1 -- 172.21.15.135:0/789215951 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f83a8027440 con 0x7f83c00f64c0 2024-05-08T23:59:27.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.939+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f83c00fbf30 con 0x7f83c00f64c0 2024-05-08T23:59:27.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.940+0000 7f83b7fff700 1 -- 172.21.15.135:0/789215951 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f83a801b370 con 0x7f83c00f64c0 2024-05-08T23:59:27.935 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:59:27.935 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:42.552068Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:59:27.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.941+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f83ac032750 msgr2=0x7f83ac034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:27.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.941+0000 7f83c5599700 1 --2- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f83ac032750 0x7f83ac034c10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f83b0009780 tx=0x7f83b0006cc0).stop 2024-05-08T23:59:27.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.941+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 msgr2=0x7f83c010a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:27.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.941+0000 7f83c5599700 1 --2- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 0x7f83c010a4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f83a80099b0 tx=0x7f83a8009cb0).stop 2024-05-08T23:59:27.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.941+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 shutdown_connections 2024-05-08T23:59:27.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.941+0000 7f83c5599700 1 --2- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f83ac032750 0x7f83ac034c10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:27.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.941+0000 7f83c5599700 1 --2- 172.21.15.135:0/789215951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83c00f64c0 0x7f83c010a4f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:27.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.941+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 >> 172.21.15.135:0/789215951 conn(0x7f83c00f1ce0 msgr2=0x7f83c00f2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:27.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.942+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 shutdown_connections 2024-05-08T23:59:27.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:27.942+0000 7f83c5599700 1 -- 172.21.15.135:0/789215951 wait complete. 2024-05-08T23:59:27.937 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-05-08T23:59:28.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:27.941212+0000 mon.smithi026 (mon.0) 114 : audit [DBG] from='client.? 172.21.15.135:0/789215951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:59:29.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:28.308320+0000 mgr.smithi026.brymfp (mgr.14156) 24 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:29.672 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-08T23:59:29.672 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:59:31.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:30.308542+0000 mgr.smithi026.brymfp (mgr.14156) 25 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:31.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.809+0000 7f464db7c700 1 -- 172.21.15.135:0/4143106927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 msgr2=0x7f46480fa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:31.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.809+0000 7f464db7c700 1 --2- 172.21.15.135:0/4143106927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 0x7f46480fa1f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4638004770 tx=0x7f4638009cb0).stop 2024-05-08T23:59:31.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.809+0000 7f464db7c700 1 -- 172.21.15.135:0/4143106927 shutdown_connections 2024-05-08T23:59:31.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.809+0000 7f464db7c700 1 --2- 172.21.15.135:0/4143106927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 0x7f46480fa1f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:31.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.810+0000 7f464db7c700 1 -- 172.21.15.135:0/4143106927 >> 172.21.15.135:0/4143106927 conn(0x7f46480f1c10 msgr2=0x7f46480f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:31.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.810+0000 7f464db7c700 1 -- 172.21.15.135:0/4143106927 shutdown_connections 2024-05-08T23:59:31.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.810+0000 7f464db7c700 1 -- 172.21.15.135:0/4143106927 wait complete. 2024-05-08T23:59:31.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.810+0000 7f464db7c700 1 Processor -- start 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.810+0000 7f464db7c700 1 -- start start 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f464db7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 0x7f46481077f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f464db7c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4648107ce0 con 0x7f4648061190 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f46477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 0x7f46481077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f46477fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 0x7f46481077f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:47908/0 (socket says 172.21.15.135:47908) 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f46477fe700 1 -- 172.21.15.135:0/2523447389 learned_addr learned my addr 172.21.15.135:0/2523447389 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f46477fe700 1 -- 172.21.15.135:0/2523447389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4638005040 con 0x7f4648061190 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f46477fe700 1 --2- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 0x7f46481077f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4638004740 tx=0x7f4638009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:31.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f4644ff9700 1 -- 172.21.15.135:0/2523447389 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4638018070 con 0x7f4648061190 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4648107ee0 con 0x7f4648061190 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f4644ff9700 1 -- 172.21.15.135:0/2523447389 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4638013e30 con 0x7f4648061190 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f4644ff9700 1 -- 172.21.15.135:0/2523447389 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f463801d600 con 0x7f4648061190 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.811+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4648108370 con 0x7f4648061190 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.812+0000 7f4644ff9700 1 -- 172.21.15.135:0/2523447389 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f463801d830 con 0x7f4648061190 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.812+0000 7f4644ff9700 1 --2- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f4630032700 0x7f4630034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.812+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4648046ce0 con 0x7f4648061190 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.812+0000 7f4644ff9700 1 -- 172.21.15.135:0/2523447389 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f4638044940 con 0x7f4648061190 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.813+0000 7f4646ffd700 1 --2- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f4630032700 0x7f4630034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:31.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.813+0000 7f4646ffd700 1 --2- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f4630032700 0x7f4630034bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f463c009780 tx=0x7f463c006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:31.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:31.818+0000 7f4644ff9700 1 -- 172.21.15.135:0/2523447389 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f463801b9c0 con 0x7f4648061190 2024-05-08T23:59:32.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.042+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f46481091f0 con 0x7f4648061190 2024-05-08T23:59:32.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.043+0000 7f4644ff9700 1 -- 172.21.15.135:0/2523447389 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f463801bbd0 con 0x7f4648061190 2024-05-08T23:59:32.038 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:59:32.038 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:42.552068Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:59:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f4630032700 msgr2=0x7f4630034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 --2- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f4630032700 0x7f4630034bc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f463c009780 tx=0x7f463c006cc0).stop 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 msgr2=0x7f46481077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 --2- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 0x7f46481077f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4638004740 tx=0x7f4638009cb0).stop 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 shutdown_connections 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 --2- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f4630032700 0x7f4630034bc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 --2- 172.21.15.135:0/2523447389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4648061190 0x7f46481077f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 >> 172.21.15.135:0/2523447389 conn(0x7f46480f1c10 msgr2=0x7f46480f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 shutdown_connections 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:32.045+0000 7f464db7c700 1 -- 172.21.15.135:0/2523447389 wait complete. 2024-05-08T23:59:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-05-08T23:59:32.632 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:32.044566+0000 mon.smithi026 (mon.0) 115 : audit [DBG] from='client.? 172.21.15.135:0/2523447389' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:59:33.533 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:32.308832+0000 mgr.smithi026.brymfp (mgr.14156) 26 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:33.793 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-08T23:59:33.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:59:35.730 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:34.309104+0000 mgr.smithi026.brymfp (mgr.14156) 27 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:35.730 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:34.454737+0000 mon.smithi026 (mon.0) 116 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:35.730 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:34.457021+0000 mgr.smithi026.brymfp (mgr.14156) 28 : cephadm [INF] Deploying daemon node-exporter.smithi026 on smithi026 2024-05-08T23:59:35.730 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:35.448804+0000 mon.smithi026 (mon.0) 117 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:35.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.767+0000 7f0f8689c700 1 -- 172.21.15.135:0/4235757626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f800f64b0 msgr2=0x7f0f800f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.767+0000 7f0f8689c700 1 --2- 172.21.15.135:0/4235757626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f800f64b0 0x7f0f800f68d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0f74004770 tx=0x7f0f74009cb0).stop 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.767+0000 7f0f8689c700 1 -- 172.21.15.135:0/4235757626 shutdown_connections 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.767+0000 7f0f8689c700 1 --2- 172.21.15.135:0/4235757626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f800f64b0 0x7f0f800f68d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.767+0000 7f0f8689c700 1 -- 172.21.15.135:0/4235757626 >> 172.21.15.135:0/4235757626 conn(0x7f0f800f1c10 msgr2=0x7f0f800f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.767+0000 7f0f8689c700 1 -- 172.21.15.135:0/4235757626 shutdown_connections 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.767+0000 7f0f8689c700 1 -- 172.21.15.135:0/4235757626 wait complete. 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.768+0000 7f0f8689c700 1 Processor -- start 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.768+0000 7f0f8689c700 1 -- start start 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.768+0000 7f0f8689c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f80107920 0x7f0f80107d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.768+0000 7f0f8689c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80108230 con 0x7f0f80107920 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.768+0000 7f0f7ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f80107920 0x7f0f80107d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.768+0000 7f0f7ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f80107920 0x7f0f80107d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:47932/0 (socket says 172.21.15.135:47932) 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.768+0000 7f0f7ffff700 1 -- 172.21.15.135:0/3530707709 learned_addr learned my addr 172.21.15.135:0/3530707709 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:59:35.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.769+0000 7f0f7ffff700 1 -- 172.21.15.135:0/3530707709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74005040 con 0x7f0f80107920 2024-05-08T23:59:35.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.769+0000 7f0f7ffff700 1 --2- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f80107920 0x7f0f80107d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0f74000c00 tx=0x7f0f7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:35.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.769+0000 7f0f7d7fa700 1 -- 172.21.15.135:0/3530707709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f74019070 con 0x7f0f80107920 2024-05-08T23:59:35.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.769+0000 7f0f7d7fa700 1 -- 172.21.15.135:0/3530707709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0f74014e20 con 0x7f0f80107920 2024-05-08T23:59:35.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.769+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f80108430 con 0x7f0f80107920 2024-05-08T23:59:35.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.769+0000 7f0f7d7fa700 1 -- 172.21.15.135:0/3530707709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f7401ee30 con 0x7f0f80107920 2024-05-08T23:59:35.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.769+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f80108f80 con 0x7f0f80107920 2024-05-08T23:59:35.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.770+0000 7f0f7d7fa700 1 -- 172.21.15.135:0/3530707709 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f0f7401e420 con 0x7f0f80107920 2024-05-08T23:59:35.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.770+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8005a310 con 0x7f0f80107920 2024-05-08T23:59:35.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.770+0000 7f0f7d7fa700 1 --2- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0f680326d0 0x7f0f68034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:35.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.770+0000 7f0f7d7fa700 1 -- 172.21.15.135:0/3530707709 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f0f740443d0 con 0x7f0f80107920 2024-05-08T23:59:35.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.770+0000 7f0f7f7fe700 1 --2- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0f680326d0 0x7f0f68034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:35.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.771+0000 7f0f7f7fe700 1 --2- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0f680326d0 0x7f0f68034b90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0f70009780 tx=0x7f0f70006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.775+0000 7f0f7d7fa700 1 -- 172.21.15.135:0/3530707709 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0f740287c0 con 0x7f0f80107920 2024-05-08T23:59:35.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.996+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0f80046ce0 con 0x7f0f80107920 2024-05-08T23:59:35.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.997+0000 7f0f7d7fa700 1 -- 172.21.15.135:0/3530707709 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f0f74026800 con 0x7f0f80107920 2024-05-08T23:59:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:59:35.992 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:42.552068Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0f680326d0 msgr2=0x7f0f68034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 --2- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0f680326d0 0x7f0f68034b90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f0f70009780 tx=0x7f0f70006cc0).stop 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f80107920 msgr2=0x7f0f80107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 --2- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f80107920 0x7f0f80107d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0f74000c00 tx=0x7f0f7400b040).stop 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 shutdown_connections 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 --2- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f0f680326d0 0x7f0f68034b90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 --2- 172.21.15.135:0/3530707709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f80107920 0x7f0f80107d40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 >> 172.21.15.135:0/3530707709 conn(0x7f0f800f1c10 msgr2=0x7f0f80060d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 shutdown_connections 2024-05-08T23:59:35.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:35.999+0000 7f0f8689c700 1 -- 172.21.15.135:0/3530707709 wait complete. 2024-05-08T23:59:35.995 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-05-08T23:59:36.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:35.998565+0000 mon.smithi026 (mon.0) 118 : audit [DBG] from='client.? 172.21.15.135:0/3530707709' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:59:37.718 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-08T23:59:37.718 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:59:37.755 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:36.309528+0000 mgr.smithi026.brymfp (mgr.14156) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:39.183 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:37.931287+0000 mon.smithi026 (mon.0) 119 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:39.183 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:37.933640+0000 mon.smithi026 (mon.0) 120 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-08T23:59:39.183 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:38.309942+0000 mgr.smithi026.brymfp (mgr.14156) 30 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:59:39.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/3580780798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 msgr2=0x7f3f9c0f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 --2- 172.21.15.135:0/3580780798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 0x7f3f9c0f79e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f3f90004770 tx=0x7f3f90009cb0).stop 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/3580780798 shutdown_connections 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 --2- 172.21.15.135:0/3580780798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 0x7f3f9c0f79e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/3580780798 >> 172.21.15.135:0/3580780798 conn(0x7f3f9c0f2d40 msgr2=0x7f3f9c0f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/3580780798 shutdown_connections 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/3580780798 wait complete. 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 Processor -- start 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.738+0000 7f3fa2a2d700 1 -- start start 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.739+0000 7f3fa2a2d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 0x7f3f9c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.739+0000 7f3fa2a2d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06b030 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.739+0000 7f3f9bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 0x7f3f9c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.739+0000 7f3f9bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 0x7f3f9c06cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:34416/0 (socket says 172.21.15.135:34416) 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.739+0000 7f3f9bfff700 1 -- 172.21.15.135:0/629944868 learned_addr learned my addr 172.21.15.135:0/629944868 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.739+0000 7f3f9bfff700 1 -- 172.21.15.135:0/629944868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90005040 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.739+0000 7f3f9bfff700 1 --2- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 0x7f3f9c06cbb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3f900099b0 tx=0x7f3f90009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.739+0000 7f3f997fa700 1 -- 172.21.15.135:0/629944868 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f90018070 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.740+0000 7f3f997fa700 1 -- 172.21.15.135:0/629944868 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3f90013730 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.740+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c06b1d0 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.740+0000 7f3f997fa700 1 -- 172.21.15.135:0/629944868 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9001d460 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.740+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c06b660 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.740+0000 7f3f997fa700 1 -- 172.21.15.135:0/629944868 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 14) v1 ==== 38702+0+0 (secure 0 0 0) 0x7f3f900125d0 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.740+0000 7f3f997fa700 1 --2- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3f84032730 0x7f3f84034bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.740+0000 7f3f997fa700 1 -- 172.21.15.135:0/629944868 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f3f900442b0 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.740+0000 7f3f9b7fe700 1 -- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3f84032730 msgr2=0x7f3f84034bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2916145691 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.741+0000 7f3f9b7fe700 1 --2- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3f84032730 0x7f3f84034bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:59:39.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.741+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c05a310 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.746+0000 7f3f997fa700 1 -- 172.21.15.135:0/629944868 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3f9001a4f0 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.942+0000 7f3f9b7fe700 1 -- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3f84032730 msgr2=0x7f3f84034bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2916145691 2024-05-08T23:59:39.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.942+0000 7f3f9b7fe700 1 --2- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3f84032730 0x7f3f84034bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:59:39.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.972+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3f9c0fd0b0 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.973+0000 7f3f997fa700 1 -- 172.21.15.135:0/629944868 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f3f9001a310 con 0x7f3f9c0f75c0 2024-05-08T23:59:39.968 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:59:39.968 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:42.552068Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:59:39.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3f84032730 msgr2=0x7f3f84034bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 --2- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3f84032730 0x7f3f84034bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 msgr2=0x7f3f9c06cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 --2- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 0x7f3f9c06cbb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3f900099b0 tx=0x7f3f90009cb0).stop 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 shutdown_connections 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 --2- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f3f84032730 0x7f3f84034bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 --2- 172.21.15.135:0/629944868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f9c0f75c0 0x7f3f9c06cbb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 >> 172.21.15.135:0/629944868 conn(0x7f3f9c0f2d40 msgr2=0x7f3f9c0f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 shutdown_connections 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:39.976+0000 7f3fa2a2d700 1 -- 172.21.15.135:0/629944868 wait complete. 2024-05-08T23:59:39.970 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-05-08T23:59:40.343 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:38.935831+0000 mon.smithi026 (mon.0) 121 : audit [INF] from='mgr.14156 172.21.15.26:0/2198357592' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-08T23:59:40.343 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:38.935892+0000 mon.smithi026 (mon.0) 122 : cluster [DBG] mgrmap e14: smithi026.brymfp(active, since 48s) 2024-05-08T23:59:41.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:39.974290+0000 mon.smithi026 (mon.0) 123 : audit [DBG] from='client.? 172.21.15.135:0/629944868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:59:41.527 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-08T23:59:41.528 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:59:43.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.542+0000 7f1d7daba700 1 -- 172.21.15.135:0/634991209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 msgr2=0x7f1d780f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:43.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.542+0000 7f1d7daba700 1 --2- 172.21.15.135:0/634991209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 0x7f1d780f68d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1d6c004770 tx=0x7f1d6c009cb0).stop 2024-05-08T23:59:43.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.542+0000 7f1d7daba700 1 -- 172.21.15.135:0/634991209 shutdown_connections 2024-05-08T23:59:43.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.542+0000 7f1d7daba700 1 --2- 172.21.15.135:0/634991209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 0x7f1d780f68d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:43.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.542+0000 7f1d7daba700 1 -- 172.21.15.135:0/634991209 >> 172.21.15.135:0/634991209 conn(0x7f1d780f1c10 msgr2=0x7f1d780f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:43.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.542+0000 7f1d7daba700 1 -- 172.21.15.135:0/634991209 shutdown_connections 2024-05-08T23:59:43.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.542+0000 7f1d7daba700 1 -- 172.21.15.135:0/634991209 wait complete. 2024-05-08T23:59:43.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.543+0000 7f1d7daba700 1 Processor -- start 2024-05-08T23:59:43.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.543+0000 7f1d7daba700 1 -- start start 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.543+0000 7f1d7daba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 0x7f1d78107800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.543+0000 7f1d7daba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78107cf0 con 0x7f1d780f64b0 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.543+0000 7f1d777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 0x7f1d78107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.543+0000 7f1d777fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 0x7f1d78107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:34434/0 (socket says 172.21.15.135:34434) 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.543+0000 7f1d777fe700 1 -- 172.21.15.135:0/1671217804 learned_addr learned my addr 172.21.15.135:0/1671217804 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.543+0000 7f1d777fe700 1 -- 172.21.15.135:0/1671217804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c005040 con 0x7f1d780f64b0 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.544+0000 7f1d777fe700 1 --2- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 0x7f1d78107800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1d6c004740 tx=0x7f1d6c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.544+0000 7f1d74f74700 1 -- 172.21.15.135:0/1671217804 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6c018070 con 0x7f1d780f64b0 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.544+0000 7f1d74f74700 1 -- 172.21.15.135:0/1671217804 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1d6c0097f0 con 0x7f1d780f64b0 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.544+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d78107ef0 con 0x7f1d780f64b0 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.544+0000 7f1d74f74700 1 -- 172.21.15.135:0/1671217804 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6c012400 con 0x7f1d780f64b0 2024-05-08T23:59:43.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.544+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d78108380 con 0x7f1d780f64b0 2024-05-08T23:59:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.545+0000 7f1d74f74700 1 -- 172.21.15.135:0/1671217804 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 14) v1 ==== 38702+0+0 (secure 0 0 0) 0x7f1d6c012670 con 0x7f1d780f64b0 2024-05-08T23:59:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.545+0000 7f1d74f74700 1 --2- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1d60032780 0x7f1d60034c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.545+0000 7f1d74f74700 1 -- 172.21.15.135:0/1671217804 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f1d6c044140 con 0x7f1d780f64b0 2024-05-08T23:59:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.545+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d78046ce0 con 0x7f1d780f64b0 2024-05-08T23:59:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.545+0000 7f1d76ffd700 1 -- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1d60032780 msgr2=0x7f1d60034c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2916145691 2024-05-08T23:59:43.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.545+0000 7f1d76ffd700 1 --2- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1d60032780 0x7f1d60034c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:59:43.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.550+0000 7f1d74f74700 1 -- 172.21.15.135:0/1671217804 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1d6c024d20 con 0x7f1d780f64b0 2024-05-08T23:59:43.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.746+0000 7f1d76ffd700 1 -- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1d60032780 msgr2=0x7f1d60034c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2916145691 2024-05-08T23:59:43.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.746+0000 7f1d76ffd700 1 --2- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1d60032780 0x7f1d60034c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:59:43.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.775+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1d780fbfa0 con 0x7f1d780f64b0 2024-05-08T23:59:43.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.776+0000 7f1d74f74700 1 -- 172.21.15.135:0/1671217804 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f1d6c0242f0 con 0x7f1d780f64b0 2024-05-08T23:59:43.770 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:59:43.770 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:42.552068Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:59:43.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1d60032780 msgr2=0x7f1d60034c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:59:43.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 --2- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1d60032780 0x7f1d60034c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 msgr2=0x7f1d78107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 --2- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 0x7f1d78107800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1d6c004740 tx=0x7f1d6c009cb0).stop 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 shutdown_connections 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 --2- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:6800/2916145691,v1:172.21.15.26:6801/2916145691] conn(0x7f1d60032780 0x7f1d60034c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 --2- 172.21.15.135:0/1671217804 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d780f64b0 0x7f1d78107800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 >> 172.21.15.135:0/1671217804 conn(0x7f1d780f1c10 msgr2=0x7f1d78060d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 shutdown_connections 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:43.778+0000 7f1d7daba700 1 -- 172.21.15.135:0/1671217804 wait complete. 2024-05-08T23:59:43.772 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-05-08T23:59:43.935 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:43.776307+0000 mon.smithi026 (mon.0) 124 : audit [DBG] from='client.? 172.21.15.135:0/1671217804' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:59:45.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:44.498389+0000 mon.smithi026 (mon.0) 125 : cluster [INF] Active manager daemon smithi026.brymfp restarted 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:44.498617+0000 mon.smithi026 (mon.0) 126 : cluster [INF] Activating manager daemon smithi026.brymfp 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:44.501242+0000 mon.smithi026 (mon.0) 127 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:44.501347+0000 mon.smithi026 (mon.0) 128 : cluster [DBG] mgrmap e15: smithi026.brymfp(active, starting, since 0.00281829s) 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.502214+0000 mon.smithi026 (mon.0) 129 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.502857+0000 mon.smithi026 (mon.0) 130 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.503534+0000 mon.smithi026 (mon.0) 131 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.503692+0000 mon.smithi026 (mon.0) 132 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.503836+0000 mon.smithi026 (mon.0) 133 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:44.505999+0000 mon.smithi026 (mon.0) 134 : cluster [INF] Manager daemon smithi026.brymfp is now available 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.605052+0000 mon.smithi026 (mon.0) 135 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.606541+0000 mon.smithi026 (mon.0) 136 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.637339+0000 mon.smithi026 (mon.0) 137 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:45.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.648661+0000 mon.smithi026 (mon.0) 138 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:59:45.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:44.653003+0000 mon.smithi026 (mon.0) 139 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-08T23:59:45.475 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-08T23:59:45.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:59:46.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:45.086763+0000 mon.smithi026 (mon.0) 140 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:46.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:45.365623+0000 mon.smithi026 (mon.0) 141 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:46.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:45.503202+0000 mon.smithi026 (mon.0) 142 : cluster [DBG] mgrmap e16: smithi026.brymfp(active, since 1.00467s) 2024-05-08T23:59:48.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-08T23:59:47.088227+0000 mon.smithi026 (mon.0) 143 : cluster [DBG] mgrmap e17: smithi026.brymfp(active, since 2s) 2024-05-08T23:59:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.025+0000 7fb6d1aed700 1 -- 172.21.15.135:0/825907672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 msgr2=0x7fb6cc0fc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.025+0000 7fb6d1aed700 1 --2- 172.21.15.135:0/825907672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 0x7fb6cc0fc610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb6c4004770 tx=0x7fb6c4009cb0).stop 2024-05-08T23:59:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.025+0000 7fb6d1aed700 1 -- 172.21.15.135:0/825907672 shutdown_connections 2024-05-08T23:59:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.025+0000 7fb6d1aed700 1 --2- 172.21.15.135:0/825907672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 0x7fb6cc0fc610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.025+0000 7fb6d1aed700 1 -- 172.21.15.135:0/825907672 >> 172.21.15.135:0/825907672 conn(0x7fb6cc0f1c10 msgr2=0x7fb6cc0f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.025+0000 7fb6d1aed700 1 -- 172.21.15.135:0/825907672 shutdown_connections 2024-05-08T23:59:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.025+0000 7fb6d1aed700 1 -- 172.21.15.135:0/825907672 wait complete. 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.026+0000 7fb6d1aed700 1 Processor -- start 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.026+0000 7fb6d1aed700 1 -- start start 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6d1aed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 0x7fb6cc1099f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6d1aed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc109ee0 con 0x7fb6cc061170 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 0x7fb6cc1099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 0x7fb6cc1099f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:33466/0 (socket says 172.21.15.135:33466) 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6cb7fe700 1 -- 172.21.15.135:0/1727568839 learned_addr learned my addr 172.21.15.135:0/1727568839 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6cb7fe700 1 -- 172.21.15.135:0/1727568839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4005040 con 0x7fb6cc061170 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6cb7fe700 1 --2- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 0x7fb6cc1099f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fb6c4004740 tx=0x7fb6c4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6c8ff9700 1 -- 172.21.15.135:0/1727568839 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6c4018070 con 0x7fb6cc061170 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc10a0e0 con 0x7fb6cc061170 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6c8ff9700 1 -- 172.21.15.135:0/1727568839 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb6c4013e30 con 0x7fb6cc061170 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.027+0000 7fb6c8ff9700 1 -- 172.21.15.135:0/1727568839 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6c401d600 con 0x7fb6cc061170 2024-05-08T23:59:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.028+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc10a570 con 0x7fb6cc061170 2024-05-08T23:59:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.028+0000 7fb6c8ff9700 1 -- 172.21.15.135:0/1727568839 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 38745+0+0 (secure 0 0 0) 0x7fb6c401d830 con 0x7fb6cc061170 2024-05-08T23:59:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.029+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc046ce0 con 0x7fb6cc061170 2024-05-08T23:59:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.029+0000 7fb6c8ff9700 1 --2- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb6b80327f0 0x7fb6b8034cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.029+0000 7fb6c8ff9700 1 -- 172.21.15.135:0/1727568839 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb6c4044820 con 0x7fb6cc061170 2024-05-08T23:59:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.029+0000 7fb6caffd700 1 --2- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb6b80327f0 0x7fb6b8034cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.029+0000 7fb6caffd700 1 --2- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb6b80327f0 0x7fb6b8034cb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fb6b4009780 tx=0x7fb6b4006cc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.034+0000 7fb6c8ff9700 1 -- 172.21.15.135:0/1727568839 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb6c4027960 con 0x7fb6cc061170 2024-05-08T23:59:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.270+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb6cc10b3c0 con 0x7fb6cc061170 2024-05-08T23:59:49.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.270+0000 7fb6c8ff9700 1 -- 172.21.15.135:0/1727568839 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7fb6c401b370 con 0x7fb6cc061170 2024-05-08T23:59:49.264 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:59:49.264 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:42.552068Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb6b80327f0 msgr2=0x7fb6b8034cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 --2- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb6b80327f0 0x7fb6b8034cb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fb6b4009780 tx=0x7fb6b4006cc0).stop 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 msgr2=0x7fb6cc1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 --2- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 0x7fb6cc1099f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fb6c4004740 tx=0x7fb6c4009cb0).stop 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 shutdown_connections 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 --2- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb6b80327f0 0x7fb6b8034cb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 --2- 172.21.15.135:0/1727568839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb6cc061170 0x7fb6cc1099f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 >> 172.21.15.135:0/1727568839 conn(0x7fb6cc0f1c10 msgr2=0x7fb6cc0f2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 shutdown_connections 2024-05-08T23:59:49.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:49.272+0000 7fb6d1aed700 1 -- 172.21.15.135:0/1727568839 wait complete. 2024-05-08T23:59:49.267 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-05-08T23:59:49.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:48.248246+0000 mon.smithi026 (mon.0) 144 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:49.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:48.541094+0000 mon.smithi026 (mon.0) 145 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:50.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:49.270738+0000 mon.smithi026 (mon.0) 146 : audit [DBG] from='client.? 172.21.15.135:0/1727568839' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:59:51.048 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-08T23:59:51.048 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:50.761732+0000 mon.smithi026 (mon.0) 147 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.267643+0000 mon.smithi026 (mon.0) 148 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.268444+0000 mon.smithi026 (mon.0) 149 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.269455+0000 mon.smithi026 (mon.0) 150 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.270285+0000 mon.smithi026 (mon.0) 151 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.323319+0000 mon.smithi026 (mon.0) 152 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.334557+0000 mon.smithi026 (mon.0) 153 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.337219+0000 mon.smithi026 (mon.0) 154 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.339142+0000 mon.smithi026 (mon.0) 155 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-08T23:59:52.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.341263+0000 mon.smithi026 (mon.0) 156 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-08T23:59:52.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:51.342096+0000 mon.smithi026 (mon.0) 157 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:53.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:51.271722+0000 mgr.smithi026.brymfp (mgr.14194) 1 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.conf 2024-05-08T23:59:53.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:51.272085+0000 mgr.smithi026.brymfp (mgr.14194) 2 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.conf 2024-05-08T23:59:53.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:51.294911+0000 mgr.smithi026.brymfp (mgr.14194) 3 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:59:53.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:51.298927+0000 mgr.smithi026.brymfp (mgr.14194) 4 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:59:53.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:51.342800+0000 mgr.smithi026.brymfp (mgr.14194) 5 : cephadm [INF] Deploying daemon crash.smithi135 on smithi135 2024-05-08T23:59:54.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.773+0000 7f18c2379700 1 -- 172.21.15.135:0/2765904841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 msgr2=0x7f18bc0f8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:54.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.773+0000 7f18c2379700 1 --2- 172.21.15.135:0/2765904841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 0x7f18bc0f8a70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f18a4004770 tx=0x7f18a4009cb0).stop 2024-05-08T23:59:54.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.773+0000 7f18c2379700 1 -- 172.21.15.135:0/2765904841 shutdown_connections 2024-05-08T23:59:54.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.773+0000 7f18c2379700 1 --2- 172.21.15.135:0/2765904841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 0x7f18bc0f8a70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:54.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.773+0000 7f18c2379700 1 -- 172.21.15.135:0/2765904841 >> 172.21.15.135:0/2765904841 conn(0x7f18bc06c440 msgr2=0x7f18bc06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:54.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.773+0000 7f18c2379700 1 -- 172.21.15.135:0/2765904841 shutdown_connections 2024-05-08T23:59:54.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.773+0000 7f18c2379700 1 -- 172.21.15.135:0/2765904841 wait complete. 2024-05-08T23:59:54.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.773+0000 7f18c2379700 1 Processor -- start 2024-05-08T23:59:54.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.774+0000 7f18c2379700 1 -- start start 2024-05-08T23:59:54.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.774+0000 7f18c2379700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 0x7f18bc10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.774+0000 7f18c2379700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc10de20 con 0x7f18bc0f8690 2024-05-08T23:59:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.774+0000 7f18bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 0x7f18bc10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.774+0000 7f18bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 0x7f18bc10d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:33486/0 (socket says 172.21.15.135:33486) 2024-05-08T23:59:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.774+0000 7f18bbfff700 1 -- 172.21.15.135:0/2599587630 learned_addr learned my addr 172.21.15.135:0/2599587630 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T23:59:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.774+0000 7f18bbfff700 1 -- 172.21.15.135:0/2599587630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4005040 con 0x7f18bc0f8690 2024-05-08T23:59:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.774+0000 7f18bbfff700 1 --2- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 0x7f18bc10d930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f18a4004740 tx=0x7f18a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.775+0000 7f18b97fa700 1 -- 172.21.15.135:0/2599587630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18a4018070 con 0x7f18bc0f8690 2024-05-08T23:59:54.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.775+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc10e020 con 0x7f18bc0f8690 2024-05-08T23:59:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.775+0000 7f18b97fa700 1 -- 172.21.15.135:0/2599587630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f18a4009860 con 0x7f18bc0f8690 2024-05-08T23:59:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.775+0000 7f18b97fa700 1 -- 172.21.15.135:0/2599587630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18a401c5b0 con 0x7f18bc0f8690 2024-05-08T23:59:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.775+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc10e430 con 0x7f18bc0f8690 2024-05-08T23:59:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.776+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc05f1f0 con 0x7f18bc0f8690 2024-05-08T23:59:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.776+0000 7f18b97fa700 1 -- 172.21.15.135:0/2599587630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 38745+0+0 (secure 0 0 0) 0x7f18a401d470 con 0x7f18bc0f8690 2024-05-08T23:59:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.776+0000 7f18b97fa700 1 --2- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f18a80327d0 0x7f18a8034c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-08T23:59:54.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.776+0000 7f18b97fa700 1 -- 172.21.15.135:0/2599587630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f18a4043fe0 con 0x7f18bc0f8690 2024-05-08T23:59:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.776+0000 7f18bb7fe700 1 --2- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f18a80327d0 0x7f18a8034c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T23:59:54.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.777+0000 7f18bb7fe700 1 --2- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f18a80327d0 0x7f18a8034c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f18ac009780 tx=0x7f18ac006cc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:54.781+0000 7f18b97fa700 1 -- 172.21.15.135:0/2599587630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f18a40242f0 con 0x7f18bc0f8690 2024-05-08T23:59:55.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.018+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f18bc108fb0 con 0x7f18bc0f8690 2024-05-08T23:59:55.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.019+0000 7f18b97fa700 1 -- 172.21.15.135:0/2599587630 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f18a40242f0 con 0x7f18bc0f8690 2024-05-08T23:59:55.014 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T23:59:55.014 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:42.552068Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:59:55.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.020+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f18a80327d0 msgr2=0x7f18a8034c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:55.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.020+0000 7f18c2379700 1 --2- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f18a80327d0 0x7f18a8034c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f18ac009780 tx=0x7f18ac006cc0).stop 2024-05-08T23:59:55.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.020+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 msgr2=0x7f18bc10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:55.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.020+0000 7f18c2379700 1 --2- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 0x7f18bc10d930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f18a4004740 tx=0x7f18a4009cb0).stop 2024-05-08T23:59:55.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.021+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 shutdown_connections 2024-05-08T23:59:55.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.021+0000 7f18c2379700 1 --2- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f18a80327d0 0x7f18a8034c90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:55.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.021+0000 7f18c2379700 1 --2- 172.21.15.135:0/2599587630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18bc0f8690 0x7f18bc10d930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-08T23:59:55.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.021+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 >> 172.21.15.135:0/2599587630 conn(0x7f18bc06c440 msgr2=0x7f18bc0f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:55.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.021+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 shutdown_connections 2024-05-08T23:59:55.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:55.021+0000 7f18c2379700 1 -- 172.21.15.135:0/2599587630 wait complete. 2024-05-08T23:59:55.016 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-05-08T23:59:55.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:55.020159+0000 mon.smithi026 (mon.0) 158 : audit [DBG] from='client.? 172.21.15.135:0/2599587630' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:59:57.007 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-08T23:59:57.007 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:59:57.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:55.702865+0000 mon.smithi026 (mon.0) 159 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:57.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:55.705145+0000 mon.smithi026 (mon.0) 160 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:59:57.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:55.707338+0000 mon.smithi026 (mon.0) 161 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:59:57.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:55.708135+0000 mon.smithi026 (mon.0) 162 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:59:57.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:55.708997+0000 mon.smithi026 (mon.0) 163 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:57.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:55.709693+0000 mgr.smithi026.brymfp (mgr.14194) 6 : cephadm [INF] Deploying daemon mgr.smithi135.kkrhgf on smithi135 2024-05-08T23:59:59.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:58.572173+0000 mon.smithi026 (mon.0) 164 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-08T23:59:59.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:58.584786+0000 mon.smithi026 (mon.0) 165 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:59:59.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:58.585635+0000 mon.smithi026 (mon.0) 166 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:59.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 08 23:59:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-08T23:59:58.586311+0000 mgr.smithi026.brymfp (mgr.14194) 7 : cephadm [INF] Deploying daemon mon.smithi135 on smithi135 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.834+0000 7fef5e027700 1 -- 172.21.15.135:0/2092831636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 msgr2=0x7fef580f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.834+0000 7fef5e027700 1 --2- 172.21.15.135:0/2092831636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 0x7fef580f6860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fef48004770 tx=0x7fef48009cb0).stop 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.834+0000 7fef5e027700 1 -- 172.21.15.135:0/2092831636 shutdown_connections 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.834+0000 7fef5e027700 1 --2- 172.21.15.135:0/2092831636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 0x7fef580f6860 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.834+0000 7fef5e027700 1 -- 172.21.15.135:0/2092831636 >> 172.21.15.135:0/2092831636 conn(0x7fef5806c440 msgr2=0x7fef5806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.834+0000 7fef5e027700 1 -- 172.21.15.135:0/2092831636 shutdown_connections 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.834+0000 7fef5e027700 1 -- 172.21.15.135:0/2092831636 wait complete. 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.835+0000 7fef5e027700 1 Processor -- start 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.835+0000 7fef5e027700 1 -- start start 2024-05-09T00:00:00.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.835+0000 7fef5e027700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 0x7fef5810fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.835+0000 7fef5e027700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5810ff80 con 0x7fef580f6480 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.835+0000 7fef577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 0x7fef5810fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.835+0000 7fef577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 0x7fef5810fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.135:34432/0 (socket says 172.21.15.135:34432) 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.835+0000 7fef577fe700 1 -- 172.21.15.135:0/3183019172 learned_addr learned my addr 172.21.15.135:0/3183019172 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.836+0000 7fef577fe700 1 -- 172.21.15.135:0/3183019172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48005040 con 0x7fef580f6480 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.836+0000 7fef577fe700 1 --2- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 0x7fef5810fa90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fef48004740 tx=0x7fef48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.836+0000 7fef54ff9700 1 -- 172.21.15.135:0/3183019172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef48018070 con 0x7fef580f6480 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.836+0000 7fef54ff9700 1 -- 172.21.15.135:0/3183019172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fef48009860 con 0x7fef580f6480 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.836+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef58110180 con 0x7fef580f6480 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.836+0000 7fef54ff9700 1 -- 172.21.15.135:0/3183019172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef4801c5b0 con 0x7fef580f6480 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.836+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58110610 con 0x7fef580f6480 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.837+0000 7fef54ff9700 1 -- 172.21.15.135:0/3183019172 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 38745+0+0 (secure 0 0 0) 0x7fef4801d470 con 0x7fef580f6480 2024-05-09T00:00:00.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.837+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5805f1f0 con 0x7fef580f6480 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.837+0000 7fef54ff9700 1 --2- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fef40032820 0x7fef40034ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.837+0000 7fef54ff9700 1 -- 172.21.15.135:0/3183019172 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fef48043fd0 con 0x7fef580f6480 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.837+0000 7fef56ffd700 1 --2- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fef40032820 0x7fef40034ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.838+0000 7fef56ffd700 1 --2- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fef40032820 0x7fef40034ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fef4c009780 tx=0x7fef4c006cc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T23:59:59.842+0000 7fef54ff9700 1 -- 172.21.15.135:0/3183019172 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fef48072f60 con 0x7fef580f6480 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.076+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fef58046ce0 con 0x7fef580f6480 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.077+0000 7fef54ff9700 1 -- 172.21.15.135:0/3183019172 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7fef48025b40 con 0x7fef580f6480 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fef40032820 msgr2=0x7fef40034ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 --2- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fef40032820 0x7fef40034ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fef4c009780 tx=0x7fef4c006cc0).stop 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 msgr2=0x7fef5810fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 --2- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 0x7fef5810fa90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fef48004740 tx=0x7fef48009cb0).stop 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 shutdown_connections 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 --2- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fef40032820 0x7fef40034ce0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 --2- 172.21.15.135:0/3183019172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef580f6480 0x7fef5810fa90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 >> 172.21.15.135:0/3183019172 conn(0x7fef5806c440 msgr2=0x7fef580f4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:00.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 shutdown_connections 2024-05-09T00:00:00.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:00.079+0000 7fef5e027700 1 -- 172.21.15.135:0/3183019172 wait complete. 2024-05-09T00:00:00.356 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-05-09T00:00:00.356 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T00:00:00.356 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:42.552068Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T00:00:00.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-08T23:59:59.639881+0000 mon.smithi026 (mon.0) 167 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:00.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:00.078212+0000 mon.smithi026 (mon.0) 168 : audit [DBG] from='client.? 172.21.15.135:0/3183019172' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:00:02.045 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T00:00:02.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T00:00:04.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:03.674398+0000 mon.smithi026 (mon.0) 169 : cluster [DBG] Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:00:04.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:03.676121+0000 mon.smithi026 (mon.0) 170 : audit [DBG] from='mgr.? 172.21.15.135:0/2252537529' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:00:04.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:03.676624+0000 mon.smithi026 (mon.0) 171 : audit [DBG] from='mgr.? 172.21.15.135:0/2252537529' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:00:04.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:03.678496+0000 mon.smithi026 (mon.0) 172 : audit [DBG] from='mgr.? 172.21.15.135:0/2252537529' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/key"}]: dispatch 2024-05-09T00:00:04.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:03.679471+0000 mon.smithi026 (mon.0) 173 : audit [DBG] from='mgr.? 172.21.15.135:0/2252537529' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:00:04.269 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:04 smithi135 bash[42991]: 494b9e6f1eee28a0d8aa92db849b47dc31278b4afbef99bfb29a665e36e43f12 2024-05-09T00:00:04.269 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:04 smithi135 systemd[1]: Started Ceph mon.smithi135 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:00:09.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.371+0000 7ff02d99e700 1 -- 172.21.15.135:0/2699735103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 msgr2=0x7ff010005890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:09.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.371+0000 7ff02d99e700 1 --2- 172.21.15.135:0/2699735103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 0x7ff010005890 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff0280f6590 tx=0x7ff01800b040).stop 2024-05-09T00:00:09.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.371+0000 7ff02d99e700 1 -- 172.21.15.135:0/2699735103 shutdown_connections 2024-05-09T00:00:09.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.371+0000 7ff02d99e700 1 --2- 172.21.15.135:0/2699735103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 0x7ff010005890 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:09.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.371+0000 7ff02d99e700 1 -- 172.21.15.135:0/2699735103 >> 172.21.15.135:0/2699735103 conn(0x7ff02806c440 msgr2=0x7ff02806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:09.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.371+0000 7ff02d99e700 1 -- 172.21.15.135:0/2699735103 shutdown_connections 2024-05-09T00:00:09.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.371+0000 7ff02d99e700 1 -- 172.21.15.135:0/2699735103 wait complete. 2024-05-09T00:00:09.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff02d99e700 1 Processor -- start 2024-05-09T00:00:09.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff02d99e700 1 -- start start 2024-05-09T00:00:09.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff02d99e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 0x7ff02810d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:09.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff02d99e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 0x7ff028107830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:09.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff02d99e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02810e360 con 0x7ff010003400 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff02d99e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02810e4a0 con 0x7ff02810dd90 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff0267fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 0x7ff028107830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff0267fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 0x7ff028107830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34338/0 (socket says 172.21.15.135:34338) 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff0267fc700 1 -- 172.21.15.135:0/2312282083 learned_addr learned my addr 172.21.15.135:0/2312282083 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff0267fc700 1 -- 172.21.15.135:0/2312282083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 msgr2=0x7ff028107830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff0267fc700 1 -- 172.21.15.135:0/2312282083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 msgr2=0x7ff028107830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.373+0000 7ff0267fc700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 0x7ff028107830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff0267fc700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 0x7ff028107830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff026ffd700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 0x7ff02810d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff026ffd700 1 -- 172.21.15.135:0/2312282083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 msgr2=0x7ff028107830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff026ffd700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 0x7ff028107830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff026ffd700 1 -- 172.21.15.135:0/2312282083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff018005040 con 0x7ff010003400 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff026ffd700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 0x7ff02810d8a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff01801b000 tx=0x7ff018002040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:09.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff00ffff700 1 -- 172.21.15.135:0/2312282083 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff018017e50 con 0x7ff010003400 2024-05-09T00:00:09.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff00ffff700 1 -- 172.21.15.135:0/2312282083 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff018004cd0 con 0x7ff010003400 2024-05-09T00:00:09.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff00ffff700 1 -- 172.21.15.135:0/2312282083 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff018021cf0 con 0x7ff010003400 2024-05-09T00:00:09.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff028107de0 con 0x7ff010003400 2024-05-09T00:00:09.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.374+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff028108350 con 0x7ff010003400 2024-05-09T00:00:09.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.375+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02805f1f0 con 0x7ff010003400 2024-05-09T00:00:09.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.376+0000 7ff00ffff700 1 -- 172.21.15.135:0/2312282083 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ff018004840 con 0x7ff010003400 2024-05-09T00:00:09.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.376+0000 7ff00ffff700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff0140612e0 0x7ff0140637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:09.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.376+0000 7ff00ffff700 1 -- 172.21.15.135:0/2312282083 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7ff01807dc10 con 0x7ff010003400 2024-05-09T00:00:09.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.376+0000 7ff0267fc700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff0140612e0 0x7ff0140637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:09.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.377+0000 7ff0267fc700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff0140612e0 0x7ff0140637a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff01c006fd0 tx=0x7ff01c008040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:09.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.381+0000 7ff00ffff700 1 -- 172.21.15.135:0/2312282083 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff018052b60 con 0x7ff010003400 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:04.020916+0000 mon.smithi026 (mon.0) 176 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:04.023524+0000 mon.smithi026 (mon.0) 177 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:04.023665+0000 mon.smithi026 (mon.0) 178 : cluster [INF] mon.smithi026 calling monitor election 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:04.036372+0000 mon.smithi026 (mon.0) 179 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:04.505169+0000 mgr.smithi026.brymfp (mgr.14194) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:05.020514+0000 mon.smithi026 (mon.0) 180 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:06.020579+0000 mon.smithi026 (mon.0) 181 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:06.021488+0000 mon.smithi135 (mon.1) 1 : cluster [INF] mon.smithi135 calling monitor election 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:06.505554+0000 mgr.smithi026.brymfp (mgr.14194) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:07.020842+0000 mon.smithi026 (mon.0) 182 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:08.020797+0000 mon.smithi026 (mon.0) 183 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:08.505976+0000 mgr.smithi026.brymfp (mgr.14194) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:09.020825+0000 mon.smithi026 (mon.0) 184 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:09.050498+0000 mon.smithi026 (mon.0) 185 : cluster [INF] mon.smithi026 is new leader, mons smithi026,smithi135 in quorum (ranks 0,1) 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:09.053782+0000 mon.smithi026 (mon.0) 186 : cluster [DBG] monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:09.065899+0000 mon.smithi026 (mon.0) 187 : cluster [DBG] fsmap 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:09.065957+0000 mon.smithi026 (mon.0) 188 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:09.066362+0000 mon.smithi026 (mon.0) 189 : cluster [DBG] mgrmap e18: smithi026.brymfp(active, since 24s), standbys: smithi135.kkrhgf 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:09.066519+0000 mon.smithi026 (mon.0) 190 : cluster [INF] overall HEALTH_OK 2024-05-09T00:00:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:09.070110+0000 mon.smithi026 (mon.0) 191 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:09.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:04.020916+0000 mon.smithi026 (mon.0) 176 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:04.023524+0000 mon.smithi026 (mon.0) 177 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:00:09.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:04.023665+0000 mon.smithi026 (mon.0) 178 : cluster [INF] mon.smithi026 calling monitor election 2024-05-09T00:00:09.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:04.036372+0000 mon.smithi026 (mon.0) 179 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:04.505169+0000 mgr.smithi026.brymfp (mgr.14194) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:09.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:05.020514+0000 mon.smithi026 (mon.0) 180 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:06.020579+0000 mon.smithi026 (mon.0) 181 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:06.021488+0000 mon.smithi135 (mon.1) 1 : cluster [INF] mon.smithi135 calling monitor election 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:06.505554+0000 mgr.smithi026.brymfp (mgr.14194) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:07.020842+0000 mon.smithi026 (mon.0) 182 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:08.020797+0000 mon.smithi026 (mon.0) 183 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:08.505976+0000 mgr.smithi026.brymfp (mgr.14194) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:09.020825+0000 mon.smithi026 (mon.0) 184 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:09.050498+0000 mon.smithi026 (mon.0) 185 : cluster [INF] mon.smithi026 is new leader, mons smithi026,smithi135 in quorum (ranks 0,1) 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:09.053782+0000 mon.smithi026 (mon.0) 186 : cluster [DBG] monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:09.065899+0000 mon.smithi026 (mon.0) 187 : cluster [DBG] fsmap 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:09.065957+0000 mon.smithi026 (mon.0) 188 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:09.066362+0000 mon.smithi026 (mon.0) 189 : cluster [DBG] mgrmap e18: smithi026.brymfp(active, since 24s), standbys: smithi135.kkrhgf 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:09.066519+0000 mon.smithi026 (mon.0) 190 : cluster [INF] overall HEALTH_OK 2024-05-09T00:00:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:09.070110+0000 mon.smithi026 (mon.0) 191 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:09.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.646+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff028046ce0 con 0x7ff010003400 2024-05-09T00:00:09.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.647+0000 7ff00ffff700 1 -- 172.21.15.135:0/2312282083 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1009 (secure 0 0 0) 0x7ff018025090 con 0x7ff010003400 2024-05-09T00:00:09.642 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T00:00:09.643 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","modified":"2024-05-09T00:00:04.020567Z","created":"2024-05-08T23:57:42.552068Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi026","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi135","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff0140612e0 msgr2=0x7ff0140637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff0140612e0 0x7ff0140637a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff01c006fd0 tx=0x7ff01c008040).stop 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 msgr2=0x7ff02810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 0x7ff02810d8a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff01801b000 tx=0x7ff018002040).stop 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 shutdown_connections 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff0140612e0 0x7ff0140637a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff010003400 0x7ff02810d8a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 --2- 172.21.15.135:0/2312282083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff02810dd90 0x7ff028107830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 >> 172.21.15.135:0/2312282083 conn(0x7ff02806c440 msgr2=0x7ff0280fb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:09.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 shutdown_connections 2024-05-09T00:00:09.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:00:09.649+0000 7ff02d99e700 1 -- 172.21.15.135:0/2312282083 wait complete. 2024-05-09T00:00:09.645 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2024-05-09T00:00:10.396 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-09T00:00:10.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-09T00:00:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:09.071948+0000 mgr.smithi026.brymfp (mgr.14194) 11 : cephadm [INF] Deploying daemon node-exporter.smithi135 on smithi135 2024-05-09T00:00:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:09.645888+0000 mon.smithi026 (mon.0) 192 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:09.648728+0000 mon.smithi026 (mon.0) 193 : audit [DBG] from='client.? 172.21.15.135:0/2312282083' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:00:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:10.021024+0000 mon.smithi026 (mon.0) 194 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:10.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:09.071948+0000 mgr.smithi026.brymfp (mgr.14194) 11 : cephadm [INF] Deploying daemon node-exporter.smithi135 on smithi135 2024-05-09T00:00:10.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:09.645888+0000 mon.smithi026 (mon.0) 192 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:10.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:09.648728+0000 mon.smithi026 (mon.0) 193 : audit [DBG] from='client.? 172.21.15.135:0/2312282083' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:00:10.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:10.021024+0000 mon.smithi026 (mon.0) 194 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:00:11.845 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:10.506244+0000 mgr.smithi026.brymfp (mgr.14194) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:11.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:10.506244+0000 mgr.smithi026.brymfp (mgr.14194) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.424+0000 7ffbd8160700 1 -- 172.21.15.26:0/3636423178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd00fc550 msgr2=0x7ffbd00fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.424+0000 7ffbd8160700 1 --2- 172.21.15.26:0/3636423178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd00fc550 0x7ffbd00fc930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ffbc0004770 tx=0x7ffbc0009cb0).stop 2024-05-09T00:00:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.424+0000 7ffbd8160700 1 -- 172.21.15.26:0/3636423178 shutdown_connections 2024-05-09T00:00:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.424+0000 7ffbd8160700 1 --2- 172.21.15.26:0/3636423178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd00fc550 0x7ffbd00fc930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.424+0000 7ffbd8160700 1 -- 172.21.15.26:0/3636423178 >> 172.21.15.26:0/3636423178 conn(0x7ffbd00f2100 msgr2=0x7ffbd00f4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.424+0000 7ffbd8160700 1 -- 172.21.15.26:0/3636423178 shutdown_connections 2024-05-09T00:00:12.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.424+0000 7ffbd8160700 1 -- 172.21.15.26:0/3636423178 wait complete. 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd8160700 1 Processor -- start 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd8160700 1 -- start start 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd8160700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 0x7ffbd010c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd8160700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd010cda0 0x7ffbd0106840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd8160700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd010d370 con 0x7ffbd010cda0 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd8160700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd010d4b0 con 0x7ffbd00fc550 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd56fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd010cda0 0x7ffbd0106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd56fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd010cda0 0x7ffbd0106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48754/0 (socket says 172.21.15.26:48754) 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd56fb700 1 -- 172.21.15.26:0/2158938525 learned_addr learned my addr 172.21.15.26:0/2158938525 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.425+0000 7ffbd5efc700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 0x7ffbd010c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd5efc700 1 -- 172.21.15.26:0/2158938525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 msgr2=0x7ffbd010c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd5efc700 1 -- 172.21.15.26:0/2158938525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 msgr2=0x7ffbd010c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd5efc700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 0x7ffbd010c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T00:00:12.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd56fb700 1 -- 172.21.15.26:0/2158938525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 msgr2=0x7ffbd010c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd5efc700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 0x7ffbd010c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd56fb700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 0x7ffbd010c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd56fb700 1 -- 172.21.15.26:0/2158938525 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0005040 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd56fb700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd010cda0 0x7ffbd0106840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ffbcc00b550 tx=0x7ffbcc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbc6ffd700 1 -- 172.21.15.26:0/2158938525 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbcc00f6f0 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbc6ffd700 1 -- 172.21.15.26:0/2158938525 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ffbcc00fce0 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbc6ffd700 1 -- 172.21.15.26:0/2158938525 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbcc011ce0 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd0106df0 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.426+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd01073b0 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.427+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd005f060 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.428+0000 7ffbc6ffd700 1 -- 172.21.15.26:0/2158938525 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ffbcc00f850 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.428+0000 7ffbc6ffd700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ffbbc0612e0 0x7ffbbc0637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.428+0000 7ffbc6ffd700 1 -- 172.21.15.26:0/2158938525 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7ffbcc07bee0 con 0x7ffbd010cda0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.428+0000 7ffbd5efc700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ffbbc0612e0 0x7ffbbc0637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:12.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.428+0000 7ffbd5efc700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ffbbc0612e0 0x7ffbbc0637a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ffbc0004e90 tx=0x7ffbc000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:12.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.432+0000 7ffbc6ffd700 1 -- 172.21.15.26:0/2158938525 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ffbcc050eb0 con 0x7ffbd010cda0 2024-05-09T00:00:12.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.606+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ffbd005a310 con 0x7ffbd010cda0 2024-05-09T00:00:12.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.606+0000 7ffbc6ffd700 1 -- 172.21.15.26:0/2158938525 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7ffbcc050aa0 con 0x7ffbd010cda0 2024-05-09T00:00:12.601 INFO:teuthology.orchestra.run.smithi026.stdout:# minimal ceph.conf for aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-09T00:00:12.601 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2024-05-09T00:00:12.601 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-09T00:00:12.601 INFO:teuthology.orchestra.run.smithi026.stdout: mon_host = [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-05-09T00:00:12.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ffbbc0612e0 msgr2=0x7ffbbc0637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:12.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ffbbc0612e0 0x7ffbbc0637a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ffbc0004e90 tx=0x7ffbc000b040).stop 2024-05-09T00:00:12.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd010cda0 msgr2=0x7ffbd0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:12.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd010cda0 0x7ffbd0106840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ffbcc00b550 tx=0x7ffbcc0090f0).stop 2024-05-09T00:00:12.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 shutdown_connections 2024-05-09T00:00:12.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ffbbc0612e0 0x7ffbbc0637a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:12.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd00fc550 0x7ffbd010c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:12.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 --2- 172.21.15.26:0/2158938525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbd010cda0 0x7ffbd0106840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:12.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 >> 172.21.15.26:0/2158938525 conn(0x7ffbd00f2100 msgr2=0x7ffbd00f2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:12.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 shutdown_connections 2024-05-09T00:00:12.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:12.608+0000 7ffbd8160700 1 -- 172.21.15.26:0/2158938525 wait complete. 2024-05-09T00:00:12.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:12.607872+0000 mon.smithi026 (mon.0) 195 : audit [DBG] from='client.? 172.21.15.26:0/2158938525' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:12.957 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:12.607872+0000 mon.smithi026 (mon.0) 195 : audit [DBG] from='client.? 172.21.15.26:0/2158938525' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:13.285 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-09T00:00:13.286 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-09T00:00:13.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T00:00:13.318 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-09T00:00:13.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:00:13.386 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T00:00:13.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T00:00:13.420 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T00:00:13.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:00:13.489 INFO:tasks.cephadm:Deploying OSDs... 2024-05-09T00:00:13.489 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-09T00:00:13.489 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T00:00:13.507 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T00:00:13.507 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2024-05-09T00:00:13.565 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T00:00:13.565 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:00:13.566 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 164725 Links: 1 2024-05-09T00:00:13.566 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:00:13.566 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:00:13.566 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-05-08 23:59:34.936449394 +0000 2024-05-09T00:00:13.566 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-05-08 23:44:21.823050527 +0000 2024-05-09T00:00:13.566 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-05-08 23:44:21.823050527 +0000 2024-05-09T00:00:13.566 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-05-09T00:00:13.566 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T00:00:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-05-09T00:00:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-05-09T00:00:13.633 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.9804e-05 s, 5.1 MB/s 2024-05-09T00:00:13.634 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T00:00:13.668 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:12.506507+0000 mgr.smithi026.brymfp (mgr.14194) 13 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:13.694 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 171200 Links: 1 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-05-08 23:59:34.936449394 +0000 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-05-08 23:44:22.211044882 +0000 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-05-08 23:44:22.211044882 +0000 2024-05-09T00:00:13.753 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-05-09T00:00:13.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T00:00:13.819 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-05-09T00:00:13.820 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-05-09T00:00:13.820 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000132726 s, 3.9 MB/s 2024-05-09T00:00:13.820 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T00:00:13.881 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2024-05-09T00:00:13.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:12.506507+0000 mgr.smithi026.brymfp (mgr.14194) 13 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:13.910 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T00:00:13.910 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:00:13.910 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 170242 Links: 1 2024-05-09T00:00:13.911 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:00:13.911 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:00:13.911 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-05-08 23:59:34.937449379 +0000 2024-05-09T00:00:13.911 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-05-08 23:44:22.556039864 +0000 2024-05-09T00:00:13.911 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-05-08 23:44:22.556039864 +0000 2024-05-09T00:00:13.911 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-05-09T00:00:13.911 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T00:00:13.977 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-05-09T00:00:13.977 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-05-09T00:00:13.977 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 8.4752e-05 s, 6.0 MB/s 2024-05-09T00:00:13.978 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T00:00:14.039 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2024-05-09T00:00:14.097 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T00:00:14.098 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:00:14.098 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 166645 Links: 1 2024-05-09T00:00:14.098 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:00:14.098 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:00:14.098 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-05-08 23:59:34.937449379 +0000 2024-05-09T00:00:14.098 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-05-08 23:44:22.897034903 +0000 2024-05-09T00:00:14.098 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-05-08 23:44:22.897034903 +0000 2024-05-09T00:00:14.098 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-05-09T00:00:14.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T00:00:14.165 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-05-09T00:00:14.165 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-05-09T00:00:14.165 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000100189 s, 5.1 MB/s 2024-05-09T00:00:14.166 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T00:00:14.226 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T00:00:14.226 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T00:00:14.245 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T00:00:14.245 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-05-09T00:00:14.303 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T00:00:14.304 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:00:14.304 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 172139 Links: 1 2024-05-09T00:00:14.304 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:00:14.304 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:00:14.304 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-09 00:00:09.547626022 +0000 2024-05-09T00:00:14.304 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:44:18.160593000 +0000 2024-05-09T00:00:14.304 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:44:18.160593000 +0000 2024-05-09T00:00:14.304 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-09T00:00:14.304 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T00:00:14.370 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-09T00:00:14.370 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-09T00:00:14.370 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000253098 s, 2.0 MB/s 2024-05-09T00:00:14.371 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T00:00:14.430 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-05-09T00:00:14.488 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T00:00:14.488 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:00:14.488 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 169234 Links: 1 2024-05-09T00:00:14.488 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:00:14.488 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:00:14.489 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-09 00:00:09.547626022 +0000 2024-05-09T00:00:14.489 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:44:18.496585642 +0000 2024-05-09T00:00:14.489 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:44:18.496585642 +0000 2024-05-09T00:00:14.489 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-09T00:00:14.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T00:00:14.553 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-09T00:00:14.554 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-09T00:00:14.554 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000196403 s, 2.6 MB/s 2024-05-09T00:00:14.555 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T00:00:14.613 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 172315 Links: 1 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-09 00:00:09.547626022 +0000 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:44:18.834578240 +0000 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:44:18.834578240 +0000 2024-05-09T00:00:14.672 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-09T00:00:14.673 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T00:00:14.738 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-09T00:00:14.738 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-09T00:00:14.738 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.0001965 s, 2.6 MB/s 2024-05-09T00:00:14.739 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T00:00:14.799 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-05-09T00:00:14.857 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T00:00:14.857 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:00:14.857 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 166427 Links: 1 2024-05-09T00:00:14.857 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:00:14.857 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:00:14.857 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-09 00:00:09.547626022 +0000 2024-05-09T00:00:14.858 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 23:44:19.169570903 +0000 2024-05-09T00:00:14.858 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 23:44:19.169570903 +0000 2024-05-09T00:00:14.858 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-09T00:00:14.858 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T00:00:14.923 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-09T00:00:14.923 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-09T00:00:14.923 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000276548 s, 1.9 MB/s 2024-05-09T00:00:14.924 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T00:00:14.982 INFO:tasks.cephadm:Deploying osd.0 on smithi026 with /dev/vg_nvme/lv_4... 2024-05-09T00:00:14.985 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T00:00:15.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:13.875671+0000 mon.smithi026 (mon.0) 196 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:15.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:13.890602+0000 mgr.smithi026.brymfp (mgr.14194) 14 : cephadm [INF] Deploying daemon prometheus.smithi135 on smithi135 2024-05-09T00:00:15.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:14.651346+0000 mon.smithi026 (mon.0) 197 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:15.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:13.875671+0000 mon.smithi026 (mon.0) 196 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:15.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:13.890602+0000 mgr.smithi026.brymfp (mgr.14194) 14 : cephadm [INF] Deploying daemon prometheus.smithi135 on smithi135 2024-05-09T00:00:15.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:14.651346+0000 mon.smithi026 (mon.0) 197 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:16.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:14.506917+0000 mgr.smithi026.brymfp (mgr.14194) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:16.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:14.506917+0000 mgr.smithi026.brymfp (mgr.14194) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:17.062 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T00:00:17.062 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T00:00:17.062 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2024-05-09T00:00:17.062 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2024-05-09T00:00:17.063 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00817457 s, 1.3 GB/s 2024-05-09T00:00:17.063 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2024-05-09T00:00:17.775 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi026:vg_nvme/lv_4 2024-05-09T00:00:18.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:16.507268+0000 mgr.smithi026.brymfp (mgr.14194) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:18.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:16.507268+0000 mgr.smithi026.brymfp (mgr.14194) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.676+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3367004930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f77e0 msgr2=0x7f7c280f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.676+0000 7f7c2ced4700 1 --2- 172.21.15.26:0/3367004930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f77e0 0x7f7c280f7c00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7c180047f0 tx=0x7f7c18009cb0).stop 2024-05-09T00:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.676+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3367004930 shutdown_connections 2024-05-09T00:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.676+0000 7f7c2ced4700 1 --2- 172.21.15.26:0/3367004930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c280f80f0 0x7f7c280f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.676+0000 7f7c2ced4700 1 --2- 172.21.15.26:0/3367004930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f77e0 0x7f7c280f7c00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.676+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3367004930 >> 172.21.15.26:0/3367004930 conn(0x7f7c280f2fc0 msgr2=0x7f7c280f5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.676+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3367004930 shutdown_connections 2024-05-09T00:00:19.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.676+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3367004930 wait complete. 2024-05-09T00:00:19.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c2ced4700 1 Processor -- start 2024-05-09T00:00:19.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c2ced4700 1 -- start start 2024-05-09T00:00:19.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c2ced4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c280f77e0 0x7f7c28108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:19.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c2ced4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f80f0 0x7f7c28108540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:19.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c2ced4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28108af0 con 0x7f7c280f80f0 2024-05-09T00:00:19.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c2ced4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28108c30 con 0x7f7c280f77e0 2024-05-09T00:00:19.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c25d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f80f0 0x7f7c28108540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:19.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c25d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f80f0 0x7f7c28108540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48770/0 (socket says 172.21.15.26:48770) 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c25d9b700 1 -- 172.21.15.26:0/3073657627 learned_addr learned my addr 172.21.15.26:0/3073657627 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c2659c700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c280f77e0 0x7f7c28108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c25d9b700 1 -- 172.21.15.26:0/3073657627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c280f77e0 msgr2=0x7f7c28108050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c25d9b700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c280f77e0 0x7f7c28108050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c25d9b700 1 -- 172.21.15.26:0/3073657627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18005040 con 0x7f7c280f80f0 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.677+0000 7f7c25d9b700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f80f0 0x7f7c28108540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f7c1c00e8f0 tx=0x7f7c1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.678+0000 7f7c177fe700 1 -- 172.21.15.26:0/3073657627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c1c007b40 con 0x7f7c280f80f0 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.678+0000 7f7c177fe700 1 -- 172.21.15.26:0/3073657627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7c1c00f040 con 0x7f7c280f80f0 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.678+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2810d6d0 con 0x7f7c280f80f0 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.678+0000 7f7c177fe700 1 -- 172.21.15.26:0/3073657627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c1c014850 con 0x7f7c280f80f0 2024-05-09T00:00:19.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.678+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2810dc90 con 0x7f7c280f80f0 2024-05-09T00:00:19.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.679+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c280fffe0 con 0x7f7c280f80f0 2024-05-09T00:00:19.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.679+0000 7f7c177fe700 1 -- 172.21.15.26:0/3073657627 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f7c1c014a80 con 0x7f7c280f80f0 2024-05-09T00:00:19.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.679+0000 7f7c177fe700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7c100611d0 0x7f7c10063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:19.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.680+0000 7f7c177fe700 1 -- 172.21.15.26:0/3073657627 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f7c1c07b480 con 0x7f7c280f80f0 2024-05-09T00:00:19.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.680+0000 7f7c2659c700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7c100611d0 0x7f7c10063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:19.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.680+0000 7f7c2659c700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7c100611d0 0x7f7c10063690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f7c18005010 tx=0x7f7c18009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:19.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.684+0000 7f7c177fe700 1 -- 172.21.15.26:0/3073657627 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7c1c0503f0 con 0x7f7c280f80f0 2024-05-09T00:00:19.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:19.866+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c28059120 con 0x7f7c100611d0 2024-05-09T00:00:20.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:18.507641+0000 mgr.smithi026.brymfp (mgr.14194) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:20.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:19.871441+0000 mon.smithi026 (mon.0) 198 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:20.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:19.873257+0000 mon.smithi026 (mon.0) 199 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:20.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:19.873815+0000 mon.smithi026 (mon.0) 200 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:20.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:18.507641+0000 mgr.smithi026.brymfp (mgr.14194) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:20.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:19.871441+0000 mon.smithi026 (mon.0) 198 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:20.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:19.873257+0000 mon.smithi026 (mon.0) 199 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:20.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:19.873815+0000 mon.smithi026 (mon.0) 200 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:21.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:19.868794+0000 mgr.smithi026.brymfp (mgr.14194) 18 : audit [DBG] from='client.14222 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:21.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:19.868794+0000 mgr.smithi026.brymfp (mgr.14194) 18 : audit [DBG] from='client.14222 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:22.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:20.508031+0000 mgr.smithi026.brymfp (mgr.14194) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:20.508031+0000 mgr.smithi026.brymfp (mgr.14194) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:23.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:22.259561+0000 mon.smithi026 (mon.0) 201 : audit [INF] from='client.? 172.21.15.26:0/2020497665' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e406a7e-5ec2-4f17-9308-640a499d3012"}]: dispatch 2024-05-09T00:00:23.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:22.263268+0000 mon.smithi026 (mon.0) 202 : audit [INF] from='client.? 172.21.15.26:0/2020497665' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e406a7e-5ec2-4f17-9308-640a499d3012"}]': finished 2024-05-09T00:00:23.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:22.263309+0000 mon.smithi026 (mon.0) 203 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-05-09T00:00:23.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:22.263398+0000 mon.smithi026 (mon.0) 204 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:23.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:22.840146+0000 mon.smithi026 (mon.0) 205 : audit [DBG] from='client.? 172.21.15.26:0/4122966933' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:23.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:22.259561+0000 mon.smithi026 (mon.0) 201 : audit [INF] from='client.? 172.21.15.26:0/2020497665' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e406a7e-5ec2-4f17-9308-640a499d3012"}]: dispatch 2024-05-09T00:00:23.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:22.263268+0000 mon.smithi026 (mon.0) 202 : audit [INF] from='client.? 172.21.15.26:0/2020497665' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e406a7e-5ec2-4f17-9308-640a499d3012"}]': finished 2024-05-09T00:00:23.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:22.263309+0000 mon.smithi026 (mon.0) 203 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-05-09T00:00:23.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:22.263398+0000 mon.smithi026 (mon.0) 204 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:23.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:22.840146+0000 mon.smithi026 (mon.0) 205 : audit [DBG] from='client.? 172.21.15.26:0/4122966933' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:24.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:22.508271+0000 mgr.smithi026.brymfp (mgr.14194) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:24.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:22.508271+0000 mgr.smithi026.brymfp (mgr.14194) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:26.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:24.508547+0000 mgr.smithi026.brymfp (mgr.14194) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:26.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:24.508547+0000 mgr.smithi026.brymfp (mgr.14194) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:27.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:26.508777+0000 mgr.smithi026.brymfp (mgr.14194) 22 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:27.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:26.595787+0000 mon.smithi026 (mon.0) 206 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:27.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:26.596950+0000 mon.smithi026 (mon.0) 207 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:27.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:26.508777+0000 mgr.smithi026.brymfp (mgr.14194) 22 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:27.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:26.595787+0000 mon.smithi026 (mon.0) 206 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:27.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:26.596950+0000 mon.smithi026 (mon.0) 207 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:28.509034+0000 mgr.smithi026.brymfp (mgr.14194) 23 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.346119+0000 mon.smithi026 (mon.0) 208 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.346830+0000 mon.smithi026 (mon.0) 209 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.347578+0000 mon.smithi026 (mon.0) 210 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.392330+0000 mon.smithi026 (mon.0) 211 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:29.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.479572+0000 mon.smithi026 (mon.0) 212 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:29.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.482995+0000 mon.smithi026 (mon.0) 213 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:29.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.487004+0000 mon.smithi026 (mon.0) 214 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:00:29.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.487731+0000 mon.smithi026 (mon.0) 215 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:00:29.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.488359+0000 mon.smithi026 (mon.0) 216 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:29.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.558601+0000 mon.smithi026 (mon.0) 217 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:00:29.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.559305+0000 mon.smithi026 (mon.0) 218 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:28.509034+0000 mgr.smithi026.brymfp (mgr.14194) 23 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.346119+0000 mon.smithi026 (mon.0) 208 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.346830+0000 mon.smithi026 (mon.0) 209 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.347578+0000 mon.smithi026 (mon.0) 210 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.392330+0000 mon.smithi026 (mon.0) 211 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.479572+0000 mon.smithi026 (mon.0) 212 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.482995+0000 mon.smithi026 (mon.0) 213 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.487004+0000 mon.smithi026 (mon.0) 214 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:00:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.487731+0000 mon.smithi026 (mon.0) 215 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:00:29.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.488359+0000 mon.smithi026 (mon.0) 216 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:29.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.558601+0000 mon.smithi026 (mon.0) 217 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:00:29.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.559305+0000 mon.smithi026 (mon.0) 218 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:30.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:29.348579+0000 mgr.smithi026.brymfp (mgr.14194) 24 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:00:30.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:29.348843+0000 mgr.smithi026.brymfp (mgr.14194) 25 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:00:30.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:29.486674+0000 mgr.smithi026.brymfp (mgr.14194) 26 : cephadm [INF] Reconfiguring mon.smithi026 (unknown last config time)... 2024-05-09T00:00:30.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:29.488969+0000 mgr.smithi026.brymfp (mgr.14194) 27 : cephadm [INF] Reconfiguring daemon mon.smithi026 on smithi026 2024-05-09T00:00:30.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:29.559888+0000 mgr.smithi026.brymfp (mgr.14194) 28 : cephadm [INF] Deploying daemon osd.0 on smithi026 2024-05-09T00:00:30.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:29.656692+0000 mon.smithi026 (mon.0) 219 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:31.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:29.348579+0000 mgr.smithi026.brymfp (mgr.14194) 24 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:00:31.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:29.348843+0000 mgr.smithi026.brymfp (mgr.14194) 25 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:00:31.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:29.486674+0000 mgr.smithi026.brymfp (mgr.14194) 26 : cephadm [INF] Reconfiguring mon.smithi026 (unknown last config time)... 2024-05-09T00:00:31.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:29.488969+0000 mgr.smithi026.brymfp (mgr.14194) 27 : cephadm [INF] Reconfiguring daemon mon.smithi026 on smithi026 2024-05-09T00:00:31.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:29.559888+0000 mgr.smithi026.brymfp (mgr.14194) 28 : cephadm [INF] Deploying daemon osd.0 on smithi026 2024-05-09T00:00:31.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:29.656692+0000 mon.smithi026 (mon.0) 219 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:31.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:30.509460+0000 mgr.smithi026.brymfp (mgr.14194) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:31.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:30.997451+0000 mon.smithi026 (mon.0) 220 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:31.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:30.998571+0000 mon.smithi026 (mon.0) 221 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.brymfp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:00:31.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:30.999414+0000 mon.smithi026 (mon.0) 222 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:00:31.962 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:31.000091+0000 mon.smithi026 (mon.0) 223 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:32.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:30.509460+0000 mgr.smithi026.brymfp (mgr.14194) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:32.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:30.997451+0000 mon.smithi026 (mon.0) 220 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:32.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:30.998571+0000 mon.smithi026 (mon.0) 221 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.brymfp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:00:32.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:30.999414+0000 mon.smithi026 (mon.0) 222 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:00:32.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:31.000091+0000 mon.smithi026 (mon.0) 223 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:32.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:30.998190+0000 mgr.smithi026.brymfp (mgr.14194) 30 : cephadm [INF] Reconfiguring mgr.smithi026.brymfp (unknown last config time)... 2024-05-09T00:00:32.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:31.000745+0000 mgr.smithi026.brymfp (mgr.14194) 31 : cephadm [INF] Reconfiguring daemon mgr.smithi026.brymfp on smithi026 2024-05-09T00:00:33.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:30.998190+0000 mgr.smithi026.brymfp (mgr.14194) 30 : cephadm [INF] Reconfiguring mgr.smithi026.brymfp (unknown last config time)... 2024-05-09T00:00:33.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:31.000745+0000 mgr.smithi026.brymfp (mgr.14194) 31 : cephadm [INF] Reconfiguring daemon mgr.smithi026.brymfp on smithi026 2024-05-09T00:00:33.758 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:32.509675+0000 mgr.smithi026.brymfp (mgr.14194) 32 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:34.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:32.509675+0000 mgr.smithi026.brymfp (mgr.14194) 32 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:36.005 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:34.509918+0000 mgr.smithi026.brymfp (mgr.14194) 33 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:36.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:34.509918+0000 mgr.smithi026.brymfp (mgr.14194) 33 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:37.494 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:36.279271+0000 mon.smithi026 (mon.0) 224 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:37.494 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:36.510340+0000 mgr.smithi026.brymfp (mgr.14194) 34 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:37.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:36.279271+0000 mon.smithi026 (mon.0) 224 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:37.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:36.510340+0000 mgr.smithi026.brymfp (mgr.14194) 34 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:38.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:37.566800+0000 mon.smithi026 (mon.0) 225 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:38.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:37.567367+0000 mgr.smithi026.brymfp (mgr.14194) 35 : cephadm [INF] Reconfiguring alertmanager.smithi026 (dependencies changed)... 2024-05-09T00:00:38.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:37.573063+0000 mgr.smithi026.brymfp (mgr.14194) 36 : cephadm [INF] Reconfiguring daemon alertmanager.smithi026 on smithi026 2024-05-09T00:00:38.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:38 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:37.566800+0000 mon.smithi026 (mon.0) 225 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:38.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:38 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:37.567367+0000 mgr.smithi026.brymfp (mgr.14194) 35 : cephadm [INF] Reconfiguring alertmanager.smithi026 (dependencies changed)... 2024-05-09T00:00:38.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:38 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:37.573063+0000 mgr.smithi026.brymfp (mgr.14194) 36 : cephadm [INF] Reconfiguring daemon alertmanager.smithi026 on smithi026 2024-05-09T00:00:39.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:38.510588+0000 mgr.smithi026.brymfp (mgr.14194) 37 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:39.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:38.510588+0000 mgr.smithi026.brymfp (mgr.14194) 37 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:40.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:40.147477+0000 mon.smithi026 (mon.0) 226 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T00:00:40.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:40.147477+0000 mon.smithi026 (mon.0) 226 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T00:00:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:40.510882+0000 mgr.smithi026.brymfp (mgr.14194) 38 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:40.580223+0000 mon.smithi026 (mon.0) 227 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T00:00:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:40.580271+0000 mon.smithi026 (mon.0) 228 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-05-09T00:00:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:40.580399+0000 mon.smithi026 (mon.0) 229 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:40.580919+0000 mon.smithi026 (mon.0) 230 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:00:41.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:40.510882+0000 mgr.smithi026.brymfp (mgr.14194) 38 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:41.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:40.580223+0000 mon.smithi026 (mon.0) 227 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T00:00:41.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:40.580271+0000 mon.smithi026 (mon.0) 228 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-05-09T00:00:41.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:40.580399+0000 mon.smithi026 (mon.0) 229 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:41.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:40.580919+0000 mon.smithi026 (mon.0) 230 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:00:42.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:41.582242+0000 mon.smithi026 (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-05-09T00:00:42.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:41.582303+0000 mon.smithi026 (mon.0) 232 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-05-09T00:00:42.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:41.582741+0000 mon.smithi026 (mon.0) 233 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:42.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:41.586662+0000 mon.smithi026 (mon.0) 234 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:42.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:42.586061+0000 mon.smithi026 (mon.0) 235 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:42.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:41.582242+0000 mon.smithi026 (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-05-09T00:00:42.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:41.582303+0000 mon.smithi026 (mon.0) 232 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-05-09T00:00:42.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:41.582741+0000 mon.smithi026 (mon.0) 233 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:42.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:41.586662+0000 mon.smithi026 (mon.0) 234 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:42.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:42.586061+0000 mon.smithi026 (mon.0) 235 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:43.890 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:41.148338+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:00:43.890 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:41.148458+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:00:43.891 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:42.511132+0000 mgr.smithi026.brymfp (mgr.14194) 39 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:43.891 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:42.594539+0000 mon.smithi026 (mon.0) 236 : cluster [INF] osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] boot 2024-05-09T00:00:43.891 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:42.594578+0000 mon.smithi026 (mon.0) 237 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-05-09T00:00:43.891 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:42.595071+0000 mon.smithi026 (mon.0) 238 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:43.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:41.148338+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:00:43.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:41.148458+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:00:43.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:42.511132+0000 mgr.smithi026.brymfp (mgr.14194) 39 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:00:43.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:42.594539+0000 mon.smithi026 (mon.0) 236 : cluster [INF] osd.0 [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] boot 2024-05-09T00:00:43.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:42.594578+0000 mon.smithi026 (mon.0) 237 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-05-09T00:00:43.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:42.595071+0000 mon.smithi026 (mon.0) 238 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:00:44.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:43.595788+0000 mon.smithi026 (mon.0) 239 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-05-09T00:00:44.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:44.038142+0000 mon.smithi026 (mon.0) 240 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:44.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:44.038987+0000 mon.smithi026 (mon.0) 241 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:00:44.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:44.039737+0000 mon.smithi026 (mon.0) 242 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:44.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:43.595788+0000 mon.smithi026 (mon.0) 239 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-05-09T00:00:44.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:44.038142+0000 mon.smithi026 (mon.0) 240 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:44.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:44.038987+0000 mon.smithi026 (mon.0) 241 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:00:44.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:44.039737+0000 mon.smithi026 (mon.0) 242 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:45.381 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 0 on host 'smithi026' 2024-05-09T00:00:45.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.386+0000 7f7c177fe700 1 -- 172.21.15.26:0/3073657627 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7c28059120 con 0x7f7c100611d0 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7c100611d0 msgr2=0x7f7c10063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7c100611d0 0x7f7c10063690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f7c18005010 tx=0x7f7c18009cb0).stop 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f80f0 msgr2=0x7f7c28108540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f80f0 0x7f7c28108540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f7c1c00e8f0 tx=0x7f7c1c00b040).stop 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 shutdown_connections 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7c100611d0 0x7f7c10063690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c280f77e0 0x7f7c28108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 --2- 172.21.15.26:0/3073657627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c280f80f0 0x7f7c28108540 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 >> 172.21.15.26:0/3073657627 conn(0x7f7c280f2fc0 msgr2=0x7f7c280fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 shutdown_connections 2024-05-09T00:00:45.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:45.389+0000 7f7c2ced4700 1 -- 172.21.15.26:0/3073657627 wait complete. 2024-05-09T00:00:45.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:44.038709+0000 mgr.smithi026.brymfp (mgr.14194) 40 : cephadm [INF] Reconfiguring crash.smithi026 (monmap changed)... 2024-05-09T00:00:45.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:44.040280+0000 mgr.smithi026.brymfp (mgr.14194) 41 : cephadm [INF] Reconfiguring daemon crash.smithi026 on smithi026 2024-05-09T00:00:45.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:44.511349+0000 mgr.smithi026.brymfp (mgr.14194) 42 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:45.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:45.386787+0000 mon.smithi026 (mon.0) 243 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:44.038709+0000 mgr.smithi026.brymfp (mgr.14194) 40 : cephadm [INF] Reconfiguring crash.smithi026 (monmap changed)... 2024-05-09T00:00:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:44.040280+0000 mgr.smithi026.brymfp (mgr.14194) 41 : cephadm [INF] Reconfiguring daemon crash.smithi026 on smithi026 2024-05-09T00:00:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:44.511349+0000 mgr.smithi026.brymfp (mgr.14194) 42 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:45.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:45.386787+0000 mon.smithi026 (mon.0) 243 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:46.251 DEBUG:teuthology.orchestra.run.smithi026:osd.0> sudo journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.0.service 2024-05-09T00:00:46.254 INFO:tasks.cephadm:Deploying osd.1 on smithi026 with /dev/vg_nvme/lv_3... 2024-05-09T00:00:46.254 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T00:00:46.287 INFO:journalctl@ceph.osd.0.smithi026.stdout:-- Logs begin at Wed 2024-05-08 23:38:32 UTC. -- 2024-05-09T00:00:47.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:46.511771+0000 mgr.smithi026.brymfp (mgr.14194) 43 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:47.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:47.495025+0000 mon.smithi026 (mon.0) 244 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:47.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:46.511771+0000 mgr.smithi026.brymfp (mgr.14194) 43 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:47.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:47.495025+0000 mon.smithi026 (mon.0) 244 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:48.887 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:47.495617+0000 mgr.smithi026.brymfp (mgr.14194) 44 : cephadm [INF] Reconfiguring grafana.smithi026 (dependencies changed)... 2024-05-09T00:00:48.887 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:47.527524+0000 mgr.smithi026.brymfp (mgr.14194) 45 : cephadm [INF] Reconfiguring daemon grafana.smithi026 on smithi026 2024-05-09T00:00:48.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:47.495617+0000 mgr.smithi026.brymfp (mgr.14194) 44 : cephadm [INF] Reconfiguring grafana.smithi026 (dependencies changed)... 2024-05-09T00:00:48.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:47.527524+0000 mgr.smithi026.brymfp (mgr.14194) 45 : cephadm [INF] Reconfiguring daemon grafana.smithi026 on smithi026 2024-05-09T00:00:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T00:00:49.412 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T00:00:49.413 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2024-05-09T00:00:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2024-05-09T00:00:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00794157 s, 1.3 GB/s 2024-05-09T00:00:49.413 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2024-05-09T00:00:49.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:48.512031+0000 mgr.smithi026.brymfp (mgr.14194) 46 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:49.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:48.512031+0000 mgr.smithi026.brymfp (mgr.14194) 46 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:50.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi026:vg_nvme/lv_3 2024-05-09T00:00:51.811 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:50.512331+0000 mgr.smithi026.brymfp (mgr.14194) 47 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:51.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:50.512331+0000 mgr.smithi026.brymfp (mgr.14194) 47 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:53.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.394+0000 7f24142f6700 1 -- 172.21.15.26:0/1670407473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f7800 msgr2=0x7f240c0f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:53.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.394+0000 7f24142f6700 1 --2- 172.21.15.26:0/1670407473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f7800 0x7f240c0f7c20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f24080047f0 tx=0x7f2408009cb0).stop 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 -- 172.21.15.26:0/1670407473 shutdown_connections 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 --2- 172.21.15.26:0/1670407473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0f8aa0 0x7f240c0f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 --2- 172.21.15.26:0/1670407473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f7800 0x7f240c0f7c20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 -- 172.21.15.26:0/1670407473 >> 172.21.15.26:0/1670407473 conn(0x7f240c0f2f80 msgr2=0x7f240c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 -- 172.21.15.26:0/1670407473 shutdown_connections 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 -- 172.21.15.26:0/1670407473 wait complete. 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 Processor -- start 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 -- start start 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0f7800 0x7f240c107fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f8aa0 0x7f240c1084c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c108a70 con 0x7f240c0f8aa0 2024-05-09T00:00:53.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.395+0000 7f24142f6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c108bb0 con 0x7f240c0f7800 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f2411891700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f8aa0 0x7f240c1084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f2411891700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f8aa0 0x7f240c1084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37146/0 (socket says 172.21.15.26:37146) 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f2411891700 1 -- 172.21.15.26:0/691372959 learned_addr learned my addr 172.21.15.26:0/691372959 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f2412092700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0f7800 0x7f240c107fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f2411891700 1 -- 172.21.15.26:0/691372959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0f7800 msgr2=0x7f240c107fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f2411891700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0f7800 0x7f240c107fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f2411891700 1 -- 172.21.15.26:0/691372959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408005040 con 0x7f240c0f8aa0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f2411891700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f8aa0 0x7f240c1084c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f24000041d0 tx=0x7f2400009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f23ff7fe700 1 -- 172.21.15.26:0/691372959 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2400007b40 con 0x7f240c0f8aa0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f23ff7fe700 1 -- 172.21.15.26:0/691372959 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f240000f040 con 0x7f240c0f8aa0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c10d650 con 0x7f240c0f8aa0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f23ff7fe700 1 -- 172.21.15.26:0/691372959 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2400013730 con 0x7f240c0f8aa0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.396+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c10db90 con 0x7f240c0f8aa0 2024-05-09T00:00:53.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.397+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c0fffe0 con 0x7f240c0f8aa0 2024-05-09T00:00:53.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.398+0000 7f23ff7fe700 1 -- 172.21.15.26:0/691372959 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f2400009110 con 0x7f240c0f8aa0 2024-05-09T00:00:53.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.398+0000 7f23ff7fe700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f23f8061180 0x7f23f8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:00:53.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.398+0000 7f23ff7fe700 1 -- 172.21.15.26:0/691372959 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1849+0+0 (secure 0 0 0) 0x7f240007b550 con 0x7f240c0f8aa0 2024-05-09T00:00:53.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.398+0000 7f2412092700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f23f8061180 0x7f23f8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:00:53.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.398+0000 7f2412092700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f23f8061180 0x7f23f8063640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2408004f10 tx=0x7f240800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:53.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.403+0000 7f23ff7fe700 1 -- 172.21.15.26:0/691372959 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f24000502a0 con 0x7f240c0f8aa0 2024-05-09T00:00:53.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:00:53.583+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f240c059120 con 0x7f23f8061180 2024-05-09T00:00:53.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:52.512717+0000 mgr.smithi026.brymfp (mgr.14194) 48 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:53.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:53.586616+0000 mon.smithi026 (mon.0) 245 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:53.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:53.588441+0000 mon.smithi026 (mon.0) 246 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:53.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:53.588947+0000 mon.smithi026 (mon.0) 247 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:52.512717+0000 mgr.smithi026.brymfp (mgr.14194) 48 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:53.586616+0000 mon.smithi026 (mon.0) 245 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:53.588441+0000 mon.smithi026 (mon.0) 246 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:53.588947+0000 mon.smithi026 (mon.0) 247 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:54.872 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:53.584564+0000 mgr.smithi026.brymfp (mgr.14194) 49 : audit [DBG] from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:54.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:53.584564+0000 mgr.smithi026.brymfp (mgr.14194) 49 : audit [DBG] from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:55.871 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:54.513213+0000 mgr.smithi026.brymfp (mgr.14194) 50 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:55.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:54.513213+0000 mgr.smithi026.brymfp (mgr.14194) 50 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:57.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:55.909788+0000 mon.smithi026 (mon.0) 248 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:57.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:55.910394+0000 mgr.smithi026.brymfp (mgr.14194) 51 : cephadm [INF] Reconfiguring crash.smithi135 (monmap changed)... 2024-05-09T00:00:57.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:55.910675+0000 mon.smithi026 (mon.0) 249 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:00:57.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:55.911355+0000 mon.smithi026 (mon.0) 250 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:57.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:55.911871+0000 mgr.smithi026.brymfp (mgr.14194) 52 : cephadm [INF] Reconfiguring daemon crash.smithi135 on smithi135 2024-05-09T00:00:57.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:55.909788+0000 mon.smithi026 (mon.0) 248 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:57.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:55.910394+0000 mgr.smithi026.brymfp (mgr.14194) 51 : cephadm [INF] Reconfiguring crash.smithi135 (monmap changed)... 2024-05-09T00:00:57.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:55.910675+0000 mon.smithi026 (mon.0) 249 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:00:57.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:55.911355+0000 mon.smithi026 (mon.0) 250 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:57.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:55.911871+0000 mgr.smithi026.brymfp (mgr.14194) 52 : cephadm [INF] Reconfiguring daemon crash.smithi135 on smithi135 2024-05-09T00:00:58.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:56.513488+0000 mgr.smithi026.brymfp (mgr.14194) 53 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:58.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:56.976925+0000 mon.smithi026 (mon.0) 251 : audit [INF] from='client.? 172.21.15.26:0/2769139671' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f0691b3-17ca-4f90-88ce-13f4e115a987"}]: dispatch 2024-05-09T00:00:58.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:56.980453+0000 mon.smithi026 (mon.0) 252 : audit [INF] from='client.? 172.21.15.26:0/2769139671' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f0691b3-17ca-4f90-88ce-13f4e115a987"}]': finished 2024-05-09T00:00:58.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:56.980497+0000 mon.smithi026 (mon.0) 253 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-05-09T00:00:58.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:56.980585+0000 mon.smithi026 (mon.0) 254 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:00:58.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:57.585340+0000 mon.smithi026 (mon.0) 255 : audit [DBG] from='client.? 172.21.15.26:0/192683634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:58.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:57.598657+0000 mon.smithi026 (mon.0) 256 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:58.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:57.599497+0000 mon.smithi026 (mon.0) 257 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:00:58.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:57.600188+0000 mon.smithi026 (mon.0) 258 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:00:58.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:57.600723+0000 mon.smithi026 (mon.0) 259 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:56.513488+0000 mgr.smithi026.brymfp (mgr.14194) 53 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:56.976925+0000 mon.smithi026 (mon.0) 251 : audit [INF] from='client.? 172.21.15.26:0/2769139671' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f0691b3-17ca-4f90-88ce-13f4e115a987"}]: dispatch 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:56.980453+0000 mon.smithi026 (mon.0) 252 : audit [INF] from='client.? 172.21.15.26:0/2769139671' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f0691b3-17ca-4f90-88ce-13f4e115a987"}]': finished 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:56.980497+0000 mon.smithi026 (mon.0) 253 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:56.980585+0000 mon.smithi026 (mon.0) 254 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:57.585340+0000 mon.smithi026 (mon.0) 255 : audit [DBG] from='client.? 172.21.15.26:0/192683634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:57.598657+0000 mon.smithi026 (mon.0) 256 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:57.599497+0000 mon.smithi026 (mon.0) 257 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:57.600188+0000 mon.smithi026 (mon.0) 258 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:00:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:57.600723+0000 mon.smithi026 (mon.0) 259 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:59.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:57.599239+0000 mgr.smithi026.brymfp (mgr.14194) 54 : cephadm [INF] Reconfiguring mgr.smithi135.kkrhgf (monmap changed)... 2024-05-09T00:00:59.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:57.601227+0000 mgr.smithi026.brymfp (mgr.14194) 55 : cephadm [INF] Reconfiguring daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:00:59.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:57.599239+0000 mgr.smithi026.brymfp (mgr.14194) 54 : cephadm [INF] Reconfiguring mgr.smithi135.kkrhgf (monmap changed)... 2024-05-09T00:00:59.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:57.601227+0000 mgr.smithi026.brymfp (mgr.14194) 55 : cephadm [INF] Reconfiguring daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:01:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:00:58.513780+0000 mgr.smithi026.brymfp (mgr.14194) 56 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:58.996903+0000 mon.smithi026 (mon.0) 260 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:58.997658+0000 mon.smithi026 (mon.0) 261 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:01:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:58.998267+0000 mon.smithi026 (mon.0) 262 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:01:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:00:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:00:58.998804+0000 mon.smithi026 (mon.0) 263 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:00.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:00:58.513780+0000 mgr.smithi026.brymfp (mgr.14194) 56 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:00.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:58.996903+0000 mon.smithi026 (mon.0) 260 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:00.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:58.997658+0000 mon.smithi026 (mon.0) 261 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:01:00.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:58.998267+0000 mon.smithi026 (mon.0) 262 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:01:00.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:00:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:00:58.998804+0000 mon.smithi026 (mon.0) 263 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:01.136 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:58.997403+0000 mgr.smithi026.brymfp (mgr.14194) 57 : cephadm [INF] Reconfiguring mon.smithi135 (monmap changed)... 2024-05-09T00:01:01.136 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:00:58.999288+0000 mgr.smithi026.brymfp (mgr.14194) 58 : cephadm [INF] Reconfiguring daemon mon.smithi135 on smithi135 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.530706+0000 mon.smithi026 (mon.0) 264 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.534204+0000 mon.smithi026 (mon.0) 265 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.535623+0000 mon.smithi026 (mon.0) 266 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi026.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.540109+0000 mon.smithi026 (mon.0) 267 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.546824+0000 mon.smithi026 (mon.0) 268 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.550190+0000 mon.smithi026 (mon.0) 269 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi026.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.556954+0000 mon.smithi026 (mon.0) 270 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.562476+0000 mon.smithi026 (mon.0) 271 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.569314+0000 mon.smithi026 (mon.0) 272 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.574015+0000 mon.smithi026 (mon.0) 273 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:01.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.578441+0000 mon.smithi026 (mon.0) 274 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:01.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:58.997403+0000 mgr.smithi026.brymfp (mgr.14194) 57 : cephadm [INF] Reconfiguring mon.smithi135 (monmap changed)... 2024-05-09T00:01:01.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:00:58.999288+0000 mgr.smithi026.brymfp (mgr.14194) 58 : cephadm [INF] Reconfiguring daemon mon.smithi135 on smithi135 2024-05-09T00:01:01.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.530706+0000 mon.smithi026 (mon.0) 264 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.534204+0000 mon.smithi026 (mon.0) 265 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.535623+0000 mon.smithi026 (mon.0) 266 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi026.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.540109+0000 mon.smithi026 (mon.0) 267 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.546824+0000 mon.smithi026 (mon.0) 268 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.550190+0000 mon.smithi026 (mon.0) 269 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi026.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.556954+0000 mon.smithi026 (mon.0) 270 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.562476+0000 mon.smithi026 (mon.0) 271 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.569314+0000 mon.smithi026 (mon.0) 272 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.574015+0000 mon.smithi026 (mon.0) 273 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:01.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.578441+0000 mon.smithi026 (mon.0) 274 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:02.094 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:00.514086+0000 mgr.smithi026.brymfp (mgr.14194) 59 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:02.095 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.534637+0000 mgr.smithi026.brymfp (mgr.14194) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:01:02.095 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.535906+0000 mgr.smithi026.brymfp (mgr.14194) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi026.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T00:01:02.095 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.547461+0000 mgr.smithi026.brymfp (mgr.14194) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:01:02.095 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.550617+0000 mgr.smithi026.brymfp (mgr.14194) 63 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi026.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T00:01:02.095 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.562980+0000 mgr.smithi026.brymfp (mgr.14194) 64 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:01:02.095 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:00.569786+0000 mgr.smithi026.brymfp (mgr.14194) 65 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T00:01:02.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:00.514086+0000 mgr.smithi026.brymfp (mgr.14194) 59 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:02.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.534637+0000 mgr.smithi026.brymfp (mgr.14194) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:01:02.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.535906+0000 mgr.smithi026.brymfp (mgr.14194) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi026.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T00:01:02.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.547461+0000 mgr.smithi026.brymfp (mgr.14194) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:01:02.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.550617+0000 mgr.smithi026.brymfp (mgr.14194) 63 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi026.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T00:01:02.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.562980+0000 mgr.smithi026.brymfp (mgr.14194) 64 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:01:02.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:00.569786+0000 mgr.smithi026.brymfp (mgr.14194) 65 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T00:01:04.188 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:02.514531+0000 mgr.smithi026.brymfp (mgr.14194) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:04.188 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:03.438515+0000 mon.smithi026 (mon.0) 275 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:04.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:02.514531+0000 mgr.smithi026.brymfp (mgr.14194) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:04.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:03.438515+0000 mon.smithi026 (mon.0) 275 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:06.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:04.514838+0000 mgr.smithi026.brymfp (mgr.14194) 67 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:06.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:05.683081+0000 mon.smithi026 (mon.0) 276 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:01:06.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:05.683715+0000 mon.smithi026 (mon.0) 277 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:06.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:04.514838+0000 mgr.smithi026.brymfp (mgr.14194) 67 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:06.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:05.683081+0000 mon.smithi026 (mon.0) 276 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:01:06.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:05.683715+0000 mon.smithi026 (mon.0) 277 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:07.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:01:05.684282+0000 mgr.smithi026.brymfp (mgr.14194) 68 : cephadm [INF] Deploying daemon osd.1 on smithi026 2024-05-09T00:01:07.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:06.401534+0000 mon.smithi026 (mon.0) 278 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:07.241 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:01:05.684282+0000 mgr.smithi026.brymfp (mgr.14194) 68 : cephadm [INF] Deploying daemon osd.1 on smithi026 2024-05-09T00:01:07.241 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:06.401534+0000 mon.smithi026 (mon.0) 278 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:08.200 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:06.515102+0000 mgr.smithi026.brymfp (mgr.14194) 69 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:08.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:06.515102+0000 mgr.smithi026.brymfp (mgr.14194) 69 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:10.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:08.515373+0000 mgr.smithi026.brymfp (mgr.14194) 70 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:10.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:08.515373+0000 mgr.smithi026.brymfp (mgr.14194) 70 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:12.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:10.515638+0000 mgr.smithi026.brymfp (mgr.14194) 71 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:12.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:10.515638+0000 mgr.smithi026.brymfp (mgr.14194) 71 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:13.282 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:12.135922+0000 mon.smithi026 (mon.0) 279 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:13.283 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:12.516005+0000 mgr.smithi026.brymfp (mgr.14194) 72 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:13.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:12.135922+0000 mon.smithi026 (mon.0) 279 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:13.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:12.516005+0000 mgr.smithi026.brymfp (mgr.14194) 72 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:01:14.248019+0000 mgr.smithi026.brymfp (mgr.14194) 73 : cephadm [INF] Detected new or changed devices on smithi026 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:14.252481+0000 mon.smithi026 (mon.0) 280 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:14.516306+0000 mgr.smithi026.brymfp (mgr.14194) 74 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:14.734856+0000 mon.smithi026 (mon.0) 281 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:14.735515+0000 mon.smithi026 (mon.0) 282 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:01:14.735946+0000 mgr.smithi026.brymfp (mgr.14194) 75 : cephadm [INF] Adjusting osd_memory_target on smithi026 to 6963M 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:14.739619+0000 mon.smithi026 (mon.0) 283 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:14.740364+0000 mon.smithi026 (mon.0) 284 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:14.740952+0000 mon.smithi026 (mon.0) 285 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:15.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:14.744663+0000 mon.smithi026 (mon.0) 286 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:15.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:14.748036+0000 mon.smithi026 (mon.0) 287 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:01:14.248019+0000 mgr.smithi026.brymfp (mgr.14194) 73 : cephadm [INF] Detected new or changed devices on smithi026 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:14.252481+0000 mon.smithi026 (mon.0) 280 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:14.516306+0000 mgr.smithi026.brymfp (mgr.14194) 74 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:14.734856+0000 mon.smithi026 (mon.0) 281 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:14.735515+0000 mon.smithi026 (mon.0) 282 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:01:14.735946+0000 mgr.smithi026.brymfp (mgr.14194) 75 : cephadm [INF] Adjusting osd_memory_target on smithi026 to 6963M 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:14.739619+0000 mon.smithi026 (mon.0) 283 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:14.740364+0000 mon.smithi026 (mon.0) 284 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:15.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:14.740952+0000 mon.smithi026 (mon.0) 285 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:15.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:14.744663+0000 mon.smithi026 (mon.0) 286 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:15.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:14.748036+0000 mon.smithi026 (mon.0) 287 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:16.218 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 1 on host 'smithi026' 2024-05-09T00:01:16.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.223+0000 7f23ff7fe700 1 -- 172.21.15.26:0/691372959 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f240c059120 con 0x7f23f8061180 2024-05-09T00:01:16.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f23f8061180 msgr2=0x7f23f8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f23f8061180 0x7f23f8063640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2408004f10 tx=0x7f240800b040).stop 2024-05-09T00:01:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f8aa0 msgr2=0x7f240c1084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f8aa0 0x7f240c1084c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f24000041d0 tx=0x7f2400009f60).stop 2024-05-09T00:01:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 shutdown_connections 2024-05-09T00:01:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f23f8061180 0x7f23f8063640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:16.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f240c0f7800 0x7f240c107fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:16.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 --2- 172.21.15.26:0/691372959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f240c0f8aa0 0x7f240c1084c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:16.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 >> 172.21.15.26:0/691372959 conn(0x7f240c0f2f80 msgr2=0x7f240c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:16.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 shutdown_connections 2024-05-09T00:01:16.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:16.225+0000 7f24142f6700 1 -- 172.21.15.26:0/691372959 wait complete. 2024-05-09T00:01:16.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:16.006880+0000 mon.smithi026 (mon.0) 288 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:01:16.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:16.223834+0000 mon.smithi026 (mon.0) 289 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:16.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:16.006880+0000 mon.smithi026 (mon.0) 288 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:01:16.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:16.223834+0000 mon.smithi026 (mon.0) 289 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:17.272 DEBUG:teuthology.orchestra.run.smithi026:osd.1> sudo journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.1.service 2024-05-09T00:01:17.274 INFO:tasks.cephadm:Deploying osd.2 on smithi026 with /dev/vg_nvme/lv_2... 2024-05-09T00:01:17.274 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T00:01:17.309 INFO:journalctl@ceph.osd.1.smithi026.stdout:-- Logs begin at Wed 2024-05-08 23:38:32 UTC. -- 2024-05-09T00:01:17.640 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:16.260554+0000 mon.smithi026 (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T00:01:17.640 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:16.260597+0000 mon.smithi026 (mon.0) 291 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-05-09T00:01:17.641 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:16.260703+0000 mon.smithi026 (mon.0) 292 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:01:17.641 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:16.261029+0000 mon.smithi026 (mon.0) 293 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:01:17.641 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:16.516576+0000 mgr.smithi026.brymfp (mgr.14194) 76 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:17.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:16.260554+0000 mon.smithi026 (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T00:01:17.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:16.260597+0000 mon.smithi026 (mon.0) 291 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-05-09T00:01:17.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:16.260703+0000 mon.smithi026 (mon.0) 292 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:01:17.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:16.261029+0000 mon.smithi026 (mon.0) 293 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:01:17.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:16.516576+0000 mgr.smithi026.brymfp (mgr.14194) 76 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:18.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:17.262628+0000 mon.smithi026 (mon.0) 294 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-05-09T00:01:18.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:17.262695+0000 mon.smithi026 (mon.0) 295 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-05-09T00:01:18.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:17.263187+0000 mon.smithi026 (mon.0) 296 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:01:18.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:17.267272+0000 mon.smithi026 (mon.0) 297 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:01:18.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:17.413009+0000 mon.smithi026 (mon.0) 298 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:18.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:17.262628+0000 mon.smithi026 (mon.0) 294 : audit [INF] from='osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-05-09T00:01:18.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:17.262695+0000 mon.smithi026 (mon.0) 295 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-05-09T00:01:18.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:17.263187+0000 mon.smithi026 (mon.0) 296 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:01:18.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:17.267272+0000 mon.smithi026 (mon.0) 297 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:01:18.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:17.413009+0000 mon.smithi026 (mon.0) 298 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:19.520 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:16.974196+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:01:19.520 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:16.974268+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:01:19.520 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:18.267898+0000 mon.smithi026 (mon.0) 299 : cluster [INF] osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] boot 2024-05-09T00:01:19.521 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:18.267931+0000 mon.smithi026 (mon.0) 300 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-05-09T00:01:19.521 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:18.268337+0000 mon.smithi026 (mon.0) 301 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:01:19.521 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:18.516839+0000 mgr.smithi026.brymfp (mgr.14194) 77 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:19.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:16.974196+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:01:19.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:16.974268+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:01:19.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:18.267898+0000 mon.smithi026 (mon.0) 299 : cluster [INF] osd.1 [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] boot 2024-05-09T00:01:19.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:18.267931+0000 mon.smithi026 (mon.0) 300 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-05-09T00:01:19.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:18.268337+0000 mon.smithi026 (mon.0) 301 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:01:19.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:18.516839+0000 mgr.smithi026.brymfp (mgr.14194) 77 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:01:20.099 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T00:01:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T00:01:20.100 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2024-05-09T00:01:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2024-05-09T00:01:20.100 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00852229 s, 1.2 GB/s 2024-05-09T00:01:20.100 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2024-05-09T00:01:20.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:19.276566+0000 mon.smithi026 (mon.0) 302 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-05-09T00:01:20.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:19.276566+0000 mon.smithi026 (mon.0) 302 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-05-09T00:01:21.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi026:vg_nvme/lv_2 2024-05-09T00:01:21.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:20.517225+0000 mgr.smithi026.brymfp (mgr.14194) 78 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:21.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:20.517225+0000 mgr.smithi026.brymfp (mgr.14194) 78 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.264+0000 7eff05864700 1 -- 172.21.15.26:0/280775637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 msgr2=0x7eff000fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.264+0000 7eff05864700 1 --2- 172.21.15.26:0/280775637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 0x7eff000fa3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7efef40047f0 tx=0x7efef4009cb0).stop 2024-05-09T00:01:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.264+0000 7eff05864700 1 -- 172.21.15.26:0/280775637 shutdown_connections 2024-05-09T00:01:23.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.264+0000 7eff05864700 1 --2- 172.21.15.26:0/280775637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff000fa950 0x7eff000fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:23.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.264+0000 7eff05864700 1 --2- 172.21.15.26:0/280775637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 0x7eff000fa3d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:23.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.264+0000 7eff05864700 1 -- 172.21.15.26:0/280775637 >> 172.21.15.26:0/280775637 conn(0x7eff000f1e50 msgr2=0x7eff000f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:23.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.264+0000 7eff05864700 1 -- 172.21.15.26:0/280775637 shutdown_connections 2024-05-09T00:01:23.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.264+0000 7eff05864700 1 -- 172.21.15.26:0/280775637 wait complete. 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7eff05864700 1 Processor -- start 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7eff05864700 1 -- start start 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7eff05864700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 0x7eff00107f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7eff05864700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff000fa950 0x7eff00108430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7eff05864700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff001089e0 con 0x7eff00061280 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7eff05864700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff00108b20 con 0x7eff000fa950 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7efefeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 0x7eff00107f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7efefeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 0x7eff00107f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38796/0 (socket says 172.21.15.26:38796) 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.265+0000 7efefeffd700 1 -- 172.21.15.26:0/2418643758 learned_addr learned my addr 172.21.15.26:0/2418643758 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:01:23.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7efefe7fc700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff000fa950 0x7eff00108430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7efefeffd700 1 -- 172.21.15.26:0/2418643758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff000fa950 msgr2=0x7eff00108430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7efefeffd700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff000fa950 0x7eff00108430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7efefeffd700 1 -- 172.21.15.26:0/2418643758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4005040 con 0x7eff00061280 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7efefeffd700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 0x7eff00107f40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7efef4013510 tx=0x7efef4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7efee7fff700 1 -- 172.21.15.26:0/2418643758 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef400e030 con 0x7eff00061280 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7efee7fff700 1 -- 172.21.15.26:0/2418643758 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7efef4007e90 con 0x7eff00061280 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0010d560 con 0x7eff00061280 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7efee7fff700 1 -- 172.21.15.26:0/2418643758 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef4018070 con 0x7eff00061280 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.266+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0010daa0 con 0x7eff00061280 2024-05-09T00:01:23.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.267+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff000fffe0 con 0x7eff00061280 2024-05-09T00:01:23.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.268+0000 7efee7fff700 1 -- 172.21.15.26:0/2418643758 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7efef401c730 con 0x7eff00061280 2024-05-09T00:01:23.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.268+0000 7efee7fff700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7efee8061180 0x7efee8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:01:23.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.268+0000 7efee7fff700 1 -- 172.21.15.26:0/2418643758 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2281+0+0 (secure 0 0 0) 0x7efef407d220 con 0x7eff00061280 2024-05-09T00:01:23.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.268+0000 7efefe7fc700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7efee8061180 0x7efee8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:01:23.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.268+0000 7efefe7fc700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7efee8061180 0x7efee8063640 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7eff00061050 tx=0x7efef0009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:23.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.273+0000 7efee7fff700 1 -- 172.21.15.26:0/2418643758 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efef4051f90 con 0x7eff00061280 2024-05-09T00:01:23.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:23.456+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7eff00059120 con 0x7efee8061180 2024-05-09T00:01:23.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:22.517621+0000 mgr.smithi026.brymfp (mgr.14194) 79 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:23.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:23.284716+0000 mon.smithi026 (mon.0) 303 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:23.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:23.461443+0000 mon.smithi026 (mon.0) 304 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:01:23.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:23.464096+0000 mon.smithi026 (mon.0) 305 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:01:23.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:23.464841+0000 mon.smithi026 (mon.0) 306 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:23.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:22.517621+0000 mgr.smithi026.brymfp (mgr.14194) 79 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:23.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:23.284716+0000 mon.smithi026 (mon.0) 303 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:23.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:23.461443+0000 mon.smithi026 (mon.0) 304 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:01:23.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:23.464096+0000 mon.smithi026 (mon.0) 305 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:01:23.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:23.464841+0000 mon.smithi026 (mon.0) 306 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:24.791 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:23.458111+0000 mgr.smithi026.brymfp (mgr.14194) 80 : audit [DBG] from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:24.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:23.458111+0000 mgr.smithi026.brymfp (mgr.14194) 80 : audit [DBG] from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:25.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:24.517950+0000 mgr.smithi026.brymfp (mgr.14194) 81 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:24.517950+0000 mgr.smithi026.brymfp (mgr.14194) 81 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:27.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:26.518383+0000 mgr.smithi026.brymfp (mgr.14194) 82 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:27.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:27.339018+0000 mon.smithi026 (mon.0) 307 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:27.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:27.340024+0000 mon.smithi026 (mon.0) 308 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:27.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:27.340670+0000 mon.smithi026 (mon.0) 309 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:27.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:27.344916+0000 mon.smithi026 (mon.0) 310 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:27.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:27.348423+0000 mon.smithi026 (mon.0) 311 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:27.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:26.518383+0000 mgr.smithi026.brymfp (mgr.14194) 82 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:27.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:27.339018+0000 mon.smithi026 (mon.0) 307 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:27.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:27.340024+0000 mon.smithi026 (mon.0) 308 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:27.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:27.340670+0000 mon.smithi026 (mon.0) 309 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:27.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:27.344916+0000 mon.smithi026 (mon.0) 310 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:27.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:27.348423+0000 mon.smithi026 (mon.0) 311 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:28.850 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:28.164378+0000 mon.smithi026 (mon.0) 312 : audit [INF] from='client.? 172.21.15.26:0/3922995297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3eaa1376-f58f-4e84-970a-f7805331d339"}]: dispatch 2024-05-09T00:01:28.850 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:28.167714+0000 mon.smithi026 (mon.0) 313 : audit [INF] from='client.? 172.21.15.26:0/3922995297' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3eaa1376-f58f-4e84-970a-f7805331d339"}]': finished 2024-05-09T00:01:28.850 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:28.167761+0000 mon.smithi026 (mon.0) 314 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-05-09T00:01:28.851 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:28.167885+0000 mon.smithi026 (mon.0) 315 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:28.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:28.164378+0000 mon.smithi026 (mon.0) 312 : audit [INF] from='client.? 172.21.15.26:0/3922995297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3eaa1376-f58f-4e84-970a-f7805331d339"}]: dispatch 2024-05-09T00:01:28.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:28.167714+0000 mon.smithi026 (mon.0) 313 : audit [INF] from='client.? 172.21.15.26:0/3922995297' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3eaa1376-f58f-4e84-970a-f7805331d339"}]': finished 2024-05-09T00:01:28.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:28.167761+0000 mon.smithi026 (mon.0) 314 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-05-09T00:01:28.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:28.167885+0000 mon.smithi026 (mon.0) 315 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:28.518694+0000 mgr.smithi026.brymfp (mgr.14194) 83 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:28.844602+0000 mon.smithi026 (mon.0) 316 : audit [DBG] from='client.? 172.21.15.26:0/3661729226' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:01:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:28.518694+0000 mgr.smithi026.brymfp (mgr.14194) 83 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:28.844602+0000 mon.smithi026 (mon.0) 316 : audit [DBG] from='client.? 172.21.15.26:0/3661729226' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:01:31.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:30.266419+0000 mon.smithi026 (mon.0) 317 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:31.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:30.518990+0000 mgr.smithi026.brymfp (mgr.14194) 84 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:31.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:31.097130+0000 mon.smithi026 (mon.0) 318 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:31.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:31.097804+0000 mon.smithi026 (mon.0) 319 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:31.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:31.098392+0000 mon.smithi026 (mon.0) 320 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:31.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:31.101656+0000 mon.smithi026 (mon.0) 321 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:31.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:30.266419+0000 mon.smithi026 (mon.0) 317 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:31.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:30.518990+0000 mgr.smithi026.brymfp (mgr.14194) 84 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:31.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:31.097130+0000 mon.smithi026 (mon.0) 318 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:31.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:31.097804+0000 mon.smithi026 (mon.0) 319 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:31.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:31.098392+0000 mon.smithi026 (mon.0) 320 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:31.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:31.101656+0000 mon.smithi026 (mon.0) 321 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:33.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:32.519492+0000 mgr.smithi026.brymfp (mgr.14194) 85 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:33.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:32.519492+0000 mgr.smithi026.brymfp (mgr.14194) 85 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:35.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:34.520056+0000 mgr.smithi026.brymfp (mgr.14194) 86 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:35.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:34.520056+0000 mgr.smithi026.brymfp (mgr.14194) 86 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:36.830 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:35.687145+0000 mon.smithi026 (mon.0) 322 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:01:36.830 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:35.687958+0000 mon.smithi026 (mon.0) 323 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:36.830 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:01:35.688607+0000 mgr.smithi026.brymfp (mgr.14194) 87 : cephadm [INF] Deploying daemon osd.2 on smithi026 2024-05-09T00:01:36.886 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:35.687145+0000 mon.smithi026 (mon.0) 322 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:01:36.886 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:35.687958+0000 mon.smithi026 (mon.0) 323 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:36.886 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:01:35.688607+0000 mgr.smithi026.brymfp (mgr.14194) 87 : cephadm [INF] Deploying daemon osd.2 on smithi026 2024-05-09T00:01:37.852 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:36.520494+0000 mgr.smithi026.brymfp (mgr.14194) 88 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:37.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:36.520494+0000 mgr.smithi026.brymfp (mgr.14194) 88 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:39.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:38.520789+0000 mgr.smithi026.brymfp (mgr.14194) 89 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:39.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:38.520789+0000 mgr.smithi026.brymfp (mgr.14194) 89 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:42.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:40.521059+0000 mgr.smithi026.brymfp (mgr.14194) 90 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:42.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:40.936116+0000 mon.smithi026 (mon.0) 324 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:42.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:40.936380+0000 mon.smithi026 (mon.0) 325 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.318 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:40.521059+0000 mgr.smithi026.brymfp (mgr.14194) 90 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:42.318 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:40.936116+0000 mon.smithi026 (mon.0) 324 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:42.319 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:40.936380+0000 mon.smithi026 (mon.0) 325 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:44.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:42.521408+0000 mgr.smithi026.brymfp (mgr.14194) 91 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:44.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:43.619482+0000 mon.smithi026 (mon.0) 326 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:44.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:42.521408+0000 mgr.smithi026.brymfp (mgr.14194) 91 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:44.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:43.619482+0000 mon.smithi026 (mon.0) 326 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.448+0000 7efee7fff700 1 -- 172.21.15.26:0/2418643758 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7eff00059120 con 0x7efee8061180 2024-05-09T00:01:44.443 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 2 on host 'smithi026' 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7efee8061180 msgr2=0x7efee8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7efee8061180 0x7efee8063640 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7eff00061050 tx=0x7efef0009040).stop 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 msgr2=0x7eff00107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 0x7eff00107f40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7efef4013510 tx=0x7efef4009cb0).stop 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 shutdown_connections 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7efee8061180 0x7efee8063640 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff00061280 0x7eff00107f40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 --2- 172.21.15.26:0/2418643758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff000fa950 0x7eff00108430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 >> 172.21.15.26:0/2418643758 conn(0x7eff000f1e50 msgr2=0x7eff000f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 shutdown_connections 2024-05-09T00:01:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:01:44.450+0000 7eff05864700 1 -- 172.21.15.26:0/2418643758 wait complete. 2024-05-09T00:01:45.466 DEBUG:teuthology.orchestra.run.smithi026:osd.2> sudo journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.2.service 2024-05-09T00:01:45.468 INFO:tasks.cephadm:Deploying osd.3 on smithi135 with /dev/vg_nvme/lv_4... 2024-05-09T00:01:45.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T00:01:45.498 INFO:journalctl@ceph.osd.2.smithi026.stdout:-- Logs begin at Wed 2024-05-08 23:38:32 UTC. -- 2024-05-09T00:01:45.806 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:44.449042+0000 mon.smithi026 (mon.0) 327 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:45.807 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:44.521761+0000 mgr.smithi026.brymfp (mgr.14194) 92 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:45.807 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:44.854978+0000 mon.smithi026 (mon.0) 328 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:01:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:44.449042+0000 mon.smithi026 (mon.0) 327 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:44.521761+0000 mgr.smithi026.brymfp (mgr.14194) 92 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:44.854978+0000 mon.smithi026 (mon.0) 328 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:01:46.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:46 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:45.456958+0000 mon.smithi026 (mon.0) 329 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T00:01:46.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:46 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:45.457029+0000 mon.smithi026 (mon.0) 330 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-05-09T00:01:46.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:46 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:45.457305+0000 mon.smithi026 (mon.0) 331 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:46.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:46 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:45.457677+0000 mon.smithi026 (mon.0) 332 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:01:46.893 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:01:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[65308]: debug 2024-05-09T00:01:46.459+0000 7fa19daf7700 -1 osd.2 0 waiting for initial osdmap 2024-05-09T00:01:46.893 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:01:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[65308]: debug 2024-05-09T00:01:46.464+0000 7fa199a72700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:01:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:45.456958+0000 mon.smithi026 (mon.0) 329 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T00:01:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:45.457029+0000 mon.smithi026 (mon.0) 330 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-05-09T00:01:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:45.457305+0000 mon.smithi026 (mon.0) 331 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:46.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:45.457677+0000 mon.smithi026 (mon.0) 332 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:01:47.770 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:46.457423+0000 mon.smithi026 (mon.0) 333 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-05-09T00:01:47.771 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:46.457479+0000 mon.smithi026 (mon.0) 334 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-05-09T00:01:47.771 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:46.457826+0000 mon.smithi026 (mon.0) 335 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:47.771 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:46.461576+0000 mon.smithi026 (mon.0) 336 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:47.771 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:46.522171+0000 mgr.smithi026.brymfp (mgr.14194) 93 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:47.771 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:47.269219+0000 mon.smithi026 (mon.0) 337 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T00:01:47.889 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T00:01:47.889 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-09T00:01:47.890 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-09T00:01:47.890 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0129588 s, 809 MB/s 2024-05-09T00:01:47.890 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-09T00:01:47.890 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:46.457423+0000 mon.smithi026 (mon.0) 333 : audit [INF] from='osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2024-05-09T00:01:47.890 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:46.457479+0000 mon.smithi026 (mon.0) 334 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-05-09T00:01:47.890 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:46.457826+0000 mon.smithi026 (mon.0) 335 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:47.890 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:46.461576+0000 mon.smithi026 (mon.0) 336 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:47.890 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:46.522171+0000 mgr.smithi026.brymfp (mgr.14194) 93 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T00:01:47.890 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:47.269219+0000 mon.smithi026 (mon.0) 337 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:48.573 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:45.884299+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:01:48.573 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:45.884442+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:01:48.573 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:47.462069+0000 mon.smithi026 (mon.0) 338 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:48.573 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:47.466051+0000 mon.smithi026 (mon.0) 339 : cluster [INF] osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] boot 2024-05-09T00:01:48.573 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:47.466091+0000 mon.smithi026 (mon.0) 340 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-05-09T00:01:48.573 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:47.466446+0000 mon.smithi026 (mon.0) 341 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:48.574 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:47.466830+0000 mon.smithi026 (mon.0) 342 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-09T00:01:48.575 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-05-09T00:01:48.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:45.884299+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:01:48.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:45.884442+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:01:48.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:47.462069+0000 mon.smithi026 (mon.0) 338 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:48.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:47.466051+0000 mon.smithi026 (mon.0) 339 : cluster [INF] osd.2 [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] boot 2024-05-09T00:01:48.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:47.466091+0000 mon.smithi026 (mon.0) 340 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-05-09T00:01:48.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:47.466446+0000 mon.smithi026 (mon.0) 341 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:01:48.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:47.466830+0000 mon.smithi026 (mon.0) 342 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-09T00:01:49.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:48.470640+0000 mon.smithi026 (mon.0) 343 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-09T00:01:49.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:48.470721+0000 mon.smithi026 (mon.0) 344 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-05-09T00:01:49.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:48.471530+0000 mon.smithi026 (mon.0) 345 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-05-09T00:01:49.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:48.522545+0000 mgr.smithi026.brymfp (mgr.14194) 94 : cluster [DBG] pgmap v70: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:49.745 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:48.470640+0000 mon.smithi026 (mon.0) 343 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-09T00:01:49.745 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:48.470721+0000 mon.smithi026 (mon.0) 344 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-05-09T00:01:49.745 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:48.471530+0000 mon.smithi026 (mon.0) 345 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-05-09T00:01:49.745 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:48.522545+0000 mgr.smithi026.brymfp (mgr.14194) 94 : cluster [DBG] pgmap v70: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:50.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:49.475102+0000 mon.smithi026 (mon.0) 346 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-05-09T00:01:50.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:49.475158+0000 mon.smithi026 (mon.0) 347 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-05-09T00:01:50.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 -- 172.21.15.135:0/2849473144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 msgr2=0x7f40ec0f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 --2- 172.21.15.135:0/2849473144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 0x7f40ec0f7c20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f40dc0047f0 tx=0x7f40dc009cb0).stop 2024-05-09T00:01:50.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 -- 172.21.15.135:0/2849473144 shutdown_connections 2024-05-09T00:01:50.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 --2- 172.21.15.135:0/2849473144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40ec0f8aa0 0x7f40ec0f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:50.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 --2- 172.21.15.135:0/2849473144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 0x7f40ec0f7c20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:50.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 -- 172.21.15.135:0/2849473144 >> 172.21.15.135:0/2849473144 conn(0x7f40ec0f2f80 msgr2=0x7f40ec0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:50.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 -- 172.21.15.135:0/2849473144 shutdown_connections 2024-05-09T00:01:50.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 -- 172.21.15.135:0/2849473144 wait complete. 2024-05-09T00:01:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.657+0000 7f40f203c700 1 Processor -- start 2024-05-09T00:01:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40f203c700 1 -- start start 2024-05-09T00:01:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40f203c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 0x7f40ec06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:01:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40f203c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40ec0f8aa0 0x7f40ec06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40f203c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec06cf80 con 0x7f40ec0f8aa0 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40f203c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec06b520 con 0x7f40ec0f7800 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40eb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 0x7f40ec06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40eb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 0x7f40ec06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59550/0 (socket says 172.21.15.135:59550) 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40eb7fe700 1 -- 172.21.15.135:0/1651365663 learned_addr learned my addr 172.21.15.135:0/1651365663 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40eaffd700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40ec0f8aa0 0x7f40ec06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40eb7fe700 1 -- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40ec0f8aa0 msgr2=0x7f40ec06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40eb7fe700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40ec0f8aa0 0x7f40ec06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40eb7fe700 1 -- 172.21.15.135:0/1651365663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc005040 con 0x7f40ec0f7800 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40eb7fe700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 0x7f40ec06c9d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f40dc004f10 tx=0x7f40dc009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40e8ff9700 1 -- 172.21.15.135:0/1651365663 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40dc00e070 con 0x7f40ec0f7800 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40e8ff9700 1 -- 172.21.15.135:0/1651365663 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f40dc007e90 con 0x7f40ec0f7800 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40e8ff9700 1 -- 172.21.15.135:0/1651365663 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40dc018070 con 0x7f40ec0f7800 2024-05-09T00:01:50.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.658+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec06b740 con 0x7f40ec0f7800 2024-05-09T00:01:50.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.659+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec06bc20 con 0x7f40ec0f7800 2024-05-09T00:01:50.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.660+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec06be90 con 0x7f40ec0f7800 2024-05-09T00:01:50.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.660+0000 7f40e8ff9700 1 -- 172.21.15.135:0/1651365663 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f40dc0123c0 con 0x7f40ec0f7800 2024-05-09T00:01:50.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.660+0000 7f40e8ff9700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f40d4061110 0x7f40d40635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:01:50.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.660+0000 7f40e8ff9700 1 -- 172.21.15.135:0/1651365663 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f40dc07cd90 con 0x7f40ec0f7800 2024-05-09T00:01:50.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.660+0000 7f40eaffd700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f40d4061110 0x7f40d40635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:01:50.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.661+0000 7f40eaffd700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f40d4061110 0x7f40d40635d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f40e0004da0 tx=0x7f40e000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:50.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.665+0000 7f40e8ff9700 1 -- 172.21.15.135:0/1651365663 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f40dc0515e0 con 0x7f40ec0f7800 2024-05-09T00:01:50.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:01:50.836+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f40ec102020 con 0x7f40d4061110 2024-05-09T00:01:50.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:49.475102+0000 mon.smithi026 (mon.0) 346 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-05-09T00:01:50.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:49.475158+0000 mon.smithi026 (mon.0) 347 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:50.478700+0000 mon.smithi026 (mon.0) 348 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:50.522776+0000 mgr.smithi026.brymfp (mgr.14194) 95 : cluster [DBG] pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:01:50.585261+0000 mgr.smithi026.brymfp (mgr.14194) 96 : cephadm [INF] Detected new or changed devices on smithi026 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.590010+0000 mon.smithi026 (mon.0) 349 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.590857+0000 mon.smithi026 (mon.0) 350 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.591439+0000 mon.smithi026 (mon.0) 351 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.591986+0000 mon.smithi026 (mon.0) 352 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:01:50.592405+0000 mgr.smithi026.brymfp (mgr.14194) 97 : cephadm [INF] Adjusting osd_memory_target on smithi026 to 4642M 2024-05-09T00:01:51.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.595319+0000 mon.smithi026 (mon.0) 353 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:51.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.596110+0000 mon.smithi026 (mon.0) 354 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:51.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.596721+0000 mon.smithi026 (mon.0) 355 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:51.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.600218+0000 mon.smithi026 (mon.0) 356 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:51.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.603609+0000 mon.smithi026 (mon.0) 357 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:51.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.838388+0000 mgr.smithi026.brymfp (mgr.14194) 98 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:51.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.840611+0000 mon.smithi026 (mon.0) 358 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:01:51.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.842605+0000 mon.smithi026 (mon.0) 359 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:01:51.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:50.843147+0000 mon.smithi026 (mon.0) 360 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:51.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:50.478700+0000 mon.smithi026 (mon.0) 348 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-05-09T00:01:51.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:50.522776+0000 mgr.smithi026.brymfp (mgr.14194) 95 : cluster [DBG] pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:51.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:01:50.585261+0000 mgr.smithi026.brymfp (mgr.14194) 96 : cephadm [INF] Detected new or changed devices on smithi026 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.590010+0000 mon.smithi026 (mon.0) 349 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.590857+0000 mon.smithi026 (mon.0) 350 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.591439+0000 mon.smithi026 (mon.0) 351 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.591986+0000 mon.smithi026 (mon.0) 352 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:01:50.592405+0000 mgr.smithi026.brymfp (mgr.14194) 97 : cephadm [INF] Adjusting osd_memory_target on smithi026 to 4642M 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.595319+0000 mon.smithi026 (mon.0) 353 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.596110+0000 mon.smithi026 (mon.0) 354 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.596721+0000 mon.smithi026 (mon.0) 355 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.600218+0000 mon.smithi026 (mon.0) 356 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.603609+0000 mon.smithi026 (mon.0) 357 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.838388+0000 mgr.smithi026.brymfp (mgr.14194) 98 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.840611+0000 mon.smithi026 (mon.0) 358 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.842605+0000 mon.smithi026 (mon.0) 359 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:01:51.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:50.843147+0000 mon.smithi026 (mon.0) 360 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:53.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:52.523196+0000 mgr.smithi026.brymfp (mgr.14194) 99 : cluster [DBG] pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:53.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:53.275715+0000 mon.smithi135 (mon.1) 2 : audit [INF] from='client.? 172.21.15.135:0/3757452574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9018149e-e25f-4d5c-8749-0feaffaa31e1"}]: dispatch 2024-05-09T00:01:53.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:53.276263+0000 mon.smithi026 (mon.0) 361 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9018149e-e25f-4d5c-8749-0feaffaa31e1"}]: dispatch 2024-05-09T00:01:53.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:53.280013+0000 mon.smithi026 (mon.0) 362 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9018149e-e25f-4d5c-8749-0feaffaa31e1"}]': finished 2024-05-09T00:01:53.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:53.280061+0000 mon.smithi026 (mon.0) 363 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-05-09T00:01:53.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:53.280166+0000 mon.smithi026 (mon.0) 364 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:01:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:52.523196+0000 mgr.smithi026.brymfp (mgr.14194) 99 : cluster [DBG] pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:53.275715+0000 mon.smithi135 (mon.1) 2 : audit [INF] from='client.? 172.21.15.135:0/3757452574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9018149e-e25f-4d5c-8749-0feaffaa31e1"}]: dispatch 2024-05-09T00:01:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:53.276263+0000 mon.smithi026 (mon.0) 361 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9018149e-e25f-4d5c-8749-0feaffaa31e1"}]: dispatch 2024-05-09T00:01:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:53.280013+0000 mon.smithi026 (mon.0) 362 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9018149e-e25f-4d5c-8749-0feaffaa31e1"}]': finished 2024-05-09T00:01:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:53.280061+0000 mon.smithi026 (mon.0) 363 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-05-09T00:01:53.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:53.280166+0000 mon.smithi026 (mon.0) 364 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:01:54.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:53.851653+0000 mon.smithi135 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.135:0/3352555771' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:01:54.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:53.986098+0000 mon.smithi026 (mon.0) 365 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:54.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:53.986773+0000 mon.smithi026 (mon.0) 366 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:54.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:53.987404+0000 mon.smithi026 (mon.0) 367 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:54.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:01:54.018309+0000 mon.smithi026 (mon.0) 368 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:54.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:53.851653+0000 mon.smithi135 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.135:0/3352555771' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:01:54.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:53.986098+0000 mon.smithi026 (mon.0) 365 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:54.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:53.986773+0000 mon.smithi026 (mon.0) 366 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:54.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:53.987404+0000 mon.smithi026 (mon.0) 367 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:54.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:01:54.018309+0000 mon.smithi026 (mon.0) 368 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:01:55.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:54.523711+0000 mgr.smithi026.brymfp (mgr.14194) 100 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:55.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:54.523711+0000 mgr.smithi026.brymfp (mgr.14194) 100 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:57.853 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:56.524171+0000 mgr.smithi026.brymfp (mgr.14194) 101 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:57.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:56.524171+0000 mgr.smithi026.brymfp (mgr.14194) 101 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:59.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:01:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:01:58.524727+0000 mgr.smithi026.brymfp (mgr.14194) 102 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:01:59.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:01:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:01:58.524727+0000 mgr.smithi026.brymfp (mgr.14194) 102 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:01.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:00.525141+0000 mgr.smithi026.brymfp (mgr.14194) 103 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:01.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:01.154906+0000 mon.smithi026 (mon.0) 369 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:02:01.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:01.155769+0000 mon.smithi026 (mon.0) 370 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:01.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:00.525141+0000 mgr.smithi026.brymfp (mgr.14194) 103 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:01.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:01.154906+0000 mon.smithi026 (mon.0) 369 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:02:01.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:01.155769+0000 mon.smithi026 (mon.0) 370 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:02.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:02:01.156522+0000 mgr.smithi026.brymfp (mgr.14194) 104 : cephadm [INF] Deploying daemon osd.3 on smithi135 2024-05-09T00:02:02.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:02:01.156522+0000 mgr.smithi026.brymfp (mgr.14194) 104 : cephadm [INF] Deploying daemon osd.3 on smithi135 2024-05-09T00:02:03.813 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:02.525500+0000 mgr.smithi026.brymfp (mgr.14194) 105 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:03.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:02.525500+0000 mgr.smithi026.brymfp (mgr.14194) 105 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:05.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:04.525815+0000 mgr.smithi026.brymfp (mgr.14194) 106 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:05.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:04.525815+0000 mgr.smithi026.brymfp (mgr.14194) 106 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:07.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:06.512631+0000 mon.smithi026 (mon.0) 371 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:06.517441+0000 mon.smithi026 (mon.0) 372 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:06.526250+0000 mgr.smithi026.brymfp (mgr.14194) 107 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:07.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:06.512631+0000 mon.smithi026 (mon.0) 371 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:07.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:06.517441+0000 mon.smithi026 (mon.0) 372 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:07.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:06.526250+0000 mgr.smithi026.brymfp (mgr.14194) 107 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:09.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:08.526749+0000 mgr.smithi026.brymfp (mgr.14194) 108 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:09.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:08.526749+0000 mgr.smithi026.brymfp (mgr.14194) 108 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:10.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.016+0000 7f40e8ff9700 1 -- 172.21.15.135:0/1651365663 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f40e000f040 con 0x7f40d4061110 2024-05-09T00:02:10.011 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 3 on host 'smithi135' 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f40d4061110 msgr2=0x7f40d40635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f40d4061110 0x7f40d40635d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f40e0004da0 tx=0x7f40e000b040).stop 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 msgr2=0x7f40ec06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 0x7f40ec06c9d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f40dc004f10 tx=0x7f40dc009cb0).stop 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 shutdown_connections 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f40d4061110 0x7f40d40635d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40ec0f7800 0x7f40ec06c9d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 --2- 172.21.15.135:0/1651365663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40ec0f8aa0 0x7f40ec06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 >> 172.21.15.135:0/1651365663 conn(0x7f40ec0f2f80 msgr2=0x7f40ec0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:10.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 shutdown_connections 2024-05-09T00:02:10.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:10.018+0000 7f40f203c700 1 -- 172.21.15.135:0/1651365663 wait complete. 2024-05-09T00:02:10.775 DEBUG:teuthology.orchestra.run.smithi135:osd.3> sudo journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.3.service 2024-05-09T00:02:10.777 INFO:tasks.cephadm:Deploying osd.4 on smithi135 with /dev/vg_nvme/lv_3... 2024-05-09T00:02:10.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T00:02:10.809 INFO:journalctl@ceph.osd.3.smithi135.stdout:-- Logs begin at Wed 2024-05-08 23:38:18 UTC. -- 2024-05-09T00:02:11.317 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:10.016762+0000 mon.smithi026 (mon.0) 373 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:11.317 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:10.387357+0000 mon.smithi135 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:02:11.317 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:10.387790+0000 mon.smithi026 (mon.0) 374 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:02:11.317 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:10.527122+0000 mgr.smithi026.brymfp (mgr.14194) 109 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:11.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:10.016762+0000 mon.smithi026 (mon.0) 373 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:11.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:10.387357+0000 mon.smithi135 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:02:11.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:10.387790+0000 mon.smithi026 (mon.0) 374 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:02:11.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:10.527122+0000 mgr.smithi026.brymfp (mgr.14194) 109 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:12.378 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:02:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[49096]: debug 2024-05-09T00:02:12.027+0000 7ff22b4f9700 -1 osd.3 0 waiting for initial osdmap 2024-05-09T00:02:12.378 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:02:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[49096]: debug 2024-05-09T00:02:12.035+0000 7ff223c6d700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:02:12.379 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:11.023723+0000 mon.smithi026 (mon.0) 375 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T00:02:12.379 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:11.023790+0000 mon.smithi026 (mon.0) 376 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-05-09T00:02:12.379 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:11.024062+0000 mon.smithi026 (mon.0) 377 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:12.379 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:11.024877+0000 mon.smithi135 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:02:12.379 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:11.025211+0000 mon.smithi026 (mon.0) 378 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:02:12.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:11.023723+0000 mon.smithi026 (mon.0) 375 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T00:02:12.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:11.023790+0000 mon.smithi026 (mon.0) 376 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-05-09T00:02:12.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:11.024062+0000 mon.smithi026 (mon.0) 377 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:12.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:11.024877+0000 mon.smithi135 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:02:12.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:11.025211+0000 mon.smithi026 (mon.0) 378 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:02:13.280 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:12.025964+0000 mon.smithi026 (mon.0) 379 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-09T00:02:13.281 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:12.026136+0000 mon.smithi026 (mon.0) 380 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-05-09T00:02:13.281 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:12.026657+0000 mon.smithi026 (mon.0) 381 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:13.281 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:12.031720+0000 mon.smithi026 (mon.0) 382 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:13.281 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:12.527586+0000 mgr.smithi026.brymfp (mgr.14194) 110 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:13.281 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:13.027196+0000 mon.smithi026 (mon.0) 383 : cluster [INF] osd.3 [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] boot 2024-05-09T00:02:13.281 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:13.027262+0000 mon.smithi026 (mon.0) 384 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-05-09T00:02:13.281 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:13.027445+0000 mon.smithi026 (mon.0) 385 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:13.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:12.025964+0000 mon.smithi026 (mon.0) 379 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-09T00:02:13.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:12.026136+0000 mon.smithi026 (mon.0) 380 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-05-09T00:02:13.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:12.026657+0000 mon.smithi026 (mon.0) 381 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:13.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:12.031720+0000 mon.smithi026 (mon.0) 382 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:13.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:12.527586+0000 mgr.smithi026.brymfp (mgr.14194) 110 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-05-09T00:02:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:13.027196+0000 mon.smithi026 (mon.0) 383 : cluster [INF] osd.3 [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] boot 2024-05-09T00:02:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:13.027262+0000 mon.smithi026 (mon.0) 384 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-05-09T00:02:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:13.027445+0000 mon.smithi026 (mon.0) 385 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:13.921 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T00:02:13.921 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T00:02:13.921 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-09T00:02:13.921 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-09T00:02:13.921 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109767 s, 955 MB/s 2024-05-09T00:02:13.921 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-09T00:02:14.354 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:11.410104+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:02:14.354 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:11.410165+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:02:14.354 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:13.098609+0000 mon.smithi026 (mon.0) 386 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-05-09T00:02:14.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:11.410104+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:02:14.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:11.410165+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:02:14.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:13.098609+0000 mon.smithi026 (mon.0) 386 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-05-09T00:02:14.713 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-05-09T00:02:15.346 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:14.102735+0000 mon.smithi026 (mon.0) 387 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-05-09T00:02:15.347 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:14.233047+0000 mon.smithi026 (mon.0) 388 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:15.347 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:14.528063+0000 mgr.smithi026.brymfp (mgr.14194) 111 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:15.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:14.102735+0000 mon.smithi026 (mon.0) 387 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-05-09T00:02:15.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:14.233047+0000 mon.smithi026 (mon.0) 388 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:15.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:14.528063+0000 mgr.smithi026.brymfp (mgr.14194) 111 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.844+0000 7f31efd55700 1 -- 172.21.15.135:0/1910146406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 msgr2=0x7f31e80f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.844+0000 7f31efd55700 1 --2- 172.21.15.135:0/1910146406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 0x7f31e80f7ac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f31e40047f0 tx=0x7f31e4009cb0).stop 2024-05-09T00:02:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.844+0000 7f31efd55700 1 -- 172.21.15.135:0/1910146406 shutdown_connections 2024-05-09T00:02:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.844+0000 7f31efd55700 1 --2- 172.21.15.135:0/1910146406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 0x7f31e80f7ac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.844+0000 7f31efd55700 1 --2- 172.21.15.135:0/1910146406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31e80f6cc0 0x7f31e80f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.844+0000 7f31efd55700 1 -- 172.21.15.135:0/1910146406 >> 172.21.15.135:0/1910146406 conn(0x7f31e80f15d0 msgr2=0x7f31e80f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.844+0000 7f31efd55700 1 -- 172.21.15.135:0/1910146406 shutdown_connections 2024-05-09T00:02:17.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.844+0000 7f31efd55700 1 -- 172.21.15.135:0/1910146406 wait complete. 2024-05-09T00:02:17.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31efd55700 1 Processor -- start 2024-05-09T00:02:17.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31efd55700 1 -- start start 2024-05-09T00:02:17.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31efd55700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31e80f6cc0 0x7f31e80f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:02:17.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31efd55700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 0x7f31e810f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:02:17.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31efd55700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8108b40 con 0x7f31e80f6cc0 2024-05-09T00:02:17.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31efd55700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e810f650 con 0x7f31e80f7660 2024-05-09T00:02:17.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31ed2f0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 0x7f31e810f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31ed2f0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 0x7f31e810f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41108/0 (socket says 172.21.15.135:41108) 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31ed2f0700 1 -- 172.21.15.135:0/453623539 learned_addr learned my addr 172.21.15.135:0/453623539 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31edaf1700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31e80f6cc0 0x7f31e80f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31ed2f0700 1 -- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31e80f6cc0 msgr2=0x7f31e80f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.845+0000 7f31ed2f0700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31e80f6cc0 0x7f31e80f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.846+0000 7f31ed2f0700 1 -- 172.21.15.135:0/453623539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4005040 con 0x7f31e80f7660 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.846+0000 7f31ed2f0700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 0x7f31e810f160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f31e4013510 tx=0x7f31e4009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.846+0000 7f31deffd700 1 -- 172.21.15.135:0/453623539 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31e400e030 con 0x7f31e80f7660 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.846+0000 7f31deffd700 1 -- 172.21.15.135:0/453623539 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f31e4007e90 con 0x7f31e80f7660 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.846+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e810f790 con 0x7f31e80f7660 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.846+0000 7f31deffd700 1 -- 172.21.15.135:0/453623539 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31e4018070 con 0x7f31e80f7660 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.846+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e810fc40 con 0x7f31e80f7660 2024-05-09T00:02:17.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.847+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e80feec0 con 0x7f31e80f7660 2024-05-09T00:02:17.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.847+0000 7f31deffd700 1 -- 172.21.15.135:0/453623539 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f31e401da20 con 0x7f31e80f7660 2024-05-09T00:02:17.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.847+0000 7f31deffd700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f31d4061180 0x7f31d4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:02:17.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.848+0000 7f31deffd700 1 -- 172.21.15.135:0/453623539 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3671+0+0 (secure 0 0 0) 0x7f31e407d710 con 0x7f31e80f7660 2024-05-09T00:02:17.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.848+0000 7f31edaf1700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f31d4061180 0x7f31d4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:02:17.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.848+0000 7f31edaf1700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f31d4061180 0x7f31d4063640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f31e805fa50 tx=0x7f31d8009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:17.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:17.852+0000 7f31deffd700 1 -- 172.21.15.135:0/453623539 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f31e4051dc0 con 0x7f31e80f7660 2024-05-09T00:02:17.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:16.528452+0000 mgr.smithi026.brymfp (mgr.14194) 112 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:17.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:16.528452+0000 mgr.smithi026.brymfp (mgr.14194) 112 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:18.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:18.022+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f31e8059120 con 0x7f31d4061180 2024-05-09T00:02:18.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:18.027100+0000 mon.smithi026 (mon.0) 389 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:02:18.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:18.029570+0000 mon.smithi026 (mon.0) 390 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:02:18.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:18.030383+0000 mon.smithi026 (mon.0) 391 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:18.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:18.027100+0000 mon.smithi026 (mon.0) 389 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:02:18.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:18.029570+0000 mon.smithi026 (mon.0) 390 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:02:18.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:18.030383+0000 mon.smithi026 (mon.0) 391 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:19.845 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:18.024604+0000 mgr.smithi026.brymfp (mgr.14194) 113 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:19.845 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:18.528927+0000 mgr.smithi026.brymfp (mgr.14194) 114 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:19.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:18.024604+0000 mgr.smithi026.brymfp (mgr.14194) 113 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:19.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:18.528927+0000 mgr.smithi026.brymfp (mgr.14194) 114 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:22.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:20.529417+0000 mgr.smithi026.brymfp (mgr.14194) 115 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:22.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:02:20.681934+0000 mgr.smithi026.brymfp (mgr.14194) 116 : cephadm [INF] Detected new or changed devices on smithi135 2024-05-09T00:02:22.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:20.686711+0000 mon.smithi026 (mon.0) 392 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:22.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:20.981464+0000 mon.smithi026 (mon.0) 393 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:02:22.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:02:20.982194+0000 mgr.smithi026.brymfp (mgr.14194) 117 : cephadm [INF] Adjusting osd_memory_target on smithi135 to 14946M 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:20.986578+0000 mon.smithi026 (mon.0) 394 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:20.987644+0000 mon.smithi026 (mon.0) 395 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:20.988576+0000 mon.smithi026 (mon.0) 396 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:20.993108+0000 mon.smithi026 (mon.0) 397 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:20.998713+0000 mon.smithi026 (mon.0) 398 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:21.303052+0000 mon.smithi026 (mon.0) 399 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:21.303705+0000 mon.smithi026 (mon.0) 400 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:21.307803+0000 mon.smithi026 (mon.0) 401 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:21.501764+0000 mon.smithi135 (mon.1) 6 : audit [INF] from='client.? 172.21.15.135:0/3304410882' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90bd084e-4ae6-4fa0-9a79-221a26a1183c"}]: dispatch 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:21.502246+0000 mon.smithi026 (mon.0) 402 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90bd084e-4ae6-4fa0-9a79-221a26a1183c"}]: dispatch 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:21.505860+0000 mon.smithi026 (mon.0) 403 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90bd084e-4ae6-4fa0-9a79-221a26a1183c"}]': finished 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:21.505912+0000 mon.smithi026 (mon.0) 404 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-05-09T00:02:22.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:21.506032+0000 mon.smithi026 (mon.0) 405 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:20.529417+0000 mgr.smithi026.brymfp (mgr.14194) 115 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:02:20.681934+0000 mgr.smithi026.brymfp (mgr.14194) 116 : cephadm [INF] Detected new or changed devices on smithi135 2024-05-09T00:02:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:20.686711+0000 mon.smithi026 (mon.0) 392 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:20.981464+0000 mon.smithi026 (mon.0) 393 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:02:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:02:20.982194+0000 mgr.smithi026.brymfp (mgr.14194) 117 : cephadm [INF] Adjusting osd_memory_target on smithi135 to 14946M 2024-05-09T00:02:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:20.986578+0000 mon.smithi026 (mon.0) 394 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:20.987644+0000 mon.smithi026 (mon.0) 395 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:20.988576+0000 mon.smithi026 (mon.0) 396 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:20.993108+0000 mon.smithi026 (mon.0) 397 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:20.998713+0000 mon.smithi026 (mon.0) 398 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:21.303052+0000 mon.smithi026 (mon.0) 399 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:21.303705+0000 mon.smithi026 (mon.0) 400 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:21.307803+0000 mon.smithi026 (mon.0) 401 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:21.501764+0000 mon.smithi135 (mon.1) 6 : audit [INF] from='client.? 172.21.15.135:0/3304410882' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90bd084e-4ae6-4fa0-9a79-221a26a1183c"}]: dispatch 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:21.502246+0000 mon.smithi026 (mon.0) 402 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90bd084e-4ae6-4fa0-9a79-221a26a1183c"}]: dispatch 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:21.505860+0000 mon.smithi026 (mon.0) 403 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90bd084e-4ae6-4fa0-9a79-221a26a1183c"}]': finished 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:21.505912+0000 mon.smithi026 (mon.0) 404 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-05-09T00:02:22.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:21.506032+0000 mon.smithi026 (mon.0) 405 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:23.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:22.152491+0000 mon.smithi135 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.135:0/2476343896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:02:23.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:22.152491+0000 mon.smithi135 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.135:0/2476343896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:02:24.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:22.529834+0000 mgr.smithi026.brymfp (mgr.14194) 118 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:24.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:22.529834+0000 mgr.smithi026.brymfp (mgr.14194) 118 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:26.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:24.530178+0000 mgr.smithi026.brymfp (mgr.14194) 119 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:26.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:24.530178+0000 mgr.smithi026.brymfp (mgr.14194) 119 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:27.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:26.530552+0000 mgr.smithi026.brymfp (mgr.14194) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:28.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:26.530552+0000 mgr.smithi026.brymfp (mgr.14194) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:30.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:28.530960+0000 mgr.smithi026.brymfp (mgr.14194) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:30.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:28.530960+0000 mgr.smithi026.brymfp (mgr.14194) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:30.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:29.730706+0000 mon.smithi026 (mon.0) 406 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:02:30.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:29.731613+0000 mon.smithi026 (mon.0) 407 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:30.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:02:29.732366+0000 mgr.smithi026.brymfp (mgr.14194) 122 : cephadm [INF] Deploying daemon osd.4 on smithi135 2024-05-09T00:02:31.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:29.730706+0000 mon.smithi026 (mon.0) 406 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:02:31.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:29.731613+0000 mon.smithi026 (mon.0) 407 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:31.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:02:29.732366+0000 mgr.smithi026.brymfp (mgr.14194) 122 : cephadm [INF] Deploying daemon osd.4 on smithi135 2024-05-09T00:02:32.071 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:30.531469+0000 mgr.smithi026.brymfp (mgr.14194) 123 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:32.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:30.531469+0000 mgr.smithi026.brymfp (mgr.14194) 123 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:33.975 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:32.531826+0000 mgr.smithi026.brymfp (mgr.14194) 124 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:34.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:32.531826+0000 mgr.smithi026.brymfp (mgr.14194) 124 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:35.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:34.532240+0000 mgr.smithi026.brymfp (mgr.14194) 125 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:35.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:35.643736+0000 mon.smithi026 (mon.0) 408 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:35.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:35.662991+0000 mon.smithi026 (mon.0) 409 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:36.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:34.532240+0000 mgr.smithi026.brymfp (mgr.14194) 125 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:36.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:35.643736+0000 mon.smithi026 (mon.0) 408 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:36.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:35.662991+0000 mon.smithi026 (mon.0) 409 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:37.964 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:36.532658+0000 mgr.smithi026.brymfp (mgr.14194) 126 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:38.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:36.532658+0000 mgr.smithi026.brymfp (mgr.14194) 126 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:39.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.623+0000 7f31deffd700 1 -- 172.21.15.135:0/453623539 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f31e8059120 con 0x7f31d4061180 2024-05-09T00:02:39.617 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 4 on host 'smithi135' 2024-05-09T00:02:39.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f31d4061180 msgr2=0x7f31d4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:39.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f31d4061180 0x7f31d4063640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f31e805fa50 tx=0x7f31d8009040).stop 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 msgr2=0x7f31e810f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 0x7f31e810f160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f31e4013510 tx=0x7f31e4009cb0).stop 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 shutdown_connections 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f31d4061180 0x7f31d4063640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31e80f6cc0 0x7f31e80f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 --2- 172.21.15.135:0/453623539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31e80f7660 0x7f31e810f160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 >> 172.21.15.135:0/453623539 conn(0x7f31e80f15d0 msgr2=0x7f31e80fb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 shutdown_connections 2024-05-09T00:02:39.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:39.625+0000 7f31efd55700 1 -- 172.21.15.135:0/453623539 wait complete. 2024-05-09T00:02:39.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:38.533111+0000 mgr.smithi026.brymfp (mgr.14194) 127 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:39.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:39.512005+0000 mon.smithi135 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:02:39.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:39.512365+0000 mon.smithi026 (mon.0) 410 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:02:39.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:39.622095+0000 mon.smithi026 (mon.0) 411 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:40.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:38.533111+0000 mgr.smithi026.brymfp (mgr.14194) 127 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:40.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:39.512005+0000 mon.smithi135 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:02:40.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:39.512365+0000 mon.smithi026 (mon.0) 410 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:02:40.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:39.622095+0000 mon.smithi026 (mon.0) 411 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:40.388 DEBUG:teuthology.orchestra.run.smithi135:osd.4> sudo journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.4.service 2024-05-09T00:02:40.390 INFO:tasks.cephadm:Deploying osd.5 on smithi135 with /dev/vg_nvme/lv_2... 2024-05-09T00:02:40.391 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T00:02:40.420 INFO:journalctl@ceph.osd.4.smithi135.stdout:-- Logs begin at Wed 2024-05-08 23:38:18 UTC. -- 2024-05-09T00:02:41.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:39.728201+0000 mon.smithi026 (mon.0) 412 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T00:02:41.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:39.728290+0000 mon.smithi026 (mon.0) 413 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-05-09T00:02:41.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:39.728480+0000 mon.smithi026 (mon.0) 414 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:41.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:39.728833+0000 mon.smithi135 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:02:41.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:39.729253+0000 mon.smithi026 (mon.0) 415 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:02:41.146 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:02:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[54512]: debug 2024-05-09T00:02:40.735+0000 7fd095685700 -1 osd.4 0 waiting for initial osdmap 2024-05-09T00:02:41.146 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:02:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[54512]: debug 2024-05-09T00:02:40.743+0000 7fd090dff700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:02:41.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:39.728201+0000 mon.smithi026 (mon.0) 412 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T00:02:41.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:39.728290+0000 mon.smithi026 (mon.0) 413 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-05-09T00:02:41.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:39.728480+0000 mon.smithi026 (mon.0) 414 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:41.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:39.728833+0000 mon.smithi135 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:02:41.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:39.729253+0000 mon.smithi026 (mon.0) 415 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:02:41.866 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:40.533466+0000 mgr.smithi026.brymfp (mgr.14194) 128 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:41.867 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:40.730374+0000 mon.smithi026 (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-09T00:02:41.867 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:40.730501+0000 mon.smithi026 (mon.0) 417 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-05-09T00:02:41.867 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:40.730910+0000 mon.smithi026 (mon.0) 418 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:41.867 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:40.735078+0000 mon.smithi026 (mon.0) 419 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:42.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:40.533466+0000 mgr.smithi026.brymfp (mgr.14194) 128 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T00:02:42.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:40.730374+0000 mon.smithi026 (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-09T00:02:42.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:40.730501+0000 mon.smithi026 (mon.0) 417 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-05-09T00:02:42.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:40.730910+0000 mon.smithi026 (mon.0) 418 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:42.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:40.735078+0000 mon.smithi026 (mon.0) 419 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:42.992 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T00:02:42.992 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T00:02:42.992 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-05-09T00:02:42.992 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-05-09T00:02:42.993 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111591 s, 940 MB/s 2024-05-09T00:02:42.993 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-05-09T00:02:43.032 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:40.468637+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:02:43.032 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:40.468720+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:02:43.032 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:41.731997+0000 mon.smithi026 (mon.0) 420 : cluster [INF] osd.4 [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] boot 2024-05-09T00:02:43.032 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:41.732034+0000 mon.smithi026 (mon.0) 421 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-05-09T00:02:43.032 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:41.732167+0000 mon.smithi026 (mon.0) 422 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:43.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:40.468637+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:02:43.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:40.468720+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:02:43.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:41.731997+0000 mon.smithi026 (mon.0) 420 : cluster [INF] osd.4 [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] boot 2024-05-09T00:02:43.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:41.732034+0000 mon.smithi026 (mon.0) 421 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-05-09T00:02:43.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:41.732167+0000 mon.smithi026 (mon.0) 422 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:43.966 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:42.533764+0000 mgr.smithi026.brymfp (mgr.14194) 129 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:43.966 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:42.741306+0000 mon.smithi026 (mon.0) 423 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-05-09T00:02:43.966 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:43.633352+0000 mon.smithi026 (mon.0) 424 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:43.983 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-05-09T00:02:44.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:42.533764+0000 mgr.smithi026.brymfp (mgr.14194) 129 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:44.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:42.741306+0000 mon.smithi026 (mon.0) 423 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-05-09T00:02:44.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:43.633352+0000 mon.smithi026 (mon.0) 424 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:44.534154+0000 mgr.smithi026.brymfp (mgr.14194) 130 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:46.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:44.534154+0000 mgr.smithi026.brymfp (mgr.14194) 130 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:46.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.742+0000 7fe829676700 1 -- 172.21.15.135:0/3624387572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 msgr2=0x7fe8240fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.742+0000 7fe829676700 1 --2- 172.21.15.135:0/3624387572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 0x7fe8240fcda0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe8180047f0 tx=0x7fe818009cb0).stop 2024-05-09T00:02:46.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.742+0000 7fe829676700 1 -- 172.21.15.135:0/3624387572 shutdown_connections 2024-05-09T00:02:46.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.742+0000 7fe829676700 1 --2- 172.21.15.135:0/3624387572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 0x7fe8240fcda0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:46.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.742+0000 7fe829676700 1 --2- 172.21.15.135:0/3624387572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe824061220 0x7fe8240fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:46.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.742+0000 7fe829676700 1 -- 172.21.15.135:0/3624387572 >> 172.21.15.135:0/3624387572 conn(0x7fe8240f1e50 msgr2=0x7fe8240f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:46.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.742+0000 7fe829676700 1 -- 172.21.15.135:0/3624387572 shutdown_connections 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.742+0000 7fe829676700 1 -- 172.21.15.135:0/3624387572 wait complete. 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.743+0000 7fe829676700 1 Processor -- start 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.743+0000 7fe829676700 1 -- start start 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.743+0000 7fe829676700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe824061220 0x7fe824107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.743+0000 7fe829676700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 0x7fe824108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.743+0000 7fe829676700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe824108a00 con 0x7fe824061220 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.743+0000 7fe829676700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe824108b40 con 0x7fe8240fa9b0 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.743+0000 7fe8227fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 0x7fe824108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.743+0000 7fe8227fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 0x7fe824108450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44194/0 (socket says 172.21.15.135:44194) 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe8227fc700 1 -- 172.21.15.135:0/1169693476 learned_addr learned my addr 172.21.15.135:0/1169693476 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe822ffd700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe824061220 0x7fe824107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe8227fc700 1 -- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe824061220 msgr2=0x7fe824107f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe8227fc700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe824061220 0x7fe824107f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:02:46.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe8227fc700 1 -- 172.21.15.135:0/1169693476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818005040 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe8227fc700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 0x7fe824108450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe818009eb0 tx=0x7fe818009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe80bfff700 1 -- 172.21.15.135:0/1169693476 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe81800e030 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe80bfff700 1 -- 172.21.15.135:0/1169693476 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe818007e90 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82410d580 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe80bfff700 1 -- 172.21.15.135:0/1169693476 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe818018070 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.744+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82410dac0 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.745+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8240fffb0 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.746+0000 7fe80bfff700 1 -- 172.21.15.135:0/1169693476 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fe81801d420 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.746+0000 7fe80bfff700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061110 0x7fe80c0635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.746+0000 7fe822ffd700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061110 0x7fe80c0635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.747+0000 7fe80bfff700 1 -- 172.21.15.135:0/1169693476 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4103+0+0 (secure 0 0 0) 0x7fe818051ee0 con 0x7fe8240fa9b0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.747+0000 7fe822ffd700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061110 0x7fe80c0635d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe814004e60 tx=0x7fe81400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.752+0000 7fe80bfff700 1 -- 172.21.15.135:0/1169693476 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe818051cb0 con 0x7fe8240fa9b0 2024-05-09T00:02:46.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:02:46.930+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe824059120 con 0x7fe80c061110 2024-05-09T00:02:47.965 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:46.534603+0000 mgr.smithi026.brymfp (mgr.14194) 131 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:47.965 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:46.931617+0000 mgr.smithi026.brymfp (mgr.14194) 132 : audit [DBG] from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:47.965 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:46.934033+0000 mon.smithi026 (mon.0) 425 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:02:47.965 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:46.936464+0000 mon.smithi026 (mon.0) 426 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:02:47.965 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:46.937210+0000 mon.smithi026 (mon.0) 427 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:48.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:46.534603+0000 mgr.smithi026.brymfp (mgr.14194) 131 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:48.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:46.931617+0000 mgr.smithi026.brymfp (mgr.14194) 132 : audit [DBG] from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:48.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:46.934033+0000 mon.smithi026 (mon.0) 425 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:02:48.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:46.936464+0000 mon.smithi026 (mon.0) 426 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:02:48.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:46.937210+0000 mon.smithi026 (mon.0) 427 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:02:47.988888+0000 mgr.smithi026.brymfp (mgr.14194) 133 : cephadm [INF] Detected new or changed devices on smithi135 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:47.993888+0000 mon.smithi026 (mon.0) 428 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:47.994907+0000 mon.smithi026 (mon.0) 429 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:47.995805+0000 mon.smithi026 (mon.0) 430 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:02:47.996466+0000 mgr.smithi026.brymfp (mgr.14194) 134 : cephadm [INF] Adjusting osd_memory_target on smithi135 to 7473M 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:48.000160+0000 mon.smithi026 (mon.0) 431 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:48.001128+0000 mon.smithi026 (mon.0) 432 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:48.001937+0000 mon.smithi026 (mon.0) 433 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:48.006089+0000 mon.smithi026 (mon.0) 434 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:49.109 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:48.010594+0000 mon.smithi026 (mon.0) 435 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:49.110 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:48.012124+0000 mon.smithi026 (mon.0) 436 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:49.110 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:48.012871+0000 mon.smithi026 (mon.0) 437 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:49.110 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:48.016887+0000 mon.smithi026 (mon.0) 438 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:49.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:02:47.988888+0000 mgr.smithi026.brymfp (mgr.14194) 133 : cephadm [INF] Detected new or changed devices on smithi135 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:47.993888+0000 mon.smithi026 (mon.0) 428 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:47.994907+0000 mon.smithi026 (mon.0) 429 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:47.995805+0000 mon.smithi026 (mon.0) 430 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:02:47.996466+0000 mgr.smithi026.brymfp (mgr.14194) 134 : cephadm [INF] Adjusting osd_memory_target on smithi135 to 7473M 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:48.000160+0000 mon.smithi026 (mon.0) 431 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:48.001128+0000 mon.smithi026 (mon.0) 432 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:48.001937+0000 mon.smithi026 (mon.0) 433 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:48.006089+0000 mon.smithi026 (mon.0) 434 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:48.010594+0000 mon.smithi026 (mon.0) 435 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:48.012124+0000 mon.smithi026 (mon.0) 436 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:48.012871+0000 mon.smithi026 (mon.0) 437 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:48.016887+0000 mon.smithi026 (mon.0) 438 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:02:50.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:48.535103+0000 mgr.smithi026.brymfp (mgr.14194) 135 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:50.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:49.883900+0000 mon.smithi135 (mon.1) 10 : audit [INF] from='client.? 172.21.15.135:0/1396970896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc"}]: dispatch 2024-05-09T00:02:50.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:49.884454+0000 mon.smithi026 (mon.0) 439 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc"}]: dispatch 2024-05-09T00:02:50.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:49.889140+0000 mon.smithi026 (mon.0) 440 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc"}]': finished 2024-05-09T00:02:50.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:49.889197+0000 mon.smithi026 (mon.0) 441 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-05-09T00:02:50.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:49.889318+0000 mon.smithi026 (mon.0) 442 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:02:50.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:48.535103+0000 mgr.smithi026.brymfp (mgr.14194) 135 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:50.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:49.883900+0000 mon.smithi135 (mon.1) 10 : audit [INF] from='client.? 172.21.15.135:0/1396970896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc"}]: dispatch 2024-05-09T00:02:50.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:49.884454+0000 mon.smithi026 (mon.0) 439 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc"}]: dispatch 2024-05-09T00:02:50.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:49.889140+0000 mon.smithi026 (mon.0) 440 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc"}]': finished 2024-05-09T00:02:50.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:49.889197+0000 mon.smithi026 (mon.0) 441 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-05-09T00:02:50.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:49.889318+0000 mon.smithi026 (mon.0) 442 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:02:51.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:50.502279+0000 mon.smithi135 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.135:0/3995544335' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:02:51.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:50.502279+0000 mon.smithi135 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.135:0/3995544335' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:02:52.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:50.535424+0000 mgr.smithi026.brymfp (mgr.14194) 136 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:52.395 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:50.535424+0000 mgr.smithi026.brymfp (mgr.14194) 136 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:54.090 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:52.535912+0000 mgr.smithi026.brymfp (mgr.14194) 137 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:54.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:52.535912+0000 mgr.smithi026.brymfp (mgr.14194) 137 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:56.027 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:54.536316+0000 mgr.smithi026.brymfp (mgr.14194) 138 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:56.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:54.536316+0000 mgr.smithi026.brymfp (mgr.14194) 138 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:58.329 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:56.536712+0000 mgr.smithi026.brymfp (mgr.14194) 139 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:58.329 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:57.039791+0000 mon.smithi026 (mon.0) 443 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:02:58.329 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:02:57.040605+0000 mon.smithi026 (mon.0) 444 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:58.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:56.536712+0000 mgr.smithi026.brymfp (mgr.14194) 139 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:02:58.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:57.039791+0000 mon.smithi026 (mon.0) 443 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:02:58.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:02:57.040605+0000 mon.smithi026 (mon.0) 444 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:59.265 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:02:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:02:57.041322+0000 mgr.smithi026.brymfp (mgr.14194) 140 : cephadm [INF] Deploying daemon osd.5 on smithi135 2024-05-09T00:02:59.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:02:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:02:57.041322+0000 mgr.smithi026.brymfp (mgr.14194) 140 : cephadm [INF] Deploying daemon osd.5 on smithi135 2024-05-09T00:03:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:02:58.537239+0000 mgr.smithi026.brymfp (mgr.14194) 141 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:00.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:02:58.537239+0000 mgr.smithi026.brymfp (mgr.14194) 141 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:01.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:00.537646+0000 mgr.smithi026.brymfp (mgr.14194) 142 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:01.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:00.537646+0000 mgr.smithi026.brymfp (mgr.14194) 142 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:03.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:01.965744+0000 mon.smithi026 (mon.0) 445 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:03.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:01.971306+0000 mon.smithi026 (mon.0) 446 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:03.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:01.965744+0000 mon.smithi026 (mon.0) 445 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:03.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:01.971306+0000 mon.smithi026 (mon.0) 446 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:04.047 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:02.537993+0000 mgr.smithi026.brymfp (mgr.14194) 143 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:04.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:02.537993+0000 mgr.smithi026.brymfp (mgr.14194) 143 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:05.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.622+0000 7fe80bfff700 1 -- 172.21.15.135:0/1169693476 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe824059120 con 0x7fe80c061110 2024-05-09T00:03:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 5 on host 'smithi135' 2024-05-09T00:03:05.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061110 msgr2=0x7fe80c0635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061110 0x7fe80c0635d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe814004e60 tx=0x7fe81400b040).stop 2024-05-09T00:03:05.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 msgr2=0x7fe824108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 0x7fe824108450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe818009eb0 tx=0x7fe818009cb0).stop 2024-05-09T00:03:05.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 shutdown_connections 2024-05-09T00:03:05.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061110 0x7fe80c0635d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:05.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe824061220 0x7fe824107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:05.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 --2- 172.21.15.135:0/1169693476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8240fa9b0 0x7fe824108450 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:05.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 >> 172.21.15.135:0/1169693476 conn(0x7fe8240f1e50 msgr2=0x7fe8240f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:05.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 shutdown_connections 2024-05-09T00:03:05.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:05.624+0000 7fe829676700 1 -- 172.21.15.135:0/1169693476 wait complete. 2024-05-09T00:03:06.123 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:04.538485+0000 mgr.smithi026.brymfp (mgr.14194) 144 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:06.123 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:05.622346+0000 mon.smithi026 (mon.0) 447 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:06.123 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:05.876338+0000 mon.smithi135 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:03:06.123 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:05.876823+0000 mon.smithi026 (mon.0) 448 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:03:06.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:04.538485+0000 mgr.smithi026.brymfp (mgr.14194) 144 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:06.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:05.622346+0000 mon.smithi026 (mon.0) 447 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:06.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:05.876338+0000 mon.smithi135 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:03:06.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:05.876823+0000 mon.smithi026 (mon.0) 448 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:03:06.895 DEBUG:teuthology.orchestra.run.smithi135:osd.5> sudo journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.5.service 2024-05-09T00:03:06.898 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-05-09T00:03:06.898 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T00:03:06.930 INFO:journalctl@ceph.osd.5.smithi135.stdout:-- Logs begin at Wed 2024-05-08 23:38:18 UTC. -- 2024-05-09T00:03:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:06.539006+0000 mgr.smithi026.brymfp (mgr.14194) 145 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:06.624364+0000 mon.smithi026 (mon.0) 449 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T00:03:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:06.624494+0000 mon.smithi026 (mon.0) 450 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-05-09T00:03:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:06.624626+0000 mon.smithi026 (mon.0) 451 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:06.627014+0000 mon.smithi135 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:03:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:06.627512+0000 mon.smithi026 (mon.0) 452 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:03:07.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:07.010506+0000 mon.smithi026 (mon.0) 453 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:07.896 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[59897]: debug 2024-05-09T00:03:07.629+0000 7fbf2555a700 -1 osd.5 0 waiting for initial osdmap 2024-05-09T00:03:07.896 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[59897]: debug 2024-05-09T00:03:07.637+0000 7fbf1e4cf700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:03:07.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:06.539006+0000 mgr.smithi026.brymfp (mgr.14194) 145 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:07.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:06.624364+0000 mon.smithi026 (mon.0) 449 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T00:03:07.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:06.624494+0000 mon.smithi026 (mon.0) 450 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-05-09T00:03:07.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:06.624626+0000 mon.smithi026 (mon.0) 451 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:07.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:06.627014+0000 mon.smithi135 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:03:07.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:06.627512+0000 mon.smithi026 (mon.0) 452 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:03:07.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:07.010506+0000 mon.smithi026 (mon.0) 453 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:08.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:07.625360+0000 mon.smithi026 (mon.0) 454 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-09T00:03:08.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:07.625464+0000 mon.smithi026 (mon.0) 455 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-05-09T00:03:08.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:07.625795+0000 mon.smithi026 (mon.0) 456 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:08.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:07.628902+0000 mon.smithi026 (mon.0) 457 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:08.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:07.625360+0000 mon.smithi026 (mon.0) 454 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-05-09T00:03:08.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:07.625464+0000 mon.smithi026 (mon.0) 455 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-05-09T00:03:08.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:07.625795+0000 mon.smithi026 (mon.0) 456 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:08.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:07.628902+0000 mon.smithi026 (mon.0) 457 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.284+0000 7f36d93aa700 1 -- 172.21.15.26:0/1843087613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 msgr2=0x7f36d40fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.284+0000 7f36d93aa700 1 --2- 172.21.15.26:0/1843087613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 0x7f36d40fa4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f36c40047f0 tx=0x7f36c4009cb0).stop 2024-05-09T00:03:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.284+0000 7f36d93aa700 1 -- 172.21.15.26:0/1843087613 shutdown_connections 2024-05-09T00:03:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.284+0000 7f36d93aa700 1 --2- 172.21.15.26:0/1843087613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d40fa9b0 0x7f36d40fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.284+0000 7f36d93aa700 1 --2- 172.21.15.26:0/1843087613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 0x7f36d40fa4c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.284+0000 7f36d93aa700 1 -- 172.21.15.26:0/1843087613 >> 172.21.15.26:0/1843087613 conn(0x7f36d40f1ee0 msgr2=0x7f36d40f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.285+0000 7f36d93aa700 1 -- 172.21.15.26:0/1843087613 shutdown_connections 2024-05-09T00:03:09.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.285+0000 7f36d93aa700 1 -- 172.21.15.26:0/1843087613 wait complete. 2024-05-09T00:03:09.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.285+0000 7f36d93aa700 1 Processor -- start 2024-05-09T00:03:09.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d93aa700 1 -- start start 2024-05-09T00:03:09.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d93aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 0x7f36d4108120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d93aa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d40fa9b0 0x7f36d4108610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d93aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4108bc0 con 0x7f36d4061730 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d93aa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4108d00 con 0x7f36d40fa9b0 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 0x7f36d4108120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 0x7f36d4108120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59176/0 (socket says 172.21.15.26:59176) 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d2ffd700 1 -- 172.21.15.26:0/307796829 learned_addr learned my addr 172.21.15.26:0/307796829 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d27fc700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d40fa9b0 0x7f36d4108610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d2ffd700 1 -- 172.21.15.26:0/307796829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d40fa9b0 msgr2=0x7f36d4108610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d2ffd700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d40fa9b0 0x7f36d4108610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d2ffd700 1 -- 172.21.15.26:0/307796829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c4005040 con 0x7f36d4061730 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.286+0000 7f36d2ffd700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 0x7f36d4108120 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f36c4009380 tx=0x7f36c4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:09.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.287+0000 7f36bbfff700 1 -- 172.21.15.26:0/307796829 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36c4018070 con 0x7f36d4061730 2024-05-09T00:03:09.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.287+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d410d740 con 0x7f36d4061730 2024-05-09T00:03:09.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.287+0000 7f36bbfff700 1 -- 172.21.15.26:0/307796829 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f36c4007e90 con 0x7f36d4061730 2024-05-09T00:03:09.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.287+0000 7f36bbfff700 1 -- 172.21.15.26:0/307796829 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36c401de10 con 0x7f36d4061730 2024-05-09T00:03:09.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.287+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d410dd00 con 0x7f36d4061730 2024-05-09T00:03:09.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.288+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d40fffe0 con 0x7f36d4061730 2024-05-09T00:03:09.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.288+0000 7f36bbfff700 1 -- 172.21.15.26:0/307796829 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f36c401d420 con 0x7f36d4061730 2024-05-09T00:03:09.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.288+0000 7f36bbfff700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f36bc061180 0x7f36bc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:09.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.288+0000 7f36bbfff700 1 -- 172.21.15.26:0/307796829 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f36c407d160 con 0x7f36d4061730 2024-05-09T00:03:09.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.288+0000 7f36d27fc700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f36bc061180 0x7f36bc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:09.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.289+0000 7f36d27fc700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f36bc061180 0x7f36bc063640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f36c8004ee0 tx=0x7f36c800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:09.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.293+0000 7f36bbfff700 1 -- 172.21.15.26:0/307796829 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f36c4051430 con 0x7f36d4061730 2024-05-09T00:03:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.465+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f36d40598f0 con 0x7f36d4061730 2024-05-09T00:03:09.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.466+0000 7f36bbfff700 1 -- 172.21.15.26:0/307796829 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f36c4013e60 con 0x7f36d4061730 2024-05-09T00:03:09.459 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:03:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f36bc061180 msgr2=0x7f36bc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f36bc061180 0x7f36bc063640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f36c8004ee0 tx=0x7f36c800b040).stop 2024-05-09T00:03:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 msgr2=0x7f36d4108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 0x7f36d4108120 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f36c4009380 tx=0x7f36c4009cb0).stop 2024-05-09T00:03:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 shutdown_connections 2024-05-09T00:03:09.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f36bc061180 0x7f36bc063640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:09.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36d4061730 0x7f36d4108120 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:09.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 --2- 172.21.15.26:0/307796829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36d40fa9b0 0x7f36d4108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:09.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 >> 172.21.15.26:0/307796829 conn(0x7f36d40f1ee0 msgr2=0x7f36d40f42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:09.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 shutdown_connections 2024-05-09T00:03:09.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:09.467+0000 7f36d93aa700 1 -- 172.21.15.26:0/307796829 wait complete. 2024-05-09T00:03:09.825 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:06.902725+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:03:09.848 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:06.902795+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:03:09.848 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:08.539499+0000 mgr.smithi026.brymfp (mgr.14194) 146 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:09.849 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:08.630982+0000 mon.smithi026 (mon.0) 458 : cluster [INF] osd.5 [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] boot 2024-05-09T00:03:09.849 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:08.631032+0000 mon.smithi026 (mon.0) 459 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-05-09T00:03:09.849 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:08.631392+0000 mon.smithi026 (mon.0) 460 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:09.849 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:09.466373+0000 mon.smithi026 (mon.0) 461 : audit [DBG] from='client.? 172.21.15.26:0/307796829' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:03:09.893 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:06.902725+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-05-09T00:03:09.893 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:06.902795+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-05-09T00:03:09.894 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:08.539499+0000 mgr.smithi026.brymfp (mgr.14194) 146 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T00:03:09.894 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:08.630982+0000 mon.smithi026 (mon.0) 458 : cluster [INF] osd.5 [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] boot 2024-05-09T00:03:09.894 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:08.631032+0000 mon.smithi026 (mon.0) 459 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-05-09T00:03:09.894 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:08.631392+0000 mon.smithi026 (mon.0) 460 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:09.894 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:09.466373+0000 mon.smithi026 (mon.0) 461 : audit [DBG] from='client.? 172.21.15.26:0/307796829' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:03:10.245 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1715212988,"num_in_osds":6,"osd_in_since":1715212969,"num_remapped_pgs":0} 2024-05-09T00:03:10.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:03:10.522 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:09.638416+0000 mon.smithi026 (mon.0) 462 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.137737+0000 mon.smithi026 (mon.0) 463 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.138723+0000 mon.smithi026 (mon.0) 464 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.139502+0000 mon.smithi026 (mon.0) 465 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.140185+0000 mon.smithi026 (mon.0) 466 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.144051+0000 mon.smithi026 (mon.0) 467 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.144943+0000 mon.smithi026 (mon.0) 468 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.145571+0000 mon.smithi026 (mon.0) 469 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.149180+0000 mon.smithi026 (mon.0) 470 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.153026+0000 mon.smithi026 (mon.0) 471 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:10.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.154299+0000 mon.smithi026 (mon.0) 472 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:10.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.154945+0000 mon.smithi026 (mon.0) 473 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:10.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:10.158348+0000 mon.smithi026 (mon.0) 474 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:09.638416+0000 mon.smithi026 (mon.0) 462 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.137737+0000 mon.smithi026 (mon.0) 463 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.138723+0000 mon.smithi026 (mon.0) 464 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.139502+0000 mon.smithi026 (mon.0) 465 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.140185+0000 mon.smithi026 (mon.0) 466 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.144051+0000 mon.smithi026 (mon.0) 467 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.144943+0000 mon.smithi026 (mon.0) 468 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.145571+0000 mon.smithi026 (mon.0) 469 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.149180+0000 mon.smithi026 (mon.0) 470 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.153026+0000 mon.smithi026 (mon.0) 471 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:10.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.154299+0000 mon.smithi026 (mon.0) 472 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:10.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.154945+0000 mon.smithi026 (mon.0) 473 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:10.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:10.158348+0000 mon.smithi026 (mon.0) 474 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:03:11.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:03:10.132981+0000 mgr.smithi026.brymfp (mgr.14194) 147 : cephadm [INF] Detected new or changed devices on smithi135 2024-05-09T00:03:11.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:03:10.140696+0000 mgr.smithi026.brymfp (mgr.14194) 148 : cephadm [INF] Adjusting osd_memory_target on smithi135 to 4982M 2024-05-09T00:03:11.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:10.539767+0000 mgr.smithi026.brymfp (mgr.14194) 149 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:11.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:03:10.132981+0000 mgr.smithi026.brymfp (mgr.14194) 147 : cephadm [INF] Detected new or changed devices on smithi135 2024-05-09T00:03:11.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:03:10.140696+0000 mgr.smithi026.brymfp (mgr.14194) 148 : cephadm [INF] Adjusting osd_memory_target on smithi135 to 4982M 2024-05-09T00:03:11.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:10.539767+0000 mgr.smithi026.brymfp (mgr.14194) 149 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:12.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.277+0000 7f7953ad3700 1 -- 172.21.15.26:0/1553849783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f7b40 msgr2=0x7f794c0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.277+0000 7f7953ad3700 1 --2- 172.21.15.26:0/1553849783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f7b40 0x7f794c0f7fa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f793c0047f0 tx=0x7f793c009cb0).stop 2024-05-09T00:03:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.277+0000 7f7953ad3700 1 -- 172.21.15.26:0/1553849783 shutdown_connections 2024-05-09T00:03:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.277+0000 7f7953ad3700 1 --2- 172.21.15.26:0/1553849783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f7b40 0x7f794c0f7fa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.277+0000 7f7953ad3700 1 --2- 172.21.15.26:0/1553849783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0f68a0 0x7f794c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.277+0000 7f7953ad3700 1 -- 172.21.15.26:0/1553849783 >> 172.21.15.26:0/1553849783 conn(0x7f794c0f2020 msgr2=0x7f794c0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.277+0000 7f7953ad3700 1 -- 172.21.15.26:0/1553849783 shutdown_connections 2024-05-09T00:03:12.272 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.277+0000 7f7953ad3700 1 -- 172.21.15.26:0/1553849783 wait complete. 2024-05-09T00:03:12.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.278+0000 7f7953ad3700 1 Processor -- start 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.278+0000 7f7953ad3700 1 -- start start 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.278+0000 7f7953ad3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f68a0 0x7f794c10a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.278+0000 7f7953ad3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0f7b40 0x7f794c10a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f7953ad3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c10ae40 con 0x7f794c0f68a0 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f7953ad3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c10af80 con 0x7f794c0f7b40 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f795186f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f68a0 0x7f794c10a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f795186f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f68a0 0x7f794c10a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53520/0 (socket says 172.21.15.26:53520) 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f795186f700 1 -- 172.21.15.26:0/3515774779 learned_addr learned my addr 172.21.15.26:0/3515774779 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f795106e700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0f7b40 0x7f794c10a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f795186f700 1 -- 172.21.15.26:0/3515774779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0f7b40 msgr2=0x7f794c10a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:12.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f795186f700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0f7b40 0x7f794c10a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f795186f700 1 -- 172.21.15.26:0/3515774779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c005040 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f795186f700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f68a0 0x7f794c10a3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f794800e910 tx=0x7f794800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f7942f78700 1 -- 172.21.15.26:0/3515774779 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794800ee50 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c10fa20 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f7942f78700 1 -- 172.21.15.26:0/3515774779 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f794800f040 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f7942f78700 1 -- 172.21.15.26:0/3515774779 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794800c810 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.279+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c10ffe0 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.280+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0fbef0 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.281+0000 7f7942f78700 1 -- 172.21.15.26:0/3515774779 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f79480092b0 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.281+0000 7f7942f78700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7938061180 0x7f7938063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.281+0000 7f7942f78700 1 -- 172.21.15.26:0/3515774779 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f794807bfb0 con 0x7f794c0f68a0 2024-05-09T00:03:12.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.281+0000 7f795106e700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7938061180 0x7f7938063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:12.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.281+0000 7f795106e700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7938061180 0x7f7938063640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f793c009bc0 tx=0x7f793c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:12.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.285+0000 7f7942f78700 1 -- 172.21.15.26:0/3515774779 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7948049f60 con 0x7f794c0f68a0 2024-05-09T00:03:12.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.456+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f794c1109f0 con 0x7f794c0f68a0 2024-05-09T00:03:12.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.456+0000 7f7942f78700 1 -- 172.21.15.26:0/3515774779 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10928 (secure 0 0 0) 0x7f7948050280 con 0x7f794c0f68a0 2024-05-09T00:03:12.450 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:03:12.450 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":38,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:57:45.460652+0000","modified":"2024-05-09T00:03:09.632546+0000","last_up_change":"2024-05-09T00:03:08.626623+0000","last_in_change":"2024-05-09T00:02:49.885020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-05-09T00:01:47.922598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9e406a7e-5ec2-4f17-9308-640a499d3012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6803","nonce":4066121531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6805","nonce":4066121531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6809","nonce":4066121531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6807","nonce":4066121531}]},"public_addr":"172.21.15.26:6803/4066121531","cluster_addr":"172.21.15.26:6805/4066121531","heartbeat_back_addr":"172.21.15.26:6809/4066121531","heartbeat_front_addr":"172.21.15.26:6807/4066121531","state":["exists","up"]},{"osd":1,"uuid":"6f0691b3-17ca-4f90-88ce-13f4e115a987","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6811","nonce":100863172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6813","nonce":100863172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6817","nonce":100863172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6815","nonce":100863172}]},"public_addr":"172.21.15.26:6811/100863172","cluster_addr":"172.21.15.26:6813/100863172","heartbeat_back_addr":"172.21.15.26:6817/100863172","heartbeat_front_addr":"172.21.15.26:6815/100863172","state":["exists","up"]},{"osd":2,"uuid":"3eaa1376-f58f-4e84-970a-f7805331d339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6819","nonce":1690203303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6821","nonce":1690203303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6825","nonce":1690203303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6823","nonce":1690203303}]},"public_addr":"172.21.15.26:6819/1690203303","cluster_addr":"172.21.15.26:6821/1690203303","heartbeat_back_addr":"172.21.15.26:6825/1690203303","heartbeat_front_addr":"172.21.15.26:6823/1690203303","state":["exists","up"]},{"osd":3,"uuid":"9018149e-e25f-4d5c-8749-0feaffaa31e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6801","nonce":2253178087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6803","nonce":2253178087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6807","nonce":2253178087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6805","nonce":2253178087}]},"public_addr":"172.21.15.135:6801/2253178087","cluster_addr":"172.21.15.135:6803/2253178087","heartbeat_back_addr":"172.21.15.135:6807/2253178087","heartbeat_front_addr":"172.21.15.135:6805/2253178087","state":["exists","up"]},{"osd":4,"uuid":"90bd084e-4ae6-4fa0-9a79-221a26a1183c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6809","nonce":3525260045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6811","nonce":3525260045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6815","nonce":3525260045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6813","nonce":3525260045}]},"public_addr":"172.21.15.135:6809/3525260045","cluster_addr":"172.21.15.135:6811/3525260045","heartbeat_back_addr":"172.21.15.135:6815/3525260045","heartbeat_front_addr":"172.21.15.135:6813/3525260045","state":["exists","up"]},{"osd":5,"uuid":"b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6817","nonce":3212995324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6819","nonce":3212995324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6823","nonce":3212995324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6821","nonce":3212995324}]},"public_addr":"172.21.15.135:6817/3212995324","cluster_addr":"172.21.15.135:6819/3212995324","heartbeat_back_addr":"172.21.15.135:6823/3212995324","heartbeat_front_addr":"172.21.15.135:6821/3212995324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:41.148461+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:16.974271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:45.884445+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:11.410167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:40.468724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:03:06.902797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/965450412":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:0/925863937":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.26:0/4163858233":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/1959910794":"2024-05-09T23:58:50.299227+0000","172.21.15.26:0/3104174095":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:6801/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/2204010739":"2024-05-09T23:58:18.405305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7938061180 msgr2=0x7f7938063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7938061180 0x7f7938063640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f793c009bc0 tx=0x7f793c00b040).stop 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f68a0 msgr2=0x7f794c10a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f68a0 0x7f794c10a3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f794800e910 tx=0x7f794800b040).stop 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 shutdown_connections 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7938061180 0x7f7938063640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f794c0f68a0 0x7f794c10a3a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 --2- 172.21.15.26:0/3515774779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0f7b40 0x7f794c10a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:12.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 >> 172.21.15.26:0/3515774779 conn(0x7f794c0f2020 msgr2=0x7f794c0f2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:12.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 shutdown_connections 2024-05-09T00:03:12.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:12.458+0000 7f7953ad3700 1 -- 172.21.15.26:0/3515774779 wait complete. 2024-05-09T00:03:12.796 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:12.456880+0000 mon.smithi026 (mon.0) 475 : audit [DBG] from='client.? 172.21.15.26:0/3515774779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:12.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:12.456880+0000 mon.smithi026 (mon.0) 475 : audit [DBG] from='client.? 172.21.15.26:0/3515774779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:13.219 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-05-09T00:01:47.922598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-05-09T00:03:13.219 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd pool get device_health_metrics pg_num 2024-05-09T00:03:13.500 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:13.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:12.540092+0000 mgr.smithi026.brymfp (mgr.14194) 150 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:13.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:12.540092+0000 mgr.smithi026.brymfp (mgr.14194) 150 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:15.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 -- 172.21.15.26:0/1559059883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 msgr2=0x7f7f880f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:15.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 --2- 172.21.15.26:0/1559059883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 0x7f7f880f6cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f7f780047f0 tx=0x7f7f78009cb0).stop 2024-05-09T00:03:15.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 -- 172.21.15.26:0/1559059883 shutdown_connections 2024-05-09T00:03:15.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 --2- 172.21.15.26:0/1559059883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f880f7b40 0x7f7f880f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:15.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 --2- 172.21.15.26:0/1559059883 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 0x7f7f880f6cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:15.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 -- 172.21.15.26:0/1559059883 >> 172.21.15.26:0/1559059883 conn(0x7f7f880f2020 msgr2=0x7f7f880f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:15.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 -- 172.21.15.26:0/1559059883 shutdown_connections 2024-05-09T00:03:15.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 -- 172.21.15.26:0/1559059883 wait complete. 2024-05-09T00:03:15.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 Processor -- start 2024-05-09T00:03:15.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.288+0000 7f7f8e900700 1 -- start start 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f8e900700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 0x7f7f880fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f8e900700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f880f7b40 0x7f7f880f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f8e900700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880fadd0 con 0x7f7f880f68a0 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f8e900700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880f9370 con 0x7f7f880f7b40 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f87fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 0x7f7f880fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f87fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 0x7f7f880fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53546/0 (socket says 172.21.15.26:53546) 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f87fff700 1 -- 172.21.15.26:0/843309576 learned_addr learned my addr 172.21.15.26:0/843309576 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f877fe700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f880f7b40 0x7f7f880f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f87fff700 1 -- 172.21.15.26:0/843309576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f880f7b40 msgr2=0x7f7f880f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f87fff700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f880f7b40 0x7f7f880f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f87fff700 1 -- 172.21.15.26:0/843309576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78005040 con 0x7f7f880f68a0 2024-05-09T00:03:15.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.289+0000 7f7f87fff700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 0x7f7f880fa820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7f78004f10 tx=0x7f7f78009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.290+0000 7f7f857fa700 1 -- 172.21.15.26:0/843309576 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f7800e070 con 0x7f7f880f68a0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.290+0000 7f7f857fa700 1 -- 172.21.15.26:0/843309576 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7f78007e90 con 0x7f7f880f68a0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.290+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f880f9590 con 0x7f7f880f68a0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.290+0000 7f7f857fa700 1 -- 172.21.15.26:0/843309576 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f78018070 con 0x7f7f880f68a0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.290+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f880f9a70 con 0x7f7f880f68a0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.290+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f880f9ce0 con 0x7f7f880f68a0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.291+0000 7f7f857fa700 1 -- 172.21.15.26:0/843309576 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f7f780123c0 con 0x7f7f880f68a0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.291+0000 7f7f857fa700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7f70061160 0x7f7f70063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.291+0000 7f7f857fa700 1 -- 172.21.15.26:0/843309576 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f7f7807d3f0 con 0x7f7f880f68a0 2024-05-09T00:03:15.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.291+0000 7f7f877fe700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7f70061160 0x7f7f70063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:15.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.292+0000 7f7f877fe700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7f70061160 0x7f7f70063620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7f7c004dc0 tx=0x7f7f7c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:15.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.296+0000 7f7f857fa700 1 -- 172.21.15.26:0/843309576 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7f78051600 con 0x7f7f880f68a0 2024-05-09T00:03:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.465+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7f880feff0 con 0x7f7f880f68a0 2024-05-09T00:03:15.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.465+0000 7f7f857fa700 1 -- 172.21.15.26:0/843309576 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v38) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7f780511f0 con 0x7f7f880f68a0 2024-05-09T00:03:15.460 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-05-09T00:03:15.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7f70061160 msgr2=0x7f7f70063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:15.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7f70061160 0x7f7f70063620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7f7c004dc0 tx=0x7f7f7c00b040).stop 2024-05-09T00:03:15.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 msgr2=0x7f7f880fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:15.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 0x7f7f880fa820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7f78004f10 tx=0x7f7f78009cb0).stop 2024-05-09T00:03:15.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 shutdown_connections 2024-05-09T00:03:15.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7f70061160 0x7f7f70063620 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:15.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f880f68a0 0x7f7f880fa820 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:15.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 --2- 172.21.15.26:0/843309576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f880f7b40 0x7f7f880f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:15.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 >> 172.21.15.26:0/843309576 conn(0x7f7f880f2020 msgr2=0x7f7f88061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:15.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.467+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 shutdown_connections 2024-05-09T00:03:15.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:15.468+0000 7f7f8e900700 1 -- 172.21.15.26:0/843309576 wait complete. 2024-05-09T00:03:15.801 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:14.540398+0000 mgr.smithi026.brymfp (mgr.14194) 151 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:15.802 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:15.466248+0000 mon.smithi026 (mon.0) 476 : audit [DBG] from='client.? 172.21.15.26:0/843309576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-05-09T00:03:15.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:14.540398+0000 mgr.smithi026.brymfp (mgr.14194) 151 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:15.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:15.466248+0000 mon.smithi026 (mon.0) 476 : audit [DBG] from='client.? 172.21.15.26:0/843309576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-05-09T00:03:16.137 INFO:tasks.cephadm:Setting up client nodes... 2024-05-09T00:03:16.137 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T00:03:17.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:16.540793+0000 mgr.smithi026.brymfp (mgr.14194) 152 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:17.956 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:16.540793+0000 mgr.smithi026.brymfp (mgr.14194) 152 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:18.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.220+0000 7f1bdf494700 1 -- 172.21.15.26:0/2242247197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806cbd0 msgr2=0x7f1bd806b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.220+0000 7f1bdf494700 1 --2- 172.21.15.26:0/2242247197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806cbd0 0x7f1bd806b0d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f1bd40047f0 tx=0x7f1bd4009cb0).stop 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.220+0000 7f1bdf494700 1 -- 172.21.15.26:0/2242247197 shutdown_connections 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.220+0000 7f1bdf494700 1 --2- 172.21.15.26:0/2242247197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd806b5c0 0x7f1bd806ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.220+0000 7f1bdf494700 1 --2- 172.21.15.26:0/2242247197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806cbd0 0x7f1bd806b0d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.220+0000 7f1bdf494700 1 -- 172.21.15.26:0/2242247197 >> 172.21.15.26:0/2242247197 conn(0x7f1bd80f3150 msgr2=0x7f1bd80f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.220+0000 7f1bdf494700 1 -- 172.21.15.26:0/2242247197 shutdown_connections 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.220+0000 7f1bdf494700 1 -- 172.21.15.26:0/2242247197 wait complete. 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdf494700 1 Processor -- start 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdf494700 1 -- start start 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdf494700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806b5c0 0x7f1bd810e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdf494700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd806cbd0 0x7f1bd810ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdf494700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd810f2e0 con 0x7f1bd806b5c0 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdf494700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd810f420 con 0x7f1bd806cbd0 2024-05-09T00:03:18.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdd230700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806b5c0 0x7f1bd810e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdd230700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806b5c0 0x7f1bd810e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53558/0 (socket says 172.21.15.26:53558) 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdd230700 1 -- 172.21.15.26:0/2473086473 learned_addr learned my addr 172.21.15.26:0/2473086473 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdca2f700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd806cbd0 0x7f1bd810ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdd230700 1 -- 172.21.15.26:0/2473086473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd806cbd0 msgr2=0x7f1bd810ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdd230700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd806cbd0 0x7f1bd810ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.221+0000 7f1bdd230700 1 -- 172.21.15.26:0/2473086473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4005040 con 0x7f1bd806b5c0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.222+0000 7f1bdd230700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806b5c0 0x7f1bd810e840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f1bd4013510 tx=0x7f1bd4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.222+0000 7f1bce7fc700 1 -- 172.21.15.26:0/2473086473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd400e030 con 0x7f1bd806b5c0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.222+0000 7f1bce7fc700 1 -- 172.21.15.26:0/2473086473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1bd4007e90 con 0x7f1bd806b5c0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.222+0000 7f1bce7fc700 1 -- 172.21.15.26:0/2473086473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd4018070 con 0x7f1bd806b5c0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.222+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd8113e60 con 0x7f1bd806b5c0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.222+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd81142c0 con 0x7f1bd806b5c0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.223+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd805fb50 con 0x7f1bd806b5c0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.223+0000 7f1bce7fc700 1 -- 172.21.15.26:0/2473086473 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f1bd401da20 con 0x7f1bd806b5c0 2024-05-09T00:03:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.223+0000 7f1bce7fc700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1bc4061180 0x7f1bc4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.224+0000 7f1bce7fc700 1 -- 172.21.15.26:0/2473086473 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f1bd407da10 con 0x7f1bd806b5c0 2024-05-09T00:03:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.224+0000 7f1bdca2f700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1bc4061180 0x7f1bc4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.224+0000 7f1bdca2f700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1bc4061180 0x7f1bc4063640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1bc8004b60 tx=0x7f1bc8009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.228+0000 7f1bce7fc700 1 -- 172.21.15.26:0/2473086473 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1bd4051d60 con 0x7f1bd806b5c0 2024-05-09T00:03:18.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.468+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f1bd81085e0 con 0x7f1bd806b5c0 2024-05-09T00:03:18.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.472+0000 7f1bce7fc700 1 -- 172.21.15.26:0/2473086473 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1bd4051950 con 0x7f1bd806b5c0 2024-05-09T00:03:18.466 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2024-05-09T00:03:18.466 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDGEjxmqEX6GxAA9mQshh9j5dMEcOwhRODXLw== 2024-05-09T00:03:18.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1bc4061180 msgr2=0x7f1bc4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:18.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1bc4061180 0x7f1bc4063640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1bc8004b60 tx=0x7f1bc8009040).stop 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806b5c0 msgr2=0x7f1bd810e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806b5c0 0x7f1bd810e840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f1bd4013510 tx=0x7f1bd4009cb0).stop 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 shutdown_connections 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1bc4061180 0x7f1bc4063640 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bd806b5c0 0x7f1bd810e840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 --2- 172.21.15.26:0/2473086473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd806cbd0 0x7f1bd810ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 >> 172.21.15.26:0/2473086473 conn(0x7f1bd80f3150 msgr2=0x7f1bd80f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 shutdown_connections 2024-05-09T00:03:18.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:18.474+0000 7f1bdf494700 1 -- 172.21.15.26:0/2473086473 wait complete. 2024-05-09T00:03:18.848 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:18.469196+0000 mon.smithi026 (mon.0) 477 : audit [INF] from='client.? 172.21.15.26:0/2473086473' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:03:18.848 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:18.472742+0000 mon.smithi026 (mon.0) 478 : audit [INF] from='client.? 172.21.15.26:0/2473086473' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:03:19.118 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-09T00:03:19.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-09T00:03:19.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T00:03:19.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:18.469196+0000 mon.smithi026 (mon.0) 477 : audit [INF] from='client.? 172.21.15.26:0/2473086473' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:03:19.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:18.472742+0000 mon.smithi026 (mon.0) 478 : audit [INF] from='client.? 172.21.15.26:0/2473086473' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:03:19.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T00:03:19.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:18.541253+0000 mgr.smithi026.brymfp (mgr.14194) 153 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:20.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:18.541253+0000 mgr.smithi026.brymfp (mgr.14194) 153 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.817+0000 7f5f2841c700 1 -- 172.21.15.135:0/2382128897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 msgr2=0x7f5f200f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.817+0000 7f5f2841c700 1 --2- 172.21.15.135:0/2382128897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 0x7f5f200f9110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5f1c0047f0 tx=0x7f5f1c009cb0).stop 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.817+0000 7f5f2841c700 1 -- 172.21.15.135:0/2382128897 shutdown_connections 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.817+0000 7f5f2841c700 1 --2- 172.21.15.135:0/2382128897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 0x7f5f200f9110 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.817+0000 7f5f2841c700 1 --2- 172.21.15.135:0/2382128897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f200f7a10 0x7f5f200f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.817+0000 7f5f2841c700 1 -- 172.21.15.135:0/2382128897 >> 172.21.15.135:0/2382128897 conn(0x7f5f200f3150 msgr2=0x7f5f200f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.817+0000 7f5f2841c700 1 -- 172.21.15.135:0/2382128897 shutdown_connections 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.817+0000 7f5f2841c700 1 -- 172.21.15.135:0/2382128897 wait complete. 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f2841c700 1 Processor -- start 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f2841c700 1 -- start start 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f2841c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f200f7a10 0x7f5f2006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:20.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f2841c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 0x7f5f2006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f2841c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2006cf80 con 0x7f5f200f7a10 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f2841c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2006b520 con 0x7f5f200f8cb0 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f259b7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 0x7f5f2006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f259b7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 0x7f5f2006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45148/0 (socket says 172.21.15.135:45148) 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f259b7700 1 -- 172.21.15.135:0/3766575064 learned_addr learned my addr 172.21.15.135:0/3766575064 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f261b8700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f200f7a10 0x7f5f2006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f259b7700 1 -- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f200f7a10 msgr2=0x7f5f2006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f259b7700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f200f7a10 0x7f5f2006c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f259b7700 1 -- 172.21.15.135:0/3766575064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c005040 con 0x7f5f200f8cb0 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f259b7700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 0x7f5f2006b030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5f1c013580 tx=0x7f5f1c009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f177fe700 1 -- 172.21.15.135:0/3766575064 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1c018070 con 0x7f5f200f8cb0 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f177fe700 1 -- 172.21.15.135:0/3766575064 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5f1c007e90 con 0x7f5f200f8cb0 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2006b740 con 0x7f5f200f8cb0 2024-05-09T00:03:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f177fe700 1 -- 172.21.15.135:0/3766575064 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1c0123c0 con 0x7f5f200f8cb0 2024-05-09T00:03:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.818+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2006bca0 con 0x7f5f200f8cb0 2024-05-09T00:03:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.819+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f20047540 con 0x7f5f200f8cb0 2024-05-09T00:03:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.820+0000 7f5f177fe700 1 -- 172.21.15.135:0/3766575064 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f5f1c01d420 con 0x7f5f200f8cb0 2024-05-09T00:03:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.820+0000 7f5f177fe700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5f0c061180 0x7f5f0c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.820+0000 7f5f177fe700 1 -- 172.21.15.135:0/3766575064 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f5f1c07d150 con 0x7f5f200f8cb0 2024-05-09T00:03:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.820+0000 7f5f261b8700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5f0c061180 0x7f5f0c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.821+0000 7f5f261b8700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5f0c061180 0x7f5f0c063640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5f200f8b10 tx=0x7f5f1000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:20.824+0000 7f5f177fe700 1 -- 172.21.15.135:0/3766575064 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5f1c051420 con 0x7f5f200f8cb0 2024-05-09T00:03:21.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.048+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f5f20102060 con 0x7f5f200f8cb0 2024-05-09T00:03:21.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.052+0000 7f5f177fe700 1 -- 172.21.15.135:0/3766575064 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5f1c051010 con 0x7f5f200f8cb0 2024-05-09T00:03:21.047 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2024-05-09T00:03:21.047 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDJEjxmEaj9AhAAXS0YKs457GHSz+gO6wutvw== 2024-05-09T00:03:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5f0c061180 msgr2=0x7f5f0c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5f0c061180 0x7f5f0c063640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5f200f8b10 tx=0x7f5f1000b040).stop 2024-05-09T00:03:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 msgr2=0x7f5f2006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:21.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 0x7f5f2006b030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5f1c013580 tx=0x7f5f1c009cb0).stop 2024-05-09T00:03:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 shutdown_connections 2024-05-09T00:03:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5f0c061180 0x7f5f0c063640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f200f7a10 0x7f5f2006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 --2- 172.21.15.135:0/3766575064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f200f8cb0 0x7f5f2006b030 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 >> 172.21.15.135:0/3766575064 conn(0x7f5f200f3150 msgr2=0x7f5f200fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:21.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 shutdown_connections 2024-05-09T00:03:21.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T00:03:21.054+0000 7f5f2841c700 1 -- 172.21.15.135:0/3766575064 wait complete. 2024-05-09T00:03:21.671 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:20.541891+0000 mgr.smithi026.brymfp (mgr.14194) 154 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:21.671 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:21.049603+0000 mon.smithi135 (mon.1) 14 : audit [INF] from='client.? 172.21.15.135:0/3766575064' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:03:21.671 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:21.050013+0000 mon.smithi026 (mon.0) 479 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:03:21.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:21.053858+0000 mon.smithi026 (mon.0) 480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:03:21.693 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T00:03:21.693 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-05-09T00:03:21.693 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-09T00:03:21.736 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T00:03:21.736 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-09T00:03:21.737 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-09T00:03:22.026 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:22.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:20.541891+0000 mgr.smithi026.brymfp (mgr.14194) 154 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:22.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:21.049603+0000 mon.smithi135 (mon.1) 14 : audit [INF] from='client.? 172.21.15.135:0/3766575064' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:03:22.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:21.050013+0000 mon.smithi026 (mon.0) 479 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:03:22.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:21.053858+0000 mon.smithi026 (mon.0) 480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:03:23.752 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:22.542385+0000 mgr.smithi026.brymfp (mgr.14194) 155 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.022+0000 7f8d70bf2700 1 -- 172.21.15.26:0/3585460443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0fab60 msgr2=0x7f8d6c0fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.022+0000 7f8d70bf2700 1 --2- 172.21.15.26:0/3585460443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0fab60 0x7f8d6c0fcf50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f8d600047f0 tx=0x7f8d60009cb0).stop 2024-05-09T00:03:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.023+0000 7f8d70bf2700 1 -- 172.21.15.26:0/3585460443 shutdown_connections 2024-05-09T00:03:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.023+0000 7f8d70bf2700 1 --2- 172.21.15.26:0/3585460443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c0fab60 0x7f8d6c0fcf50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.023+0000 7f8d70bf2700 1 --2- 172.21.15.26:0/3585460443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d6c061780 0x7f8d6c0fa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.023+0000 7f8d70bf2700 1 -- 172.21.15.26:0/3585460443 >> 172.21.15.26:0/3585460443 conn(0x7f8d6c0f2020 msgr2=0x7f8d6c0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.023+0000 7f8d70bf2700 1 -- 172.21.15.26:0/3585460443 shutdown_connections 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.023+0000 7f8d70bf2700 1 -- 172.21.15.26:0/3585460443 wait complete. 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.023+0000 7f8d70bf2700 1 Processor -- start 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.023+0000 7f8d70bf2700 1 -- start start 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d70bf2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c061780 0x7f8d6c108060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d70bf2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d6c0fab60 0x7f8d6c108550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d70bf2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c108b00 con 0x7f8d6c061780 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d70bf2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c108c40 con 0x7f8d6c0fab60 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d6a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c061780 0x7f8d6c108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d6a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c061780 0x7f8d6c108060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34934/0 (socket says 172.21.15.26:34934) 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d6a59c700 1 -- 172.21.15.26:0/2541112468 learned_addr learned my addr 172.21.15.26:0/2541112468 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d69d9b700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d6c0fab60 0x7f8d6c108550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d6a59c700 1 -- 172.21.15.26:0/2541112468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d6c0fab60 msgr2=0x7f8d6c108550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d6a59c700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d6c0fab60 0x7f8d6c108550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d6a59c700 1 -- 172.21.15.26:0/2541112468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d60005040 con 0x7f8d6c061780 2024-05-09T00:03:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d6a59c700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c061780 0x7f8d6c108060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f8d5c00c790 tx=0x7f8d5c004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d5b7fe700 1 -- 172.21.15.26:0/2541112468 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d5c00e680 con 0x7f8d6c061780 2024-05-09T00:03:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c10d6e0 con 0x7f8d6c061780 2024-05-09T00:03:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d5b7fe700 1 -- 172.21.15.26:0/2541112468 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8d5c00ec70 con 0x7f8d6c061780 2024-05-09T00:03:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d5b7fe700 1 -- 172.21.15.26:0/2541112468 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d5c012d30 con 0x7f8d6c061780 2024-05-09T00:03:24.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.024+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c10dc20 con 0x7f8d6c061780 2024-05-09T00:03:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.025+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c1000f0 con 0x7f8d6c061780 2024-05-09T00:03:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.026+0000 7f8d5b7fe700 1 -- 172.21.15.26:0/2541112468 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f8d5c012400 con 0x7f8d6c061780 2024-05-09T00:03:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.026+0000 7f8d5b7fe700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8d54061180 0x7f8d54063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.026+0000 7f8d5b7fe700 1 -- 172.21.15.26:0/2541112468 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f8d5c07be40 con 0x7f8d6c061780 2024-05-09T00:03:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.026+0000 7f8d69d9b700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8d54061180 0x7f8d54063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.027+0000 7f8d69d9b700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8d54061180 0x7f8d54063640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8d60004f10 tx=0x7f8d6000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:24.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.031+0000 7f8d5b7fe700 1 -- 172.21.15.26:0/2541112468 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8d5c047f60 con 0x7f8d6c061780 2024-05-09T00:03:24.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:22.542385+0000 mgr.smithi026.brymfp (mgr.14194) 155 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:24.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.246+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8d6c0598f0 con 0x7f8d6c061780 2024-05-09T00:03:24.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.249+0000 7f8d5b7fe700 1 -- 172.21.15.26:0/2541112468 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+152026 (secure 0 0 0) 0x7f8d5c0451f0 con 0x7f8d6c061780 2024-05-09T00:03:24.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:03:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8d54061180 msgr2=0x7f8d54063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8d54061180 0x7f8d54063640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8d60004f10 tx=0x7f8d6000b040).stop 2024-05-09T00:03:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c061780 msgr2=0x7f8d6c108060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c061780 0x7f8d6c108060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f8d5c00c790 tx=0x7f8d5c004330).stop 2024-05-09T00:03:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 shutdown_connections 2024-05-09T00:03:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8d54061180 0x7f8d54063640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6c061780 0x7f8d6c108060 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:24.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 --2- 172.21.15.26:0/2541112468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d6c0fab60 0x7f8d6c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 >> 172.21.15.26:0/2541112468 conn(0x7f8d6c0f2020 msgr2=0x7f8d6c0f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 shutdown_connections 2024-05-09T00:03:24.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:24.251+0000 7f8d70bf2700 1 -- 172.21.15.26:0/2541112468 wait complete. 2024-05-09T00:03:24.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:24.247263+0000 mon.smithi026 (mon.0) 481 : audit [DBG] from='client.? 172.21.15.26:0/2541112468' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T00:03:25.003 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"active_gid":14194,"active_name":"smithi026.brymfp","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":3278576613},{"type":"v1","addr":"172.21.15.26:6801","nonce":3278576613}]},"active_addr":"172.21.15.26:6801/3278576613","active_change":"2024-05-08T23:59:44.498521+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":14208,"name":"smithi135.kkrhgf","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.26:8443/","prometheus":"http://172.21.15.26:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":2070328984}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":2652974841}]}]} 2024-05-09T00:03:25.007 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-09T00:03:25.008 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-09T00:03:25.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:03:25.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:24.247263+0000 mon.smithi026 (mon.0) 481 : audit [DBG] from='client.? 172.21.15.26:0/2541112468' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T00:03:25.296 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:25.767 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:24.542884+0000 mgr.smithi026.brymfp (mgr.14194) 156 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:26.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:24.542884+0000 mgr.smithi026.brymfp (mgr.14194) 156 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:27.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.069+0000 7f179e65f700 1 -- 172.21.15.26:0/49054014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 msgr2=0x7f17980f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:27.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.069+0000 7f179e65f700 1 --2- 172.21.15.26:0/49054014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 0x7f17980f90b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f178c0047f0 tx=0x7f178c009cb0).stop 2024-05-09T00:03:27.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.069+0000 7f179e65f700 1 -- 172.21.15.26:0/49054014 shutdown_connections 2024-05-09T00:03:27.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.069+0000 7f179e65f700 1 --2- 172.21.15.26:0/49054014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 0x7f17980f90b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.069+0000 7f179e65f700 1 --2- 172.21.15.26:0/49054014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17980f79b0 0x7f17980f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.069+0000 7f179e65f700 1 -- 172.21.15.26:0/49054014 >> 172.21.15.26:0/49054014 conn(0x7f17980f30f0 msgr2=0x7f17980f5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.069+0000 7f179e65f700 1 -- 172.21.15.26:0/49054014 shutdown_connections 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.069+0000 7f179e65f700 1 -- 172.21.15.26:0/49054014 wait complete. 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f179e65f700 1 Processor -- start 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f179e65f700 1 -- start start 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f179e65f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17980f79b0 0x7f17981080b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f179e65f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 0x7f17981085a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:27.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f179e65f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798108b50 con 0x7f17980f8c50 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f179e65f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798108c90 con 0x7f17980f79b0 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f17977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 0x7f17981085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f17977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 0x7f17981085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34952/0 (socket says 172.21.15.26:34952) 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.070+0000 7f17977fe700 1 -- 172.21.15.26:0/2787056568 learned_addr learned my addr 172.21.15.26:0/2787056568 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f1797fff700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17980f79b0 0x7f17981080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f17977fe700 1 -- 172.21.15.26:0/2787056568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17980f79b0 msgr2=0x7f17981080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f17977fe700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17980f79b0 0x7f17981080b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f17977fe700 1 -- 172.21.15.26:0/2787056568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c005040 con 0x7f17980f8c50 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f17977fe700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 0x7f17981085a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f178c013510 tx=0x7f178c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:27.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f17957fa700 1 -- 172.21.15.26:0/2787056568 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c00e030 con 0x7f17980f8c50 2024-05-09T00:03:27.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f17957fa700 1 -- 172.21.15.26:0/2787056568 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f178c007e90 con 0x7f17980f8c50 2024-05-09T00:03:27.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179810d6d0 con 0x7f17980f8c50 2024-05-09T00:03:27.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f17957fa700 1 -- 172.21.15.26:0/2787056568 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c018070 con 0x7f17980f8c50 2024-05-09T00:03:27.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.071+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179810dc10 con 0x7f17980f8c50 2024-05-09T00:03:27.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.072+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1798100120 con 0x7f17980f8c50 2024-05-09T00:03:27.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.073+0000 7f17957fa700 1 -- 172.21.15.26:0/2787056568 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f178c01d420 con 0x7f17980f8c50 2024-05-09T00:03:27.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.073+0000 7f17957fa700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1780061180 0x7f1780063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:27.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.073+0000 7f17957fa700 1 -- 172.21.15.26:0/2787056568 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f178c07d930 con 0x7f17980f8c50 2024-05-09T00:03:27.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.073+0000 7f1797fff700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1780061180 0x7f1780063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:27.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.073+0000 7f1797fff700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1780061180 0x7f1780063640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f17980f8ab0 tx=0x7f178800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:27.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.078+0000 7f17957fa700 1 -- 172.21.15.26:0/2787056568 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f178c051c80 con 0x7f17980f8c50 2024-05-09T00:03:27.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.249+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17980598f0 con 0x7f17980f8c50 2024-05-09T00:03:27.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.249+0000 7f17957fa700 1 -- 172.21.15.26:0/2787056568 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10928 (secure 0 0 0) 0x7f178c051870 con 0x7f17980f8c50 2024-05-09T00:03:27.244 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:03:27.244 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":38,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:57:45.460652+0000","modified":"2024-05-09T00:03:09.632546+0000","last_up_change":"2024-05-09T00:03:08.626623+0000","last_in_change":"2024-05-09T00:02:49.885020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-05-09T00:01:47.922598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9e406a7e-5ec2-4f17-9308-640a499d3012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6803","nonce":4066121531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6805","nonce":4066121531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6809","nonce":4066121531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6807","nonce":4066121531}]},"public_addr":"172.21.15.26:6803/4066121531","cluster_addr":"172.21.15.26:6805/4066121531","heartbeat_back_addr":"172.21.15.26:6809/4066121531","heartbeat_front_addr":"172.21.15.26:6807/4066121531","state":["exists","up"]},{"osd":1,"uuid":"6f0691b3-17ca-4f90-88ce-13f4e115a987","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6811","nonce":100863172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6813","nonce":100863172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6817","nonce":100863172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6815","nonce":100863172}]},"public_addr":"172.21.15.26:6811/100863172","cluster_addr":"172.21.15.26:6813/100863172","heartbeat_back_addr":"172.21.15.26:6817/100863172","heartbeat_front_addr":"172.21.15.26:6815/100863172","state":["exists","up"]},{"osd":2,"uuid":"3eaa1376-f58f-4e84-970a-f7805331d339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6819","nonce":1690203303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6821","nonce":1690203303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6825","nonce":1690203303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6823","nonce":1690203303}]},"public_addr":"172.21.15.26:6819/1690203303","cluster_addr":"172.21.15.26:6821/1690203303","heartbeat_back_addr":"172.21.15.26:6825/1690203303","heartbeat_front_addr":"172.21.15.26:6823/1690203303","state":["exists","up"]},{"osd":3,"uuid":"9018149e-e25f-4d5c-8749-0feaffaa31e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6801","nonce":2253178087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6803","nonce":2253178087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6807","nonce":2253178087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6805","nonce":2253178087}]},"public_addr":"172.21.15.135:6801/2253178087","cluster_addr":"172.21.15.135:6803/2253178087","heartbeat_back_addr":"172.21.15.135:6807/2253178087","heartbeat_front_addr":"172.21.15.135:6805/2253178087","state":["exists","up"]},{"osd":4,"uuid":"90bd084e-4ae6-4fa0-9a79-221a26a1183c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6809","nonce":3525260045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6811","nonce":3525260045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6815","nonce":3525260045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6813","nonce":3525260045}]},"public_addr":"172.21.15.135:6809/3525260045","cluster_addr":"172.21.15.135:6811/3525260045","heartbeat_back_addr":"172.21.15.135:6815/3525260045","heartbeat_front_addr":"172.21.15.135:6813/3525260045","state":["exists","up"]},{"osd":5,"uuid":"b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6817","nonce":3212995324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6819","nonce":3212995324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6823","nonce":3212995324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6821","nonce":3212995324}]},"public_addr":"172.21.15.135:6817/3212995324","cluster_addr":"172.21.15.135:6819/3212995324","heartbeat_back_addr":"172.21.15.135:6823/3212995324","heartbeat_front_addr":"172.21.15.135:6821/3212995324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:41.148461+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:16.974271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:45.884445+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:11.410167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:40.468724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:03:06.902797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/965450412":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:0/925863937":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.26:0/4163858233":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/1959910794":"2024-05-09T23:58:50.299227+0000","172.21.15.26:0/3104174095":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:6801/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/2204010739":"2024-05-09T23:58:18.405305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:03:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1780061180 msgr2=0x7f1780063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1780061180 0x7f1780063640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f17980f8ab0 tx=0x7f178800b040).stop 2024-05-09T00:03:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 msgr2=0x7f17981085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 0x7f17981085a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f178c013510 tx=0x7f178c009cb0).stop 2024-05-09T00:03:27.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 shutdown_connections 2024-05-09T00:03:27.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1780061180 0x7f1780063640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:27.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17980f79b0 0x7f17981080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:27.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 --2- 172.21.15.26:0/2787056568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17980f8c50 0x7f17981085a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:27.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 >> 172.21.15.26:0/2787056568 conn(0x7f17980f30f0 msgr2=0x7f17980fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:27.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 shutdown_connections 2024-05-09T00:03:27.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:27.251+0000 7f179e65f700 1 -- 172.21.15.26:0/2787056568 wait complete. 2024-05-09T00:03:28.058 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:26.543234+0000 mgr.smithi026.brymfp (mgr.14194) 157 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:28.058 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:27.250709+0000 mon.smithi026 (mon.0) 482 : audit [DBG] from='client.? 172.21.15.26:0/2787056568' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:28.082 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-09T00:03:28.082 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:03:28.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:26.543234+0000 mgr.smithi026.brymfp (mgr.14194) 157 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:28.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:27.250709+0000 mon.smithi026 (mon.0) 482 : audit [DBG] from='client.? 172.21.15.26:0/2787056568' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:28.362 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:29.999 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:28.543519+0000 mgr.smithi026.brymfp (mgr.14194) 158 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:30.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:28.543519+0000 mgr.smithi026.brymfp (mgr.14194) 158 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.236+0000 7f0710c7a700 1 -- 172.21.15.26:0/2756162550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f8c40 msgr2=0x7f070c0f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.236+0000 7f0710c7a700 1 --2- 172.21.15.26:0/2756162550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f8c40 0x7f070c0f90a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f07000047f0 tx=0x7f0700009cb0).stop 2024-05-09T00:03:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.236+0000 7f0710c7a700 1 -- 172.21.15.26:0/2756162550 shutdown_connections 2024-05-09T00:03:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.236+0000 7f0710c7a700 1 --2- 172.21.15.26:0/2756162550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f8c40 0x7f070c0f90a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.236+0000 7f0710c7a700 1 --2- 172.21.15.26:0/2756162550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f070c0f79a0 0x7f070c0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:30.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.236+0000 7f0710c7a700 1 -- 172.21.15.26:0/2756162550 >> 172.21.15.26:0/2756162550 conn(0x7f070c0f3100 msgr2=0x7f070c0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.236+0000 7f0710c7a700 1 -- 172.21.15.26:0/2756162550 shutdown_connections 2024-05-09T00:03:30.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.236+0000 7f0710c7a700 1 -- 172.21.15.26:0/2756162550 wait complete. 2024-05-09T00:03:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.237+0000 7f0710c7a700 1 Processor -- start 2024-05-09T00:03:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.237+0000 7f0710c7a700 1 -- start start 2024-05-09T00:03:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.237+0000 7f0710c7a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f79a0 0x7f070c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.237+0000 7f0710c7a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f070c0f8c40 0x7f070c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.237+0000 7f0710c7a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c06cf80 con 0x7f070c0f79a0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.237+0000 7f0710c7a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c06b520 con 0x7f070c0f8c40 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.237+0000 7f070a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f79a0 0x7f070c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f070a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f79a0 0x7f070c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34960/0 (socket says 172.21.15.26:34960) 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f070a59c700 1 -- 172.21.15.26:0/1223618573 learned_addr learned my addr 172.21.15.26:0/1223618573 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f0709d9b700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f070c0f8c40 0x7f070c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f070a59c700 1 -- 172.21.15.26:0/1223618573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f070c0f8c40 msgr2=0x7f070c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f070a59c700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f070c0f8c40 0x7f070c06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f070a59c700 1 -- 172.21.15.26:0/1223618573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700005040 con 0x7f070c0f79a0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f070a59c700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f79a0 0x7f070c06c9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f06fc00c790 tx=0x7f06fc007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f06fb7fe700 1 -- 172.21.15.26:0/1223618573 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06fc00e680 con 0x7f070c0f79a0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070c06b7a0 con 0x7f070c0f79a0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070c06bce0 con 0x7f070c0f79a0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f06fb7fe700 1 -- 172.21.15.26:0/1223618573 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f06fc00ec70 con 0x7f070c0f79a0 2024-05-09T00:03:30.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.238+0000 7f06fb7fe700 1 -- 172.21.15.26:0/1223618573 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06fc01bc10 con 0x7f070c0f79a0 2024-05-09T00:03:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.239+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec005150 con 0x7f070c0f79a0 2024-05-09T00:03:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.240+0000 7f06fb7fe700 1 -- 172.21.15.26:0/1223618573 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f06fc01b3b0 con 0x7f070c0f79a0 2024-05-09T00:03:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.240+0000 7f06fb7fe700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06f4061180 0x7f06f4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:30.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.240+0000 7f06fb7fe700 1 -- 172.21.15.26:0/1223618573 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f06fc07bea0 con 0x7f070c0f79a0 2024-05-09T00:03:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.240+0000 7f0709d9b700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06f4061180 0x7f06f4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.240+0000 7f0709d9b700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06f4061180 0x7f06f4063640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f07000047c0 tx=0x7f070000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:30.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.244+0000 7f06fb7fe700 1 -- 172.21.15.26:0/1223618573 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f06fc050170 con 0x7f070c0f79a0 2024-05-09T00:03:30.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.416+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06ec005820 con 0x7f070c0f79a0 2024-05-09T00:03:30.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.417+0000 7f06fb7fe700 1 -- 172.21.15.26:0/1223618573 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10928 (secure 0 0 0) 0x7f06fc017020 con 0x7f070c0f79a0 2024-05-09T00:03:30.412 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:03:30.412 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":38,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:57:45.460652+0000","modified":"2024-05-09T00:03:09.632546+0000","last_up_change":"2024-05-09T00:03:08.626623+0000","last_in_change":"2024-05-09T00:02:49.885020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-05-09T00:01:47.922598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9e406a7e-5ec2-4f17-9308-640a499d3012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6803","nonce":4066121531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6805","nonce":4066121531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6809","nonce":4066121531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6807","nonce":4066121531}]},"public_addr":"172.21.15.26:6803/4066121531","cluster_addr":"172.21.15.26:6805/4066121531","heartbeat_back_addr":"172.21.15.26:6809/4066121531","heartbeat_front_addr":"172.21.15.26:6807/4066121531","state":["exists","up"]},{"osd":1,"uuid":"6f0691b3-17ca-4f90-88ce-13f4e115a987","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6811","nonce":100863172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6813","nonce":100863172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6817","nonce":100863172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6815","nonce":100863172}]},"public_addr":"172.21.15.26:6811/100863172","cluster_addr":"172.21.15.26:6813/100863172","heartbeat_back_addr":"172.21.15.26:6817/100863172","heartbeat_front_addr":"172.21.15.26:6815/100863172","state":["exists","up"]},{"osd":2,"uuid":"3eaa1376-f58f-4e84-970a-f7805331d339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6819","nonce":1690203303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6821","nonce":1690203303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6825","nonce":1690203303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6823","nonce":1690203303}]},"public_addr":"172.21.15.26:6819/1690203303","cluster_addr":"172.21.15.26:6821/1690203303","heartbeat_back_addr":"172.21.15.26:6825/1690203303","heartbeat_front_addr":"172.21.15.26:6823/1690203303","state":["exists","up"]},{"osd":3,"uuid":"9018149e-e25f-4d5c-8749-0feaffaa31e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6801","nonce":2253178087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6803","nonce":2253178087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6807","nonce":2253178087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6805","nonce":2253178087}]},"public_addr":"172.21.15.135:6801/2253178087","cluster_addr":"172.21.15.135:6803/2253178087","heartbeat_back_addr":"172.21.15.135:6807/2253178087","heartbeat_front_addr":"172.21.15.135:6805/2253178087","state":["exists","up"]},{"osd":4,"uuid":"90bd084e-4ae6-4fa0-9a79-221a26a1183c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6809","nonce":3525260045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6811","nonce":3525260045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6815","nonce":3525260045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6813","nonce":3525260045}]},"public_addr":"172.21.15.135:6809/3525260045","cluster_addr":"172.21.15.135:6811/3525260045","heartbeat_back_addr":"172.21.15.135:6815/3525260045","heartbeat_front_addr":"172.21.15.135:6813/3525260045","state":["exists","up"]},{"osd":5,"uuid":"b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6817","nonce":3212995324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6819","nonce":3212995324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6823","nonce":3212995324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6821","nonce":3212995324}]},"public_addr":"172.21.15.135:6817/3212995324","cluster_addr":"172.21.15.135:6819/3212995324","heartbeat_back_addr":"172.21.15.135:6823/3212995324","heartbeat_front_addr":"172.21.15.135:6821/3212995324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:41.148461+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:16.974271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:45.884445+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:11.410167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:40.468724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:03:06.902797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/965450412":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:0/925863937":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.26:0/4163858233":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/1959910794":"2024-05-09T23:58:50.299227+0000","172.21.15.26:0/3104174095":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:6801/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/2204010739":"2024-05-09T23:58:18.405305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:03:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06f4061180 msgr2=0x7f06f4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06f4061180 0x7f06f4063640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f07000047c0 tx=0x7f070000b040).stop 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f79a0 msgr2=0x7f070c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f79a0 0x7f070c06c9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f06fc00c790 tx=0x7f06fc007f90).stop 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 shutdown_connections 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06f4061180 0x7f06f4063640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f070c0f79a0 0x7f070c06c9d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 --2- 172.21.15.26:0/1223618573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f070c0f8c40 0x7f070c06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 >> 172.21.15.26:0/1223618573 conn(0x7f070c0f3100 msgr2=0x7f070c0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 shutdown_connections 2024-05-09T00:03:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:30.419+0000 7f0710c7a700 1 -- 172.21.15.26:0/1223618573 wait complete. 2024-05-09T00:03:30.707 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:30.418396+0000 mon.smithi026 (mon.0) 483 : audit [DBG] from='client.? 172.21.15.26:0/1223618573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:31.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-09T00:03:31.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-09T00:03:31.119 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-09T00:03:31.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-09T00:03:31.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-09T00:03:31.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-09T00:03:31.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:30.418396+0000 mon.smithi026 (mon.0) 483 : audit [DBG] from='client.? 172.21.15.26:0/1223618573' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:31.522 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:31.556 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:31.943 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:30.543945+0000 mgr.smithi026.brymfp (mgr.14194) 159 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:32.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:30.543945+0000 mgr.smithi026.brymfp (mgr.14194) 159 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:32.868 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:32.869 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:33.937 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:32.544251+0000 mgr.smithi026.brymfp (mgr.14194) 160 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:34.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:32.544251+0000 mgr.smithi026.brymfp (mgr.14194) 160 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:35.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.004+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/3914465104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 msgr2=0x7fb4a40f8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.004+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/3914465104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 0x7fb4a40f8fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb48c0047f0 tx=0x7fb48c009cb0).stop 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.004+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/3914465104 shutdown_connections 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.004+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/3914465104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 0x7fb4a40f8fe0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.004+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/3914465104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4a40f78e0 0x7fb4a40f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.004+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/3914465104 >> 172.21.15.26:0/3914465104 conn(0x7fb4a40f3020 msgr2=0x7fb4a40f5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.004+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/3914465104 shutdown_connections 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.004+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/3914465104 wait complete. 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4aa1bb700 1 Processor -- start 2024-05-09T00:03:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4aa1bb700 1 -- start start 2024-05-09T00:03:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4aa1bb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4a40f78e0 0x7fb4a4108090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4aa1bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 0x7fb4a4108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:36.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4aa1bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4108b30 con 0x7fb4a40f8b80 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4aa1bb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4108c70 con 0x7fb4a40f78e0 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4a2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 0x7fb4a4108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4a2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 0x7fb4a4108580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52768/0 (socket says 172.21.15.26:52768) 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4a2ffd700 1 -- 172.21.15.26:0/84716296 learned_addr learned my addr 172.21.15.26:0/84716296 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.005+0000 7fb4a37fe700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4a40f78e0 0x7fb4a4108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4a2ffd700 1 -- 172.21.15.26:0/84716296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4a40f78e0 msgr2=0x7fb4a4108090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4a2ffd700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4a40f78e0 0x7fb4a4108090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4a2ffd700 1 -- 172.21.15.26:0/84716296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c005040 con 0x7fb4a40f8b80 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4a2ffd700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 0x7fb4a4108580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb48c013470 tx=0x7fb48c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48c00e030 con 0x7fb4a40f8b80 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a41095b0 con 0x7fb4a40f8b80 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb48c007e90 con 0x7fb4a40f8b80 2024-05-09T00:03:36.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a4109a90 con 0x7fb4a40f8b80 2024-05-09T00:03:36.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.006+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48c018070 con 0x7fb4a40f8b80 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.007+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb484000ff0 con 0x7fb4a40f8b80 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.008+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fb48c01d420 con 0x7fb4a40f8b80 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.008+0000 7fb4a0ff9700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb490061160 0x7fb490063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.008+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fb48c07d7b0 con 0x7fb4a40f8b80 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.008+0000 7fb4a37fe700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb490061160 0x7fb490063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.008+0000 7fb4a0ff9700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] conn(0x7fb490066d30 0x7fb490069170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.008+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 --> [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4900697f0 con 0x7fb490066d30 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.008+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb48c082220 con 0x7fb4a40f8b80 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.009+0000 7fb4a3fff700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] conn(0x7fb490066d30 0x7fb490069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.009+0000 7fb4a37fe700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb490061160 0x7fb490063620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb494009fd0 tx=0x7fb49400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.009+0000 7fb4a3fff700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] conn(0x7fb490066d30 0x7fb490069170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.010+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 <== osd.0 v2:172.21.15.26:6802/4066121531 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fb4900697f0 con 0x7fb490066d30 2024-05-09T00:03:36.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.024+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 --> [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb484002b80 con 0x7fb490066d30 2024-05-09T00:03:36.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.024+0000 7fb4a0ff9700 1 -- 172.21.15.26:0/84716296 <== osd.0 v2:172.21.15.26:6802/4066121531 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb484002b80 con 0x7fb490066d30 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] conn(0x7fb490066d30 msgr2=0x7fb490069170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] conn(0x7fb490066d30 0x7fb490069170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb490061160 msgr2=0x7fb490063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb490061160 0x7fb490063620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb494009fd0 tx=0x7fb49400b040).stop 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 msgr2=0x7fb4a4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 0x7fb4a4108580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb48c013470 tx=0x7fb48c009cb0).stop 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 shutdown_connections 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6802/4066121531,v1:172.21.15.26:6803/4066121531] conn(0x7fb490066d30 0x7fb490069170 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb490061160 0x7fb490063620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4a40f78e0 0x7fb4a4108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 --2- 172.21.15.26:0/84716296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4a40f8b80 0x7fb4a4108580 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:36.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 >> 172.21.15.26:0/84716296 conn(0x7fb4a40f3020 msgr2=0x7fb4a40fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:36.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 shutdown_connections 2024-05-09T00:03:36.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:36.025+0000 7fb4aa1bb700 1 -- 172.21.15.26:0/84716296 wait complete. 2024-05-09T00:03:36.040 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:34.544625+0000 mgr.smithi026.brymfp (mgr.14194) 161 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:36.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:34.544625+0000 mgr.smithi026.brymfp (mgr.14194) 161 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:38.106 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:36.545016+0000 mgr.smithi026.brymfp (mgr.14194) 162 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:38.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:36.545016+0000 mgr.smithi026.brymfp (mgr.14194) 162 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:39.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.224+0000 7f316ebcc700 1 -- 172.21.15.26:0/660023924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f7b40 msgr2=0x7f31680f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.224+0000 7f316ebcc700 1 --2- 172.21.15.26:0/660023924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f7b40 0x7f31680f7fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f31540047f0 tx=0x7f3154009cb0).stop 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.224+0000 7f316ebcc700 1 -- 172.21.15.26:0/660023924 shutdown_connections 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.224+0000 7f316ebcc700 1 --2- 172.21.15.26:0/660023924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f7b40 0x7f31680f7fa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.224+0000 7f316ebcc700 1 --2- 172.21.15.26:0/660023924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31680f68a0 0x7f31680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.224+0000 7f316ebcc700 1 -- 172.21.15.26:0/660023924 >> 172.21.15.26:0/660023924 conn(0x7f31680f2020 msgr2=0x7f31680f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.224+0000 7f316ebcc700 1 -- 172.21.15.26:0/660023924 shutdown_connections 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.224+0000 7f316ebcc700 1 -- 172.21.15.26:0/660023924 wait complete. 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316ebcc700 1 Processor -- start 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316ebcc700 1 -- start start 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316ebcc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f68a0 0x7f31680fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316ebcc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31680f7b40 0x7f31680f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316ebcc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31680fadd0 con 0x7f31680f68a0 2024-05-09T00:03:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316ebcc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31680f9370 con 0x7f31680f7b40 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316c968700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f68a0 0x7f31680fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316c968700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f68a0 0x7f31680fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52788/0 (socket says 172.21.15.26:52788) 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316c968700 1 -- 172.21.15.26:0/513762881 learned_addr learned my addr 172.21.15.26:0/513762881 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f3167fff700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31680f7b40 0x7f31680f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316c968700 1 -- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31680f7b40 msgr2=0x7f31680f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316c968700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31680f7b40 0x7f31680f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316c968700 1 -- 172.21.15.26:0/513762881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154005040 con 0x7f31680f68a0 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f3167fff700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31680f7b40 0x7f31680f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.225+0000 7f316c968700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f68a0 0x7f31680fa820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f315c002820 tx=0x7f315c009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.226+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315c002d60 con 0x7f31680f68a0 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.226+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f315c00f040 con 0x7f31680f68a0 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.226+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31680f95f0 con 0x7f31680f68a0 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.226+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315c00d820 con 0x7f31680f68a0 2024-05-09T00:03:39.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.226+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31680f9b30 con 0x7f31680f68a0 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.227+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3168061c00 con 0x7f31680f68a0 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.227+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f315c0092f0 con 0x7f31680f68a0 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.228+0000 7f3165ffb700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3158061180 0x7f3158063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.228+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f315c07c160 con 0x7f31680f68a0 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.228+0000 7f3167fff700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3158061180 0x7f3158063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.228+0000 7f3165ffb700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] conn(0x7f3158066d50 0x7f3158069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.228+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 --> [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3158069810 con 0x7f3158066d50 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.228+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f315c07e7d0 con 0x7f31680f68a0 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.228+0000 7f3167fff700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3158061180 0x7f3158063640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3154013470 tx=0x7f315400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.228+0000 7f316d169700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] conn(0x7f3158066d50 0x7f3158069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.229+0000 7f316d169700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] conn(0x7f3158066d50 0x7f3158069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.229+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 <== osd.3 v2:172.21.15.135:6800/2253178087 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f3158069810 con 0x7f3158066d50 2024-05-09T00:03:39.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.244+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 --> [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31680fc240 con 0x7f3158066d50 2024-05-09T00:03:39.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.244+0000 7f3165ffb700 1 -- 172.21.15.26:0/513762881 <== osd.3 v2:172.21.15.135:6800/2253178087 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f31680fc240 con 0x7f3158066d50 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] conn(0x7f3158066d50 msgr2=0x7f3158069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] conn(0x7f3158066d50 0x7f3158069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3158061180 msgr2=0x7f3158063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3158061180 0x7f3158063640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3154013470 tx=0x7f315400b040).stop 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f68a0 msgr2=0x7f31680fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f68a0 0x7f31680fa820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f315c002820 tx=0x7f315c009f00).stop 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 shutdown_connections 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:6800/2253178087,v1:172.21.15.135:6801/2253178087] conn(0x7f3158066d50 0x7f3158069190 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3158061180 0x7f3158063640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31680f68a0 0x7f31680fa820 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 --2- 172.21.15.26:0/513762881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31680f7b40 0x7f31680f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 >> 172.21.15.26:0/513762881 conn(0x7f31680f2020 msgr2=0x7f3168061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 shutdown_connections 2024-05-09T00:03:39.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:39.245+0000 7f316ebcc700 1 -- 172.21.15.26:0/513762881 wait complete. 2024-05-09T00:03:39.849 INFO:teuthology.orchestra.run.smithi026.stdout:38654705702 2024-05-09T00:03:39.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-09T00:03:40.119 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:38.545507+0000 mgr.smithi026.brymfp (mgr.14194) 163 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:40.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:38.545507+0000 mgr.smithi026.brymfp (mgr.14194) 163 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:40.552 INFO:teuthology.orchestra.run.smithi026.stdout:111669149716 2024-05-09T00:03:40.553 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-09T00:03:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 -- 172.21.15.26:0/2218137870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f79a0 msgr2=0x7f53e40f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/2218137870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f79a0 0x7f53e40f7dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f53d40047f0 tx=0x7f53d4009cb0).stop 2024-05-09T00:03:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 -- 172.21.15.26:0/2218137870 shutdown_connections 2024-05-09T00:03:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/2218137870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e40f8c40 0x7f53e40f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/2218137870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f79a0 0x7f53e40f7dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 -- 172.21.15.26:0/2218137870 >> 172.21.15.26:0/2218137870 conn(0x7f53e40f3100 msgr2=0x7f53e40f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 -- 172.21.15.26:0/2218137870 shutdown_connections 2024-05-09T00:03:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 -- 172.21.15.26:0/2218137870 wait complete. 2024-05-09T00:03:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 Processor -- start 2024-05-09T00:03:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.581+0000 7f53ea2c9700 1 -- start start 2024-05-09T00:03:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53ea2c9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e40f79a0 0x7f53e41081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53ea2c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f8c40 0x7f53e41086b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53ea2c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4108c60 con 0x7f53e40f8c40 2024-05-09T00:03:41.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53ea2c9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4108da0 con 0x7f53e40f79a0 2024-05-09T00:03:41.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f8c40 0x7f53e41086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:41.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f8c40 0x7f53e41086b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60158/0 (socket says 172.21.15.26:60158) 2024-05-09T00:03:41.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e37fe700 1 -- 172.21.15.26:0/1385379224 learned_addr learned my addr 172.21.15.26:0/1385379224 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:41.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e3fff700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e40f79a0 0x7f53e41081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:41.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e37fe700 1 -- 172.21.15.26:0/1385379224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e40f79a0 msgr2=0x7f53e41081c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e37fe700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e40f79a0 0x7f53e41081c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e37fe700 1 -- 172.21.15.26:0/1385379224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4005040 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e3fff700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e40f79a0 0x7f53e41081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e37fe700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f8c40 0x7f53e41086b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f53d800e8f0 tx=0x7f53d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d800ee90 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e410d840 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f53d800f040 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.582+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d800c8a0 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.583+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e410de00 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.583+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53e405f5f0 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.584+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f53d8007b40 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.584+0000 7f53e1775700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f53cc061180 0x7f53cc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.584+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f53d807c020 con 0x7f53e40f8c40 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.584+0000 7f53e3fff700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f53cc061180 0x7f53cc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:41.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.584+0000 7f53e1775700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] conn(0x7f53cc066da0 0x7f53cc0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:41.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.584+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 --> [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53cc069860 con 0x7f53cc066da0 2024-05-09T00:03:41.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.584+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53d807e570 con 0x7f53e40f8c40 2024-05-09T00:03:41.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.585+0000 7f53e8866700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] conn(0x7f53cc066da0 0x7f53cc0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:41.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.585+0000 7f53e3fff700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f53cc061180 0x7f53cc063640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f53d4009ee0 tx=0x7f53d400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.585+0000 7f53e8866700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] conn(0x7f53cc066da0 0x7f53cc0691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.585+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 <== osd.2 v2:172.21.15.26:6818/1690203303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f53cc069860 con 0x7f53cc066da0 2024-05-09T00:03:41.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.600+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 --> [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53e4059360 con 0x7f53cc066da0 2024-05-09T00:03:41.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.600+0000 7f53e1775700 1 -- 172.21.15.26:0/1385379224 <== osd.2 v2:172.21.15.26:6818/1690203303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53e4059360 con 0x7f53cc066da0 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] conn(0x7f53cc066da0 msgr2=0x7f53cc0691e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] conn(0x7f53cc066da0 0x7f53cc0691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f53cc061180 msgr2=0x7f53cc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f53cc061180 0x7f53cc063640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f53d4009ee0 tx=0x7f53d400b040).stop 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f8c40 msgr2=0x7f53e41086b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f8c40 0x7f53e41086b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f53d800e8f0 tx=0x7f53d800b040).stop 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 shutdown_connections 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f53cc061180 0x7f53cc063640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:6818/1690203303,v1:172.21.15.26:6819/1690203303] conn(0x7f53cc066da0 0x7f53cc0691e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e40f79a0 0x7f53e41081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 --2- 172.21.15.26:0/1385379224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53e40f8c40 0x7f53e41086b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 >> 172.21.15.26:0/1385379224 conn(0x7f53e40f3100 msgr2=0x7f53e40fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 shutdown_connections 2024-05-09T00:03:41.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.601+0000 7f53ea2c9700 1 -- 172.21.15.26:0/1385379224 wait complete. 2024-05-09T00:03:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.377+0000 7fcab6338700 1 -- 172.21.15.26:0/2953082399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 msgr2=0x7fcab00f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.377+0000 7fcab6338700 1 --2- 172.21.15.26:0/2953082399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 0x7fcab00f90a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fcaa40047f0 tx=0x7fcaa4009cb0).stop 2024-05-09T00:03:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.377+0000 7fcab6338700 1 -- 172.21.15.26:0/2953082399 shutdown_connections 2024-05-09T00:03:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.377+0000 7fcab6338700 1 --2- 172.21.15.26:0/2953082399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 0x7fcab00f90a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.377+0000 7fcab6338700 1 --2- 172.21.15.26:0/2953082399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcab00f79a0 0x7fcab00f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:03:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.377+0000 7fcab6338700 1 -- 172.21.15.26:0/2953082399 >> 172.21.15.26:0/2953082399 conn(0x7fcab00f3100 msgr2=0x7fcab00f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.377+0000 7fcab6338700 1 -- 172.21.15.26:0/2953082399 shutdown_connections 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.377+0000 7fcab6338700 1 -- 172.21.15.26:0/2953082399 wait complete. 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcab6338700 1 Processor -- start 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcab6338700 1 -- start start 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcab6338700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcab00f79a0 0x7fcab0108130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcab6338700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 0x7fcab0108620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcab6338700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0108c60 con 0x7fcab00f8c40 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcab6338700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0108da0 con 0x7fcab00f79a0 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcaaf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 0x7fcab0108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcaaf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 0x7fcab0108620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52822/0 (socket says 172.21.15.26:52822) 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcaaf7fe700 1 -- 172.21.15.26:0/115246923 learned_addr learned my addr 172.21.15.26:0/115246923 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.378+0000 7fcaaffff700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcab00f79a0 0x7fcab0108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcaaf7fe700 1 -- 172.21.15.26:0/115246923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcab00f79a0 msgr2=0x7fcab0108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcaaf7fe700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcab00f79a0 0x7fcab0108130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcaaf7fe700 1 -- 172.21.15.26:0/115246923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa4005040 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcaaf7fe700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 0x7fcab0108620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fcaa4013510 tx=0x7fcaa4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaa400e030 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcaa4007e90 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab010d7e0 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaa4018070 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.379+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab010dcc0 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.380+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcab005f5f0 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.380+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fcaa401d940 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcaad7fa700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fca98061160 0x7fca98063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fcaa407dab0 con 0x7fcab00f8c40 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcaaffff700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fca98061160 0x7fca98063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcaad7fa700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] conn(0x7fca98066d30 0x7fca98069170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 --> [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca980697f0 con 0x7fca98066d30 2024-05-09T00:03:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaa4082220 con 0x7fcab00f8c40 2024-05-09T00:03:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcab48d5700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] conn(0x7fca98066d30 0x7fca98069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcaaffff700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fca98061160 0x7fca98063620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fcaa0006fd0 tx=0x7fcaa0009060).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.381+0000 7fcab48d5700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] conn(0x7fca98066d30 0x7fca98069170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.382+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 <== osd.1 v2:172.21.15.26:6810/100863172 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fca980697f0 con 0x7fca98066d30 2024-05-09T00:03:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.396+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 --> [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcab0059360 con 0x7fca98066d30 2024-05-09T00:03:41.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.396+0000 7fcaad7fa700 1 -- 172.21.15.26:0/115246923 <== osd.1 v2:172.21.15.26:6810/100863172 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcab0059360 con 0x7fca98066d30 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] conn(0x7fca98066d30 msgr2=0x7fca98069170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] conn(0x7fca98066d30 0x7fca98069170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fca98061160 msgr2=0x7fca98063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fca98061160 0x7fca98063620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fcaa0006fd0 tx=0x7fcaa0009060).stop 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 msgr2=0x7fcab0108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 0x7fcab0108620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fcaa4013510 tx=0x7fcaa4009cb0).stop 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 shutdown_connections 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fca98061160 0x7fca98063620 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcab00f79a0 0x7fcab0108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:6810/100863172,v1:172.21.15.26:6811/100863172] conn(0x7fca98066d30 0x7fca98069170 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 --2- 172.21.15.26:0/115246923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcab00f8c40 0x7fcab0108620 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 >> 172.21.15.26:0/115246923 conn(0x7fcab00f3100 msgr2=0x7fcab00fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 shutdown_connections 2024-05-09T00:03:41.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:41.397+0000 7fcab6338700 1 -- 172.21.15.26:0/115246923 wait complete. 2024-05-09T00:03:41.987 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:40.545878+0000 mgr.smithi026.brymfp (mgr.14194) 164 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:42.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:40.545878+0000 mgr.smithi026.brymfp (mgr.14194) 164 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:42.389 INFO:teuthology.orchestra.run.smithi026.stdout:60129542174 2024-05-09T00:03:42.389 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 -- 172.21.15.26:0/972129258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f7b40 msgr2=0x7fbe7c0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 --2- 172.21.15.26:0/972129258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f7b40 0x7fbe7c0f7fa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fbe680047f0 tx=0x7fbe68009cb0).stop 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 -- 172.21.15.26:0/972129258 shutdown_connections 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 --2- 172.21.15.26:0/972129258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f7b40 0x7fbe7c0f7fa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 --2- 172.21.15.26:0/972129258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f68a0 0x7fbe7c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 -- 172.21.15.26:0/972129258 >> 172.21.15.26:0/972129258 conn(0x7fbe7c0f2020 msgr2=0x7fbe7c0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 -- 172.21.15.26:0/972129258 shutdown_connections 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 -- 172.21.15.26:0/972129258 wait complete. 2024-05-09T00:03:42.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 Processor -- start 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.387+0000 7fbe82fad700 1 -- start start 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe82fad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f68a0 0x7fbe7c0fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe82fad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f7b40 0x7fbe7c0f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe82fad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0fadd0 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe82fad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0f9370 con 0x7fbe7c0f7b40 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe80d49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f68a0 0x7fbe7c0fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe80d49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f68a0 0x7fbe7c0fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52804/0 (socket says 172.21.15.26:52804) 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe80d49700 1 -- 172.21.15.26:0/3067212191 learned_addr learned my addr 172.21.15.26:0/3067212191 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe7bfff700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f7b40 0x7fbe7c0f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe80d49700 1 -- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f7b40 msgr2=0x7fbe7c0f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe80d49700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f7b40 0x7fbe7c0f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe80d49700 1 -- 172.21.15.26:0/3067212191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68005040 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe80d49700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f68a0 0x7fbe7c0fa820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fbe70002780 tx=0x7fbe70009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe70007b40 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c0f95f0 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbe7000f040 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.388+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe700146f0 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.389+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c0f9b30 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.389+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe7c061c00 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.390+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fbe70007ca0 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.390+0000 7fbe79ffb700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fbe6c0611d0 0x7fbe6c063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:42.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.390+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fbe7007c580 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.390+0000 7fbe7bfff700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fbe6c0611d0 0x7fbe6c063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.390+0000 7fbe79ffb700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] conn(0x7fbe6c066da0 0x7fbe6c0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.390+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 --> [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe6c069860 con 0x7fbe6c066da0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.390+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe7007ea40 con 0x7fbe7c0f68a0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.391+0000 7fbe7bfff700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fbe6c0611d0 0x7fbe6c063690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbe68004f10 tx=0x7fbe6800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.391+0000 7fbe8154a700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] conn(0x7fbe6c066da0 0x7fbe6c0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.391+0000 7fbe8154a700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] conn(0x7fbe6c066da0 0x7fbe6c0691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.392+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 <== osd.5 v2:172.21.15.135:6816/3212995324 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fbe6c069860 con 0x7fbe6c066da0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.406+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 --> [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe7c0fc1c0 con 0x7fbe6c066da0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.406+0000 7fbe79ffb700 1 -- 172.21.15.26:0/3067212191 <== osd.5 v2:172.21.15.135:6816/3212995324 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbe7c0fc1c0 con 0x7fbe6c066da0 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] conn(0x7fbe6c066da0 msgr2=0x7fbe6c0691e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] conn(0x7fbe6c066da0 0x7fbe6c0691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:42.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fbe6c0611d0 msgr2=0x7fbe6c063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fbe6c0611d0 0x7fbe6c063690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbe68004f10 tx=0x7fbe6800b040).stop 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f68a0 msgr2=0x7fbe7c0fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f68a0 0x7fbe7c0fa820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fbe70002780 tx=0x7fbe70009ee0).stop 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 shutdown_connections 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fbe6c0611d0 0x7fbe6c063690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:6816/3212995324,v1:172.21.15.135:6817/3212995324] conn(0x7fbe6c066da0 0x7fbe6c0691e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f68a0 0x7fbe7c0fa820 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 --2- 172.21.15.26:0/3067212191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f7b40 0x7fbe7c0f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 >> 172.21.15.26:0/3067212191 conn(0x7fbe7c0f2020 msgr2=0x7fbe7c061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 shutdown_connections 2024-05-09T00:03:42.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:40.407+0000 7fbe82fad700 1 -- 172.21.15.26:0/3067212191 wait complete. 2024-05-09T00:03:43.387 INFO:teuthology.orchestra.run.smithi026.stdout:158913789961 2024-05-09T00:03:43.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-09T00:03:43.849 INFO:teuthology.orchestra.run.smithi026.stdout:81604378650 2024-05-09T00:03:43.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-09T00:03:43.965 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:42.546190+0000 mgr.smithi026.brymfp (mgr.14194) 165 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:44.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:42.546190+0000 mgr.smithi026.brymfp (mgr.14194) 165 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:44.396 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.099+0000 7f036b816700 1 -- 172.21.15.26:0/4026200925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f8c40 msgr2=0x7f03640f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.099+0000 7f036b816700 1 --2- 172.21.15.26:0/4026200925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f8c40 0x7f03640f90a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f03540047f0 tx=0x7f0354009cb0).stop 2024-05-09T00:03:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.100+0000 7f036b816700 1 -- 172.21.15.26:0/4026200925 shutdown_connections 2024-05-09T00:03:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.100+0000 7f036b816700 1 --2- 172.21.15.26:0/4026200925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f8c40 0x7f03640f90a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.100+0000 7f036b816700 1 --2- 172.21.15.26:0/4026200925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03640f79a0 0x7f03640f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:03:45.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.100+0000 7f036b816700 1 -- 172.21.15.26:0/4026200925 >> 172.21.15.26:0/4026200925 conn(0x7f03640f3100 msgr2=0x7f03640f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.100+0000 7f036b816700 1 -- 172.21.15.26:0/4026200925 shutdown_connections 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.100+0000 7f036b816700 1 -- 172.21.15.26:0/4026200925 wait complete. 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.100+0000 7f036b816700 1 Processor -- start 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.100+0000 7f036b816700 1 -- start start 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f036b816700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f79a0 0x7f0364108130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f036b816700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03640f8c40 0x7f0364108620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f036b816700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0364108c60 con 0x7f03640f79a0 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f036b816700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0364108da0 con 0x7f03640f8c40 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f03695b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f79a0 0x7f0364108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f03695b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f79a0 0x7f0364108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60182/0 (socket says 172.21.15.26:60182) 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f03695b2700 1 -- 172.21.15.26:0/2034743709 learned_addr learned my addr 172.21.15.26:0/2034743709 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f0368db1700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03640f8c40 0x7f0364108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f03695b2700 1 -- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03640f8c40 msgr2=0x7f0364108620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f03695b2700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03640f8c40 0x7f0364108620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f03695b2700 1 -- 172.21.15.26:0/2034743709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0354005040 con 0x7f03640f79a0 2024-05-09T00:03:45.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f03695b2700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f79a0 0x7f0364108130 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f036000b480 tx=0x7f03600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0360002500 con 0x7f03640f79a0 2024-05-09T00:03:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0360002af0 con 0x7f03640f79a0 2024-05-09T00:03:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036410d840 con 0x7f03640f79a0 2024-05-09T00:03:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0360012c40 con 0x7f03640f79a0 2024-05-09T00:03:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.101+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036410dd80 con 0x7f03640f79a0 2024-05-09T00:03:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.102+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f036405f5f0 con 0x7f03640f79a0 2024-05-09T00:03:45.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.103+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f0360002660 con 0x7f03640f79a0 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.103+0000 7f035a7fc700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0350061180 0x7f0350063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.103+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f036007c4f0 con 0x7f03640f79a0 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.103+0000 7f0368db1700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0350061180 0x7f0350063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.103+0000 7f035a7fc700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] conn(0x7f0350066d50 0x7f0350069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.103+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 --> [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0350069810 con 0x7f0350066d50 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.103+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f036007eb60 con 0x7f03640f79a0 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.103+0000 7f0368db1700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0350061180 0x7f0350063640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f0354007cf0 tx=0x7f0354009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.104+0000 7f0369db3700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] conn(0x7f0350066d50 0x7f0350069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.104+0000 7f0369db3700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] conn(0x7f0350066d50 0x7f0350069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.105+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 <== osd.4 v2:172.21.15.135:6808/3525260045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f0350069810 con 0x7f0350066d50 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.119+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 --> [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0364059360 con 0x7f0350066d50 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f035a7fc700 1 -- 172.21.15.26:0/2034743709 <== osd.4 v2:172.21.15.135:6808/3525260045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0364059360 con 0x7f0350066d50 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] conn(0x7f0350066d50 msgr2=0x7f0350069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] conn(0x7f0350066d50 0x7f0350069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0350061180 msgr2=0x7f0350063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:45.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0350061180 0x7f0350063640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f0354007cf0 tx=0x7f0354009cb0).stop 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f79a0 msgr2=0x7f0364108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f79a0 0x7f0364108130 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f036000b480 tx=0x7f03600090f0).stop 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 shutdown_connections 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:6808/3525260045,v1:172.21.15.135:6809/3525260045] conn(0x7f0350066d50 0x7f0350069190 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0350061180 0x7f0350063640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03640f79a0 0x7f0364108130 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 --2- 172.21.15.26:0/2034743709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03640f8c40 0x7f0364108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 >> 172.21.15.26:0/2034743709 conn(0x7f03640f3100 msgr2=0x7f03640fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 shutdown_connections 2024-05-09T00:03:45.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:45.120+0000 7f036b816700 1 -- 172.21.15.26:0/2034743709 wait complete. 2024-05-09T00:03:45.789 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:46.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:44.546624+0000 mgr.smithi026.brymfp (mgr.14194) 166 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:46.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:44.546624+0000 mgr.smithi026.brymfp (mgr.14194) 166 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:46.581 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:47.533 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:47.561 INFO:teuthology.orchestra.run.smithi026.stdout:137438953487 2024-05-09T00:03:47.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-09T00:03:47.802 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:46.547163+0000 mgr.smithi026.brymfp (mgr.14194) 167 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:48.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:46.547163+0000 mgr.smithi026.brymfp (mgr.14194) 167 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:50.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:48.547683+0000 mgr.smithi026.brymfp (mgr.14194) 168 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:50.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:48.547683+0000 mgr.smithi026.brymfp (mgr.14194) 168 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:51.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.531+0000 7f07a1794700 1 -- 172.21.15.26:0/2468608911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f8c50 msgr2=0x7f079c0f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:51.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.531+0000 7f07a1794700 1 --2- 172.21.15.26:0/2468608911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f8c50 0x7f079c0f90b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f07900047f0 tx=0x7f0790009cb0).stop 2024-05-09T00:03:51.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.531+0000 7f07a1794700 1 -- 172.21.15.26:0/2468608911 shutdown_connections 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.531+0000 7f07a1794700 1 --2- 172.21.15.26:0/2468608911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f8c50 0x7f079c0f90b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.531+0000 7f07a1794700 1 --2- 172.21.15.26:0/2468608911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c0f79b0 0x7f079c0f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.531+0000 7f07a1794700 1 -- 172.21.15.26:0/2468608911 >> 172.21.15.26:0/2468608911 conn(0x7f079c0f30f0 msgr2=0x7f079c0f5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.532+0000 7f07a1794700 1 -- 172.21.15.26:0/2468608911 shutdown_connections 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.532+0000 7f07a1794700 1 -- 172.21.15.26:0/2468608911 wait complete. 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.532+0000 7f07a1794700 1 Processor -- start 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f07a1794700 1 -- start start 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f07a1794700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f79b0 0x7f079c108070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f07a1794700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c0f8c50 0x7f079c108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f07a1794700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c108b10 con 0x7f079c0f79b0 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f07a1794700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c108c50 con 0x7f079c0f8c50 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f079affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f79b0 0x7f079c108070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f079affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f79b0 0x7f079c108070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60186/0 (socket says 172.21.15.26:60186) 2024-05-09T00:03:51.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f079affd700 1 -- 172.21.15.26:0/2653442130 learned_addr learned my addr 172.21.15.26:0/2653442130 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f079a7fc700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c0f8c50 0x7f079c108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f079affd700 1 -- 172.21.15.26:0/2653442130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c0f8c50 msgr2=0x7f079c108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f079affd700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c0f8c50 0x7f079c108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f079affd700 1 -- 172.21.15.26:0/2653442130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790005040 con 0x7f079c0f79b0 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.533+0000 7f079affd700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f79b0 0x7f079c108070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f078c00c790 tx=0x7f078c007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.534+0000 7f0783fff700 1 -- 172.21.15.26:0/2653442130 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f078c0106f0 con 0x7f079c0f79b0 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.534+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c10d6f0 con 0x7f079c0f79b0 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.534+0000 7f0783fff700 1 -- 172.21.15.26:0/2653442130 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f078c010ce0 con 0x7f079c0f79b0 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.534+0000 7f0783fff700 1 -- 172.21.15.26:0/2653442130 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f078c012c80 con 0x7f079c0f79b0 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.534+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c10dc30 con 0x7f079c0f79b0 2024-05-09T00:03:51.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.535+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c100120 con 0x7f079c0f79b0 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stdout:60129542176 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.535+0000 7f0783fff700 1 -- 172.21.15.26:0/2653442130 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f078c012400 con 0x7f079c0f79b0 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.535+0000 7f0783fff700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0784061180 0x7f0784063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.536+0000 7f0783fff700 1 -- 172.21.15.26:0/2653442130 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f078c07bfb0 con 0x7f079c0f79b0 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.536+0000 7f079a7fc700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0784061180 0x7f0784063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.536+0000 7f079a7fc700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0784061180 0x7f0784063640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0790000c00 tx=0x7f0790009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.540+0000 7f0783fff700 1 -- 172.21.15.26:0/2653442130 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f078c048f60 con 0x7f079c0f79b0 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.712+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f079c101f90 con 0x7f079c0f79b0 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.712+0000 7f0783fff700 1 -- 172.21.15.26:0/2653442130 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f078c050280 con 0x7f079c0f79b0 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0784061180 msgr2=0x7f0784063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0784061180 0x7f0784063640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0790000c00 tx=0x7f0790009cb0).stop 2024-05-09T00:03:51.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f79b0 msgr2=0x7f079c108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f79b0 0x7f079c108070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f078c00c790 tx=0x7f078c007f70).stop 2024-05-09T00:03:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 shutdown_connections 2024-05-09T00:03:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0784061180 0x7f0784063640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f079c0f79b0 0x7f079c108070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 --2- 172.21.15.26:0/2653442130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c0f8c50 0x7f079c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 >> 172.21.15.26:0/2653442130 conn(0x7f079c0f30f0 msgr2=0x7f079c0fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 shutdown_connections 2024-05-09T00:03:51.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:50.714+0000 7f07a1794700 1 -- 172.21.15.26:0/2653442130 wait complete. 2024-05-09T00:03:51.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:50.547947+0000 mgr.smithi026.brymfp (mgr.14194) 169 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:51.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:50.713841+0000 mon.smithi026 (mon.0) 484 : audit [DBG] from='client.? 172.21.15.26:0/2653442130' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T00:03:51.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.955+0000 7f0d440e8700 1 -- 172.21.15.26:0/1213469369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 msgr2=0x7f0d3c0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:51.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.955+0000 7f0d440e8700 1 --2- 172.21.15.26:0/1213469369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 0x7f0d3c0fcf60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f0d380047f0 tx=0x7f0d38009cb0).stop 2024-05-09T00:03:51.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.955+0000 7f0d440e8700 1 -- 172.21.15.26:0/1213469369 shutdown_connections 2024-05-09T00:03:51.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.955+0000 7f0d440e8700 1 --2- 172.21.15.26:0/1213469369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 0x7f0d3c0fcf60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.955+0000 7f0d440e8700 1 --2- 172.21.15.26:0/1213469369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c061740 0x7f0d3c0fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.955+0000 7f0d440e8700 1 -- 172.21.15.26:0/1213469369 >> 172.21.15.26:0/1213469369 conn(0x7f0d3c0f2020 msgr2=0x7f0d3c0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:51.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.956+0000 7f0d440e8700 1 -- 172.21.15.26:0/1213469369 shutdown_connections 2024-05-09T00:03:51.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.956+0000 7f0d440e8700 1 -- 172.21.15.26:0/1213469369 wait complete. 2024-05-09T00:03:51.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.956+0000 7f0d440e8700 1 Processor -- start 2024-05-09T00:03:51.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.956+0000 7f0d440e8700 1 -- start start 2024-05-09T00:03:51.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d440e8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c061740 0x7f0d3c108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d440e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 0x7f0d3c108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d440e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c108b20 con 0x7f0d3c0fab10 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d440e8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c108c60 con 0x7f0d3c061740 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41683700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 0x7f0d3c108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41683700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 0x7f0d3c108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40570/0 (socket says 172.21.15.26:40570) 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41683700 1 -- 172.21.15.26:0/2679654599 learned_addr learned my addr 172.21.15.26:0/2679654599 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41e84700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c061740 0x7f0d3c108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41683700 1 -- 172.21.15.26:0/2679654599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c061740 msgr2=0x7f0d3c108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41683700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c061740 0x7f0d3c108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41683700 1 -- 172.21.15.26:0/2679654599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d38005040 con 0x7f0d3c0fab10 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41e84700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c061740 0x7f0d3c108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d41683700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 0x7f0d3c108570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f0d38013470 tx=0x7f0d38009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:51.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d32ffd700 1 -- 172.21.15.26:0/2679654599 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d3800e030 con 0x7f0d3c0fab10 2024-05-09T00:03:51.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.957+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c10d6a0 con 0x7f0d3c0fab10 2024-05-09T00:03:51.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.958+0000 7f0d32ffd700 1 -- 172.21.15.26:0/2679654599 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0d38007e90 con 0x7f0d3c0fab10 2024-05-09T00:03:51.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.958+0000 7f0d32ffd700 1 -- 172.21.15.26:0/2679654599 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d38018070 con 0x7f0d3c0fab10 2024-05-09T00:03:51.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.958+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c10dbe0 con 0x7f0d3c0fab10 2024-05-09T00:03:51.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.958+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3c100100 con 0x7f0d3c0fab10 2024-05-09T00:03:51.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.959+0000 7f0d32ffd700 1 -- 172.21.15.26:0/2679654599 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f0d3801d9b0 con 0x7f0d3c0fab10 2024-05-09T00:03:51.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.959+0000 7f0d32ffd700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0d28061180 0x7f0d28063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:51.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.959+0000 7f0d32ffd700 1 -- 172.21.15.26:0/2679654599 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f0d3807dca0 con 0x7f0d3c0fab10 2024-05-09T00:03:51.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.959+0000 7f0d41e84700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0d28061180 0x7f0d28063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:51.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.960+0000 7f0d41e84700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0d28061180 0x7f0d28063640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0d2c0041d0 tx=0x7f0d2c009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:51.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:51.964+0000 7f0d32ffd700 1 -- 172.21.15.26:0/2679654599 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0d38082070 con 0x7f0d3c0fab10 2024-05-09T00:03:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.138+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d3c0598f0 con 0x7f0d3c0fab10 2024-05-09T00:03:52.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.139+0000 7f0d32ffd700 1 -- 172.21.15.26:0/2679654599 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d38051f70 con 0x7f0d3c0fab10 2024-05-09T00:03:52.134 INFO:teuthology.orchestra.run.smithi026.stdout:38654705705 2024-05-09T00:03:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.140+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0d28061180 msgr2=0x7f0d28063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.140+0000 7f0d440e8700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0d28061180 0x7f0d28063640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0d2c0041d0 tx=0x7f0d2c009040).stop 2024-05-09T00:03:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.140+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 msgr2=0x7f0d3c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.140+0000 7f0d440e8700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 0x7f0d3c108570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f0d38013470 tx=0x7f0d38009cb0).stop 2024-05-09T00:03:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.140+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 shutdown_connections 2024-05-09T00:03:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.140+0000 7f0d440e8700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0d28061180 0x7f0d28063640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:52.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.140+0000 7f0d440e8700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d3c061740 0x7f0d3c108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.140+0000 7f0d440e8700 1 --2- 172.21.15.26:0/2679654599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d3c0fab10 0x7f0d3c108570 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.141+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 >> 172.21.15.26:0/2679654599 conn(0x7f0d3c0f2020 msgr2=0x7f0d3c0f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.141+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 shutdown_connections 2024-05-09T00:03:52.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:52.141+0000 7f0d440e8700 1 -- 172.21.15.26:0/2679654599 wait complete. 2024-05-09T00:03:52.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:50.547947+0000 mgr.smithi026.brymfp (mgr.14194) 169 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:52.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:50.713841+0000 mon.smithi026 (mon.0) 484 : audit [DBG] from='client.? 172.21.15.26:0/2653442130' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T00:03:52.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-05-09T00:03:52.666 DEBUG:teuthology.parallel:result is None 2024-05-09T00:03:52.919 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:52.140407+0000 mon.smithi026 (mon.0) 485 : audit [DBG] from='client.? 172.21.15.26:0/2679654599' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T00:03:53.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:52.140407+0000 mon.smithi026 (mon.0) 485 : audit [DBG] from='client.? 172.21.15.26:0/2679654599' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T00:03:53.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.234+0000 7fa0a42a5700 1 -- 172.21.15.26:0/4166181566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 msgr2=0x7fa09c0f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:53.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.234+0000 7fa0a42a5700 1 --2- 172.21.15.26:0/4166181566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 0x7fa09c0f7d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa0980047f0 tx=0x7fa098009cb0).stop 2024-05-09T00:03:53.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.234+0000 7fa0a42a5700 1 -- 172.21.15.26:0/4166181566 shutdown_connections 2024-05-09T00:03:53.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.234+0000 7fa0a42a5700 1 --2- 172.21.15.26:0/4166181566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa09c0f8b90 0x7fa09c0f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:03:53.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.234+0000 7fa0a42a5700 1 --2- 172.21.15.26:0/4166181566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 0x7fa09c0f7d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:53.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.234+0000 7fa0a42a5700 1 -- 172.21.15.26:0/4166181566 >> 172.21.15.26:0/4166181566 conn(0x7fa09c0f3050 msgr2=0x7fa09c0f5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:53.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.234+0000 7fa0a42a5700 1 -- 172.21.15.26:0/4166181566 shutdown_connections 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.234+0000 7fa0a42a5700 1 -- 172.21.15.26:0/4166181566 wait complete. 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a42a5700 1 Processor -- start 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a42a5700 1 -- start start 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a42a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 0x7fa09c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a42a5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa09c0f8b90 0x7fa09c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a42a5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c06b620 con 0x7fa09c0f78f0 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a42a5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c06b760 con 0x7fa09c0f8b90 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a2041700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 0x7fa09c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a2041700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 0x7fa09c06cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40578/0 (socket says 172.21.15.26:40578) 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a2041700 1 -- 172.21.15.26:0/3125867558 learned_addr learned my addr 172.21.15.26:0/3125867558 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a1840700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa09c0f8b90 0x7fa09c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a2041700 1 -- 172.21.15.26:0/3125867558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa09c0f8b90 msgr2=0x7fa09c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.235+0000 7fa0a2041700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa09c0f8b90 0x7fa09c06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:53.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.236+0000 7fa0a2041700 1 -- 172.21.15.26:0/3125867558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098005040 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.236+0000 7fa0a2041700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 0x7fa09c06cbb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fa098013470 tx=0x7fa098009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.236+0000 7fa093779700 1 -- 172.21.15.26:0/3125867558 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa09800e030 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.236+0000 7fa093779700 1 -- 172.21.15.26:0/3125867558 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa098007e90 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.236+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c06b9e0 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.236+0000 7fa093779700 1 -- 172.21.15.26:0/3125867558 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa098018070 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.236+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c110140 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.237+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c046ce0 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.237+0000 7fa093779700 1 -- 172.21.15.26:0/3125867558 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fa09801d940 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.238+0000 7fa093779700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa0880611d0 0x7fa088063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.238+0000 7fa093779700 1 -- 172.21.15.26:0/3125867558 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fa09807db30 con 0x7fa09c0f78f0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.238+0000 7fa0a1840700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa0880611d0 0x7fa088063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.238+0000 7fa0a1840700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa0880611d0 0x7fa088063690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa08c009990 tx=0x7fa08c008040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:53.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.242+0000 7fa093779700 1 -- 172.21.15.26:0/3125867558 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa09804e3d0 con 0x7fa09c0f78f0 2024-05-09T00:03:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.417+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa09c100130 con 0x7fa09c0f78f0 2024-05-09T00:03:53.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.418+0000 7fa093779700 1 -- 172.21.15.26:0/3125867558 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0980519f0 con 0x7fa09c0f78f0 2024-05-09T00:03:53.412 INFO:teuthology.orchestra.run.smithi026.stdout:81604378652 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa0880611d0 msgr2=0x7fa088063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa0880611d0 0x7fa088063690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa08c009990 tx=0x7fa08c008040).stop 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 msgr2=0x7fa09c06cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 0x7fa09c06cbb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fa098013470 tx=0x7fa098009cb0).stop 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 shutdown_connections 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa0880611d0 0x7fa088063690 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa09c0f78f0 0x7fa09c06cbb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 --2- 172.21.15.26:0/3125867558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa09c0f8b90 0x7fa09c06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 >> 172.21.15.26:0/3125867558 conn(0x7fa09c0f3050 msgr2=0x7fa09c0fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 shutdown_connections 2024-05-09T00:03:53.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:53.419+0000 7fa0a42a5700 1 -- 172.21.15.26:0/3125867558 wait complete. 2024-05-09T00:03:54.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:52.548287+0000 mgr.smithi026.brymfp (mgr.14194) 170 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:54.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:53.419322+0000 mon.smithi026 (mon.0) 486 : audit [DBG] from='client.? 172.21.15.26:0/3125867558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T00:03:54.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:52.548287+0000 mgr.smithi026.brymfp (mgr.14194) 170 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:54.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:53.419322+0000 mon.smithi026 (mon.0) 486 : audit [DBG] from='client.? 172.21.15.26:0/3125867558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T00:03:54.241 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378650 got 81604378652 for osd.2 2024-05-09T00:03:54.241 DEBUG:teuthology.parallel:result is None 2024-05-09T00:03:54.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 -- 172.21.15.26:0/3976853053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f7b40 msgr2=0x7f18540f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:54.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 --2- 172.21.15.26:0/3976853053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f7b40 0x7f18540f7fa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f18500047f0 tx=0x7f1850009cb0).stop 2024-05-09T00:03:54.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 -- 172.21.15.26:0/3976853053 shutdown_connections 2024-05-09T00:03:54.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 --2- 172.21.15.26:0/3976853053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f7b40 0x7f18540f7fa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:54.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 --2- 172.21.15.26:0/3976853053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540f68a0 0x7f18540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 -- 172.21.15.26:0/3976853053 >> 172.21.15.26:0/3976853053 conn(0x7f18540f2020 msgr2=0x7f18540f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 -- 172.21.15.26:0/3976853053 shutdown_connections 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 -- 172.21.15.26:0/3976853053 wait complete. 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 Processor -- start 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.407+0000 7f185b56a700 1 -- start start 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f185b56a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f68a0 0x7f18540615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f185b56a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540f7b40 0x7f185410ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f185b56a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185410d360 con 0x7f18540f68a0 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f185b56a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185410d4a0 con 0x7f18540f7b40 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f1859306700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f68a0 0x7f18540615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f1859306700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f68a0 0x7f18540615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40602/0 (socket says 172.21.15.26:40602) 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f1859306700 1 -- 172.21.15.26:0/836496369 learned_addr learned my addr 172.21.15.26:0/836496369 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:54.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f1858b05700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540f7b40 0x7f185410ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f1859306700 1 -- 172.21.15.26:0/836496369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540f7b40 msgr2=0x7f185410ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f1859306700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540f7b40 0x7f185410ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f1859306700 1 -- 172.21.15.26:0/836496369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850005040 con 0x7f18540f68a0 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f1859306700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f68a0 0x7f18540615c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f184800c7c0 tx=0x7f1848007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f18467fc700 1 -- 172.21.15.26:0/836496369 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18480106f0 con 0x7f18540f68a0 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185410d700 con 0x7f18540f68a0 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f18467fc700 1 -- 172.21.15.26:0/836496369 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1848010ce0 con 0x7f18540f68a0 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f18467fc700 1 -- 172.21.15.26:0/836496369 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1848012c70 con 0x7f18540f68a0 2024-05-09T00:03:54.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.408+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185410dc40 con 0x7f18540f68a0 2024-05-09T00:03:54.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.409+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18540ff010 con 0x7f18540f68a0 2024-05-09T00:03:54.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.410+0000 7f18467fc700 1 -- 172.21.15.26:0/836496369 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f1848012400 con 0x7f18540f68a0 2024-05-09T00:03:54.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.410+0000 7f18467fc700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1840061180 0x7f1840063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:54.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.410+0000 7f18467fc700 1 -- 172.21.15.26:0/836496369 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f184807bf00 con 0x7f18540f68a0 2024-05-09T00:03:54.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.410+0000 7f1858b05700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1840061180 0x7f1840063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:54.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.410+0000 7f1858b05700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1840061180 0x7f1840063640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1850004f10 tx=0x7f185000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:54.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.414+0000 7f18467fc700 1 -- 172.21.15.26:0/836496369 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1848048f60 con 0x7f18540f68a0 2024-05-09T00:03:54.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.588+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f18540599b0 con 0x7f18540f68a0 2024-05-09T00:03:54.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.588+0000 7f18467fc700 1 -- 172.21.15.26:0/836496369 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18480501d0 con 0x7f18540f68a0 2024-05-09T00:03:54.583 INFO:teuthology.orchestra.run.smithi026.stdout:158913789963 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1840061180 msgr2=0x7f1840063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1840061180 0x7f1840063640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1850004f10 tx=0x7f185000b040).stop 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f68a0 msgr2=0x7f18540615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f68a0 0x7f18540615c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f184800c7c0 tx=0x7f1848007f70).stop 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 shutdown_connections 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1840061180 0x7f1840063640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18540f68a0 0x7f18540615c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 --2- 172.21.15.26:0/836496369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540f7b40 0x7f185410ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 >> 172.21.15.26:0/836496369 conn(0x7f18540f2020 msgr2=0x7f18540fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 shutdown_connections 2024-05-09T00:03:54.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:54.590+0000 7f185b56a700 1 -- 172.21.15.26:0/836496369 wait complete. 2024-05-09T00:03:54.843 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:54.589768+0000 mon.smithi026 (mon.0) 487 : audit [DBG] from='client.? 172.21.15.26:0/836496369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T00:03:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:03:54.869 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705702 got 38654705705 for osd.0 2024-05-09T00:03:54.869 DEBUG:teuthology.parallel:result is None 2024-05-09T00:03:55.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:54.589768+0000 mon.smithi026 (mon.0) 487 : audit [DBG] from='client.? 172.21.15.26:0/836496369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T00:03:55.883 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789961 got 158913789963 for osd.5 2024-05-09T00:03:55.883 DEBUG:teuthology.parallel:result is None 2024-05-09T00:03:56.137 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:54.548556+0000 mgr.smithi026.brymfp (mgr.14194) 171 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:56.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:54.548556+0000 mgr.smithi026.brymfp (mgr.14194) 171 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.087+0000 7ff39bc80700 1 -- 172.21.15.26:0/30629631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 msgr2=0x7ff3940f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.087+0000 7ff39bc80700 1 --2- 172.21.15.26:0/30629631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 0x7ff3940f7dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff3880047f0 tx=0x7ff388009cb0).stop 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.087+0000 7ff39bc80700 1 -- 172.21.15.26:0/30629631 shutdown_connections 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.087+0000 7ff39bc80700 1 --2- 172.21.15.26:0/30629631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3940f8c40 0x7ff3940f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.087+0000 7ff39bc80700 1 --2- 172.21.15.26:0/30629631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 0x7ff3940f7dc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.087+0000 7ff39bc80700 1 -- 172.21.15.26:0/30629631 >> 172.21.15.26:0/30629631 conn(0x7ff3940f3100 msgr2=0x7ff3940f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.087+0000 7ff39bc80700 1 -- 172.21.15.26:0/30629631 shutdown_connections 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.087+0000 7ff39bc80700 1 -- 172.21.15.26:0/30629631 wait complete. 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff39bc80700 1 Processor -- start 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff39bc80700 1 -- start start 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff39bc80700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 0x7ff3941081e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:56.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff39bc80700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3940f8c40 0x7ff3941086d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff39bc80700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394108c80 con 0x7ff3940f79a0 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff39bc80700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff394108dc0 con 0x7ff3940f8c40 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff399a1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 0x7ff3941081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff399a1c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 0x7ff3941081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40616/0 (socket says 172.21.15.26:40616) 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.088+0000 7ff399a1c700 1 -- 172.21.15.26:0/1383874455 learned_addr learned my addr 172.21.15.26:0/1383874455 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff39921b700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3940f8c40 0x7ff3941086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff399a1c700 1 -- 172.21.15.26:0/1383874455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3940f8c40 msgr2=0x7ff3941086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff399a1c700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3940f8c40 0x7ff3941086d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff399a1c700 1 -- 172.21.15.26:0/1383874455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388005040 con 0x7ff3940f79a0 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff39921b700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3940f8c40 0x7ff3941086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff399a1c700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 0x7ff3941081e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff388013580 tx=0x7ff388009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff386ffd700 1 -- 172.21.15.26:0/1383874455 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff388018070 con 0x7ff3940f79a0 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39410d800 con 0x7ff3940f79a0 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff386ffd700 1 -- 172.21.15.26:0/1383874455 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff388007e90 con 0x7ff3940f79a0 2024-05-09T00:03:56.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff386ffd700 1 -- 172.21.15.26:0/1383874455 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3880123c0 con 0x7ff3940f79a0 2024-05-09T00:03:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.089+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39410ddc0 con 0x7ff3940f79a0 2024-05-09T00:03:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.090+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff394100110 con 0x7ff3940f79a0 2024-05-09T00:03:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.090+0000 7ff386ffd700 1 -- 172.21.15.26:0/1383874455 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ff38801d420 con 0x7ff3940f79a0 2024-05-09T00:03:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.091+0000 7ff386ffd700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff380061180 0x7ff380063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.091+0000 7ff386ffd700 1 -- 172.21.15.26:0/1383874455 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7ff38807d1d0 con 0x7ff3940f79a0 2024-05-09T00:03:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.091+0000 7ff39921b700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff380061180 0x7ff380063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.091+0000 7ff39921b700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff380061180 0x7ff380063640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff390009f20 tx=0x7ff39000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:56.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.095+0000 7ff386ffd700 1 -- 172.21.15.26:0/1383874455 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff3880514a0 con 0x7ff3940f79a0 2024-05-09T00:03:56.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.273+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3940598f0 con 0x7ff3940f79a0 2024-05-09T00:03:56.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.273+0000 7ff386ffd700 1 -- 172.21.15.26:0/1383874455 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff388051090 con 0x7ff3940f79a0 2024-05-09T00:03:56.268 INFO:teuthology.orchestra.run.smithi026.stdout:111669149719 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff380061180 msgr2=0x7ff380063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff380061180 0x7ff380063640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff390009f20 tx=0x7ff39000b040).stop 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 msgr2=0x7ff3941081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 0x7ff3941081e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff388013580 tx=0x7ff388009cb0).stop 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 shutdown_connections 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff380061180 0x7ff380063640 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3940f79a0 0x7ff3941081e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 --2- 172.21.15.26:0/1383874455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3940f8c40 0x7ff3941086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 >> 172.21.15.26:0/1383874455 conn(0x7ff3940f3100 msgr2=0x7ff3940fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 shutdown_connections 2024-05-09T00:03:56.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:56.275+0000 7ff39bc80700 1 -- 172.21.15.26:0/1383874455 wait complete. 2024-05-09T00:03:57.114 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:56.274974+0000 mon.smithi026 (mon.0) 488 : audit [DBG] from='client.? 172.21.15.26:0/1383874455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T00:03:57.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:56.274974+0000 mon.smithi026 (mon.0) 488 : audit [DBG] from='client.? 172.21.15.26:0/1383874455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T00:03:57.835 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:56.548907+0000 mgr.smithi026.brymfp (mgr.14194) 172 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:57.858 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149719 for osd.3 2024-05-09T00:03:57.858 DEBUG:teuthology.parallel:result is None 2024-05-09T00:03:58.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:56.548907+0000 mgr.smithi026.brymfp (mgr.14194) 172 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:03:58.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 -- 172.21.15.26:0/2804810923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f7b40 msgr2=0x7fb9200f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 --2- 172.21.15.26:0/2804810923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f7b40 0x7fb9200f7fa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fb90c004730 tx=0x7fb90c009cb0).stop 2024-05-09T00:03:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 -- 172.21.15.26:0/2804810923 shutdown_connections 2024-05-09T00:03:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 --2- 172.21.15.26:0/2804810923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f7b40 0x7fb9200f7fa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 --2- 172.21.15.26:0/2804810923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9200f68a0 0x7fb9200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 -- 172.21.15.26:0/2804810923 >> 172.21.15.26:0/2804810923 conn(0x7fb9200f2020 msgr2=0x7fb9200f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 -- 172.21.15.26:0/2804810923 shutdown_connections 2024-05-09T00:03:58.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 -- 172.21.15.26:0/2804810923 wait complete. 2024-05-09T00:03:58.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 Processor -- start 2024-05-09T00:03:58.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.401+0000 7fb926acf700 1 -- start start 2024-05-09T00:03:58.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb926acf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f68a0 0x7fb9200fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb926acf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9200f7b40 0x7fb9200f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb926acf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200fadd0 con 0x7fb9200f68a0 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb926acf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200f9370 con 0x7fb9200f7b40 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb92486b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f68a0 0x7fb9200fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb92486b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f68a0 0x7fb9200fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40646/0 (socket says 172.21.15.26:40646) 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb92486b700 1 -- 172.21.15.26:0/4086119292 learned_addr learned my addr 172.21.15.26:0/4086119292 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb91ffff700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9200f7b40 0x7fb9200f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb92486b700 1 -- 172.21.15.26:0/4086119292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9200f7b40 msgr2=0x7fb9200f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb92486b700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9200f7b40 0x7fb9200f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb92486b700 1 -- 172.21.15.26:0/4086119292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c005040 con 0x7fb9200f68a0 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb91ffff700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9200f7b40 0x7fb9200f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb92486b700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f68a0 0x7fb9200fa820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fb91400e8c0 tx=0x7fb91400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb91df76700 1 -- 172.21.15.26:0/4086119292 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91400ee60 con 0x7fb9200f68a0 2024-05-09T00:03:58.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb91df76700 1 -- 172.21.15.26:0/4086119292 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb91400f040 con 0x7fb9200f68a0 2024-05-09T00:03:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb91df76700 1 -- 172.21.15.26:0/4086119292 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91400c810 con 0x7fb9200f68a0 2024-05-09T00:03:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.402+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9200f95f0 con 0x7fb9200f68a0 2024-05-09T00:03:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.403+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9200f9bb0 con 0x7fb9200f68a0 2024-05-09T00:03:58.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.404+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9200feff0 con 0x7fb9200f68a0 2024-05-09T00:03:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.404+0000 7fb91df76700 1 -- 172.21.15.26:0/4086119292 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fb914007b40 con 0x7fb9200f68a0 2024-05-09T00:03:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.404+0000 7fb91df76700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb910061180 0x7fb910063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:03:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.405+0000 7fb91df76700 1 -- 172.21.15.26:0/4086119292 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fb91407c120 con 0x7fb9200f68a0 2024-05-09T00:03:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.405+0000 7fb91ffff700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb910061180 0x7fb910063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:03:58.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.405+0000 7fb91ffff700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb910061180 0x7fb910063640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb90c000c00 tx=0x7fb90c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:58.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.409+0000 7fb91df76700 1 -- 172.21.15.26:0/4086119292 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb914050410 con 0x7fb9200f68a0 2024-05-09T00:03:58.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.580+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb920110630 con 0x7fb9200f68a0 2024-05-09T00:03:58.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.580+0000 7fb91df76700 1 -- 172.21.15.26:0/4086119292 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb914019090 con 0x7fb9200f68a0 2024-05-09T00:03:58.575 INFO:teuthology.orchestra.run.smithi026.stdout:137438953489 2024-05-09T00:03:58.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb910061180 msgr2=0x7fb910063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:58.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb910061180 0x7fb910063640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb90c000c00 tx=0x7fb90c00b040).stop 2024-05-09T00:03:58.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f68a0 msgr2=0x7fb9200fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:58.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f68a0 0x7fb9200fa820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fb91400e8c0 tx=0x7fb91400b040).stop 2024-05-09T00:03:58.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 shutdown_connections 2024-05-09T00:03:58.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb910061180 0x7fb910063640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:58.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb9200f68a0 0x7fb9200fa820 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:58.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 --2- 172.21.15.26:0/4086119292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9200f7b40 0x7fb9200f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:03:58.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 >> 172.21.15.26:0/4086119292 conn(0x7fb9200f2020 msgr2=0x7fb920061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:58.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 shutdown_connections 2024-05-09T00:03:58.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:03:58.582+0000 7fb926acf700 1 -- 172.21.15.26:0/4086119292 wait complete. 2024-05-09T00:03:58.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:03:58.582114+0000 mon.smithi026 (mon.0) 489 : audit [DBG] from='client.? 172.21.15.26:0/4086119292' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T00:03:59.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:03:58.582114+0000 mon.smithi026 (mon.0) 489 : audit [DBG] from='client.? 172.21.15.26:0/4086119292' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T00:03:59.498 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953487 got 137438953489 for osd.4 2024-05-09T00:03:59.498 DEBUG:teuthology.parallel:result is None 2024-05-09T00:03:59.498 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-09T00:03:59.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T00:03:59.783 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:04:00.062 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:03:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:03:58.549224+0000 mgr.smithi026.brymfp (mgr.14194) 173 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:03:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:03:58.549224+0000 mgr.smithi026.brymfp (mgr.14194) 173 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.648+0000 7f94299b8700 1 -- 172.21.15.26:0/1378524995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 msgr2=0x7f94240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.648+0000 7f94299b8700 1 --2- 172.21.15.26:0/1378524995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 0x7f94240f6cc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f94140047f0 tx=0x7f9414009cb0).stop 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.648+0000 7f94299b8700 1 -- 172.21.15.26:0/1378524995 shutdown_connections 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.648+0000 7f94299b8700 1 --2- 172.21.15.26:0/1378524995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94240f7b40 0x7f94240f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.648+0000 7f94299b8700 1 --2- 172.21.15.26:0/1378524995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 0x7f94240f6cc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.648+0000 7f94299b8700 1 -- 172.21.15.26:0/1378524995 >> 172.21.15.26:0/1378524995 conn(0x7f94240f2020 msgr2=0x7f94240f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.649+0000 7f94299b8700 1 -- 172.21.15.26:0/1378524995 shutdown_connections 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.649+0000 7f94299b8700 1 -- 172.21.15.26:0/1378524995 wait complete. 2024-05-09T00:04:01.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.649+0000 7f94299b8700 1 Processor -- start 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.649+0000 7f94299b8700 1 -- start start 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f94299b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 0x7f94241070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f94299b8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94240f7b40 0x7f94241075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f94299b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9424107b50 con 0x7f94240f68a0 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f94299b8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9424107c90 con 0x7f94240f7b40 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 0x7f94241070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 0x7f94241070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40536/0 (socket says 172.21.15.26:40536) 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f9422ffd700 1 -- 172.21.15.26:0/3150894605 learned_addr learned my addr 172.21.15.26:0/3150894605 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f94227fc700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94240f7b40 0x7f94241075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f9422ffd700 1 -- 172.21.15.26:0/3150894605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94240f7b40 msgr2=0x7f94241075a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f9422ffd700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94240f7b40 0x7f94241075a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:01.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f9422ffd700 1 -- 172.21.15.26:0/3150894605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414005040 con 0x7f94240f68a0 2024-05-09T00:04:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f94227fc700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94240f7b40 0x7f94241075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f9422ffd700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 0x7f94241070b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f9414013580 tx=0x7f9414009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f940bfff700 1 -- 172.21.15.26:0/3150894605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9414018070 con 0x7f94240f68a0 2024-05-09T00:04:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f940bfff700 1 -- 172.21.15.26:0/3150894605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9414007e90 con 0x7f94240f68a0 2024-05-09T00:04:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942410c6d0 con 0x7f94240f68a0 2024-05-09T00:04:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f940bfff700 1 -- 172.21.15.26:0/3150894605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94140123c0 con 0x7f94240f68a0 2024-05-09T00:04:01.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.650+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942410cc90 con 0x7f94240f68a0 2024-05-09T00:04:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.652+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94240feff0 con 0x7f94240f68a0 2024-05-09T00:04:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.652+0000 7f940bfff700 1 -- 172.21.15.26:0/3150894605 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f941401d420 con 0x7f94240f68a0 2024-05-09T00:04:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.652+0000 7f940bfff700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f940c061180 0x7f940c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.652+0000 7f940bfff700 1 -- 172.21.15.26:0/3150894605 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f941407d1b0 con 0x7f94240f68a0 2024-05-09T00:04:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.652+0000 7f94227fc700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f940c061180 0x7f940c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:01.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.653+0000 7f94227fc700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f940c061180 0x7f940c063640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f9418007fd0 tx=0x7f941800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:01.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.656+0000 7f940bfff700 1 -- 172.21.15.26:0/3150894605 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9414051480 con 0x7f94240f68a0 2024-05-09T00:04:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.826+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9424059120 con 0x7f940c061180 2024-05-09T00:04:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.828+0000 7f940bfff700 1 -- 172.21.15.26:0/3150894605 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27781 (secure 0 0 0) 0x7f9424059120 con 0x7f940c061180 2024-05-09T00:04:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.829+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f940c061180 msgr2=0x7f940c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.829+0000 7f94299b8700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f940c061180 0x7f940c063640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f9418007fd0 tx=0x7f941800b040).stop 2024-05-09T00:04:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 msgr2=0x7f94241070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 0x7f94241070b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f9414013580 tx=0x7f9414009cb0).stop 2024-05-09T00:04:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 shutdown_connections 2024-05-09T00:04:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f940c061180 0x7f940c063640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94240f68a0 0x7f94241070b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 --2- 172.21.15.26:0/3150894605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94240f7b40 0x7f94241075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 >> 172.21.15.26:0/3150894605 conn(0x7f94240f2020 msgr2=0x7f94240fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 shutdown_connections 2024-05-09T00:04:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:01.830+0000 7f94299b8700 1 -- 172.21.15.26:0/3150894605 wait complete. 2024-05-09T00:04:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-05-09T00:04:02.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:00.549797+0000 mgr.smithi026.brymfp (mgr.14194) 174 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:02.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:00.549797+0000 mgr.smithi026.brymfp (mgr.14194) 174 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:02.620 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-05-09T00:04:00.549517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1784568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":1782528,"kb_avail":560686344,"statfs":{"total":575970213888,"available":574142816256,"internally_reserved":0,"allocated":2039808,"data_stored":762216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1825308672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T00:03:07.624810+0000","last_change":"2024-05-09T00:02:42.011674+0000","last_active":"2024-05-09T00:03:07.624810+0000","last_peered":"2024-05-09T00:03:07.624810+0000","last_clean":"2024-05-09T00:03:07.624810+0000","last_became_active":"2024-05-09T00:02:42.011326+0000","last_became_peered":"2024-05-09T00:02:42.011326+0000","last_unstale":"2024-05-09T00:03:07.624810+0000","last_undegraded":"2024-05-09T00:03:07.624810+0000","last_fullsized":"2024-05-09T00:03:07.624810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:48.463907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:48.463907+0000","last_clean_scrub_stamp":"2024-05-09T00:01:48.463907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.375},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.44}]},{"osd":1,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu May 9 00:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu May 9 00:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu May 9 00:03:45 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.33600000000000002,"15min":0.32900000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.252},{"interface":"front","average":{"1min":0.373,"5min":0.33300000000000002,"15min":0.32700000000000001},"min":{"1min":0.25800000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu May 9 00:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.35599999999999998,"15min":0.34599999999999997},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu May 9 00:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu May 9 00:03:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.317,"15min":0.311},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.248},{"interface":"front","average":{"1min":0.374,"5min":0.34000000000000002,"15min":0.33400000000000002},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu May 9 00:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.28599999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu May 9 00:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.31900000000000001,"15min":0.315},"min":{"1min":0.26500000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.317,"15min":0.31},"min":{"1min":0.29999999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu May 9 00:03:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.35999999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.309},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.377,"15min":0.36899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu May 9 00:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:04:02.621 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T00:04:02.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:01.828468+0000 mgr.smithi026.brymfp (mgr.14194) 175 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:04:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:04:03.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:01.828468+0000 mgr.smithi026.brymfp (mgr.14194) 175 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:04:04.069 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:02.550317+0000 mgr.smithi026.brymfp (mgr.14194) 176 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:04.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:02.550317+0000 mgr.smithi026.brymfp (mgr.14194) 176 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 -- 172.21.15.26:0/3988740272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f68a0 msgr2=0x7f62080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 --2- 172.21.15.26:0/3988740272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f68a0 0x7f62080f6cc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f61f80047f0 tx=0x7f61f8009cb0).stop 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 -- 172.21.15.26:0/3988740272 shutdown_connections 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 --2- 172.21.15.26:0/3988740272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62080f7b40 0x7f62080f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 --2- 172.21.15.26:0/3988740272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f68a0 0x7f62080f6cc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 -- 172.21.15.26:0/3988740272 >> 172.21.15.26:0/3988740272 conn(0x7f62080f2020 msgr2=0x7f62080f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 -- 172.21.15.26:0/3988740272 shutdown_connections 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 -- 172.21.15.26:0/3988740272 wait complete. 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 Processor -- start 2024-05-09T00:04:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.592+0000 7f620e9ad700 1 -- start start 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f620e9ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62080f68a0 0x7f62081080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f620e9ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f7b40 0x7f6208108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f620e9ad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6208108b40 con 0x7f62080f7b40 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f620e9ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6208108c80 con 0x7f62080f68a0 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f62077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f7b40 0x7f6208108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f62077fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f7b40 0x7f6208108590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40554/0 (socket says 172.21.15.26:40554) 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f62077fe700 1 -- 172.21.15.26:0/723778198 learned_addr learned my addr 172.21.15.26:0/723778198 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f6207fff700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62080f68a0 0x7f62081080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f62077fe700 1 -- 172.21.15.26:0/723778198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62080f68a0 msgr2=0x7f62081080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f62077fe700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62080f68a0 0x7f62081080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f62077fe700 1 -- 172.21.15.26:0/723778198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8005040 con 0x7f62080f7b40 2024-05-09T00:04:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f62077fe700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f7b40 0x7f6208108590 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f61fc00c740 tx=0x7f61fc007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.593+0000 7f62057fa700 1 -- 172.21.15.26:0/723778198 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61fc00e680 con 0x7f62080f7b40 2024-05-09T00:04:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.594+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620810d720 con 0x7f62080f7b40 2024-05-09T00:04:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.594+0000 7f62057fa700 1 -- 172.21.15.26:0/723778198 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f61fc00ec70 con 0x7f62080f7b40 2024-05-09T00:04:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.594+0000 7f62057fa700 1 -- 172.21.15.26:0/723778198 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61fc013d30 con 0x7f62080f7b40 2024-05-09T00:04:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.594+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620810dc60 con 0x7f62080f7b40 2024-05-09T00:04:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.595+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62080feff0 con 0x7f62080f7b40 2024-05-09T00:04:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.595+0000 7f62057fa700 1 -- 172.21.15.26:0/723778198 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f61fc00e7e0 con 0x7f62080f7b40 2024-05-09T00:04:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.595+0000 7f62057fa700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f61f0061180 0x7f61f0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.595+0000 7f62057fa700 1 -- 172.21.15.26:0/723778198 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f61fc07c830 con 0x7f62080f7b40 2024-05-09T00:04:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.595+0000 7f6207fff700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f61f0061180 0x7f61f0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:04.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.596+0000 7f6207fff700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f61f0061180 0x7f61f0063640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f61f8013470 tx=0x7f61f800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:04.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.601+0000 7f62057fa700 1 -- 172.21.15.26:0/723778198 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f61fc050b00 con 0x7f62080f7b40 2024-05-09T00:04:04.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.769+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6208061200 con 0x7f61f0061180 2024-05-09T00:04:04.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.770+0000 7f62057fa700 1 -- 172.21.15.26:0/723778198 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27824 (secure 0 0 0) 0x7f6208061200 con 0x7f61f0061180 2024-05-09T00:04:04.765 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f61f0061180 msgr2=0x7f61f0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f61f0061180 0x7f61f0063640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f61f8013470 tx=0x7f61f800b040).stop 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f7b40 msgr2=0x7f6208108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f7b40 0x7f6208108590 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f61fc00c740 tx=0x7f61fc007ef0).stop 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 shutdown_connections 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f61f0061180 0x7f61f0063640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62080f68a0 0x7f62081080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 --2- 172.21.15.26:0/723778198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62080f7b40 0x7f6208108590 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:04.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 >> 172.21.15.26:0/723778198 conn(0x7f62080f2020 msgr2=0x7f6208060af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 shutdown_connections 2024-05-09T00:04:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:04.772+0000 7f620e9ad700 1 -- 172.21.15.26:0/723778198 wait complete. 2024-05-09T00:04:04.768 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-05-09T00:04:05.489 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-05-09T00:04:04.550486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1784568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":1782528,"kb_avail":560686344,"statfs":{"total":575970213888,"available":574142816256,"internally_reserved":0,"allocated":2039808,"data_stored":762216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1825308672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T00:03:07.624810+0000","last_change":"2024-05-09T00:02:42.011674+0000","last_active":"2024-05-09T00:03:07.624810+0000","last_peered":"2024-05-09T00:03:07.624810+0000","last_clean":"2024-05-09T00:03:07.624810+0000","last_became_active":"2024-05-09T00:02:42.011326+0000","last_became_peered":"2024-05-09T00:02:42.011326+0000","last_unstale":"2024-05-09T00:03:07.624810+0000","last_undegraded":"2024-05-09T00:03:07.624810+0000","last_fullsized":"2024-05-09T00:03:07.624810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:48.463907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:48.463907+0000","last_clean_scrub_stamp":"2024-05-09T00:01:48.463907+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu May 9 00:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu May 9 00:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu May 9 00:03:45 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.432},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378655,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.33600000000000002,"15min":0.32900000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.33300000000000002,"15min":0.32700000000000001},"min":{"1min":0.25800000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu May 9 00:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.35599999999999998,"15min":0.34599999999999997},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu May 9 00:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu May 9 00:03:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.317,"15min":0.311},"min":{"1min":0.252,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.45200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.34000000000000002,"15min":0.33400000000000002},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu May 9 00:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.28599999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.314},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu May 9 00:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.31900000000000001,"15min":0.315},"min":{"1min":0.26500000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.317,"15min":0.31},"min":{"1min":0.29999999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.317}]},{"osd":2,"last update":"Thu May 9 00:03:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.35999999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.377,"15min":0.36899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu May 9 00:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.436}]},{"osd":4,"last update":"Thu May 9 00:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:04:05.490 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-09T00:04:05.490 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T00:04:05.490 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-09T00:04:05.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-09T00:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:04:06.007 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:04.550628+0000 mgr.smithi026.brymfp (mgr.14194) 177 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:06.007 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:04.771218+0000 mgr.smithi026.brymfp (mgr.14194) 178 : audit [DBG] from='client.14398 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:04:06.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:04.550628+0000 mgr.smithi026.brymfp (mgr.14194) 177 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:06.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:04.771218+0000 mgr.smithi026.brymfp (mgr.14194) 178 : audit [DBG] from='client.14398 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:04:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 -- 172.21.15.26:0/1268754847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f8c50 msgr2=0x7f05400f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 --2- 172.21.15.26:0/1268754847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f8c50 0x7f05400f90b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f05340047f0 tx=0x7f0534009cb0).stop 2024-05-09T00:04:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 -- 172.21.15.26:0/1268754847 shutdown_connections 2024-05-09T00:04:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 --2- 172.21.15.26:0/1268754847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f8c50 0x7f05400f90b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 --2- 172.21.15.26:0/1268754847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05400f79b0 0x7f05400f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 -- 172.21.15.26:0/1268754847 >> 172.21.15.26:0/1268754847 conn(0x7f05400f30f0 msgr2=0x7f05400f5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 -- 172.21.15.26:0/1268754847 shutdown_connections 2024-05-09T00:04:07.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 -- 172.21.15.26:0/1268754847 wait complete. 2024-05-09T00:04:07.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.536+0000 7f05461a2700 1 Processor -- start 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f05461a2700 1 -- start start 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f05461a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f79b0 0x7f0540108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f05461a2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05400f8c50 0x7f0540108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f05461a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540108ae0 con 0x7f05400f79b0 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f05461a2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540108c20 con 0x7f05400f8c50 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f053f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f79b0 0x7f0540108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f053f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f79b0 0x7f0540108040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40572/0 (socket says 172.21.15.26:40572) 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f053f7fe700 1 -- 172.21.15.26:0/2428967009 learned_addr learned my addr 172.21.15.26:0/2428967009 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f053effd700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05400f8c50 0x7f0540108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f053f7fe700 1 -- 172.21.15.26:0/2428967009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05400f8c50 msgr2=0x7f0540108530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f053f7fe700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05400f8c50 0x7f0540108530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f053f7fe700 1 -- 172.21.15.26:0/2428967009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534005040 con 0x7f05400f79b0 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.537+0000 7f053f7fe700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f79b0 0x7f0540108040 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f053000c790 tx=0x7f0530007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.538+0000 7f053cff9700 1 -- 172.21.15.26:0/2428967009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053000e680 con 0x7f05400f79b0 2024-05-09T00:04:07.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.538+0000 7f053cff9700 1 -- 172.21.15.26:0/2428967009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f053000ec70 con 0x7f05400f79b0 2024-05-09T00:04:07.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.538+0000 7f053cff9700 1 -- 172.21.15.26:0/2428967009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0530012d30 con 0x7f05400f79b0 2024-05-09T00:04:07.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.538+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054010d6c0 con 0x7f05400f79b0 2024-05-09T00:04:07.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.538+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054010dc00 con 0x7f05400f79b0 2024-05-09T00:04:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.539+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0540100100 con 0x7f05400f79b0 2024-05-09T00:04:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.539+0000 7f053cff9700 1 -- 172.21.15.26:0/2428967009 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f053000e7e0 con 0x7f05400f79b0 2024-05-09T00:04:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.539+0000 7f053cff9700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0528061180 0x7f0528063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.540+0000 7f053cff9700 1 -- 172.21.15.26:0/2428967009 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f053007bd20 con 0x7f05400f79b0 2024-05-09T00:04:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.540+0000 7f053effd700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0528061180 0x7f0528063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:07.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.540+0000 7f053effd700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0528061180 0x7f0528063640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f05340047c0 tx=0x7f053400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:07.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.544+0000 7f053cff9700 1 -- 172.21.15.26:0/2428967009 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0530048f60 con 0x7f05400f79b0 2024-05-09T00:04:07.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.756+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0540101f70 con 0x7f05400f79b0 2024-05-09T00:04:07.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.757+0000 7f053cff9700 1 -- 172.21.15.26:0/2428967009 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f0530017040 con 0x7f05400f79b0 2024-05-09T00:04:07.751 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:07.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0528061180 msgr2=0x7f0528063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:07.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0528061180 0x7f0528063640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f05340047c0 tx=0x7f053400b040).stop 2024-05-09T00:04:07.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f79b0 msgr2=0x7f0540108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:07.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f79b0 0x7f0540108040 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f053000c790 tx=0x7f0530007f90).stop 2024-05-09T00:04:07.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 shutdown_connections 2024-05-09T00:04:07.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0528061180 0x7f0528063640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:07.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05400f79b0 0x7f0540108040 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:07.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 --2- 172.21.15.26:0/2428967009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05400f8c50 0x7f0540108530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:07.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.758+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 >> 172.21.15.26:0/2428967009 conn(0x7f05400f30f0 msgr2=0x7f05400fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:07.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.759+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 shutdown_connections 2024-05-09T00:04:07.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:07.759+0000 7f05461a2700 1 -- 172.21.15.26:0/2428967009 wait complete. 2024-05-09T00:04:08.141 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:06.551055+0000 mgr.smithi026.brymfp (mgr.14194) 179 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:08.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:06.551055+0000 mgr.smithi026.brymfp (mgr.14194) 179 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:08.646 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T00:04:08.646 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-09T00:04:08.647 INFO:tasks.cephadm:Setup complete, yielding 2024-05-09T00:04:08.647 INFO:teuthology.run_tasks:Running task print... 2024-05-09T00:04:08.661 INFO:teuthology.task.print:**** done end installing pacific cephadm ... 2024-05-09T00:04:08.662 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:04:08.759 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:04:08.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-05-09T00:04:08.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:07.757421+0000 mon.smithi026 (mon.0) 490 : audit [DBG] from='client.? 172.21.15.26:0/2428967009' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T00:04:09.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:07.757421+0000 mon.smithi026 (mon.0) 490 : audit [DBG] from='client.? 172.21.15.26:0/2428967009' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T00:04:10.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:08.551481+0000 mgr.smithi026.brymfp (mgr.14194) 180 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:10.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:08.551481+0000 mgr.smithi026.brymfp (mgr.14194) 180 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.921+0000 7fe12c4cd700 1 -- 172.21.15.26:0/1579465951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f66f0 msgr2=0x7fe1240f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.921+0000 7fe12c4cd700 1 --2- 172.21.15.26:0/1579465951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f66f0 0x7fe1240f6b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fe1200047f0 tx=0x7fe120009cb0).stop 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.921+0000 7fe12c4cd700 1 -- 172.21.15.26:0/1579465951 shutdown_connections 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.921+0000 7fe12c4cd700 1 --2- 172.21.15.26:0/1579465951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1240f7990 0x7fe1240f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.921+0000 7fe12c4cd700 1 --2- 172.21.15.26:0/1579465951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f66f0 0x7fe1240f6b10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.921+0000 7fe12c4cd700 1 -- 172.21.15.26:0/1579465951 >> 172.21.15.26:0/1579465951 conn(0x7fe1240f1e50 msgr2=0x7fe1240f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.921+0000 7fe12c4cd700 1 -- 172.21.15.26:0/1579465951 shutdown_connections 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.921+0000 7fe12c4cd700 1 -- 172.21.15.26:0/1579465951 wait complete. 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe12c4cd700 1 Processor -- start 2024-05-09T00:04:10.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe12c4cd700 1 -- start start 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe12c4cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1240f66f0 0x7fe124061060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe12c4cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f7990 0x7fe12410cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe12c4cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12410d290 con 0x7fe1240f7990 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe12c4cd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12410d3d0 con 0x7fe1240f66f0 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe129a68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f7990 0x7fe12410cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe129a68700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f7990 0x7fe12410cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40580/0 (socket says 172.21.15.26:40580) 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe129a68700 1 -- 172.21.15.26:0/2089893010 learned_addr learned my addr 172.21.15.26:0/2089893010 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.922+0000 7fe12a269700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1240f66f0 0x7fe124061060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe129a68700 1 -- 172.21.15.26:0/2089893010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1240f66f0 msgr2=0x7fe124061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe129a68700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1240f66f0 0x7fe124061060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe129a68700 1 -- 172.21.15.26:0/2089893010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120005040 con 0x7fe1240f7990 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe12a269700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1240f66f0 0x7fe124061060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe129a68700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f7990 0x7fe12410cda0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe118002820 tx=0x7fe118009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:10.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe1177fe700 1 -- 172.21.15.26:0/2089893010 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe118007b40 con 0x7fe1240f7990 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe1177fe700 1 -- 172.21.15.26:0/2089893010 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe11800f040 con 0x7fe1240f7990 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12410d630 con 0x7fe1240f7990 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe1177fe700 1 -- 172.21.15.26:0/2089893010 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe118013730 con 0x7fe1240f7990 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.923+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12410db70 con 0x7fe1240f7990 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.924+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1240feed0 con 0x7fe1240f7990 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.925+0000 7fe1177fe700 1 -- 172.21.15.26:0/2089893010 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fe118009110 con 0x7fe1240f7990 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.925+0000 7fe1177fe700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe110061180 0x7fe110063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.925+0000 7fe12a269700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe110061180 0x7fe110063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.925+0000 7fe1177fe700 1 -- 172.21.15.26:0/2089893010 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fe11807bf40 con 0x7fe1240f7990 2024-05-09T00:04:10.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.925+0000 7fe12a269700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe110061180 0x7fe110063640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe120004f10 tx=0x7fe12000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:10.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:10.929+0000 7fe1177fe700 1 -- 172.21.15.26:0/2089893010 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe118050210 con 0x7fe1240f7990 2024-05-09T00:04:11.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.101+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fe1240598f0 con 0x7fe1240f7990 2024-05-09T00:04:11.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.105+0000 7fe1177fe700 1 -- 172.21.15.26:0/2089893010 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v19)=0 v19) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe11804fe00 con 0x7fe1240f7990 2024-05-09T00:04:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe110061180 msgr2=0x7fe110063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe110061180 0x7fe110063640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe120004f10 tx=0x7fe12000b040).stop 2024-05-09T00:04:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f7990 msgr2=0x7fe12410cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f7990 0x7fe12410cda0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fe118002820 tx=0x7fe118009f60).stop 2024-05-09T00:04:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 shutdown_connections 2024-05-09T00:04:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe110061180 0x7fe110063640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1240f66f0 0x7fe124061060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:11.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 --2- 172.21.15.26:0/2089893010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1240f7990 0x7fe12410cda0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:11.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 >> 172.21.15.26:0/2089893010 conn(0x7fe1240f1e50 msgr2=0x7fe1240fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 shutdown_connections 2024-05-09T00:04:11.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:11.107+0000 7fe12c4cd700 1 -- 172.21.15.26:0/2089893010 wait complete. 2024-05-09T00:04:11.103 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:10.162488+0000 mon.smithi026 (mon.0) 491 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:11.103 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:10.502729+0000 mon.smithi026 (mon.0) 492 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:11.103 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:10.503381+0000 mon.smithi026 (mon.0) 493 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:11.103 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:10.507612+0000 mon.smithi026 (mon.0) 494 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:11.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:10.162488+0000 mon.smithi026 (mon.0) 491 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:11.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:10.502729+0000 mon.smithi026 (mon.0) 492 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:11.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:10.503381+0000 mon.smithi026 (mon.0) 493 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:11.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:10.507612+0000 mon.smithi026 (mon.0) 494 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:11.752 INFO:teuthology.run_tasks:Running task print... 2024-05-09T00:04:11.788 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-05-09T00:04:11.789 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:04:11.837 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:04:11.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-09T00:04:12.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:10.551947+0000 mgr.smithi026.brymfp (mgr.14194) 181 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:12.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:11.105766+0000 mon.smithi026 (mon.0) 495 : audit [INF] from='client.? 172.21.15.26:0/2089893010' entity='client.admin' 2024-05-09T00:04:12.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:11.125852+0000 mon.smithi026 (mon.0) 496 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:12.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:11.127517+0000 mon.smithi026 (mon.0) 497 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:12.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:11.128132+0000 mon.smithi026 (mon.0) 498 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:12.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:11.132180+0000 mon.smithi026 (mon.0) 499 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:12.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:10.551947+0000 mgr.smithi026.brymfp (mgr.14194) 181 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:12.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:11.105766+0000 mon.smithi026 (mon.0) 495 : audit [INF] from='client.? 172.21.15.26:0/2089893010' entity='client.admin' 2024-05-09T00:04:12.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:11.125852+0000 mon.smithi026 (mon.0) 496 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:12.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:11.127517+0000 mon.smithi026 (mon.0) 497 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:12.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:11.128132+0000 mon.smithi026 (mon.0) 498 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:12.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:11.132180+0000 mon.smithi026 (mon.0) 499 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.954+0000 7fdfe7be4700 1 -- 172.21.15.26:0/174537130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00611e0 msgr2=0x7fdfe00fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.954+0000 7fdfe7be4700 1 --2- 172.21.15.26:0/174537130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00611e0 0x7fdfe00fa470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fdfdc0047f0 tx=0x7fdfdc009cb0).stop 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.954+0000 7fdfe7be4700 1 -- 172.21.15.26:0/174537130 shutdown_connections 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.954+0000 7fdfe7be4700 1 --2- 172.21.15.26:0/174537130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfe00fa960 0x7fdfe00fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.954+0000 7fdfe7be4700 1 --2- 172.21.15.26:0/174537130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00611e0 0x7fdfe00fa470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.954+0000 7fdfe7be4700 1 -- 172.21.15.26:0/174537130 >> 172.21.15.26:0/174537130 conn(0x7fdfe00f1e50 msgr2=0x7fdfe00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.954+0000 7fdfe7be4700 1 -- 172.21.15.26:0/174537130 shutdown_connections 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.954+0000 7fdfe7be4700 1 -- 172.21.15.26:0/174537130 wait complete. 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe7be4700 1 Processor -- start 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe7be4700 1 -- start start 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe7be4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfe00611e0 0x7fdfe00f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe7be4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00fa960 0x7fdfe00f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe7be4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe00f82c0 con 0x7fdfe00fa960 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe7be4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe00f6860 con 0x7fdfe00611e0 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe517f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00fa960 0x7fdfe00f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe517f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00fa960 0x7fdfe00f6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44996/0 (socket says 172.21.15.26:44996) 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe517f700 1 -- 172.21.15.26:0/3849564542 learned_addr learned my addr 172.21.15.26:0/3849564542 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.955+0000 7fdfe5980700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfe00611e0 0x7fdfe00f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfe517f700 1 -- 172.21.15.26:0/3849564542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfe00611e0 msgr2=0x7fdfe00f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfe517f700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfe00611e0 0x7fdfe00f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfe517f700 1 -- 172.21.15.26:0/3849564542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc005040 con 0x7fdfe00fa960 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfe517f700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00fa960 0x7fdfe00f6370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fdfd4002780 tx=0x7fdfd4009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfd2ffd700 1 -- 172.21.15.26:0/3849564542 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfd4007b40 con 0x7fdfe00fa960 2024-05-09T00:04:13.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe00f6ae0 con 0x7fdfe00fa960 2024-05-09T00:04:13.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfd2ffd700 1 -- 172.21.15.26:0/3849564542 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fdfd400f040 con 0x7fdfe00fa960 2024-05-09T00:04:13.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfd2ffd700 1 -- 172.21.15.26:0/3849564542 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfd40146f0 con 0x7fdfe00fa960 2024-05-09T00:04:13.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.956+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe00f7020 con 0x7fdfe00fa960 2024-05-09T00:04:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.957+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe00ffff0 con 0x7fdfe00fa960 2024-05-09T00:04:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.957+0000 7fdfd2ffd700 1 -- 172.21.15.26:0/3849564542 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fdfd4007ca0 con 0x7fdfe00fa960 2024-05-09T00:04:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.958+0000 7fdfd2ffd700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fdfcc061180 0x7fdfcc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.958+0000 7fdfd2ffd700 1 -- 172.21.15.26:0/3849564542 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fdfd407c430 con 0x7fdfe00fa960 2024-05-09T00:04:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.958+0000 7fdfe5980700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fdfcc061180 0x7fdfcc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:13.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.958+0000 7fdfe5980700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fdfcc061180 0x7fdfcc063640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fdfdc0047c0 tx=0x7fdfdc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:13.962+0000 7fdfd2ffd700 1 -- 172.21.15.26:0/3849564542 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fdfd4050700 con 0x7fdfe00fa960 2024-05-09T00:04:14.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:12.552269+0000 mgr.smithi026.brymfp (mgr.14194) 182 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:14.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.151+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfe0059120 con 0x7fdfcc061180 2024-05-09T00:04:14.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.152+0000 7fdfd2ffd700 1 -- 172.21.15.26:0/3849564542 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fdfe0059120 con 0x7fdfcc061180 2024-05-09T00:04:14.145 INFO:teuthology.orchestra.run.smithi026.stdout:Backend: cephadm 2024-05-09T00:04:14.146 INFO:teuthology.orchestra.run.smithi026.stdout:Available: Yes 2024-05-09T00:04:14.146 INFO:teuthology.orchestra.run.smithi026.stdout:Paused: No 2024-05-09T00:04:14.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:12.552269+0000 mgr.smithi026.brymfp (mgr.14194) 182 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:14.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fdfcc061180 msgr2=0x7fdfcc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:14.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fdfcc061180 0x7fdfcc063640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fdfdc0047c0 tx=0x7fdfdc00b040).stop 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00fa960 msgr2=0x7fdfe00f6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00fa960 0x7fdfe00f6370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fdfd4002780 tx=0x7fdfd4009ee0).stop 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 shutdown_connections 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fdfcc061180 0x7fdfcc063640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfe00611e0 0x7fdfe00f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 --2- 172.21.15.26:0/3849564542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe00fa960 0x7fdfe00f6370 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 >> 172.21.15.26:0/3849564542 conn(0x7fdfe00f1e50 msgr2=0x7fdfe00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 shutdown_connections 2024-05-09T00:04:14.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:14.154+0000 7fdfe7be4700 1 -- 172.21.15.26:0/3849564542 wait complete. 2024-05-09T00:04:15.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-09T00:04:16.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:14.152493+0000 mgr.smithi026.brymfp (mgr.14194) 183 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:16.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:14.552695+0000 mgr.smithi026.brymfp (mgr.14194) 184 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:16.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:14.152493+0000 mgr.smithi026.brymfp (mgr.14194) 183 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:16.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:14.552695+0000 mgr.smithi026.brymfp (mgr.14194) 184 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.171+0000 7f0a60fac700 1 -- 172.21.15.26:0/4248808727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 msgr2=0x7f0a5c0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.171+0000 7f0a60fac700 1 --2- 172.21.15.26:0/4248808727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 0x7f0a5c0fcda0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f0a500047f0 tx=0x7f0a50009cb0).stop 2024-05-09T00:04:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.172+0000 7f0a60fac700 1 -- 172.21.15.26:0/4248808727 shutdown_connections 2024-05-09T00:04:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.172+0000 7f0a60fac700 1 --2- 172.21.15.26:0/4248808727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 0x7f0a5c0fcda0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:17.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.172+0000 7f0a60fac700 1 --2- 172.21.15.26:0/4248808727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a5c061220 0x7f0a5c0fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.172+0000 7f0a60fac700 1 -- 172.21.15.26:0/4248808727 >> 172.21.15.26:0/4248808727 conn(0x7f0a5c0f1e50 msgr2=0x7f0a5c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.172+0000 7f0a60fac700 1 -- 172.21.15.26:0/4248808727 shutdown_connections 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.172+0000 7f0a60fac700 1 -- 172.21.15.26:0/4248808727 wait complete. 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.172+0000 7f0a60fac700 1 Processor -- start 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.172+0000 7f0a60fac700 1 -- start start 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a60fac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a5c061220 0x7f0a5c107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a60fac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 0x7f0a5c108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a60fac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c108a20 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a60fac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c108b60 con 0x7f0a5c061220 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a59d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 0x7f0a5c108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a59d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 0x7f0a5c108470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45010/0 (socket says 172.21.15.26:45010) 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a59d9b700 1 -- 172.21.15.26:0/1666069666 learned_addr learned my addr 172.21.15.26:0/1666069666 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a5a59c700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a5c061220 0x7f0a5c107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a59d9b700 1 -- 172.21.15.26:0/1666069666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a5c061220 msgr2=0x7f0a5c107f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a59d9b700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a5c061220 0x7f0a5c107f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a59d9b700 1 -- 172.21.15.26:0/1666069666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50005040 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a59d9b700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 0x7f0a5c108470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f0a50004f10 tx=0x7f0a50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a4b7fe700 1 -- 172.21.15.26:0/1666069666 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a5000e070 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a4b7fe700 1 -- 172.21.15.26:0/1666069666 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0a50007e90 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c10d5a0 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a4b7fe700 1 -- 172.21.15.26:0/1666069666 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a50018070 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.173+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c10dae0 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.174+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5c0fffb0 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.176+0000 7f0a4b7fe700 1 -- 172.21.15.26:0/1666069666 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f0a500123c0 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.176+0000 7f0a4b7fe700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0a44061110 0x7f0a440635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.176+0000 7f0a4b7fe700 1 -- 172.21.15.26:0/1666069666 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f0a5007d2f0 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.176+0000 7f0a5a59c700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0a44061110 0x7f0a440635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:17.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.176+0000 7f0a5a59c700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0a44061110 0x7f0a440635d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0a4c004dc0 tx=0x7f0a4c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:17.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.180+0000 7f0a4b7fe700 1 -- 172.21.15.26:0/1666069666 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0a50051640 con 0x7f0a5c0fa9b0 2024-05-09T00:04:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.363+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a5c059120 con 0x7f0a44061110 2024-05-09T00:04:17.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.371+0000 7f0a4b7fe700 1 -- 172.21.15.26:0/1666069666 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2700 (secure 0 0 0) 0x7f0a5c059120 con 0x7f0a44061110 2024-05-09T00:04:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:04:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (3m) 2m ago 5m 15.4M - 0.23.0 ba2b418f427c e4c5eae7b44c 2024-05-09T00:04:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (4m) 2m ago 4m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (4m) 70s ago 4m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (3m) 2m ago 4m 45.3M - 8.3.5 dad864ee21e9 0d0dbb754a90 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:9283 running (6m) 2m ago 6m 425M - 16.2.15-1-g8963e9de 727f386679cb 405cee21e657 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (4m) 70s ago 4m 386M - 16.2.15-1-g8963e9de 727f386679cb b1280065c59a 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (6m) 2m ago 6m 47.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (4m) 70s ago 4m 51.7M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (4m) 2m ago 4m 22.6M - 1.3.1 1dbe0e931976 eb62f1a664c9 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (4m) 70s ago 4m 22.1M - 1.3.1 1dbe0e931976 0ef67083c290 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (3m) 2m ago 3m 33.1M 4642M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (3m) 2m ago 3m 36.5M 4642M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (2m) 2m ago 2m 32.5M 4642M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (2m) 70s ago 2m 35.5M 4982M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (102s) 70s ago 101s 35.0M 4982M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (75s) 70s ago 75s 12.8M 4982M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (3m) 70s ago 3m 56.0M - 2.33.4 514e6a882f6e dbc569e4b23d 2024-05-09T00:04:17.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0a44061110 msgr2=0x7f0a440635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0a44061110 0x7f0a440635d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0a4c004dc0 tx=0x7f0a4c00b040).stop 2024-05-09T00:04:17.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 msgr2=0x7f0a5c108470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 0x7f0a5c108470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f0a50004f10 tx=0x7f0a50009cb0).stop 2024-05-09T00:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 shutdown_connections 2024-05-09T00:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0a44061110 0x7f0a440635d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a5c061220 0x7f0a5c107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 --2- 172.21.15.26:0/1666069666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a5c0fa9b0 0x7f0a5c108470 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 >> 172.21.15.26:0/1666069666 conn(0x7f0a5c0f1e50 msgr2=0x7f0a5c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 shutdown_connections 2024-05-09T00:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:17.373+0000 7f0a60fac700 1 -- 172.21.15.26:0/1666069666 wait complete. 2024-05-09T00:04:18.113 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:16.553022+0000 mgr.smithi026.brymfp (mgr.14194) 185 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:18.138 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-09T00:04:18.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:16.553022+0000 mgr.smithi026.brymfp (mgr.14194) 185 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:18.892 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:17.364143+0000 mgr.smithi026.brymfp (mgr.14194) 186 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:19.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:17.364143+0000 mgr.smithi026.brymfp (mgr.14194) 186 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:20.036 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:18.553472+0000 mgr.smithi026.brymfp (mgr.14194) 187 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:20.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:18.553472+0000 mgr.smithi026.brymfp (mgr.14194) 187 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 -- 172.21.15.26:0/539399089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480611c0 msgr2=0x7f50480fa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 --2- 172.21.15.26:0/539399089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480611c0 0x7f50480fa490 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f50440047f0 tx=0x7f5044009cb0).stop 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 -- 172.21.15.26:0/539399089 shutdown_connections 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 --2- 172.21.15.26:0/539399089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480fa980 0x7f50480fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 --2- 172.21.15.26:0/539399089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480611c0 0x7f50480fa490 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 -- 172.21.15.26:0/539399089 >> 172.21.15.26:0/539399089 conn(0x7f50480f1e50 msgr2=0x7f50480f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 -- 172.21.15.26:0/539399089 shutdown_connections 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 -- 172.21.15.26:0/539399089 wait complete. 2024-05-09T00:04:20.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 Processor -- start 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.301+0000 7f504fcec700 1 -- start start 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504fcec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480611c0 0x7f504810a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504fcec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480fa980 0x7f504810a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504fcec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504810ac10 con 0x7f50480fa980 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504fcec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504810ad50 con 0x7f50480611c0 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504d287700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480fa980 0x7f504810a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504d287700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480fa980 0x7f504810a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45030/0 (socket says 172.21.15.26:45030) 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504d287700 1 -- 172.21.15.26:0/1936859467 learned_addr learned my addr 172.21.15.26:0/1936859467 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504da88700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480611c0 0x7f504810a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504d287700 1 -- 172.21.15.26:0/1936859467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480611c0 msgr2=0x7f504810a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504d287700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480611c0 0x7f504810a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:20.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504d287700 1 -- 172.21.15.26:0/1936859467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044005040 con 0x7f50480fa980 2024-05-09T00:04:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504d287700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480fa980 0x7f504810a660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f503800c6e0 tx=0x7f5038007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f503effd700 1 -- 172.21.15.26:0/1936859467 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503800e680 con 0x7f50480fa980 2024-05-09T00:04:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f503effd700 1 -- 172.21.15.26:0/1936859467 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f503800ec70 con 0x7f50480fa980 2024-05-09T00:04:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504810f7f0 con 0x7f50480fa980 2024-05-09T00:04:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.302+0000 7f503effd700 1 -- 172.21.15.26:0/1936859467 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5038013ce0 con 0x7f50480fa980 2024-05-09T00:04:20.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.303+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504810fd30 con 0x7f50480fa980 2024-05-09T00:04:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.303+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5048100000 con 0x7f50480fa980 2024-05-09T00:04:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.304+0000 7f503effd700 1 -- 172.21.15.26:0/1936859467 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f503800e7e0 con 0x7f50480fa980 2024-05-09T00:04:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.304+0000 7f503effd700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5034061180 0x7f5034063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.304+0000 7f503effd700 1 -- 172.21.15.26:0/1936859467 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f503807c2e0 con 0x7f50480fa980 2024-05-09T00:04:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.304+0000 7f504da88700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5034061180 0x7f5034063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:20.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.305+0000 7f504da88700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5034061180 0x7f5034063640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f50440047c0 tx=0x7f504400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.309+0000 7f503effd700 1 -- 172.21.15.26:0/1936859467 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5038050570 con 0x7f50480fa980 2024-05-09T00:04:20.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.486+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f50481103c0 con 0x7f5034061180 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.490+0000 7f503effd700 1 -- 172.21.15.26:0/1936859467 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f50481103c0 con 0x7f5034061180 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:crash 2/2 2m ago 5m * 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:mgr 2/2 2m ago 5m count:2 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:mon 2/2 2m ago 4m smithi026:172.21.15.26=smithi026;smithi135:172.21.15.135=smithi135;count:2 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:osd 6 2m ago - 2024-05-09T00:04:20.484 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus ?:9095 1/1 73s ago 5m count:1 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5034061180 msgr2=0x7f5034063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5034061180 0x7f5034063640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f50440047c0 tx=0x7f504400b040).stop 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480fa980 msgr2=0x7f504810a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480fa980 0x7f504810a660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f503800c6e0 tx=0x7f5038007e90).stop 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 shutdown_connections 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5034061180 0x7f5034063640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480611c0 0x7f504810a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 --2- 172.21.15.26:0/1936859467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50480fa980 0x7f504810a660 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 >> 172.21.15.26:0/1936859467 conn(0x7f50480f1e50 msgr2=0x7f50480fb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 shutdown_connections 2024-05-09T00:04:20.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:20.492+0000 7f504fcec700 1 -- 172.21.15.26:0/1936859467 wait complete. 2024-05-09T00:04:21.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-09T00:04:22.027 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:20.487587+0000 mgr.smithi026.brymfp (mgr.14194) 188 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:22.027 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:20.553794+0000 mgr.smithi026.brymfp (mgr.14194) 189 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:20.487587+0000 mgr.smithi026.brymfp (mgr.14194) 188 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:22.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:20.553794+0000 mgr.smithi026.brymfp (mgr.14194) 189 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.433+0000 7f9c10187700 1 -- 172.21.15.26:0/2460314164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 msgr2=0x7f9c080f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.433+0000 7f9c10187700 1 --2- 172.21.15.26:0/2460314164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 0x7f9c080f6b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9bf80047f0 tx=0x7f9bf8009cb0).stop 2024-05-09T00:04:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.433+0000 7f9c10187700 1 -- 172.21.15.26:0/2460314164 shutdown_connections 2024-05-09T00:04:23.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.433+0000 7f9c10187700 1 --2- 172.21.15.26:0/2460314164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c080f7990 0x7f9c080f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.433+0000 7f9c10187700 1 --2- 172.21.15.26:0/2460314164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 0x7f9c080f6b10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.433+0000 7f9c10187700 1 -- 172.21.15.26:0/2460314164 >> 172.21.15.26:0/2460314164 conn(0x7f9c080f1e50 msgr2=0x7f9c080f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.433+0000 7f9c10187700 1 -- 172.21.15.26:0/2460314164 shutdown_connections 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.433+0000 7f9c10187700 1 -- 172.21.15.26:0/2460314164 wait complete. 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c10187700 1 Processor -- start 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c10187700 1 -- start start 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c10187700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 0x7f9c080fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c10187700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c080f7990 0x7f9c080f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c10187700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080fac20 con 0x7f9c080f66f0 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c10187700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080f91c0 con 0x7f9c080f7990 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c0df23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 0x7f9c080fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:23.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c0df23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 0x7f9c080fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60216/0 (socket says 172.21.15.26:60216) 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c0df23700 1 -- 172.21.15.26:0/608021272 learned_addr learned my addr 172.21.15.26:0/608021272 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c0d722700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c080f7990 0x7f9c080f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c0df23700 1 -- 172.21.15.26:0/608021272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c080f7990 msgr2=0x7f9c080f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c0df23700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c080f7990 0x7f9c080f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.434+0000 7f9c0df23700 1 -- 172.21.15.26:0/608021272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf8005040 con 0x7f9c080f66f0 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.435+0000 7f9c0df23700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 0x7f9c080fa670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9bf8009eb0 tx=0x7f9bf8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.435+0000 7f9bfeffd700 1 -- 172.21.15.26:0/608021272 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf800e030 con 0x7f9c080f66f0 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.435+0000 7f9bfeffd700 1 -- 172.21.15.26:0/608021272 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9bf8007e90 con 0x7f9c080f66f0 2024-05-09T00:04:23.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.435+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c080f93e0 con 0x7f9c080f66f0 2024-05-09T00:04:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.435+0000 7f9bfeffd700 1 -- 172.21.15.26:0/608021272 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf8018070 con 0x7f9c080f66f0 2024-05-09T00:04:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.435+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c080f98c0 con 0x7f9c080f66f0 2024-05-09T00:04:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.436+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c080f9b30 con 0x7f9c080f66f0 2024-05-09T00:04:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.436+0000 7f9bfeffd700 1 -- 172.21.15.26:0/608021272 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9bf801d420 con 0x7f9c080f66f0 2024-05-09T00:04:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.436+0000 7f9bfeffd700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9bf4061110 0x7f9bf40635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.437+0000 7f9bfeffd700 1 -- 172.21.15.26:0/608021272 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f9bf807d7c0 con 0x7f9c080f66f0 2024-05-09T00:04:23.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.437+0000 7f9c0d722700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9bf4061110 0x7f9bf40635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.437+0000 7f9c0d722700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9bf4061110 0x7f9bf40635d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f9c04004e60 tx=0x7f9c0400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:23.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.441+0000 7f9bfeffd700 1 -- 172.21.15.26:0/608021272 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9bf8051a30 con 0x7f9c080f66f0 2024-05-09T00:04:23.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.620+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c080fbdd0 con 0x7f9bf4061110 2024-05-09T00:04:23.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.621+0000 7f9bfeffd700 1 -- 172.21.15.26:0/608021272 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f9c080fbdd0 con 0x7f9bf4061110 2024-05-09T00:04:23.615 INFO:teuthology.orchestra.run.smithi026.stdout:HOST ADDR LABELS STATUS 2024-05-09T00:04:23.615 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026 172.21.15.26 2024-05-09T00:04:23.615 INFO:teuthology.orchestra.run.smithi026.stdout:smithi135 172.21.15.135 2024-05-09T00:04:23.615 INFO:teuthology.orchestra.run.smithi026.stdout:2 hosts in cluster 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.623+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9bf4061110 msgr2=0x7f9bf40635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.623+0000 7f9c10187700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9bf4061110 0x7f9bf40635d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f9c04004e60 tx=0x7f9c0400b040).stop 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.623+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 msgr2=0x7f9c080fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.623+0000 7f9c10187700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 0x7f9c080fa670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9bf8009eb0 tx=0x7f9bf8009cb0).stop 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.624+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 shutdown_connections 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.624+0000 7f9c10187700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9bf4061110 0x7f9bf40635d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.624+0000 7f9c10187700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c080f66f0 0x7f9c080fa670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.624+0000 7f9c10187700 1 --2- 172.21.15.26:0/608021272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c080f7990 0x7f9c080f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.624+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 >> 172.21.15.26:0/608021272 conn(0x7f9c080f1e50 msgr2=0x7f9c08060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.624+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 shutdown_connections 2024-05-09T00:04:23.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:23.624+0000 7f9c10187700 1 -- 172.21.15.26:0/608021272 wait complete. 2024-05-09T00:04:23.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:22.554122+0000 mgr.smithi026.brymfp (mgr.14194) 190 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:24.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:22.554122+0000 mgr.smithi026.brymfp (mgr.14194) 190 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:24.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-09T00:04:25.020 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:23.621783+0000 mgr.smithi026.brymfp (mgr.14194) 191 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:25.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:23.621783+0000 mgr.smithi026.brymfp (mgr.14194) 191 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:26.113 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:24.554607+0000 mgr.smithi026.brymfp (mgr.14194) 192 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:26.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:24.554607+0000 mgr.smithi026.brymfp (mgr.14194) 192 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:26.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.398+0000 7f9dd179e700 1 -- 172.21.15.26:0/2215245510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f88f0 msgr2=0x7f9dcc0f8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.398+0000 7f9dd179e700 1 --2- 172.21.15.26:0/2215245510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f88f0 0x7f9dcc0f8d50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f9dc00047f0 tx=0x7f9dc0009cb0).stop 2024-05-09T00:04:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.398+0000 7f9dd179e700 1 -- 172.21.15.26:0/2215245510 shutdown_connections 2024-05-09T00:04:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.398+0000 7f9dd179e700 1 --2- 172.21.15.26:0/2215245510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f88f0 0x7f9dcc0f8d50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.398+0000 7f9dd179e700 1 --2- 172.21.15.26:0/2215245510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc0f7650 0x7f9dcc0f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.398+0000 7f9dd179e700 1 -- 172.21.15.26:0/2215245510 >> 172.21.15.26:0/2215245510 conn(0x7f9dcc0f2db0 msgr2=0x7f9dcc0f51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.398+0000 7f9dd179e700 1 -- 172.21.15.26:0/2215245510 shutdown_connections 2024-05-09T00:04:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.398+0000 7f9dd179e700 1 -- 172.21.15.26:0/2215245510 wait complete. 2024-05-09T00:04:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.399+0000 7f9dd179e700 1 Processor -- start 2024-05-09T00:04:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.399+0000 7f9dd179e700 1 -- start start 2024-05-09T00:04:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.399+0000 7f9dd179e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f7650 0x7f9dcc107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.399+0000 7f9dd179e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc0f88f0 0x7f9dcc108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:26.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.399+0000 7f9dd179e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc108a10 con 0x7f9dcc0f7650 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.399+0000 7f9dd179e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc108b50 con 0x7f9dcc0f88f0 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.399+0000 7f9dcbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f7650 0x7f9dcc107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dcbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f7650 0x7f9dcc107f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60236/0 (socket says 172.21.15.26:60236) 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dcbfff700 1 -- 172.21.15.26:0/76049800 learned_addr learned my addr 172.21.15.26:0/76049800 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dcb7fe700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc0f88f0 0x7f9dcc108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dcbfff700 1 -- 172.21.15.26:0/76049800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc0f88f0 msgr2=0x7f9dcc108460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dcbfff700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc0f88f0 0x7f9dcc108460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dcbfff700 1 -- 172.21.15.26:0/76049800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0005040 con 0x7f9dcc0f7650 2024-05-09T00:04:26.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dcbfff700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f7650 0x7f9dcc107f70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f9dbc00e8c0 tx=0x7f9dbc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dc97fa700 1 -- 172.21.15.26:0/76049800 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dbc007b40 con 0x7f9dcc0f7650 2024-05-09T00:04:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc1094f0 con 0x7f9dcc0f7650 2024-05-09T00:04:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dc97fa700 1 -- 172.21.15.26:0/76049800 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9dbc00f040 con 0x7f9dcc0f7650 2024-05-09T00:04:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dc97fa700 1 -- 172.21.15.26:0/76049800 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dbc0147e0 con 0x7f9dcc0f7650 2024-05-09T00:04:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.400+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc109ab0 con 0x7f9dcc0f7650 2024-05-09T00:04:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.401+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc046ce0 con 0x7f9dcc0f7650 2024-05-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.402+0000 7f9dc97fa700 1 -- 172.21.15.26:0/76049800 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9dbc0090d0 con 0x7f9dcc0f7650 2024-05-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.402+0000 7f9dc97fa700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9db4061180 0x7f9db4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.402+0000 7f9dc97fa700 1 -- 172.21.15.26:0/76049800 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f9dbc07c730 con 0x7f9dcc0f7650 2024-05-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.403+0000 7f9dcb7fe700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9db4061180 0x7f9db4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.403+0000 7f9dcb7fe700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9db4061180 0x7f9db4063640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9dc00047c0 tx=0x7f9dc0009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:26.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.406+0000 7f9dc97fa700 1 -- 172.21.15.26:0/76049800 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9dbc0509c0 con 0x7f9dcc0f7650 2024-05-09T00:04:26.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.584+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dcc109d30 con 0x7f9db4061180 2024-05-09T00:04:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.586+0000 7f9dc97fa700 1 -- 172.21.15.26:0/76049800 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f9dcc109d30 con 0x7f9db4061180 2024-05-09T00:04:26.579 INFO:teuthology.orchestra.run.smithi026.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-09T00:04:26.579 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026 /dev/nvme0n1 ssd INTEL SSDPED1D480GA_PHMB74760020480DGN 447G 2m ago Has a FileSystem, LVM detected 2024-05-09T00:04:26.580 INFO:teuthology.orchestra.run.smithi026.stdout:smithi135 /dev/nvme0n1 ssd INTEL SSDPEDMD400G4_PHFT620401BA400BGN 372G 76s ago Has a FileSystem, LVM detected 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9db4061180 msgr2=0x7f9db4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9db4061180 0x7f9db4063640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9dc00047c0 tx=0x7f9dc0009cb0).stop 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f7650 msgr2=0x7f9dcc107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f7650 0x7f9dcc107f70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f9dbc00e8c0 tx=0x7f9dbc00b040).stop 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 shutdown_connections 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9db4061180 0x7f9db4063640 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9dcc0f7650 0x7f9dcc107f70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 --2- 172.21.15.26:0/76049800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dcc0f88f0 0x7f9dcc108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 >> 172.21.15.26:0/76049800 conn(0x7f9dcc0f2db0 msgr2=0x7f9dcc0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 shutdown_connections 2024-05-09T00:04:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:26.587+0000 7f9dd179e700 1 -- 172.21.15.26:0/76049800 wait complete. 2024-05-09T00:04:27.344 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:04:27.447 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:04:27.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-05-09T00:04:28.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:26.554885+0000 mgr.smithi026.brymfp (mgr.14194) 193 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:28.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:26.585618+0000 mgr.smithi026.brymfp (mgr.14194) 194 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:28.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:26.554885+0000 mgr.smithi026.brymfp (mgr.14194) 193 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:28.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:26.585618+0000 mgr.smithi026.brymfp (mgr.14194) 194 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 -- 172.21.15.26:0/2175442253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5b30 msgr2=0x7ff5a40f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 --2- 172.21.15.26:0/2175442253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5b30 0x7ff5a40f5f50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7ff5980047f0 tx=0x7ff598009cb0).stop 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 -- 172.21.15.26:0/2175442253 shutdown_connections 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 --2- 172.21.15.26:0/2175442253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5a40f64d0 0x7ff5a40f8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 --2- 172.21.15.26:0/2175442253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f5b30 0x7ff5a40f5f50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 -- 172.21.15.26:0/2175442253 >> 172.21.15.26:0/2175442253 conn(0x7ff5a40f1670 msgr2=0x7ff5a40f3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 -- 172.21.15.26:0/2175442253 shutdown_connections 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 -- 172.21.15.26:0/2175442253 wait complete. 2024-05-09T00:04:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.444+0000 7ff5a928d700 1 Processor -- start 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a928d700 1 -- start start 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a928d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5a40f5b30 0x7ff5a4107fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a928d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f64d0 0x7ff5a41084a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a928d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4108a50 con 0x7ff5a40f64d0 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a928d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4108b90 con 0x7ff5a40f5b30 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f64d0 0x7ff5a41084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a27fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f64d0 0x7ff5a41084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60246/0 (socket says 172.21.15.26:60246) 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a27fc700 1 -- 172.21.15.26:0/1465042522 learned_addr learned my addr 172.21.15.26:0/1465042522 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a2ffd700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5a40f5b30 0x7ff5a4107fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:29.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a27fc700 1 -- 172.21.15.26:0/1465042522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5a40f5b30 msgr2=0x7ff5a4107fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:29.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a27fc700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5a40f5b30 0x7ff5a4107fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:29.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.445+0000 7ff5a27fc700 1 -- 172.21.15.26:0/1465042522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598005040 con 0x7ff5a40f64d0 2024-05-09T00:04:29.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.446+0000 7ff5a27fc700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f64d0 0x7ff5a41084a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff594002780 tx=0x7ff594009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:29.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.446+0000 7ff58bfff700 1 -- 172.21.15.26:0/1465042522 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff594007b40 con 0x7ff5a40f64d0 2024-05-09T00:04:29.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.446+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a410d630 con 0x7ff5a40f64d0 2024-05-09T00:04:29.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.446+0000 7ff58bfff700 1 -- 172.21.15.26:0/1465042522 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff59400f040 con 0x7ff5a40f64d0 2024-05-09T00:04:29.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.446+0000 7ff58bfff700 1 -- 172.21.15.26:0/1465042522 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5940146f0 con 0x7ff5a40f64d0 2024-05-09T00:04:29.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.446+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a410db70 con 0x7ff5a40f64d0 2024-05-09T00:04:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.447+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4100010 con 0x7ff5a40f64d0 2024-05-09T00:04:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.447+0000 7ff58bfff700 1 -- 172.21.15.26:0/1465042522 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ff594007ca0 con 0x7ff5a40f64d0 2024-05-09T00:04:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.448+0000 7ff58bfff700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff58c061180 0x7ff58c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.448+0000 7ff58bfff700 1 -- 172.21.15.26:0/1465042522 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7ff59407c470 con 0x7ff5a40f64d0 2024-05-09T00:04:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.448+0000 7ff5a2ffd700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff58c061180 0x7ff58c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.448+0000 7ff5a2ffd700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff58c061180 0x7ff58c063640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff598004f10 tx=0x7ff59800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:29.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.452+0000 7ff58bfff700 1 -- 172.21.15.26:0/1465042522 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff594050740 con 0x7ff5a40f64d0 2024-05-09T00:04:29.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:29.649+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5a4059120 con 0x7ff58c061180 2024-05-09T00:04:30.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:28.555355+0000 mgr.smithi026.brymfp (mgr.14194) 195 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:30.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:28.555355+0000 mgr.smithi026.brymfp (mgr.14194) 195 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:31.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.176+0000 7ff58bfff700 1 -- 172.21.15.26:0/1465042522 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff5a4059120 con 0x7ff58c061180 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff58c061180 msgr2=0x7ff58c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff58c061180 0x7ff58c063640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff598004f10 tx=0x7ff59800b040).stop 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f64d0 msgr2=0x7ff5a41084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f64d0 0x7ff5a41084a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7ff594002780 tx=0x7ff594009ee0).stop 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 shutdown_connections 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7ff58c061180 0x7ff58c063640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5a40f5b30 0x7ff5a4107fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 --2- 172.21.15.26:0/1465042522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5a40f64d0 0x7ff5a41084a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 >> 172.21.15.26:0/1465042522 conn(0x7ff5a40f1670 msgr2=0x7ff5a40fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 shutdown_connections 2024-05-09T00:04:31.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:31.179+0000 7ff5a928d700 1 -- 172.21.15.26:0/1465042522 wait complete. 2024-05-09T00:04:31.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:29.650615+0000 mgr.smithi026.brymfp (mgr.14194) 196 : audit [DBG] from='client.14430 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:31.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:29.651072+0000 mon.smithi026 (mon.0) 500 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-09T00:04:31.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:30.138973+0000 mon.smithi026 (mon.0) 501 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-09T00:04:31.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:30.139013+0000 mon.smithi026 (mon.0) 502 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-05-09T00:04:31.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:30.139975+0000 mon.smithi026 (mon.0) 503 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-09T00:04:31.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:30.555697+0000 mgr.smithi026.brymfp (mgr.14194) 197 : cluster [DBG] pgmap v170: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:31.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-09T00:04:31.151+0000 7f1fccfe6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:04:31.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:29.650615+0000 mgr.smithi026.brymfp (mgr.14194) 196 : audit [DBG] from='client.14430 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:04:31.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:29.651072+0000 mon.smithi026 (mon.0) 500 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-09T00:04:31.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:30.138973+0000 mon.smithi026 (mon.0) 501 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-09T00:04:31.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:30.139013+0000 mon.smithi026 (mon.0) 502 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-05-09T00:04:31.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:30.139975+0000 mon.smithi026 (mon.0) 503 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-09T00:04:31.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:30.555697+0000 mgr.smithi026.brymfp (mgr.14194) 197 : cluster [DBG] pgmap v170: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:31.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T00:04:32.303 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.146265+0000 mon.smithi026 (mon.0) 504 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:31.146522+0000 mon.smithi026 (mon.0) 505 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.151239+0000 mon.smithi026 (mon.0) 506 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:31.152165+0000 mon.smithi026 (mon.0) 507 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:31.152194+0000 mon.smithi026 (mon.0) 508 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:31.165423+0000 mon.smithi026 (mon.0) 509 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.165871+0000 mon.smithi026 (mon.0) 510 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:31.165974+0000 mon.smithi026 (mon.0) 511 : cluster [DBG] fsmap cephfs:0 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:04:31.169777+0000 mgr.smithi026.brymfp (mgr.14194) 198 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.175598+0000 mon.smithi026 (mon.0) 512 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.204237+0000 mon.smithi026 (mon.0) 513 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.205913+0000 mon.smithi026 (mon.0) 514 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.206627+0000 mon.smithi026 (mon.0) 515 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.211401+0000 mon.smithi026 (mon.0) 516 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:32.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.218535+0000 mon.smithi026 (mon.0) 517 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:32.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.219342+0000 mon.smithi026 (mon.0) 518 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.nhrcgk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:04:32.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.222397+0000 mon.smithi026 (mon.0) 519 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.nhrcgk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:04:32.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:31.223156+0000 mon.smithi026 (mon.0) 520 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:32.305 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:04:31.223873+0000 mgr.smithi026.brymfp (mgr.14194) 199 : cephadm [INF] Deploying daemon mds.cephfs.smithi026.nhrcgk on smithi026 2024-05-09T00:04:32.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.146265+0000 mon.smithi026 (mon.0) 504 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-09T00:04:32.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:31.146522+0000 mon.smithi026 (mon.0) 505 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-05-09T00:04:32.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.151239+0000 mon.smithi026 (mon.0) 506 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-09T00:04:32.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:31.152165+0000 mon.smithi026 (mon.0) 507 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:04:32.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:31.152194+0000 mon.smithi026 (mon.0) 508 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:31.165423+0000 mon.smithi026 (mon.0) 509 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.165871+0000 mon.smithi026 (mon.0) 510 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:31.165974+0000 mon.smithi026 (mon.0) 511 : cluster [DBG] fsmap cephfs:0 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:04:31.169777+0000 mgr.smithi026.brymfp (mgr.14194) 198 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.175598+0000 mon.smithi026 (mon.0) 512 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.204237+0000 mon.smithi026 (mon.0) 513 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.205913+0000 mon.smithi026 (mon.0) 514 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.206627+0000 mon.smithi026 (mon.0) 515 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.211401+0000 mon.smithi026 (mon.0) 516 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.218535+0000 mon.smithi026 (mon.0) 517 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.219342+0000 mon.smithi026 (mon.0) 518 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.nhrcgk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.222397+0000 mon.smithi026 (mon.0) 519 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.nhrcgk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:04:32.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:31.223156+0000 mon.smithi026 (mon.0) 520 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:32.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:04:31.223873+0000 mgr.smithi026.brymfp (mgr.14194) 199 : cephadm [INF] Deploying daemon mds.cephfs.smithi026.nhrcgk on smithi026 2024-05-09T00:04:33.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:32.163075+0000 mon.smithi026 (mon.0) 521 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-05-09T00:04:33.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:32.555992+0000 mgr.smithi026.brymfp (mgr.14194) 200 : cluster [DBG] pgmap v174: 65 pgs: 3 creating+peering, 4 active+clean, 58 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:33.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:32.163075+0000 mon.smithi026 (mon.0) 521 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-05-09T00:04:33.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:32.555992+0000 mgr.smithi026.brymfp (mgr.14194) 200 : cluster [DBG] pgmap v174: 65 pgs: 3 creating+peering, 4 active+clean, 58 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:34.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:34 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:33.168070+0000 mon.smithi026 (mon.0) 522 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-05-09T00:04:34.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:34 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:33.168070+0000 mon.smithi026 (mon.0) 522 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-05-09T00:04:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 -- 172.21.15.26:0/1725249189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f66f0 msgr2=0x7f95a80f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 --2- 172.21.15.26:0/1725249189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f66f0 0x7f95a80f6b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f95980047f0 tx=0x7f9598009cb0).stop 2024-05-09T00:04:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 -- 172.21.15.26:0/1725249189 shutdown_connections 2024-05-09T00:04:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 --2- 172.21.15.26:0/1725249189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95a80f7990 0x7f95a80f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 --2- 172.21.15.26:0/1725249189 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f66f0 0x7f95a80f6b10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 -- 172.21.15.26:0/1725249189 >> 172.21.15.26:0/1725249189 conn(0x7f95a80f1e50 msgr2=0x7f95a80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 -- 172.21.15.26:0/1725249189 shutdown_connections 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 -- 172.21.15.26:0/1725249189 wait complete. 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.268+0000 7f95adda3700 1 Processor -- start 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95adda3700 1 -- start start 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95adda3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95a80f66f0 0x7f95a8107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95adda3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f7990 0x7f95a8108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95adda3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8108a10 con 0x7f95a80f7990 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95adda3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8108b50 con 0x7f95a80f66f0 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f7990 0x7f95a8108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f7990 0x7f95a8108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44316/0 (socket says 172.21.15.26:44316) 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95a6ffd700 1 -- 172.21.15.26:0/3742184112 learned_addr learned my addr 172.21.15.26:0/3742184112 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95a6ffd700 1 -- 172.21.15.26:0/3742184112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95a80f66f0 msgr2=0x7f95a8107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95a6ffd700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95a80f66f0 0x7f95a8107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95a6ffd700 1 -- 172.21.15.26:0/3742184112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598005040 con 0x7f95a80f7990 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95a6ffd700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f7990 0x7f95a8108460 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f959c002770 tx=0x7f959c002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.269+0000 7f95a4ff9700 1 -- 172.21.15.26:0/3742184112 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c002d80 con 0x7f95a80f7990 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.270+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a810d5f0 con 0x7f95a80f7990 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.270+0000 7f95a4ff9700 1 -- 172.21.15.26:0/3742184112 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f959c00f040 con 0x7f95a80f7990 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.270+0000 7f95a4ff9700 1 -- 172.21.15.26:0/3742184112 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c00d820 con 0x7f95a80f7990 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.270+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a810db30 con 0x7f95a80f7990 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.270+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a80feeb0 con 0x7f95a80f7990 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.272+0000 7f95a4ff9700 1 -- 172.21.15.26:0/3742184112 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f959c007b40 con 0x7f95a80f7990 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.272+0000 7f95a4ff9700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9590061180 0x7f9590063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.272+0000 7f95a4ff9700 1 -- 172.21.15.26:0/3742184112 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f959c07c930 con 0x7f95a80f7990 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.272+0000 7f95a77fe700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9590061180 0x7f9590063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.272+0000 7f95a77fe700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9590061180 0x7f9590063640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9598013510 tx=0x7f9598009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:35.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.276+0000 7f95a4ff9700 1 -- 172.21.15.26:0/3742184112 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f959c0508e0 con 0x7f95a80f7990 2024-05-09T00:04:35.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.495+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f95a810e5f0 con 0x7f95a80f7990 2024-05-09T00:04:35.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.496+0000 7f95a4ff9700 1 -- 172.21.15.26:0/3742184112 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1034 (secure 0 0 0) 0x7f959c0504d0 con 0x7f95a80f7990 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:e2 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 2 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:31.152074+0000 2024-05-09T00:04:35.491 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:in 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:up {} 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:04:35.492 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:04:35.493 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2024-05-09T00:04:35.493 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:04:35.493 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 0 2024-05-09T00:04:35.493 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:35.493 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9590061180 msgr2=0x7f9590063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9590061180 0x7f9590063640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9598013510 tx=0x7f9598009cb0).stop 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f7990 msgr2=0x7f95a8108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f7990 0x7f95a8108460 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f959c002770 tx=0x7f959c002b30).stop 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 shutdown_connections 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9590061180 0x7f9590063640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95a80f66f0 0x7f95a8107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 --2- 172.21.15.26:0/3742184112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95a80f7990 0x7f95a8108460 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 >> 172.21.15.26:0/3742184112 conn(0x7f95a80f1e50 msgr2=0x7f95a8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.497+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 shutdown_connections 2024-05-09T00:04:35.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:35.498+0000 7f95adda3700 1 -- 172.21.15.26:0/3742184112 wait complete. 2024-05-09T00:04:35.495 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2024-05-09T00:04:35.520 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:34.556377+0000 mgr.smithi026.brymfp (mgr.14194) 201 : cluster [DBG] pgmap v176: 65 pgs: 3 creating+peering, 49 active+clean, 13 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:35.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:34.556377+0000 mgr.smithi026.brymfp (mgr.14194) 201 : cluster [DBG] pgmap v176: 65 pgs: 3 creating+peering, 49 active+clean, 13 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:36.152 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:04:36.172 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:04:36.173 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:35.354925+0000 mon.smithi026 (mon.0) 523 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:35.355852+0000 mon.smithi026 (mon.0) 524 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lzxgvd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:35.358274+0000 mon.smithi026 (mon.0) 525 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lzxgvd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:35.358926+0000 mon.smithi026 (mon.0) 526 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:04:35.359521+0000 mgr.smithi026.brymfp (mgr.14194) 202 : cephadm [INF] Deploying daemon mds.cephfs.smithi135.lzxgvd on smithi135 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:35.497354+0000 mon.smithi026 (mon.0) 527 : audit [DBG] from='client.? 172.21.15.26:0/3742184112' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.176156+0000 mon.smithi026 (mon.0) 528 : cluster [DBG] mds.? [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] up:boot 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.176194+0000 mon.smithi026 (mon.0) 529 : cluster [INF] daemon mds.cephfs.smithi026.nhrcgk assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.176259+0000 mon.smithi026 (mon.0) 530 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.176281+0000 mon.smithi026 (mon.0) 531 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T00:04:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.176290+0000 mon.smithi026 (mon.0) 532 : cluster [INF] Cluster is now healthy 2024-05-09T00:04:36.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.176449+0000 mon.smithi026 (mon.0) 533 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-05-09T00:04:36.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:36.176538+0000 mon.smithi026 (mon.0) 534 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:04:36.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.179264+0000 mon.smithi026 (mon.0) 535 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:creating} 2024-05-09T00:04:36.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.193246+0000 mon.smithi026 (mon.0) 536 : cluster [INF] daemon mds.cephfs.smithi026.nhrcgk is now active in filesystem cephfs as rank 0 2024-05-09T00:04:36.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:35.354925+0000 mon.smithi026 (mon.0) 523 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:36.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:35.355852+0000 mon.smithi026 (mon.0) 524 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lzxgvd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:04:36.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:35.358274+0000 mon.smithi026 (mon.0) 525 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lzxgvd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:04:36.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:35.358926+0000 mon.smithi026 (mon.0) 526 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:04:35.359521+0000 mgr.smithi026.brymfp (mgr.14194) 202 : cephadm [INF] Deploying daemon mds.cephfs.smithi135.lzxgvd on smithi135 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:35.497354+0000 mon.smithi026 (mon.0) 527 : audit [DBG] from='client.? 172.21.15.26:0/3742184112' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.176156+0000 mon.smithi026 (mon.0) 528 : cluster [DBG] mds.? [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] up:boot 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.176194+0000 mon.smithi026 (mon.0) 529 : cluster [INF] daemon mds.cephfs.smithi026.nhrcgk assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.176259+0000 mon.smithi026 (mon.0) 530 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.176281+0000 mon.smithi026 (mon.0) 531 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.176290+0000 mon.smithi026 (mon.0) 532 : cluster [INF] Cluster is now healthy 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.176449+0000 mon.smithi026 (mon.0) 533 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:36.176538+0000 mon.smithi026 (mon.0) 534 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.179264+0000 mon.smithi026 (mon.0) 535 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:creating} 2024-05-09T00:04:36.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.193246+0000 mon.smithi026 (mon.0) 536 : cluster [INF] daemon mds.cephfs.smithi026.nhrcgk is now active in filesystem cephfs as rank 0 2024-05-09T00:04:37.387 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:36.556943+0000 mgr.smithi026.brymfp (mgr.14194) 203 : cluster [DBG] pgmap v177: 65 pgs: 3 creating+peering, 62 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:37.387 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:37.180819+0000 mon.smithi026 (mon.0) 537 : cluster [DBG] mds.? [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] up:active 2024-05-09T00:04:37.387 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:37.180865+0000 mon.smithi026 (mon.0) 538 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 2024-05-09T00:04:37.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:36.556943+0000 mgr.smithi026.brymfp (mgr.14194) 203 : cluster [DBG] pgmap v177: 65 pgs: 3 creating+peering, 62 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:37.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:37.180819+0000 mon.smithi026 (mon.0) 537 : cluster [DBG] mds.? [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] up:active 2024-05-09T00:04:37.643 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:37.180865+0000 mon.smithi026 (mon.0) 538 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 2024-05-09T00:04:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.200+0000 7f954a74b700 1 -- 172.21.15.26:0/950062755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95440fa9b0 msgr2=0x7f95440fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.200+0000 7f954a74b700 1 --2- 172.21.15.26:0/950062755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95440fa9b0 0x7f95440fcda0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f95380047f0 tx=0x7f9538009cb0).stop 2024-05-09T00:04:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.200+0000 7f954a74b700 1 -- 172.21.15.26:0/950062755 shutdown_connections 2024-05-09T00:04:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.200+0000 7f954a74b700 1 --2- 172.21.15.26:0/950062755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95440fa9b0 0x7f95440fcda0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.200+0000 7f954a74b700 1 --2- 172.21.15.26:0/950062755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9544061220 0x7f95440fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.200+0000 7f954a74b700 1 -- 172.21.15.26:0/950062755 >> 172.21.15.26:0/950062755 conn(0x7f95440f1e50 msgr2=0x7f95440f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.200+0000 7f954a74b700 1 -- 172.21.15.26:0/950062755 shutdown_connections 2024-05-09T00:04:38.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.200+0000 7f954a74b700 1 -- 172.21.15.26:0/950062755 wait complete. 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.201+0000 7f954a74b700 1 Processor -- start 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.201+0000 7f954a74b700 1 -- start start 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.201+0000 7f954a74b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9544061220 0x7f95441080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.201+0000 7f954a74b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440fa9b0 0x7f9544108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.201+0000 7f954a74b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544108b40 con 0x7f9544061220 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.201+0000 7f954a74b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544108c80 con 0x7f95440fa9b0 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f9543fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9544061220 0x7f95441080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f9543fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9544061220 0x7f95441080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44326/0 (socket says 172.21.15.26:44326) 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f9543fff700 1 -- 172.21.15.26:0/1114117547 learned_addr learned my addr 172.21.15.26:0/1114117547 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:38.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f95437fe700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440fa9b0 0x7f9544108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f9543fff700 1 -- 172.21.15.26:0/1114117547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440fa9b0 msgr2=0x7f9544108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f9543fff700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440fa9b0 0x7f9544108590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f9543fff700 1 -- 172.21.15.26:0/1114117547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538005040 con 0x7f9544061220 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f95437fe700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440fa9b0 0x7f9544108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f9543fff700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9544061220 0x7f95441080a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f953400e8f0 tx=0x7f953400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f95417fa700 1 -- 172.21.15.26:0/1114117547 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953400ee90 con 0x7f9544061220 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f95417fa700 1 -- 172.21.15.26:0/1114117547 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f953400f040 con 0x7f9544061220 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954410d720 con 0x7f9544061220 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f95417fa700 1 -- 172.21.15.26:0/1114117547 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953400c8a0 con 0x7f9544061220 2024-05-09T00:04:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.202+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954410dce0 con 0x7f9544061220 2024-05-09T00:04:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.203+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95440fffb0 con 0x7f9544061220 2024-05-09T00:04:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.204+0000 7f95417fa700 1 -- 172.21.15.26:0/1114117547 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9534007b40 con 0x7f9544061220 2024-05-09T00:04:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.204+0000 7f95417fa700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f952c061180 0x7f952c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:38.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.204+0000 7f95417fa700 1 -- 172.21.15.26:0/1114117547 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f953407c5b0 con 0x7f9544061220 2024-05-09T00:04:38.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.204+0000 7f95437fe700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f952c061180 0x7f952c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:38.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.205+0000 7f95437fe700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f952c061180 0x7f952c063640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9538004e60 tx=0x7f953800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:38.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.213+0000 7f95417fa700 1 -- 172.21.15.26:0/1114117547 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9534050480 con 0x7f9544061220 2024-05-09T00:04:38.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:38.462+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f9544101e20 con 0x7f9544061220 2024-05-09T00:04:39.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.132+0000 7f95417fa700 1 -- 172.21.15.26:0/1114117547 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f95340190b0 con 0x7f9544061220 2024-05-09T00:04:39.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f952c061180 msgr2=0x7f952c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:39.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f952c061180 0x7f952c063640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9538004e60 tx=0x7f953800b040).stop 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9544061220 msgr2=0x7f95441080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9544061220 0x7f95441080a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f953400e8f0 tx=0x7f953400b040).stop 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 shutdown_connections 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f952c061180 0x7f952c063640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9544061220 0x7f95441080a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 --2- 172.21.15.26:0/1114117547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95440fa9b0 0x7f9544108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 >> 172.21.15.26:0/1114117547 conn(0x7f95440f1e50 msgr2=0x7f95440f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 shutdown_connections 2024-05-09T00:04:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:39.134+0000 7f954a74b700 1 -- 172.21.15.26:0/1114117547 wait complete. 2024-05-09T00:04:39.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:38.088262+0000 mon.smithi026 (mon.0) 539 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:39.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:38.089574+0000 mon.smithi026 (mon.0) 540 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.gbyppy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:04:39.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:38.094043+0000 mon.smithi026 (mon.0) 541 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.gbyppy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:04:39.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:38.094991+0000 mon.smithi026 (mon.0) 542 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:39.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:04:38.095672+0000 mgr.smithi026.brymfp (mgr.14194) 204 : cephadm [INF] Deploying daemon mds.cephfs.smithi026.gbyppy on smithi026 2024-05-09T00:04:39.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:38.130202+0000 mon.smithi026 (mon.0) 543 : cluster [DBG] mds.? [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] up:boot 2024-05-09T00:04:39.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:38.130256+0000 mon.smithi026 (mon.0) 544 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 1 up:standby 2024-05-09T00:04:39.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:38.130360+0000 mon.smithi026 (mon.0) 545 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:04:39.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:38.463948+0000 mon.smithi026 (mon.0) 546 : audit [INF] from='client.? 172.21.15.26:0/1114117547' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-05-09T00:04:39.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:38.557520+0000 mgr.smithi026.brymfp (mgr.14194) 205 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 1.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:38.088262+0000 mon.smithi026 (mon.0) 539 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:38.089574+0000 mon.smithi026 (mon.0) 540 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.gbyppy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:38.094043+0000 mon.smithi026 (mon.0) 541 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.gbyppy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:38.094991+0000 mon.smithi026 (mon.0) 542 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:04:38.095672+0000 mgr.smithi026.brymfp (mgr.14194) 204 : cephadm [INF] Deploying daemon mds.cephfs.smithi026.gbyppy on smithi026 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:38.130202+0000 mon.smithi026 (mon.0) 543 : cluster [DBG] mds.? [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] up:boot 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:38.130256+0000 mon.smithi026 (mon.0) 544 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 1 up:standby 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:38.130360+0000 mon.smithi026 (mon.0) 545 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:04:39.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:38.463948+0000 mon.smithi026 (mon.0) 546 : audit [INF] from='client.? 172.21.15.26:0/1114117547' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-05-09T00:04:39.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:38.557520+0000 mgr.smithi026.brymfp (mgr.14194) 205 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 1.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:40.216 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:39.133574+0000 mon.smithi026 (mon.0) 547 : audit [INF] from='client.? 172.21.15.26:0/1114117547' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-05-09T00:04:40.216 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:39.133639+0000 mon.smithi026 (mon.0) 548 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 1 up:standby 2024-05-09T00:04:40.240 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:04:40.340 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:04:40.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-05-09T00:04:40.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:39.133574+0000 mon.smithi026 (mon.0) 547 : audit [INF] from='client.? 172.21.15.26:0/1114117547' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-05-09T00:04:40.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:39.133639+0000 mon.smithi026 (mon.0) 548 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 1 up:standby 2024-05-09T00:04:41.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:40.558022+0000 mgr.smithi026.brymfp (mgr.14194) 206 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.5 KiB/s wr, 5 op/s 2024-05-09T00:04:41.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:40.558022+0000 mgr.smithi026.brymfp (mgr.14194) 206 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.5 KiB/s wr, 5 op/s 2024-05-09T00:04:42.571 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:41.569741+0000 mon.smithi026 (mon.0) 549 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:42.571 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:41.570662+0000 mon.smithi026 (mon.0) 550 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.hcciyw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:04:42.571 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:41.573045+0000 mon.smithi026 (mon.0) 551 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.hcciyw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:04:42.571 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:41.573651+0000 mon.smithi026 (mon.0) 552 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:42.571 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:04:41.574193+0000 mgr.smithi026.brymfp (mgr.14194) 207 : cephadm [INF] Deploying daemon mds.cephfs.smithi135.hcciyw on smithi135 2024-05-09T00:04:42.572 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:42.142979+0000 mon.smithi026 (mon.0) 553 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] up:boot 2024-05-09T00:04:42.572 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:42.143021+0000 mon.smithi026 (mon.0) 554 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 2 up:standby 2024-05-09T00:04:42.572 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:42.143546+0000 mon.smithi026 (mon.0) 555 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:04:42.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:41.569741+0000 mon.smithi026 (mon.0) 549 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:42.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:41.570662+0000 mon.smithi026 (mon.0) 550 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.hcciyw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:04:42.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:41.573045+0000 mon.smithi026 (mon.0) 551 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.hcciyw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:04:42.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:41.573651+0000 mon.smithi026 (mon.0) 552 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:04:41.574193+0000 mgr.smithi026.brymfp (mgr.14194) 207 : cephadm [INF] Deploying daemon mds.cephfs.smithi135.hcciyw on smithi135 2024-05-09T00:04:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:42.142979+0000 mon.smithi026 (mon.0) 553 : cluster [DBG] mds.? [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] up:boot 2024-05-09T00:04:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:42.143021+0000 mon.smithi026 (mon.0) 554 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 2 up:standby 2024-05-09T00:04:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:42.143546+0000 mon.smithi026 (mon.0) 555 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:04:42.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.805+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3754887476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 msgr2=0x7f7fec0fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:42.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.805+0000 7f7ff3f08700 1 --2- 172.21.15.26:0/3754887476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 0x7f7fec0fcdb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f7fdc0047f0 tx=0x7f7fdc009cb0).stop 2024-05-09T00:04:42.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.805+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3754887476 shutdown_connections 2024-05-09T00:04:42.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.805+0000 7f7ff3f08700 1 --2- 172.21.15.26:0/3754887476 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 0x7f7fec0fcdb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:42.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.805+0000 7f7ff3f08700 1 --2- 172.21.15.26:0/3754887476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fec0611e0 0x7f7fec0fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:42.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.805+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3754887476 >> 172.21.15.26:0/3754887476 conn(0x7f7fec0f1e50 msgr2=0x7f7fec0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:42.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.805+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3754887476 shutdown_connections 2024-05-09T00:04:42.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.805+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3754887476 wait complete. 2024-05-09T00:04:42.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff3f08700 1 Processor -- start 2024-05-09T00:04:42.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff3f08700 1 -- start start 2024-05-09T00:04:42.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff3f08700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fec0611e0 0x7f7fec107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:42.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff3f08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 0x7f7fec108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:42.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff3f08700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec108a20 con 0x7f7fec0fa960 2024-05-09T00:04:42.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff3f08700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec108b60 con 0x7f7fec0611e0 2024-05-09T00:04:42.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff14a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 0x7f7fec108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:42.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff14a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 0x7f7fec108470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55546/0 (socket says 172.21.15.26:55546) 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff14a3700 1 -- 172.21.15.26:0/3335089089 learned_addr learned my addr 172.21.15.26:0/3335089089 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.806+0000 7f7ff1ca4700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fec0611e0 0x7f7fec107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7ff14a3700 1 -- 172.21.15.26:0/3335089089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fec0611e0 msgr2=0x7f7fec107f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7ff14a3700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fec0611e0 0x7f7fec107f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7ff14a3700 1 -- 172.21.15.26:0/3335089089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc005040 con 0x7f7fec0fa960 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7ff14a3700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 0x7f7fec108470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7fdc009eb0 tx=0x7f7fdc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7fe2ffd700 1 -- 172.21.15.26:0/3335089089 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fdc00e030 con 0x7f7fec0fa960 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec10d5a0 con 0x7f7fec0fa960 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7fe2ffd700 1 -- 172.21.15.26:0/3335089089 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7fdc007e90 con 0x7f7fec0fa960 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7fe2ffd700 1 -- 172.21.15.26:0/3335089089 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fdc018070 con 0x7f7fec0fa960 2024-05-09T00:04:42.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.807+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec10dae0 con 0x7f7fec0fa960 2024-05-09T00:04:42.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.808+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec0fffc0 con 0x7f7fec0fa960 2024-05-09T00:04:42.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.808+0000 7f7fe2ffd700 1 -- 172.21.15.26:0/3335089089 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f7fdc01d420 con 0x7f7fec0fa960 2024-05-09T00:04:42.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.809+0000 7f7fe2ffd700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7fd8061180 0x7f7fd8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:42.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.809+0000 7f7ff1ca4700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7fd8061180 0x7f7fd8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:42.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.809+0000 7f7fe2ffd700 1 -- 172.21.15.26:0/3335089089 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f7fdc07dca0 con 0x7f7fec0fa960 2024-05-09T00:04:42.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.809+0000 7f7ff1ca4700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7fd8061180 0x7f7fd8063640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f7fe8004dc0 tx=0x7f7fe800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:42.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:42.813+0000 7f7fe2ffd700 1 -- 172.21.15.26:0/3335089089 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7fdc082070 con 0x7f7fec0fa960 2024-05-09T00:04:43.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.029+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7fec0598f0 con 0x7f7fec0fa960 2024-05-09T00:04:43.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.572+0000 7f7fe2ffd700 1 -- 172.21.15.26:0/3335089089 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7fdc051c30 con 0x7f7fec0fa960 2024-05-09T00:04:43.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7fd8061180 msgr2=0x7f7fd8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:43.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7fd8061180 0x7f7fd8063640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f7fe8004dc0 tx=0x7f7fe800b040).stop 2024-05-09T00:04:43.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 msgr2=0x7f7fec108470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:43.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 0x7f7fec108470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7fdc009eb0 tx=0x7f7fdc009cb0).stop 2024-05-09T00:04:43.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 shutdown_connections 2024-05-09T00:04:43.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7fd8061180 0x7f7fd8063640 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:43.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fec0611e0 0x7f7fec107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:43.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 --2- 172.21.15.26:0/3335089089 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fec0fa960 0x7f7fec108470 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:43.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 >> 172.21.15.26:0/3335089089 conn(0x7f7fec0f1e50 msgr2=0x7f7fec0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:43.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 shutdown_connections 2024-05-09T00:04:43.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:43.575+0000 7f7ff3f08700 1 -- 172.21.15.26:0/3335089089 wait complete. 2024-05-09T00:04:43.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:42.558569+0000 mgr.smithi026.brymfp (mgr.14194) 208 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 2 op/s 2024-05-09T00:04:43.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:43.031515+0000 mon.smithi026 (mon.0) 556 : audit [INF] from='client.? 172.21.15.26:0/3335089089' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-09T00:04:43.877 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:42.558569+0000 mgr.smithi026.brymfp (mgr.14194) 208 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 2 op/s 2024-05-09T00:04:43.877 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:43.031515+0000 mon.smithi026 (mon.0) 556 : audit [INF] from='client.? 172.21.15.26:0/3335089089' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-09T00:04:44.231 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:04:44.295 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:04:44.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-05-09T00:04:44.843 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:43.573315+0000 mon.smithi026 (mon.0) 557 : audit [INF] from='client.? 172.21.15.26:0/3335089089' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-09T00:04:44.843 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:43.573396+0000 mon.smithi026 (mon.0) 558 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 2 up:standby 2024-05-09T00:04:44.843 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:44.094537+0000 mon.smithi026 (mon.0) 559 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:44.843 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:44.095866+0000 mon.smithi026 (mon.0) 560 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:44.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:43.573315+0000 mon.smithi026 (mon.0) 557 : audit [INF] from='client.? 172.21.15.26:0/3335089089' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-09T00:04:44.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:43.573396+0000 mon.smithi026 (mon.0) 558 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 2 up:standby 2024-05-09T00:04:44.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:44.094537+0000 mon.smithi026 (mon.0) 559 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:44.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:44.095866+0000 mon.smithi026 (mon.0) 560 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:45.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:44.559041+0000 mgr.smithi026.brymfp (mgr.14194) 209 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 2 op/s 2024-05-09T00:04:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:44.582449+0000 mon.smithi026 (mon.0) 561 : cluster [DBG] mds.? [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] up:boot 2024-05-09T00:04:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:44.582507+0000 mon.smithi026 (mon.0) 562 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:04:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:44.582599+0000 mon.smithi026 (mon.0) 563 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:04:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:44.704181+0000 mon.smithi026 (mon.0) 564 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:44.559041+0000 mgr.smithi026.brymfp (mgr.14194) 209 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 2 op/s 2024-05-09T00:04:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:44.582449+0000 mon.smithi026 (mon.0) 561 : cluster [DBG] mds.? [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] up:boot 2024-05-09T00:04:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:44.582507+0000 mon.smithi026 (mon.0) 562 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:04:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:44.582599+0000 mon.smithi026 (mon.0) 563 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:04:45.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:44.704181+0000 mon.smithi026 (mon.0) 564 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:47.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 -- 172.21.15.26:0/583476688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 msgr2=0x7f99b00f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:47.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 --2- 172.21.15.26:0/583476688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 0x7f99b00f7e30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f99a00047f0 tx=0x7f99a0009cb0).stop 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 -- 172.21.15.26:0/583476688 shutdown_connections 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 --2- 172.21.15.26:0/583476688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00f8cb0 0x7f99b00f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 --2- 172.21.15.26:0/583476688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 0x7f99b00f7e30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 -- 172.21.15.26:0/583476688 >> 172.21.15.26:0/583476688 conn(0x7f99b00f3150 msgr2=0x7f99b00f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 -- 172.21.15.26:0/583476688 shutdown_connections 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 -- 172.21.15.26:0/583476688 wait complete. 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 Processor -- start 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.127+0000 7f99b699e700 1 -- start start 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99b699e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 0x7f99b0108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99b699e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00f8cb0 0x7f99b0108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:47.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99b699e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0108c30 con 0x7f99b00f7a10 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99b699e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0108d70 con 0x7f99b00f8cb0 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99affff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 0x7f99b0108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99affff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 0x7f99b0108190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55556/0 (socket says 172.21.15.26:55556) 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99affff700 1 -- 172.21.15.26:0/729218201 learned_addr learned my addr 172.21.15.26:0/729218201 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99af7fe700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00f8cb0 0x7f99b0108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99affff700 1 -- 172.21.15.26:0/729218201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00f8cb0 msgr2=0x7f99b0108680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99affff700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00f8cb0 0x7f99b0108680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99affff700 1 -- 172.21.15.26:0/729218201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a0005040 con 0x7f99b00f7a10 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99af7fe700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00f8cb0 0x7f99b0108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99affff700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 0x7f99b0108190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f99a0013470 tx=0x7f99a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99ad7fa700 1 -- 172.21.15.26:0/729218201 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99a000e030 con 0x7f99b00f7a10 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.128+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b010d7b0 con 0x7f99b00f7a10 2024-05-09T00:04:47.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.129+0000 7f99ad7fa700 1 -- 172.21.15.26:0/729218201 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f99a0007e90 con 0x7f99b00f7a10 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.129+0000 7f99ad7fa700 1 -- 172.21.15.26:0/729218201 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99a0018070 con 0x7f99b00f7a10 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.129+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b010dcf0 con 0x7f99b00f7a10 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.129+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b005fb50 con 0x7f99b00f7a10 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.130+0000 7f99ad7fa700 1 -- 172.21.15.26:0/729218201 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f99a001d940 con 0x7f99b00f7a10 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.130+0000 7f99ad7fa700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f999c061180 0x7f999c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.130+0000 7f99ad7fa700 1 -- 172.21.15.26:0/729218201 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f99a007df00 con 0x7f99b00f7a10 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.131+0000 7f99af7fe700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f999c061180 0x7f999c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.131+0000 7f99af7fe700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f999c061180 0x7f999c063640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f99980041d0 tx=0x7f9998009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:47.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.135+0000 7f99ad7fa700 1 -- 172.21.15.26:0/729218201 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f99a0051e90 con 0x7f99b00f7a10 2024-05-09T00:04:47.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.353+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f99b0102110 con 0x7f99b00f7a10 2024-05-09T00:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.768+0000 7f99ad7fa700 1 -- 172.21.15.26:0/729218201 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v11) v1 ==== 168+0+0 (secure 0 0 0) 0x7f99a0051a80 con 0x7f99b00f7a10 2024-05-09T00:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.769+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f999c061180 msgr2=0x7f999c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.769+0000 7f99b699e700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f999c061180 0x7f999c063640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f99980041d0 tx=0x7f9998009040).stop 2024-05-09T00:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 msgr2=0x7f99b0108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 0x7f99b0108190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f99a0013470 tx=0x7f99a0009cb0).stop 2024-05-09T00:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 shutdown_connections 2024-05-09T00:04:47.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f999c061180 0x7f999c063640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:47.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b00f7a10 0x7f99b0108190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:47.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 --2- 172.21.15.26:0/729218201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99b00f8cb0 0x7f99b0108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:47.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 >> 172.21.15.26:0/729218201 conn(0x7f99b00f3150 msgr2=0x7f99b00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:47.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 shutdown_connections 2024-05-09T00:04:47.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:47.770+0000 7f99b699e700 1 -- 172.21.15.26:0/729218201 wait complete. 2024-05-09T00:04:47.765 INFO:teuthology.orchestra.run.smithi026.stderr:inline data enabled 2024-05-09T00:04:48.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:46.559512+0000 mgr.smithi026.brymfp (mgr.14194) 210 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-05-09T00:04:48.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:46.765104+0000 mon.smithi026 (mon.0) 565 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:48.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:47.354800+0000 mon.smithi026 (mon.0) 566 : audit [INF] from='client.? 172.21.15.26:0/729218201' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T00:04:48.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:46.559512+0000 mgr.smithi026.brymfp (mgr.14194) 210 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-05-09T00:04:48.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:46.765104+0000 mon.smithi026 (mon.0) 565 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:48.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:47.354800+0000 mon.smithi026 (mon.0) 566 : audit [INF] from='client.? 172.21.15.26:0/729218201' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T00:04:49.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:47.763602+0000 mon.smithi026 (mon.0) 567 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-05-09T00:04:49.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:47.769406+0000 mon.smithi026 (mon.0) 568 : audit [INF] from='client.? 172.21.15.26:0/729218201' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T00:04:49.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:47.769484+0000 mon.smithi026 (mon.0) 569 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:04:49.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:47.763602+0000 mon.smithi026 (mon.0) 567 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-05-09T00:04:49.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:47.769406+0000 mon.smithi026 (mon.0) 568 : audit [INF] from='client.? 172.21.15.26:0/729218201' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T00:04:49.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:47.769484+0000 mon.smithi026 (mon.0) 569 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:04:49.349 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:04:49.416 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:04:49.416 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T00:04:50.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:48.560014+0000 mgr.smithi026.brymfp (mgr.14194) 211 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 921 B/s wr, 1 op/s 2024-05-09T00:04:50.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:48.560014+0000 mgr.smithi026.brymfp (mgr.14194) 211 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 921 B/s wr, 1 op/s 2024-05-09T00:04:51.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:50.068272+0000 mon.smithi026 (mon.0) 570 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:51.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:50.069055+0000 mon.smithi026 (mon.0) 571 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:51.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:50.069660+0000 mon.smithi026 (mon.0) 572 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:51.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:50.072999+0000 mon.smithi026 (mon.0) 573 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:51.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:50.077321+0000 mon.smithi026 (mon.0) 574 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:51.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:50.560492+0000 mgr.smithi026.brymfp (mgr.14194) 212 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-05-09T00:04:51.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:50.068272+0000 mon.smithi026 (mon.0) 570 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:51.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:50.069055+0000 mon.smithi026 (mon.0) 571 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:51.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:50.069660+0000 mon.smithi026 (mon.0) 572 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:51.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:50.072999+0000 mon.smithi026 (mon.0) 573 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:51.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:50.077321+0000 mon.smithi026 (mon.0) 574 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:51.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:50.560492+0000 mgr.smithi026.brymfp (mgr.14194) 212 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-05-09T00:04:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.390+0000 7f3614aae700 1 -- 172.21.15.26:0/3588375418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f7a10 msgr2=0x7f36100f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.390+0000 7f3614aae700 1 --2- 172.21.15.26:0/3588375418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f7a10 0x7f36100f7e30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f36000047f0 tx=0x7f3600009cb0).stop 2024-05-09T00:04:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.390+0000 7f3614aae700 1 -- 172.21.15.26:0/3588375418 shutdown_connections 2024-05-09T00:04:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.390+0000 7f3614aae700 1 --2- 172.21.15.26:0/3588375418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36100f8cb0 0x7f36100f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.390+0000 7f3614aae700 1 --2- 172.21.15.26:0/3588375418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f7a10 0x7f36100f7e30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.390+0000 7f3614aae700 1 -- 172.21.15.26:0/3588375418 >> 172.21.15.26:0/3588375418 conn(0x7f36100f3150 msgr2=0x7f36100f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.390+0000 7f3614aae700 1 -- 172.21.15.26:0/3588375418 shutdown_connections 2024-05-09T00:04:51.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.390+0000 7f3614aae700 1 -- 172.21.15.26:0/3588375418 wait complete. 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f3614aae700 1 Processor -- start 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f3614aae700 1 -- start start 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f3614aae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36100f7a10 0x7f36101081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f3614aae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f8cb0 0x7f36101086c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f3614aae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610108c70 con 0x7f36100f8cb0 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f3614aae700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610108db0 con 0x7f36100f7a10 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f360dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f8cb0 0x7f36101086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f360dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f8cb0 0x7f36101086c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55564/0 (socket says 172.21.15.26:55564) 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f360dd9b700 1 -- 172.21.15.26:0/2831615714 learned_addr learned my addr 172.21.15.26:0/2831615714 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f360e59c700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36100f7a10 0x7f36101081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f360dd9b700 1 -- 172.21.15.26:0/2831615714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36100f7a10 msgr2=0x7f36101081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:51.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f360dd9b700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36100f7a10 0x7f36101081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f360dd9b700 1 -- 172.21.15.26:0/2831615714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600005040 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.391+0000 7f360dd9b700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f8cb0 0x7f36101086c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f36040041d0 tx=0x7f3604009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.392+0000 7f35ff7fe700 1 -- 172.21.15.26:0/2831615714 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3604007b40 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.392+0000 7f35ff7fe700 1 -- 172.21.15.26:0/2831615714 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f360400f040 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.392+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361010d850 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.392+0000 7f35ff7fe700 1 -- 172.21.15.26:0/2831615714 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3604013730 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.392+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361010dd90 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.393+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361005fb50 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.393+0000 7f35ff7fe700 1 -- 172.21.15.26:0/2831615714 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f3604009110 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.394+0000 7f35ff7fe700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f35f80611d0 0x7f35f8063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.394+0000 7f35ff7fe700 1 -- 172.21.15.26:0/2831615714 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f360407c300 con 0x7f36100f8cb0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.394+0000 7f360e59c700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f35f80611d0 0x7f35f8063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:51.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.394+0000 7f360e59c700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f35f80611d0 0x7f35f8063690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3600004f10 tx=0x7f360000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:51.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.397+0000 7f35ff7fe700 1 -- 172.21.15.26:0/2831615714 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3604050250 con 0x7f36100f8cb0 2024-05-09T00:04:51.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.614+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f36101001f0 con 0x7f36100f8cb0 2024-05-09T00:04:51.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.614+0000 7f35ff7fe700 1 -- 172.21.15.26:0/2831615714 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7f360404fe40 con 0x7f36100f8cb0 2024-05-09T00:04:51.609 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:04:51.609 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:04:51.609 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:04:51.609 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:04:51.609 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:51.609 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:04:51.610 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:04:51.611 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:04:51.612 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:04:51.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f35f80611d0 msgr2=0x7f35f8063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:51.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f35f80611d0 0x7f35f8063690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3600004f10 tx=0x7f360000b040).stop 2024-05-09T00:04:51.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f8cb0 msgr2=0x7f36101086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:51.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f8cb0 0x7f36101086c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f36040041d0 tx=0x7f3604009f60).stop 2024-05-09T00:04:51.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 shutdown_connections 2024-05-09T00:04:51.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f35f80611d0 0x7f35f8063690 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:51.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36100f7a10 0x7f36101081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:51.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 --2- 172.21.15.26:0/2831615714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36100f8cb0 0x7f36101086c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:51.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 >> 172.21.15.26:0/2831615714 conn(0x7f36100f3150 msgr2=0x7f36100fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:51.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 shutdown_connections 2024-05-09T00:04:51.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:51.616+0000 7f3614aae700 1 -- 172.21.15.26:0/2831615714 wait complete. 2024-05-09T00:04:51.614 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:04:52.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:51.616118+0000 mon.smithi026 (mon.0) 575 : audit [DBG] from='client.? 172.21.15.26:0/2831615714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:04:52.395 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:51.616118+0000 mon.smithi026 (mon.0) 575 : audit [DBG] from='client.? 172.21.15.26:0/2831615714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:04:52.572 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-05-09T00:04:54.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:52.560932+0000 mgr.smithi026.brymfp (mgr.14194) 213 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-05-09T00:04:54.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:52.837008+0000 mon.smithi026 (mon.0) 576 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:54.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:52.560932+0000 mgr.smithi026.brymfp (mgr.14194) 213 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-05-09T00:04:54.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:52.837008+0000 mon.smithi026 (mon.0) 576 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:55.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.255+0000 7f3cc09d1700 1 -- 172.21.15.26:0/4174705158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 msgr2=0x7f3cbc0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:55.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.255+0000 7f3cc09d1700 1 --2- 172.21.15.26:0/4174705158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 0x7f3cbc0f6b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f3cac0047f0 tx=0x7f3cac009cb0).stop 2024-05-09T00:04:55.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.255+0000 7f3cc09d1700 1 -- 172.21.15.26:0/4174705158 shutdown_connections 2024-05-09T00:04:55.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.255+0000 7f3cc09d1700 1 --2- 172.21.15.26:0/4174705158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc0f7990 0x7f3cbc0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:55.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.255+0000 7f3cc09d1700 1 --2- 172.21.15.26:0/4174705158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 0x7f3cbc0f6b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.255+0000 7f3cc09d1700 1 -- 172.21.15.26:0/4174705158 >> 172.21.15.26:0/4174705158 conn(0x7f3cbc0f1e50 msgr2=0x7f3cbc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.255+0000 7f3cc09d1700 1 -- 172.21.15.26:0/4174705158 shutdown_connections 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.256+0000 7f3cc09d1700 1 -- 172.21.15.26:0/4174705158 wait complete. 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.256+0000 7f3cc09d1700 1 Processor -- start 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.256+0000 7f3cc09d1700 1 -- start start 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.256+0000 7f3cc09d1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 0x7f3cbc061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.256+0000 7f3cc09d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc0f7990 0x7f3cbc10cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.256+0000 7f3cc09d1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc10d290 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.256+0000 7f3cc09d1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc10d3d0 con 0x7f3cbc0f7990 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cba59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 0x7f3cbc061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:55.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cba59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 0x7f3cbc061040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37080/0 (socket says 172.21.15.26:37080) 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cba59c700 1 -- 172.21.15.26:0/3813620696 learned_addr learned my addr 172.21.15.26:0/3813620696 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cb9d9b700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc0f7990 0x7f3cbc10cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cba59c700 1 -- 172.21.15.26:0/3813620696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc0f7990 msgr2=0x7f3cbc10cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cba59c700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc0f7990 0x7f3cbc10cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cba59c700 1 -- 172.21.15.26:0/3813620696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac005040 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cba59c700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 0x7f3cbc061040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f3cac004f10 tx=0x7f3cac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cab7fe700 1 -- 172.21.15.26:0/3813620696 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cac00e070 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cab7fe700 1 -- 172.21.15.26:0/3813620696 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3cac007e90 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc10d5d0 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cab7fe700 1 -- 172.21.15.26:0/3813620696 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cac018070 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.257+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc10da80 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.258+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc0feeb0 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.259+0000 7f3cab7fe700 1 -- 172.21.15.26:0/3813620696 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f3cac0123c0 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.259+0000 7f3cab7fe700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3ca4061110 0x7f3ca40635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:55.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.259+0000 7f3cab7fe700 1 -- 172.21.15.26:0/3813620696 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f3cac07d670 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.259+0000 7f3cb9d9b700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3ca4061110 0x7f3ca40635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:55.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.259+0000 7f3cb9d9b700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3ca4061110 0x7f3ca40635d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3cb0004dc0 tx=0x7f3cb000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:55.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.264+0000 7f3cab7fe700 1 -- 172.21.15.26:0/3813620696 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3cac051600 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.480+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cbc100d20 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.481+0000 7f3cab7fe700 1 -- 172.21.15.26:0/3813620696 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+4582 (secure 0 0 0) 0x7f3cac0511f0 con 0x7f3cbc0f66f0 2024-05-09T00:04:55.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.482+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3ca4061110 msgr2=0x7f3ca40635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:55.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3ca4061110 0x7f3ca40635d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3cb0004dc0 tx=0x7f3cb000b040).stop 2024-05-09T00:04:55.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 msgr2=0x7f3cbc061040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:55.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 0x7f3cbc061040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f3cac004f10 tx=0x7f3cac009cb0).stop 2024-05-09T00:04:55.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 shutdown_connections 2024-05-09T00:04:55.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3ca4061110 0x7f3ca40635d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:55.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cbc0f66f0 0x7f3cbc061040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:55.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 --2- 172.21.15.26:0/3813620696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cbc0f7990 0x7f3cbc10cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:55.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 >> 172.21.15.26:0/3813620696 conn(0x7f3cbc0f1e50 msgr2=0x7f3cbc0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:55.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 shutdown_connections 2024-05-09T00:04:55.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:55.483+0000 7f3cc09d1700 1 -- 172.21.15.26:0/3813620696 wait complete. 2024-05-09T00:04:55.478 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:04:55.487 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:04:56.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:54.561389+0000 mgr.smithi026.brymfp (mgr.14194) 214 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-05-09T00:04:56.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:55.482230+0000 mon.smithi026 (mon.0) 577 : audit [DBG] from='client.? 172.21.15.26:0/3813620696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:04:56.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:54.561389+0000 mgr.smithi026.brymfp (mgr.14194) 214 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-05-09T00:04:56.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:55.482230+0000 mon.smithi026 (mon.0) 577 : audit [DBG] from='client.? 172.21.15.26:0/3813620696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:04:56.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-05-09T00:04:58.072 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:56.561736+0000 mgr.smithi026.brymfp (mgr.14194) 215 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:58.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:56.561736+0000 mgr.smithi026.brymfp (mgr.14194) 215 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.567+0000 7f1d6c474700 1 -- 172.21.15.26:0/2774487608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 msgr2=0x7f1d640f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.567+0000 7f1d6c474700 1 --2- 172.21.15.26:0/2774487608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 0x7f1d640f7e30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f1d600047f0 tx=0x7f1d60009cb0).stop 2024-05-09T00:04:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.567+0000 7f1d6c474700 1 -- 172.21.15.26:0/2774487608 shutdown_connections 2024-05-09T00:04:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.567+0000 7f1d6c474700 1 --2- 172.21.15.26:0/2774487608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d640f8cb0 0x7f1d640f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.567+0000 7f1d6c474700 1 --2- 172.21.15.26:0/2774487608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 0x7f1d640f7e30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.567+0000 7f1d6c474700 1 -- 172.21.15.26:0/2774487608 >> 172.21.15.26:0/2774487608 conn(0x7f1d640f3150 msgr2=0x7f1d640f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:58.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6c474700 1 -- 172.21.15.26:0/2774487608 shutdown_connections 2024-05-09T00:04:58.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6c474700 1 -- 172.21.15.26:0/2774487608 wait complete. 2024-05-09T00:04:58.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6c474700 1 Processor -- start 2024-05-09T00:04:58.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6c474700 1 -- start start 2024-05-09T00:04:58.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6c474700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 0x7f1d6406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:58.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6c474700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d640f8cb0 0x7f1d6406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:58.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6c474700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6406cf80 con 0x7f1d640f7a10 2024-05-09T00:04:58.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6c474700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6406b520 con 0x7f1d640f8cb0 2024-05-09T00:04:58.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6a210700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 0x7f1d6406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:58.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6a210700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 0x7f1d6406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37098/0 (socket says 172.21.15.26:37098) 2024-05-09T00:04:58.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.568+0000 7f1d6a210700 1 -- 172.21.15.26:0/3328934187 learned_addr learned my addr 172.21.15.26:0/3328934187 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:58.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d69a0f700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d640f8cb0 0x7f1d6406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d6a210700 1 -- 172.21.15.26:0/3328934187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d640f8cb0 msgr2=0x7f1d6406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d6a210700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d640f8cb0 0x7f1d6406b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d6a210700 1 -- 172.21.15.26:0/3328934187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60005040 con 0x7f1d640f7a10 2024-05-09T00:04:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d6a210700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 0x7f1d6406c9d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f1d60013470 tx=0x7f1d60009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d5b7fe700 1 -- 172.21.15.26:0/3328934187 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6000e030 con 0x7f1d640f7a10 2024-05-09T00:04:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6406b740 con 0x7f1d640f7a10 2024-05-09T00:04:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d5b7fe700 1 -- 172.21.15.26:0/3328934187 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1d60007e90 con 0x7f1d640f7a10 2024-05-09T00:04:58.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d5b7fe700 1 -- 172.21.15.26:0/3328934187 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d60018070 con 0x7f1d640f7a10 2024-05-09T00:04:58.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.569+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6406bc20 con 0x7f1d640f7a10 2024-05-09T00:04:58.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.570+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6405fb50 con 0x7f1d640f7a10 2024-05-09T00:04:58.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.570+0000 7f1d5b7fe700 1 -- 172.21.15.26:0/3328934187 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f1d6001d420 con 0x7f1d640f7a10 2024-05-09T00:04:58.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.571+0000 7f1d5b7fe700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1d50061180 0x7f1d50063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:58.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.571+0000 7f1d5b7fe700 1 -- 172.21.15.26:0/3328934187 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f1d6007ddd0 con 0x7f1d640f7a10 2024-05-09T00:04:58.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.571+0000 7f1d69a0f700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1d50061180 0x7f1d50063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:58.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.571+0000 7f1d69a0f700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1d50061180 0x7f1d50063640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1d540041d0 tx=0x7f1d54009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:58.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.575+0000 7f1d5b7fe700 1 -- 172.21.15.26:0/3328934187 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1d60051d60 con 0x7f1d640f7a10 2024-05-09T00:04:58.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.816+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f1d6406be40 con 0x7f1d640f7a10 2024-05-09T00:04:58.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.816+0000 7f1d5b7fe700 1 -- 172.21.15.26:0/3328934187 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v11) v1 ==== 78+0+99 (secure 0 0 0) 0x7f1d60051950 con 0x7f1d640f7a10 2024-05-09T00:04:58.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1d50061180 msgr2=0x7f1d50063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:58.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1d50061180 0x7f1d50063640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1d540041d0 tx=0x7f1d54009040).stop 2024-05-09T00:04:58.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 msgr2=0x7f1d6406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:58.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 0x7f1d6406c9d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f1d60013470 tx=0x7f1d60009cb0).stop 2024-05-09T00:04:58.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 shutdown_connections 2024-05-09T00:04:58.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1d50061180 0x7f1d50063640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:58.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d640f7a10 0x7f1d6406c9d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:58.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 --2- 172.21.15.26:0/3328934187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d640f8cb0 0x7f1d6406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:58.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 >> 172.21.15.26:0/3328934187 conn(0x7f1d640f3150 msgr2=0x7f1d640fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:58.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 shutdown_connections 2024-05-09T00:04:58.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:58.818+0000 7f1d6c474700 1 -- 172.21.15.26:0/3328934187 wait complete. 2024-05-09T00:04:58.823 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:04:59.417 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-05-09T00:04:59.429 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:04:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 -- 172.21.15.26:0/2138479250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f66f0 msgr2=0x7fab8c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 --2- 172.21.15.26:0/2138479250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f66f0 0x7fab8c0f6b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fab7c0047f0 tx=0x7fab7c009cb0).stop 2024-05-09T00:04:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 -- 172.21.15.26:0/2138479250 shutdown_connections 2024-05-09T00:04:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 --2- 172.21.15.26:0/2138479250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c0f7990 0x7fab8c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 --2- 172.21.15.26:0/2138479250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f66f0 0x7fab8c0f6b10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 -- 172.21.15.26:0/2138479250 >> 172.21.15.26:0/2138479250 conn(0x7fab8c0f1df0 msgr2=0x7fab8c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 -- 172.21.15.26:0/2138479250 shutdown_connections 2024-05-09T00:04:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 -- 172.21.15.26:0/2138479250 wait complete. 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 Processor -- start 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.631+0000 7fab9204c700 1 -- start start 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab9204c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c0f66f0 0x7fab8c061080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab9204c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f7990 0x7fab8c10cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab9204c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c10d230 con 0x7fab8c0f7990 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab9204c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c10d370 con 0x7fab8c0f66f0 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f7990 0x7fab8c10cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab8affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f7990 0x7fab8c10cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37106/0 (socket says 172.21.15.26:37106) 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab8affd700 1 -- 172.21.15.26:0/889929595 learned_addr learned my addr 172.21.15.26:0/889929595 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab8b7fe700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c0f66f0 0x7fab8c061080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab8affd700 1 -- 172.21.15.26:0/889929595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c0f66f0 msgr2=0x7fab8c061080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab8affd700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c0f66f0 0x7fab8c061080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab8affd700 1 -- 172.21.15.26:0/889929595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c005040 con 0x7fab8c0f7990 2024-05-09T00:04:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab8affd700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f7990 0x7fab8c10cd40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fab80002820 tx=0x7fab80009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab88ff9700 1 -- 172.21.15.26:0/889929595 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab80007b40 con 0x7fab8c0f7990 2024-05-09T00:04:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab88ff9700 1 -- 172.21.15.26:0/889929595 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fab8000f040 con 0x7fab8c0f7990 2024-05-09T00:04:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c10d5d0 con 0x7fab8c0f7990 2024-05-09T00:04:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab88ff9700 1 -- 172.21.15.26:0/889929595 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8000d740 con 0x7fab8c0f7990 2024-05-09T00:04:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.632+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c10db10 con 0x7fab8c0f7990 2024-05-09T00:04:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.633+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c0feeb0 con 0x7fab8c0f7990 2024-05-09T00:04:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.634+0000 7fab88ff9700 1 -- 172.21.15.26:0/889929595 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fab80009110 con 0x7fab8c0f7990 2024-05-09T00:04:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.634+0000 7fab88ff9700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fab74061180 0x7fab74063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.634+0000 7fab88ff9700 1 -- 172.21.15.26:0/889929595 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fab8007c1c0 con 0x7fab8c0f7990 2024-05-09T00:04:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.634+0000 7fab8b7fe700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fab74061180 0x7fab74063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.635+0000 7fab8b7fe700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fab74061180 0x7fab74063640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fab7c013470 tx=0x7fab7c009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:59.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.638+0000 7fab88ff9700 1 -- 172.21.15.26:0/889929595 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fab80050150 con 0x7fab8c0f7990 2024-05-09T00:04:59.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.812+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab8c059990 con 0x7fab8c0f7990 2024-05-09T00:04:59.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.813+0000 7fab88ff9700 1 -- 172.21.15.26:0/889929595 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14113 (secure 0 0 0) 0x7fab80055e60 con 0x7fab8c0f7990 2024-05-09T00:04:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:04:59.808 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":43,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:57:45.460652+0000","modified":"2024-05-09T00:04:33.161088+0000","last_up_change":"2024-05-09T00:03:08.626623+0000","last_in_change":"2024-05-09T00:02:49.885020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-05-09T00:01:47.922598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-05-09T00:04:30.085512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-05-09T00:04:30.572779+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9e406a7e-5ec2-4f17-9308-640a499d3012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6803","nonce":4066121531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6805","nonce":4066121531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6809","nonce":4066121531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":4066121531},{"type":"v1","addr":"172.21.15.26:6807","nonce":4066121531}]},"public_addr":"172.21.15.26:6803/4066121531","cluster_addr":"172.21.15.26:6805/4066121531","heartbeat_back_addr":"172.21.15.26:6809/4066121531","heartbeat_front_addr":"172.21.15.26:6807/4066121531","state":["exists","up"]},{"osd":1,"uuid":"6f0691b3-17ca-4f90-88ce-13f4e115a987","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6811","nonce":100863172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6813","nonce":100863172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6817","nonce":100863172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":100863172},{"type":"v1","addr":"172.21.15.26:6815","nonce":100863172}]},"public_addr":"172.21.15.26:6811/100863172","cluster_addr":"172.21.15.26:6813/100863172","heartbeat_back_addr":"172.21.15.26:6817/100863172","heartbeat_front_addr":"172.21.15.26:6815/100863172","state":["exists","up"]},{"osd":2,"uuid":"3eaa1376-f58f-4e84-970a-f7805331d339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6819","nonce":1690203303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6821","nonce":1690203303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6825","nonce":1690203303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1690203303},{"type":"v1","addr":"172.21.15.26:6823","nonce":1690203303}]},"public_addr":"172.21.15.26:6819/1690203303","cluster_addr":"172.21.15.26:6821/1690203303","heartbeat_back_addr":"172.21.15.26:6825/1690203303","heartbeat_front_addr":"172.21.15.26:6823/1690203303","state":["exists","up"]},{"osd":3,"uuid":"9018149e-e25f-4d5c-8749-0feaffaa31e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6801","nonce":2253178087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6803","nonce":2253178087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6807","nonce":2253178087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2253178087},{"type":"v1","addr":"172.21.15.135:6805","nonce":2253178087}]},"public_addr":"172.21.15.135:6801/2253178087","cluster_addr":"172.21.15.135:6803/2253178087","heartbeat_back_addr":"172.21.15.135:6807/2253178087","heartbeat_front_addr":"172.21.15.135:6805/2253178087","state":["exists","up"]},{"osd":4,"uuid":"90bd084e-4ae6-4fa0-9a79-221a26a1183c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6809","nonce":3525260045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6811","nonce":3525260045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6815","nonce":3525260045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3525260045},{"type":"v1","addr":"172.21.15.135:6813","nonce":3525260045}]},"public_addr":"172.21.15.135:6809/3525260045","cluster_addr":"172.21.15.135:6811/3525260045","heartbeat_back_addr":"172.21.15.135:6815/3525260045","heartbeat_front_addr":"172.21.15.135:6813/3525260045","state":["exists","up"]},{"osd":5,"uuid":"b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6817","nonce":3212995324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6819","nonce":3212995324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6823","nonce":3212995324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3212995324},{"type":"v1","addr":"172.21.15.135:6821","nonce":3212995324}]},"public_addr":"172.21.15.135:6817/3212995324","cluster_addr":"172.21.15.135:6819/3212995324","heartbeat_back_addr":"172.21.15.135:6823/3212995324","heartbeat_front_addr":"172.21.15.135:6821/3212995324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:41.148461+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:16.974271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:45.884445+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:11.410167+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:40.468724+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:03:06.902797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/965450412":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:0/925863937":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.26:0/4163858233":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/1959910794":"2024-05-09T23:58:50.299227+0000","172.21.15.26:0/3104174095":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:6801/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/2204010739":"2024-05-09T23:58:18.405305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:04:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fab74061180 msgr2=0x7fab74063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fab74061180 0x7fab74063640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fab7c013470 tx=0x7fab7c009cb0).stop 2024-05-09T00:04:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f7990 msgr2=0x7fab8c10cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f7990 0x7fab8c10cd40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fab80002820 tx=0x7fab80009f60).stop 2024-05-09T00:04:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 shutdown_connections 2024-05-09T00:04:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fab74061180 0x7fab74063640 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c0f66f0 0x7fab8c061080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 --2- 172.21.15.26:0/889929595 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab8c0f7990 0x7fab8c10cd40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 >> 172.21.15.26:0/889929595 conn(0x7fab8c0f1df0 msgr2=0x7fab8c0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:59.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 shutdown_connections 2024-05-09T00:04:59.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.815+0000 7fab9204c700 1 -- 172.21.15.26:0/889929595 wait complete. 2024-05-09T00:04:59.821 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:04:58.562100+0000 mgr.smithi026.brymfp (mgr.14194) 216 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:04:59.821 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:58.665780+0000 mon.smithi026 (mon.0) 578 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:59.821 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:58.666549+0000 mon.smithi026 (mon.0) 579 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:59.821 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:58.667203+0000 mon.smithi026 (mon.0) 580 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:59.821 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:58.670891+0000 mon.smithi026 (mon.0) 581 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:59.821 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:58.817746+0000 mon.smithi026 (mon.0) 582 : audit [DBG] from='client.? 172.21.15.26:0/3328934187' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-09T00:04:59.821 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:04:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:59.650053+0000 mon.smithi026 (mon.0) 583 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:04:59.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-05-09T00:01:47.922598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-05-09T00:04:30.085512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-05-09T00:04:30.572779+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-09T00:04:59.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-05-09T00:04:59.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.950+0000 7f181e887700 1 -- 172.21.15.26:0/3020746970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 msgr2=0x7f18180f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.950+0000 7f181e887700 1 --2- 172.21.15.26:0/3020746970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 0x7f18180f6af0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f18080047f0 tx=0x7f1808009cb0).stop 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.950+0000 7f181e887700 1 -- 172.21.15.26:0/3020746970 shutdown_connections 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.950+0000 7f181e887700 1 --2- 172.21.15.26:0/3020746970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18180f7970 0x7f18180f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.950+0000 7f181e887700 1 --2- 172.21.15.26:0/3020746970 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 0x7f18180f6af0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.950+0000 7f181e887700 1 -- 172.21.15.26:0/3020746970 >> 172.21.15.26:0/3020746970 conn(0x7f18180f1df0 msgr2=0x7f18180f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.950+0000 7f181e887700 1 -- 172.21.15.26:0/3020746970 shutdown_connections 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.950+0000 7f181e887700 1 -- 172.21.15.26:0/3020746970 wait complete. 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f181e887700 1 Processor -- start 2024-05-09T00:04:59.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f181e887700 1 -- start start 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f181e887700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 0x7f181810a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f181e887700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18180f7970 0x7f181810a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f181e887700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181810abe0 con 0x7f18180f66d0 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f181e887700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181810ad20 con 0x7f18180f7970 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f1817fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 0x7f181810a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f1817fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 0x7f181810a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37116/0 (socket says 172.21.15.26:37116) 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f1817fff700 1 -- 172.21.15.26:0/482887099 learned_addr learned my addr 172.21.15.26:0/482887099 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.951+0000 7f18177fe700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18180f7970 0x7f181810a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f1817fff700 1 -- 172.21.15.26:0/482887099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18180f7970 msgr2=0x7f181810a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f1817fff700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18180f7970 0x7f181810a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f1817fff700 1 -- 172.21.15.26:0/482887099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808005040 con 0x7f18180f66d0 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f1817fff700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 0x7f181810a140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f1808004f10 tx=0x7f1808009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:59.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f18157fa700 1 -- 172.21.15.26:0/482887099 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f180800e070 con 0x7f18180f66d0 2024-05-09T00:04:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f18157fa700 1 -- 172.21.15.26:0/482887099 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1808007e90 con 0x7f18180f66d0 2024-05-09T00:04:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181810f760 con 0x7f18180f66d0 2024-05-09T00:04:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f18157fa700 1 -- 172.21.15.26:0/482887099 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1808018070 con 0x7f18180f66d0 2024-05-09T00:04:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.952+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181810fca0 con 0x7f18180f66d0 2024-05-09T00:04:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.953+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18180fee90 con 0x7f18180f66d0 2024-05-09T00:04:59.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.953+0000 7f18157fa700 1 -- 172.21.15.26:0/482887099 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f18080123c0 con 0x7f18180f66d0 2024-05-09T00:04:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.954+0000 7f18157fa700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1800061110 0x7f18000635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:04:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.954+0000 7f18157fa700 1 -- 172.21.15.26:0/482887099 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f180807d670 con 0x7f18180f66d0 2024-05-09T00:04:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.954+0000 7f18177fe700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1800061110 0x7f18000635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:04:59.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.954+0000 7f18177fe700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1800061110 0x7f18000635d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f180c004dc0 tx=0x7f180c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:59.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:04:59.958+0000 7f18157fa700 1 -- 172.21.15.26:0/482887099 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1808051600 con 0x7f18180f66d0 2024-05-09T00:05:00.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.131+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1818110330 con 0x7f18180f66d0 2024-05-09T00:05:00.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.131+0000 7f18157fa700 1 -- 172.21.15.26:0/482887099 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v43) v1 ==== 110+0+10 (secure 0 0 0) 0x7f18080511f0 con 0x7f18180f66d0 2024-05-09T00:05:00.126 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-05-09T00:05:00.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1800061110 msgr2=0x7f18000635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1800061110 0x7f18000635d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f180c004dc0 tx=0x7f180c00b040).stop 2024-05-09T00:05:00.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 msgr2=0x7f181810a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 0x7f181810a140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f1808004f10 tx=0x7f1808009cb0).stop 2024-05-09T00:05:00.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 shutdown_connections 2024-05-09T00:05:00.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1800061110 0x7f18000635d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18180f66d0 0x7f181810a140 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 --2- 172.21.15.26:0/482887099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18180f7970 0x7f181810a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 >> 172.21.15.26:0/482887099 conn(0x7f18180f1df0 msgr2=0x7f1818060d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:00.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 shutdown_connections 2024-05-09T00:05:00.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.133+0000 7f181e887700 1 -- 172.21.15.26:0/482887099 wait complete. 2024-05-09T00:05:00.139 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-05-09T00:05:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:04:58.562100+0000 mgr.smithi026.brymfp (mgr.14194) 216 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:58.665780+0000 mon.smithi026 (mon.0) 578 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:58.666549+0000 mon.smithi026 (mon.0) 579 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:05:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:58.667203+0000 mon.smithi026 (mon.0) 580 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:05:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:58.670891+0000 mon.smithi026 (mon.0) 581 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:58.817746+0000 mon.smithi026 (mon.0) 582 : audit [DBG] from='client.? 172.21.15.26:0/3328934187' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-09T00:05:00.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:04:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:59.650053+0000 mon.smithi026 (mon.0) 583 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.267+0000 7f74d122d700 1 -- 172.21.15.26:0/4234460119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f7970 msgr2=0x7f74cc0f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.267+0000 7f74d122d700 1 --2- 172.21.15.26:0/4234460119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f7970 0x7f74cc0f7dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f74bc0047f0 tx=0x7f74bc009cb0).stop 2024-05-09T00:05:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.267+0000 7f74d122d700 1 -- 172.21.15.26:0/4234460119 shutdown_connections 2024-05-09T00:05:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.267+0000 7f74d122d700 1 --2- 172.21.15.26:0/4234460119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f7970 0x7f74cc0f7dd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.267+0000 7f74d122d700 1 --2- 172.21.15.26:0/4234460119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74cc0f66d0 0x7f74cc0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.267+0000 7f74d122d700 1 -- 172.21.15.26:0/4234460119 >> 172.21.15.26:0/4234460119 conn(0x7f74cc0f1df0 msgr2=0x7f74cc0f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.267+0000 7f74d122d700 1 -- 172.21.15.26:0/4234460119 shutdown_connections 2024-05-09T00:05:00.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.267+0000 7f74d122d700 1 -- 172.21.15.26:0/4234460119 wait complete. 2024-05-09T00:05:00.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.268+0000 7f74d122d700 1 Processor -- start 2024-05-09T00:05:00.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.268+0000 7f74d122d700 1 -- start start 2024-05-09T00:05:00.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.268+0000 7f74d122d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f66d0 0x7f74cc061080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.268+0000 7f74d122d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74cc0f7970 0x7f74cc10cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.268+0000 7f74d122d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc10d1f0 con 0x7f74cc0f66d0 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.268+0000 7f74d122d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc10d330 con 0x7f74cc0f7970 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74cad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f66d0 0x7f74cc061080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74cad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f66d0 0x7f74cc061080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37134/0 (socket says 172.21.15.26:37134) 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74cad9d700 1 -- 172.21.15.26:0/1109373844 learned_addr learned my addr 172.21.15.26:0/1109373844 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74ca59c700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74cc0f7970 0x7f74cc10cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74cad9d700 1 -- 172.21.15.26:0/1109373844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74cc0f7970 msgr2=0x7f74cc10cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74cad9d700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74cc0f7970 0x7f74cc10cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74cad9d700 1 -- 172.21.15.26:0/1109373844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc005040 con 0x7f74cc0f66d0 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74cad9d700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f66d0 0x7f74cc061080 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f74b4002850 tx=0x7f74b4009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74c3fff700 1 -- 172.21.15.26:0/1109373844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b4002d90 con 0x7f74cc0f66d0 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc10d590 con 0x7f74cc0f66d0 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74c3fff700 1 -- 172.21.15.26:0/1109373844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f74b400f040 con 0x7f74cc0f66d0 2024-05-09T00:05:00.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74c3fff700 1 -- 172.21.15.26:0/1109373844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b400d820 con 0x7f74cc0f66d0 2024-05-09T00:05:00.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.269+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc10dad0 con 0x7f74cc0f66d0 2024-05-09T00:05:00.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.270+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc0fee90 con 0x7f74cc0f66d0 2024-05-09T00:05:00.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.270+0000 7f74c3fff700 1 -- 172.21.15.26:0/1109373844 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f74b4009380 con 0x7f74cc0f66d0 2024-05-09T00:05:00.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.271+0000 7f74c3fff700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f74b8061180 0x7f74b8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.271+0000 7f74c3fff700 1 -- 172.21.15.26:0/1109373844 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f74b407c4b0 con 0x7f74cc0f66d0 2024-05-09T00:05:00.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.271+0000 7f74ca59c700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f74b8061180 0x7f74b8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.271+0000 7f74ca59c700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f74b8061180 0x7f74b8063640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f74bc013470 tx=0x7f74bc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:00.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.275+0000 7f74c3fff700 1 -- 172.21.15.26:0/1109373844 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f74b40504f0 con 0x7f74cc0f66d0 2024-05-09T00:05:00.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.444+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f74cc100d00 con 0x7f74cc0f66d0 2024-05-09T00:05:00.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.444+0000 7f74c3fff700 1 -- 172.21.15.26:0/1109373844 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f74b4009110 con 0x7f74cc0f66d0 2024-05-09T00:05:00.439 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f74b8061180 msgr2=0x7f74b8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f74b8061180 0x7f74b8063640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f74bc013470 tx=0x7f74bc00b040).stop 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f66d0 msgr2=0x7f74cc061080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f66d0 0x7f74cc061080 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f74b4002850 tx=0x7f74b4009f00).stop 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 shutdown_connections 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f74b8061180 0x7f74b8063640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74cc0f66d0 0x7f74cc061080 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 --2- 172.21.15.26:0/1109373844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74cc0f7970 0x7f74cc10cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 >> 172.21.15.26:0/1109373844 conn(0x7f74cc0f1df0 msgr2=0x7f74cc0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:00.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 shutdown_connections 2024-05-09T00:05:00.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.446+0000 7f74d122d700 1 -- 172.21.15.26:0/1109373844 wait complete. 2024-05-09T00:05:00.453 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-05-09T00:05:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.581+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/2789519593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f7970 msgr2=0x7f5b280f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.581+0000 7f5b2dd6f700 1 --2- 172.21.15.26:0/2789519593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f7970 0x7f5b280f7dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5b1c0047f0 tx=0x7f5b1c009cb0).stop 2024-05-09T00:05:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.581+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/2789519593 shutdown_connections 2024-05-09T00:05:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.581+0000 7f5b2dd6f700 1 --2- 172.21.15.26:0/2789519593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f7970 0x7f5b280f7dd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.581+0000 7f5b2dd6f700 1 --2- 172.21.15.26:0/2789519593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b280f66d0 0x7f5b280f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.581+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/2789519593 >> 172.21.15.26:0/2789519593 conn(0x7f5b280f1df0 msgr2=0x7f5b280f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:00.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.581+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/2789519593 shutdown_connections 2024-05-09T00:05:00.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.581+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/2789519593 wait complete. 2024-05-09T00:05:00.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b2dd6f700 1 Processor -- start 2024-05-09T00:05:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b2dd6f700 1 -- start start 2024-05-09T00:05:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b2dd6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f66d0 0x7f5b28108030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b2dd6f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b280f7970 0x7f5b28108520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b2dd6f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b28108ad0 con 0x7f5b280f66d0 2024-05-09T00:05:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b2dd6f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b28108c10 con 0x7f5b280f7970 2024-05-09T00:05:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f66d0 0x7f5b28108030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f66d0 0x7f5b28108030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37160/0 (socket says 172.21.15.26:37160) 2024-05-09T00:05:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.582+0000 7f5b277fe700 1 -- 172.21.15.26:0/3326206718 learned_addr learned my addr 172.21.15.26:0/3326206718 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b26ffd700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b280f7970 0x7f5b28108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b277fe700 1 -- 172.21.15.26:0/3326206718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b280f7970 msgr2=0x7f5b28108520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b277fe700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b280f7970 0x7f5b28108520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b277fe700 1 -- 172.21.15.26:0/3326206718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c005040 con 0x7f5b280f66d0 2024-05-09T00:05:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b26ffd700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b280f7970 0x7f5b28108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b277fe700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f66d0 0x7f5b28108030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f5b1800e8c0 tx=0x7f5b1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:00.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b24ff9700 1 -- 172.21.15.26:0/3326206718 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1800ee60 con 0x7f5b280f66d0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b24ff9700 1 -- 172.21.15.26:0/3326206718 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5b1800f040 con 0x7f5b280f66d0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2810d6b0 con 0x7f5b280f66d0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b24ff9700 1 -- 172.21.15.26:0/3326206718 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1800c810 con 0x7f5b280f66d0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.583+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2810dc70 con 0x7f5b280f66d0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.584+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b280fee90 con 0x7f5b280f66d0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.584+0000 7f5b24ff9700 1 -- 172.21.15.26:0/3326206718 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f5b18007b40 con 0x7f5b280f66d0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.585+0000 7f5b24ff9700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5b10061180 0x7f5b10063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.585+0000 7f5b24ff9700 1 -- 172.21.15.26:0/3326206718 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f5b1807c4f0 con 0x7f5b280f66d0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.585+0000 7f5b26ffd700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5b10061180 0x7f5b10063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.585+0000 7f5b26ffd700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5b10061180 0x7f5b10063640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5b1c009ee0 tx=0x7f5b1c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:00.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.589+0000 7f5b24ff9700 1 -- 172.21.15.26:0/3326206718 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5b18050500 con 0x7f5b280f66d0 2024-05-09T00:05:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.760+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f5b2810e360 con 0x7f5b280f66d0 2024-05-09T00:05:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.761+0000 7f5b24ff9700 1 -- 172.21.15.26:0/3326206718 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f5b180190b0 con 0x7f5b280f66d0 2024-05-09T00:05:00.755 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-05-09T00:05:00.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.762+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5b10061180 msgr2=0x7f5b10063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.762+0000 7f5b2dd6f700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5b10061180 0x7f5b10063640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5b1c009ee0 tx=0x7f5b1c00b040).stop 2024-05-09T00:05:00.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.762+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f66d0 msgr2=0x7f5b28108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.762+0000 7f5b2dd6f700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f66d0 0x7f5b28108030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f5b1800e8c0 tx=0x7f5b1800b040).stop 2024-05-09T00:05:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.762+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 shutdown_connections 2024-05-09T00:05:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.762+0000 7f5b2dd6f700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5b10061180 0x7f5b10063640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.762+0000 7f5b2dd6f700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b280f66d0 0x7f5b28108030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.762+0000 7f5b2dd6f700 1 --2- 172.21.15.26:0/3326206718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b280f7970 0x7f5b28108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.763+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 >> 172.21.15.26:0/3326206718 conn(0x7f5b280f1df0 msgr2=0x7f5b280605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.763+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 shutdown_connections 2024-05-09T00:05:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.763+0000 7f5b2dd6f700 1 -- 172.21.15.26:0/3326206718 wait complete. 2024-05-09T00:05:00.768 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:04:59.814528+0000 mon.smithi026 (mon.0) 584 : audit [DBG] from='client.? 172.21.15.26:0/889929595' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:05:00.768 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:00.132743+0000 mon.smithi026 (mon.0) 585 : audit [DBG] from='client.? 172.21.15.26:0/482887099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-05-09T00:05:00.768 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:00.445920+0000 mon.smithi026 (mon.0) 586 : audit [DBG] from='client.? 172.21.15.26:0/1109373844' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-09T00:05:00.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:05:00.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.895+0000 7f0080187700 1 -- 172.21.15.26:0/786513504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 msgr2=0x7f00780f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.895+0000 7f0080187700 1 --2- 172.21.15.26:0/786513504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 0x7f00780f6b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f00740047f0 tx=0x7f0074009cb0).stop 2024-05-09T00:05:00.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.895+0000 7f0080187700 1 -- 172.21.15.26:0/786513504 shutdown_connections 2024-05-09T00:05:00.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.895+0000 7f0080187700 1 --2- 172.21.15.26:0/786513504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780f7990 0x7f00780f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.895+0000 7f0080187700 1 --2- 172.21.15.26:0/786513504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 0x7f00780f6b10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.895+0000 7f0080187700 1 -- 172.21.15.26:0/786513504 >> 172.21.15.26:0/786513504 conn(0x7f00780f1df0 msgr2=0x7f00780f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:00.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.895+0000 7f0080187700 1 -- 172.21.15.26:0/786513504 shutdown_connections 2024-05-09T00:05:00.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.895+0000 7f0080187700 1 -- 172.21.15.26:0/786513504 wait complete. 2024-05-09T00:05:00.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.896+0000 7f0080187700 1 Processor -- start 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.896+0000 7f0080187700 1 -- start start 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f0080187700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 0x7f0078106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f0080187700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780f7990 0x7f0078107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f0080187700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00781078f0 con 0x7f00780f66f0 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f0080187700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0078107a30 con 0x7f00780f7990 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f007df23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 0x7f0078106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f007df23700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 0x7f0078106e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37178/0 (socket says 172.21.15.26:37178) 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f007df23700 1 -- 172.21.15.26:0/3817786485 learned_addr learned my addr 172.21.15.26:0/3817786485 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f007d722700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780f7990 0x7f0078107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f007df23700 1 -- 172.21.15.26:0/3817786485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780f7990 msgr2=0x7f0078107340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f007df23700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780f7990 0x7f0078107340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f007df23700 1 -- 172.21.15.26:0/3817786485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074005040 con 0x7f00780f66f0 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f007df23700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 0x7f0078106e50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0074004f10 tx=0x7f0074009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f006effd700 1 -- 172.21.15.26:0/3817786485 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f007400e070 con 0x7f00780f66f0 2024-05-09T00:05:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f006effd700 1 -- 172.21.15.26:0/3817786485 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0074007e90 con 0x7f00780f66f0 2024-05-09T00:05:00.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007810c470 con 0x7f00780f66f0 2024-05-09T00:05:00.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f006effd700 1 -- 172.21.15.26:0/3817786485 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0074018070 con 0x7f00780f66f0 2024-05-09T00:05:00.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.897+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007810c9b0 con 0x7f00780f66f0 2024-05-09T00:05:00.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.898+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00780feeb0 con 0x7f00780f66f0 2024-05-09T00:05:00.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.899+0000 7f006effd700 1 -- 172.21.15.26:0/3817786485 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f00740123c0 con 0x7f00780f66f0 2024-05-09T00:05:00.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.899+0000 7f006effd700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0064061180 0x7f0064063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:00.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.899+0000 7f006effd700 1 -- 172.21.15.26:0/3817786485 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f007407d640 con 0x7f00780f66f0 2024-05-09T00:05:00.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.899+0000 7f007d722700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0064061180 0x7f0064063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:00.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.900+0000 7f007d722700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0064061180 0x7f0064063640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0068004dc0 tx=0x7f006800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:00.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:00.904+0000 7f006effd700 1 -- 172.21.15.26:0/3817786485 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0074051590 con 0x7f00780f66f0 2024-05-09T00:05:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.121+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00780598f0 con 0x7f00780f66f0 2024-05-09T00:05:01.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.121+0000 7f006effd700 1 -- 172.21.15.26:0/3817786485 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+4582 (secure 0 0 0) 0x7f0074051180 con 0x7f00780f66f0 2024-05-09T00:05:01.116 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:05:01.116 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/3575480423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3575480423},{"type":"v1","addr":"172.21.15.26:6829","nonce":3575480423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:04:47.763524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14434":{"gid":14434,"name":"cephfs.smithi026.nhrcgk","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.26:6827/3998166556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3998166556},{"type":"v1","addr":"172.21.15.26:6827","nonce":3998166556}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-05-09T00:05:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0064061180 msgr2=0x7f0064063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0064061180 0x7f0064063640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0068004dc0 tx=0x7f006800b040).stop 2024-05-09T00:05:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 msgr2=0x7f0078106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 0x7f0078106e50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0074004f10 tx=0x7f0074009cb0).stop 2024-05-09T00:05:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 shutdown_connections 2024-05-09T00:05:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f0064061180 0x7f0064063640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00780f66f0 0x7f0078106e50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 --2- 172.21.15.26:0/3817786485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00780f7990 0x7f0078107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.123+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 >> 172.21.15.26:0/3817786485 conn(0x7f00780f1df0 msgr2=0x7f00780fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.124+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 shutdown_connections 2024-05-09T00:05:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:01.124+0000 7f0080187700 1 -- 172.21.15.26:0/3817786485 wait complete. 2024-05-09T00:05:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:05:01.130 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 1, 'flags': 18} 2024-05-09T00:05:01.130 INFO:teuthology.run_tasks:Running task kclient... 2024-05-09T00:05:01.158 INFO:tasks.kclient:Mounting kernel clients... 2024-05-09T00:05:01.158 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-05-09T00:05:01.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:01.159 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-05-09T00:05:01.159 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:04:59.814528+0000 mon.smithi026 (mon.0) 584 : audit [DBG] from='client.? 172.21.15.26:0/889929595' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:05:01.159 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:00.132743+0000 mon.smithi026 (mon.0) 585 : audit [DBG] from='client.? 172.21.15.26:0/482887099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-05-09T00:05:01.160 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:00.445920+0000 mon.smithi026 (mon.0) 586 : audit [DBG] from='client.? 172.21.15.26:0/1109373844' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-09T00:05:01.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:01.179 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-05-09T00:05:01.248 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2024-05-09T00:05:01.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:05:01.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:01.249 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-09T00:05:01.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:01.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-09T00:05:01.352 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-05-09T00:05:01.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:05:01.354 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-09T00:05:01.354 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T00:05:01.354 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T00:05:01.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T00:05:01.630 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:05:02.073 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:00.562511+0000 mgr.smithi026.brymfp (mgr.14194) 217 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:02.074 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:00.762291+0000 mon.smithi026 (mon.0) 587 : audit [DBG] from='client.? 172.21.15.26:0/3326206718' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-09T00:05:02.074 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:01.123051+0000 mon.smithi026 (mon.0) 588 : audit [DBG] from='client.? 172.21.15.26:0/3817786485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:05:02.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:00.562511+0000 mgr.smithi026.brymfp (mgr.14194) 217 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:02.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:00.762291+0000 mon.smithi026 (mon.0) 587 : audit [DBG] from='client.? 172.21.15.26:0/3326206718' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-09T00:05:02.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:01.123051+0000 mon.smithi026 (mon.0) 588 : audit [DBG] from='client.? 172.21.15.26:0/3817786485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:05:03.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.329+0000 7f7eda7b3700 1 -- 172.21.15.26:0/677901468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f79a0 msgr2=0x7f7ed40f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:03.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.329+0000 7f7eda7b3700 1 --2- 172.21.15.26:0/677901468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f79a0 0x7f7ed40f7dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7ec40047f0 tx=0x7f7ec4009cb0).stop 2024-05-09T00:05:03.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.329+0000 7f7eda7b3700 1 -- 172.21.15.26:0/677901468 shutdown_connections 2024-05-09T00:05:03.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.329+0000 7f7eda7b3700 1 --2- 172.21.15.26:0/677901468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed40f8c40 0x7f7ed40f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:05:03.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.329+0000 7f7eda7b3700 1 --2- 172.21.15.26:0/677901468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f79a0 0x7f7ed40f7dc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:03.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.329+0000 7f7eda7b3700 1 -- 172.21.15.26:0/677901468 >> 172.21.15.26:0/677901468 conn(0x7f7ed40f3100 msgr2=0x7f7ed40f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:03.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.329+0000 7f7eda7b3700 1 -- 172.21.15.26:0/677901468 shutdown_connections 2024-05-09T00:05:03.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.329+0000 7f7eda7b3700 1 -- 172.21.15.26:0/677901468 wait complete. 2024-05-09T00:05:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.330+0000 7f7eda7b3700 1 Processor -- start 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.330+0000 7f7eda7b3700 1 -- start start 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.330+0000 7f7eda7b3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed40f79a0 0x7f7ed4108110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.330+0000 7f7eda7b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f8c40 0x7f7ed4108600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.330+0000 7f7eda7b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed4108c40 con 0x7f7ed40f8c40 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.330+0000 7f7eda7b3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed4108d80 con 0x7f7ed40f79a0 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.330+0000 7f7ed37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f8c40 0x7f7ed4108600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.330+0000 7f7ed37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f8c40 0x7f7ed4108600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56696/0 (socket says 172.21.15.26:56696) 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed37fe700 1 -- 172.21.15.26:0/1740634669 learned_addr learned my addr 172.21.15.26:0/1740634669 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed3fff700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed40f79a0 0x7f7ed4108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed37fe700 1 -- 172.21.15.26:0/1740634669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed40f79a0 msgr2=0x7f7ed4108110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed37fe700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed40f79a0 0x7f7ed4108110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed37fe700 1 -- 172.21.15.26:0/1740634669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4005040 con 0x7f7ed40f8c40 2024-05-09T00:05:03.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed37fe700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f8c40 0x7f7ed4108600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f7ec800b4b0 tx=0x7f7ec80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed17fa700 1 -- 172.21.15.26:0/1740634669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec8002500 con 0x7f7ed40f8c40 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed410d820 con 0x7f7ed40f8c40 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed17fa700 1 -- 172.21.15.26:0/1740634669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7ec8002af0 con 0x7f7ed40f8c40 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7ed17fa700 1 -- 172.21.15.26:0/1740634669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec8012bc0 con 0x7f7ed40f8c40 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.331+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed410dd60 con 0x7f7ed40f8c40 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.332+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed4100170 con 0x7f7ed40f8c40 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.333+0000 7f7ed17fa700 1 -- 172.21.15.26:0/1740634669 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f7ec8002660 con 0x7f7ed40f8c40 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.333+0000 7f7ed17fa700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7ebc061180 0x7f7ebc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.333+0000 7f7ed17fa700 1 -- 172.21.15.26:0/1740634669 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f7ec807c8a0 con 0x7f7ed40f8c40 2024-05-09T00:05:03.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.333+0000 7f7ed3fff700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7ebc061180 0x7f7ebc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.334+0000 7f7ed3fff700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7ebc061180 0x7f7ebc063640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7ec4004f10 tx=0x7f7ec400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:03.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.338+0000 7f7ed17fa700 1 -- 172.21.15.26:0/1740634669 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7ec8050830 con 0x7f7ed40f8c40 2024-05-09T00:05:03.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.551+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ed4101fe0 con 0x7f7ed40f8c40 2024-05-09T00:05:03.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.551+0000 7f7ed17fa700 1 -- 172.21.15.26:0/1740634669 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) v1 ==== 53+0+83 (secure 0 0 0) 0x7f7ec8050420 con 0x7f7ed40f8c40 2024-05-09T00:05:03.547 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7ebc061180 msgr2=0x7f7ebc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7ebc061180 0x7f7ebc063640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7ec4004f10 tx=0x7f7ec400b040).stop 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f8c40 msgr2=0x7f7ed4108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f8c40 0x7f7ed4108600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f7ec800b4b0 tx=0x7f7ec80090f0).stop 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 shutdown_connections 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7ebc061180 0x7f7ebc063640 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed40f79a0 0x7f7ed4108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 --2- 172.21.15.26:0/1740634669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ed40f8c40 0x7f7ed4108600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 >> 172.21.15.26:0/1740634669 conn(0x7f7ed40f3100 msgr2=0x7f7ed40fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 shutdown_connections 2024-05-09T00:05:03.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:03.553+0000 7f7eda7b3700 1 -- 172.21.15.26:0/1740634669 wait complete. 2024-05-09T00:05:03.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:02.562857+0000 mgr.smithi026.brymfp (mgr.14194) 218 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:03.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:03.552776+0000 mon.smithi026 (mon.0) 589 : audit [DBG] from='client.? 172.21.15.26:0/1740634669' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T00:05:04.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:02.562857+0000 mgr.smithi026.brymfp (mgr.14194) 218 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:04.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:03.552776+0000 mon.smithi026 (mon.0) 589 : audit [DBG] from='client.? 172.21.15.26:0/1740634669' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T00:05:04.305 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T00:05:04.305 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T00:05:04.306 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-05-09T00:05:04.306 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T00:05:04.306 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T00:05:04.306 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T00:05:04.306 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T00:05:04.306 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T00:05:04.306 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T00:05:04.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:04.307 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-05-09T00:05:04.329 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T00:05:04.330 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T00:05:04.330 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T00:05:04.330 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:05:04.330 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-05-09T00:05:04.330 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:05:04.330 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:05:04.330 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-05-09T00:05:04.330 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 41622sec preferred_lft 41622sec 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:05:04.331 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:05:04.332 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-05-09T00:05:04.332 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T00:05:04.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:04.332 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-05-09T00:05:04.333 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-05-09T00:05:04.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2024-05-09T00:05:04.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2024-05-09T00:05:04.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2024-05-09T00:05:04.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T00:05:04.333 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-05-09T00:05:04.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:04.516 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T00:05:04.546 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-05-09T00:05:04.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:04.548 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-05-09T00:05:04.624 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-05-09T00:05:04.624 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T00:05:04.625 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-09T00:05:04.625 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-09T00:05:04.625 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T00:05:04.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:04.625 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-05-09T00:05:04.625 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-05-09T00:05:04.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-09T00:05:04.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-09T00:05:04.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-09T00:05:04.626 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-05-09T00:05:04.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:04.897 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-05-09T00:05:04.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:04.916 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2024-05-09T00:05:04.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:04.975 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-05-09T00:05:04.975 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-05-09T00:05:04.975 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T00:05:04.975 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T00:05:04.975 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-05-09T00:05:05.073 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T00:05:05.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:05.073 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-05-09T00:05:05.073 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-05-09T00:05:05.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T00:05:05.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T00:05:05.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T00:05:05.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T00:05:05.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T00:05:05.073 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-05-09T00:05:05.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:05.276 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-05-09T00:05:05.276 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-05-09T00:05:05.276 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2024-05-09T00:05:05.276 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T00:05:05.277 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-05-09T00:05:05.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:05:05.375 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T00:05:05.394 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T00:05:05.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:05:05.394 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T00:05:05.452 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T00:05:05.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:05.452 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T00:05:05.544 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T00:05:05.545 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs" will pass to kernel. 2024-05-09T00:05:05.628 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T00:05:05.628 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs" will pass to kernel. 2024-05-09T00:05:05.631 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T00:05:05.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:05.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T00:05:05.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:05.660 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:05:05.747 INFO:teuthology.orchestra.run.smithi026.stdout:client14496 2024-05-09T00:05:05.747 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-09T00:05:05.747 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:05:05.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:05.767 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:05:05.852 INFO:teuthology.orchestra.run.smithi026.stdout:client14496 2024-05-09T00:05:05.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:05.852 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:05:05.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:04.563269+0000 mgr.smithi026.brymfp (mgr.14194) 219 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:05.897 INFO:teuthology.orchestra.run.smithi026.stdout:client14496 2024-05-09T00:05:05.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:05.897 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa42787e-0d96-11ef-bc97-c7b262605968.client14496/status') 2024-05-09T00:05:05.990 INFO:teuthology.orchestra.run.smithi026.stdout:instance: client.14496 (3)192.168.0.1:0/3285800047 2024-05-09T00:05:05.990 INFO:teuthology.orchestra.run.smithi026.stdout:blocklisted: false 2024-05-09T00:05:05.990 INFO:teuthology.orchestra.run.smithi026.stderr:0+1 records in 2024-05-09T00:05:05.990 INFO:teuthology.orchestra.run.smithi026.stderr:0+1 records out 2024-05-09T00:05:05.990 INFO:teuthology.orchestra.run.smithi026.stderr:70 bytes copied, 2.4497e-05 s, 2.9 MB/s 2024-05-09T00:05:05.991 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-09T00:05:05.991 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T00:05:05.992 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T00:05:05.992 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T00:05:06.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:04.563269+0000 mgr.smithi026.brymfp (mgr.14194) 219 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:06.269 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/mon.smithi026/config 2024-05-09T00:05:07.677 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:06.563782+0000 mgr.smithi026.brymfp (mgr.14194) 220 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:07.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.957+0000 7f6c61b83700 1 -- 172.21.15.26:0/3692093674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 msgr2=0x7f6c5c0f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:07.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.957+0000 7f6c61b83700 1 --2- 172.21.15.26:0/3692093674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 0x7f6c5c0f90a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f6c440047f0 tx=0x7f6c44009cb0).stop 2024-05-09T00:05:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.957+0000 7f6c61b83700 1 -- 172.21.15.26:0/3692093674 shutdown_connections 2024-05-09T00:05:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.957+0000 7f6c61b83700 1 --2- 172.21.15.26:0/3692093674 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 0x7f6c5c0f90a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.957+0000 7f6c61b83700 1 --2- 172.21.15.26:0/3692093674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c5c0f79a0 0x7f6c5c0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.957+0000 7f6c61b83700 1 -- 172.21.15.26:0/3692093674 >> 172.21.15.26:0/3692093674 conn(0x7f6c5c0f3100 msgr2=0x7f6c5c0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.957+0000 7f6c61b83700 1 -- 172.21.15.26:0/3692093674 shutdown_connections 2024-05-09T00:05:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.957+0000 7f6c61b83700 1 -- 172.21.15.26:0/3692093674 wait complete. 2024-05-09T00:05:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c61b83700 1 Processor -- start 2024-05-09T00:05:07.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c61b83700 1 -- start start 2024-05-09T00:05:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c61b83700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c5c0f79a0 0x7f6c5c108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c61b83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 0x7f6c5c108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c61b83700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c108ae0 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c61b83700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c108c20 con 0x7f6c5c0f79a0 2024-05-09T00:05:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c5affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 0x7f6c5c108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c5affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 0x7f6c5c108530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56716/0 (socket says 172.21.15.26:56716) 2024-05-09T00:05:07.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c5affd700 1 -- 172.21.15.26:0/2302470548 learned_addr learned my addr 172.21.15.26:0/2302470548 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c5b7fe700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c5c0f79a0 0x7f6c5c108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c5affd700 1 -- 172.21.15.26:0/2302470548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c5c0f79a0 msgr2=0x7f6c5c108040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c5affd700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c5c0f79a0 0x7f6c5c108040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.958+0000 7f6c5affd700 1 -- 172.21.15.26:0/2302470548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44005040 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.959+0000 7f6c5affd700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 0x7f6c5c108530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f6c44013470 tx=0x7f6c44009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.959+0000 7f6c58ff9700 1 -- 172.21.15.26:0/2302470548 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c4400e030 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.959+0000 7f6c58ff9700 1 -- 172.21.15.26:0/2302470548 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f6c44007e90 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.959+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5c10d660 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.959+0000 7f6c58ff9700 1 -- 172.21.15.26:0/2302470548 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c44018070 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.959+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5c10dba0 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.960+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5c1000f0 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.960+0000 7f6c58ff9700 1 -- 172.21.15.26:0/2302470548 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f6c4401d420 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.961+0000 7f6c58ff9700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6c48061110 0x7f6c480635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:07.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.961+0000 7f6c5b7fe700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6c48061110 0x7f6c480635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:07.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.961+0000 7f6c58ff9700 1 -- 172.21.15.26:0/2302470548 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f6c4407dc60 con 0x7f6c5c0f8c40 2024-05-09T00:05:07.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.961+0000 7f6c5b7fe700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6c48061110 0x7f6c480635d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6c5c0f8aa0 tx=0x7f6c4c009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:07.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:07.965+0000 7f6c58ff9700 1 -- 172.21.15.26:0/2302470548 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6c44051bf0 con 0x7f6c5c0f8c40 2024-05-09T00:05:08.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:06.563782+0000 mgr.smithi026.brymfp (mgr.14194) 220 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:08.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.181+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6c5c0598f0 con 0x7f6c5c0f8c40 2024-05-09T00:05:08.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.181+0000 7f6c58ff9700 1 -- 172.21.15.26:0/2302470548 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) v1 ==== 53+0+83 (secure 0 0 0) 0x7f6c440517e0 con 0x7f6c5c0f8c40 2024-05-09T00:05:08.176 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-09T00:05:08.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6c48061110 msgr2=0x7f6c480635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6c48061110 0x7f6c480635d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6c5c0f8aa0 tx=0x7f6c4c009040).stop 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 msgr2=0x7f6c5c108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 0x7f6c5c108530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f6c44013470 tx=0x7f6c44009cb0).stop 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 shutdown_connections 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6c48061110 0x7f6c480635d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c5c0f79a0 0x7f6c5c108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 --2- 172.21.15.26:0/2302470548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c5c0f8c40 0x7f6c5c108530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 >> 172.21.15.26:0/2302470548 conn(0x7f6c5c0f3100 msgr2=0x7f6c5c0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 shutdown_connections 2024-05-09T00:05:08.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:08.183+0000 7f6c61b83700 1 -- 172.21.15.26:0/2302470548 wait complete. 2024-05-09T00:05:08.815 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:08.183129+0000 mon.smithi026 (mon.0) 590 : audit [DBG] from='client.? 172.21.15.26:0/2302470548' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T00:05:08.838 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T00:05:08.838 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T00:05:08.838 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-05-09T00:05:08.839 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-09T00:05:08.839 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T00:05:08.839 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T00:05:08.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T00:05:08.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T00:05:08.839 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-09T00:05:08.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:08.839 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-05-09T00:05:08.863 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:05:08.864 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:05:08.864 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T00:05:08.864 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:05:08.864 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-09T00:05:08.864 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 41604sec preferred_lft 41604sec 2024-05-09T00:05:08.864 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2024-05-09T00:05:08.864 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:05:08.864 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T00:05:08.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:08.864 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-09T00:05:08.865 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-09T00:05:08.865 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-05-09T00:05:08.865 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-05-09T00:05:08.865 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-05-09T00:05:08.865 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T00:05:08.865 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-09T00:05:08.949 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:08.183129+0000 mon.smithi026 (mon.0) 590 : audit [DBG] from='client.? 172.21.15.26:0/2302470548' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T00:05:09.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:09.042 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T00:05:09.070 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-05-09T00:05:09.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:09.071 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-05-09T00:05:09.150 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-05-09T00:05:09.151 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T00:05:09.151 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T00:05:09.151 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T00:05:09.151 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T00:05:09.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:09.152 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-09T00:05:09.152 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-09T00:05:09.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T00:05:09.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T00:05:09.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T00:05:09.152 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-09T00:05:09.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:09.433 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-09T00:05:09.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:09.450 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-05-09T00:05:09.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:09.508 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-09T00:05:09.508 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-09T00:05:09.508 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T00:05:09.508 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-09T00:05:09.508 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-09T00:05:09.603 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-09T00:05:09.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:09.604 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-09T00:05:09.604 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-09T00:05:09.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-09T00:05:09.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T00:05:09.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-09T00:05:09.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-09T00:05:09.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-09T00:05:09.604 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-09T00:05:09.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:09.808 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-09T00:05:09.808 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-09T00:05:09.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-05-09T00:05:09.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T00:05:09.808 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-09T00:05:09.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:08.564524+0000 mgr.smithi026.brymfp (mgr.14194) 221 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 2.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T00:05:09.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:05:09.905 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-09T00:05:09.963 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-09T00:05:09.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:05:09.963 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-09T00:05:10.021 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T00:05:10.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:10.021 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T00:05:10.137 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T00:05:10.138 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs" will pass to kernel. 2024-05-09T00:05:10.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:08.564524+0000 mgr.smithi026.brymfp (mgr.14194) 221 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 2.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T00:05:10.227 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T00:05:10.227 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs" will pass to kernel. 2024-05-09T00:05:10.230 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T00:05:10.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:10.230 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-09T00:05:10.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:10.257 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:05:10.332 INFO:teuthology.orchestra.run.smithi135.stdout:client14502 2024-05-09T00:05:10.332 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T00:05:10.332 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:05:10.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:10.394 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:05:10.467 INFO:teuthology.orchestra.run.smithi135.stdout:client14502 2024-05-09T00:05:10.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:10.467 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:05:10.540 INFO:teuthology.orchestra.run.smithi135.stdout:client14502 2024-05-09T00:05:10.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:05:10.541 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa42787e-0d96-11ef-bc97-c7b262605968.client14502/status') 2024-05-09T00:05:10.620 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.14502 (3)172.21.15.135:0/1350715060 2024-05-09T00:05:10.621 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-05-09T00:05:10.622 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-05-09T00:05:10.622 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-05-09T00:05:10.622 INFO:teuthology.orchestra.run.smithi135.stderr:72 bytes copied, 2.3091e-05 s, 3.1 MB/s 2024-05-09T00:05:10.623 INFO:teuthology.run_tasks:Running task print... 2024-05-09T00:05:10.696 INFO:teuthology.task.print:**** done client 2024-05-09T00:05:10.696 INFO:teuthology.run_tasks:Running task parallel... 2024-05-09T00:05:10.752 INFO:teuthology.task.parallel:starting parallel... 2024-05-09T00:05:10.753 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-09T00:05:10.754 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T00:05:10.754 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:05:10.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-05-09T00:05:10.755 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-09T00:05:10.756 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-09T00:05:10.760 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:05:10.761 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T00:05:10.761 INFO:tasks.workunit:timeout=3h 2024-05-09T00:05:10.761 INFO:tasks.workunit:cleanup=True 2024-05-09T00:05:10.761 DEBUG:teuthology.orchestra.run.smithi026:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T00:05:10.787 INFO:teuthology.orchestra.run.smithi026.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T00:05:10.787 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-09T00:05:10.787 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 71h/113d Inode: 1 Links: 2 2024-05-09T00:05:10.787 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:05:10.787 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-09T00:05:10.787 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T00:05:10.787 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-05-09 00:04:36.180999465 +0000 2024-05-09T00:05:10.788 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-05-09 00:05:05.664542668 +0000 2024-05-09T00:05:10.788 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-05-09 00:04:36.180999465 +0000 2024-05-09T00:05:10.788 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T00:05:10.788 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T00:05:10.861 DEBUG:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-09T00:05:10.879 INFO:teuthology.orchestra.run.smithi135.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-09T00:05:10.880 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-05-09T00:05:10.880 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 89h/137d Inode: 1 Links: 3 2024-05-09T00:05:10.880 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:05:10.880 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-09T00:05:10.880 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T00:05:10.880 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-09 00:05:10.862466571 +0000 2024-05-09T00:05:10.880 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-09 00:05:10.862466571 +0000 2024-05-09T00:05:10.880 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-09 00:04:36.180999465 +0000 2024-05-09T00:05:10.880 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-09T00:05:10.880 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-09T00:05:10.951 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:05:10.951 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:05:10.969 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T00:05:11.009 INFO:tasks.workunit.client.1.smithi135.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-09T00:05:11.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:10.565163+0000 mgr.smithi026.brymfp (mgr.14194) 222 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 2.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T00:05:12.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:10.565163+0000 mgr.smithi026.brymfp (mgr.14194) 222 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 2.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T00:05:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.763+0000 7f34864df700 1 -- 172.21.15.26:0/2205104898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800f7a10 msgr2=0x7f34800f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.763+0000 7f34864df700 1 --2- 172.21.15.26:0/2205104898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800f7a10 0x7f34800f7e30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f34700047f0 tx=0x7f3470009cb0).stop 2024-05-09T00:05:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.763+0000 7f34864df700 1 -- 172.21.15.26:0/2205104898 shutdown_connections 2024-05-09T00:05:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.763+0000 7f34864df700 1 --2- 172.21.15.26:0/2205104898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34800f8cb0 0x7f34800f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:05:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.763+0000 7f34864df700 1 --2- 172.21.15.26:0/2205104898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800f7a10 0x7f34800f7e30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.763+0000 7f34864df700 1 -- 172.21.15.26:0/2205104898 >> 172.21.15.26:0/2205104898 conn(0x7f34800f3150 msgr2=0x7f34800f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:12.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.763+0000 7f34864df700 1 -- 172.21.15.26:0/2205104898 shutdown_connections 2024-05-09T00:05:12.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.763+0000 7f34864df700 1 -- 172.21.15.26:0/2205104898 wait complete. 2024-05-09T00:05:12.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.764+0000 7f34864df700 1 Processor -- start 2024-05-09T00:05:12.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.764+0000 7f34864df700 1 -- start start 2024-05-09T00:05:12.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.764+0000 7f34864df700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34800f7a10 0x7f348006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:12.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.764+0000 7f34864df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800f8cb0 0x7f348006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.764+0000 7f34864df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348006b520 con 0x7f34800f8cb0 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.764+0000 7f34864df700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348006b660 con 0x7f34800f7a10 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800f8cb0 0x7f348006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800f8cb0 0x7f348006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40340/0 (socket says 172.21.15.26:40340) 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347f7fe700 1 -- 172.21.15.26:0/2992526941 learned_addr learned my addr 172.21.15.26:0/2992526941 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347ffff700 1 --2- 172.21.15.26:0/2992526941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34800f7a10 0x7f348006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347f7fe700 1 -- 172.21.15.26:0/2992526941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34800f7a10 msgr2=0x7f348006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347f7fe700 1 --2- 172.21.15.26:0/2992526941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34800f7a10 0x7f348006c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347f7fe700 1 -- 172.21.15.26:0/2992526941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3470005040 con 0x7f34800f8cb0 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347f7fe700 1 --2- 172.21.15.26:0/2992526941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34800f8cb0 0x7f348006b030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f347400b4b0 tx=0x7f34740090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347d7fa700 1 -- 172.21.15.26:0/2992526941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3474002500 con 0x7f34800f8cb0 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f34864df700 1 -- 172.21.15.26:0/2992526941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348006b940 con 0x7f34800f8cb0 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347d7fa700 1 -- 172.21.15.26:0/2992526941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3474002af0 con 0x7f34800f8cb0 2024-05-09T00:05:12.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f347d7fa700 1 -- 172.21.15.26:0/2992526941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3474012bf0 con 0x7f34800f8cb0 2024-05-09T00:05:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.765+0000 7f34864df700 1 -- 172.21.15.26:0/2992526941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348006be80 con 0x7f34800f8cb0 2024-05-09T00:05:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.766+0000 7f34864df700 1 -- 172.21.15.26:0/2992526941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348005fb50 con 0x7f34800f8cb0 2024-05-09T00:05:12.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.767+0000 7f347d7fa700 1 -- 172.21.15.26:0/2992526941 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f3474002660 con 0x7f34800f8cb0 2024-05-09T00:05:12.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.767+0000 7f347d7fa700 1 --2- 172.21.15.26:0/2992526941 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3468061180 0x7f3468063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:12.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.767+0000 7f347d7fa700 1 -- 172.21.15.26:0/2992526941 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f347407ce50 con 0x7f34800f8cb0 2024-05-09T00:05:12.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.767+0000 7f347ffff700 1 --2- 172.21.15.26:0/2992526941 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3468061180 0x7f3468063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:12.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.768+0000 7f347ffff700 1 --2- 172.21.15.26:0/2992526941 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f3468061180 0x7f3468063640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f3470004f10 tx=0x7f347000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:12.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.771+0000 7f347d7fa700 1 -- 172.21.15.26:0/2992526941 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3474050d40 con 0x7f34800f8cb0 2024-05-09T00:05:12.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.942+0000 7f34864df700 1 -- 172.21.15.26:0/2992526941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f3480100250 con 0x7f34800f8cb0 2024-05-09T00:05:12.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:12.942+0000 7f347d7fa700 1 -- 172.21.15.26:0/2992526941 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v20)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v20) v1 ==== 179+0+0 (secure 0 0 0) 0x7f3474050930 con 0x7f34800f8cb0 2024-05-09T00:05:12.938 INFO:teuthology.orchestra.run.smithi026.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-05-09T00:05:13.720 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T00:05:13.720 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:05:13.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-09T00:05:14.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:12.565548+0000 mgr.smithi026.brymfp (mgr.14194) 223 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 2.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T00:05:14.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:12.565548+0000 mgr.smithi026.brymfp (mgr.14194) 223 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 2.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T00:05:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.777+0000 7f576987f700 1 -- 172.21.15.26:0/604637850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 msgr2=0x7f57640f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.777+0000 7f576987f700 1 --2- 172.21.15.26:0/604637850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 0x7f57640f7c00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f57540047f0 tx=0x7f5754009cb0).stop 2024-05-09T00:05:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.777+0000 7f576987f700 1 -- 172.21.15.26:0/604637850 shutdown_connections 2024-05-09T00:05:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.777+0000 7f576987f700 1 --2- 172.21.15.26:0/604637850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57640f80f0 0x7f57640f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.777+0000 7f576987f700 1 --2- 172.21.15.26:0/604637850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 0x7f57640f7c00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.777+0000 7f576987f700 1 -- 172.21.15.26:0/604637850 >> 172.21.15.26:0/604637850 conn(0x7f57640f2fc0 msgr2=0x7f57640f5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.777+0000 7f576987f700 1 -- 172.21.15.26:0/604637850 shutdown_connections 2024-05-09T00:05:15.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.777+0000 7f576987f700 1 -- 172.21.15.26:0/604637850 wait complete. 2024-05-09T00:05:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.778+0000 7f576987f700 1 Processor -- start 2024-05-09T00:05:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.778+0000 7f576987f700 1 -- start start 2024-05-09T00:05:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.778+0000 7f576987f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 0x7f5764107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.778+0000 7f576987f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57640f80f0 0x7f5764108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.778+0000 7f576987f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57641089f0 con 0x7f57640f77e0 2024-05-09T00:05:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.778+0000 7f576987f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5764108b30 con 0x7f57640f80f0 2024-05-09T00:05:15.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.778+0000 7f5762ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 0x7f5764107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f5762ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 0x7f5764107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40366/0 (socket says 172.21.15.26:40366) 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f5762ffd700 1 -- 172.21.15.26:0/2467251765 learned_addr learned my addr 172.21.15.26:0/2467251765 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f5762ffd700 1 -- 172.21.15.26:0/2467251765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57640f80f0 msgr2=0x7f5764108440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f57627fc700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57640f80f0 0x7f5764108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f5762ffd700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57640f80f0 0x7f5764108440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f5762ffd700 1 -- 172.21.15.26:0/2467251765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754005040 con 0x7f57640f77e0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f57627fc700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57640f80f0 0x7f5764108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f5762ffd700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 0x7f5764107f50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f5754013510 tx=0x7f5754009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f575bfff700 1 -- 172.21.15.26:0/2467251765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f575400e030 con 0x7f57640f77e0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f575bfff700 1 -- 172.21.15.26:0/2467251765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5754007e90 con 0x7f57640f77e0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576410d570 con 0x7f57640f77e0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f575bfff700 1 -- 172.21.15.26:0/2467251765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5754018070 con 0x7f57640f77e0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.779+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576410dab0 con 0x7f57640f77e0 2024-05-09T00:05:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.780+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57640fffe0 con 0x7f57640f77e0 2024-05-09T00:05:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.781+0000 7f575bfff700 1 -- 172.21.15.26:0/2467251765 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f575401da20 con 0x7f57640f77e0 2024-05-09T00:05:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.781+0000 7f575bfff700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5750061180 0x7f5750063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.781+0000 7f575bfff700 1 -- 172.21.15.26:0/2467251765 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f575407de70 con 0x7f57640f77e0 2024-05-09T00:05:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.781+0000 7f57627fc700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5750061180 0x7f5750063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.781+0000 7f57627fc700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5750061180 0x7f5750063640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f574c004ba0 tx=0x7f574c009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.786+0000 7f575bfff700 1 -- 172.21.15.26:0/2467251765 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5754051e00 con 0x7f57640f77e0 2024-05-09T00:05:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.955+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f57640598f0 con 0x7f57640f77e0 2024-05-09T00:05:15.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.955+0000 7f575bfff700 1 -- 172.21.15.26:0/2467251765 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v20)=0 v20) v1 ==== 155+0+0 (secure 0 0 0) 0x7f57540519f0 con 0x7f57640f77e0 2024-05-09T00:05:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5750061180 msgr2=0x7f5750063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:15.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5750061180 0x7f5750063640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f574c004ba0 tx=0x7f574c009040).stop 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 msgr2=0x7f5764107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 0x7f5764107f50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f5754013510 tx=0x7f5754009cb0).stop 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 shutdown_connections 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f5750061180 0x7f5750063640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57640f77e0 0x7f5764107f50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 --2- 172.21.15.26:0/2467251765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57640f80f0 0x7f5764108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 >> 172.21.15.26:0/2467251765 conn(0x7f57640f2fc0 msgr2=0x7f57640fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 shutdown_connections 2024-05-09T00:05:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:15.957+0000 7f576987f700 1 -- 172.21.15.26:0/2467251765 wait complete. 2024-05-09T00:05:15.979 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:14.565977+0000 mgr.smithi026.brymfp (mgr.14194) 224 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T00:05:16.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:14.565977+0000 mgr.smithi026.brymfp (mgr.14194) 224 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T00:05:16.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-09T00:05:18.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:16.566650+0000 mgr.smithi026.brymfp (mgr.14194) 225 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T00:05:18.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:16.566650+0000 mgr.smithi026.brymfp (mgr.14194) 225 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T00:05:18.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.871+0000 7fc8f786c700 1 -- 172.21.15.26:0/868588332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 msgr2=0x7fc8f00f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.871+0000 7fc8f786c700 1 --2- 172.21.15.26:0/868588332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 0x7fc8f00f7c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fc8e40047f0 tx=0x7fc8e4009cb0).stop 2024-05-09T00:05:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.871+0000 7fc8f786c700 1 -- 172.21.15.26:0/868588332 shutdown_connections 2024-05-09T00:05:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.871+0000 7fc8f786c700 1 --2- 172.21.15.26:0/868588332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8f00f8aa0 0x7fc8f00f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.871+0000 7fc8f786c700 1 --2- 172.21.15.26:0/868588332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 0x7fc8f00f7c20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.871+0000 7fc8f786c700 1 -- 172.21.15.26:0/868588332 >> 172.21.15.26:0/868588332 conn(0x7fc8f00f2f80 msgr2=0x7fc8f00f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.871+0000 7fc8f786c700 1 -- 172.21.15.26:0/868588332 shutdown_connections 2024-05-09T00:05:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.871+0000 7fc8f786c700 1 -- 172.21.15.26:0/868588332 wait complete. 2024-05-09T00:05:18.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f786c700 1 Processor -- start 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f786c700 1 -- start start 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f786c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 0x7fc8f0107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f786c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8f00f8aa0 0x7fc8f0108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f786c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0108a40 con 0x7fc8f00f7800 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f786c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0108b80 con 0x7fc8f00f8aa0 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f5608700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 0x7fc8f0107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f5608700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 0x7fc8f0107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40376/0 (socket says 172.21.15.26:40376) 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f5608700 1 -- 172.21.15.26:0/1980140038 learned_addr learned my addr 172.21.15.26:0/1980140038 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f4e07700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8f00f8aa0 0x7fc8f0108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:18.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f5608700 1 -- 172.21.15.26:0/1980140038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8f00f8aa0 msgr2=0x7fc8f0108490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f5608700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8f00f8aa0 0x7fc8f0108490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f5608700 1 -- 172.21.15.26:0/1980140038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4005040 con 0x7fc8f00f7800 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.872+0000 7fc8f4e07700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8f00f8aa0 0x7fc8f0108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.873+0000 7fc8f5608700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 0x7fc8f0107fa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fc8e4013470 tx=0x7fc8e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.873+0000 7fc8e27fc700 1 -- 172.21.15.26:0/1980140038 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e400e030 con 0x7fc8f00f7800 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.873+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f010d5c0 con 0x7fc8f00f7800 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.873+0000 7fc8e27fc700 1 -- 172.21.15.26:0/1980140038 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc8e4007e90 con 0x7fc8f00f7800 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.873+0000 7fc8e27fc700 1 -- 172.21.15.26:0/1980140038 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e4018070 con 0x7fc8f00f7800 2024-05-09T00:05:18.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.873+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f010db00 con 0x7fc8f00f7800 2024-05-09T00:05:18.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.874+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f00fffe0 con 0x7fc8f00f7800 2024-05-09T00:05:18.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.874+0000 7fc8e27fc700 1 -- 172.21.15.26:0/1980140038 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fc8e401d940 con 0x7fc8f00f7800 2024-05-09T00:05:18.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.875+0000 7fc8e27fc700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc8dc061180 0x7fc8dc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:18.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.875+0000 7fc8e27fc700 1 -- 172.21.15.26:0/1980140038 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fc8e407dee0 con 0x7fc8f00f7800 2024-05-09T00:05:18.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.875+0000 7fc8f4e07700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc8dc061180 0x7fc8dc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:18.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.875+0000 7fc8f4e07700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc8dc061180 0x7fc8dc063640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc8ec0041d0 tx=0x7fc8ec009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:18.879+0000 7fc8e27fc700 1 -- 172.21.15.26:0/1980140038 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc8e4051e70 con 0x7fc8f00f7800 2024-05-09T00:05:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.049+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc8f00598f0 con 0x7fc8f00f7800 2024-05-09T00:05:19.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.049+0000 7fc8e27fc700 1 -- 172.21.15.26:0/1980140038 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v20)=0 v20) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc8e4051a60 con 0x7fc8f00f7800 2024-05-09T00:05:19.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc8dc061180 msgr2=0x7fc8dc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:19.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc8dc061180 0x7fc8dc063640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc8ec0041d0 tx=0x7fc8ec009040).stop 2024-05-09T00:05:19.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 msgr2=0x7fc8f0107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:19.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 0x7fc8f0107fa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fc8e4013470 tx=0x7fc8e4009cb0).stop 2024-05-09T00:05:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 shutdown_connections 2024-05-09T00:05:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc8dc061180 0x7fc8dc063640 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f00f7800 0x7fc8f0107fa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 --2- 172.21.15.26:0/1980140038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8f00f8aa0 0x7fc8f0108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 >> 172.21.15.26:0/1980140038 conn(0x7fc8f00f2f80 msgr2=0x7fc8f00fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 shutdown_connections 2024-05-09T00:05:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:19.051+0000 7fc8f786c700 1 -- 172.21.15.26:0/1980140038 wait complete. 2024-05-09T00:05:19.789 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-09T00:05:20.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:18.567217+0000 mgr.smithi026.brymfp (mgr.14194) 226 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T00:05:20.146 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:18.567217+0000 mgr.smithi026.brymfp (mgr.14194) 226 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T00:05:21.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.761+0000 7f7a2923b700 1 -- 172.21.15.26:0/3880893925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a240fa9b0 msgr2=0x7f7a240fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:21.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.761+0000 7f7a2923b700 1 --2- 172.21.15.26:0/3880893925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a240fa9b0 0x7f7a240fcda0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f7a180047f0 tx=0x7f7a18009cb0).stop 2024-05-09T00:05:21.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.761+0000 7f7a2923b700 1 -- 172.21.15.26:0/3880893925 shutdown_connections 2024-05-09T00:05:21.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.761+0000 7f7a2923b700 1 --2- 172.21.15.26:0/3880893925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a240fa9b0 0x7f7a240fcda0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:21.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.761+0000 7f7a2923b700 1 --2- 172.21.15.26:0/3880893925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a24061220 0x7f7a240fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:21.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.761+0000 7f7a2923b700 1 -- 172.21.15.26:0/3880893925 >> 172.21.15.26:0/3880893925 conn(0x7f7a240f1e50 msgr2=0x7f7a240f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:21.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.761+0000 7f7a2923b700 1 -- 172.21.15.26:0/3880893925 shutdown_connections 2024-05-09T00:05:21.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.761+0000 7f7a2923b700 1 -- 172.21.15.26:0/3880893925 wait complete. 2024-05-09T00:05:21.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.762+0000 7f7a2923b700 1 Processor -- start 2024-05-09T00:05:21.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.762+0000 7f7a2923b700 1 -- start start 2024-05-09T00:05:21.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.762+0000 7f7a2923b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a24061220 0x7f7a24107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:21.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.762+0000 7f7a2923b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a240fa9b0 0x7f7a24108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:21.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.762+0000 7f7a2923b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24108a20 con 0x7f7a24061220 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.762+0000 7f7a2923b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24108b60 con 0x7f7a240fa9b0 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a22d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a24061220 0x7f7a24107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a22d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a24061220 0x7f7a24107f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39518/0 (socket says 172.21.15.26:39518) 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a22d9d700 1 -- 172.21.15.26:0/1201580546 learned_addr learned my addr 172.21.15.26:0/1201580546 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a2259c700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a240fa9b0 0x7f7a24108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a22d9d700 1 -- 172.21.15.26:0/1201580546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a240fa9b0 msgr2=0x7f7a24108470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a22d9d700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a240fa9b0 0x7f7a24108470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a22d9d700 1 -- 172.21.15.26:0/1201580546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a18005040 con 0x7f7a24061220 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a22d9d700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a24061220 0x7f7a24107f80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f7a1400c740 tx=0x7f7a14007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a0bfff700 1 -- 172.21.15.26:0/1201580546 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a1400e680 con 0x7f7a24061220 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2410d600 con 0x7f7a24061220 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a0bfff700 1 -- 172.21.15.26:0/1201580546 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7a1400ec70 con 0x7f7a24061220 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a0bfff700 1 -- 172.21.15.26:0/1201580546 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a14013d30 con 0x7f7a24061220 2024-05-09T00:05:21.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.763+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2410db40 con 0x7f7a24061220 2024-05-09T00:05:21.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.764+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a240fffb0 con 0x7f7a24061220 2024-05-09T00:05:21.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.765+0000 7f7a0bfff700 1 -- 172.21.15.26:0/1201580546 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f7a1400e7e0 con 0x7f7a24061220 2024-05-09T00:05:21.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.765+0000 7f7a0bfff700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7a0c061180 0x7f7a0c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:21.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.765+0000 7f7a0bfff700 1 -- 172.21.15.26:0/1201580546 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f7a1407cb70 con 0x7f7a24061220 2024-05-09T00:05:21.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.765+0000 7f7a2259c700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7a0c061180 0x7f7a0c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:21.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.765+0000 7f7a2259c700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7a0c061180 0x7f7a0c063640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7a18013470 tx=0x7f7a1800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:21.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.769+0000 7f7a0bfff700 1 -- 172.21.15.26:0/1201580546 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7a14050b00 con 0x7f7a24061220 2024-05-09T00:05:21.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:20.567678+0000 mgr.smithi026.brymfp (mgr.14194) 227 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:21.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.944+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f7a24101e20 con 0x7f7a24061220 2024-05-09T00:05:21.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.947+0000 7f7a0bfff700 1 -- 172.21.15.26:0/1201580546 <== mon.0 v2:172.21.15.26:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a14050b00 con 0x7f7a24061220 2024-05-09T00:05:21.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.948+0000 7f7a0bfff700 1 -- 172.21.15.26:0/1201580546 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f7a140506f0 con 0x7f7a24061220 2024-05-09T00:05:21.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7a0c061180 msgr2=0x7f7a0c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:21.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7a0c061180 0x7f7a0c063640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7a18013470 tx=0x7f7a1800b040).stop 2024-05-09T00:05:21.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a24061220 msgr2=0x7f7a24107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:21.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a24061220 0x7f7a24107f80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f7a1400c740 tx=0x7f7a14007ef0).stop 2024-05-09T00:05:21.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 shutdown_connections 2024-05-09T00:05:21.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f7a0c061180 0x7f7a0c063640 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:21.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a24061220 0x7f7a24107f80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:21.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 --2- 172.21.15.26:0/1201580546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a240fa9b0 0x7f7a24108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:21.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 >> 172.21.15.26:0/1201580546 conn(0x7f7a240f1e50 msgr2=0x7f7a240f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:21.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 shutdown_connections 2024-05-09T00:05:21.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:21.951+0000 7f7a2923b700 1 -- 172.21.15.26:0/1201580546 wait complete. 2024-05-09T00:05:22.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:20.567678+0000 mgr.smithi026.brymfp (mgr.14194) 227 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:22.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-05-09T00:05:23.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:21.948459+0000 mon.smithi026 (mon.0) 591 : audit [INF] from='client.? 172.21.15.26:0/1201580546' entity='client.admin' 2024-05-09T00:05:23.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:21.984559+0000 mon.smithi026 (mon.0) 592 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:23.225 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:22.301576+0000 mon.smithi026 (mon.0) 593 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:05:23.225 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:22.302278+0000 mon.smithi026 (mon.0) 594 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:05:23.225 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:22.306378+0000 mon.smithi026 (mon.0) 595 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:23.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:21.948459+0000 mon.smithi026 (mon.0) 591 : audit [INF] from='client.? 172.21.15.26:0/1201580546' entity='client.admin' 2024-05-09T00:05:23.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:21.984559+0000 mon.smithi026 (mon.0) 592 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:23.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:22.301576+0000 mon.smithi026 (mon.0) 593 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:05:23.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:22.302278+0000 mon.smithi026 (mon.0) 594 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:05:23.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:22.306378+0000 mon.smithi026 (mon.0) 595 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:24.159 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:22.568002+0000 mgr.smithi026.brymfp (mgr.14194) 228 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:24.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:22.568002+0000 mgr.smithi026.brymfp (mgr.14194) 228 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.404+0000 7fc53cd71700 1 -- 172.21.15.26:0/595268340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 msgr2=0x7fc5380f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.404+0000 7fc53cd71700 1 --2- 172.21.15.26:0/595268340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 0x7fc5380f7df0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fc52c0047f0 tx=0x7fc52c009cb0).stop 2024-05-09T00:05:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.404+0000 7fc53cd71700 1 -- 172.21.15.26:0/595268340 shutdown_connections 2024-05-09T00:05:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.404+0000 7fc53cd71700 1 --2- 172.21.15.26:0/595268340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 0x7fc5380f7df0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.404+0000 7fc53cd71700 1 --2- 172.21.15.26:0/595268340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5380f66f0 0x7fc5380f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.404+0000 7fc53cd71700 1 -- 172.21.15.26:0/595268340 >> 172.21.15.26:0/595268340 conn(0x7fc5380f1e50 msgr2=0x7fc5380f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.404+0000 7fc53cd71700 1 -- 172.21.15.26:0/595268340 shutdown_connections 2024-05-09T00:05:24.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.404+0000 7fc53cd71700 1 -- 172.21.15.26:0/595268340 wait complete. 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc53cd71700 1 Processor -- start 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc53cd71700 1 -- start start 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc53cd71700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5380f66f0 0x7fc538106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc53cd71700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 0x7fc538107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc53cd71700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538107a00 con 0x7fc5380f7990 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc53cd71700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538107b40 con 0x7fc5380f66f0 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc535d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 0x7fc538107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc535d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 0x7fc538107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39540/0 (socket says 172.21.15.26:39540) 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.405+0000 7fc535d9b700 1 -- 172.21.15.26:0/2228561232 learned_addr learned my addr 172.21.15.26:0/2228561232 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc53659c700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5380f66f0 0x7fc538106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc535d9b700 1 -- 172.21.15.26:0/2228561232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5380f66f0 msgr2=0x7fc538106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:24.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc535d9b700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5380f66f0 0x7fc538106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc535d9b700 1 -- 172.21.15.26:0/2228561232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c005040 con 0x7fc5380f7990 2024-05-09T00:05:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc535d9b700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 0x7fc538107450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fc52c013560 tx=0x7fc52c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc5277fe700 1 -- 172.21.15.26:0/2228561232 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52c018070 con 0x7fc5380f7990 2024-05-09T00:05:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc5277fe700 1 -- 172.21.15.26:0/2228561232 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc52c007e90 con 0x7fc5380f7990 2024-05-09T00:05:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53810c580 con 0x7fc5380f7990 2024-05-09T00:05:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc5277fe700 1 -- 172.21.15.26:0/2228561232 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52c01c380 con 0x7fc5380f7990 2024-05-09T00:05:24.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.406+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53810cb40 con 0x7fc5380f7990 2024-05-09T00:05:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.407+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5380feeb0 con 0x7fc5380f7990 2024-05-09T00:05:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.407+0000 7fc5277fe700 1 -- 172.21.15.26:0/2228561232 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fc52c0123c0 con 0x7fc5380f7990 2024-05-09T00:05:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.408+0000 7fc5277fe700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc520061180 0x7fc520063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.408+0000 7fc5277fe700 1 -- 172.21.15.26:0/2228561232 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fc52c07d610 con 0x7fc5380f7990 2024-05-09T00:05:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.408+0000 7fc53659c700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc520061180 0x7fc520063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:24.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.408+0000 7fc53659c700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc520061180 0x7fc520063640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc5380f77f0 tx=0x7fc52800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:24.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.413+0000 7fc5277fe700 1 -- 172.21.15.26:0/2228561232 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc52c0515a0 con 0x7fc5380f7990 2024-05-09T00:05:24.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.599+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5380591e0 con 0x7fc520061180 2024-05-09T00:05:24.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.604+0000 7fc5277fe700 1 -- 172.21.15.26:0/2228561232 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fc5380591e0 con 0x7fc520061180 2024-05-09T00:05:24.598 INFO:teuthology.orchestra.run.smithi026.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:05:24.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc520061180 msgr2=0x7fc520063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc520061180 0x7fc520063640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc5380f77f0 tx=0x7fc52800b040).stop 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 msgr2=0x7fc538107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 0x7fc538107450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fc52c013560 tx=0x7fc52c009cb0).stop 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 shutdown_connections 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc520061180 0x7fc520063640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5380f66f0 0x7fc538106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 --2- 172.21.15.26:0/2228561232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5380f7990 0x7fc538107450 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 >> 172.21.15.26:0/2228561232 conn(0x7fc5380f1e50 msgr2=0x7fc5380fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 shutdown_connections 2024-05-09T00:05:24.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:24.606+0000 7fc53cd71700 1 -- 172.21.15.26:0/2228561232 wait complete. 2024-05-09T00:05:25.479 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T00:05:25.479 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:05:25.480 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-05-09T00:05:25.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:24.568419+0000 mgr.smithi026.brymfp (mgr.14194) 229 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:25.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:24.600518+0000 mgr.smithi026.brymfp (mgr.14194) 230 : audit [DBG] from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:25.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:05:24.601122+0000 mgr.smithi026.brymfp (mgr.14194) 231 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:05:25.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:24.604713+0000 mon.smithi026 (mon.0) 596 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:25.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:24.629767+0000 mon.smithi026 (mon.0) 597 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:25.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:24.631256+0000 mon.smithi026 (mon.0) 598 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:05:25.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:24.631865+0000 mon.smithi026 (mon.0) 599 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:05:25.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:24.635970+0000 mon.smithi026 (mon.0) 600 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:25.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:05:24.640097+0000 mgr.smithi026.brymfp (mgr.14194) 232 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:24.568419+0000 mgr.smithi026.brymfp (mgr.14194) 229 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:24.600518+0000 mgr.smithi026.brymfp (mgr.14194) 230 : audit [DBG] from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:05:24.601122+0000 mgr.smithi026.brymfp (mgr.14194) 231 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:24.604713+0000 mon.smithi026 (mon.0) 596 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:24.629767+0000 mon.smithi026 (mon.0) 597 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:24.631256+0000 mon.smithi026 (mon.0) 598 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:24.631865+0000 mon.smithi026 (mon.0) 599 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:24.635970+0000 mon.smithi026 (mon.0) 600 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:25.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:05:24.640097+0000 mgr.smithi026.brymfp (mgr.14194) 232 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:05:27.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.692+0000 7faa672a9700 1 -- 172.21.15.26:0/1541104972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 msgr2=0x7faa600f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.692+0000 7faa672a9700 1 --2- 172.21.15.26:0/1541104972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 0x7faa600f7df0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7faa500047f0 tx=0x7faa50009cb0).stop 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.692+0000 7faa672a9700 1 -- 172.21.15.26:0/1541104972 shutdown_connections 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.692+0000 7faa672a9700 1 --2- 172.21.15.26:0/1541104972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 0x7faa600f7df0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.692+0000 7faa672a9700 1 --2- 172.21.15.26:0/1541104972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600f66f0 0x7faa600f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.692+0000 7faa672a9700 1 -- 172.21.15.26:0/1541104972 >> 172.21.15.26:0/1541104972 conn(0x7faa600f1e50 msgr2=0x7faa600f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.692+0000 7faa672a9700 1 -- 172.21.15.26:0/1541104972 shutdown_connections 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.692+0000 7faa672a9700 1 -- 172.21.15.26:0/1541104972 wait complete. 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.693+0000 7faa672a9700 1 Processor -- start 2024-05-09T00:05:27.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.693+0000 7faa672a9700 1 -- start start 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.693+0000 7faa672a9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600f66f0 0x7faa60106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.693+0000 7faa672a9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 0x7faa60107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.693+0000 7faa672a9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60107930 con 0x7faa600f7990 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.693+0000 7faa672a9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60107a70 con 0x7faa600f66f0 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.693+0000 7faa64844700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 0x7faa60107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa64844700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 0x7faa60107380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39558/0 (socket says 172.21.15.26:39558) 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa65045700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600f66f0 0x7faa60106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa64844700 1 -- 172.21.15.26:0/319593539 learned_addr learned my addr 172.21.15.26:0/319593539 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa64844700 1 -- 172.21.15.26:0/319593539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600f66f0 msgr2=0x7faa60106e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:27.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa64844700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600f66f0 0x7faa60106e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:27.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa64844700 1 -- 172.21.15.26:0/319593539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa50005040 con 0x7faa600f7990 2024-05-09T00:05:27.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa64844700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 0x7faa60107380 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7faa50013620 tx=0x7faa50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:27.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa56777700 1 -- 172.21.15.26:0/319593539 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5000e030 con 0x7faa600f7990 2024-05-09T00:05:27.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa56777700 1 -- 172.21.15.26:0/319593539 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa50007e90 con 0x7faa600f7990 2024-05-09T00:05:27.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.694+0000 7faa56777700 1 -- 172.21.15.26:0/319593539 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5001eea0 con 0x7faa600f7990 2024-05-09T00:05:27.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.695+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa60060590 con 0x7faa600f7990 2024-05-09T00:05:27.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.695+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa60060ad0 con 0x7faa600f7990 2024-05-09T00:05:27.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.696+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa600feeb0 con 0x7faa600f7990 2024-05-09T00:05:27.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.697+0000 7faa56777700 1 -- 172.21.15.26:0/319593539 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7faa5001e440 con 0x7faa600f7990 2024-05-09T00:05:27.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.697+0000 7faa56777700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faa4c061180 0x7faa4c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:27.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.697+0000 7faa56777700 1 -- 172.21.15.26:0/319593539 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7faa5007ddf0 con 0x7faa600f7990 2024-05-09T00:05:27.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.697+0000 7faa65045700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faa4c061180 0x7faa4c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:27.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.698+0000 7faa65045700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faa4c061180 0x7faa4c063640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7faa600f77f0 tx=0x7faa5c011040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:27.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.705+0000 7faa56777700 1 -- 172.21.15.26:0/319593539 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7faa50051d80 con 0x7faa600f7990 2024-05-09T00:05:27.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:26.568755+0000 mgr.smithi026.brymfp (mgr.14194) 233 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:05:27.895 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:26.568755+0000 mgr.smithi026.brymfp (mgr.14194) 233 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:05:27.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.987+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa60060d40 con 0x7faa4c061180 2024-05-09T00:05:27.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.988+0000 7faa56777700 1 -- 172.21.15.26:0/319593539 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7faa60060d40 con 0x7faa4c061180 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faa4c061180 msgr2=0x7faa4c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faa4c061180 0x7faa4c063640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7faa600f77f0 tx=0x7faa5c011040).stop 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 msgr2=0x7faa60107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 0x7faa60107380 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7faa50013620 tx=0x7faa50009cb0).stop 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 shutdown_connections 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faa4c061180 0x7faa4c063640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600f66f0 0x7faa60106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 --2- 172.21.15.26:0/319593539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa600f7990 0x7faa60107380 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 >> 172.21.15.26:0/319593539 conn(0x7faa600f1e50 msgr2=0x7faa600fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:27.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 shutdown_connections 2024-05-09T00:05:27.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:27.990+0000 7faa672a9700 1 -- 172.21.15.26:0/319593539 wait complete. 2024-05-09T00:05:27.996 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:05:28.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.139+0000 7f498d368700 1 -- 172.21.15.26:0/913762415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f5e70 msgr2=0x7f49880f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.139+0000 7f498d368700 1 --2- 172.21.15.26:0/913762415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f5e70 0x7f49880f6290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f49780048f0 tx=0x7f497800adc0).stop 2024-05-09T00:05:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.140+0000 7f498d368700 1 -- 172.21.15.26:0/913762415 shutdown_connections 2024-05-09T00:05:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.140+0000 7f498d368700 1 --2- 172.21.15.26:0/913762415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49880f7070 0x7f49880f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.140+0000 7f498d368700 1 --2- 172.21.15.26:0/913762415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f5e70 0x7f49880f6290 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.140+0000 7f498d368700 1 -- 172.21.15.26:0/913762415 >> 172.21.15.26:0/913762415 conn(0x7f49880f15d0 msgr2=0x7f49880f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.140+0000 7f498d368700 1 -- 172.21.15.26:0/913762415 shutdown_connections 2024-05-09T00:05:28.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.140+0000 7f498d368700 1 -- 172.21.15.26:0/913762415 wait complete. 2024-05-09T00:05:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.140+0000 7f498d368700 1 Processor -- start 2024-05-09T00:05:28.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f498d368700 1 -- start start 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f498d368700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49880f5e70 0x7f498810a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f498d368700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f7070 0x7f498810a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f498d368700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498810ac70 con 0x7f49880f7070 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f498d368700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498810adb0 con 0x7f49880f5e70 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f49867fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f7070 0x7f498810a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f49867fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f7070 0x7f498810a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39572/0 (socket says 172.21.15.26:39572) 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f49867fc700 1 -- 172.21.15.26:0/2566970452 learned_addr learned my addr 172.21.15.26:0/2566970452 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f4986ffd700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49880f5e70 0x7f498810a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f49867fc700 1 -- 172.21.15.26:0/2566970452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49880f5e70 msgr2=0x7f498810a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f49867fc700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49880f5e70 0x7f498810a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f49867fc700 1 -- 172.21.15.26:0/2566970452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978005040 con 0x7f49880f7070 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f4986ffd700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49880f5e70 0x7f498810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.141+0000 7f49867fc700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f7070 0x7f498810a6c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f497c0041d0 tx=0x7f497c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:28.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.142+0000 7f496ffff700 1 -- 172.21.15.26:0/2566970452 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f497c002d90 con 0x7f49880f7070 2024-05-09T00:05:28.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.142+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498810f850 con 0x7f49880f7070 2024-05-09T00:05:28.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.142+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498810fe10 con 0x7f49880f7070 2024-05-09T00:05:28.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.142+0000 7f496ffff700 1 -- 172.21.15.26:0/2566970452 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f497c00f040 con 0x7f49880f7070 2024-05-09T00:05:28.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.142+0000 7f496ffff700 1 -- 172.21.15.26:0/2566970452 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f497c00d800 con 0x7f49880f7070 2024-05-09T00:05:28.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.143+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4974005150 con 0x7f49880f7070 2024-05-09T00:05:28.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.144+0000 7f496ffff700 1 -- 172.21.15.26:0/2566970452 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f497c00dad0 con 0x7f49880f7070 2024-05-09T00:05:28.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.144+0000 7f496ffff700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f4970061180 0x7f4970063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.144+0000 7f496ffff700 1 -- 172.21.15.26:0/2566970452 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f497c07c860 con 0x7f49880f7070 2024-05-09T00:05:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.145+0000 7f4986ffd700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f4970061180 0x7f4970063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.146+0000 7f4986ffd700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f4970061180 0x7f4970063640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4978000c00 tx=0x7f497800adc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:28.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.151+0000 7f496ffff700 1 -- 172.21.15.26:0/2566970452 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f497c050870 con 0x7f49880f7070 2024-05-09T00:05:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.460+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4974000bf0 con 0x7f4970061180 2024-05-09T00:05:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.462+0000 7f496ffff700 1 -- 172.21.15.26:0/2566970452 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f4974000bf0 con 0x7f4970061180 2024-05-09T00:05:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.464+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f4970061180 msgr2=0x7f4970063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.464+0000 7f498d368700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f4970061180 0x7f4970063640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4978000c00 tx=0x7f497800adc0).stop 2024-05-09T00:05:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.464+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f7070 msgr2=0x7f498810a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.464+0000 7f498d368700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f7070 0x7f498810a6c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f497c0041d0 tx=0x7f497c009f60).stop 2024-05-09T00:05:28.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.469+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 shutdown_connections 2024-05-09T00:05:28.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.469+0000 7f498d368700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f4970061180 0x7f4970063640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.469+0000 7f498d368700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49880f5e70 0x7f498810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.469+0000 7f498d368700 1 --2- 172.21.15.26:0/2566970452 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49880f7070 0x7f498810a6c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.469+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 >> 172.21.15.26:0/2566970452 conn(0x7f49880f15d0 msgr2=0x7f49880fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:28.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.469+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 shutdown_connections 2024-05-09T00:05:28.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.469+0000 7f498d368700 1 -- 172.21.15.26:0/2566970452 wait complete. 2024-05-09T00:05:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.604+0000 7f14de1ad700 1 -- 172.21.15.26:0/3478414043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f66f0 msgr2=0x7f14d80f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.604+0000 7f14de1ad700 1 --2- 172.21.15.26:0/3478414043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f66f0 0x7f14d80f6b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f14c80047f0 tx=0x7f14c8009cb0).stop 2024-05-09T00:05:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.604+0000 7f14de1ad700 1 -- 172.21.15.26:0/3478414043 shutdown_connections 2024-05-09T00:05:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.604+0000 7f14de1ad700 1 --2- 172.21.15.26:0/3478414043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d80f7990 0x7f14d80f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.604+0000 7f14de1ad700 1 --2- 172.21.15.26:0/3478414043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f66f0 0x7f14d80f6b10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.604+0000 7f14de1ad700 1 -- 172.21.15.26:0/3478414043 >> 172.21.15.26:0/3478414043 conn(0x7f14d80f1e50 msgr2=0x7f14d80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.604+0000 7f14de1ad700 1 -- 172.21.15.26:0/3478414043 shutdown_connections 2024-05-09T00:05:28.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.604+0000 7f14de1ad700 1 -- 172.21.15.26:0/3478414043 wait complete. 2024-05-09T00:05:28.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.605+0000 7f14de1ad700 1 Processor -- start 2024-05-09T00:05:28.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.605+0000 7f14de1ad700 1 -- start start 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.605+0000 7f14de1ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d80f66f0 0x7f14d8108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.605+0000 7f14de1ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f7990 0x7f14d8108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.605+0000 7f14de1ad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8108b20 con 0x7f14d80f7990 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.605+0000 7f14de1ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8108c60 con 0x7f14d80f66f0 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.605+0000 7f14d6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f7990 0x7f14d8108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f7990 0x7f14d8108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39584/0 (socket says 172.21.15.26:39584) 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d6ffd700 1 -- 172.21.15.26:0/2434678337 learned_addr learned my addr 172.21.15.26:0/2434678337 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d77fe700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d80f66f0 0x7f14d8108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d6ffd700 1 -- 172.21.15.26:0/2434678337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d80f66f0 msgr2=0x7f14d8108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d6ffd700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d80f66f0 0x7f14d8108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d6ffd700 1 -- 172.21.15.26:0/2434678337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8005040 con 0x7f14d80f7990 2024-05-09T00:05:28.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d6ffd700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f7990 0x7f14d8108570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f14cc00e8f0 tx=0x7f14cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:28.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d4ff9700 1 -- 172.21.15.26:0/2434678337 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14cc007b40 con 0x7f14d80f7990 2024-05-09T00:05:28.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d4ff9700 1 -- 172.21.15.26:0/2434678337 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14cc00f040 con 0x7f14d80f7990 2024-05-09T00:05:28.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14d4ff9700 1 -- 172.21.15.26:0/2434678337 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14cc014920 con 0x7f14d80f7990 2024-05-09T00:05:28.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d810d700 con 0x7f14d80f7990 2024-05-09T00:05:28.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.606+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d810dcc0 con 0x7f14d80f7990 2024-05-09T00:05:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.609+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d80feeb0 con 0x7f14d80f7990 2024-05-09T00:05:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.609+0000 7f14d4ff9700 1 -- 172.21.15.26:0/2434678337 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f14cc014b10 con 0x7f14d80f7990 2024-05-09T00:05:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.610+0000 7f14d4ff9700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f14c00611d0 0x7f14c0063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.610+0000 7f14d77fe700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f14c00611d0 0x7f14c0063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.610+0000 7f14d4ff9700 1 -- 172.21.15.26:0/2434678337 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f14cc07c540 con 0x7f14d80f7990 2024-05-09T00:05:28.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.611+0000 7f14d77fe700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f14c00611d0 0x7f14c0063690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f14c80047c0 tx=0x7f14c8009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:28.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.615+0000 7f14d4ff9700 1 -- 172.21.15.26:0/2434678337 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f14cc050490 con 0x7f14d80f7990 2024-05-09T00:05:28.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.860+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14d810e3b0 con 0x7f14c00611d0 2024-05-09T00:05:28.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.869+0000 7f14d4ff9700 1 -- 172.21.15.26:0/2434678337 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3344 (secure 0 0 0) 0x7f14d810e3b0 con 0x7f14c00611d0 2024-05-09T00:05:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:05:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (4m) 30s ago 6m 23.7M - 0.23.0 ba2b418f427c e4c5eae7b44c 2024-05-09T00:05:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (6m) 30s ago 6m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:05:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (5m) 36s ago 5m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:05:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (4m) 30s ago 5m 56.8M - 8.3.5 dad864ee21e9 0d0dbb754a90 2024-05-09T00:05:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (47s) 30s ago 47s 11.9M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:05:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (54s) 30s ago 53s 14.6M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:05:28.863 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (45s) 36s ago 44s 11.7M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (51s) 36s ago 50s 11.5M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:9283 running (7m) 30s ago 7m 433M - 16.2.15-1-g8963e9de 727f386679cb 405cee21e657 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (5m) 36s ago 5m 387M - 16.2.15-1-g8963e9de 727f386679cb b1280065c59a 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (7m) 30s ago 7m 61.1M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (5m) 36s ago 5m 60.9M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (5m) 30s ago 5m 24.9M - 1.3.1 1dbe0e931976 eb62f1a664c9 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (5m) 36s ago 5m 25.8M - 1.3.1 1dbe0e931976 0ef67083c290 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (4m) 30s ago 4m 39.5M 4642M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (4m) 30s ago 4m 42.7M 4642M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (3m) 30s ago 3m 39.1M 4642M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (3m) 36s ago 3m 41.1M 4982M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (2m) 36s ago 2m 39.7M 4982M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (2m) 36s ago 2m 39.4M 4982M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:05:28.864 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (5m) 36s ago 5m 60.6M - 2.33.4 514e6a882f6e dbc569e4b23d 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f14c00611d0 msgr2=0x7f14c0063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f14c00611d0 0x7f14c0063690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f14c80047c0 tx=0x7f14c8009cb0).stop 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f7990 msgr2=0x7f14d8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f7990 0x7f14d8108570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f14cc00e8f0 tx=0x7f14cc00b040).stop 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 shutdown_connections 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f14c00611d0 0x7f14c0063690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14d80f66f0 0x7f14d8108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 --2- 172.21.15.26:0/2434678337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14d80f7990 0x7f14d8108570 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 >> 172.21.15.26:0/2434678337 conn(0x7f14d80f1e50 msgr2=0x7f14d8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:28.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 shutdown_connections 2024-05-09T00:05:28.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.871+0000 7f14de1ad700 1 -- 172.21.15.26:0/2434678337 wait complete. 2024-05-09T00:05:28.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:27.988300+0000 mgr.smithi026.brymfp (mgr.14194) 234 : audit [DBG] from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:28.895 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:27.988300+0000 mgr.smithi026.brymfp (mgr.14194) 234 : audit [DBG] from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.998+0000 7fa9f2b95700 1 -- 172.21.15.26:0/781236826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 msgr2=0x7fa9ec0fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.998+0000 7fa9f2b95700 1 --2- 172.21.15.26:0/781236826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 0x7fa9ec0fa430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa9dc009b60 tx=0x7fa9dc004d10).stop 2024-05-09T00:05:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.998+0000 7fa9f2b95700 1 -- 172.21.15.26:0/781236826 shutdown_connections 2024-05-09T00:05:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.998+0000 7fa9f2b95700 1 --2- 172.21.15.26:0/781236826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ec0fa9b0 0x7fa9ec0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.998+0000 7fa9f2b95700 1 --2- 172.21.15.26:0/781236826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 0x7fa9ec0fa430 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.998+0000 7fa9f2b95700 1 -- 172.21.15.26:0/781236826 >> 172.21.15.26:0/781236826 conn(0x7fa9ec0f1e50 msgr2=0x7fa9ec0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:28.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.999+0000 7fa9f2b95700 1 -- 172.21.15.26:0/781236826 shutdown_connections 2024-05-09T00:05:28.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.999+0000 7fa9f2b95700 1 -- 172.21.15.26:0/781236826 wait complete. 2024-05-09T00:05:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.999+0000 7fa9f2b95700 1 Processor -- start 2024-05-09T00:05:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.999+0000 7fa9f2b95700 1 -- start start 2024-05-09T00:05:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.999+0000 7fa9f2b95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 0x7fa9ec0f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.999+0000 7fa9f2b95700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ec0fa9b0 0x7fa9ec0f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.999+0000 7fa9f2b95700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0f8280 con 0x7fa9ec061220 2024-05-09T00:05:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:28.999+0000 7fa9f2b95700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0f6820 con 0x7fa9ec0fa9b0 2024-05-09T00:05:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.000+0000 7fa9ebfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ec0fa9b0 0x7fa9ec0f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.000+0000 7fa9ebfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ec0fa9b0 0x7fa9ec0f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:53664/0 (socket says 172.21.15.26:53664) 2024-05-09T00:05:28.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.000+0000 7fa9ebfff700 1 -- 172.21.15.26:0/138087261 learned_addr learned my addr 172.21.15.26:0/138087261 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:28.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.000+0000 7fa9f0931700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 0x7fa9ec0f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.000+0000 7fa9f0931700 1 -- 172.21.15.26:0/138087261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ec0fa9b0 msgr2=0x7fa9ec0f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:28.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.000+0000 7fa9f0931700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ec0fa9b0 0x7fa9ec0f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:28.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.000+0000 7fa9f0931700 1 -- 172.21.15.26:0/138087261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0097c0 con 0x7fa9ec061220 2024-05-09T00:05:28.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.001+0000 7fa9f0931700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 0x7fa9ec0f7cd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fa9dc003380 tx=0x7fa9dc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:28.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.001+0000 7fa9e9ffb700 1 -- 172.21.15.26:0/138087261 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9dc00e070 con 0x7fa9ec061220 2024-05-09T00:05:28.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.001+0000 7fa9e9ffb700 1 -- 172.21.15.26:0/138087261 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9dc01e8d0 con 0x7fa9ec061220 2024-05-09T00:05:28.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.001+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec0f6a40 con 0x7fa9ec061220 2024-05-09T00:05:28.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.001+0000 7fa9e9ffb700 1 -- 172.21.15.26:0/138087261 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9dc019070 con 0x7fa9ec061220 2024-05-09T00:05:28.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.001+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec0f6fa0 con 0x7fa9ec061220 2024-05-09T00:05:28.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.003+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec0fffe0 con 0x7fa9ec061220 2024-05-09T00:05:28.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.004+0000 7fa9e9ffb700 1 -- 172.21.15.26:0/138087261 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fa9dc01ea40 con 0x7fa9ec061220 2024-05-09T00:05:28.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.004+0000 7fa9e9ffb700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa9d4061180 0x7fa9d4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.004+0000 7fa9e9ffb700 1 -- 172.21.15.26:0/138087261 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fa9dc07dd10 con 0x7fa9ec061220 2024-05-09T00:05:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.005+0000 7fa9ebfff700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa9d4061180 0x7fa9d4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:28.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.005+0000 7fa9ebfff700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa9d4061180 0x7fa9d4063640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fa9e0004d40 tx=0x7fa9e0009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:29.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.012+0000 7fa9e9ffb700 1 -- 172.21.15.26:0/138087261 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa9dc051ca0 con 0x7fa9ec061220 2024-05-09T00:05:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.387+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa9ec102010 con 0x7fa9ec061220 2024-05-09T00:05:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.388+0000 7fa9e9ffb700 1 -- 172.21.15.26:0/138087261 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fa9dc051890 con 0x7fa9ec061220 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:05:29.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:05:29.383 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:05:29.383 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:05:29.383 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 14 2024-05-09T00:05:29.383 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:05:29.383 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:05:29.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.390+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa9d4061180 msgr2=0x7fa9d4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.390+0000 7fa9f2b95700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa9d4061180 0x7fa9d4063640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fa9e0004d40 tx=0x7fa9e0009040).stop 2024-05-09T00:05:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.390+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 msgr2=0x7fa9ec0f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.390+0000 7fa9f2b95700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 0x7fa9ec0f7cd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fa9dc003380 tx=0x7fa9dc004d10).stop 2024-05-09T00:05:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.391+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 shutdown_connections 2024-05-09T00:05:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.391+0000 7fa9f2b95700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fa9d4061180 0x7fa9d4063640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.391+0000 7fa9f2b95700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9ec061220 0x7fa9ec0f7cd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.391+0000 7fa9f2b95700 1 --2- 172.21.15.26:0/138087261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ec0fa9b0 0x7fa9ec0f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.391+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 >> 172.21.15.26:0/138087261 conn(0x7fa9ec0f1e50 msgr2=0x7fa9ec0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.393+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 shutdown_connections 2024-05-09T00:05:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.393+0000 7fa9f2b95700 1 -- 172.21.15.26:0/138087261 wait complete. 2024-05-09T00:05:29.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.506+0000 7fb0dc146700 1 -- 172.21.15.26:0/526683728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 msgr2=0x7fb0d40f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:29.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.506+0000 7fb0dc146700 1 --2- 172.21.15.26:0/526683728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 0x7fb0d40f7df0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb0d00047f0 tx=0x7fb0d0009cb0).stop 2024-05-09T00:05:29.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.506+0000 7fb0dc146700 1 -- 172.21.15.26:0/526683728 shutdown_connections 2024-05-09T00:05:29.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.506+0000 7fb0dc146700 1 --2- 172.21.15.26:0/526683728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 0x7fb0d40f7df0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.506+0000 7fb0dc146700 1 --2- 172.21.15.26:0/526683728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40f66f0 0x7fb0d40f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.506+0000 7fb0dc146700 1 -- 172.21.15.26:0/526683728 >> 172.21.15.26:0/526683728 conn(0x7fb0d40f1e50 msgr2=0x7fb0d40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.507+0000 7fb0dc146700 1 -- 172.21.15.26:0/526683728 shutdown_connections 2024-05-09T00:05:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.507+0000 7fb0dc146700 1 -- 172.21.15.26:0/526683728 wait complete. 2024-05-09T00:05:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0dc146700 1 Processor -- start 2024-05-09T00:05:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0dc146700 1 -- start start 2024-05-09T00:05:29.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0dc146700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40f66f0 0x7fb0d4106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0dc146700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 0x7fb0d41073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0dc146700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4107960 con 0x7fb0d40f7990 2024-05-09T00:05:29.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0dc146700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4107aa0 con 0x7fb0d40f66f0 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0d9ee2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40f66f0 0x7fb0d4106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0d96e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 0x7fb0d41073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0d9ee2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40f66f0 0x7fb0d4106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:53676/0 (socket says 172.21.15.26:53676) 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0d96e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 0x7fb0d41073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39624/0 (socket says 172.21.15.26:39624) 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.508+0000 7fb0d9ee2700 1 -- 172.21.15.26:0/198999087 learned_addr learned my addr 172.21.15.26:0/198999087 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0d96e1700 1 -- 172.21.15.26:0/198999087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40f66f0 msgr2=0x7fb0d4106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0d96e1700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40f66f0 0x7fb0d4106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0d96e1700 1 -- 172.21.15.26:0/198999087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0005040 con 0x7fb0d40f7990 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0d96e1700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 0x7fb0d41073b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb0d0013560 tx=0x7fb0d0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0c6ffd700 1 -- 172.21.15.26:0/198999087 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d0018070 con 0x7fb0d40f7990 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0c6ffd700 1 -- 172.21.15.26:0/198999087 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0d0007e90 con 0x7fb0d40f7990 2024-05-09T00:05:29.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d4060590 con 0x7fb0d40f7990 2024-05-09T00:05:29.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0c6ffd700 1 -- 172.21.15.26:0/198999087 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d0012620 con 0x7fb0d40f7990 2024-05-09T00:05:29.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.509+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d4060b50 con 0x7fb0d40f7990 2024-05-09T00:05:29.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.510+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d40feed0 con 0x7fb0d40f7990 2024-05-09T00:05:29.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.511+0000 7fb0c6ffd700 1 -- 172.21.15.26:0/198999087 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fb0d001d420 con 0x7fb0d40f7990 2024-05-09T00:05:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.511+0000 7fb0c6ffd700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb0c0061180 0x7fb0c0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.511+0000 7fb0c6ffd700 1 -- 172.21.15.26:0/198999087 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fb0d007d6e0 con 0x7fb0d40f7990 2024-05-09T00:05:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.511+0000 7fb0d9ee2700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb0c0061180 0x7fb0c0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:29.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.512+0000 7fb0d9ee2700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb0c0061180 0x7fb0c0063640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb0cc0134f0 tx=0x7fb0cc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:29.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.516+0000 7fb0c6ffd700 1 -- 172.21.15.26:0/198999087 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb0d0051670 con 0x7fb0d40f7990 2024-05-09T00:05:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.861+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb0d4100d00 con 0x7fb0d40f7990 2024-05-09T00:05:29.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.862+0000 7fb0c6ffd700 1 -- 172.21.15.26:0/198999087 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7fb0d007d070 con 0x7fb0d40f7990 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:05:29.856 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:05:29.857 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:05:29.858 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:05:29.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb0c0061180 msgr2=0x7fb0c0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:29.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb0c0061180 0x7fb0c0063640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb0cc0134f0 tx=0x7fb0cc00b040).stop 2024-05-09T00:05:29.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 msgr2=0x7fb0d41073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:29.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 0x7fb0d41073b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb0d0013560 tx=0x7fb0d0009cb0).stop 2024-05-09T00:05:29.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 shutdown_connections 2024-05-09T00:05:29.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb0c0061180 0x7fb0c0063640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0d40f66f0 0x7fb0d4106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 --2- 172.21.15.26:0/198999087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0d40f7990 0x7fb0d41073b0 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0x7fb0d0013560 tx=0x7fb0d0009cb0).stop 2024-05-09T00:05:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 >> 172.21.15.26:0/198999087 conn(0x7fb0d40f1e50 msgr2=0x7fb0d40fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 shutdown_connections 2024-05-09T00:05:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:29.864+0000 7fb0dc146700 1 -- 172.21.15.26:0/198999087 wait complete. 2024-05-09T00:05:29.860 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:05:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:28.462170+0000 mgr.smithi026.brymfp (mgr.14194) 235 : audit [DBG] from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:28.569134+0000 mgr.smithi026.brymfp (mgr.14194) 236 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:05:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:28.861129+0000 mgr.smithi026.brymfp (mgr.14194) 237 : audit [DBG] from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:29.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:29.388632+0000 mon.smithi026 (mon.0) 601 : audit [DBG] from='client.? 172.21.15.26:0/138087261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:05:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:28.462170+0000 mgr.smithi026.brymfp (mgr.14194) 235 : audit [DBG] from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:28.569134+0000 mgr.smithi026.brymfp (mgr.14194) 236 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:05:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:28.861129+0000 mgr.smithi026.brymfp (mgr.14194) 237 : audit [DBG] from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:29.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:29.388632+0000 mon.smithi026 (mon.0) 601 : audit [DBG] from='client.? 172.21.15.26:0/138087261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:05:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.001+0000 7fd0595ce700 1 -- 172.21.15.26:0/295888225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 msgr2=0x7fd0540f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.001+0000 7fd0595ce700 1 --2- 172.21.15.26:0/295888225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 0x7fd0540f7e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fd0480047f0 tx=0x7fd048009cb0).stop 2024-05-09T00:05:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.001+0000 7fd0595ce700 1 -- 172.21.15.26:0/295888225 shutdown_connections 2024-05-09T00:05:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.001+0000 7fd0595ce700 1 --2- 172.21.15.26:0/295888225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 0x7fd0540f7e10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.001+0000 7fd0595ce700 1 --2- 172.21.15.26:0/295888225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0540f6710 0x7fd0540f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.001+0000 7fd0595ce700 1 -- 172.21.15.26:0/295888225 >> 172.21.15.26:0/295888225 conn(0x7fd0540f1e70 msgr2=0x7fd0540f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:29.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.001+0000 7fd0595ce700 1 -- 172.21.15.26:0/295888225 shutdown_connections 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.001+0000 7fd0595ce700 1 -- 172.21.15.26:0/295888225 wait complete. 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.002+0000 7fd0595ce700 1 Processor -- start 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.002+0000 7fd0595ce700 1 -- start start 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.003+0000 7fd0595ce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0540f6710 0x7fd054105da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.003+0000 7fd0595ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 0x7fd054106290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.003+0000 7fd0595ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054106840 con 0x7fd0540f79b0 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.003+0000 7fd0595ce700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054106980 con 0x7fd0540f6710 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.003+0000 7fd0527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 0x7fd054106290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.003+0000 7fd0527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 0x7fd054106290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39646/0 (socket says 172.21.15.26:39646) 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.003+0000 7fd0527fc700 1 -- 172.21.15.26:0/3880105404 learned_addr learned my addr 172.21.15.26:0/3880105404 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.003+0000 7fd052ffd700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0540f6710 0x7fd054105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd052ffd700 1 -- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 msgr2=0x7fd054106290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd052ffd700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 0x7fd054106290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd052ffd700 1 -- 172.21.15.26:0/3880105404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048005040 con 0x7fd0540f6710 2024-05-09T00:05:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd052ffd700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0540f6710 0x7fd054105da0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd0440026d0 tx=0x7fd044009e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd03bfff700 1 -- 172.21.15.26:0/3880105404 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd044007b40 con 0x7fd0540f6710 2024-05-09T00:05:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd03bfff700 1 -- 172.21.15.26:0/3880105404 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd04400f040 con 0x7fd0540f6710 2024-05-09T00:05:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd03bfff700 1 -- 172.21.15.26:0/3880105404 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd044013690 con 0x7fd0540f6710 2024-05-09T00:05:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05410b420 con 0x7fd0540f6710 2024-05-09T00:05:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.004+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05410b9e0 con 0x7fd0540f6710 2024-05-09T00:05:30.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.006+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05410d2a0 con 0x7fd0540f6710 2024-05-09T00:05:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.006+0000 7fd03bfff700 1 -- 172.21.15.26:0/3880105404 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fd0440090d0 con 0x7fd0540f6710 2024-05-09T00:05:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.006+0000 7fd03bfff700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fd03c061180 0x7fd03c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.006+0000 7fd03bfff700 1 -- 172.21.15.26:0/3880105404 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fd04407c260 con 0x7fd0540f6710 2024-05-09T00:05:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.006+0000 7fd0527fc700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fd03c061180 0x7fd03c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:30.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.007+0000 7fd0527fc700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fd03c061180 0x7fd03c063640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd048004f10 tx=0x7fd04800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:30.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.011+0000 7fd03bfff700 1 -- 172.21.15.26:0/3880105404 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd0440501f0 con 0x7fd0540f6710 2024-05-09T00:05:30.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.299+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd05410b5b0 con 0x7fd03c061180 2024-05-09T00:05:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.300+0000 7fd03bfff700 1 -- 172.21.15.26:0/3880105404 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd05410b5b0 con 0x7fd03c061180 2024-05-09T00:05:30.293 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:05:30.294 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-09T00:05:30.294 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:05:30.294 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:05:30.294 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [], 2024-05-09T00:05:30.294 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "", 2024-05-09T00:05:30.294 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 image", 2024-05-09T00:05:30.294 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:05:30.294 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:05:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.302+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fd03c061180 msgr2=0x7fd03c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:30.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.302+0000 7fd0595ce700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fd03c061180 0x7fd03c063640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd048004f10 tx=0x7fd04800b040).stop 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0540f6710 msgr2=0x7fd054105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0540f6710 0x7fd054105da0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd0440026d0 tx=0x7fd044009e40).stop 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 shutdown_connections 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fd03c061180 0x7fd03c063640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0540f6710 0x7fd054105da0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 --2- 172.21.15.26:0/3880105404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0540f79b0 0x7fd054106290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 >> 172.21.15.26:0/3880105404 conn(0x7fd0540f1e70 msgr2=0x7fd0540fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 shutdown_connections 2024-05-09T00:05:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.303+0000 7fd0595ce700 1 -- 172.21.15.26:0/3880105404 wait complete. 2024-05-09T00:05:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.428+0000 7f8b04dcb700 1 -- 172.21.15.26:0/244323840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f7070 msgr2=0x7f8b000f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.428+0000 7f8b04dcb700 1 --2- 172.21.15.26:0/244323840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f7070 0x7f8b000f74f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8af40048f0 tx=0x7f8af400adc0).stop 2024-05-09T00:05:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.428+0000 7f8b04dcb700 1 -- 172.21.15.26:0/244323840 shutdown_connections 2024-05-09T00:05:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.428+0000 7f8b04dcb700 1 --2- 172.21.15.26:0/244323840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f7070 0x7f8b000f74f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.428+0000 7f8b04dcb700 1 --2- 172.21.15.26:0/244323840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f5e70 0x7f8b000f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.428+0000 7f8b04dcb700 1 -- 172.21.15.26:0/244323840 >> 172.21.15.26:0/244323840 conn(0x7f8b000f15d0 msgr2=0x7f8b000f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.428+0000 7f8b04dcb700 1 -- 172.21.15.26:0/244323840 shutdown_connections 2024-05-09T00:05:30.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.428+0000 7f8b04dcb700 1 -- 172.21.15.26:0/244323840 wait complete. 2024-05-09T00:05:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8b04dcb700 1 Processor -- start 2024-05-09T00:05:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8b04dcb700 1 -- start start 2024-05-09T00:05:30.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8b04dcb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f5e70 0x7f8b00107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8b04dcb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7070 0x7f8b00108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8b04dcb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00108a00 con 0x7f8b000f5e70 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8b04dcb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00108b40 con 0x7f8b000f7070 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8afe59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f5e70 0x7f8b00107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8afe59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f5e70 0x7f8b00107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39664/0 (socket says 172.21.15.26:39664) 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8afe59c700 1 -- 172.21.15.26:0/2812120850 learned_addr learned my addr 172.21.15.26:0/2812120850 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.429+0000 7f8afdd9b700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7070 0x7f8b00108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8afe59c700 1 -- 172.21.15.26:0/2812120850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7070 msgr2=0x7f8b00108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8afe59c700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7070 0x7f8b00108450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8afe59c700 1 -- 172.21.15.26:0/2812120850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af4005040 con 0x7f8b000f5e70 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8afdd9b700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7070 0x7f8b00108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:05:30.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8afe59c700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f5e70 0x7f8b00107f60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8af0002770 tx=0x7f8af0002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8aef7fe700 1 -- 172.21.15.26:0/2812120850 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8af0007b40 con 0x7f8b000f5e70 2024-05-09T00:05:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0010d5e0 con 0x7f8b000f5e70 2024-05-09T00:05:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8aef7fe700 1 -- 172.21.15.26:0/2812120850 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8af000f040 con 0x7f8b000f5e70 2024-05-09T00:05:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8aef7fe700 1 -- 172.21.15.26:0/2812120850 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8af0014820 con 0x7f8b000f5e70 2024-05-09T00:05:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.430+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0010dba0 con 0x7f8b000f5e70 2024-05-09T00:05:30.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.431+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b000fddb0 con 0x7f8b000f5e70 2024-05-09T00:05:30.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.433+0000 7f8aef7fe700 1 -- 172.21.15.26:0/2812120850 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f8af0007ca0 con 0x7f8b000f5e70 2024-05-09T00:05:30.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.433+0000 7f8aef7fe700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8ae80611d0 0x7f8ae8063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:05:30.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.434+0000 7f8aef7fe700 1 -- 172.21.15.26:0/2812120850 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f8af007c8a0 con 0x7f8b000f5e70 2024-05-09T00:05:30.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.434+0000 7f8afdd9b700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8ae80611d0 0x7f8ae8063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:05:30.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.434+0000 7f8afdd9b700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8ae80611d0 0x7f8ae8063690 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8af400c3b0 tx=0x7f8af400adc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:30.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.438+0000 7f8aef7fe700 1 -- 172.21.15.26:0/2812120850 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8af00507f0 con 0x7f8b000f5e70 2024-05-09T00:05:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.779+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8b0010e2a0 con 0x7f8b000f5e70 2024-05-09T00:05:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.780+0000 7f8aef7fe700 1 -- 172.21.15.26:0/2812120850 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f8af00503e0 con 0x7f8b000f5e70 2024-05-09T00:05:30.773 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:05:30.774 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:05:30.774 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:05:30.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8ae80611d0 msgr2=0x7f8ae8063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8ae80611d0 0x7f8ae8063690 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8af400c3b0 tx=0x7f8af400adc0).stop 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f5e70 msgr2=0x7f8b00107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f5e70 0x7f8b00107f60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8af0002770 tx=0x7f8af0002a80).stop 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 shutdown_connections 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f8ae80611d0 0x7f8ae8063690 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f5e70 0x7f8b00107f60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 --2- 172.21.15.26:0/2812120850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7070 0x7f8b00108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 >> 172.21.15.26:0/2812120850 conn(0x7f8b000f15d0 msgr2=0x7f8b000fad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 shutdown_connections 2024-05-09T00:05:30.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:05:30.782+0000 7f8b04dcb700 1 -- 172.21.15.26:0/2812120850 wait complete. 2024-05-09T00:05:30.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:29.862471+0000 mon.smithi026 (mon.0) 602 : audit [DBG] from='client.? 172.21.15.26:0/198999087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:05:30.895 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:29.862471+0000 mon.smithi026 (mon.0) 602 : audit [DBG] from='client.? 172.21.15.26:0/198999087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:05:31.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:30.300445+0000 mgr.smithi026.brymfp (mgr.14194) 238 : audit [DBG] from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:31.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:30.569568+0000 mgr.smithi026.brymfp (mgr.14194) 239 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:05:31.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:30.780574+0000 mon.smithi026 (mon.0) 603 : audit [DBG] from='client.? 172.21.15.26:0/2812120850' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:05:31.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:30.300445+0000 mgr.smithi026.brymfp (mgr.14194) 238 : audit [DBG] from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:05:31.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:30.569568+0000 mgr.smithi026.brymfp (mgr.14194) 239 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:05:31.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:30.780574+0000 mon.smithi026 (mon.0) 603 : audit [DBG] from='client.? 172.21.15.26:0/2812120850' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:05:33.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:32.569901+0000 mgr.smithi026.brymfp (mgr.14194) 240 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:33.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:32.569901+0000 mgr.smithi026.brymfp (mgr.14194) 240 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:35.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:34.570328+0000 mgr.smithi026.brymfp (mgr.14194) 241 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:35.895 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:34.570328+0000 mgr.smithi026.brymfp (mgr.14194) 241 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:37.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:36.570654+0000 mgr.smithi026.brymfp (mgr.14194) 242 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:37.895 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:36.570654+0000 mgr.smithi026.brymfp (mgr.14194) 242 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:39.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:38.571166+0000 mgr.smithi026.brymfp (mgr.14194) 243 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:39.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:38.571166+0000 mgr.smithi026.brymfp (mgr.14194) 243 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:41.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:40.571750+0000 mgr.smithi026.brymfp (mgr.14194) 244 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:41.895 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:40.571750+0000 mgr.smithi026.brymfp (mgr.14194) 244 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:43.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:42.572076+0000 mgr.smithi026.brymfp (mgr.14194) 245 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:43.895 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:42.572076+0000 mgr.smithi026.brymfp (mgr.14194) 245 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:45.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:44.572465+0000 mgr.smithi026.brymfp (mgr.14194) 246 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:45.895 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:44.572465+0000 mgr.smithi026.brymfp (mgr.14194) 246 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:47.893 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:46.572831+0000 mgr.smithi026.brymfp (mgr.14194) 247 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:47.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:46.572831+0000 mgr.smithi026.brymfp (mgr.14194) 247 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 7.7 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:05:49.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:48.573291+0000 mgr.smithi026.brymfp (mgr.14194) 248 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-09T00:05:49.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:48.573291+0000 mgr.smithi026.brymfp (mgr.14194) 248 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-05-09T00:05:51.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:50.573725+0000 mgr.smithi026.brymfp (mgr.14194) 249 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T00:05:51.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:50.573725+0000 mgr.smithi026.brymfp (mgr.14194) 249 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T00:05:53.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:51.940150+0000 mon.smithi026 (mon.0) 604 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:05:51.940482+0000 mgr.smithi026.brymfp (mgr.14194) 250 : cephadm [INF] Upgrade: Target is version 18.2.2-1322-gd21e4f96 (unknown) 2024-05-09T00:05:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:05:51.940557+0000 mgr.smithi026.brymfp (mgr.14194) 251 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985, digests ['quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985'] 2024-05-09T00:05:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:51.941298+0000 mon.smithi026 (mon.0) 605 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:05:51.945863+0000 mon.smithi026 (mon.0) 606 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:05:51.946588+0000 mgr.smithi026.brymfp (mgr.14194) 252 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi026.brymfp) 2024-05-09T00:05:53.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:51.940150+0000 mon.smithi026 (mon.0) 604 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:53.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:05:51.940482+0000 mgr.smithi026.brymfp (mgr.14194) 250 : cephadm [INF] Upgrade: Target is version 18.2.2-1322-gd21e4f96 (unknown) 2024-05-09T00:05:53.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:05:51.940557+0000 mgr.smithi026.brymfp (mgr.14194) 251 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985, digests ['quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985'] 2024-05-09T00:05:53.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:51.941298+0000 mon.smithi026 (mon.0) 605 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:53.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:05:51.945863+0000 mon.smithi026 (mon.0) 606 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:05:53.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:05:51.946588+0000 mgr.smithi026.brymfp (mgr.14194) 252 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi026.brymfp) 2024-05-09T00:05:54.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:05:52.186794+0000 mgr.smithi026.brymfp (mgr.14194) 253 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985 on smithi135 2024-05-09T00:05:54.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:52.574293+0000 mgr.smithi026.brymfp (mgr.14194) 254 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T00:05:54.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:05:52.186794+0000 mgr.smithi026.brymfp (mgr.14194) 253 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985 on smithi135 2024-05-09T00:05:54.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:52.574293+0000 mgr.smithi026.brymfp (mgr.14194) 254 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T00:05:56.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:54.574786+0000 mgr.smithi026.brymfp (mgr.14194) 255 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:56.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:54.574786+0000 mgr.smithi026.brymfp (mgr.14194) 255 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:58.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:56.575147+0000 mgr.smithi026.brymfp (mgr.14194) 256 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:05:58.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:56.575147+0000 mgr.smithi026.brymfp (mgr.14194) 256 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:06:00.223 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:05:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:05:58.575545+0000 mgr.smithi026.brymfp (mgr.14194) 257 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:06:00.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:05:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:05:58.575545+0000 mgr.smithi026.brymfp (mgr.14194) 257 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T00:06:00.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.890+0000 7fb19beed700 1 -- 172.21.15.26:0/2900728483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1940fa950 msgr2=0x7fb1940fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.890+0000 7fb19beed700 1 --2- 172.21.15.26:0/2900728483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1940fa950 0x7fb1940fcda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fb1840047f0 tx=0x7fb184009cb0).stop 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.890+0000 7fb19beed700 1 -- 172.21.15.26:0/2900728483 shutdown_connections 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.890+0000 7fb19beed700 1 --2- 172.21.15.26:0/2900728483 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1940fa950 0x7fb1940fcda0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.890+0000 7fb19beed700 1 --2- 172.21.15.26:0/2900728483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb194061280 0x7fb1940fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.890+0000 7fb19beed700 1 -- 172.21.15.26:0/2900728483 >> 172.21.15.26:0/2900728483 conn(0x7fb1940f1e50 msgr2=0x7fb1940f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.890+0000 7fb19beed700 1 -- 172.21.15.26:0/2900728483 shutdown_connections 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.890+0000 7fb19beed700 1 -- 172.21.15.26:0/2900728483 wait complete. 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb19beed700 1 Processor -- start 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb19beed700 1 -- start start 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb19beed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb194061280 0x7fb1940f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb19beed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1940fa950 0x7fb1940f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb19beed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940f8220 con 0x7fb194061280 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb19beed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940f67c0 con 0x7fb1940fa950 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb199c89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb194061280 0x7fb1940f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:00.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb199c89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb194061280 0x7fb1940f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56790/0 (socket says 172.21.15.26:56790) 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb199c89700 1 -- 172.21.15.26:0/1044352057 learned_addr learned my addr 172.21.15.26:0/1044352057 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.891+0000 7fb199488700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1940fa950 0x7fb1940f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb199c89700 1 -- 172.21.15.26:0/1044352057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1940fa950 msgr2=0x7fb1940f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb199c89700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1940fa950 0x7fb1940f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb199c89700 1 -- 172.21.15.26:0/1044352057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184005040 con 0x7fb194061280 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb199c89700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb194061280 0x7fb1940f7c70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fb19000e910 tx=0x7fb19000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb18affd700 1 -- 172.21.15.26:0/1044352057 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb190007b40 con 0x7fb194061280 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb18affd700 1 -- 172.21.15.26:0/1044352057 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb19000f040 con 0x7fb194061280 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1940f69e0 con 0x7fb194061280 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb18affd700 1 -- 172.21.15.26:0/1044352057 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb190014920 con 0x7fb194061280 2024-05-09T00:06:00.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.892+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1940f6fa0 con 0x7fb194061280 2024-05-09T00:06:00.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.893+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1940fffd0 con 0x7fb194061280 2024-05-09T00:06:00.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.893+0000 7fb18affd700 1 -- 172.21.15.26:0/1044352057 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fb190007ca0 con 0x7fb194061280 2024-05-09T00:06:00.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.894+0000 7fb18affd700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb180061180 0x7fb180063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:00.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.894+0000 7fb18affd700 1 -- 172.21.15.26:0/1044352057 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fb19007c200 con 0x7fb194061280 2024-05-09T00:06:00.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.894+0000 7fb199488700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb180061180 0x7fb180063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:00.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.894+0000 7fb199488700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb180061180 0x7fb180063640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb1840047c0 tx=0x7fb184009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:00.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:00.899+0000 7fb18affd700 1 -- 172.21.15.26:0/1044352057 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb190049f60 con 0x7fb194061280 2024-05-09T00:06:01.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.098+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb194059120 con 0x7fb180061180 2024-05-09T00:06:01.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.099+0000 7fb18affd700 1 -- 172.21.15.26:0/1044352057 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fb194059120 con 0x7fb180061180 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb180061180 msgr2=0x7fb180063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb180061180 0x7fb180063640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb1840047c0 tx=0x7fb184009cb0).stop 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb194061280 msgr2=0x7fb1940f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb194061280 0x7fb1940f7c70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fb19000e910 tx=0x7fb19000b040).stop 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 shutdown_connections 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fb180061180 0x7fb180063640 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb194061280 0x7fb1940f7c70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 --2- 172.21.15.26:0/1044352057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1940fa950 0x7fb1940f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 >> 172.21.15.26:0/1044352057 conn(0x7fb1940f1e50 msgr2=0x7fb1940f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 shutdown_connections 2024-05-09T00:06:01.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.101+0000 7fb19beed700 1 -- 172.21.15.26:0/1044352057 wait complete. 2024-05-09T00:06:01.106 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:06:01.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.209+0000 7f1f7a9be700 1 -- 172.21.15.26:0/3904272617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 msgr2=0x7f1f740f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.209+0000 7f1f7a9be700 1 --2- 172.21.15.26:0/3904272617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 0x7f1f740f7df0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f1f680047f0 tx=0x7f1f68009cb0).stop 2024-05-09T00:06:01.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.209+0000 7f1f7a9be700 1 -- 172.21.15.26:0/3904272617 shutdown_connections 2024-05-09T00:06:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.209+0000 7f1f7a9be700 1 --2- 172.21.15.26:0/3904272617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 0x7f1f740f7df0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.209+0000 7f1f7a9be700 1 --2- 172.21.15.26:0/3904272617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f740f66f0 0x7f1f740f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.209+0000 7f1f7a9be700 1 -- 172.21.15.26:0/3904272617 >> 172.21.15.26:0/3904272617 conn(0x7f1f740f1e50 msgr2=0x7f1f740f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.209+0000 7f1f7a9be700 1 -- 172.21.15.26:0/3904272617 shutdown_connections 2024-05-09T00:06:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.209+0000 7f1f7a9be700 1 -- 172.21.15.26:0/3904272617 wait complete. 2024-05-09T00:06:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f7a9be700 1 Processor -- start 2024-05-09T00:06:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f7a9be700 1 -- start start 2024-05-09T00:06:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f7a9be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f740f66f0 0x7f1f74107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f7a9be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 0x7f1f74108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f7a9be700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f741089f0 con 0x7f1f740f7990 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f7a9be700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74108b30 con 0x7f1f740f66f0 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 0x7f1f74108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 0x7f1f74108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56808/0 (socket says 172.21.15.26:56808) 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f737fe700 1 -- 172.21.15.26:0/1322517955 learned_addr learned my addr 172.21.15.26:0/1322517955 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f73fff700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f740f66f0 0x7f1f74107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f737fe700 1 -- 172.21.15.26:0/1322517955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f740f66f0 msgr2=0x7f1f74107f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f737fe700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f740f66f0 0x7f1f74107f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.210+0000 7f1f737fe700 1 -- 172.21.15.26:0/1322517955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f68005040 con 0x7f1f740f7990 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.211+0000 7f1f737fe700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 0x7f1f74108440 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f1f6800b120 tx=0x7f1f68009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.211+0000 7f1f717fa700 1 -- 172.21.15.26:0/1322517955 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f6800e030 con 0x7f1f740f7990 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.211+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7410d570 con 0x7f1f740f7990 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.211+0000 7f1f717fa700 1 -- 172.21.15.26:0/1322517955 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f68007e90 con 0x7f1f740f7990 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.211+0000 7f1f717fa700 1 -- 172.21.15.26:0/1322517955 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f68018070 con 0x7f1f740f7990 2024-05-09T00:06:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.211+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7410db30 con 0x7f1f740f7990 2024-05-09T00:06:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.212+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f740feeb0 con 0x7f1f740f7990 2024-05-09T00:06:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.212+0000 7f1f717fa700 1 -- 172.21.15.26:0/1322517955 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f1f6801d960 con 0x7f1f740f7990 2024-05-09T00:06:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.213+0000 7f1f717fa700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1f5c061180 0x7f1f5c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.213+0000 7f1f717fa700 1 -- 172.21.15.26:0/1322517955 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f1f6807deb0 con 0x7f1f740f7990 2024-05-09T00:06:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.213+0000 7f1f73fff700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1f5c061180 0x7f1f5c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.213+0000 7f1f73fff700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1f5c061180 0x7f1f5c063640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f1f740f77f0 tx=0x7f1f64009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.217+0000 7f1f717fa700 1 -- 172.21.15.26:0/1322517955 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1f68051e40 con 0x7f1f740f7990 2024-05-09T00:06:01.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.403+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f7410e170 con 0x7f1f5c061180 2024-05-09T00:06:01.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.405+0000 7f1f717fa700 1 -- 172.21.15.26:0/1322517955 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f1f7410e170 con 0x7f1f5c061180 2024-05-09T00:06:01.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1f5c061180 msgr2=0x7f1f5c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1f5c061180 0x7f1f5c063640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f1f740f77f0 tx=0x7f1f64009040).stop 2024-05-09T00:06:01.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 msgr2=0x7f1f74108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 0x7f1f74108440 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f1f6800b120 tx=0x7f1f68009cb0).stop 2024-05-09T00:06:01.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 shutdown_connections 2024-05-09T00:06:01.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f1f5c061180 0x7f1f5c063640 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f740f66f0 0x7f1f74107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 --2- 172.21.15.26:0/1322517955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f740f7990 0x7f1f74108440 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.406+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 >> 172.21.15.26:0/1322517955 conn(0x7f1f740f1e50 msgr2=0x7f1f74060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:01.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.407+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 shutdown_connections 2024-05-09T00:06:01.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.407+0000 7f1f7a9be700 1 -- 172.21.15.26:0/1322517955 wait complete. 2024-05-09T00:06:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 -- 172.21.15.26:0/472112279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 msgr2=0x7f6e4c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 --2- 172.21.15.26:0/472112279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 0x7f6e4c0f9110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f6e3c0047f0 tx=0x7f6e3c009cb0).stop 2024-05-09T00:06:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 -- 172.21.15.26:0/472112279 shutdown_connections 2024-05-09T00:06:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 --2- 172.21.15.26:0/472112279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 0x7f6e4c0f9110 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 --2- 172.21.15.26:0/472112279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c0f7a10 0x7f6e4c0f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 -- 172.21.15.26:0/472112279 >> 172.21.15.26:0/472112279 conn(0x7f6e4c0f3150 msgr2=0x7f6e4c0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 -- 172.21.15.26:0/472112279 shutdown_connections 2024-05-09T00:06:01.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 -- 172.21.15.26:0/472112279 wait complete. 2024-05-09T00:06:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 Processor -- start 2024-05-09T00:06:01.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.518+0000 7f6e54771700 1 -- start start 2024-05-09T00:06:01.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e54771700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c0f7a10 0x7f6e4c1081b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e54771700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 0x7f6e4c1086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e54771700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c108c50 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e54771700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c108d90 con 0x7f6e4c0f7a10 2024-05-09T00:06:01.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e51d0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 0x7f6e4c1086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e51d0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 0x7f6e4c1086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38588/0 (socket says 172.21.15.26:38588) 2024-05-09T00:06:01.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e51d0c700 1 -- 172.21.15.26:0/2077383537 learned_addr learned my addr 172.21.15.26:0/2077383537 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:01.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e5250d700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c0f7a10 0x7f6e4c1081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e51d0c700 1 -- 172.21.15.26:0/2077383537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c0f7a10 msgr2=0x7f6e4c1081b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e51d0c700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c0f7a10 0x7f6e4c1081b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e51d0c700 1 -- 172.21.15.26:0/2077383537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c005040 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e51d0c700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 0x7f6e4c1086a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6e3c013620 tx=0x7f6e3c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e437fe700 1 -- 172.21.15.26:0/2077383537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3c00e070 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e437fe700 1 -- 172.21.15.26:0/2077383537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e3c007e90 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c10d7d0 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.519+0000 7f6e437fe700 1 -- 172.21.15.26:0/2077383537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3c018070 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.520+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c10dd90 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.521+0000 7f6e437fe700 1 -- 172.21.15.26:0/2077383537 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f6e3c01d420 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.521+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c05fb50 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.521+0000 7f6e437fe700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e38061180 0x7f6e38063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.521+0000 7f6e437fe700 1 -- 172.21.15.26:0/2077383537 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f6e3c081170 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.521+0000 7f6e5250d700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e38061180 0x7f6e38063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.522+0000 7f6e5250d700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e38061180 0x7f6e38063640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f6e4c0f8b10 tx=0x7f6e4800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:01.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.526+0000 7f6e437fe700 1 -- 172.21.15.26:0/2077383537 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6e3c082060 con 0x7f6e4c0f8cb0 2024-05-09T00:06:01.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.715+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e4c059120 con 0x7f6e38061180 2024-05-09T00:06:01.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.727+0000 7f6e437fe700 1 -- 172.21.15.26:0/2077383537 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3344 (secure 0 0 0) 0x7f6e4c059120 con 0x7f6e38061180 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (5m) 63s ago 6m 23.7M - 0.23.0 ba2b418f427c e4c5eae7b44c 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (6m) 63s ago 6m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (6m) 68s ago 6m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (5m) 63s ago 6m 56.8M - 8.3.5 dad864ee21e9 0d0dbb754a90 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (80s) 63s ago 80s 11.9M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (86s) 63s ago 86s 14.6M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (78s) 68s ago 77s 11.7M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (84s) 68s ago 83s 11.5M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:9283 running (8m) 63s ago 7m 433M - 16.2.15-1-g8963e9de 727f386679cb 405cee21e657 2024-05-09T00:06:01.722 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (6m) 68s ago 6m 387M - 16.2.15-1-g8963e9de 727f386679cb b1280065c59a 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (8m) 63s ago 8m 61.1M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (5m) 68s ago 5m 60.9M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (6m) 63s ago 6m 24.9M - 1.3.1 1dbe0e931976 eb62f1a664c9 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (5m) 68s ago 5m 25.8M - 1.3.1 1dbe0e931976 0ef67083c290 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 63s ago 5m 39.5M 4642M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (4m) 63s ago 4m 42.7M 4642M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (4m) 63s ago 4m 39.1M 4642M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (3m) 68s ago 3m 41.1M 4982M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (3m) 68s ago 3m 39.7M 4982M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (3m) 68s ago 2m 39.4M 4982M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:06:01.723 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (5m) 68s ago 5m 60.6M - 2.33.4 514e6a882f6e dbc569e4b23d 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e38061180 msgr2=0x7f6e38063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e38061180 0x7f6e38063640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f6e4c0f8b10 tx=0x7f6e4800b040).stop 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 msgr2=0x7f6e4c1086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 0x7f6e4c1086a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6e3c013620 tx=0x7f6e3c009cb0).stop 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 shutdown_connections 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e38061180 0x7f6e38063640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e4c0f7a10 0x7f6e4c1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 --2- 172.21.15.26:0/2077383537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e4c0f8cb0 0x7f6e4c1086a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 >> 172.21.15.26:0/2077383537 conn(0x7f6e4c0f3150 msgr2=0x7f6e4c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:01.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 shutdown_connections 2024-05-09T00:06:01.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.729+0000 7f6e54771700 1 -- 172.21.15.26:0/2077383537 wait complete. 2024-05-09T00:06:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.847+0000 7f9ea9c32700 1 -- 172.21.15.26:0/1686139884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f7800 msgr2=0x7f9ea40f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.847+0000 7f9ea9c32700 1 --2- 172.21.15.26:0/1686139884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f7800 0x7f9ea40f7c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f9e940047f0 tx=0x7f9e94009cb0).stop 2024-05-09T00:06:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.848+0000 7f9ea9c32700 1 -- 172.21.15.26:0/1686139884 shutdown_connections 2024-05-09T00:06:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.848+0000 7f9ea9c32700 1 --2- 172.21.15.26:0/1686139884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ea40f8aa0 0x7f9ea40f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.848+0000 7f9ea9c32700 1 --2- 172.21.15.26:0/1686139884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f7800 0x7f9ea40f7c20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.848+0000 7f9ea9c32700 1 -- 172.21.15.26:0/1686139884 >> 172.21.15.26:0/1686139884 conn(0x7f9ea40f2f80 msgr2=0x7f9ea40f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.848+0000 7f9ea9c32700 1 -- 172.21.15.26:0/1686139884 shutdown_connections 2024-05-09T00:06:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.848+0000 7f9ea9c32700 1 -- 172.21.15.26:0/1686139884 wait complete. 2024-05-09T00:06:01.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.848+0000 7f9ea9c32700 1 Processor -- start 2024-05-09T00:06:01.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea9c32700 1 -- start start 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea9c32700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ea40f7800 0x7f9ea4107ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea9c32700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f8aa0 0x7f9ea41083d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea9c32700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea4108980 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea9c32700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea4108ac0 con 0x7f9ea40f7800 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ea40f7800 0x7f9ea4107ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ea40f7800 0x7f9ea4107ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:45326/0 (socket says 172.21.15.26:45326) 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea37fe700 1 -- 172.21.15.26:0/3302162719 learned_addr learned my addr 172.21.15.26:0/3302162719 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.849+0000 7f9ea2ffd700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f8aa0 0x7f9ea41083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea2ffd700 1 -- 172.21.15.26:0/3302162719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ea40f7800 msgr2=0x7f9ea4107ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea2ffd700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ea40f7800 0x7f9ea4107ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea2ffd700 1 -- 172.21.15.26:0/3302162719 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94005040 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea37fe700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ea40f7800 0x7f9ea4107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea2ffd700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f8aa0 0x7f9ea41083d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f9e98002700 tx=0x7f9e98009e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea0ff9700 1 -- 172.21.15.26:0/3302162719 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e98007b40 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea410d560 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea0ff9700 1 -- 172.21.15.26:0/3302162719 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e9800f040 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea0ff9700 1 -- 172.21.15.26:0/3302162719 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e98014780 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.850+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea410db20 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.851+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea40fffc0 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.852+0000 7f9ea0ff9700 1 -- 172.21.15.26:0/3302162719 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9e98007ca0 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.853+0000 7f9ea0ff9700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9e8c061180 0x7f9e8c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.853+0000 7f9ea0ff9700 1 -- 172.21.15.26:0/3302162719 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f9e9807caa0 con 0x7f9ea40f8aa0 2024-05-09T00:06:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.853+0000 7f9ea37fe700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9e8c061180 0x7f9e8c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.853+0000 7f9ea37fe700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9e8c061180 0x7f9e8c063640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9e94004f10 tx=0x7f9e94009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:01.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:01.860+0000 7f9ea0ff9700 1 -- 172.21.15.26:0/3302162719 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9e98050ab0 con 0x7f9ea40f8aa0 2024-05-09T00:06:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.118+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ea4101e30 con 0x7f9ea40f8aa0 2024-05-09T00:06:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.118+0000 7f9ea0ff9700 1 -- 172.21.15.26:0/3302162719 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f9e980506a0 con 0x7f9ea40f8aa0 2024-05-09T00:06:02.113 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:06:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:06:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:06:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:06:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:06:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 14 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:06:02.114 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9e8c061180 msgr2=0x7f9e8c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9e8c061180 0x7f9e8c063640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9e94004f10 tx=0x7f9e94009cb0).stop 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f8aa0 msgr2=0x7f9ea41083d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f8aa0 0x7f9ea41083d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f9e98002700 tx=0x7f9e98009e40).stop 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 shutdown_connections 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9e8c061180 0x7f9e8c063640 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ea40f7800 0x7f9ea4107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 --2- 172.21.15.26:0/3302162719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ea40f8aa0 0x7f9ea41083d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 >> 172.21.15.26:0/3302162719 conn(0x7f9ea40f2f80 msgr2=0x7f9ea40fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 shutdown_connections 2024-05-09T00:06:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.120+0000 7f9ea9c32700 1 -- 172.21.15.26:0/3302162719 wait complete. 2024-05-09T00:06:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.224+0000 7f6ac387a700 1 -- 172.21.15.26:0/2774963717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f66f0 msgr2=0x7f6abc0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.224+0000 7f6ac387a700 1 --2- 172.21.15.26:0/2774963717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f66f0 0x7f6abc0f6b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f6ab80047f0 tx=0x7f6ab8009cb0).stop 2024-05-09T00:06:02.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.224+0000 7f6ac387a700 1 -- 172.21.15.26:0/2774963717 shutdown_connections 2024-05-09T00:06:02.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.224+0000 7f6ac387a700 1 --2- 172.21.15.26:0/2774963717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6abc0f7990 0x7f6abc0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.224+0000 7f6ac387a700 1 --2- 172.21.15.26:0/2774963717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f66f0 0x7f6abc0f6b10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.225+0000 7f6ac387a700 1 -- 172.21.15.26:0/2774963717 >> 172.21.15.26:0/2774963717 conn(0x7f6abc0f1e50 msgr2=0x7f6abc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:02.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.225+0000 7f6ac387a700 1 -- 172.21.15.26:0/2774963717 shutdown_connections 2024-05-09T00:06:02.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.225+0000 7f6ac387a700 1 -- 172.21.15.26:0/2774963717 wait complete. 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac387a700 1 Processor -- start 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac387a700 1 -- start start 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac387a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6abc0f66f0 0x7f6abc107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac387a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f7990 0x7f6abc108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac387a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc108a10 con 0x7f6abc0f7990 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac387a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc108b50 con 0x7f6abc0f66f0 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac0e15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f7990 0x7f6abc108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac0e15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f7990 0x7f6abc108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38628/0 (socket says 172.21.15.26:38628) 2024-05-09T00:06:02.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac0e15700 1 -- 172.21.15.26:0/772149412 learned_addr learned my addr 172.21.15.26:0/772149412 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac0e15700 1 -- 172.21.15.26:0/772149412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6abc0f66f0 msgr2=0x7f6abc107f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:06:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac0e15700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6abc0f66f0 0x7f6abc107f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:06:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.226+0000 7f6ac0e15700 1 -- 172.21.15.26:0/772149412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8005040 con 0x7f6abc0f7990 2024-05-09T00:06:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.227+0000 7f6ac0e15700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f7990 0x7f6abc108460 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f6aac002770 tx=0x7f6aac002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.227+0000 7f6ab27fc700 1 -- 172.21.15.26:0/772149412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac002d80 con 0x7f6abc0f7990 2024-05-09T00:06:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.227+0000 7f6ab27fc700 1 -- 172.21.15.26:0/772149412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6aac00f040 con 0x7f6abc0f7990 2024-05-09T00:06:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.227+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc10d5f0 con 0x7f6abc0f7990 2024-05-09T00:06:02.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.227+0000 7f6ab27fc700 1 -- 172.21.15.26:0/772149412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac00d820 con 0x7f6abc0f7990 2024-05-09T00:06:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.227+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc10db30 con 0x7f6abc0f7990 2024-05-09T00:06:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.228+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc0feeb0 con 0x7f6abc0f7990 2024-05-09T00:06:02.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.228+0000 7f6ab27fc700 1 -- 172.21.15.26:0/772149412 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f6aac009110 con 0x7f6abc0f7990 2024-05-09T00:06:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.229+0000 7f6ab27fc700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6aa8061180 0x7f6aa8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.229+0000 7f6ab27fc700 1 -- 172.21.15.26:0/772149412 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f6aac07c600 con 0x7f6abc0f7990 2024-05-09T00:06:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.229+0000 7f6ac1616700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6aa8061180 0x7f6aa8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:02.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.229+0000 7f6ac1616700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6aa8061180 0x7f6aa8063640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6ab8013620 tx=0x7f6ab8009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:02.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.233+0000 7f6ab27fc700 1 -- 172.21.15.26:0/772149412 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6aac050590 con 0x7f6abc0f7990 2024-05-09T00:06:02.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:00.576133+0000 mgr.smithi026.brymfp (mgr.14194) 258 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T00:06:02.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:00.576133+0000 mgr.smithi026.brymfp (mgr.14194) 258 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T00:06:02.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.453+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6abc10e230 con 0x7f6abc0f7990 2024-05-09T00:06:02.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.453+0000 7f6ab27fc700 1 -- 172.21.15.26:0/772149412 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7f6aac050180 con 0x7f6abc0f7990 2024-05-09T00:06:02.448 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:06:02.448 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:06:02.448 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:06:02.448 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:06:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:06:02.448 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:06:02.449 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:06:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:06:02.451 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:06:02.451 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:06:02.451 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:06:02.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6aa8061180 msgr2=0x7f6aa8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6aa8061180 0x7f6aa8063640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6ab8013620 tx=0x7f6ab8009cb0).stop 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f7990 msgr2=0x7f6abc108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f7990 0x7f6abc108460 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f6aac002770 tx=0x7f6aac002b30).stop 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 shutdown_connections 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6aa8061180 0x7f6aa8063640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6abc0f66f0 0x7f6abc107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 --2- 172.21.15.26:0/772149412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6abc0f7990 0x7f6abc108460 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 >> 172.21.15.26:0/772149412 conn(0x7f6abc0f1e50 msgr2=0x7f6abc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 shutdown_connections 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.455+0000 7f6ac387a700 1 -- 172.21.15.26:0/772149412 wait complete. 2024-05-09T00:06:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:06:02.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 -- 172.21.15.26:0/1754929963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc8061240 msgr2=0x7fafc80fc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 --2- 172.21.15.26:0/1754929963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc8061240 0x7fafc80fc850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fafb80047f0 tx=0x7fafb8009cb0).stop 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 -- 172.21.15.26:0/1754929963 shutdown_connections 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 --2- 172.21.15.26:0/1754929963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc80fcd40 0x7fafc80ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 --2- 172.21.15.26:0/1754929963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc8061240 0x7fafc80fc850 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 -- 172.21.15.26:0/1754929963 >> 172.21.15.26:0/1754929963 conn(0x7fafc80f1e50 msgr2=0x7fafc80f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 -- 172.21.15.26:0/1754929963 shutdown_connections 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 -- 172.21.15.26:0/1754929963 wait complete. 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 Processor -- start 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.567+0000 7fafce59b700 1 -- start start 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafce59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc8061240 0x7fafc810a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafce59b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc80fcd40 0x7fafc810a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafce59b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc810ad20 con 0x7fafc80fcd40 2024-05-09T00:06:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafce59b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc810ae60 con 0x7fafc8061240 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc80fcd40 0x7fafc810a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc80fcd40 0x7fafc810a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38638/0 (socket says 172.21.15.26:38638) 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafc77fe700 1 -- 172.21.15.26:0/3936542584 learned_addr learned my addr 172.21.15.26:0/3936542584 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafc7fff700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc8061240 0x7fafc810a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafc77fe700 1 -- 172.21.15.26:0/3936542584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc8061240 msgr2=0x7fafc810a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafc77fe700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc8061240 0x7fafc810a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafc77fe700 1 -- 172.21.15.26:0/3936542584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8005040 con 0x7fafc80fcd40 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.568+0000 7fafc77fe700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc80fcd40 0x7fafc810a770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fafbc00e8c0 tx=0x7fafbc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.569+0000 7fafc57fa700 1 -- 172.21.15.26:0/3936542584 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafbc007b40 con 0x7fafc80fcd40 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.569+0000 7fafc57fa700 1 -- 172.21.15.26:0/3936542584 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafbc00f040 con 0x7fafc80fcd40 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.569+0000 7fafc57fa700 1 -- 172.21.15.26:0/3936542584 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafbc014880 con 0x7fafc80fcd40 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.569+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc810f900 con 0x7fafc80fcd40 2024-05-09T00:06:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.569+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc810fec0 con 0x7fafc80fcd40 2024-05-09T00:06:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.570+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc8102200 con 0x7fafc80fcd40 2024-05-09T00:06:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.570+0000 7fafc57fa700 1 -- 172.21.15.26:0/3936542584 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fafbc007ca0 con 0x7fafc80fcd40 2024-05-09T00:06:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.570+0000 7fafc57fa700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fafb0061180 0x7fafb0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.571+0000 7fafc57fa700 1 -- 172.21.15.26:0/3936542584 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fafbc07c140 con 0x7fafc80fcd40 2024-05-09T00:06:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.571+0000 7fafc7fff700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fafb0061180 0x7fafb0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.571+0000 7fafc7fff700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fafb0061180 0x7fafb0063640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fafb8005010 tx=0x7fafb8009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.575+0000 7fafc57fa700 1 -- 172.21.15.26:0/3936542584 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fafbc049f60 con 0x7fafc80fcd40 2024-05-09T00:06:02.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.766+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafc8059120 con 0x7fafb0061180 2024-05-09T00:06:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.767+0000 7fafc57fa700 1 -- 172.21.15.26:0/3936542584 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fafc8059120 con 0x7fafb0061180 2024-05-09T00:06:02.762 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:06:02.762 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:06:02.762 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:06:02.762 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:06:02.762 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [], 2024-05-09T00:06:02.762 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "0/21 daemons upgraded", 2024-05-09T00:06:02.763 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985 image on host smithi135", 2024-05-09T00:06:02.763 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:06:02.763 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:06:02.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fafb0061180 msgr2=0x7fafb0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fafb0061180 0x7fafb0063640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fafb8005010 tx=0x7fafb8009cb0).stop 2024-05-09T00:06:02.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc80fcd40 msgr2=0x7fafc810a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc80fcd40 0x7fafc810a770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fafbc00e8c0 tx=0x7fafbc00b040).stop 2024-05-09T00:06:02.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 shutdown_connections 2024-05-09T00:06:02.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fafb0061180 0x7fafb0063640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafc8061240 0x7fafc810a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 --2- 172.21.15.26:0/3936542584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc80fcd40 0x7fafc810a770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.769+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 >> 172.21.15.26:0/3936542584 conn(0x7fafc80f1e50 msgr2=0x7fafc80f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:02.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.770+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 shutdown_connections 2024-05-09T00:06:02.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.770+0000 7fafce59b700 1 -- 172.21.15.26:0/3936542584 wait complete. 2024-05-09T00:06:02.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.890+0000 7f9cf888d700 1 -- 172.21.15.26:0/487964876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f8cb0 msgr2=0x7f9cf40f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.890+0000 7f9cf888d700 1 --2- 172.21.15.26:0/487964876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f8cb0 0x7f9cf40f9110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f9ce80047f0 tx=0x7f9ce8009cb0).stop 2024-05-09T00:06:02.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.891+0000 7f9cf888d700 1 -- 172.21.15.26:0/487964876 shutdown_connections 2024-05-09T00:06:02.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.891+0000 7f9cf888d700 1 --2- 172.21.15.26:0/487964876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f8cb0 0x7f9cf40f9110 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.891+0000 7f9cf888d700 1 --2- 172.21.15.26:0/487964876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cf40f7a10 0x7f9cf40f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.891+0000 7f9cf888d700 1 -- 172.21.15.26:0/487964876 >> 172.21.15.26:0/487964876 conn(0x7f9cf40f3150 msgr2=0x7f9cf40f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:02.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.891+0000 7f9cf888d700 1 -- 172.21.15.26:0/487964876 shutdown_connections 2024-05-09T00:06:02.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.891+0000 7f9cf888d700 1 -- 172.21.15.26:0/487964876 wait complete. 2024-05-09T00:06:02.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.891+0000 7f9cf888d700 1 Processor -- start 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.891+0000 7f9cf888d700 1 -- start start 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf888d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f7a10 0x7f9cf4108270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf888d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cf40f8cb0 0x7f9cf4108760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf888d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4108d10 con 0x7f9cf40f7a10 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf888d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4108e50 con 0x7f9cf40f8cb0 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f7a10 0x7f9cf4108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f7a10 0x7f9cf4108270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38658/0 (socket says 172.21.15.26:38658) 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf1d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cf40f8cb0 0x7f9cf4108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf259c700 1 -- 172.21.15.26:0/1179809356 learned_addr learned my addr 172.21.15.26:0/1179809356 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf259c700 1 -- 172.21.15.26:0/1179809356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cf40f8cb0 msgr2=0x7f9cf4108760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf259c700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cf40f8cb0 0x7f9cf4108760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf259c700 1 -- 172.21.15.26:0/1179809356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce8005040 con 0x7f9cf40f7a10 2024-05-09T00:06:02.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf1d9b700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cf40f8cb0 0x7f9cf4108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:06:02.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf259c700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f7a10 0x7f9cf4108270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f9ce400e8c0 tx=0x7f9ce400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:02.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9ce37fe700 1 -- 172.21.15.26:0/1179809356 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce4007b40 con 0x7f9cf40f7a10 2024-05-09T00:06:02.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf410d8f0 con 0x7f9cf40f7a10 2024-05-09T00:06:02.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.892+0000 7f9ce37fe700 1 -- 172.21.15.26:0/1179809356 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ce400f040 con 0x7f9cf40f7a10 2024-05-09T00:06:02.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.893+0000 7f9ce37fe700 1 -- 172.21.15.26:0/1179809356 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce4014880 con 0x7f9cf40f7a10 2024-05-09T00:06:02.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.893+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf410deb0 con 0x7f9cf40f7a10 2024-05-09T00:06:02.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.894+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf405fb50 con 0x7f9cf40f7a10 2024-05-09T00:06:02.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.894+0000 7f9ce37fe700 1 -- 172.21.15.26:0/1179809356 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9ce4007ca0 con 0x7f9cf40f7a10 2024-05-09T00:06:02.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.895+0000 7f9ce37fe700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9cdc061180 0x7f9cdc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:02.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.895+0000 7f9ce37fe700 1 -- 172.21.15.26:0/1179809356 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f9ce407c4f0 con 0x7f9cf40f7a10 2024-05-09T00:06:02.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.895+0000 7f9cf1d9b700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9cdc061180 0x7f9cdc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:02.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.895+0000 7f9cf1d9b700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9cdc061180 0x7f9cdc063640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f9ce8009bc0 tx=0x7f9ce8009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:02.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:02.899+0000 7f9ce37fe700 1 -- 172.21.15.26:0/1179809356 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9ce4050480 con 0x7f9cf40f7a10 2024-05-09T00:06:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.172+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9cf41001d0 con 0x7f9cf40f7a10 2024-05-09T00:06:03.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.173+0000 7f9ce37fe700 1 -- 172.21.15.26:0/1179809356 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f9ce4019090 con 0x7f9cf40f7a10 2024-05-09T00:06:03.168 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:06:03.168 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:06:03.168 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9cdc061180 msgr2=0x7f9cdc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9cdc061180 0x7f9cdc063640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f9ce8009bc0 tx=0x7f9ce8009cb0).stop 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f7a10 msgr2=0x7f9cf4108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f7a10 0x7f9cf4108270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f9ce400e8c0 tx=0x7f9ce400b040).stop 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 shutdown_connections 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f9cdc061180 0x7f9cdc063640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cf40f7a10 0x7f9cf4108270 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 --2- 172.21.15.26:0/1179809356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cf40f8cb0 0x7f9cf4108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 >> 172.21.15.26:0/1179809356 conn(0x7f9cf40f3150 msgr2=0x7f9cf40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:03.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 shutdown_connections 2024-05-09T00:06:03.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:03.175+0000 7f9cf888d700 1 -- 172.21.15.26:0/1179809356 wait complete. 2024-05-09T00:06:03.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:01.100208+0000 mgr.smithi026.brymfp (mgr.14194) 259 : audit [DBG] from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:03.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:01.406025+0000 mgr.smithi026.brymfp (mgr.14194) 260 : audit [DBG] from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:03.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:01.717948+0000 mgr.smithi026.brymfp (mgr.14194) 261 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:03.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:02.119837+0000 mon.smithi026 (mon.0) 607 : audit [DBG] from='client.? 172.21.15.26:0/3302162719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:06:03.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:02 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:02.454853+0000 mon.smithi026 (mon.0) 608 : audit [DBG] from='client.? 172.21.15.26:0/772149412' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:06:03.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:01.100208+0000 mgr.smithi026.brymfp (mgr.14194) 259 : audit [DBG] from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:03.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:01.406025+0000 mgr.smithi026.brymfp (mgr.14194) 260 : audit [DBG] from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:03.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:01.717948+0000 mgr.smithi026.brymfp (mgr.14194) 261 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:03.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:02.119837+0000 mon.smithi026 (mon.0) 607 : audit [DBG] from='client.? 172.21.15.26:0/3302162719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:06:03.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:02.454853+0000 mon.smithi026 (mon.0) 608 : audit [DBG] from='client.? 172.21.15.26:0/772149412' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:06:04.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:02.576435+0000 mgr.smithi026.brymfp (mgr.14194) 262 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:06:04.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:02.768687+0000 mgr.smithi026.brymfp (mgr.14194) 263 : audit [DBG] from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:04.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:03.174473+0000 mon.smithi026 (mon.0) 609 : audit [DBG] from='client.? 172.21.15.26:0/1179809356' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:06:04.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:02.576435+0000 mgr.smithi026.brymfp (mgr.14194) 262 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:06:04.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:02.768687+0000 mgr.smithi026.brymfp (mgr.14194) 263 : audit [DBG] from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:04.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:03.174473+0000 mon.smithi026 (mon.0) 609 : audit [DBG] from='client.? 172.21.15.26:0/1179809356' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:06:06.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:04.576877+0000 mgr.smithi026.brymfp (mgr.14194) 264 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:06:06.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:04.576877+0000 mgr.smithi026.brymfp (mgr.14194) 264 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:06:08.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:06.577281+0000 mgr.smithi026.brymfp (mgr.14194) 265 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:08.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:06.577281+0000 mgr.smithi026.brymfp (mgr.14194) 265 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:10.224 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:08.577740+0000 mgr.smithi026.brymfp (mgr.14194) 266 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:10.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:08.577740+0000 mgr.smithi026.brymfp (mgr.14194) 266 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:12.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:10.578198+0000 mgr.smithi026.brymfp (mgr.14194) 267 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:12.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:10.578198+0000 mgr.smithi026.brymfp (mgr.14194) 267 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:14.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:12.578576+0000 mgr.smithi026.brymfp (mgr.14194) 268 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:14.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:12.578576+0000 mgr.smithi026.brymfp (mgr.14194) 268 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:16.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:14.578987+0000 mgr.smithi026.brymfp (mgr.14194) 269 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:16.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:14.578987+0000 mgr.smithi026.brymfp (mgr.14194) 269 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:18.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:16.579362+0000 mgr.smithi026.brymfp (mgr.14194) 270 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:18.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:16.579362+0000 mgr.smithi026.brymfp (mgr.14194) 270 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:20.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:18.579837+0000 mgr.smithi026.brymfp (mgr.14194) 271 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:20.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:18.579837+0000 mgr.smithi026.brymfp (mgr.14194) 271 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:22.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:20.580302+0000 mgr.smithi026.brymfp (mgr.14194) 272 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:22.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:20.580302+0000 mgr.smithi026.brymfp (mgr.14194) 272 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:24.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:22.580710+0000 mgr.smithi026.brymfp (mgr.14194) 273 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:24.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:22.580710+0000 mgr.smithi026.brymfp (mgr.14194) 273 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:26.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:24.581195+0000 mgr.smithi026.brymfp (mgr.14194) 274 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:26.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:24.581195+0000 mgr.smithi026.brymfp (mgr.14194) 274 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:28.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:26.581617+0000 mgr.smithi026.brymfp (mgr.14194) 275 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:28.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:26.581617+0000 mgr.smithi026.brymfp (mgr.14194) 275 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:30.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:30 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:28.582087+0000 mgr.smithi026.brymfp (mgr.14194) 276 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:30.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:28.582087+0000 mgr.smithi026.brymfp (mgr.14194) 276 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:32.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:32 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:30.582547+0000 mgr.smithi026.brymfp (mgr.14194) 277 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:32.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:30.582547+0000 mgr.smithi026.brymfp (mgr.14194) 277 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.334+0000 7f06e45a7700 1 -- 172.21.15.26:0/4019374093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06dc0f7990 msgr2=0x7f06dc0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.334+0000 7f06e45a7700 1 --2- 172.21.15.26:0/4019374093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06dc0f7990 0x7f06dc0f7df0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f06cc0047f0 tx=0x7f06cc009cb0).stop 2024-05-09T00:06:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.334+0000 7f06e45a7700 1 -- 172.21.15.26:0/4019374093 shutdown_connections 2024-05-09T00:06:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.334+0000 7f06e45a7700 1 --2- 172.21.15.26:0/4019374093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06dc0f7990 0x7f06dc0f7df0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.334+0000 7f06e45a7700 1 --2- 172.21.15.26:0/4019374093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc0f66f0 0x7f06dc0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.334+0000 7f06e45a7700 1 -- 172.21.15.26:0/4019374093 >> 172.21.15.26:0/4019374093 conn(0x7f06dc0f1e50 msgr2=0x7f06dc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.334+0000 7f06e45a7700 1 -- 172.21.15.26:0/4019374093 shutdown_connections 2024-05-09T00:06:33.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.334+0000 7f06e45a7700 1 -- 172.21.15.26:0/4019374093 wait complete. 2024-05-09T00:06:33.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.335+0000 7f06e45a7700 1 Processor -- start 2024-05-09T00:06:33.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.335+0000 7f06e45a7700 1 -- start start 2024-05-09T00:06:33.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.335+0000 7f06e45a7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc0f66f0 0x7f06dc061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.335+0000 7f06e45a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06dc0f7990 0x7f06dc10ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.335+0000 7f06e45a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc10d2f0 con 0x7f06dc0f7990 2024-05-09T00:06:33.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.335+0000 7f06e45a7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc10d430 con 0x7f06dc0f66f0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e2343700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc0f66f0 0x7f06dc061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e2343700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc0f66f0 0x7f06dc061040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:41102/0 (socket says 172.21.15.26:41102) 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e2343700 1 -- 172.21.15.26:0/3165282014 learned_addr learned my addr 172.21.15.26:0/3165282014 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e1b42700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06dc0f7990 0x7f06dc10ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e2343700 1 -- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06dc0f7990 msgr2=0x7f06dc10ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e2343700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06dc0f7990 0x7f06dc10ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e2343700 1 -- 172.21.15.26:0/3165282014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc005040 con 0x7f06dc0f66f0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e2343700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc0f66f0 0x7f06dc061040 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f06d800e8c0 tx=0x7f06d800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06d37fe700 1 -- 172.21.15.26:0/3165282014 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d800ee60 con 0x7f06dc0f66f0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc10d690 con 0x7f06dc0f66f0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc10dc20 con 0x7f06dc0f66f0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06d37fe700 1 -- 172.21.15.26:0/3165282014 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06d800f040 con 0x7f06dc0f66f0 2024-05-09T00:06:33.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.336+0000 7f06d37fe700 1 -- 172.21.15.26:0/3165282014 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d800c810 con 0x7f06dc0f66f0 2024-05-09T00:06:33.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.338+0000 7f06d37fe700 1 -- 172.21.15.26:0/3165282014 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f06d8007b40 con 0x7f06dc0f66f0 2024-05-09T00:06:33.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.339+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c0005150 con 0x7f06dc0f66f0 2024-05-09T00:06:33.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.339+0000 7f06d37fe700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06c8065590 0x7f06c8067a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.339+0000 7f06d37fe700 1 -- 172.21.15.26:0/3165282014 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f06d807c4c0 con 0x7f06dc0f66f0 2024-05-09T00:06:33.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.339+0000 7f06e1b42700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06c8065590 0x7f06c8067a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.339+0000 7f06e1b42700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06c8065590 0x7f06c8067a50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f06cc004540 tx=0x7f06cc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:33.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.348+0000 7f06d37fe700 1 -- 172.21.15.26:0/3165282014 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f06d8050470 con 0x7f06dc0f66f0 2024-05-09T00:06:33.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.539+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06c0000bf0 con 0x7f06c8065590 2024-05-09T00:06:33.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.540+0000 7f06d37fe700 1 -- 172.21.15.26:0/3165282014 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f06c0000bf0 con 0x7f06c8065590 2024-05-09T00:06:33.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.542+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06c8065590 msgr2=0x7f06c8067a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.542+0000 7f06e45a7700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06c8065590 0x7f06c8067a50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f06cc004540 tx=0x7f06cc00b040).stop 2024-05-09T00:06:33.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.542+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc0f66f0 msgr2=0x7f06dc061040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.542+0000 7f06e45a7700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc0f66f0 0x7f06dc061040 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f06d800e8c0 tx=0x7f06d800b040).stop 2024-05-09T00:06:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.545+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 shutdown_connections 2024-05-09T00:06:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.545+0000 7f06e45a7700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f06c8065590 0x7f06c8067a50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.545+0000 7f06e45a7700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06dc0f66f0 0x7f06dc061040 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.545+0000 7f06e45a7700 1 --2- 172.21.15.26:0/3165282014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06dc0f7990 0x7f06dc10ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.545+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 >> 172.21.15.26:0/3165282014 conn(0x7f06dc0f1e50 msgr2=0x7f06dc0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.545+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 shutdown_connections 2024-05-09T00:06:33.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.545+0000 7f06e45a7700 1 -- 172.21.15.26:0/3165282014 wait complete. 2024-05-09T00:06:33.549 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:06:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/2344838607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e580f7800 msgr2=0x7f6e580f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 --2- 172.21.15.26:0/2344838607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e580f7800 0x7f6e580f7c20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f6e4c0047f0 tx=0x7f6e4c009cb0).stop 2024-05-09T00:06:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/2344838607 shutdown_connections 2024-05-09T00:06:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 --2- 172.21.15.26:0/2344838607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e580f8aa0 0x7f6e580f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 --2- 172.21.15.26:0/2344838607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e580f7800 0x7f6e580f7c20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/2344838607 >> 172.21.15.26:0/2344838607 conn(0x7f6e580f2f80 msgr2=0x7f6e580f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/2344838607 shutdown_connections 2024-05-09T00:06:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/2344838607 wait complete. 2024-05-09T00:06:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 Processor -- start 2024-05-09T00:06:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.652+0000 7f6e5ebfe700 1 -- start start 2024-05-09T00:06:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e5ebfe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e580f7800 0x7f6e58108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e5ebfe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e580f8aa0 0x7f6e58108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e5ebfe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58108b20 con 0x7f6e580f7800 2024-05-09T00:06:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e5ebfe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58108c60 con 0x7f6e580f8aa0 2024-05-09T00:06:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e57fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e580f8aa0 0x7f6e58108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e57fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e580f8aa0 0x7f6e58108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:41118/0 (socket says 172.21.15.26:41118) 2024-05-09T00:06:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e57fff700 1 -- 172.21.15.26:0/1296985560 learned_addr learned my addr 172.21.15.26:0/1296985560 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e5c99a700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e580f7800 0x7f6e58108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e57fff700 1 -- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e580f7800 msgr2=0x7f6e58108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e57fff700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e580f7800 0x7f6e58108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e57fff700 1 -- 172.21.15.26:0/1296985560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c005040 con 0x7f6e580f8aa0 2024-05-09T00:06:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.653+0000 7f6e57fff700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e580f8aa0 0x7f6e58108570 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6e4400e910 tx=0x7f6e4400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.654+0000 7f6e55ffb700 1 -- 172.21.15.26:0/1296985560 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e44007b40 con 0x7f6e580f8aa0 2024-05-09T00:06:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.654+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5810d700 con 0x7f6e580f8aa0 2024-05-09T00:06:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.654+0000 7f6e55ffb700 1 -- 172.21.15.26:0/1296985560 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e4400f040 con 0x7f6e580f8aa0 2024-05-09T00:06:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.654+0000 7f6e55ffb700 1 -- 172.21.15.26:0/1296985560 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e44014920 con 0x7f6e580f8aa0 2024-05-09T00:06:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.654+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5806b150 con 0x7f6e580f8aa0 2024-05-09T00:06:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.655+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e580fffe0 con 0x7f6e580f8aa0 2024-05-09T00:06:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.655+0000 7f6e55ffb700 1 -- 172.21.15.26:0/1296985560 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f6e44007ca0 con 0x7f6e580f8aa0 2024-05-09T00:06:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.656+0000 7f6e55ffb700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e48065590 0x7f6e48067a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.656+0000 7f6e55ffb700 1 -- 172.21.15.26:0/1296985560 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f6e4407c2d0 con 0x7f6e580f8aa0 2024-05-09T00:06:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.656+0000 7f6e5c99a700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e48065590 0x7f6e48067a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.656+0000 7f6e5c99a700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e48065590 0x7f6e48067a50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f6e4c0047c0 tx=0x7f6e4c009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:33.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.664+0000 7f6e55ffb700 1 -- 172.21.15.26:0/1296985560 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6e44049f60 con 0x7f6e580f8aa0 2024-05-09T00:06:33.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.852+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e58059120 con 0x7f6e48065590 2024-05-09T00:06:33.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.853+0000 7f6e55ffb700 1 -- 172.21.15.26:0/1296985560 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f6e58059120 con 0x7f6e48065590 2024-05-09T00:06:33.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e48065590 msgr2=0x7f6e48067a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e48065590 0x7f6e48067a50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f6e4c0047c0 tx=0x7f6e4c009cb0).stop 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e580f8aa0 msgr2=0x7f6e58108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e580f8aa0 0x7f6e58108570 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6e4400e910 tx=0x7f6e4400b040).stop 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 shutdown_connections 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f6e48065590 0x7f6e48067a50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e580f7800 0x7f6e58108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 --2- 172.21.15.26:0/1296985560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e580f8aa0 0x7f6e58108570 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 >> 172.21.15.26:0/1296985560 conn(0x7f6e580f2f80 msgr2=0x7f6e580fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.855+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 shutdown_connections 2024-05-09T00:06:33.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.856+0000 7f6e5ebfe700 1 -- 172.21.15.26:0/1296985560 wait complete. 2024-05-09T00:06:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.957+0000 7fc3da5d2700 1 -- 172.21.15.26:0/2806452783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d40fa9a0 msgr2=0x7fc3d40fcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.957+0000 7fc3da5d2700 1 --2- 172.21.15.26:0/2806452783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d40fa9a0 0x7fc3d40fcd90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fc3c80047f0 tx=0x7fc3c8009cb0).stop 2024-05-09T00:06:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.958+0000 7fc3da5d2700 1 -- 172.21.15.26:0/2806452783 shutdown_connections 2024-05-09T00:06:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.958+0000 7fc3da5d2700 1 --2- 172.21.15.26:0/2806452783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d40fa9a0 0x7fc3d40fcd90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.958+0000 7fc3da5d2700 1 --2- 172.21.15.26:0/2806452783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3d4061730 0x7fc3d40fa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.958+0000 7fc3da5d2700 1 -- 172.21.15.26:0/2806452783 >> 172.21.15.26:0/2806452783 conn(0x7fc3d40f1eb0 msgr2=0x7fc3d40f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.958+0000 7fc3da5d2700 1 -- 172.21.15.26:0/2806452783 shutdown_connections 2024-05-09T00:06:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.958+0000 7fc3da5d2700 1 -- 172.21.15.26:0/2806452783 wait complete. 2024-05-09T00:06:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.958+0000 7fc3da5d2700 1 Processor -- start 2024-05-09T00:06:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.958+0000 7fc3da5d2700 1 -- start start 2024-05-09T00:06:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3da5d2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3d4061730 0x7fc3d41080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3da5d2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d40fa9a0 0x7fc3d41085b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3da5d2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4108b60 con 0x7fc3d40fa9a0 2024-05-09T00:06:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3da5d2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4108ca0 con 0x7fc3d4061730 2024-05-09T00:06:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3d4061730 0x7fc3d41080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3d4061730 0x7fc3d41080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:41140/0 (socket says 172.21.15.26:41140) 2024-05-09T00:06:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3d3fff700 1 -- 172.21.15.26:0/4144644740 learned_addr learned my addr 172.21.15.26:0/4144644740 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3d37fe700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d40fa9a0 0x7fc3d41085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3d3fff700 1 -- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d40fa9a0 msgr2=0x7fc3d41085b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3d3fff700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d40fa9a0 0x7fc3d41085b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3d3fff700 1 -- 172.21.15.26:0/4144644740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8005040 con 0x7fc3d4061730 2024-05-09T00:06:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.959+0000 7fc3d3fff700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3d4061730 0x7fc3d41080c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc3c400e8c0 tx=0x7fc3c400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.960+0000 7fc3d17fa700 1 -- 172.21.15.26:0/4144644740 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c400ee60 con 0x7fc3d4061730 2024-05-09T00:06:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.960+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d410d740 con 0x7fc3d4061730 2024-05-09T00:06:33.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.960+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d410dd00 con 0x7fc3d4061730 2024-05-09T00:06:33.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.960+0000 7fc3d17fa700 1 -- 172.21.15.26:0/4144644740 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3c400f040 con 0x7fc3d4061730 2024-05-09T00:06:33.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.960+0000 7fc3d17fa700 1 -- 172.21.15.26:0/4144644740 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3c400c7f0 con 0x7fc3d4061730 2024-05-09T00:06:33.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.961+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c0005150 con 0x7fc3d4061730 2024-05-09T00:06:33.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.961+0000 7fc3d17fa700 1 -- 172.21.15.26:0/4144644740 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fc3c4009340 con 0x7fc3d4061730 2024-05-09T00:06:33.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.962+0000 7fc3d17fa700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc3bc061180 0x7fc3bc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:33.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.962+0000 7fc3d17fa700 1 -- 172.21.15.26:0/4144644740 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fc3c407c490 con 0x7fc3d4061730 2024-05-09T00:06:33.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.962+0000 7fc3d37fe700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc3bc061180 0x7fc3bc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:33.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.962+0000 7fc3d37fe700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc3bc061180 0x7fc3bc063640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc3c8004e60 tx=0x7fc3c800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:33.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:33.970+0000 7fc3d17fa700 1 -- 172.21.15.26:0/4144644740 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc3c40504a0 con 0x7fc3d4061730 2024-05-09T00:06:34.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.168+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3c0000bf0 con 0x7fc3bc061180 2024-05-09T00:06:34.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.185+0000 7fc3d17fa700 1 -- 172.21.15.26:0/4144644740 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc3c0000bf0 con 0x7fc3bc061180 2024-05-09T00:06:34.181 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:06:34.181 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (5m) 95s ago 7m 23.7M - 0.23.0 ba2b418f427c e4c5eae7b44c 2024-05-09T00:06:34.181 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (7m) 95s ago 7m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:06:34.181 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (6m) 101s ago 6m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (5m) 95s ago 6m 56.8M - 8.3.5 dad864ee21e9 0d0dbb754a90 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (113s) 95s ago 112s 11.9M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (119s) 95s ago 118s 14.6M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (110s) 101s ago 110s 11.7M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (116s) 101s ago 116s 11.5M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:9283 running (8m) 95s ago 8m 433M - 16.2.15-1-g8963e9de 727f386679cb 405cee21e657 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (6m) 101s ago 6m 387M - 16.2.15-1-g8963e9de 727f386679cb b1280065c59a 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (8m) 95s ago 8m 61.1M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (6m) 101s ago 6m 60.9M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (6m) 95s ago 6m 24.9M - 1.3.1 1dbe0e931976 eb62f1a664c9 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (6m) 101s ago 6m 25.8M - 1.3.1 1dbe0e931976 0ef67083c290 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 95s ago 5m 39.5M 4642M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:06:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (5m) 95s ago 5m 42.7M 4642M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:06:34.183 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (4m) 95s ago 4m 39.1M 4642M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:06:34.183 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (4m) 101s ago 4m 41.1M 4982M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:06:34.183 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (3m) 101s ago 3m 39.7M 4982M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:06:34.183 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (3m) 101s ago 3m 39.4M 4982M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:06:34.183 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (6m) 101s ago 6m 60.6M - 2.33.4 514e6a882f6e dbc569e4b23d 2024-05-09T00:06:34.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.187+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc3bc061180 msgr2=0x7fc3bc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.187+0000 7fc3da5d2700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc3bc061180 0x7fc3bc063640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc3c8004e60 tx=0x7fc3c800b040).stop 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.187+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3d4061730 msgr2=0x7fc3d41080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.187+0000 7fc3da5d2700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3d4061730 0x7fc3d41080c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc3c400e8c0 tx=0x7fc3c400b040).stop 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.188+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 shutdown_connections 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.188+0000 7fc3da5d2700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fc3bc061180 0x7fc3bc063640 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.188+0000 7fc3da5d2700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3d4061730 0x7fc3d41080c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.188+0000 7fc3da5d2700 1 --2- 172.21.15.26:0/4144644740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3d40fa9a0 0x7fc3d41085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.188+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 >> 172.21.15.26:0/4144644740 conn(0x7fc3d40f1eb0 msgr2=0x7fc3d40f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.188+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 shutdown_connections 2024-05-09T00:06:34.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.188+0000 7fc3da5d2700 1 -- 172.21.15.26:0/4144644740 wait complete. 2024-05-09T00:06:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.293+0000 7faabc366700 1 -- 172.21.15.26:0/2383056029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 msgr2=0x7faab40fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.293+0000 7faabc366700 1 --2- 172.21.15.26:0/2383056029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 0x7faab40fa3d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7faab00047f0 tx=0x7faab0009cb0).stop 2024-05-09T00:06:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.294+0000 7faabc366700 1 -- 172.21.15.26:0/2383056029 shutdown_connections 2024-05-09T00:06:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.294+0000 7faabc366700 1 --2- 172.21.15.26:0/2383056029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faab40fa950 0x7faab40fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:06:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.294+0000 7faabc366700 1 --2- 172.21.15.26:0/2383056029 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 0x7faab40fa3d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.294+0000 7faabc366700 1 -- 172.21.15.26:0/2383056029 >> 172.21.15.26:0/2383056029 conn(0x7faab40f1e50 msgr2=0x7faab40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.294+0000 7faabc366700 1 -- 172.21.15.26:0/2383056029 shutdown_connections 2024-05-09T00:06:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.294+0000 7faabc366700 1 -- 172.21.15.26:0/2383056029 wait complete. 2024-05-09T00:06:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.294+0000 7faabc366700 1 Processor -- start 2024-05-09T00:06:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.294+0000 7faabc366700 1 -- start start 2024-05-09T00:06:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faabc366700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 0x7faab4105da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faabc366700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faab40fa950 0x7faab4106290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faabc366700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab41068d0 con 0x7faab4061280 2024-05-09T00:06:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faabc366700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab4106a10 con 0x7faab40fa950 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaba102700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 0x7faab4105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaba102700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 0x7faab4105da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58362/0 (socket says 172.21.15.26:58362) 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaba102700 1 -- 172.21.15.26:0/193597375 learned_addr learned my addr 172.21.15.26:0/193597375 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaba102700 1 -- 172.21.15.26:0/193597375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faab40fa950 msgr2=0x7faab4106290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaba102700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faab40fa950 0x7faab4106290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaba102700 1 -- 172.21.15.26:0/193597375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0005040 con 0x7faab4061280 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaba102700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 0x7faab4105da0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7faab00092e0 tx=0x7faab0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaab7fe700 1 -- 172.21.15.26:0/193597375 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faab000e030 con 0x7faab4061280 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab410b450 con 0x7faab4061280 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab410b9b0 con 0x7faab4061280 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaab7fe700 1 -- 172.21.15.26:0/193597375 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faab0007e90 con 0x7faab4061280 2024-05-09T00:06:34.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.295+0000 7faaab7fe700 1 -- 172.21.15.26:0/193597375 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faab0018070 con 0x7faab4061280 2024-05-09T00:06:34.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.296+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa98005150 con 0x7faab4061280 2024-05-09T00:06:34.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.297+0000 7faaab7fe700 1 -- 172.21.15.26:0/193597375 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7faab001d960 con 0x7faab4061280 2024-05-09T00:06:34.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.298+0000 7faaab7fe700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faaa0061160 0x7faaa0063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:34.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.298+0000 7faaab7fe700 1 -- 172.21.15.26:0/193597375 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7faab007e1d0 con 0x7faab4061280 2024-05-09T00:06:34.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.298+0000 7faab9901700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faaa0061160 0x7faaa0063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:34.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.299+0000 7faab9901700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faaa0061160 0x7faaa0063620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faab4061050 tx=0x7faaa4006ae0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:34.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.302+0000 7faaab7fe700 1 -- 172.21.15.26:0/193597375 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7faab00521e0 con 0x7faab4061280 2024-05-09T00:06:34.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:34 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:32.582942+0000 mgr.smithi026.brymfp (mgr.14194) 278 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:34.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:34 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:32.582942+0000 mgr.smithi026.brymfp (mgr.14194) 278 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:34.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.622+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faa98005af0 con 0x7faab4061280 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.623+0000 7faaab7fe700 1 -- 172.21.15.26:0/193597375 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7faab004e030 con 0x7faab4061280 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:06:34.617 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 14 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:06:34.618 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:06:34.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faaa0061160 msgr2=0x7faaa0063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faaa0061160 0x7faaa0063620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faab4061050 tx=0x7faaa4006ae0).stop 2024-05-09T00:06:34.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 msgr2=0x7faab4105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 0x7faab4105da0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7faab00092e0 tx=0x7faab0009cb0).stop 2024-05-09T00:06:34.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 shutdown_connections 2024-05-09T00:06:34.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7faaa0061160 0x7faaa0063620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faab4061280 0x7faab4105da0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 --2- 172.21.15.26:0/193597375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faab40fa950 0x7faab4106290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:06:34.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 >> 172.21.15.26:0/193597375 conn(0x7faab40f1e50 msgr2=0x7faab40f61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:34.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 shutdown_connections 2024-05-09T00:06:34.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.625+0000 7faabc366700 1 -- 172.21.15.26:0/193597375 wait complete. 2024-05-09T00:06:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.729+0000 7f11f5f9c700 1 -- 172.21.15.26:0/4136869853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 msgr2=0x7f11f00fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.729+0000 7f11f5f9c700 1 --2- 172.21.15.26:0/4136869853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 0x7f11f00fa3d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f11e00047f0 tx=0x7f11e0009cb0).stop 2024-05-09T00:06:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.729+0000 7f11f5f9c700 1 -- 172.21.15.26:0/4136869853 shutdown_connections 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.729+0000 7f11f5f9c700 1 --2- 172.21.15.26:0/4136869853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11f00fa950 0x7f11f00fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.729+0000 7f11f5f9c700 1 --2- 172.21.15.26:0/4136869853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 0x7f11f00fa3d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.729+0000 7f11f5f9c700 1 -- 172.21.15.26:0/4136869853 >> 172.21.15.26:0/4136869853 conn(0x7f11f00f1e50 msgr2=0x7f11f00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.729+0000 7f11f5f9c700 1 -- 172.21.15.26:0/4136869853 shutdown_connections 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.729+0000 7f11f5f9c700 1 -- 172.21.15.26:0/4136869853 wait complete. 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11f5f9c700 1 Processor -- start 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11f5f9c700 1 -- start start 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11f5f9c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 0x7f11f00f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11f5f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11f00fa950 0x7f11f00f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11f5f9c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00f8220 con 0x7f11f0061280 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11f5f9c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00f67c0 con 0x7f11f00fa950 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11ef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 0x7f11f00f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:34.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11ef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 0x7f11f00f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58374/0 (socket says 172.21.15.26:58374) 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11ef7fe700 1 -- 172.21.15.26:0/188379163 learned_addr learned my addr 172.21.15.26:0/188379163 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.730+0000 7f11eeffd700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11f00fa950 0x7f11f00f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11ef7fe700 1 -- 172.21.15.26:0/188379163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11f00fa950 msgr2=0x7f11f00f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11ef7fe700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11f00fa950 0x7f11f00f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11ef7fe700 1 -- 172.21.15.26:0/188379163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0005040 con 0x7f11f0061280 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11ef7fe700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 0x7f11f00f7c70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f11e0013560 tx=0x7f11e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11ecff9700 1 -- 172.21.15.26:0/188379163 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e0018070 con 0x7f11f0061280 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f00f69e0 con 0x7f11f0061280 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11ecff9700 1 -- 172.21.15.26:0/188379163 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11e0007e90 con 0x7f11f0061280 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f00f6f40 con 0x7f11f0061280 2024-05-09T00:06:34.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.731+0000 7f11ecff9700 1 -- 172.21.15.26:0/188379163 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e001c380 con 0x7f11f0061280 2024-05-09T00:06:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.732+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f0100000 con 0x7f11f0061280 2024-05-09T00:06:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.733+0000 7f11ecff9700 1 -- 172.21.15.26:0/188379163 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f11e00123c0 con 0x7f11f0061280 2024-05-09T00:06:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.734+0000 7f11ecff9700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f11d8061180 0x7f11d8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:34.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.734+0000 7f11ecff9700 1 -- 172.21.15.26:0/188379163 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f11e007d5e0 con 0x7f11f0061280 2024-05-09T00:06:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.734+0000 7f11eeffd700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f11d8061180 0x7f11d8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:34.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.734+0000 7f11eeffd700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f11d8061180 0x7f11d8063640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f11f0061050 tx=0x7f11e400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:34.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.742+0000 7f11ecff9700 1 -- 172.21.15.26:0/188379163 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f11e0051620 con 0x7f11f0061280 2024-05-09T00:06:34.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.987+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11f00598f0 con 0x7f11f0061280 2024-05-09T00:06:34.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.988+0000 7f11ecff9700 1 -- 172.21.15.26:0/188379163 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7f11e0051210 con 0x7f11f0061280 2024-05-09T00:06:34.982 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:06:34.982 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:06:34.982 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:06:34.982 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:06:34.982 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:06:34.982 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:06:34.982 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:06:34.983 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:06:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:06:34.985 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:06:34.985 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:06:34.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f11d8061180 msgr2=0x7f11d8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f11d8061180 0x7f11d8063640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f11f0061050 tx=0x7f11e400b040).stop 2024-05-09T00:06:34.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 msgr2=0x7f11f00f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 0x7f11f00f7c70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f11e0013560 tx=0x7f11e0009cb0).stop 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 shutdown_connections 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f11d8061180 0x7f11d8063640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11f0061280 0x7f11f00f7c70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 --2- 172.21.15.26:0/188379163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11f00fa950 0x7f11f00f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.990+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 >> 172.21.15.26:0/188379163 conn(0x7f11f00f1e50 msgr2=0x7f11f00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.991+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 shutdown_connections 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:34.991+0000 7f11f5f9c700 1 -- 172.21.15.26:0/188379163 wait complete. 2024-05-09T00:06:34.986 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:06:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.101+0000 7f84d0622700 1 -- 172.21.15.26:0/1939742518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 msgr2=0x7f84c80f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.101+0000 7f84d0622700 1 --2- 172.21.15.26:0/1939742518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 0x7f84c80f7df0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f84b80047f0 tx=0x7f84b8009cb0).stop 2024-05-09T00:06:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.101+0000 7f84d0622700 1 -- 172.21.15.26:0/1939742518 shutdown_connections 2024-05-09T00:06:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.101+0000 7f84d0622700 1 --2- 172.21.15.26:0/1939742518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 0x7f84c80f7df0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.101+0000 7f84d0622700 1 --2- 172.21.15.26:0/1939742518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c80f66f0 0x7f84c80f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.101+0000 7f84d0622700 1 -- 172.21.15.26:0/1939742518 >> 172.21.15.26:0/1939742518 conn(0x7f84c80f1e50 msgr2=0x7f84c80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.101+0000 7f84d0622700 1 -- 172.21.15.26:0/1939742518 shutdown_connections 2024-05-09T00:06:35.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.101+0000 7f84d0622700 1 -- 172.21.15.26:0/1939742518 wait complete. 2024-05-09T00:06:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.102+0000 7f84d0622700 1 Processor -- start 2024-05-09T00:06:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.102+0000 7f84d0622700 1 -- start start 2024-05-09T00:06:35.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.102+0000 7f84d0622700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c80f66f0 0x7f84c8107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.102+0000 7f84d0622700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 0x7f84c8108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.102+0000 7f84d0622700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8108a10 con 0x7f84c80f7990 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.102+0000 7f84d0622700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8108b50 con 0x7f84c80f66f0 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.102+0000 7f84ce3be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c80f66f0 0x7f84c8107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84ce3be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c80f66f0 0x7f84c8107f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:41182/0 (socket says 172.21.15.26:41182) 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84ce3be700 1 -- 172.21.15.26:0/2194683357 learned_addr learned my addr 172.21.15.26:0/2194683357 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84cdbbd700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 0x7f84c8108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84cdbbd700 1 -- 172.21.15.26:0/2194683357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c80f66f0 msgr2=0x7f84c8107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84cdbbd700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c80f66f0 0x7f84c8107f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84cdbbd700 1 -- 172.21.15.26:0/2194683357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8005040 con 0x7f84c80f7990 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84ce3be700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c80f66f0 0x7f84c8107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84cdbbd700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 0x7f84c8108460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f84b8013620 tx=0x7f84b8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84bf7fe700 1 -- 172.21.15.26:0/2194683357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b800e070 con 0x7f84c80f7990 2024-05-09T00:06:35.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84bf7fe700 1 -- 172.21.15.26:0/2194683357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f84b8007e90 con 0x7f84c80f7990 2024-05-09T00:06:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c810d590 con 0x7f84c80f7990 2024-05-09T00:06:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84bf7fe700 1 -- 172.21.15.26:0/2194683357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b8018070 con 0x7f84c80f7990 2024-05-09T00:06:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.103+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c810db50 con 0x7f84c80f7990 2024-05-09T00:06:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.105+0000 7f84bf7fe700 1 -- 172.21.15.26:0/2194683357 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f84b801d420 con 0x7f84c80f7990 2024-05-09T00:06:35.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.105+0000 7f84bf7fe700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f84b4061180 0x7f84b4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:35.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.105+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c80feeb0 con 0x7f84c80f7990 2024-05-09T00:06:35.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.106+0000 7f84bf7fe700 1 -- 172.21.15.26:0/2194683357 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f84b807d480 con 0x7f84c80f7990 2024-05-09T00:06:35.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.106+0000 7f84ce3be700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f84b4061180 0x7f84b4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:35.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.106+0000 7f84ce3be700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f84b4061180 0x7f84b4063640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f84c4004fd0 tx=0x7f84c400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:35.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.113+0000 7f84bf7fe700 1 -- 172.21.15.26:0/2194683357 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f84b8051350 con 0x7f84c80f7990 2024-05-09T00:06:35.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.315+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 --> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84c810e190 con 0x7f84b4061180 2024-05-09T00:06:35.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.316+0000 7f84bf7fe700 1 -- 172.21.15.26:0/2194683357 <== mgr.14194 v2:172.21.15.26:6800/3278576613 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f84c810e190 con 0x7f84b4061180 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [], 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "0/21 daemons upgraded", 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985 image on host smithi135", 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:06:35.311 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:06:35.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f84b4061180 msgr2=0x7f84b4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f84b4061180 0x7f84b4063640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f84c4004fd0 tx=0x7f84c400b040).stop 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 msgr2=0x7f84c8108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 0x7f84c8108460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f84b8013620 tx=0x7f84b8009cb0).stop 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 shutdown_connections 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7f84b4061180 0x7f84b4063640 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c80f66f0 0x7f84c8107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 --2- 172.21.15.26:0/2194683357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84c80f7990 0x7f84c8108460 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 >> 172.21.15.26:0/2194683357 conn(0x7f84c80f1e50 msgr2=0x7f84c8060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 shutdown_connections 2024-05-09T00:06:35.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.318+0000 7f84d0622700 1 -- 172.21.15.26:0/2194683357 wait complete. 2024-05-09T00:06:35.377 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:33.540244+0000 mgr.smithi026.brymfp (mgr.14194) 279 : audit [DBG] from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:35.377 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:33.853588+0000 mgr.smithi026.brymfp (mgr.14194) 280 : audit [DBG] from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:35.377 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:34.623061+0000 mon.smithi026 (mon.0) 610 : audit [DBG] from='client.? 172.21.15.26:0/193597375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:06:35.377 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:34.988383+0000 mon.smithi026 (mon.0) 611 : audit [DBG] from='client.? 172.21.15.26:0/188379163' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:06:35.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:33.540244+0000 mgr.smithi026.brymfp (mgr.14194) 279 : audit [DBG] from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:35.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:33.853588+0000 mgr.smithi026.brymfp (mgr.14194) 280 : audit [DBG] from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:35.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:34.623061+0000 mon.smithi026 (mon.0) 610 : audit [DBG] from='client.? 172.21.15.26:0/193597375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:06:35.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:34.988383+0000 mon.smithi026 (mon.0) 611 : audit [DBG] from='client.? 172.21.15.26:0/188379163' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:06:35.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.423+0000 7fe8256b0700 1 -- 172.21.15.26:0/3037186621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f7990 msgr2=0x7fe8200f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:35.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.423+0000 7fe8256b0700 1 --2- 172.21.15.26:0/3037186621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f7990 0x7fe8200f7df0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fe8100047f0 tx=0x7fe810009cb0).stop 2024-05-09T00:06:35.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.423+0000 7fe8256b0700 1 -- 172.21.15.26:0/3037186621 shutdown_connections 2024-05-09T00:06:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.423+0000 7fe8256b0700 1 --2- 172.21.15.26:0/3037186621 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f7990 0x7fe8200f7df0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.423+0000 7fe8256b0700 1 --2- 172.21.15.26:0/3037186621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8200f66f0 0x7fe8200f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.423+0000 7fe8256b0700 1 -- 172.21.15.26:0/3037186621 >> 172.21.15.26:0/3037186621 conn(0x7fe8200f1e50 msgr2=0x7fe8200f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.423+0000 7fe8256b0700 1 -- 172.21.15.26:0/3037186621 shutdown_connections 2024-05-09T00:06:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.423+0000 7fe8256b0700 1 -- 172.21.15.26:0/3037186621 wait complete. 2024-05-09T00:06:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe8256b0700 1 Processor -- start 2024-05-09T00:06:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe8256b0700 1 -- start start 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe8256b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f66f0 0x7fe820106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe8256b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8200f7990 0x7fe820107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe8256b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe820107930 con 0x7fe8200f66f0 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe8256b0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe820107a70 con 0x7fe8200f7990 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe81effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f66f0 0x7fe820106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe81effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f66f0 0x7fe820106e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58420/0 (socket says 172.21.15.26:58420) 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe81effd700 1 -- 172.21.15.26:0/4280084035 learned_addr learned my addr 172.21.15.26:0/4280084035 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.424+0000 7fe81e7fc700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8200f7990 0x7fe820107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe81effd700 1 -- 172.21.15.26:0/4280084035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8200f7990 msgr2=0x7fe820107380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe81effd700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8200f7990 0x7fe820107380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe81effd700 1 -- 172.21.15.26:0/4280084035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810005040 con 0x7fe8200f66f0 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe81effd700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f66f0 0x7fe820106e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fe808002820 tx=0x7fe808009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe817fff700 1 -- 172.21.15.26:0/4280084035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe808007b40 con 0x7fe8200f66f0 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82010c4c0 con 0x7fe8200f66f0 2024-05-09T00:06:35.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe817fff700 1 -- 172.21.15.26:0/4280084035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe80800f040 con 0x7fe8200f66f0 2024-05-09T00:06:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82010ca80 con 0x7fe8200f66f0 2024-05-09T00:06:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.425+0000 7fe817fff700 1 -- 172.21.15.26:0/4280084035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe808014820 con 0x7fe8200f66f0 2024-05-09T00:06:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.426+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe800005150 con 0x7fe8200f66f0 2024-05-09T00:06:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.426+0000 7fe817fff700 1 -- 172.21.15.26:0/4280084035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fe808014a90 con 0x7fe8200f66f0 2024-05-09T00:06:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.427+0000 7fe817fff700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061180 0x7fe80c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:06:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.427+0000 7fe817fff700 1 -- 172.21.15.26:0/4280084035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fe80807c410 con 0x7fe8200f66f0 2024-05-09T00:06:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.427+0000 7fe81e7fc700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061180 0x7fe80c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:06:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.427+0000 7fe81e7fc700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061180 0x7fe80c063640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fe810004f10 tx=0x7fe81000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:35.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.431+0000 7fe817fff700 1 -- 172.21.15.26:0/4280084035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe808050420 con 0x7fe8200f66f0 2024-05-09T00:06:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.669+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe800005820 con 0x7fe8200f66f0 2024-05-09T00:06:35.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.670+0000 7fe817fff700 1 -- 172.21.15.26:0/4280084035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe808050010 con 0x7fe8200f66f0 2024-05-09T00:06:35.664 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:06:35.664 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:06:35.664 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061180 msgr2=0x7fe80c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061180 0x7fe80c063640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fe810004f10 tx=0x7fe81000b040).stop 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f66f0 msgr2=0x7fe820106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f66f0 0x7fe820106e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fe808002820 tx=0x7fe808009f00).stop 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 shutdown_connections 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:6800/3278576613,v1:172.21.15.26:6801/3278576613] conn(0x7fe80c061180 0x7fe80c063640 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8200f66f0 0x7fe820106e90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 --2- 172.21.15.26:0/4280084035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8200f7990 0x7fe820107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:06:35.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 >> 172.21.15.26:0/4280084035 conn(0x7fe8200f1e50 msgr2=0x7fe8200fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 shutdown_connections 2024-05-09T00:06:35.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:06:35.672+0000 7fe8256b0700 1 -- 172.21.15.26:0/4280084035 wait complete. 2024-05-09T00:06:36.111 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:34.169860+0000 mgr.smithi026.brymfp (mgr.14194) 281 : audit [DBG] from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:36.111 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:34.583453+0000 mgr.smithi026.brymfp (mgr.14194) 282 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:36.111 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:35.670614+0000 mon.smithi026 (mon.0) 612 : audit [DBG] from='client.? 172.21.15.26:0/4280084035' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:06:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:34.169860+0000 mgr.smithi026.brymfp (mgr.14194) 281 : audit [DBG] from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:34.583453+0000 mgr.smithi026.brymfp (mgr.14194) 282 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:36.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:35.670614+0000 mon.smithi026 (mon.0) 612 : audit [DBG] from='client.? 172.21.15.26:0/4280084035' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:06:37.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:35.316511+0000 mgr.smithi026.brymfp (mgr.14194) 283 : audit [DBG] from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:37.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:36.516271+0000 mon.smithi026 (mon.0) 613 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:06:37.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:36.517299+0000 mon.smithi026 (mon.0) 614 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:06:37.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:36.518143+0000 mon.smithi026 (mon.0) 615 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:06:37.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:36.518868+0000 mon.smithi026 (mon.0) 616 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:06:37.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:35.316511+0000 mgr.smithi026.brymfp (mgr.14194) 283 : audit [DBG] from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:06:37.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:36.516271+0000 mon.smithi026 (mon.0) 613 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:06:37.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:36.517299+0000 mon.smithi026 (mon.0) 614 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:06:37.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:36.518143+0000 mon.smithi026 (mon.0) 615 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:06:37.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:36.518868+0000 mon.smithi026 (mon.0) 616 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:06:37.669 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 94% (11609/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-09T00:06:38.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:06:36.511460+0000 mgr.smithi026.brymfp (mgr.14194) 284 : cephadm [INF] Upgrade: Updating mgr.smithi135.kkrhgf 2024-05-09T00:06:38.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:06:36.519576+0000 mgr.smithi026.brymfp (mgr.14194) 285 : cephadm [INF] Deploying daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:06:38.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:38 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:36.583803+0000 mgr.smithi026.brymfp (mgr.14194) 286 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:38.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:38 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:06:36.511460+0000 mgr.smithi026.brymfp (mgr.14194) 284 : cephadm [INF] Upgrade: Updating mgr.smithi135.kkrhgf 2024-05-09T00:06:38.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:38 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:06:36.519576+0000 mgr.smithi026.brymfp (mgr.14194) 285 : cephadm [INF] Deploying daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:06:38.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:38 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:36.583803+0000 mgr.smithi026.brymfp (mgr.14194) 286 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:38.547 INFO:tasks.workunit.client.0.smithi026.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-09T00:06:38.547 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-05-09T00:06:38.547 INFO:tasks.workunit.client.0.smithi026.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T00:06:38.547 INFO:tasks.workunit.client.0.smithi026.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T00:06:38.547 INFO:tasks.workunit.client.0.smithi026.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T00:06:38.547 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr: git switch -c 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr:Or undo this operation with: 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr: git switch - 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-05-09T00:06:38.548 INFO:tasks.workunit.client.0.smithi026.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-09T00:06:38.554 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T00:06:38.610 INFO:tasks.workunit.client.0.smithi026.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T00:06:38.612 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T00:06:38.612 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T00:06:39.098 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T00:06:39.158 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T00:06:39.198 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T00:06:39.200 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T00:06:39.200 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T00:06:39.238 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T00:06:39.241 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-09T00:06:39.241 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T00:06:39.260 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-05-09T00:06:39.262 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-09T00:06:39.264 DEBUG:teuthology.orchestra.run.smithi026:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-05-09T00:06:39.324 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir -p fsstress 2024-05-09T00:06:39.325 INFO:tasks.workunit.client.0.smithi026.stderr:+ pushd fsstress 2024-05-09T00:06:39.326 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T00:06:39.326 INFO:tasks.workunit.client.0.smithi026.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-09T00:06:40.098 INFO:tasks.workunit.client.0.smithi026.stderr:+ tar xzf ltp-full.tgz 2024-05-09T00:06:40.288 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:38.584200+0000 mgr.smithi026.brymfp (mgr.14194) 287 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:40.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:38.584200+0000 mgr.smithi026.brymfp (mgr.14194) 287 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:41.067 INFO:tasks.workunit.client.1.smithi135.stderr:Updating files: 87% (10787/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-09T00:06:41.523 INFO:tasks.workunit.client.1.smithi135.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-09T00:06:41.523 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-05-09T00:06:41.523 INFO:tasks.workunit.client.1.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr: git switch -c 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr:Or undo this operation with: 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr: git switch - 2024-05-09T00:06:41.524 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-05-09T00:06:41.525 INFO:tasks.workunit.client.1.smithi135.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T00:06:41.525 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-05-09T00:06:41.525 INFO:tasks.workunit.client.1.smithi135.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-09T00:06:41.531 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-09T00:06:41.611 INFO:tasks.workunit.client.1.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T00:06:41.613 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T00:06:41.613 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T00:06:41.815 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:40.440663+0000 mon.smithi026 (mon.0) 617 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:06:41.815 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:40.441610+0000 mon.smithi026 (mon.0) 618 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:41.815 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:40.584579+0000 mgr.smithi026.brymfp (mgr.14194) 288 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:40.440663+0000 mon.smithi026 (mon.0) 617 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:06:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:40.441610+0000 mon.smithi026 (mon.0) 618 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:41.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:40.584579+0000 mgr.smithi026.brymfp (mgr.14194) 288 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:42.628 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T00:06:42.744 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T00:06:42.784 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T00:06:42.785 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T00:06:42.785 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T00:06:42.827 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T00:06:42.830 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T00:06:42.830 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-09T00:06:42.889 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-05-09T00:06:42.891 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-09T00:06:42.891 DEBUG:teuthology.orchestra.run.smithi135:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-05-09T00:06:42.955 INFO:tasks.workunit.client.1.smithi135.stderr:+ mkdir -p fsstress 2024-05-09T00:06:42.957 INFO:tasks.workunit.client.1.smithi135.stderr:+ pushd fsstress 2024-05-09T00:06:42.957 INFO:tasks.workunit.client.1.smithi135.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T00:06:42.957 INFO:tasks.workunit.client.1.smithi135.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-09T00:06:43.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:42.584909+0000 mgr.smithi026.brymfp (mgr.14194) 289 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:43.896 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:42.584909+0000 mgr.smithi026.brymfp (mgr.14194) 289 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 11 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:43.982 INFO:tasks.workunit.client.1.smithi135.stderr:+ tar xzf ltp-full.tgz 2024-05-09T00:06:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:44.586161+0000 mgr.smithi026.brymfp (mgr.14194) 290 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 8.0 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 683 KiB/s wr, 1 op/s 2024-05-09T00:06:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:44.741749+0000 mon.smithi026 (mon.0) 619 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:06:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:45.264625+0000 mon.smithi026 (mon.0) 620 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:06:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:45.265618+0000 mon.smithi026 (mon.0) 621 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:06:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:45.272276+0000 mon.smithi026 (mon.0) 622 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:06:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:45.279768+0000 mon.smithi026 (mon.0) 623 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:45.894 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:45.285996+0000 mon.smithi026 (mon.0) 624 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr fail", "who": "smithi026.brymfp"}]: dispatch 2024-05-09T00:06:45.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:45.298857+0000 mon.smithi026 (mon.0) 625 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-05-09T00:06:45.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:45.299030+0000 mon.smithi026 (mon.0) 626 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "mgr fail", "who": "smithi026.brymfp"}]': finished 2024-05-09T00:06:45.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:45.299065+0000 mon.smithi026 (mon.0) 627 : cluster [DBG] mgrmap e19: smithi135.kkrhgf(active, starting, since 0.0124258s) 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:44.586161+0000 mgr.smithi026.brymfp (mgr.14194) 290 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 8.0 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 683 KiB/s wr, 1 op/s 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:44.741749+0000 mon.smithi026 (mon.0) 619 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:45.264625+0000 mon.smithi026 (mon.0) 620 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:45.265618+0000 mon.smithi026 (mon.0) 621 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:45.272276+0000 mon.smithi026 (mon.0) 622 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:45.279768+0000 mon.smithi026 (mon.0) 623 : audit [DBG] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:45.285996+0000 mon.smithi026 (mon.0) 624 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr fail", "who": "smithi026.brymfp"}]: dispatch 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:45.298857+0000 mon.smithi026 (mon.0) 625 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:45.299030+0000 mon.smithi026 (mon.0) 626 : audit [INF] from='mgr.14194 172.21.15.26:0/4269157718' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "mgr fail", "who": "smithi026.brymfp"}]': finished 2024-05-09T00:06:46.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:45.299065+0000 mon.smithi026 (mon.0) 627 : cluster [DBG] mgrmap e19: smithi135.kkrhgf(active, starting, since 0.0124258s) 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:47.880985+0000 mon.smithi026 (mon.0) 628 : cluster [INF] Active manager daemon smithi135.kkrhgf restarted 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:47.881322+0000 mon.smithi026 (mon.0) 629 : cluster [INF] Activating manager daemon smithi135.kkrhgf 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.882554+0000 mon.smithi135 (mon.1) 15 : audit [DBG] from='mgr.? 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:47.886885+0000 mon.smithi026 (mon.0) 630 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:47.887102+0000 mon.smithi026 (mon.0) 631 : cluster [DBG] mgrmap e20: smithi135.kkrhgf(active, starting, since 0.00595287s) 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.888077+0000 mon.smithi135 (mon.1) 16 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.888211+0000 mon.smithi135 (mon.1) 17 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.888346+0000 mon.smithi135 (mon.1) 18 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.888575+0000 mon.smithi135 (mon.1) 19 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:06:47.992 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.888892+0000 mon.smithi135 (mon.1) 20 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.889167+0000 mon.smithi135 (mon.1) 21 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.889466+0000 mon.smithi135 (mon.1) 22 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.889776+0000 mon.smithi135 (mon.1) 23 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr metadata", "who": "smithi135.kkrhgf", "id": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.889966+0000 mon.smithi135 (mon.1) 24 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.890159+0000 mon.smithi135 (mon.1) 25 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.890340+0000 mon.smithi135 (mon.1) 26 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.890522+0000 mon.smithi135 (mon.1) 27 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.890685+0000 mon.smithi135 (mon.1) 28 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.890864+0000 mon.smithi135 (mon.1) 29 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.891700+0000 mon.smithi135 (mon.1) 30 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.892180+0000 mon.smithi135 (mon.1) 31 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.892554+0000 mon.smithi135 (mon.1) 32 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:06:47.993 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.892746+0000 mon.smithi135 (mon.1) 33 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:06:47.994 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.893907+0000 mon.smithi135 (mon.1) 34 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/key"}]: dispatch 2024-05-09T00:06:47.994 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:47.894166+0000 mon.smithi135 (mon.1) 35 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:06:48.203 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:47.880985+0000 mon.smithi026 (mon.0) 628 : cluster [INF] Active manager daemon smithi135.kkrhgf restarted 2024-05-09T00:06:48.203 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:47.881322+0000 mon.smithi026 (mon.0) 629 : cluster [INF] Activating manager daemon smithi135.kkrhgf 2024-05-09T00:06:48.203 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.882554+0000 mon.smithi135 (mon.1) 15 : audit [DBG] from='mgr.? 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:06:48.203 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:47.886885+0000 mon.smithi026 (mon.0) 630 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-05-09T00:06:48.203 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:47.887102+0000 mon.smithi026 (mon.0) 631 : cluster [DBG] mgrmap e20: smithi135.kkrhgf(active, starting, since 0.00595287s) 2024-05-09T00:06:48.203 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.888077+0000 mon.smithi135 (mon.1) 16 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:06:48.203 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.888211+0000 mon.smithi135 (mon.1) 17 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.888346+0000 mon.smithi135 (mon.1) 18 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.888575+0000 mon.smithi135 (mon.1) 19 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.888892+0000 mon.smithi135 (mon.1) 20 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.889167+0000 mon.smithi135 (mon.1) 21 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.889466+0000 mon.smithi135 (mon.1) 22 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.889776+0000 mon.smithi135 (mon.1) 23 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr metadata", "who": "smithi135.kkrhgf", "id": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.889966+0000 mon.smithi135 (mon.1) 24 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.890159+0000 mon.smithi135 (mon.1) 25 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.890340+0000 mon.smithi135 (mon.1) 26 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.890522+0000 mon.smithi135 (mon.1) 27 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.890685+0000 mon.smithi135 (mon.1) 28 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.890864+0000 mon.smithi135 (mon.1) 29 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.891700+0000 mon.smithi135 (mon.1) 30 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:06:48.204 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.892180+0000 mon.smithi135 (mon.1) 31 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:06:48.205 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.892554+0000 mon.smithi135 (mon.1) 32 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:06:48.205 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.892746+0000 mon.smithi135 (mon.1) 33 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:06:48.205 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.893907+0000 mon.smithi135 (mon.1) 34 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/key"}]: dispatch 2024-05-09T00:06:48.205 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:47.894166+0000 mon.smithi135 (mon.1) 35 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:06:49.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:48.060657+0000 mon.smithi026 (mon.0) 632 : cluster [INF] Manager daemon smithi135.kkrhgf is now available 2024-05-09T00:06:49.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.080836+0000 mon.smithi026 (mon.0) 633 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:49.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.087859+0000 mon.smithi135 (mon.1) 36 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:49.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.107796+0000 mon.smithi135 (mon.1) 37 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:06:49.144 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.118253+0000 mon.smithi135 (mon.1) 38 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.kkrhgf/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:06:49.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.118587+0000 mon.smithi026 (mon.0) 634 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.kkrhgf/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:06:49.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.132358+0000 mon.smithi135 (mon.1) 39 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.kkrhgf/trash_purge_schedule"}]: dispatch 2024-05-09T00:06:49.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.132764+0000 mon.smithi026 (mon.0) 635 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.kkrhgf/trash_purge_schedule"}]: dispatch 2024-05-09T00:06:49.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.136026+0000 mon.smithi026 (mon.0) 636 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:49.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.690342+0000 mon.smithi026 (mon.0) 637 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:49.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:48.694369+0000 mon.smithi026 (mon.0) 638 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:49.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:48.060657+0000 mon.smithi026 (mon.0) 632 : cluster [INF] Manager daemon smithi135.kkrhgf is now available 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.080836+0000 mon.smithi026 (mon.0) 633 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.087859+0000 mon.smithi135 (mon.1) 36 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.107796+0000 mon.smithi135 (mon.1) 37 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.118253+0000 mon.smithi135 (mon.1) 38 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.kkrhgf/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.118587+0000 mon.smithi026 (mon.0) 634 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.kkrhgf/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.132358+0000 mon.smithi135 (mon.1) 39 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.kkrhgf/trash_purge_schedule"}]: dispatch 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.132764+0000 mon.smithi026 (mon.0) 635 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.kkrhgf/trash_purge_schedule"}]: dispatch 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.136026+0000 mon.smithi026 (mon.0) 636 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.690342+0000 mon.smithi026 (mon.0) 637 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:48.694369+0000 mon.smithi026 (mon.0) 638 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:50.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:06:48.640246+0000 mgr.smithi135.kkrhgf (mgr.24419) 1 : cephadm [INF] Deploying cephadm binary to smithi135 2024-05-09T00:06:50.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:06:48.660560+0000 mgr.smithi135.kkrhgf (mgr.24419) 2 : cephadm [INF] Deploying cephadm binary to smithi026 2024-05-09T00:06:50.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:48.944191+0000 mon.smithi026 (mon.0) 639 : cluster [DBG] mgrmap e21: smithi135.kkrhgf(active, since 1.06304s) 2024-05-09T00:06:50.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:48.953764+0000 mgr.smithi135.kkrhgf (mgr.24419) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:50.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:06:49.155588+0000 mgr.smithi135.kkrhgf (mgr.24419) 4 : cephadm [INF] [09/May/2024:00:06:49] ENGINE Bus STARTING 2024-05-09T00:06:50.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:06:49.284683+0000 mgr.smithi135.kkrhgf (mgr.24419) 5 : cephadm [INF] [09/May/2024:00:06:49] ENGINE Serving on http://172.21.15.135:8765 2024-05-09T00:06:50.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:06:48.640246+0000 mgr.smithi135.kkrhgf (mgr.24419) 1 : cephadm [INF] Deploying cephadm binary to smithi135 2024-05-09T00:06:50.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:06:48.660560+0000 mgr.smithi135.kkrhgf (mgr.24419) 2 : cephadm [INF] Deploying cephadm binary to smithi026 2024-05-09T00:06:50.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:48.944191+0000 mon.smithi026 (mon.0) 639 : cluster [DBG] mgrmap e21: smithi135.kkrhgf(active, since 1.06304s) 2024-05-09T00:06:50.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:48.953764+0000 mgr.smithi135.kkrhgf (mgr.24419) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:50.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:06:49.155588+0000 mgr.smithi135.kkrhgf (mgr.24419) 4 : cephadm [INF] [09/May/2024:00:06:49] ENGINE Bus STARTING 2024-05-09T00:06:50.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:06:49.284683+0000 mgr.smithi135.kkrhgf (mgr.24419) 5 : cephadm [INF] [09/May/2024:00:06:49] ENGINE Serving on http://172.21.15.135:8765 2024-05-09T00:06:51.228 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:06:49.434418+0000 mgr.smithi135.kkrhgf (mgr.24419) 6 : cephadm [INF] [09/May/2024:00:06:49] ENGINE Serving on https://172.21.15.135:7150 2024-05-09T00:06:51.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:06:49.434541+0000 mgr.smithi135.kkrhgf (mgr.24419) 7 : cephadm [INF] [09/May/2024:00:06:49] ENGINE Bus STARTED 2024-05-09T00:06:51.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:49.891796+0000 mgr.smithi135.kkrhgf (mgr.24419) 8 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:51.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:49.948148+0000 mon.smithi026 (mon.0) 640 : cluster [DBG] mgrmap e22: smithi135.kkrhgf(active, since 2s) 2024-05-09T00:06:51.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:50.100942+0000 mon.smithi135 (mon.1) 40 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:06:51.229 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:50.101459+0000 mon.smithi026 (mon.0) 641 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:06:51.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:06:49.434418+0000 mgr.smithi135.kkrhgf (mgr.24419) 6 : cephadm [INF] [09/May/2024:00:06:49] ENGINE Serving on https://172.21.15.135:7150 2024-05-09T00:06:51.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:06:49.434541+0000 mgr.smithi135.kkrhgf (mgr.24419) 7 : cephadm [INF] [09/May/2024:00:06:49] ENGINE Bus STARTED 2024-05-09T00:06:51.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:49.891796+0000 mgr.smithi135.kkrhgf (mgr.24419) 8 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:51.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:49.948148+0000 mon.smithi026 (mon.0) 640 : cluster [DBG] mgrmap e22: smithi135.kkrhgf(active, since 2s) 2024-05-09T00:06:51.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:50.100942+0000 mon.smithi135 (mon.1) 40 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:06:51.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:50.101459+0000 mon.smithi026 (mon.0) 641 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:06:52.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:50.948239+0000 mon.smithi026 (mon.0) 642 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:06:52.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:50.948300+0000 mon.smithi026 (mon.0) 643 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-05-09T00:06:52.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:50.949503+0000 mon.smithi135 (mon.1) 41 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:06:52.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:50.951869+0000 mon.smithi026 (mon.0) 644 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:06:52.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:51.929483+0000 mon.smithi026 (mon.0) 645 : cluster [DBG] Standby manager daemon smithi026.brymfp started 2024-05-09T00:06:52.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:51.931559+0000 mon.smithi026 (mon.0) 646 : audit [DBG] from='mgr.? 172.21.15.26:0/3865714948' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.brymfp/crt"}]: dispatch 2024-05-09T00:06:52.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:51.933504+0000 mon.smithi026 (mon.0) 647 : audit [DBG] from='mgr.? 172.21.15.26:0/3865714948' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:06:52.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:51.936285+0000 mon.smithi026 (mon.0) 648 : audit [DBG] from='mgr.? 172.21.15.26:0/3865714948' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.brymfp/key"}]: dispatch 2024-05-09T00:06:52.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:51.936721+0000 mon.smithi026 (mon.0) 649 : audit [DBG] from='mgr.? 172.21.15.26:0/3865714948' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:50.948239+0000 mon.smithi026 (mon.0) 642 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:50.948300+0000 mon.smithi026 (mon.0) 643 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:50.949503+0000 mon.smithi135 (mon.1) 41 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:50.951869+0000 mon.smithi026 (mon.0) 644 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:51.929483+0000 mon.smithi026 (mon.0) 645 : cluster [DBG] Standby manager daemon smithi026.brymfp started 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:51.931559+0000 mon.smithi026 (mon.0) 646 : audit [DBG] from='mgr.? 172.21.15.26:0/3865714948' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.brymfp/crt"}]: dispatch 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:51.933504+0000 mon.smithi026 (mon.0) 647 : audit [DBG] from='mgr.? 172.21.15.26:0/3865714948' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:51.936285+0000 mon.smithi026 (mon.0) 648 : audit [DBG] from='mgr.? 172.21.15.26:0/3865714948' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.brymfp/key"}]: dispatch 2024-05-09T00:06:52.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:51.936721+0000 mon.smithi026 (mon.0) 649 : audit [DBG] from='mgr.? 172.21.15.26:0/3865714948' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:06:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:51.892240+0000 mgr.smithi135.kkrhgf (mgr.24419) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:51.965917+0000 mon.smithi026 (mon.0) 650 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:06:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:51.965990+0000 mon.smithi026 (mon.0) 651 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-05-09T00:06:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:51.975349+0000 mon.smithi026 (mon.0) 652 : cluster [DBG] mgrmap e23: smithi135.kkrhgf(active, since 4s), standbys: smithi026.brymfp 2024-05-09T00:06:53.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:51.977377+0000 mon.smithi135 (mon.1) 42 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-09T00:06:53.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:51.892240+0000 mgr.smithi135.kkrhgf (mgr.24419) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:53.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:51.965917+0000 mon.smithi026 (mon.0) 650 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:06:53.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:51.965990+0000 mon.smithi026 (mon.0) 651 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-05-09T00:06:53.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:51.975349+0000 mon.smithi026 (mon.0) 652 : cluster [DBG] mgrmap e23: smithi135.kkrhgf(active, since 4s), standbys: smithi026.brymfp 2024-05-09T00:06:53.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:51.977377+0000 mon.smithi135 (mon.1) 42 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-09T00:06:54.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:53.065218+0000 mon.smithi026 (mon.0) 653 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:54.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:53.065218+0000 mon.smithi026 (mon.0) 653 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:55.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:53.892649+0000 mgr.smithi135.kkrhgf (mgr.24419) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:55.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:54.075134+0000 mon.smithi026 (mon.0) 654 : cluster [DBG] mgrmap e24: smithi135.kkrhgf(active, since 6s), standbys: smithi026.brymfp 2024-05-09T00:06:55.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:53.892649+0000 mgr.smithi135.kkrhgf (mgr.24419) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:06:55.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:54.075134+0000 mon.smithi026 (mon.0) 654 : cluster [DBG] mgrmap e24: smithi135.kkrhgf(active, since 6s), standbys: smithi026.brymfp 2024-05-09T00:06:56.609 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:55.173727+0000 mon.smithi026 (mon.0) 655 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.609 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:55.179719+0000 mon.smithi026 (mon.0) 656 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.609 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:55.494262+0000 mon.smithi026 (mon.0) 657 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.609 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:55.967548+0000 mon.smithi026 (mon.0) 658 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.609 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:55.972617+0000 mon.smithi026 (mon.0) 659 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:55.173727+0000 mon.smithi026 (mon.0) 655 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:55.179719+0000 mon.smithi026 (mon.0) 656 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:55.494262+0000 mon.smithi026 (mon.0) 657 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:55.967548+0000 mon.smithi026 (mon.0) 658 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:56.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:55.972617+0000 mon.smithi026 (mon.0) 659 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:06:57.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:55.893101+0000 mgr.smithi135.kkrhgf (mgr.24419) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 52 op/s 2024-05-09T00:06:57.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:56.520087+0000 mon.smithi026 (mon.0) 660 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:06:58.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:55.893101+0000 mgr.smithi135.kkrhgf (mgr.24419) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 52 op/s 2024-05-09T00:06:58.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:56.520087+0000 mon.smithi026 (mon.0) 660 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:06:58.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:56.520277+0000 mon.smithi135 (mon.1) 43 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:06:58.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:56.520465+0000 mon.smithi135 (mon.1) 44 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:06:58.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:57.479019+0000 mon.smithi026 (mon.0) 661 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:06:58.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:57.480785+0000 mon.smithi135 (mon.1) 45 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:06:58.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:57.893419+0000 mgr.smithi135.kkrhgf (mgr.24419) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 1.8 MiB/s wr, 45 op/s 2024-05-09T00:06:58.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:57.983768+0000 mon.smithi135 (mon.1) 46 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:06:58.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:57.986971+0000 mon.smithi135 (mon.1) 47 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:06:58.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:06:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:06:57.987148+0000 mon.smithi135 (mon.1) 48 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:06:58.901 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:56.520277+0000 mon.smithi135 (mon.1) 43 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:06:58.901 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:56.520465+0000 mon.smithi135 (mon.1) 44 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:06:58.901 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:57.479019+0000 mon.smithi026 (mon.0) 661 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:06:58.901 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:57.480785+0000 mon.smithi135 (mon.1) 45 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:06:58.902 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:57.893419+0000 mgr.smithi135.kkrhgf (mgr.24419) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 1.8 MiB/s wr, 45 op/s 2024-05-09T00:06:58.902 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:57.983768+0000 mon.smithi135 (mon.1) 46 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:06:58.902 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:57.986971+0000 mon.smithi135 (mon.1) 47 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:06:58.902 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:06:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:06:57.987148+0000 mon.smithi135 (mon.1) 48 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:07:01.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:06:59.893841+0000 mgr.smithi135.kkrhgf (mgr.24419) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 104 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 4.6 MiB/s wr, 366 op/s 2024-05-09T00:07:01.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.258803+0000 mon.smithi026 (mon.0) 662 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:01.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.265296+0000 mon.smithi026 (mon.0) 663 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:01.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.267340+0000 mon.smithi135 (mon.1) 49 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.267618+0000 mon.smithi026 (mon.0) 664 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.268493+0000 mon.smithi135 (mon.1) 50 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.268723+0000 mon.smithi026 (mon.0) 665 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.269549+0000 mon.smithi135 (mon.1) 51 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.269750+0000 mon.smithi026 (mon.0) 666 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:00.270440+0000 mgr.smithi135.kkrhgf (mgr.24419) 14 : cephadm [INF] Adjusting osd_memory_target on smithi026 to 1911M 2024-05-09T00:07:01.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:00.274486+0000 mon.smithi026 (mon.0) 667 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:06:59.893841+0000 mgr.smithi135.kkrhgf (mgr.24419) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 104 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 4.6 MiB/s wr, 366 op/s 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.258803+0000 mon.smithi026 (mon.0) 662 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.265296+0000 mon.smithi026 (mon.0) 663 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.267340+0000 mon.smithi135 (mon.1) 49 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.267618+0000 mon.smithi026 (mon.0) 664 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.268493+0000 mon.smithi135 (mon.1) 50 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.268723+0000 mon.smithi026 (mon.0) 665 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.269549+0000 mon.smithi135 (mon.1) 51 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.269750+0000 mon.smithi026 (mon.0) 666 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:00.270440+0000 mgr.smithi135.kkrhgf (mgr.24419) 14 : cephadm [INF] Adjusting osd_memory_target on smithi026 to 1911M 2024-05-09T00:07:01.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:00.274486+0000 mon.smithi026 (mon.0) 667 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:03.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:01.894237+0000 mgr.smithi135.kkrhgf (mgr.24419) 15 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 104 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 4.1 MiB/s wr, 328 op/s 2024-05-09T00:07:03.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:03.108183+0000 mon.smithi135 (mon.1) 52 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:07:03.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:01.894237+0000 mgr.smithi135.kkrhgf (mgr.24419) 15 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 104 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 4.1 MiB/s wr, 328 op/s 2024-05-09T00:07:03.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:03.108183+0000 mon.smithi135 (mon.1) 52 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:07:05.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:03.894640+0000 mgr.smithi135.kkrhgf (mgr.24419) 16 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 104 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 8.4 KiB/s rd, 3.5 MiB/s wr, 275 op/s 2024-05-09T00:07:05.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:03.990570+0000 mon.smithi026 (mon.0) 668 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:05.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:03.995922+0000 mon.smithi026 (mon.0) 669 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:05.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:04.683386+0000 mon.smithi026 (mon.0) 670 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:05.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:04.688117+0000 mon.smithi026 (mon.0) 671 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:05.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:03.894640+0000 mgr.smithi135.kkrhgf (mgr.24419) 16 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 104 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 8.4 KiB/s rd, 3.5 MiB/s wr, 275 op/s 2024-05-09T00:07:05.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:03.990570+0000 mon.smithi026 (mon.0) 668 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:05.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:03.995922+0000 mon.smithi026 (mon.0) 669 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:05.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:04.683386+0000 mon.smithi026 (mon.0) 670 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:05.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:04.688117+0000 mon.smithi026 (mon.0) 671 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.782+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1394285650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 msgr2=0x7f8edc0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.782+0000 7f8ee2c53700 1 --2- 172.21.15.26:0/1394285650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 0x7f8edc0f9110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f8ec80047f0 tx=0x7f8ec8009cb0).stop 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.782+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1394285650 shutdown_connections 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.782+0000 7f8ee2c53700 1 --2- 172.21.15.26:0/1394285650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 0x7f8edc0f9110 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.782+0000 7f8ee2c53700 1 --2- 172.21.15.26:0/1394285650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc0f7a10 0x7f8edc0f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.782+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1394285650 >> 172.21.15.26:0/1394285650 conn(0x7f8edc0f3150 msgr2=0x7f8edc0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.782+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1394285650 shutdown_connections 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.782+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1394285650 wait complete. 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8ee2c53700 1 Processor -- start 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8ee2c53700 1 -- start start 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8ee2c53700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc0f7a10 0x7f8edc108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8ee2c53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 0x7f8edc108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8ee2c53700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc108c30 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8ee2c53700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc108d70 con 0x7f8edc0f7a10 2024-05-09T00:07:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8edbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 0x7f8edc108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8edbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 0x7f8edc108680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49762/0 (socket says 172.21.15.26:49762) 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.783+0000 7f8edbfff700 1 -- 172.21.15.26:0/1097201110 learned_addr learned my addr 172.21.15.26:0/1097201110 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8ee09ef700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc0f7a10 0x7f8edc108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8edbfff700 1 -- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc0f7a10 msgr2=0x7f8edc108190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8edbfff700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc0f7a10 0x7f8edc108190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8edbfff700 1 -- 172.21.15.26:0/1097201110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8005040 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8edbfff700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 0x7f8edc108680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f8ec800b120 tx=0x7f8ec8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/1097201110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec800e030 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc062760 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/1097201110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ec8007e90 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/1097201110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec8018070 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.784+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc062d20 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.785+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc05fb50 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.786+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/1097201110 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f8ec801d960 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.786+0000 7f8ed9ffb700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8ecc066dc0 0x7f8ecc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.787+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/1097201110 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f8ec80859a0 con 0x7f8edc0f8cb0 2024-05-09T00:07:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.787+0000 7f8ee09ef700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8ecc066dc0 0x7f8ecc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:05.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.787+0000 7f8ee09ef700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8ecc066dc0 0x7f8ecc069280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8edc0f8b10 tx=0x7f8ed0009040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:05.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:05.794+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/1097201110 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f8ec8053a40 con 0x7f8edc0f8cb0 2024-05-09T00:07:06.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.047+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8edc1020e0 con 0x7f8ecc066dc0 2024-05-09T00:07:06.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.049+0000 7f8ed9ffb700 1 -- 172.21.15.26:0/1097201110 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8edc1020e0 con 0x7f8ecc066dc0 2024-05-09T00:07:06.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8ecc066dc0 msgr2=0x7f8ecc069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8ecc066dc0 0x7f8ecc069280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8edc0f8b10 tx=0x7f8ed0009040).stop 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 msgr2=0x7f8edc108680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 0x7f8edc108680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f8ec800b120 tx=0x7f8ec8009cb0).stop 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 shutdown_connections 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8ecc066dc0 0x7f8ecc069280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8edc0f7a10 0x7f8edc108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 --2- 172.21.15.26:0/1097201110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8edc0f8cb0 0x7f8edc108680 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 >> 172.21.15.26:0/1097201110 conn(0x7f8edc0f3150 msgr2=0x7f8edc0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 shutdown_connections 2024-05-09T00:07:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.052+0000 7f8ee2c53700 1 -- 172.21.15.26:0/1097201110 wait complete. 2024-05-09T00:07:06.058 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:07:06.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.166+0000 7fa3f2499700 1 -- 172.21.15.26:0/1138250018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec061280 msgr2=0x7fa3ec0fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.166+0000 7fa3f2499700 1 --2- 172.21.15.26:0/1138250018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec061280 0x7fa3ec0fa3d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fa3dc0047f0 tx=0x7fa3dc009cb0).stop 2024-05-09T00:07:06.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.166+0000 7fa3f2499700 1 -- 172.21.15.26:0/1138250018 shutdown_connections 2024-05-09T00:07:06.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.166+0000 7fa3f2499700 1 --2- 172.21.15.26:0/1138250018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec0fa950 0x7fa3ec0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.166+0000 7fa3f2499700 1 --2- 172.21.15.26:0/1138250018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec061280 0x7fa3ec0fa3d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.166+0000 7fa3f2499700 1 -- 172.21.15.26:0/1138250018 >> 172.21.15.26:0/1138250018 conn(0x7fa3ec0f1e50 msgr2=0x7fa3ec0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:06.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.166+0000 7fa3f2499700 1 -- 172.21.15.26:0/1138250018 shutdown_connections 2024-05-09T00:07:06.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.167+0000 7fa3f2499700 1 -- 172.21.15.26:0/1138250018 wait complete. 2024-05-09T00:07:06.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.167+0000 7fa3f2499700 1 Processor -- start 2024-05-09T00:07:06.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.167+0000 7fa3f2499700 1 -- start start 2024-05-09T00:07:06.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3f2499700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec061280 0x7fa3ec108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3f2499700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0fa950 0x7fa3ec108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3f2499700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec108b20 con 0x7fa3ec0fa950 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3f2499700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec108c60 con 0x7fa3ec061280 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0fa950 0x7fa3ec108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0fa950 0x7fa3ec108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49770/0 (socket says 172.21.15.26:49770) 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3eb7fe700 1 -- 172.21.15.26:0/3938027702 learned_addr learned my addr 172.21.15.26:0/3938027702 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3ebfff700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec061280 0x7fa3ec108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3eb7fe700 1 -- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec061280 msgr2=0x7fa3ec108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3eb7fe700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec061280 0x7fa3ec108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3eb7fe700 1 -- 172.21.15.26:0/3938027702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc005040 con 0x7fa3ec0fa950 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.168+0000 7fa3eb7fe700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0fa950 0x7fa3ec108570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fa3e000e8c0 tx=0x7fa3e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.169+0000 7fa3e97fa700 1 -- 172.21.15.26:0/3938027702 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e0007b40 con 0x7fa3ec0fa950 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.169+0000 7fa3e97fa700 1 -- 172.21.15.26:0/3938027702 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa3e000f040 con 0x7fa3ec0fa950 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.169+0000 7fa3e97fa700 1 -- 172.21.15.26:0/3938027702 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e0014880 con 0x7fa3ec0fa950 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.169+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec10d700 con 0x7fa3ec0fa950 2024-05-09T00:07:06.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.169+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec10dcc0 con 0x7fa3ec0fa950 2024-05-09T00:07:06.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.170+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec0fffe0 con 0x7fa3ec0fa950 2024-05-09T00:07:06.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.171+0000 7fa3e97fa700 1 -- 172.21.15.26:0/3938027702 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fa3e0007ca0 con 0x7fa3ec0fa950 2024-05-09T00:07:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.171+0000 7fa3e97fa700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa3d4066dc0 0x7fa3d4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.172+0000 7fa3e97fa700 1 -- 172.21.15.26:0/3938027702 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fa3e0083c10 con 0x7fa3ec0fa950 2024-05-09T00:07:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.172+0000 7fa3ebfff700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa3d4066dc0 0x7fa3d4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:06.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.172+0000 7fa3ebfff700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa3d4066dc0 0x7fa3d4069280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa3dc0047c0 tx=0x7fa3dc009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:06.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.177+0000 7fa3e97fa700 1 -- 172.21.15.26:0/3938027702 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7fa3e0051d30 con 0x7fa3ec0fa950 2024-05-09T00:07:06.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.402+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3ec059120 con 0x7fa3d4066dc0 2024-05-09T00:07:06.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.404+0000 7fa3e97fa700 1 -- 172.21.15.26:0/3938027702 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa3ec059120 con 0x7fa3d4066dc0 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa3d4066dc0 msgr2=0x7fa3d4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa3d4066dc0 0x7fa3d4069280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa3dc0047c0 tx=0x7fa3dc009cb0).stop 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0fa950 msgr2=0x7fa3ec108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0fa950 0x7fa3ec108570 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fa3e000e8c0 tx=0x7fa3e000b040).stop 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 shutdown_connections 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa3d4066dc0 0x7fa3d4069280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3ec061280 0x7fa3ec108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 --2- 172.21.15.26:0/3938027702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa3ec0fa950 0x7fa3ec108570 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 >> 172.21.15.26:0/3938027702 conn(0x7fa3ec0f1e50 msgr2=0x7fa3ec0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 shutdown_connections 2024-05-09T00:07:06.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.406+0000 7fa3f2499700 1 -- 172.21.15.26:0/3938027702 wait complete. 2024-05-09T00:07:06.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 -- 172.21.15.26:0/503689436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 msgr2=0x7f6a340ff110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 --2- 172.21.15.26:0/503689436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 0x7f6a340ff110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f6a200047f0 tx=0x7f6a20009cb0).stop 2024-05-09T00:07:06.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 -- 172.21.15.26:0/503689436 shutdown_connections 2024-05-09T00:07:06.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 --2- 172.21.15.26:0/503689436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 0x7f6a340ff110 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 --2- 172.21.15.26:0/503689436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a34061220 0x7f6a340fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 -- 172.21.15.26:0/503689436 >> 172.21.15.26:0/503689436 conn(0x7f6a340f1e50 msgr2=0x7f6a340f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 -- 172.21.15.26:0/503689436 shutdown_connections 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 -- 172.21.15.26:0/503689436 wait complete. 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.513+0000 7f6a3adff700 1 Processor -- start 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a3adff700 1 -- start start 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a3adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a34061220 0x7f6a3410a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a3adff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 0x7f6a3410a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a3adff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3410ad30 con 0x7f6a340fcd20 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a3adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3410ae70 con 0x7f6a34061220 2024-05-09T00:07:06.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a33fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 0x7f6a3410a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a38b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a34061220 0x7f6a3410a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a33fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 0x7f6a3410a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49794/0 (socket says 172.21.15.26:49794) 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a33fff700 1 -- 172.21.15.26:0/3859002256 learned_addr learned my addr 172.21.15.26:0/3859002256 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a38b9b700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a34061220 0x7f6a3410a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:57048/0 (socket says 172.21.15.26:57048) 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a33fff700 1 -- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a34061220 msgr2=0x7f6a3410a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a33fff700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a34061220 0x7f6a3410a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a33fff700 1 -- 172.21.15.26:0/3859002256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20005040 con 0x7f6a340fcd20 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a38b9b700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a34061220 0x7f6a3410a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.514+0000 7f6a33fff700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 0x7f6a3410a780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f6a20013560 tx=0x7f6a20009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.515+0000 7f6a31ffb700 1 -- 172.21.15.26:0/3859002256 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a20018070 con 0x7f6a340fcd20 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.515+0000 7f6a31ffb700 1 -- 172.21.15.26:0/3859002256 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a20007e90 con 0x7f6a340fcd20 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.515+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3410f8b0 con 0x7f6a340fcd20 2024-05-09T00:07:06.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.515+0000 7f6a31ffb700 1 -- 172.21.15.26:0/3859002256 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a2001c380 con 0x7f6a340fcd20 2024-05-09T00:07:06.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.515+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3410fe70 con 0x7f6a340fcd20 2024-05-09T00:07:06.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.516+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a341021b0 con 0x7f6a340fcd20 2024-05-09T00:07:06.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.516+0000 7f6a31ffb700 1 -- 172.21.15.26:0/3859002256 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f6a200123c0 con 0x7f6a340fcd20 2024-05-09T00:07:06.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.517+0000 7f6a31ffb700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f6a24066e10 0x7f6a240692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.517+0000 7f6a31ffb700 1 -- 172.21.15.26:0/3859002256 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f6a20084ba0 con 0x7f6a340fcd20 2024-05-09T00:07:06.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.517+0000 7f6a38b9b700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f6a24066e10 0x7f6a240692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:06.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.517+0000 7f6a38b9b700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f6a24066e10 0x7f6a240692d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6a28007bf0 tx=0x7f6a2800b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:06.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.522+0000 7f6a31ffb700 1 -- 172.21.15.26:0/3859002256 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f6a20052d40 con 0x7f6a340fcd20 2024-05-09T00:07:06.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.744+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a34059120 con 0x7f6a24066e10 2024-05-09T00:07:06.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.755+0000 7f6a31ffb700 1 -- 172.21.15.26:0/3859002256 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6a34059120 con 0x7f6a24066e10 2024-05-09T00:07:06.750 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:07:06.750 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (6m) 11s ago 7m 23.8M - 0.23.0 ba2b418f427c e4c5eae7b44c 2024-05-09T00:07:06.750 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (7m) 11s ago 7m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:07:06.750 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (7m) 2s ago 7m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:07:06.750 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (6m) 11s ago 7m 58.1M - 8.3.5 dad864ee21e9 0d0dbb754a90 2024-05-09T00:07:06.750 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (2m) 11s ago 2m 12.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (2m) 11s ago 2m 106M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (2m) 2s ago 2m 12.6M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (2m) 2s ago 2m 12.4M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:9283 running (9m) 11s ago 9m 320M - 16.2.15-1-g8963e9de 727f386679cb 405cee21e657 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (27s) 2s ago 7m 479M - 18.2.2-1322-gd21e4f96 af23193ff691 8681491889c9 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (9m) 11s ago 9m 48.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (7m) 2s ago 7m 40.7M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (7m) 11s ago 7m 25.3M - 1.3.1 1dbe0e931976 eb62f1a664c9 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (6m) 2s ago 6m 25.8M - 1.3.1 1dbe0e931976 0ef67083c290 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (6m) 11s ago 6m 82.7M 1911M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (5m) 11s ago 5m 81.8M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (5m) 11s ago 5m 67.7M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (5m) 2s ago 5m 87.4M 4982M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (4m) 2s ago 4m 84.2M 4982M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:07:06.751 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (4m) 2s ago 4m 82.1M 4982M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:07:06.752 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (6m) 2s ago 6m 62.8M - 2.33.4 514e6a882f6e dbc569e4b23d 2024-05-09T00:07:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f6a24066e10 msgr2=0x7f6a240692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f6a24066e10 0x7f6a240692d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6a28007bf0 tx=0x7f6a2800b040).stop 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 msgr2=0x7f6a3410a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 0x7f6a3410a780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f6a20013560 tx=0x7f6a20009cb0).stop 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 shutdown_connections 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f6a24066e10 0x7f6a240692d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a34061220 0x7f6a3410a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 --2- 172.21.15.26:0/3859002256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a340fcd20 0x7f6a3410a780 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 >> 172.21.15.26:0/3859002256 conn(0x7f6a340f1e50 msgr2=0x7f6a340f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 shutdown_connections 2024-05-09T00:07:06.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.757+0000 7f6a3adff700 1 -- 172.21.15.26:0/3859002256 wait complete. 2024-05-09T00:07:06.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.872+0000 7f02eabc2700 1 -- 172.21.15.26:0/2178093942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f7990 msgr2=0x7f02e40f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.872+0000 7f02eabc2700 1 --2- 172.21.15.26:0/2178093942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f7990 0x7f02e40f7df0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f02d00047f0 tx=0x7f02d0009cb0).stop 2024-05-09T00:07:06.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.872+0000 7f02eabc2700 1 -- 172.21.15.26:0/2178093942 shutdown_connections 2024-05-09T00:07:06.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.872+0000 7f02eabc2700 1 --2- 172.21.15.26:0/2178093942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f7990 0x7f02e40f7df0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.872+0000 7f02eabc2700 1 --2- 172.21.15.26:0/2178093942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e40f66f0 0x7f02e40f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.872+0000 7f02eabc2700 1 -- 172.21.15.26:0/2178093942 >> 172.21.15.26:0/2178093942 conn(0x7f02e40f1e50 msgr2=0x7f02e40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:06.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.872+0000 7f02eabc2700 1 -- 172.21.15.26:0/2178093942 shutdown_connections 2024-05-09T00:07:06.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.872+0000 7f02eabc2700 1 -- 172.21.15.26:0/2178093942 wait complete. 2024-05-09T00:07:06.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02eabc2700 1 Processor -- start 2024-05-09T00:07:06.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02eabc2700 1 -- start start 2024-05-09T00:07:06.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02eabc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f66f0 0x7f02e4061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02eabc2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e40f7990 0x7f02e410f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02eabc2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e4108c50 con 0x7f02e40f66f0 2024-05-09T00:07:06.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02eabc2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e410f760 con 0x7f02e40f7990 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02e895e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f66f0 0x7f02e4061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02e895e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f66f0 0x7f02e4061040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49808/0 (socket says 172.21.15.26:49808) 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02e895e700 1 -- 172.21.15.26:0/2753778589 learned_addr learned my addr 172.21.15.26:0/2753778589 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.873+0000 7f02e3fff700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e40f7990 0x7f02e410f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02e895e700 1 -- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e40f7990 msgr2=0x7f02e410f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02e895e700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e40f7990 0x7f02e410f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02e895e700 1 -- 172.21.15.26:0/2753778589 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0005040 con 0x7f02e40f66f0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02e895e700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f66f0 0x7f02e4061040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f02d800e8c0 tx=0x7f02d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02e1ffb700 1 -- 172.21.15.26:0/2753778589 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02d8007b40 con 0x7f02e40f66f0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e410f900 con 0x7f02e40f66f0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02e1ffb700 1 -- 172.21.15.26:0/2753778589 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02d800f040 con 0x7f02e40f66f0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02e1ffb700 1 -- 172.21.15.26:0/2753778589 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02d8014880 con 0x7f02e40f66f0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.874+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e410fe90 con 0x7f02e40f66f0 2024-05-09T00:07:06.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.876+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e40feeb0 con 0x7f02e40f66f0 2024-05-09T00:07:06.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.876+0000 7f02e1ffb700 1 -- 172.21.15.26:0/2753778589 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f02d8014ab0 con 0x7f02e40f66f0 2024-05-09T00:07:06.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.876+0000 7f02e1ffb700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f02d4066dc0 0x7f02d4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:06.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.876+0000 7f02e1ffb700 1 -- 172.21.15.26:0/2753778589 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f02d8083f30 con 0x7f02e40f66f0 2024-05-09T00:07:06.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.876+0000 7f02e3fff700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f02d4066dc0 0x7f02d4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:06.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.877+0000 7f02e3fff700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f02d4066dc0 0x7f02d4069280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f02d00047c0 tx=0x7f02d0009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:06.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:06.881+0000 7f02e1ffb700 1 -- 172.21.15.26:0/2753778589 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f02d80b74a0 con 0x7f02e40f66f0 2024-05-09T00:07:07.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:05.895125+0000 mgr.smithi135.kkrhgf (mgr.24419) 17 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 122 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 8.3 KiB/s rd, 5.0 MiB/s wr, 394 op/s 2024-05-09T00:07:07.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:06.050100+0000 mgr.smithi135.kkrhgf (mgr.24419) 18 : audit [DBG] from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:07.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.220+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f02e4100d20 con 0x7f02e40f66f0 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.220+0000 7f02e1ffb700 1 -- 172.21.15.26:0/2753778589 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f02d8052050 con 0x7f02e40f66f0 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:07:07.216 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:07:07.217 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f02d4066dc0 msgr2=0x7f02d4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f02d4066dc0 0x7f02d4069280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f02d00047c0 tx=0x7f02d0009cb0).stop 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f66f0 msgr2=0x7f02e4061040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f66f0 0x7f02e4061040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f02d800e8c0 tx=0x7f02d800b040).stop 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 shutdown_connections 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f02d4066dc0 0x7f02d4069280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02e40f66f0 0x7f02e4061040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 --2- 172.21.15.26:0/2753778589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02e40f7990 0x7f02e410f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 >> 172.21.15.26:0/2753778589 conn(0x7f02e40f1e50 msgr2=0x7f02e40fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 shutdown_connections 2024-05-09T00:07:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.223+0000 7f02eabc2700 1 -- 172.21.15.26:0/2753778589 wait complete. 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 -- 172.21.15.26:0/2269232065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 msgr2=0x7f79100fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 --2- 172.21.15.26:0/2269232065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 0x7f79100fa3d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f79000047f0 tx=0x7f7900009cb0).stop 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 -- 172.21.15.26:0/2269232065 shutdown_connections 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 --2- 172.21.15.26:0/2269232065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79100fa950 0x7f79100fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 --2- 172.21.15.26:0/2269232065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 0x7f79100fa3d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 -- 172.21.15.26:0/2269232065 >> 172.21.15.26:0/2269232065 conn(0x7f79100f1e50 msgr2=0x7f79100f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 -- 172.21.15.26:0/2269232065 shutdown_connections 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 -- 172.21.15.26:0/2269232065 wait complete. 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.339+0000 7f7916183700 1 Processor -- start 2024-05-09T00:07:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f7916183700 1 -- start start 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f7916183700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 0x7f79100f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f7916183700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79100fa950 0x7f79100f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f7916183700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79100f8220 con 0x7f7910061280 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f7916183700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79100f67c0 con 0x7f79100fa950 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f790f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 0x7f79100f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f790f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 0x7f79100f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49836/0 (socket says 172.21.15.26:49836) 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f790f7fe700 1 -- 172.21.15.26:0/163195121 learned_addr learned my addr 172.21.15.26:0/163195121 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f790effd700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79100fa950 0x7f79100f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f790f7fe700 1 -- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79100fa950 msgr2=0x7f79100f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f790f7fe700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79100fa950 0x7f79100f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f790f7fe700 1 -- 172.21.15.26:0/163195121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900005040 con 0x7f7910061280 2024-05-09T00:07:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.340+0000 7f790f7fe700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 0x7f79100f7c70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f7900013620 tx=0x7f7900009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.341+0000 7f790cff9700 1 -- 172.21.15.26:0/163195121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790000e070 con 0x7f7910061280 2024-05-09T00:07:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.341+0000 7f790cff9700 1 -- 172.21.15.26:0/163195121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7900007e90 con 0x7f7910061280 2024-05-09T00:07:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.341+0000 7f790cff9700 1 -- 172.21.15.26:0/163195121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7900018070 con 0x7f7910061280 2024-05-09T00:07:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.341+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79100f69e0 con 0x7f7910061280 2024-05-09T00:07:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.341+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79100f6ef0 con 0x7f7910061280 2024-05-09T00:07:07.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.342+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7910047540 con 0x7f7910061280 2024-05-09T00:07:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.342+0000 7f790cff9700 1 -- 172.21.15.26:0/163195121 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f790001d420 con 0x7f7910061280 2024-05-09T00:07:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.343+0000 7f790cff9700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f78f8066dc0 0x7f78f8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.343+0000 7f790cff9700 1 -- 172.21.15.26:0/163195121 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f7900085590 con 0x7f7910061280 2024-05-09T00:07:07.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.344+0000 7f790effd700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f78f8066dc0 0x7f78f8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.344+0000 7f790effd700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f78f8066dc0 0x7f78f8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7910061050 tx=0x7f790400b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:07.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.348+0000 7f790cff9700 1 -- 172.21.15.26:0/163195121 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f79000535f0 con 0x7f7910061280 2024-05-09T00:07:07.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:05.895125+0000 mgr.smithi135.kkrhgf (mgr.24419) 17 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 122 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 8.3 KiB/s rd, 5.0 MiB/s wr, 394 op/s 2024-05-09T00:07:07.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:06.050100+0000 mgr.smithi135.kkrhgf (mgr.24419) 18 : audit [DBG] from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.631+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7910101e50 con 0x7f7910061280 2024-05-09T00:07:07.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.632+0000 7f790cff9700 1 -- 172.21.15.26:0/163195121 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7f79000531e0 con 0x7f7910061280 2024-05-09T00:07:07.627 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:07:07.627 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:07:07.628 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:07:07.629 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:07:07.630 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:07:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f78f8066dc0 msgr2=0x7f78f8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f78f8066dc0 0x7f78f8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7910061050 tx=0x7f790400b040).stop 2024-05-09T00:07:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 msgr2=0x7f79100f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 0x7f79100f7c70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f7900013620 tx=0x7f7900009cb0).stop 2024-05-09T00:07:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 shutdown_connections 2024-05-09T00:07:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f78f8066dc0 0x7f78f8069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7910061280 0x7f79100f7c70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 --2- 172.21.15.26:0/163195121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79100fa950 0x7f79100f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 >> 172.21.15.26:0/163195121 conn(0x7f79100f1e50 msgr2=0x7f79100f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.634+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 shutdown_connections 2024-05-09T00:07:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.635+0000 7f7916183700 1 -- 172.21.15.26:0/163195121 wait complete. 2024-05-09T00:07:07.632 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:07:07.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.741+0000 7f5413595700 1 -- 172.21.15.26:0/3901790829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c061220 msgr2=0x7f540c0fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.741+0000 7f5413595700 1 --2- 172.21.15.26:0/3901790829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c061220 0x7f540c0fa430 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f54080047f0 tx=0x7f5408009cb0).stop 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.741+0000 7f5413595700 1 -- 172.21.15.26:0/3901790829 shutdown_connections 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.741+0000 7f5413595700 1 --2- 172.21.15.26:0/3901790829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c0fa9b0 0x7f540c0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.741+0000 7f5413595700 1 --2- 172.21.15.26:0/3901790829 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c061220 0x7f540c0fa430 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.741+0000 7f5413595700 1 -- 172.21.15.26:0/3901790829 >> 172.21.15.26:0/3901790829 conn(0x7f540c0f1e50 msgr2=0x7f540c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.741+0000 7f5413595700 1 -- 172.21.15.26:0/3901790829 shutdown_connections 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.741+0000 7f5413595700 1 -- 172.21.15.26:0/3901790829 wait complete. 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.742+0000 7f5413595700 1 Processor -- start 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.742+0000 7f5413595700 1 -- start start 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.742+0000 7f5413595700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c061220 0x7f540c108090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.742+0000 7f5413595700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c0fa9b0 0x7f540c108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.742+0000 7f5413595700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c108b30 con 0x7f540c0fa9b0 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.742+0000 7f5413595700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c108c70 con 0x7f540c061220 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5410b30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c0fa9b0 0x7f540c108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:07.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5411331700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c061220 0x7f540c108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:07.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5410b30700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c0fa9b0 0x7f540c108580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49840/0 (socket says 172.21.15.26:49840) 2024-05-09T00:07:07.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5411331700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c061220 0x7f540c108090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:57100/0 (socket says 172.21.15.26:57100) 2024-05-09T00:07:07.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5410b30700 1 -- 172.21.15.26:0/322317901 learned_addr learned my addr 172.21.15.26:0/322317901 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:07.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5410b30700 1 -- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c061220 msgr2=0x7f540c108090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5410b30700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c061220 0x7f540c108090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5410b30700 1 -- 172.21.15.26:0/322317901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408005040 con 0x7f540c0fa9b0 2024-05-09T00:07:07.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5411331700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c061220 0x7f540c108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:07:07.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5410b30700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c0fa9b0 0x7f540c108580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f53fc00e8c0 tx=0x7f53fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:07.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f54027fc700 1 -- 172.21.15.26:0/322317901 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53fc007b40 con 0x7f540c0fa9b0 2024-05-09T00:07:07.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f54027fc700 1 -- 172.21.15.26:0/322317901 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53fc00f040 con 0x7f540c0fa9b0 2024-05-09T00:07:07.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c10d710 con 0x7f540c0fa9b0 2024-05-09T00:07:07.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f54027fc700 1 -- 172.21.15.26:0/322317901 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53fc014880 con 0x7f540c0fa9b0 2024-05-09T00:07:07.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.743+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c10dcd0 con 0x7f540c0fa9b0 2024-05-09T00:07:07.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.745+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0fffe0 con 0x7f540c0fa9b0 2024-05-09T00:07:07.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.745+0000 7f54027fc700 1 -- 172.21.15.26:0/322317901 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f53fc007ca0 con 0x7f540c0fa9b0 2024-05-09T00:07:07.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.745+0000 7f54027fc700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f53f8066dc0 0x7f53f8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:07.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.746+0000 7f54027fc700 1 -- 172.21.15.26:0/322317901 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f53fc083cd0 con 0x7f540c0fa9b0 2024-05-09T00:07:07.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.746+0000 7f5411331700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f53f8066dc0 0x7f53f8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:07.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.746+0000 7f5411331700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f53f8066dc0 0x7f53f8069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5408009bc0 tx=0x7f5408009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:07.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.752+0000 7f54027fc700 1 -- 172.21.15.26:0/322317901 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f53fc051d70 con 0x7f540c0fa9b0 2024-05-09T00:07:07.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.976+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f540c059120 con 0x7f53f8066dc0 2024-05-09T00:07:07.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.977+0000 7f54027fc700 1 -- 172.21.15.26:0/322317901 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f540c059120 con 0x7f53f8066dc0 2024-05-09T00:07:07.972 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:07:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:07:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:07:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:07:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [], 2024-05-09T00:07:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "1/21 daemons upgraded", 2024-05-09T00:07:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "", 2024-05-09T00:07:07.973 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:07:07.973 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f53f8066dc0 msgr2=0x7f53f8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f53f8066dc0 0x7f53f8069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5408009bc0 tx=0x7f5408009cb0).stop 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c0fa9b0 msgr2=0x7f540c108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c0fa9b0 0x7f540c108580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f53fc00e8c0 tx=0x7f53fc00b040).stop 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 shutdown_connections 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f53f8066dc0 0x7f53f8069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c061220 0x7f540c108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 --2- 172.21.15.26:0/322317901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540c0fa9b0 0x7f540c108580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 >> 172.21.15.26:0/322317901 conn(0x7f540c0f1e50 msgr2=0x7f540c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 shutdown_connections 2024-05-09T00:07:07.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:07.979+0000 7f5413595700 1 -- 172.21.15.26:0/322317901 wait complete. 2024-05-09T00:07:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.109+0000 7f49d22db700 1 -- 172.21.15.26:0/2467505485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 msgr2=0x7f49cc0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.109+0000 7f49d22db700 1 --2- 172.21.15.26:0/2467505485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 0x7f49cc0fcda0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f49c00047f0 tx=0x7f49c0009cb0).stop 2024-05-09T00:07:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.109+0000 7f49d22db700 1 -- 172.21.15.26:0/2467505485 shutdown_connections 2024-05-09T00:07:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.109+0000 7f49d22db700 1 --2- 172.21.15.26:0/2467505485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 0x7f49cc0fcda0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.109+0000 7f49d22db700 1 --2- 172.21.15.26:0/2467505485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49cc061280 0x7f49cc0fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.109+0000 7f49d22db700 1 -- 172.21.15.26:0/2467505485 >> 172.21.15.26:0/2467505485 conn(0x7f49cc0f1e50 msgr2=0x7f49cc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.109+0000 7f49d22db700 1 -- 172.21.15.26:0/2467505485 shutdown_connections 2024-05-09T00:07:08.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.109+0000 7f49d22db700 1 -- 172.21.15.26:0/2467505485 wait complete. 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.110+0000 7f49d22db700 1 Processor -- start 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.110+0000 7f49d22db700 1 -- start start 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.110+0000 7f49d22db700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49cc061280 0x7f49cc0f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.110+0000 7f49d22db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 0x7f49cc0f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.110+0000 7f49d22db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0f8220 con 0x7f49cc0fa950 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.110+0000 7f49d22db700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0f67c0 con 0x7f49cc061280 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 0x7f49cc0f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 0x7f49cc0f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49846/0 (socket says 172.21.15.26:49846) 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cb7fe700 1 -- 172.21.15.26:0/1454612858 learned_addr learned my addr 172.21.15.26:0/1454612858 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:08.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cbfff700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49cc061280 0x7f49cc0f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cb7fe700 1 -- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49cc061280 msgr2=0x7f49cc0f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cb7fe700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49cc061280 0x7f49cc0f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cb7fe700 1 -- 172.21.15.26:0/1454612858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0005040 con 0x7f49cc0fa950 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cbfff700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49cc061280 0x7f49cc0f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49cb7fe700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 0x7f49cc0f62d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f49c0013560 tx=0x7f49c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49c9775700 1 -- 172.21.15.26:0/1454612858 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c0018070 con 0x7f49cc0fa950 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49c9775700 1 -- 172.21.15.26:0/1454612858 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49c0007e90 con 0x7f49cc0fa950 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49c9775700 1 -- 172.21.15.26:0/1454612858 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c001c380 con 0x7f49cc0fa950 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc0f69e0 con 0x7f49cc0fa950 2024-05-09T00:07:08.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.111+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc0f6f40 con 0x7f49cc0fa950 2024-05-09T00:07:08.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.113+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc0fffb0 con 0x7f49cc0fa950 2024-05-09T00:07:08.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.113+0000 7f49c9775700 1 -- 172.21.15.26:0/1454612858 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f49c00123c0 con 0x7f49cc0fa950 2024-05-09T00:07:08.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.114+0000 7f49c9775700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f49b4066dc0 0x7f49b4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:08.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.114+0000 7f49c9775700 1 -- 172.21.15.26:0/1454612858 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f49c0085090 con 0x7f49cc0fa950 2024-05-09T00:07:08.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.114+0000 7f49cbfff700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f49b4066dc0 0x7f49b4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.114+0000 7f49cbfff700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f49b4066dc0 0x7f49b4069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f49bc007bf0 tx=0x7f49bc00b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:08.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.119+0000 7f49c9775700 1 -- 172.21.15.26:0/1454612858 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f49c0053130 con 0x7f49cc0fa950 2024-05-09T00:07:08.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:06.405027+0000 mgr.smithi135.kkrhgf (mgr.24419) 19 : audit [DBG] from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:08.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:06.746823+0000 mgr.smithi135.kkrhgf (mgr.24419) 20 : audit [DBG] from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:08.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:07.221936+0000 mon.smithi026 (mon.0) 672 : audit [DBG] from='client.? 172.21.15.26:0/2753778589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:07:08.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:07.633272+0000 mon.smithi026 (mon.0) 673 : audit [DBG] from='client.? 172.21.15.26:0/163195121' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:07:08.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:06.405027+0000 mgr.smithi135.kkrhgf (mgr.24419) 19 : audit [DBG] from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:08.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:06.746823+0000 mgr.smithi135.kkrhgf (mgr.24419) 20 : audit [DBG] from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:08.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:07.221936+0000 mon.smithi026 (mon.0) 672 : audit [DBG] from='client.? 172.21.15.26:0/2753778589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:07:08.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:07.633272+0000 mon.smithi026 (mon.0) 673 : audit [DBG] from='client.? 172.21.15.26:0/163195121' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:07:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.438+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f49cc0598f0 con 0x7f49cc0fa950 2024-05-09T00:07:08.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.439+0000 7f49c9775700 1 -- 172.21.15.26:0/1454612858 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f49c0052d20 con 0x7f49cc0fa950 2024-05-09T00:07:08.434 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:07:08.434 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:07:08.434 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:07:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f49b4066dc0 msgr2=0x7f49b4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f49b4066dc0 0x7f49b4069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f49bc007bf0 tx=0x7f49bc00b040).stop 2024-05-09T00:07:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 msgr2=0x7f49cc0f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 0x7f49cc0f62d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f49c0013560 tx=0x7f49c0009cb0).stop 2024-05-09T00:07:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 shutdown_connections 2024-05-09T00:07:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f49b4066dc0 0x7f49b4069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49cc061280 0x7f49cc0f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 --2- 172.21.15.26:0/1454612858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49cc0fa950 0x7f49cc0f62d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 >> 172.21.15.26:0/1454612858 conn(0x7f49cc0f1e50 msgr2=0x7f49cc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 shutdown_connections 2024-05-09T00:07:08.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:08.441+0000 7f49d22db700 1 -- 172.21.15.26:0/1454612858 wait complete. 2024-05-09T00:07:09.180 INFO:tasks.workunit.client.0.smithi026.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-09T00:07:09.181 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T00:07:09.181 INFO:tasks.workunit.client.0.smithi026.stderr:+ make 2024-05-09T00:07:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:07.895480+0000 mgr.smithi135.kkrhgf (mgr.24419) 21 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 122 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3.9 MiB/s wr, 364 op/s 2024-05-09T00:07:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:07.978407+0000 mgr.smithi135.kkrhgf (mgr.24419) 22 : audit [DBG] from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:09.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:08 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:08.440486+0000 mon.smithi026 (mon.0) 674 : audit [DBG] from='client.? 172.21.15.26:0/1454612858' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:07:09.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:07.895480+0000 mgr.smithi135.kkrhgf (mgr.24419) 21 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 122 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3.9 MiB/s wr, 364 op/s 2024-05-09T00:07:09.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:07.978407+0000 mgr.smithi135.kkrhgf (mgr.24419) 22 : audit [DBG] from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:09.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:08 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:08.440486+0000 mon.smithi026 (mon.0) 674 : audit [DBG] from='client.? 172.21.15.26:0/1454612858' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:07:09.695 INFO:tasks.workunit.client.0.smithi026.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-09T00:07:11.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.718726+0000 mon.smithi026 (mon.0) 675 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:11.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.724165+0000 mon.smithi026 (mon.0) 676 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.725638+0000 mon.smithi135 (mon.1) 53 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.725885+0000 mon.smithi026 (mon.0) 677 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.726609+0000 mon.smithi135 (mon.1) 54 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.726823+0000 mon.smithi026 (mon.0) 678 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.727520+0000 mon.smithi135 (mon.1) 55 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.727741+0000 mon.smithi026 (mon.0) 679 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:09.728297+0000 mgr.smithi135.kkrhgf (mgr.24419) 23 : cephadm [INF] Adjusting osd_memory_target on smithi135 to 2251M 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.731517+0000 mon.smithi026 (mon.0) 680 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.733502+0000 mon.smithi135 (mon.1) 56 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:09.734080+0000 mon.smithi135 (mon.1) 57 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:09.735030+0000 mgr.smithi135.kkrhgf (mgr.24419) 24 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:07:11.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:09.735186+0000 mgr.smithi135.kkrhgf (mgr.24419) 25 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:07:11.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:09.895904+0000 mgr.smithi135.kkrhgf (mgr.24419) 26 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 132 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.8 MiB/s wr, 373 op/s 2024-05-09T00:07:11.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:09.999450+0000 mgr.smithi135.kkrhgf (mgr.24419) 27 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:07:11.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:09.999595+0000 mgr.smithi135.kkrhgf (mgr.24419) 28 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:07:11.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:10.263699+0000 mgr.smithi135.kkrhgf (mgr.24419) 29 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.718726+0000 mon.smithi026 (mon.0) 675 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.724165+0000 mon.smithi026 (mon.0) 676 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.725638+0000 mon.smithi135 (mon.1) 53 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.725885+0000 mon.smithi026 (mon.0) 677 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.726609+0000 mon.smithi135 (mon.1) 54 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.726823+0000 mon.smithi026 (mon.0) 678 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.727520+0000 mon.smithi135 (mon.1) 55 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.727741+0000 mon.smithi026 (mon.0) 679 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:09.728297+0000 mgr.smithi135.kkrhgf (mgr.24419) 23 : cephadm [INF] Adjusting osd_memory_target on smithi135 to 2251M 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.731517+0000 mon.smithi026 (mon.0) 680 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.733502+0000 mon.smithi135 (mon.1) 56 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:07:11.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:09.734080+0000 mon.smithi135 (mon.1) 57 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:07:11.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:09.735030+0000 mgr.smithi135.kkrhgf (mgr.24419) 24 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:07:11.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:09.735186+0000 mgr.smithi135.kkrhgf (mgr.24419) 25 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:07:11.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:09.895904+0000 mgr.smithi135.kkrhgf (mgr.24419) 26 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 132 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.8 MiB/s wr, 373 op/s 2024-05-09T00:07:11.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:09.999450+0000 mgr.smithi135.kkrhgf (mgr.24419) 27 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:07:11.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:09.999595+0000 mgr.smithi135.kkrhgf (mgr.24419) 28 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:07:11.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:10.263699+0000 mgr.smithi135.kkrhgf (mgr.24419) 29 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:07:12.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:10.527789+0000 mgr.smithi135.kkrhgf (mgr.24419) 30 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:07:12.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:10.796487+0000 mon.smithi026 (mon.0) 681 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:12.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:10.801234+0000 mon.smithi026 (mon.0) 682 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:12.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:10.865900+0000 mgr.smithi135.kkrhgf (mgr.24419) 31 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:07:12.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:11.235001+0000 mgr.smithi135.kkrhgf (mgr.24419) 32 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:07:12.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:10.527789+0000 mgr.smithi135.kkrhgf (mgr.24419) 30 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:07:12.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:10.796487+0000 mon.smithi026 (mon.0) 681 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:12.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:10.801234+0000 mon.smithi026 (mon.0) 682 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:12.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:10.865900+0000 mgr.smithi135.kkrhgf (mgr.24419) 31 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:07:12.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:11.235001+0000 mgr.smithi135.kkrhgf (mgr.24419) 32 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:07:12.756 INFO:tasks.workunit.client.1.smithi135.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-09T00:07:12.757 INFO:tasks.workunit.client.1.smithi135.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T00:07:12.757 INFO:tasks.workunit.client.1.smithi135.stderr:+ make 2024-05-09T00:07:13.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:11.896250+0000 mgr.smithi135.kkrhgf (mgr.24419) 33 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 132 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s wr, 129 op/s 2024-05-09T00:07:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:12.139318+0000 mon.smithi026 (mon.0) 683 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:12.160167+0000 mon.smithi026 (mon.0) 684 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:12.180733+0000 mon.smithi026 (mon.0) 685 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:12.381306+0000 mon.smithi026 (mon.0) 686 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:12.394853+0000 mon.smithi026 (mon.0) 687 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:12.404585+0000 mon.smithi026 (mon.0) 688 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:12.418767+0000 mon.smithi026 (mon.0) 689 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:11.896250+0000 mgr.smithi135.kkrhgf (mgr.24419) 33 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 132 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s wr, 129 op/s 2024-05-09T00:07:13.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:12.139318+0000 mon.smithi026 (mon.0) 683 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:12.160167+0000 mon.smithi026 (mon.0) 684 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:12.180733+0000 mon.smithi026 (mon.0) 685 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:12.381306+0000 mon.smithi026 (mon.0) 686 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:12.394853+0000 mon.smithi026 (mon.0) 687 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:12.404585+0000 mon.smithi026 (mon.0) 688 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:13.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:12.418767+0000 mon.smithi026 (mon.0) 689 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:07:14.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:12.422458+0000 mgr.smithi135.kkrhgf (mgr.24419) 34 : cephadm [INF] Reconfiguring alertmanager.smithi026 (dependencies changed)... 2024-05-09T00:07:14.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:07:12.433849+0000 mgr.smithi135.kkrhgf (mgr.24419) 35 : cephadm [INF] Reconfiguring daemon alertmanager.smithi026 on smithi026 2024-05-09T00:07:14.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:12.422458+0000 mgr.smithi135.kkrhgf (mgr.24419) 34 : cephadm [INF] Reconfiguring alertmanager.smithi026 (dependencies changed)... 2024-05-09T00:07:14.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:07:12.433849+0000 mgr.smithi135.kkrhgf (mgr.24419) 35 : cephadm [INF] Reconfiguring daemon alertmanager.smithi026 on smithi026 2024-05-09T00:07:15.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:13.899593+0000 mgr.smithi135.kkrhgf (mgr.24419) 36 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 132 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s wr, 129 op/s 2024-05-09T00:07:15.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:13.899593+0000 mgr.smithi135.kkrhgf (mgr.24419) 36 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 132 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s wr, 129 op/s 2024-05-09T00:07:17.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:15.900328+0000 mgr.smithi135.kkrhgf (mgr.24419) 37 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 180 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 791 op/s 2024-05-09T00:07:17.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:15.900328+0000 mgr.smithi135.kkrhgf (mgr.24419) 37 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 180 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 791 op/s 2024-05-09T00:07:18.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:18.108538+0000 mon.smithi135 (mon.1) 58 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:07:18.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:18.108538+0000 mon.smithi135 (mon.1) 58 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:07:19.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:17.900725+0000 mgr.smithi135.kkrhgf (mgr.24419) 38 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 180 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 670 op/s 2024-05-09T00:07:19.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:17.900725+0000 mgr.smithi135.kkrhgf (mgr.24419) 38 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 180 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 670 op/s 2024-05-09T00:07:21.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:19.901426+0000 mgr.smithi135.kkrhgf (mgr.24419) 39 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.5 MiB/s wr, 998 op/s 2024-05-09T00:07:21.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:19.901426+0000 mgr.smithi135.kkrhgf (mgr.24419) 39 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.5 MiB/s wr, 998 op/s 2024-05-09T00:07:21.779 INFO:tasks.workunit.client.0.smithi026.stderr:++ readlink -f fsstress 2024-05-09T00:07:21.779 INFO:tasks.workunit.client.0.smithi026.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-09T00:07:21.779 INFO:tasks.workunit.client.0.smithi026.stderr:+ popd 2024-05-09T00:07:21.780 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T00:07:21.780 INFO:tasks.workunit.client.0.smithi026.stderr:+ popd 2024-05-09T00:07:21.780 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp 2024-05-09T00:07:21.780 INFO:tasks.workunit.client.0.smithi026.stderr:++ mktemp -d -p . 2024-05-09T00:07:21.782 INFO:tasks.workunit.client.0.smithi026.stderr:+ T=./tmp.lNzgA45L2o 2024-05-09T00:07:21.782 INFO:tasks.workunit.client.0.smithi026.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.lNzgA45L2o -l 1 -n 1000 -p 10 -v 2024-05-09T00:07:21.784 INFO:tasks.workunit.client.0.smithi026.stdout:seed = 1714422426 2024-05-09T00:07:21.793 INFO:tasks.workunit.client.0.smithi026.stdout:0/0: symlink l0 0 2024-05-09T00:07:21.797 INFO:tasks.workunit.client.0.smithi026.stdout:1/0: creat f0 x:0 0 0 2024-05-09T00:07:21.797 INFO:tasks.workunit.client.0.smithi026.stdout:1/1: chown f0 1 1 2024-05-09T00:07:21.798 INFO:tasks.workunit.client.0.smithi026.stdout:0/1: mknod c1 0 2024-05-09T00:07:21.798 INFO:tasks.workunit.client.0.smithi026.stdout:0/2: chown c1 2630 1 2024-05-09T00:07:21.799 INFO:tasks.workunit.client.0.smithi026.stdout:0/3: dread - no filename 2024-05-09T00:07:21.799 INFO:tasks.workunit.client.0.smithi026.stdout:0/4: write - no filename 2024-05-09T00:07:21.799 INFO:tasks.workunit.client.0.smithi026.stdout:0/5: fsync - no filename 2024-05-09T00:07:21.799 INFO:tasks.workunit.client.0.smithi026.stdout:0/6: stat l0 0 2024-05-09T00:07:21.799 INFO:tasks.workunit.client.0.smithi026.stdout:0/7: truncate - no filename 2024-05-09T00:07:21.800 INFO:tasks.workunit.client.0.smithi026.stdout:3/0: fsync - no filename 2024-05-09T00:07:21.800 INFO:tasks.workunit.client.0.smithi026.stdout:3/1: dwrite - no filename 2024-05-09T00:07:21.804 INFO:tasks.workunit.client.0.smithi026.stdout:0/8: link c1 c2 0 2024-05-09T00:07:21.804 INFO:tasks.workunit.client.0.smithi026.stdout:0/9: fsync - no filename 2024-05-09T00:07:21.804 INFO:tasks.workunit.client.0.smithi026.stdout:0/10: dwrite - no filename 2024-05-09T00:07:21.806 INFO:tasks.workunit.client.0.smithi026.stdout:4/0: fsync - no filename 2024-05-09T00:07:21.806 INFO:tasks.workunit.client.0.smithi026.stdout:4/1: dwrite - no filename 2024-05-09T00:07:21.806 INFO:tasks.workunit.client.0.smithi026.stdout:4/2: link - no file 2024-05-09T00:07:21.806 INFO:tasks.workunit.client.0.smithi026.stdout:4/3: dread - no filename 2024-05-09T00:07:21.807 INFO:tasks.workunit.client.0.smithi026.stdout:3/2: creat f0 x:0 0 0 2024-05-09T00:07:21.807 INFO:tasks.workunit.client.0.smithi026.stdout:3/3: chown f0 8205301 1 2024-05-09T00:07:21.809 INFO:tasks.workunit.client.0.smithi026.stdout:0/11: link c2 c3 0 2024-05-09T00:07:21.809 INFO:tasks.workunit.client.0.smithi026.stdout:0/12: fsync - no filename 2024-05-09T00:07:21.809 INFO:tasks.workunit.client.0.smithi026.stdout:0/13: dwrite - no filename 2024-05-09T00:07:21.809 INFO:tasks.workunit.client.0.smithi026.stdout:0/14: write - no filename 2024-05-09T00:07:21.812 INFO:tasks.workunit.client.0.smithi026.stdout:4/4: mkdir d0 0 2024-05-09T00:07:21.816 INFO:tasks.workunit.client.0.smithi026.stdout:0/15: creat f4 x:0 0 0 2024-05-09T00:07:21.818 INFO:tasks.workunit.client.0.smithi026.stdout:6/0: chown . 6333 1 2024-05-09T00:07:21.818 INFO:tasks.workunit.client.0.smithi026.stdout:6/1: dread - no filename 2024-05-09T00:07:21.818 INFO:tasks.workunit.client.0.smithi026.stdout:6/2: dwrite - no filename 2024-05-09T00:07:21.819 INFO:tasks.workunit.client.0.smithi026.stdout:5/0: symlink l0 0 2024-05-09T00:07:21.822 INFO:tasks.workunit.client.0.smithi026.stdout:4/5: creat d0/f1 x:0 0 0 2024-05-09T00:07:21.822 INFO:tasks.workunit.client.0.smithi026.stdout:4/6: chown d0/f1 124166275 1 2024-05-09T00:07:21.826 INFO:tasks.workunit.client.0.smithi026.stdout:0/16: creat f5 x:0 0 0 2024-05-09T00:07:21.827 INFO:tasks.workunit.client.0.smithi026.stdout:1/2: dwrite f0 [0,4194304] 0 2024-05-09T00:07:21.827 INFO:tasks.workunit.client.0.smithi026.stdout:6/3: symlink l0 0 2024-05-09T00:07:21.827 INFO:tasks.workunit.client.0.smithi026.stdout:6/4: dwrite - no filename 2024-05-09T00:07:21.830 INFO:tasks.workunit.client.0.smithi026.stdout:4/7: link d0/f1 d0/f2 0 2024-05-09T00:07:21.832 INFO:tasks.workunit.client.0.smithi026.stdout:0/17: link c2 c6 0 2024-05-09T00:07:21.833 INFO:tasks.workunit.client.0.smithi026.stdout:8/0: chown . 634472935 1 2024-05-09T00:07:21.834 INFO:tasks.workunit.client.0.smithi026.stdout:8/1: dwrite - no filename 2024-05-09T00:07:21.835 INFO:tasks.workunit.client.0.smithi026.stdout:7/0: symlink l0 0 2024-05-09T00:07:21.839 INFO:tasks.workunit.client.0.smithi026.stdout:1/3: link f0 f1 0 2024-05-09T00:07:21.841 INFO:tasks.workunit.client.0.smithi026.stdout:6/5: creat f1 x:0 0 0 2024-05-09T00:07:21.841 INFO:tasks.workunit.client.0.smithi026.stdout:6/6: read - f1 zero size 2024-05-09T00:07:21.846 INFO:tasks.workunit.client.0.smithi026.stdout:4/8: unlink d0/f1 0 2024-05-09T00:07:21.847 INFO:tasks.workunit.client.0.smithi026.stdout:0/18: creat f7 x:0 0 0 2024-05-09T00:07:21.850 INFO:tasks.workunit.client.0.smithi026.stdout:8/2: creat f0 x:0 0 0 2024-05-09T00:07:21.854 INFO:tasks.workunit.client.0.smithi026.stdout:1/4: unlink f0 0 2024-05-09T00:07:21.857 INFO:tasks.workunit.client.0.smithi026.stdout:6/7: link l0 l2 0 2024-05-09T00:07:21.860 INFO:tasks.workunit.client.0.smithi026.stdout:4/9: creat d0/f3 x:0 0 0 2024-05-09T00:07:21.860 INFO:tasks.workunit.client.0.smithi026.stdout:4/10: fdatasync d0/f2 0 2024-05-09T00:07:21.863 INFO:tasks.workunit.client.0.smithi026.stdout:9/0: mknod c0 0 2024-05-09T00:07:21.865 INFO:tasks.workunit.client.0.smithi026.stdout:8/3: dwrite f0 [0,4194304] 0 2024-05-09T00:07:21.866 INFO:tasks.workunit.client.0.smithi026.stdout:1/5: read f1 [2342707,17586] 0 2024-05-09T00:07:21.866 INFO:tasks.workunit.client.0.smithi026.stdout:4/11: symlink d0/l4 0 2024-05-09T00:07:21.869 INFO:tasks.workunit.client.0.smithi026.stdout:9/1: mknod c1 0 2024-05-09T00:07:21.877 INFO:tasks.workunit.client.0.smithi026.stdout:1/6: link f1 f2 0 2024-05-09T00:07:21.880 INFO:tasks.workunit.client.0.smithi026.stdout:9/2: creat f2 x:0 0 0 2024-05-09T00:07:21.880 INFO:tasks.workunit.client.0.smithi026.stdout:9/3: write f2 [835179,41777] 0 2024-05-09T00:07:21.880 INFO:tasks.workunit.client.0.smithi026.stdout:6/8: dwrite f1 [0,4194304] 0 2024-05-09T00:07:21.882 INFO:tasks.workunit.client.0.smithi026.stdout:1/7: creat f3 x:0 0 0 2024-05-09T00:07:21.883 INFO:tasks.workunit.client.0.smithi026.stdout:8/4: dwrite f0 [0,4194304] 0 2024-05-09T00:07:21.883 INFO:tasks.workunit.client.0.smithi026.stdout:8/5: chown f0 124301028 1 2024-05-09T00:07:21.884 INFO:tasks.workunit.client.0.smithi026.stdout:8/6: write f0 [1801075,102802] 0 2024-05-09T00:07:21.885 INFO:tasks.workunit.client.0.smithi026.stdout:1/8: read f1 [2598536,80604] 0 2024-05-09T00:07:21.887 INFO:tasks.workunit.client.0.smithi026.stdout:6/9: symlink l3 0 2024-05-09T00:07:21.891 INFO:tasks.workunit.client.0.smithi026.stdout:8/7: dread f0 [0,4194304] 0 2024-05-09T00:07:21.894 INFO:tasks.workunit.client.0.smithi026.stdout:1/9: link f3 f4 0 2024-05-09T00:07:21.895 INFO:tasks.workunit.client.0.smithi026.stdout:1/10: dread - f3 zero size 2024-05-09T00:07:21.896 INFO:tasks.workunit.client.0.smithi026.stdout:6/10: creat f4 x:0 0 0 2024-05-09T00:07:21.899 INFO:tasks.workunit.client.0.smithi026.stdout:8/8: creat f1 x:0 0 0 2024-05-09T00:07:21.899 INFO:tasks.workunit.client.0.smithi026.stdout:8/9: chown f1 1 1 2024-05-09T00:07:21.899 INFO:tasks.workunit.client.0.smithi026.stdout:8/10: stat f1 0 2024-05-09T00:07:21.899 INFO:tasks.workunit.client.0.smithi026.stdout:8/11: readlink - no filename 2024-05-09T00:07:21.899 INFO:tasks.workunit.client.0.smithi026.stdout:8/12: write f0 [1820844,83501] 0 2024-05-09T00:07:21.901 INFO:tasks.workunit.client.0.smithi026.stdout:1/11: mkdir d5 0 2024-05-09T00:07:21.901 INFO:tasks.workunit.client.0.smithi026.stdout:1/12: chown f3 217 1 2024-05-09T00:07:21.903 INFO:tasks.workunit.client.0.smithi026.stdout:1/13: symlink d5/l6 0 2024-05-09T00:07:21.907 INFO:tasks.workunit.client.0.smithi026.stdout:1/14: rename f1 to d5/f7 0 2024-05-09T00:07:21.918 INFO:tasks.workunit.client.0.smithi026.stdout:6/11: dwrite f1 [0,4194304] 0 2024-05-09T00:07:21.918 INFO:tasks.workunit.client.0.smithi026.stdout:6/12: write f4 [440494,91536] 0 2024-05-09T00:07:21.940 INFO:tasks.workunit.client.0.smithi026.stdout:6/13: dread f1 [0,4194304] 0 2024-05-09T00:07:21.940 INFO:tasks.workunit.client.0.smithi026.stdout:1/15: dwrite d5/f7 [0,4194304] 0 2024-05-09T00:07:21.940 INFO:tasks.workunit.client.0.smithi026.stdout:6/14: chown f1 2805921 1 2024-05-09T00:07:21.940 INFO:tasks.workunit.client.0.smithi026.stdout:1/16: write f3 [652230,68236] 0 2024-05-09T00:07:21.940 INFO:tasks.workunit.client.0.smithi026.stdout:6/15: write f4 [1538205,102808] 0 2024-05-09T00:07:21.943 INFO:tasks.workunit.client.0.smithi026.stdout:1/17: dread f4 [0,4194304] 0 2024-05-09T00:07:21.944 INFO:tasks.workunit.client.0.smithi026.stdout:1/18: write f2 [285783,24916] 0 2024-05-09T00:07:21.960 INFO:tasks.workunit.client.0.smithi026.stdout:6/16: mkdir d5 0 2024-05-09T00:07:21.960 INFO:tasks.workunit.client.0.smithi026.stdout:6/17: truncate f4 2211303 0 2024-05-09T00:07:21.962 INFO:tasks.workunit.client.0.smithi026.stdout:1/19: mknod d5/c8 0 2024-05-09T00:07:21.976 INFO:tasks.workunit.client.0.smithi026.stdout:1/20: dwrite f4 [0,4194304] 0 2024-05-09T00:07:21.981 INFO:tasks.workunit.client.0.smithi026.stdout:1/21: mknod d5/c9 0 2024-05-09T00:07:21.992 INFO:tasks.workunit.client.0.smithi026.stdout:1/22: dread f2 [0,4194304] 0 2024-05-09T00:07:21.994 INFO:tasks.workunit.client.0.smithi026.stdout:1/23: mknod d5/ca 0 2024-05-09T00:07:21.995 INFO:tasks.workunit.client.0.smithi026.stdout:1/24: write d5/f7 [1520536,120755] 0 2024-05-09T00:07:21.996 INFO:tasks.workunit.client.0.smithi026.stdout:1/25: write f4 [40215,3836] 0 2024-05-09T00:07:21.998 INFO:tasks.workunit.client.0.smithi026.stdout:1/26: fdatasync f4 0 2024-05-09T00:07:21.998 INFO:tasks.workunit.client.0.smithi026.stdout:1/27: stat d5/l6 0 2024-05-09T00:07:22.645 INFO:tasks.workunit.client.0.smithi026.stdout:3/4: fsync f0 0 2024-05-09T00:07:22.645 INFO:tasks.workunit.client.0.smithi026.stdout:3/5: chown f0 1420890 1 2024-05-09T00:07:22.645 INFO:tasks.workunit.client.0.smithi026.stdout:3/6: write f0 [517386,87950] 0 2024-05-09T00:07:22.647 INFO:tasks.workunit.client.0.smithi026.stdout:0/19: fsync f4 0 2024-05-09T00:07:22.647 INFO:tasks.workunit.client.0.smithi026.stdout:0/20: dread - f5 zero size 2024-05-09T00:07:22.648 INFO:tasks.workunit.client.0.smithi026.stdout:0/21: mknod c8 0 2024-05-09T00:07:22.648 INFO:tasks.workunit.client.0.smithi026.stdout:3/7: dread f0 [0,4194304] 0 2024-05-09T00:07:22.649 INFO:tasks.workunit.client.0.smithi026.stdout:3/8: symlink l1 0 2024-05-09T00:07:22.650 INFO:tasks.workunit.client.0.smithi026.stdout:3/9: creat f2 x:0 0 0 2024-05-09T00:07:22.651 INFO:tasks.workunit.client.0.smithi026.stdout:3/10: creat f3 x:0 0 0 2024-05-09T00:07:22.651 INFO:tasks.workunit.client.0.smithi026.stdout:3/11: dread - f2 zero size 2024-05-09T00:07:22.652 INFO:tasks.workunit.client.0.smithi026.stdout:3/12: mknod c4 0 2024-05-09T00:07:22.658 INFO:tasks.workunit.client.0.smithi026.stdout:7/1: getdents . 0 2024-05-09T00:07:22.658 INFO:tasks.workunit.client.0.smithi026.stdout:7/2: write - no filename 2024-05-09T00:07:22.658 INFO:tasks.workunit.client.0.smithi026.stdout:7/3: chown l0 236701 1 2024-05-09T00:07:22.658 INFO:tasks.workunit.client.0.smithi026.stdout:7/4: truncate - no filename 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/5: mknod c1 0 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/6: dwrite - no filename 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/7: dwrite - no filename 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/8: write - no filename 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/9: chown c1 544896157 1 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/10: rmdir - no directory 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/11: chown c1 570853952 1 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/12: truncate - no filename 2024-05-09T00:07:22.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/13: read - no filename 2024-05-09T00:07:22.660 INFO:tasks.workunit.client.0.smithi026.stdout:7/14: chown l0 3600687 1 2024-05-09T00:07:22.661 INFO:tasks.workunit.client.0.smithi026.stdout:7/15: rename l0 to l2 0 2024-05-09T00:07:22.663 INFO:tasks.workunit.client.0.smithi026.stdout:7/16: link c1 c3 0 2024-05-09T00:07:22.665 INFO:tasks.workunit.client.0.smithi026.stdout:7/17: mknod c4 0 2024-05-09T00:07:22.665 INFO:tasks.workunit.client.0.smithi026.stdout:7/18: dwrite - no filename 2024-05-09T00:07:22.666 INFO:tasks.workunit.client.0.smithi026.stdout:7/19: creat f5 x:0 0 0 2024-05-09T00:07:22.667 INFO:tasks.workunit.client.0.smithi026.stdout:7/20: unlink c3 0 2024-05-09T00:07:22.676 INFO:tasks.workunit.client.0.smithi026.stdout:4/12: getdents d0 0 2024-05-09T00:07:22.676 INFO:tasks.workunit.client.0.smithi026.stdout:4/13: write d0/f3 [16402,11371] 0 2024-05-09T00:07:22.677 INFO:tasks.workunit.client.0.smithi026.stdout:4/14: fdatasync d0/f2 0 2024-05-09T00:07:22.677 INFO:tasks.workunit.client.0.smithi026.stdout:4/15: dread - d0/f2 zero size 2024-05-09T00:07:22.684 INFO:tasks.workunit.client.0.smithi026.stdout:9/4: fsync f2 0 2024-05-09T00:07:22.685 INFO:tasks.workunit.client.0.smithi026.stdout:9/5: creat f3 x:0 0 0 2024-05-09T00:07:22.686 INFO:tasks.workunit.client.0.smithi026.stdout:9/6: link c0 c4 0 2024-05-09T00:07:22.687 INFO:tasks.workunit.client.0.smithi026.stdout:7/21: dwrite f5 [0,4194304] 0 2024-05-09T00:07:22.687 INFO:tasks.workunit.client.0.smithi026.stdout:6/18: write f1 [4718648,52717] 0 2024-05-09T00:07:22.689 INFO:tasks.workunit.client.0.smithi026.stdout:7/22: creat f6 x:0 0 0 2024-05-09T00:07:22.690 INFO:tasks.workunit.client.0.smithi026.stdout:7/23: creat f7 x:0 0 0 2024-05-09T00:07:22.690 INFO:tasks.workunit.client.0.smithi026.stdout:7/24: readlink l2 0 2024-05-09T00:07:22.690 INFO:tasks.workunit.client.0.smithi026.stdout:6/19: fdatasync f4 0 2024-05-09T00:07:22.693 INFO:tasks.workunit.client.0.smithi026.stdout:6/20: rmdir d5 0 2024-05-09T00:07:22.694 INFO:tasks.workunit.client.0.smithi026.stdout:6/21: readlink l3 0 2024-05-09T00:07:22.695 INFO:tasks.workunit.client.0.smithi026.stdout:7/25: mkdir d8 0 2024-05-09T00:07:22.696 INFO:tasks.workunit.client.0.smithi026.stdout:6/22: creat f6 x:0 0 0 2024-05-09T00:07:22.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/23: chown l0 163 1 2024-05-09T00:07:22.708 INFO:tasks.workunit.client.0.smithi026.stdout:9/7: dwrite f3 [0,4194304] 0 2024-05-09T00:07:22.708 INFO:tasks.workunit.client.0.smithi026.stdout:9/8: chown f2 500951387 1 2024-05-09T00:07:22.713 INFO:tasks.workunit.client.0.smithi026.stdout:9/9: mknod c5 0 2024-05-09T00:07:22.714 INFO:tasks.workunit.client.0.smithi026.stdout:9/10: creat f6 x:0 0 0 2024-05-09T00:07:22.730 INFO:tasks.workunit.client.0.smithi026.stdout:9/11: dwrite f6 [0,4194304] 0 2024-05-09T00:07:22.737 INFO:tasks.workunit.client.0.smithi026.stdout:9/12: mkdir d7 0 2024-05-09T00:07:22.747 INFO:tasks.workunit.client.0.smithi026.stdout:1/28: write f3 [4638841,26012] 0 2024-05-09T00:07:22.845 INFO:tasks.workunit.client.1.smithi135.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-09T00:07:22.854 INFO:tasks.workunit.client.0.smithi026.stdout:0/22: getdents . 0 2024-05-09T00:07:22.856 INFO:tasks.workunit.client.0.smithi026.stdout:0/23: symlink l9 0 2024-05-09T00:07:22.856 INFO:tasks.workunit.client.0.smithi026.stdout:0/24: chown f5 30560164 1 2024-05-09T00:07:22.857 INFO:tasks.workunit.client.0.smithi026.stdout:3/13: fsync f3 0 2024-05-09T00:07:22.857 INFO:tasks.workunit.client.0.smithi026.stdout:3/14: readlink l1 0 2024-05-09T00:07:22.857 INFO:tasks.workunit.client.0.smithi026.stdout:0/25: creat fa x:0 0 0 2024-05-09T00:07:22.858 INFO:tasks.workunit.client.0.smithi026.stdout:3/15: mkdir d5 0 2024-05-09T00:07:22.860 INFO:tasks.workunit.client.0.smithi026.stdout:0/26: link f7 fb 0 2024-05-09T00:07:22.861 INFO:tasks.workunit.client.0.smithi026.stdout:3/16: link l1 d5/l6 0 2024-05-09T00:07:22.861 INFO:tasks.workunit.client.0.smithi026.stdout:3/17: truncate f2 968236 0 2024-05-09T00:07:22.861 INFO:tasks.workunit.client.0.smithi026.stdout:3/18: truncate f3 967617 0 2024-05-09T00:07:22.863 INFO:tasks.workunit.client.0.smithi026.stdout:3/19: creat d5/f7 x:0 0 0 2024-05-09T00:07:22.864 INFO:tasks.workunit.client.0.smithi026.stdout:3/20: mkdir d5/d8 0 2024-05-09T00:07:22.864 INFO:tasks.workunit.client.0.smithi026.stdout:3/21: truncate f0 941674 0 2024-05-09T00:07:22.864 INFO:tasks.workunit.client.0.smithi026.stdout:3/22: fdatasync f3 0 2024-05-09T00:07:22.864 INFO:tasks.workunit.client.0.smithi026.stdout:3/23: truncate f3 1005083 0 2024-05-09T00:07:22.866 INFO:tasks.workunit.client.0.smithi026.stdout:3/24: unlink f3 0 2024-05-09T00:07:22.866 INFO:tasks.workunit.client.0.smithi026.stdout:3/25: stat d5/f7 0 2024-05-09T00:07:22.866 INFO:tasks.workunit.client.0.smithi026.stdout:3/26: write f2 [1840576,44496] 0 2024-05-09T00:07:22.869 INFO:tasks.workunit.client.0.smithi026.stdout:4/16: symlink d0/l5 0 2024-05-09T00:07:22.869 INFO:tasks.workunit.client.0.smithi026.stdout:9/13: fsync f3 0 2024-05-09T00:07:22.870 INFO:tasks.workunit.client.0.smithi026.stdout:4/17: fdatasync d0/f3 0 2024-05-09T00:07:22.870 INFO:tasks.workunit.client.0.smithi026.stdout:4/18: fdatasync d0/f3 0 2024-05-09T00:07:22.871 INFO:tasks.workunit.client.0.smithi026.stdout:9/14: link f6 d7/f8 0 2024-05-09T00:07:22.875 INFO:tasks.workunit.client.0.smithi026.stdout:6/24: truncate f1 4278869 0 2024-05-09T00:07:22.876 INFO:tasks.workunit.client.0.smithi026.stdout:6/25: link l2 l7 0 2024-05-09T00:07:22.877 INFO:tasks.workunit.client.0.smithi026.stdout:6/26: mknod c8 0 2024-05-09T00:07:22.877 INFO:tasks.workunit.client.0.smithi026.stdout:6/27: write f6 [578557,56843] 0 2024-05-09T00:07:22.877 INFO:tasks.workunit.client.0.smithi026.stdout:9/15: dread f2 [0,4194304] 0 2024-05-09T00:07:22.879 INFO:tasks.workunit.client.0.smithi026.stdout:6/28: creat f9 x:0 0 0 2024-05-09T00:07:22.879 INFO:tasks.workunit.client.0.smithi026.stdout:6/29: chown c8 168 1 2024-05-09T00:07:22.886 INFO:tasks.workunit.client.0.smithi026.stdout:9/16: dread f6 [0,4194304] 0 2024-05-09T00:07:22.886 INFO:tasks.workunit.client.0.smithi026.stdout:3/27: dwrite d5/f7 [0,4194304] 0 2024-05-09T00:07:22.886 INFO:tasks.workunit.client.0.smithi026.stdout:3/28: write f2 [2207572,15561] 0 2024-05-09T00:07:22.890 INFO:tasks.workunit.client.0.smithi026.stdout:0/27: getdents . 0 2024-05-09T00:07:22.890 INFO:tasks.workunit.client.0.smithi026.stdout:0/28: rmdir - no directory 2024-05-09T00:07:22.890 INFO:tasks.workunit.client.0.smithi026.stdout:0/29: truncate fa 718454 0 2024-05-09T00:07:22.892 INFO:tasks.workunit.client.0.smithi026.stdout:0/30: rename c1 to cc 0 2024-05-09T00:07:22.892 INFO:tasks.workunit.client.0.smithi026.stdout:0/31: chown cc 994944 1 2024-05-09T00:07:22.895 INFO:tasks.workunit.client.0.smithi026.stdout:0/32: link c8 cd 0 2024-05-09T00:07:22.896 INFO:tasks.workunit.client.0.smithi026.stdout:0/33: write f5 [207024,100501] 0 2024-05-09T00:07:22.897 INFO:tasks.workunit.client.0.smithi026.stdout:0/34: mknod ce 0 2024-05-09T00:07:22.897 INFO:tasks.workunit.client.0.smithi026.stdout:0/35: write fa [1113048,74708] 0 2024-05-09T00:07:22.899 INFO:tasks.workunit.client.0.smithi026.stdout:0/36: creat ff x:0 0 0 2024-05-09T00:07:22.901 INFO:tasks.workunit.client.0.smithi026.stdout:4/19: dwrite d0/f3 [0,4194304] 0 2024-05-09T00:07:22.904 INFO:tasks.workunit.client.0.smithi026.stdout:4/20: chown d0/l4 3 1 2024-05-09T00:07:22.906 INFO:tasks.workunit.client.0.smithi026.stdout:4/21: truncate d0/f2 240995 0 2024-05-09T00:07:22.907 INFO:tasks.workunit.client.0.smithi026.stdout:1/29: dwrite d5/f7 [0,4194304] 0 2024-05-09T00:07:22.907 INFO:tasks.workunit.client.0.smithi026.stdout:9/17: fsync d7/f8 0 2024-05-09T00:07:22.907 INFO:tasks.workunit.client.0.smithi026.stdout:9/18: fdatasync d7/f8 0 2024-05-09T00:07:22.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/29: dread f2 [0,4194304] 0 2024-05-09T00:07:22.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/30: chown f2 0 1 2024-05-09T00:07:22.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/31: chown f0 160988 1 2024-05-09T00:07:22.914 INFO:tasks.workunit.client.0.smithi026.stdout:0/37: dread fa [0,4194304] 0 2024-05-09T00:07:22.916 INFO:tasks.workunit.client.0.smithi026.stdout:3/32: write f2 [1083965,2598] 0 2024-05-09T00:07:22.916 INFO:tasks.workunit.client.0.smithi026.stdout:9/19: dread f2 [0,4194304] 0 2024-05-09T00:07:22.916 INFO:tasks.workunit.client.0.smithi026.stdout:6/30: dread f1 [0,4194304] 0 2024-05-09T00:07:22.916 INFO:tasks.workunit.client.0.smithi026.stdout:6/31: write f9 [402381,27295] 0 2024-05-09T00:07:22.916 INFO:tasks.workunit.client.0.smithi026.stdout:6/32: stat f6 0 2024-05-09T00:07:22.918 INFO:tasks.workunit.client.0.smithi026.stdout:9/20: creat d7/f9 x:0 0 0 2024-05-09T00:07:22.919 INFO:tasks.workunit.client.0.smithi026.stdout:4/22: write d0/f2 [812361,71408] 0 2024-05-09T00:07:22.919 INFO:tasks.workunit.client.0.smithi026.stdout:4/23: write d0/f2 [813721,114677] 0 2024-05-09T00:07:22.920 INFO:tasks.workunit.client.0.smithi026.stdout:0/38: dread fa [0,4194304] 0 2024-05-09T00:07:22.921 INFO:tasks.workunit.client.0.smithi026.stdout:4/24: rename d0/f3 to d0/f6 0 2024-05-09T00:07:22.923 INFO:tasks.workunit.client.0.smithi026.stdout:0/39: rename f7 to f10 0 2024-05-09T00:07:22.927 INFO:tasks.workunit.client.0.smithi026.stdout:4/25: fsync d0/f6 0 2024-05-09T00:07:22.928 INFO:tasks.workunit.client.0.smithi026.stdout:0/40: getdents . 0 2024-05-09T00:07:22.928 INFO:tasks.workunit.client.0.smithi026.stdout:0/41: truncate f10 475436 0 2024-05-09T00:07:22.930 INFO:tasks.workunit.client.0.smithi026.stdout:0/42: link fa f11 0 2024-05-09T00:07:22.931 INFO:tasks.workunit.client.0.smithi026.stdout:0/43: chown f4 13005 1 2024-05-09T00:07:22.932 INFO:tasks.workunit.client.0.smithi026.stdout:0/44: read - ff zero size 2024-05-09T00:07:22.932 INFO:tasks.workunit.client.0.smithi026.stdout:0/45: read - f4 zero size 2024-05-09T00:07:22.932 INFO:tasks.workunit.client.0.smithi026.stdout:0/46: chown f4 20 1 2024-05-09T00:07:22.978 INFO:tasks.workunit.client.0.smithi026.stdout:6/33: dwrite f4 [0,4194304] 0 2024-05-09T00:07:22.988 INFO:tasks.workunit.client.0.smithi026.stdout:1/30: dwrite f4 [4194304,4194304] 0 2024-05-09T00:07:22.988 INFO:tasks.workunit.client.0.smithi026.stdout:1/31: chown d5/ca 847 1 2024-05-09T00:07:22.988 INFO:tasks.workunit.client.0.smithi026.stdout:0/47: dwrite f4 [0,4194304] 0 2024-05-09T00:07:22.989 INFO:tasks.workunit.client.0.smithi026.stdout:1/32: rmdir d5 39 2024-05-09T00:07:22.990 INFO:tasks.workunit.client.0.smithi026.stdout:1/33: write f4 [3644385,76728] 0 2024-05-09T00:07:22.991 INFO:tasks.workunit.client.0.smithi026.stdout:0/48: truncate f10 1437528 0 2024-05-09T00:07:22.991 INFO:tasks.workunit.client.0.smithi026.stdout:3/33: dwrite f2 [0,4194304] 0 2024-05-09T00:07:22.993 INFO:tasks.workunit.client.0.smithi026.stdout:3/34: rmdir d5/d8 0 2024-05-09T00:07:22.993 INFO:tasks.workunit.client.0.smithi026.stdout:3/35: fsync f2 0 2024-05-09T00:07:22.994 INFO:tasks.workunit.client.0.smithi026.stdout:0/49: dread fa [0,4194304] 0 2024-05-09T00:07:22.996 INFO:tasks.workunit.client.0.smithi026.stdout:0/50: chown fb 2 1 2024-05-09T00:07:22.996 INFO:tasks.workunit.client.0.smithi026.stdout:9/21: dwrite f2 [0,4194304] 0 2024-05-09T00:07:22.996 INFO:tasks.workunit.client.0.smithi026.stdout:9/22: dread - d7/f9 zero size 2024-05-09T00:07:22.997 INFO:tasks.workunit.client.0.smithi026.stdout:9/23: write f6 [1477859,86836] 0 2024-05-09T00:07:22.997 INFO:tasks.workunit.client.0.smithi026.stdout:9/24: chown c0 3974 1 2024-05-09T00:07:22.999 INFO:tasks.workunit.client.0.smithi026.stdout:3/36: dread d5/f7 [0,4194304] 0 2024-05-09T00:07:23.000 INFO:tasks.workunit.client.0.smithi026.stdout:0/51: link ff f12 0 2024-05-09T00:07:23.001 INFO:tasks.workunit.client.0.smithi026.stdout:9/25: symlink d7/la 0 2024-05-09T00:07:23.001 INFO:tasks.workunit.client.0.smithi026.stdout:9/26: readlink d7/la 0 2024-05-09T00:07:23.003 INFO:tasks.workunit.client.0.smithi026.stdout:9/27: mknod d7/cb 0 2024-05-09T00:07:23.005 INFO:tasks.workunit.client.0.smithi026.stdout:0/52: symlink l13 0 2024-05-09T00:07:23.006 INFO:tasks.workunit.client.0.smithi026.stdout:1/34: dread d5/f7 [0,4194304] 0 2024-05-09T00:07:23.006 INFO:tasks.workunit.client.0.smithi026.stdout:1/35: chown d5 114226 1 2024-05-09T00:07:23.006 INFO:tasks.workunit.client.0.smithi026.stdout:1/36: chown d5/l6 120 1 2024-05-09T00:07:23.007 INFO:tasks.workunit.client.0.smithi026.stdout:1/37: getdents d5 0 2024-05-09T00:07:23.008 INFO:tasks.workunit.client.0.smithi026.stdout:1/38: mkdir d5/db 0 2024-05-09T00:07:23.008 INFO:tasks.workunit.client.0.smithi026.stdout:1/39: chown f4 46 1 2024-05-09T00:07:23.009 INFO:tasks.workunit.client.0.smithi026.stdout:1/40: chown d5/f7 276311760 1 2024-05-09T00:07:23.009 INFO:tasks.workunit.client.0.smithi026.stdout:1/41: stat d5/l6 0 2024-05-09T00:07:23.011 INFO:tasks.workunit.client.0.smithi026.stdout:6/34: dwrite f4 [0,4194304] 0 2024-05-09T00:07:23.013 INFO:tasks.workunit.client.0.smithi026.stdout:0/53: dread f5 [0,4194304] 0 2024-05-09T00:07:23.014 INFO:tasks.workunit.client.0.smithi026.stdout:6/35: creat fa x:0 0 0 2024-05-09T00:07:23.017 INFO:tasks.workunit.client.0.smithi026.stdout:6/36: stat l7 0 2024-05-09T00:07:23.020 INFO:tasks.workunit.client.0.smithi026.stdout:3/37: dwrite f2 [0,4194304] 0 2024-05-09T00:07:23.021 INFO:tasks.workunit.client.0.smithi026.stdout:3/38: dread f0 [0,4194304] 0 2024-05-09T00:07:23.025 INFO:tasks.workunit.client.0.smithi026.stdout:3/39: dread d5/f7 [0,4194304] 0 2024-05-09T00:07:23.026 INFO:tasks.workunit.client.0.smithi026.stdout:3/40: dread f0 [0,4194304] 0 2024-05-09T00:07:23.026 INFO:tasks.workunit.client.0.smithi026.stdout:9/28: dwrite d7/f8 [4194304,4194304] 0 2024-05-09T00:07:23.028 INFO:tasks.workunit.client.0.smithi026.stdout:3/41: mkdir d5/d9 0 2024-05-09T00:07:23.030 INFO:tasks.workunit.client.0.smithi026.stdout:9/29: creat d7/fc x:0 0 0 2024-05-09T00:07:23.032 INFO:tasks.workunit.client.0.smithi026.stdout:3/42: symlink d5/la 0 2024-05-09T00:07:23.034 INFO:tasks.workunit.client.0.smithi026.stdout:9/30: unlink d7/fc 0 2024-05-09T00:07:23.035 INFO:tasks.workunit.client.0.smithi026.stdout:3/43: creat d5/fb x:0 0 0 2024-05-09T00:07:23.037 INFO:tasks.workunit.client.0.smithi026.stdout:9/31: write f3 [3214485,88202] 0 2024-05-09T00:07:23.038 INFO:tasks.workunit.client.0.smithi026.stdout:0/54: dwrite f10 [0,4194304] 0 2024-05-09T00:07:23.039 INFO:tasks.workunit.client.0.smithi026.stdout:9/32: creat d7/fd x:0 0 0 2024-05-09T00:07:23.039 INFO:tasks.workunit.client.0.smithi026.stdout:9/33: dread - d7/fd zero size 2024-05-09T00:07:23.039 INFO:tasks.workunit.client.0.smithi026.stdout:9/34: readlink d7/la 0 2024-05-09T00:07:23.040 INFO:tasks.workunit.client.0.smithi026.stdout:9/35: read f2 [1602555,76652] 0 2024-05-09T00:07:23.040 INFO:tasks.workunit.client.0.smithi026.stdout:9/36: chown c4 190280 1 2024-05-09T00:07:23.040 INFO:tasks.workunit.client.0.smithi026.stdout:9/37: dread - d7/f9 zero size 2024-05-09T00:07:23.041 INFO:tasks.workunit.client.0.smithi026.stdout:0/55: creat f14 x:0 0 0 2024-05-09T00:07:23.043 INFO:tasks.workunit.client.0.smithi026.stdout:9/38: link f3 d7/fe 0 2024-05-09T00:07:23.046 INFO:tasks.workunit.client.0.smithi026.stdout:9/39: mknod d7/cf 0 2024-05-09T00:07:23.052 INFO:tasks.workunit.client.0.smithi026.stdout:9/40: getdents d7 0 2024-05-09T00:07:23.054 INFO:tasks.workunit.client.0.smithi026.stdout:3/44: dwrite d5/fb [0,4194304] 0 2024-05-09T00:07:23.055 INFO:tasks.workunit.client.0.smithi026.stdout:9/41: fdatasync f3 0 2024-05-09T00:07:23.057 INFO:tasks.workunit.client.0.smithi026.stdout:3/45: mkdir d5/d9/dc 0 2024-05-09T00:07:23.059 INFO:tasks.workunit.client.0.smithi026.stdout:0/56: dwrite fb [0,4194304] 0 2024-05-09T00:07:23.059 INFO:tasks.workunit.client.0.smithi026.stdout:0/57: write ff [158279,32404] 0 2024-05-09T00:07:23.059 INFO:tasks.workunit.client.0.smithi026.stdout:0/58: truncate f11 1639498 0 2024-05-09T00:07:23.108 INFO:tasks.workunit.client.1.smithi135.stderr:++ readlink -f fsstress 2024-05-09T00:07:23.109 INFO:tasks.workunit.client.1.smithi135.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-09T00:07:23.109 INFO:tasks.workunit.client.1.smithi135.stderr:+ popd 2024-05-09T00:07:23.109 INFO:tasks.workunit.client.1.smithi135.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T00:07:23.109 INFO:tasks.workunit.client.1.smithi135.stderr:+ popd 2024-05-09T00:07:23.110 INFO:tasks.workunit.client.1.smithi135.stdout:~/cephtest/mnt.1/client.1/tmp 2024-05-09T00:07:23.110 INFO:tasks.workunit.client.1.smithi135.stderr:++ mktemp -d -p . 2024-05-09T00:07:23.182 INFO:tasks.workunit.client.1.smithi135.stderr:+ T=./tmp.FmsGTl995D 2024-05-09T00:07:23.182 INFO:tasks.workunit.client.1.smithi135.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.FmsGTl995D -l 1 -n 1000 -p 10 -v 2024-05-09T00:07:23.183 INFO:tasks.workunit.client.1.smithi135.stdout:seed = 1715400903 2024-05-09T00:07:23.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/0: write - no filename 2024-05-09T00:07:23.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/1: dwrite - no filename 2024-05-09T00:07:23.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/2: stat - no entries 2024-05-09T00:07:23.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/3: write - no filename 2024-05-09T00:07:23.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/4: dread - no filename 2024-05-09T00:07:23.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/5: truncate - no filename 2024-05-09T00:07:23.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/6: write - no filename 2024-05-09T00:07:23.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/7: rename - no filename 2024-05-09T00:07:23.186 INFO:tasks.workunit.client.1.smithi135.stdout:1/0: dread - no filename 2024-05-09T00:07:23.186 INFO:tasks.workunit.client.1.smithi135.stdout:1/1: chown . 31961967 1 2024-05-09T00:07:23.187 INFO:tasks.workunit.client.0.smithi026.stdout:9/42: dwrite f3 [0,4194304] 0 2024-05-09T00:07:23.187 INFO:tasks.workunit.client.0.smithi026.stdout:9/43: getdents d7 0 2024-05-09T00:07:23.187 INFO:tasks.workunit.client.0.smithi026.stdout:0/59: dwrite fb [0,4194304] 0 2024-05-09T00:07:23.209 INFO:tasks.workunit.client.1.smithi135.stdout:0/8: symlink l0 0 2024-05-09T00:07:23.209 INFO:tasks.workunit.client.1.smithi135.stdout:0/9: chown l0 0 1 2024-05-09T00:07:23.209 INFO:tasks.workunit.client.1.smithi135.stdout:2/0: stat - no entries 2024-05-09T00:07:23.210 INFO:tasks.workunit.client.1.smithi135.stdout:2/1: rename - no filename 2024-05-09T00:07:23.210 INFO:tasks.workunit.client.1.smithi135.stdout:2/2: rmdir - no directory 2024-05-09T00:07:23.210 INFO:tasks.workunit.client.1.smithi135.stdout:2/3: dread - no filename 2024-05-09T00:07:23.211 INFO:tasks.workunit.client.1.smithi135.stdout:1/2: creat f0 x:0 0 0 2024-05-09T00:07:23.212 INFO:tasks.workunit.client.0.smithi026.stdout:9/44: truncate f6 3248200 0 2024-05-09T00:07:23.214 INFO:tasks.workunit.client.1.smithi135.stdout:0/10: rename l0 to l1 0 2024-05-09T00:07:23.214 INFO:tasks.workunit.client.1.smithi135.stdout:0/11: fdatasync - no filename 2024-05-09T00:07:23.214 INFO:tasks.workunit.client.1.smithi135.stdout:0/12: rmdir - no directory 2024-05-09T00:07:23.214 INFO:tasks.workunit.client.0.smithi026.stdout:0/60: chown l0 2 1 2024-05-09T00:07:23.216 INFO:tasks.workunit.client.0.smithi026.stdout:9/45: mknod d7/c10 0 2024-05-09T00:07:23.218 INFO:tasks.workunit.client.1.smithi135.stdout:2/4: symlink l0 0 2024-05-09T00:07:23.220 INFO:tasks.workunit.client.1.smithi135.stdout:1/3: rename f0 to f1 0 2024-05-09T00:07:23.220 INFO:tasks.workunit.client.1.smithi135.stdout:1/4: chown f1 175887 1 2024-05-09T00:07:23.221 INFO:tasks.workunit.client.1.smithi135.stdout:0/13: symlink l2 0 2024-05-09T00:07:23.225 INFO:tasks.workunit.client.1.smithi135.stdout:3/0: creat f0 x:0 0 0 2024-05-09T00:07:23.226 INFO:tasks.workunit.client.1.smithi135.stdout:2/5: mkdir d1 0 2024-05-09T00:07:23.226 INFO:tasks.workunit.client.1.smithi135.stdout:2/6: chown d1 186603 1 2024-05-09T00:07:23.228 INFO:tasks.workunit.client.1.smithi135.stdout:1/5: creat f2 x:0 0 0 2024-05-09T00:07:23.232 INFO:tasks.workunit.client.1.smithi135.stdout:4/0: creat f0 x:0 0 0 2024-05-09T00:07:23.234 INFO:tasks.workunit.client.1.smithi135.stdout:2/7: unlink l0 0 2024-05-09T00:07:23.235 INFO:tasks.workunit.client.1.smithi135.stdout:6/0: rmdir - no directory 2024-05-09T00:07:23.235 INFO:tasks.workunit.client.1.smithi135.stdout:6/1: write - no filename 2024-05-09T00:07:23.235 INFO:tasks.workunit.client.1.smithi135.stdout:6/2: stat - no entries 2024-05-09T00:07:23.235 INFO:tasks.workunit.client.1.smithi135.stdout:6/3: rmdir - no directory 2024-05-09T00:07:23.235 INFO:tasks.workunit.client.1.smithi135.stdout:6/4: dwrite - no filename 2024-05-09T00:07:23.236 INFO:tasks.workunit.client.1.smithi135.stdout:6/5: read - no filename 2024-05-09T00:07:23.236 INFO:tasks.workunit.client.1.smithi135.stdout:6/6: rmdir - no directory 2024-05-09T00:07:23.236 INFO:tasks.workunit.client.1.smithi135.stdout:5/0: creat f0 x:0 0 0 2024-05-09T00:07:23.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/1: mkdir d1 0 2024-05-09T00:07:23.238 INFO:tasks.workunit.client.1.smithi135.stdout:2/8: mknod d1/c2 0 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/0: write - no filename 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/1: dwrite - no filename 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/2: fdatasync - no filename 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/3: read - no filename 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/4: rename - no filename 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/5: link - no file 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/6: unlink - no file 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/7: chown . 2039 1 2024-05-09T00:07:23.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/8: truncate - no filename 2024-05-09T00:07:23.241 INFO:tasks.workunit.client.1.smithi135.stdout:7/9: dread - no filename 2024-05-09T00:07:23.244 INFO:tasks.workunit.client.1.smithi135.stdout:6/7: creat f0 x:0 0 0 2024-05-09T00:07:23.245 INFO:tasks.workunit.client.1.smithi135.stdout:6/8: truncate f0 648489 0 2024-05-09T00:07:23.246 INFO:tasks.workunit.client.1.smithi135.stdout:5/1: creat f1 x:0 0 0 2024-05-09T00:07:23.246 INFO:tasks.workunit.client.1.smithi135.stdout:5/2: dread - f0 zero size 2024-05-09T00:07:23.246 INFO:tasks.workunit.client.1.smithi135.stdout:5/3: write f1 [180651,33193] 0 2024-05-09T00:07:23.246 INFO:tasks.workunit.client.1.smithi135.stdout:5/4: read f1 [16071,50933] 0 2024-05-09T00:07:23.246 INFO:tasks.workunit.client.1.smithi135.stdout:5/5: write f0 [673027,45293] 0 2024-05-09T00:07:23.247 INFO:tasks.workunit.client.1.smithi135.stdout:4/2: rmdir d1 0 2024-05-09T00:07:23.247 INFO:tasks.workunit.client.1.smithi135.stdout:4/3: chown f0 3240 1 2024-05-09T00:07:23.249 INFO:tasks.workunit.client.1.smithi135.stdout:2/9: symlink d1/l3 0 2024-05-09T00:07:23.249 INFO:tasks.workunit.client.1.smithi135.stdout:2/10: truncate - no filename 2024-05-09T00:07:23.250 INFO:tasks.workunit.client.1.smithi135.stdout:8/0: rmdir - no directory 2024-05-09T00:07:23.251 INFO:tasks.workunit.client.1.smithi135.stdout:8/1: dread - no filename 2024-05-09T00:07:23.251 INFO:tasks.workunit.client.1.smithi135.stdout:8/2: write - no filename 2024-05-09T00:07:23.251 INFO:tasks.workunit.client.1.smithi135.stdout:1/6: dwrite f1 [0,4194304] 0 2024-05-09T00:07:23.251 INFO:tasks.workunit.client.1.smithi135.stdout:7/10: mknod c0 0 2024-05-09T00:07:23.253 INFO:tasks.workunit.client.1.smithi135.stdout:6/9: rename f0 to f1 0 2024-05-09T00:07:23.254 INFO:tasks.workunit.client.0.smithi026.stdout:9/46: dwrite f6 [0,4194304] 0 2024-05-09T00:07:23.255 INFO:tasks.workunit.client.1.smithi135.stdout:3/1: dwrite f0 [0,4194304] 0 2024-05-09T00:07:23.255 INFO:tasks.workunit.client.1.smithi135.stdout:3/2: fdatasync f0 0 2024-05-09T00:07:23.255 INFO:tasks.workunit.client.1.smithi135.stdout:4/4: mknod c2 0 2024-05-09T00:07:23.255 INFO:tasks.workunit.client.1.smithi135.stdout:4/5: chown c2 93380 1 2024-05-09T00:07:23.255 INFO:tasks.workunit.client.1.smithi135.stdout:4/6: dread - f0 zero size 2024-05-09T00:07:23.256 INFO:tasks.workunit.client.1.smithi135.stdout:2/11: creat d1/f4 x:0 0 0 2024-05-09T00:07:23.258 INFO:tasks.workunit.client.1.smithi135.stdout:9/0: dwrite - no filename 2024-05-09T00:07:23.258 INFO:tasks.workunit.client.1.smithi135.stdout:9/1: dwrite - no filename 2024-05-09T00:07:23.258 INFO:tasks.workunit.client.1.smithi135.stdout:9/2: dwrite - no filename 2024-05-09T00:07:23.258 INFO:tasks.workunit.client.1.smithi135.stdout:9/3: write - no filename 2024-05-09T00:07:23.258 INFO:tasks.workunit.client.1.smithi135.stdout:9/4: unlink - no file 2024-05-09T00:07:23.261 INFO:tasks.workunit.client.1.smithi135.stdout:8/3: symlink l0 0 2024-05-09T00:07:23.261 INFO:tasks.workunit.client.1.smithi135.stdout:8/4: dwrite - no filename 2024-05-09T00:07:23.262 INFO:tasks.workunit.client.1.smithi135.stdout:8/5: fdatasync - no filename 2024-05-09T00:07:23.262 INFO:tasks.workunit.client.1.smithi135.stdout:8/6: dwrite - no filename 2024-05-09T00:07:23.262 INFO:tasks.workunit.client.1.smithi135.stdout:8/7: dwrite - no filename 2024-05-09T00:07:23.265 INFO:tasks.workunit.client.1.smithi135.stdout:1/7: rename f1 to f3 0 2024-05-09T00:07:23.265 INFO:tasks.workunit.client.1.smithi135.stdout:1/8: truncate f2 752458 0 2024-05-09T00:07:23.265 INFO:tasks.workunit.client.1.smithi135.stdout:7/11: symlink l1 0 2024-05-09T00:07:23.266 INFO:tasks.workunit.client.1.smithi135.stdout:7/12: dread - no filename 2024-05-09T00:07:23.266 INFO:tasks.workunit.client.1.smithi135.stdout:7/13: truncate - no filename 2024-05-09T00:07:23.273 INFO:tasks.workunit.client.0.smithi026.stdout:9/47: dwrite d7/fd [0,4194304] 0 2024-05-09T00:07:23.274 INFO:tasks.workunit.client.0.smithi026.stdout:9/48: read d7/fe [1016489,26504] 0 2024-05-09T00:07:23.274 INFO:tasks.workunit.client.1.smithi135.stdout:9/5: mknod c0 0 2024-05-09T00:07:23.274 INFO:tasks.workunit.client.1.smithi135.stdout:2/12: unlink d1/c2 0 2024-05-09T00:07:23.274 INFO:tasks.workunit.client.1.smithi135.stdout:8/8: link l0 l1 0 2024-05-09T00:07:23.274 INFO:tasks.workunit.client.1.smithi135.stdout:8/9: chown l1 16 1 2024-05-09T00:07:23.275 INFO:tasks.workunit.client.1.smithi135.stdout:8/10: write - no filename 2024-05-09T00:07:23.276 INFO:tasks.workunit.client.1.smithi135.stdout:5/6: getdents . 0 2024-05-09T00:07:23.277 INFO:tasks.workunit.client.1.smithi135.stdout:4/7: dwrite f0 [0,4194304] 0 2024-05-09T00:07:23.279 INFO:tasks.workunit.client.1.smithi135.stdout:7/14: symlink l2 0 2024-05-09T00:07:23.279 INFO:tasks.workunit.client.1.smithi135.stdout:7/15: fsync - no filename 2024-05-09T00:07:23.281 INFO:tasks.workunit.client.1.smithi135.stdout:2/13: rename d1/l3 to d1/l5 0 2024-05-09T00:07:23.282 INFO:tasks.workunit.client.1.smithi135.stdout:6/10: fsync f1 0 2024-05-09T00:07:23.287 INFO:tasks.workunit.client.1.smithi135.stdout:6/11: dread f1 [0,4194304] 0 2024-05-09T00:07:23.288 INFO:tasks.workunit.client.1.smithi135.stdout:1/9: getdents . 0 2024-05-09T00:07:23.290 INFO:tasks.workunit.client.1.smithi135.stdout:6/12: dread f1 [0,4194304] 0 2024-05-09T00:07:23.291 INFO:tasks.workunit.client.1.smithi135.stdout:5/7: dwrite f1 [0,4194304] 0 2024-05-09T00:07:23.291 INFO:tasks.workunit.client.1.smithi135.stdout:5/8: chown f0 3978439 1 2024-05-09T00:07:23.291 INFO:tasks.workunit.client.1.smithi135.stdout:1/10: creat f4 x:0 0 0 2024-05-09T00:07:23.292 INFO:tasks.workunit.client.1.smithi135.stdout:6/13: mkdir d2 0 2024-05-09T00:07:23.292 INFO:tasks.workunit.client.1.smithi135.stdout:6/14: chown f1 12473025 1 2024-05-09T00:07:23.294 INFO:tasks.workunit.client.1.smithi135.stdout:6/15: link f1 d2/f3 0 2024-05-09T00:07:23.295 INFO:tasks.workunit.client.0.smithi026.stdout:9/49: dwrite d7/f8 [0,4194304] 0 2024-05-09T00:07:23.296 INFO:tasks.workunit.client.1.smithi135.stdout:6/16: creat d2/f4 x:0 0 0 2024-05-09T00:07:23.297 INFO:tasks.workunit.client.0.smithi026.stdout:9/50: mknod d7/c11 0 2024-05-09T00:07:23.298 INFO:tasks.workunit.client.1.smithi135.stdout:8/11: getdents . 0 2024-05-09T00:07:23.298 INFO:tasks.workunit.client.1.smithi135.stdout:8/12: write - no filename 2024-05-09T00:07:23.299 INFO:tasks.workunit.client.0.smithi026.stdout:9/51: unlink f6 0 2024-05-09T00:07:23.300 INFO:tasks.workunit.client.1.smithi135.stdout:7/16: getdents . 0 2024-05-09T00:07:23.300 INFO:tasks.workunit.client.1.smithi135.stdout:7/17: fdatasync - no filename 2024-05-09T00:07:23.301 INFO:tasks.workunit.client.1.smithi135.stdout:7/18: symlink l3 0 2024-05-09T00:07:23.303 INFO:tasks.workunit.client.1.smithi135.stdout:7/19: rename l1 to l4 0 2024-05-09T00:07:23.303 INFO:tasks.workunit.client.1.smithi135.stdout:7/20: dread - no filename 2024-05-09T00:07:23.304 INFO:tasks.workunit.client.1.smithi135.stdout:7/21: dread - no filename 2024-05-09T00:07:23.306 INFO:tasks.workunit.client.1.smithi135.stdout:2/14: dwrite d1/f4 [0,4194304] 0 2024-05-09T00:07:23.308 INFO:tasks.workunit.client.1.smithi135.stdout:7/22: symlink l5 0 2024-05-09T00:07:23.308 INFO:tasks.workunit.client.1.smithi135.stdout:7/23: chown l5 0 1 2024-05-09T00:07:23.308 INFO:tasks.workunit.client.1.smithi135.stdout:5/9: write f1 [4800280,39734] 0 2024-05-09T00:07:23.310 INFO:tasks.workunit.client.1.smithi135.stdout:6/17: getdents d2 0 2024-05-09T00:07:23.311 INFO:tasks.workunit.client.1.smithi135.stdout:2/15: creat d1/f6 x:0 0 0 2024-05-09T00:07:23.311 INFO:tasks.workunit.client.1.smithi135.stdout:2/16: truncate d1/f4 4508343 0 2024-05-09T00:07:23.314 INFO:tasks.workunit.client.1.smithi135.stdout:6/18: rename d2/f4 to d2/f5 0 2024-05-09T00:07:23.314 INFO:tasks.workunit.client.1.smithi135.stdout:6/19: chown f1 125131 1 2024-05-09T00:07:23.315 INFO:tasks.workunit.client.1.smithi135.stdout:2/17: rename d1/f6 to d1/f7 0 2024-05-09T00:07:23.315 INFO:tasks.workunit.client.1.smithi135.stdout:2/18: truncate d1/f7 99842 0 2024-05-09T00:07:23.316 INFO:tasks.workunit.client.1.smithi135.stdout:4/8: dwrite f0 [4194304,4194304] 0 2024-05-09T00:07:23.317 INFO:tasks.workunit.client.1.smithi135.stdout:7/24: symlink l6 0 2024-05-09T00:07:23.317 INFO:tasks.workunit.client.1.smithi135.stdout:7/25: read - no filename 2024-05-09T00:07:23.318 INFO:tasks.workunit.client.1.smithi135.stdout:6/20: creat d2/f6 x:0 0 0 2024-05-09T00:07:23.322 INFO:tasks.workunit.client.1.smithi135.stdout:4/9: rename f0 to f3 0 2024-05-09T00:07:23.326 INFO:tasks.workunit.client.1.smithi135.stdout:7/26: symlink l7 0 2024-05-09T00:07:23.332 INFO:tasks.workunit.client.1.smithi135.stdout:7/27: unlink l4 0 2024-05-09T00:07:23.332 INFO:tasks.workunit.client.1.smithi135.stdout:7/28: dwrite - no filename 2024-05-09T00:07:23.333 INFO:tasks.workunit.client.1.smithi135.stdout:7/29: stat l2 0 2024-05-09T00:07:23.335 INFO:tasks.workunit.client.1.smithi135.stdout:7/30: creat f8 x:0 0 0 2024-05-09T00:07:23.335 INFO:tasks.workunit.client.1.smithi135.stdout:7/31: truncate f8 579112 0 2024-05-09T00:07:23.337 INFO:tasks.workunit.client.1.smithi135.stdout:7/32: rename l5 to l9 0 2024-05-09T00:07:23.339 INFO:tasks.workunit.client.1.smithi135.stdout:4/10: truncate f3 708748 0 2024-05-09T00:07:23.342 INFO:tasks.workunit.client.1.smithi135.stdout:4/11: symlink l4 0 2024-05-09T00:07:23.342 INFO:tasks.workunit.client.1.smithi135.stdout:5/10: dwrite f1 [0,4194304] 0 2024-05-09T00:07:23.343 INFO:tasks.workunit.client.1.smithi135.stdout:4/12: creat f5 x:0 0 0 2024-05-09T00:07:23.345 INFO:tasks.workunit.client.1.smithi135.stdout:4/13: mknod c6 0 2024-05-09T00:07:23.345 INFO:tasks.workunit.client.1.smithi135.stdout:7/33: fsync f8 0 2024-05-09T00:07:23.347 INFO:tasks.workunit.client.1.smithi135.stdout:7/34: creat fa x:0 0 0 2024-05-09T00:07:23.347 INFO:tasks.workunit.client.1.smithi135.stdout:7/35: write fa [657396,107160] 0 2024-05-09T00:07:23.347 INFO:tasks.workunit.client.1.smithi135.stdout:7/36: fsync f8 0 2024-05-09T00:07:23.347 INFO:tasks.workunit.client.1.smithi135.stdout:4/14: write f3 [1161669,95755] 0 2024-05-09T00:07:23.347 INFO:tasks.workunit.client.1.smithi135.stdout:4/15: chown l4 821 1 2024-05-09T00:07:23.349 INFO:tasks.workunit.client.1.smithi135.stdout:4/16: creat f7 x:0 0 0 2024-05-09T00:07:23.350 INFO:tasks.workunit.client.1.smithi135.stdout:7/37: mkdir db 0 2024-05-09T00:07:23.350 INFO:tasks.workunit.client.1.smithi135.stdout:7/38: write f8 [1228866,65103] 0 2024-05-09T00:07:23.350 INFO:tasks.workunit.client.1.smithi135.stdout:2/19: dwrite d1/f4 [0,4194304] 0 2024-05-09T00:07:23.350 INFO:tasks.workunit.client.1.smithi135.stdout:2/20: write d1/f4 [4910958,122786] 0 2024-05-09T00:07:23.351 INFO:tasks.workunit.client.1.smithi135.stdout:4/17: symlink l8 0 2024-05-09T00:07:23.351 INFO:tasks.workunit.client.1.smithi135.stdout:4/18: write f7 [351219,23567] 0 2024-05-09T00:07:23.352 INFO:tasks.workunit.client.1.smithi135.stdout:7/39: link f8 db/fc 0 2024-05-09T00:07:23.352 INFO:tasks.workunit.client.1.smithi135.stdout:6/21: dwrite d2/f5 [0,4194304] 0 2024-05-09T00:07:23.352 INFO:tasks.workunit.client.1.smithi135.stdout:6/22: chown d2 0 1 2024-05-09T00:07:23.353 INFO:tasks.workunit.client.1.smithi135.stdout:2/21: mknod d1/c8 0 2024-05-09T00:07:23.355 INFO:tasks.workunit.client.1.smithi135.stdout:7/40: unlink l3 0 2024-05-09T00:07:23.357 INFO:tasks.workunit.client.1.smithi135.stdout:4/19: dread f7 [0,4194304] 0 2024-05-09T00:07:23.358 INFO:tasks.workunit.client.1.smithi135.stdout:5/11: truncate f1 1132839 0 2024-05-09T00:07:23.360 INFO:tasks.workunit.client.1.smithi135.stdout:7/41: mkdir db/dd 0 2024-05-09T00:07:23.360 INFO:tasks.workunit.client.1.smithi135.stdout:4/20: unlink f5 0 2024-05-09T00:07:23.361 INFO:tasks.workunit.client.1.smithi135.stdout:7/42: mkdir db/dd/de 0 2024-05-09T00:07:23.372 INFO:tasks.workunit.client.1.smithi135.stdout:5/12: read f1 [476910,8947] 0 2024-05-09T00:07:23.372 INFO:tasks.workunit.client.1.smithi135.stdout:4/21: truncate f3 899092 0 2024-05-09T00:07:23.372 INFO:tasks.workunit.client.1.smithi135.stdout:4/22: fdatasync f3 0 2024-05-09T00:07:23.374 INFO:tasks.workunit.client.1.smithi135.stdout:5/13: creat f2 x:0 0 0 2024-05-09T00:07:23.374 INFO:tasks.workunit.client.1.smithi135.stdout:4/23: rename c6 to c9 0 2024-05-09T00:07:23.374 INFO:tasks.workunit.client.1.smithi135.stdout:4/24: rmdir - no directory 2024-05-09T00:07:23.375 INFO:tasks.workunit.client.1.smithi135.stdout:4/25: creat fa x:0 0 0 2024-05-09T00:07:23.376 INFO:tasks.workunit.client.1.smithi135.stdout:4/26: chown f3 41389 1 2024-05-09T00:07:23.376 INFO:tasks.workunit.client.1.smithi135.stdout:4/27: truncate fa 475686 0 2024-05-09T00:07:23.377 INFO:tasks.workunit.client.1.smithi135.stdout:6/23: dwrite d2/f5 [0,4194304] 0 2024-05-09T00:07:23.377 INFO:tasks.workunit.client.1.smithi135.stdout:6/24: chown f1 134179861 1 2024-05-09T00:07:23.379 INFO:tasks.workunit.client.1.smithi135.stdout:5/14: dread f0 [0,4194304] 0 2024-05-09T00:07:23.379 INFO:tasks.workunit.client.1.smithi135.stdout:5/15: fsync f0 0 2024-05-09T00:07:23.379 INFO:tasks.workunit.client.1.smithi135.stdout:6/25: link d2/f6 d2/f7 0 2024-05-09T00:07:23.384 INFO:tasks.workunit.client.1.smithi135.stdout:6/26: unlink d2/f6 0 2024-05-09T00:07:23.384 INFO:tasks.workunit.client.1.smithi135.stdout:6/27: fsync d2/f5 0 2024-05-09T00:07:23.384 INFO:tasks.workunit.client.1.smithi135.stdout:6/28: chown d2/f7 12189 1 2024-05-09T00:07:23.384 INFO:tasks.workunit.client.1.smithi135.stdout:5/16: getdents . 0 2024-05-09T00:07:23.386 INFO:tasks.workunit.client.1.smithi135.stdout:5/17: symlink l3 0 2024-05-09T00:07:23.387 INFO:tasks.workunit.client.1.smithi135.stdout:5/18: truncate f0 1265737 0 2024-05-09T00:07:23.388 INFO:tasks.workunit.client.1.smithi135.stdout:6/29: fsync d2/f7 0 2024-05-09T00:07:23.389 INFO:tasks.workunit.client.1.smithi135.stdout:6/30: dread - d2/f7 zero size 2024-05-09T00:07:23.389 INFO:tasks.workunit.client.1.smithi135.stdout:2/22: dwrite d1/f4 [4194304,4194304] 0 2024-05-09T00:07:23.394 INFO:tasks.workunit.client.1.smithi135.stdout:6/31: mknod d2/c8 0 2024-05-09T00:07:23.420 INFO:tasks.workunit.client.1.smithi135.stdout:4/28: dwrite f7 [0,4194304] 0 2024-05-09T00:07:23.423 INFO:tasks.workunit.client.1.smithi135.stdout:5/19: dwrite f0 [0,4194304] 0 2024-05-09T00:07:23.425 INFO:tasks.workunit.client.1.smithi135.stdout:5/20: creat f4 x:0 0 0 2024-05-09T00:07:23.427 INFO:tasks.workunit.client.1.smithi135.stdout:2/23: dwrite d1/f4 [0,4194304] 0 2024-05-09T00:07:23.427 INFO:tasks.workunit.client.1.smithi135.stdout:6/32: dwrite d2/f3 [0,4194304] 0 2024-05-09T00:07:23.428 INFO:tasks.workunit.client.1.smithi135.stdout:2/24: rename d1/l5 to d1/l9 0 2024-05-09T00:07:23.431 INFO:tasks.workunit.client.1.smithi135.stdout:2/25: write d1/f4 [156294,56657] 0 2024-05-09T00:07:23.431 INFO:tasks.workunit.client.1.smithi135.stdout:6/33: creat d2/f9 x:0 0 0 2024-05-09T00:07:23.433 INFO:tasks.workunit.client.1.smithi135.stdout:6/34: mkdir d2/da 0 2024-05-09T00:07:23.433 INFO:tasks.workunit.client.1.smithi135.stdout:6/35: chown d2/f3 202465902 1 2024-05-09T00:07:23.434 INFO:tasks.workunit.client.1.smithi135.stdout:6/36: read - d2/f9 zero size 2024-05-09T00:07:23.435 INFO:tasks.workunit.client.1.smithi135.stdout:6/37: rename d2/f5 to d2/da/fb 0 2024-05-09T00:07:23.435 INFO:tasks.workunit.client.1.smithi135.stdout:6/38: fdatasync d2/f3 0 2024-05-09T00:07:23.436 INFO:tasks.workunit.client.1.smithi135.stdout:6/39: creat d2/fc x:0 0 0 2024-05-09T00:07:23.439 INFO:tasks.workunit.client.1.smithi135.stdout:5/21: dwrite f4 [0,4194304] 0 2024-05-09T00:07:23.439 INFO:tasks.workunit.client.1.smithi135.stdout:5/22: chown l3 22538 1 2024-05-09T00:07:23.440 INFO:tasks.workunit.client.1.smithi135.stdout:6/40: truncate d2/f3 60914 0 2024-05-09T00:07:23.443 INFO:tasks.workunit.client.1.smithi135.stdout:5/23: mknod c5 0 2024-05-09T00:07:23.444 INFO:tasks.workunit.client.1.smithi135.stdout:5/24: creat f6 x:0 0 0 2024-05-09T00:07:23.444 INFO:tasks.workunit.client.1.smithi135.stdout:5/25: chown f0 1 1 2024-05-09T00:07:23.448 INFO:tasks.workunit.client.1.smithi135.stdout:5/26: symlink l7 0 2024-05-09T00:07:23.450 INFO:tasks.workunit.client.1.smithi135.stdout:5/27: read f1 [920197,126430] 0 2024-05-09T00:07:23.452 INFO:tasks.workunit.client.1.smithi135.stdout:5/28: symlink l8 0 2024-05-09T00:07:23.453 INFO:tasks.workunit.client.1.smithi135.stdout:5/29: write f2 [684814,117709] 0 2024-05-09T00:07:23.454 INFO:tasks.workunit.client.1.smithi135.stdout:5/30: unlink f0 0 2024-05-09T00:07:23.455 INFO:tasks.workunit.client.1.smithi135.stdout:5/31: creat f9 x:0 0 0 2024-05-09T00:07:23.456 INFO:tasks.workunit.client.1.smithi135.stdout:6/41: dwrite d2/da/fb [0,4194304] 0 2024-05-09T00:07:23.457 INFO:tasks.workunit.client.1.smithi135.stdout:6/42: creat d2/fd x:0 0 0 2024-05-09T00:07:23.458 INFO:tasks.workunit.client.1.smithi135.stdout:6/43: symlink d2/le 0 2024-05-09T00:07:23.458 INFO:tasks.workunit.client.1.smithi135.stdout:2/26: dread d1/f4 [0,4194304] 0 2024-05-09T00:07:23.460 INFO:tasks.workunit.client.1.smithi135.stdout:6/44: rename d2/c8 to d2/cf 0 2024-05-09T00:07:23.460 INFO:tasks.workunit.client.1.smithi135.stdout:6/45: write f1 [460960,10742] 0 2024-05-09T00:07:23.460 INFO:tasks.workunit.client.1.smithi135.stdout:6/46: write d2/fd [404707,36517] 0 2024-05-09T00:07:23.460 INFO:tasks.workunit.client.1.smithi135.stdout:6/47: dread - d2/fc zero size 2024-05-09T00:07:23.468 INFO:tasks.workunit.client.1.smithi135.stdout:5/32: dread f4 [0,4194304] 0 2024-05-09T00:07:23.470 INFO:tasks.workunit.client.1.smithi135.stdout:5/33: symlink la 0 2024-05-09T00:07:23.473 INFO:tasks.workunit.client.1.smithi135.stdout:5/34: mkdir db 0 2024-05-09T00:07:23.473 INFO:tasks.workunit.client.1.smithi135.stdout:5/35: chown f4 45 1 2024-05-09T00:07:23.473 INFO:tasks.workunit.client.1.smithi135.stdout:5/36: mknod db/cc 0 2024-05-09T00:07:23.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/48: dwrite d2/fc [0,4194304] 0 2024-05-09T00:07:23.474 INFO:tasks.workunit.client.1.smithi135.stdout:5/37: creat db/fd x:0 0 0 2024-05-09T00:07:23.476 INFO:tasks.workunit.client.1.smithi135.stdout:6/49: creat d2/da/f10 x:0 0 0 2024-05-09T00:07:23.476 INFO:tasks.workunit.client.1.smithi135.stdout:6/50: write d2/f3 [1436186,122943] 0 2024-05-09T00:07:23.476 INFO:tasks.workunit.client.1.smithi135.stdout:6/51: truncate d2/f9 811846 0 2024-05-09T00:07:23.477 INFO:tasks.workunit.client.1.smithi135.stdout:6/52: stat d2/f3 0 2024-05-09T00:07:23.477 INFO:tasks.workunit.client.1.smithi135.stdout:6/53: write d2/da/f10 [280266,48178] 0 2024-05-09T00:07:23.477 INFO:tasks.workunit.client.1.smithi135.stdout:5/38: unlink l8 0 2024-05-09T00:07:23.477 INFO:tasks.workunit.client.1.smithi135.stdout:5/39: chown c5 396 1 2024-05-09T00:07:23.478 INFO:tasks.workunit.client.1.smithi135.stdout:6/54: symlink d2/da/l11 0 2024-05-09T00:07:23.478 INFO:tasks.workunit.client.1.smithi135.stdout:6/55: readlink d2/da/l11 0 2024-05-09T00:07:23.478 INFO:tasks.workunit.client.1.smithi135.stdout:5/40: creat db/fe x:0 0 0 2024-05-09T00:07:23.478 INFO:tasks.workunit.client.1.smithi135.stdout:5/41: write f9 [925606,111880] 0 2024-05-09T00:07:23.478 INFO:tasks.workunit.client.1.smithi135.stdout:6/56: mknod d2/da/c12 0 2024-05-09T00:07:23.480 INFO:tasks.workunit.client.1.smithi135.stdout:6/57: unlink d2/f3 0 2024-05-09T00:07:23.481 INFO:tasks.workunit.client.1.smithi135.stdout:6/58: stat f1 0 2024-05-09T00:07:23.484 INFO:tasks.workunit.client.1.smithi135.stdout:2/27: dwrite d1/f4 [0,4194304] 0 2024-05-09T00:07:23.484 INFO:tasks.workunit.client.1.smithi135.stdout:6/59: rename d2/da/l11 to d2/l13 0 2024-05-09T00:07:23.484 INFO:tasks.workunit.client.1.smithi135.stdout:6/60: write f1 [2564837,124575] 0 2024-05-09T00:07:23.487 INFO:tasks.workunit.client.1.smithi135.stdout:2/28: dread d1/f7 [0,4194304] 0 2024-05-09T00:07:23.488 INFO:tasks.workunit.client.1.smithi135.stdout:2/29: creat d1/fa x:0 0 0 2024-05-09T00:07:23.488 INFO:tasks.workunit.client.1.smithi135.stdout:2/30: truncate d1/fa 423975 0 2024-05-09T00:07:23.488 INFO:tasks.workunit.client.1.smithi135.stdout:2/31: chown d1 3407 1 2024-05-09T00:07:23.489 INFO:tasks.workunit.client.1.smithi135.stdout:2/32: stat d1 0 2024-05-09T00:07:23.489 INFO:tasks.workunit.client.1.smithi135.stdout:2/33: read d1/fa [275073,61360] 0 2024-05-09T00:07:23.491 INFO:tasks.workunit.client.1.smithi135.stdout:5/42: dwrite db/fd [0,4194304] 0 2024-05-09T00:07:23.493 INFO:tasks.workunit.client.1.smithi135.stdout:5/43: rename c5 to db/cf 0 2024-05-09T00:07:23.497 INFO:tasks.workunit.client.1.smithi135.stdout:5/44: creat db/f10 x:0 0 0 2024-05-09T00:07:23.500 INFO:tasks.workunit.client.1.smithi135.stdout:2/34: rmdir d1 39 2024-05-09T00:07:23.500 INFO:tasks.workunit.client.1.smithi135.stdout:5/45: dread f2 [0,4194304] 0 2024-05-09T00:07:23.501 INFO:tasks.workunit.client.1.smithi135.stdout:2/35: rename d1/l9 to d1/lb 0 2024-05-09T00:07:23.502 INFO:tasks.workunit.client.1.smithi135.stdout:2/36: rmdir d1 39 2024-05-09T00:07:23.502 INFO:tasks.workunit.client.1.smithi135.stdout:2/37: stat d1 0 2024-05-09T00:07:23.502 INFO:tasks.workunit.client.1.smithi135.stdout:2/38: mknod d1/cc 0 2024-05-09T00:07:23.503 INFO:tasks.workunit.client.1.smithi135.stdout:5/46: dread f1 [0,4194304] 0 2024-05-09T00:07:23.503 INFO:tasks.workunit.client.1.smithi135.stdout:5/47: chown f9 6 1 2024-05-09T00:07:23.503 INFO:tasks.workunit.client.1.smithi135.stdout:2/39: dread d1/f7 [0,4194304] 0 2024-05-09T00:07:23.504 INFO:tasks.workunit.client.1.smithi135.stdout:5/48: creat db/f11 x:0 0 0 2024-05-09T00:07:23.504 INFO:tasks.workunit.client.1.smithi135.stdout:2/40: dread d1/f7 [0,4194304] 0 2024-05-09T00:07:23.505 INFO:tasks.workunit.client.1.smithi135.stdout:2/41: creat d1/fd x:0 0 0 2024-05-09T00:07:23.505 INFO:tasks.workunit.client.1.smithi135.stdout:2/42: dread - d1/fd zero size 2024-05-09T00:07:23.511 INFO:tasks.workunit.client.1.smithi135.stdout:2/43: rmdir d1 39 2024-05-09T00:07:23.511 INFO:tasks.workunit.client.1.smithi135.stdout:2/44: dread - d1/fd zero size 2024-05-09T00:07:23.527 INFO:tasks.workunit.client.1.smithi135.stdout:2/45: dwrite d1/fa [0,4194304] 0 2024-05-09T00:07:23.527 INFO:tasks.workunit.client.1.smithi135.stdout:2/46: chown d1/lb 107505723 1 2024-05-09T00:07:23.527 INFO:tasks.workunit.client.1.smithi135.stdout:2/47: readlink d1/lb 0 2024-05-09T00:07:23.618 INFO:tasks.workunit.client.1.smithi135.stdout:2/48: dwrite d1/f4 [4194304,4194304] 0 2024-05-09T00:07:23.619 INFO:tasks.workunit.client.1.smithi135.stdout:2/49: symlink d1/le 0 2024-05-09T00:07:23.625 INFO:tasks.workunit.client.1.smithi135.stdout:2/50: dread d1/f4 [4194304,4194304] 0 2024-05-09T00:07:23.626 INFO:tasks.workunit.client.1.smithi135.stdout:2/51: rename d1/cc to d1/cf 0 2024-05-09T00:07:23.643 INFO:tasks.workunit.client.1.smithi135.stdout:2/52: dwrite d1/f7 [0,4194304] 0 2024-05-09T00:07:23.643 INFO:tasks.workunit.client.1.smithi135.stdout:2/53: chown d1/f4 921 1 2024-05-09T00:07:23.644 INFO:tasks.workunit.client.1.smithi135.stdout:2/54: write d1/fa [3093691,105762] 0 2024-05-09T00:07:23.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:21.901839+0000 mgr.smithi135.kkrhgf (mgr.24419) 40 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s wr, 989 op/s 2024-05-09T00:07:23.645 INFO:tasks.workunit.client.1.smithi135.stdout:2/55: symlink d1/l10 0 2024-05-09T00:07:23.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:21.901839+0000 mgr.smithi135.kkrhgf (mgr.24419) 40 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s wr, 989 op/s 2024-05-09T00:07:23.649 INFO:tasks.workunit.client.1.smithi135.stdout:2/56: getdents d1 0 2024-05-09T00:07:23.650 INFO:tasks.workunit.client.1.smithi135.stdout:2/57: creat d1/f11 x:0 0 0 2024-05-09T00:07:25.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:23.902206+0000 mgr.smithi135.kkrhgf (mgr.24419) 41 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s wr, 989 op/s 2024-05-09T00:07:25.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:23.902206+0000 mgr.smithi135.kkrhgf (mgr.24419) 41 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 218 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s wr, 989 op/s 2024-05-09T00:07:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:2/58: sync 2024-05-09T00:07:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:5/49: sync 2024-05-09T00:07:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:6/61: sync 2024-05-09T00:07:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:0/14: sync 2024-05-09T00:07:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:0/15: dread - no filename 2024-05-09T00:07:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:7/43: sync 2024-05-09T00:07:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:1/11: sync 2024-05-09T00:07:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:3/3: sync 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:0/16: readlink l2 0 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:0/17: stat l2 0 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:0/18: dread - no filename 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:0/19: fsync - no filename 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:0/20: truncate - no filename 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:0/21: chown l1 1204304 1 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:9/6: sync 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:9/7: dwrite - no filename 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:8/13: sync 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:8/14: dread - no filename 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:8/15: rmdir - no directory 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:4/29: sync 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:9/8: chown c0 1637 1 2024-05-09T00:07:26.546 INFO:tasks.workunit.client.1.smithi135.stdout:9/9: write - no filename 2024-05-09T00:07:26.547 INFO:tasks.workunit.client.1.smithi135.stdout:4/30: stat l8 0 2024-05-09T00:07:26.547 INFO:tasks.workunit.client.1.smithi135.stdout:2/59: truncate d1/fd 923934 0 2024-05-09T00:07:26.547 INFO:tasks.workunit.client.1.smithi135.stdout:5/50: rename f2 to db/f12 0 2024-05-09T00:07:26.548 INFO:tasks.workunit.client.1.smithi135.stdout:5/51: write f1 [574956,91908] 0 2024-05-09T00:07:26.548 INFO:tasks.workunit.client.1.smithi135.stdout:7/44: rmdir db/dd/de 0 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/22: mkdir d3 0 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/23: dwrite - no filename 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/24: write - no filename 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/25: dwrite - no filename 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/26: dread - no filename 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/27: chown l2 47 1 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/28: dread - no filename 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/29: dwrite - no filename 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/30: write - no filename 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/31: dread - no filename 2024-05-09T00:07:26.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/32: dread - no filename 2024-05-09T00:07:26.551 INFO:tasks.workunit.client.1.smithi135.stdout:3/4: creat f1 x:0 0 0 2024-05-09T00:07:26.551 INFO:tasks.workunit.client.1.smithi135.stdout:3/5: read - f1 zero size 2024-05-09T00:07:26.551 INFO:tasks.workunit.client.1.smithi135.stdout:8/16: creat f2 x:0 0 0 2024-05-09T00:07:26.552 INFO:tasks.workunit.client.1.smithi135.stdout:8/17: write f2 [941360,82855] 0 2024-05-09T00:07:26.552 INFO:tasks.workunit.client.1.smithi135.stdout:9/10: unlink c0 0 2024-05-09T00:07:26.552 INFO:tasks.workunit.client.1.smithi135.stdout:9/11: truncate - no filename 2024-05-09T00:07:26.553 INFO:tasks.workunit.client.1.smithi135.stdout:2/60: chown d1/f7 29 1 2024-05-09T00:07:26.553 INFO:tasks.workunit.client.1.smithi135.stdout:6/62: mknod d2/c14 0 2024-05-09T00:07:26.554 INFO:tasks.workunit.client.1.smithi135.stdout:7/45: chown c0 69 1 2024-05-09T00:07:26.555 INFO:tasks.workunit.client.1.smithi135.stdout:0/33: creat d3/f4 x:0 0 0 2024-05-09T00:07:26.556 INFO:tasks.workunit.client.1.smithi135.stdout:3/6: mknod c2 0 2024-05-09T00:07:26.557 INFO:tasks.workunit.client.1.smithi135.stdout:9/12: mkdir d1 0 2024-05-09T00:07:26.557 INFO:tasks.workunit.client.1.smithi135.stdout:9/13: dwrite - no filename 2024-05-09T00:07:26.557 INFO:tasks.workunit.client.1.smithi135.stdout:9/14: fsync - no filename 2024-05-09T00:07:26.557 INFO:tasks.workunit.client.1.smithi135.stdout:9/15: fsync - no filename 2024-05-09T00:07:26.557 INFO:tasks.workunit.client.1.smithi135.stdout:9/16: read - no filename 2024-05-09T00:07:26.557 INFO:tasks.workunit.client.1.smithi135.stdout:9/17: chown d1 1 1 2024-05-09T00:07:26.558 INFO:tasks.workunit.client.1.smithi135.stdout:1/12: dread f2 [0,4194304] 0 2024-05-09T00:07:26.559 INFO:tasks.workunit.client.1.smithi135.stdout:7/46: creat db/ff x:0 0 0 2024-05-09T00:07:26.559 INFO:tasks.workunit.client.1.smithi135.stdout:7/47: write fa [1689165,1530] 0 2024-05-09T00:07:26.559 INFO:tasks.workunit.client.1.smithi135.stdout:3/7: creat f3 x:0 0 0 2024-05-09T00:07:26.560 INFO:tasks.workunit.client.1.smithi135.stdout:3/8: dread - f1 zero size 2024-05-09T00:07:26.560 INFO:tasks.workunit.client.1.smithi135.stdout:3/9: write f1 [781798,87376] 0 2024-05-09T00:07:26.561 INFO:tasks.workunit.client.1.smithi135.stdout:9/18: creat d1/f2 x:0 0 0 2024-05-09T00:07:26.561 INFO:tasks.workunit.client.1.smithi135.stdout:2/61: dread d1/fd [0,4194304] 0 2024-05-09T00:07:26.562 INFO:tasks.workunit.client.1.smithi135.stdout:8/18: read f2 [260532,76125] 0 2024-05-09T00:07:26.563 INFO:tasks.workunit.client.1.smithi135.stdout:6/63: mknod d2/c15 0 2024-05-09T00:07:26.563 INFO:tasks.workunit.client.1.smithi135.stdout:1/13: dread f2 [0,4194304] 0 2024-05-09T00:07:26.563 INFO:tasks.workunit.client.1.smithi135.stdout:1/14: rmdir - no directory 2024-05-09T00:07:26.564 INFO:tasks.workunit.client.1.smithi135.stdout:4/31: dwrite f7 [0,4194304] 0 2024-05-09T00:07:26.565 INFO:tasks.workunit.client.1.smithi135.stdout:7/48: mknod db/c10 0 2024-05-09T00:07:26.565 INFO:tasks.workunit.client.1.smithi135.stdout:9/19: symlink d1/l3 0 2024-05-09T00:07:26.567 INFO:tasks.workunit.client.1.smithi135.stdout:8/19: mknod c3 0 2024-05-09T00:07:26.568 INFO:tasks.workunit.client.1.smithi135.stdout:6/64: dread - d2/f7 zero size 2024-05-09T00:07:26.568 INFO:tasks.workunit.client.1.smithi135.stdout:6/65: rename d2 to d2/da/d16 22 2024-05-09T00:07:26.571 INFO:tasks.workunit.client.1.smithi135.stdout:4/32: link l8 lb 0 2024-05-09T00:07:26.571 INFO:tasks.workunit.client.1.smithi135.stdout:4/33: fdatasync f7 0 2024-05-09T00:07:26.572 INFO:tasks.workunit.client.1.smithi135.stdout:7/49: unlink fa 0 2024-05-09T00:07:26.574 INFO:tasks.workunit.client.1.smithi135.stdout:9/20: symlink d1/l4 0 2024-05-09T00:07:26.574 INFO:tasks.workunit.client.1.smithi135.stdout:9/21: read - d1/f2 zero size 2024-05-09T00:07:26.575 INFO:tasks.workunit.client.1.smithi135.stdout:6/66: creat d2/f17 x:0 0 0 2024-05-09T00:07:26.575 INFO:tasks.workunit.client.1.smithi135.stdout:6/67: write d2/f17 [781082,119279] 0 2024-05-09T00:07:26.575 INFO:tasks.workunit.client.1.smithi135.stdout:1/15: mkdir d5 0 2024-05-09T00:07:26.577 INFO:tasks.workunit.client.1.smithi135.stdout:4/34: stat l8 0 2024-05-09T00:07:26.579 INFO:tasks.workunit.client.1.smithi135.stdout:7/50: symlink db/dd/l11 0 2024-05-09T00:07:26.579 INFO:tasks.workunit.client.1.smithi135.stdout:7/51: dread - db/ff zero size 2024-05-09T00:07:26.580 INFO:tasks.workunit.client.1.smithi135.stdout:5/52: dwrite db/fe [0,4194304] 0 2024-05-09T00:07:26.580 INFO:tasks.workunit.client.1.smithi135.stdout:6/68: link d2/fc d2/da/f18 0 2024-05-09T00:07:26.582 INFO:tasks.workunit.client.1.smithi135.stdout:4/35: mkdir dc 0 2024-05-09T00:07:26.583 INFO:tasks.workunit.client.1.smithi135.stdout:7/52: creat db/f12 x:0 0 0 2024-05-09T00:07:26.583 INFO:tasks.workunit.client.1.smithi135.stdout:6/69: write d2/da/fb [1241748,115093] 0 2024-05-09T00:07:26.583 INFO:tasks.workunit.client.1.smithi135.stdout:7/53: truncate db/f12 67653 0 2024-05-09T00:07:26.583 INFO:tasks.workunit.client.1.smithi135.stdout:7/54: fdatasync db/fc 0 2024-05-09T00:07:26.583 INFO:tasks.workunit.client.1.smithi135.stdout:7/55: write db/ff [850794,87443] 0 2024-05-09T00:07:26.584 INFO:tasks.workunit.client.1.smithi135.stdout:5/53: symlink db/l13 0 2024-05-09T00:07:26.586 INFO:tasks.workunit.client.1.smithi135.stdout:6/70: symlink d2/da/l19 0 2024-05-09T00:07:26.586 INFO:tasks.workunit.client.1.smithi135.stdout:6/71: fdatasync d2/f9 0 2024-05-09T00:07:26.589 INFO:tasks.workunit.client.1.smithi135.stdout:7/56: mkdir db/d13 0 2024-05-09T00:07:26.593 INFO:tasks.workunit.client.1.smithi135.stdout:7/57: dread f8 [0,4194304] 0 2024-05-09T00:07:26.594 INFO:tasks.workunit.client.1.smithi135.stdout:6/72: mkdir d2/d1a 0 2024-05-09T00:07:26.597 INFO:tasks.workunit.client.1.smithi135.stdout:7/58: creat db/dd/f14 x:0 0 0 2024-05-09T00:07:26.598 INFO:tasks.workunit.client.1.smithi135.stdout:6/73: link d2/f9 d2/d1a/f1b 0 2024-05-09T00:07:26.599 INFO:tasks.workunit.client.1.smithi135.stdout:7/59: link l7 db/l15 0 2024-05-09T00:07:26.599 INFO:tasks.workunit.client.1.smithi135.stdout:7/60: write f8 [1431310,29058] 0 2024-05-09T00:07:26.607 INFO:tasks.workunit.client.1.smithi135.stdout:8/20: dwrite f2 [0,4194304] 0 2024-05-09T00:07:26.611 INFO:tasks.workunit.client.1.smithi135.stdout:2/62: dwrite d1/fd [0,4194304] 0 2024-05-09T00:07:26.611 INFO:tasks.workunit.client.1.smithi135.stdout:4/36: dwrite f7 [4194304,4194304] 0 2024-05-09T00:07:26.612 INFO:tasks.workunit.client.1.smithi135.stdout:3/10: dwrite f1 [0,4194304] 0 2024-05-09T00:07:26.612 INFO:tasks.workunit.client.1.smithi135.stdout:3/11: chown f1 59924080 1 2024-05-09T00:07:26.703 INFO:tasks.workunit.client.1.smithi135.stdout:7/61: creat db/f16 x:0 0 0 2024-05-09T00:07:26.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/16: dwrite f2 [0,4194304] 0 2024-05-09T00:07:26.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/17: read - f4 zero size 2024-05-09T00:07:26.703 INFO:tasks.workunit.client.1.smithi135.stdout:8/21: mkdir d4 0 2024-05-09T00:07:26.706 INFO:tasks.workunit.client.1.smithi135.stdout:4/37: mkdir dc/dd 0 2024-05-09T00:07:26.719 INFO:tasks.workunit.client.1.smithi135.stdout:4/38: dwrite f7 [4194304,4194304] 0 2024-05-09T00:07:26.749 INFO:tasks.workunit.client.1.smithi135.stdout:3/12: symlink l4 0 2024-05-09T00:07:26.759 INFO:tasks.workunit.client.1.smithi135.stdout:9/22: getdents d1 0 2024-05-09T00:07:26.759 INFO:tasks.workunit.client.1.smithi135.stdout:9/23: fsync d1/f2 0 2024-05-09T00:07:26.760 INFO:tasks.workunit.client.1.smithi135.stdout:9/24: fsync d1/f2 0 2024-05-09T00:07:26.762 INFO:tasks.workunit.client.1.smithi135.stdout:7/62: symlink db/l17 0 2024-05-09T00:07:26.767 INFO:tasks.workunit.client.1.smithi135.stdout:2/63: mkdir d1/d12 0 2024-05-09T00:07:26.767 INFO:tasks.workunit.client.1.smithi135.stdout:8/22: stat l0 0 2024-05-09T00:07:26.767 INFO:tasks.workunit.client.1.smithi135.stdout:2/64: write d1/f11 [569843,7986] 0 2024-05-09T00:07:26.769 INFO:tasks.workunit.client.1.smithi135.stdout:4/39: creat dc/dd/fe x:0 0 0 2024-05-09T00:07:26.771 INFO:tasks.workunit.client.1.smithi135.stdout:3/13: creat f5 x:0 0 0 2024-05-09T00:07:26.772 INFO:tasks.workunit.client.1.smithi135.stdout:7/63: symlink db/d13/l18 0 2024-05-09T00:07:26.775 INFO:tasks.workunit.client.1.smithi135.stdout:7/64: read db/ff [645363,87438] 0 2024-05-09T00:07:26.775 INFO:tasks.workunit.client.1.smithi135.stdout:7/65: write db/dd/f14 [470520,59497] 0 2024-05-09T00:07:26.775 INFO:tasks.workunit.client.1.smithi135.stdout:7/66: truncate db/dd/f14 958906 0 2024-05-09T00:07:26.775 INFO:tasks.workunit.client.1.smithi135.stdout:7/67: readlink db/d13/l18 0 2024-05-09T00:07:26.775 INFO:tasks.workunit.client.1.smithi135.stdout:1/18: unlink f3 0 2024-05-09T00:07:26.776 INFO:tasks.workunit.client.1.smithi135.stdout:1/19: rename d5 to d5/d6 22 2024-05-09T00:07:26.776 INFO:tasks.workunit.client.1.smithi135.stdout:1/20: stat f2 0 2024-05-09T00:07:26.776 INFO:tasks.workunit.client.1.smithi135.stdout:5/54: rmdir db 39 2024-05-09T00:07:26.776 INFO:tasks.workunit.client.1.smithi135.stdout:5/55: stat db/cc 0 2024-05-09T00:07:26.777 INFO:tasks.workunit.client.1.smithi135.stdout:7/68: dread db/fc [0,4194304] 0 2024-05-09T00:07:26.783 INFO:tasks.workunit.client.1.smithi135.stdout:1/21: rmdir d5 0 2024-05-09T00:07:26.784 INFO:tasks.workunit.client.1.smithi135.stdout:6/74: getdents d2/d1a 0 2024-05-09T00:07:26.786 INFO:tasks.workunit.client.1.smithi135.stdout:2/65: truncate d1/f4 7236340 0 2024-05-09T00:07:26.786 INFO:tasks.workunit.client.1.smithi135.stdout:5/56: rmdir db 39 2024-05-09T00:07:26.788 INFO:tasks.workunit.client.1.smithi135.stdout:9/25: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:26.788 INFO:tasks.workunit.client.1.smithi135.stdout:7/69: mknod db/c19 0 2024-05-09T00:07:26.788 INFO:tasks.workunit.client.1.smithi135.stdout:7/70: truncate db/f16 267893 0 2024-05-09T00:07:26.789 INFO:tasks.workunit.client.1.smithi135.stdout:8/23: dwrite f2 [0,4194304] 0 2024-05-09T00:07:26.791 INFO:tasks.workunit.client.1.smithi135.stdout:5/57: getdents db 0 2024-05-09T00:07:26.791 INFO:tasks.workunit.client.1.smithi135.stdout:5/58: dread - db/f10 zero size 2024-05-09T00:07:26.795 INFO:tasks.workunit.client.1.smithi135.stdout:9/26: mkdir d1/d5 0 2024-05-09T00:07:26.796 INFO:tasks.workunit.client.1.smithi135.stdout:7/71: unlink db/f12 0 2024-05-09T00:07:26.799 INFO:tasks.workunit.client.1.smithi135.stdout:6/75: dwrite d2/f7 [0,4194304] 0 2024-05-09T00:07:26.799 INFO:tasks.workunit.client.1.smithi135.stdout:9/27: write d1/f2 [4049632,42993] 0 2024-05-09T00:07:26.800 INFO:tasks.workunit.client.1.smithi135.stdout:2/66: mknod d1/c13 0 2024-05-09T00:07:26.802 INFO:tasks.workunit.client.1.smithi135.stdout:7/72: link db/dd/l11 db/dd/l1a 0 2024-05-09T00:07:26.803 INFO:tasks.workunit.client.1.smithi135.stdout:0/34: sync 2024-05-09T00:07:26.803 INFO:tasks.workunit.client.1.smithi135.stdout:0/35: dread - d3/f4 zero size 2024-05-09T00:07:26.803 INFO:tasks.workunit.client.1.smithi135.stdout:0/36: chown l1 49414514 1 2024-05-09T00:07:26.805 INFO:tasks.workunit.client.1.smithi135.stdout:8/24: rename f2 to d4/f5 0 2024-05-09T00:07:26.806 INFO:tasks.workunit.client.1.smithi135.stdout:2/67: readlink d1/le 0 2024-05-09T00:07:26.807 INFO:tasks.workunit.client.1.smithi135.stdout:7/73: creat db/dd/f1b x:0 0 0 2024-05-09T00:07:26.807 INFO:tasks.workunit.client.1.smithi135.stdout:2/68: dread d1/f11 [0,4194304] 0 2024-05-09T00:07:26.809 INFO:tasks.workunit.client.1.smithi135.stdout:3/14: getdents . 0 2024-05-09T00:07:26.809 INFO:tasks.workunit.client.1.smithi135.stdout:3/15: dread - f5 zero size 2024-05-09T00:07:26.810 INFO:tasks.workunit.client.1.smithi135.stdout:5/59: dwrite db/f12 [0,4194304] 0 2024-05-09T00:07:26.810 INFO:tasks.workunit.client.1.smithi135.stdout:5/60: chown db/f11 172 1 2024-05-09T00:07:26.811 INFO:tasks.workunit.client.1.smithi135.stdout:8/25: mknod d4/c6 0 2024-05-09T00:07:26.811 INFO:tasks.workunit.client.1.smithi135.stdout:8/26: fdatasync d4/f5 0 2024-05-09T00:07:26.813 INFO:tasks.workunit.client.1.smithi135.stdout:7/74: creat db/dd/f1c x:0 0 0 2024-05-09T00:07:26.813 INFO:tasks.workunit.client.1.smithi135.stdout:2/69: chown d1/l10 3726540 1 2024-05-09T00:07:26.816 INFO:tasks.workunit.client.1.smithi135.stdout:6/76: rename d2/da/l19 to d2/l1c 0 2024-05-09T00:07:26.817 INFO:tasks.workunit.client.1.smithi135.stdout:1/22: getdents . 0 2024-05-09T00:07:26.821 INFO:tasks.workunit.client.1.smithi135.stdout:5/61: rmdir db 39 2024-05-09T00:07:26.824 INFO:tasks.workunit.client.1.smithi135.stdout:0/37: rename l1 to d3/l5 0 2024-05-09T00:07:26.827 INFO:tasks.workunit.client.1.smithi135.stdout:6/77: mkdir d2/da/d1d 0 2024-05-09T00:07:26.828 INFO:tasks.workunit.client.1.smithi135.stdout:3/16: dwrite f0 [0,4194304] 0 2024-05-09T00:07:26.829 INFO:tasks.workunit.client.1.smithi135.stdout:1/23: creat f7 x:0 0 0 2024-05-09T00:07:26.831 INFO:tasks.workunit.client.1.smithi135.stdout:2/70: symlink d1/l14 0 2024-05-09T00:07:26.833 INFO:tasks.workunit.client.1.smithi135.stdout:6/78: mkdir d2/d1a/d1e 0 2024-05-09T00:07:26.833 INFO:tasks.workunit.client.1.smithi135.stdout:6/79: write d2/da/f10 [349346,20564] 0 2024-05-09T00:07:26.835 INFO:tasks.workunit.client.1.smithi135.stdout:8/27: dwrite d4/f5 [0,4194304] 0 2024-05-09T00:07:26.836 INFO:tasks.workunit.client.1.smithi135.stdout:3/17: mknod c6 0 2024-05-09T00:07:26.837 INFO:tasks.workunit.client.1.smithi135.stdout:1/24: creat f8 x:0 0 0 2024-05-09T00:07:26.840 INFO:tasks.workunit.client.1.smithi135.stdout:2/71: creat d1/d12/f15 x:0 0 0 2024-05-09T00:07:26.842 INFO:tasks.workunit.client.1.smithi135.stdout:7/75: getdents db/dd 0 2024-05-09T00:07:26.844 INFO:tasks.workunit.client.1.smithi135.stdout:1/25: creat f9 x:0 0 0 2024-05-09T00:07:26.845 INFO:tasks.workunit.client.1.smithi135.stdout:6/80: dread d2/f9 [0,4194304] 0 2024-05-09T00:07:26.847 INFO:tasks.workunit.client.1.smithi135.stdout:7/76: unlink db/dd/l1a 0 2024-05-09T00:07:26.852 INFO:tasks.workunit.client.1.smithi135.stdout:5/62: dwrite db/fe [0,4194304] 0 2024-05-09T00:07:26.852 INFO:tasks.workunit.client.1.smithi135.stdout:5/63: chown l7 8054 1 2024-05-09T00:07:26.852 INFO:tasks.workunit.client.1.smithi135.stdout:0/38: rename d3/l5 to d3/l6 0 2024-05-09T00:07:26.855 INFO:tasks.workunit.client.1.smithi135.stdout:6/81: mknod d2/d1a/c1f 0 2024-05-09T00:07:26.855 INFO:tasks.workunit.client.1.smithi135.stdout:1/26: mkdir da 0 2024-05-09T00:07:26.855 INFO:tasks.workunit.client.1.smithi135.stdout:6/82: write d2/fd [1025206,86269] 0 2024-05-09T00:07:26.856 INFO:tasks.workunit.client.1.smithi135.stdout:5/64: rmdir db 39 2024-05-09T00:07:26.860 INFO:tasks.workunit.client.1.smithi135.stdout:6/83: mkdir d2/d20 0 2024-05-09T00:07:26.864 INFO:tasks.workunit.client.1.smithi135.stdout:6/84: mknod d2/da/c21 0 2024-05-09T00:07:26.869 INFO:tasks.workunit.client.1.smithi135.stdout:5/65: read db/f12 [384226,61391] 0 2024-05-09T00:07:26.869 INFO:tasks.workunit.client.1.smithi135.stdout:5/66: chown db/l13 9 1 2024-05-09T00:07:26.870 INFO:tasks.workunit.client.1.smithi135.stdout:5/67: chown la 844736855 1 2024-05-09T00:07:26.870 INFO:tasks.workunit.client.1.smithi135.stdout:6/85: write d2/da/f18 [3237726,42354] 0 2024-05-09T00:07:26.870 INFO:tasks.workunit.client.1.smithi135.stdout:7/77: dwrite db/fc [0,4194304] 0 2024-05-09T00:07:26.871 INFO:tasks.workunit.client.1.smithi135.stdout:2/72: dwrite d1/f7 [0,4194304] 0 2024-05-09T00:07:26.871 INFO:tasks.workunit.client.1.smithi135.stdout:8/28: dwrite d4/f5 [0,4194304] 0 2024-05-09T00:07:26.872 INFO:tasks.workunit.client.1.smithi135.stdout:5/68: rename db/cf to db/c14 0 2024-05-09T00:07:26.874 INFO:tasks.workunit.client.1.smithi135.stdout:6/86: rename d2/c14 to d2/da/c22 0 2024-05-09T00:07:26.876 INFO:tasks.workunit.client.1.smithi135.stdout:7/78: symlink db/l1d 0 2024-05-09T00:07:26.877 INFO:tasks.workunit.client.1.smithi135.stdout:2/73: truncate d1/fd 690768 0 2024-05-09T00:07:26.879 INFO:tasks.workunit.client.1.smithi135.stdout:5/69: creat db/f15 x:0 0 0 2024-05-09T00:07:26.888 INFO:tasks.workunit.client.1.smithi135.stdout:7/79: dread db/fc [0,4194304] 0 2024-05-09T00:07:26.889 INFO:tasks.workunit.client.1.smithi135.stdout:8/29: dread d4/f5 [0,4194304] 0 2024-05-09T00:07:26.889 INFO:tasks.workunit.client.1.smithi135.stdout:3/18: dwrite f1 [0,4194304] 0 2024-05-09T00:07:26.890 INFO:tasks.workunit.client.1.smithi135.stdout:7/80: unlink db/c19 0 2024-05-09T00:07:26.892 INFO:tasks.workunit.client.1.smithi135.stdout:8/30: getdents d4 0 2024-05-09T00:07:26.892 INFO:tasks.workunit.client.1.smithi135.stdout:3/19: getdents . 0 2024-05-09T00:07:26.893 INFO:tasks.workunit.client.1.smithi135.stdout:3/20: rmdir - no directory 2024-05-09T00:07:26.893 INFO:tasks.workunit.client.1.smithi135.stdout:3/21: getdents . 0 2024-05-09T00:07:26.893 INFO:tasks.workunit.client.1.smithi135.stdout:3/22: truncate f0 4374196 0 2024-05-09T00:07:26.893 INFO:tasks.workunit.client.1.smithi135.stdout:3/23: dread - f3 zero size 2024-05-09T00:07:26.894 INFO:tasks.workunit.client.1.smithi135.stdout:7/81: mkdir db/d1e 0 2024-05-09T00:07:26.894 INFO:tasks.workunit.client.1.smithi135.stdout:3/24: symlink l7 0 2024-05-09T00:07:26.895 INFO:tasks.workunit.client.1.smithi135.stdout:1/27: dwrite f9 [0,4194304] 0 2024-05-09T00:07:26.895 INFO:tasks.workunit.client.1.smithi135.stdout:2/74: dread d1/f7 [0,4194304] 0 2024-05-09T00:07:26.895 INFO:tasks.workunit.client.1.smithi135.stdout:2/75: stat d1/f7 0 2024-05-09T00:07:26.896 INFO:tasks.workunit.client.1.smithi135.stdout:5/70: dwrite f4 [0,4194304] 0 2024-05-09T00:07:26.897 INFO:tasks.workunit.client.1.smithi135.stdout:6/87: unlink d2/da/c22 0 2024-05-09T00:07:26.898 INFO:tasks.workunit.client.1.smithi135.stdout:3/25: dread - f5 zero size 2024-05-09T00:07:26.899 INFO:tasks.workunit.client.1.smithi135.stdout:8/31: dread d4/f5 [0,4194304] 0 2024-05-09T00:07:26.901 INFO:tasks.workunit.client.1.smithi135.stdout:7/82: rename db/l15 to db/dd/l1f 0 2024-05-09T00:07:26.903 INFO:tasks.workunit.client.1.smithi135.stdout:1/28: mkdir da/db 0 2024-05-09T00:07:26.904 INFO:tasks.workunit.client.1.smithi135.stdout:6/88: creat d2/d1a/d1e/f23 x:0 0 0 2024-05-09T00:07:26.905 INFO:tasks.workunit.client.1.smithi135.stdout:6/89: readlink d2/l13 0 2024-05-09T00:07:26.905 INFO:tasks.workunit.client.1.smithi135.stdout:6/90: write d2/da/f18 [4368945,103108] 0 2024-05-09T00:07:26.905 INFO:tasks.workunit.client.1.smithi135.stdout:3/26: fdatasync f3 0 2024-05-09T00:07:26.905 INFO:tasks.workunit.client.1.smithi135.stdout:3/27: truncate f5 30801 0 2024-05-09T00:07:26.906 INFO:tasks.workunit.client.1.smithi135.stdout:8/32: truncate d4/f5 1324974 0 2024-05-09T00:07:26.907 INFO:tasks.workunit.client.1.smithi135.stdout:5/71: rename f6 to db/f16 0 2024-05-09T00:07:26.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/83: truncate db/dd/f14 1500593 0 2024-05-09T00:07:26.909 INFO:tasks.workunit.client.1.smithi135.stdout:1/29: truncate f4 960877 0 2024-05-09T00:07:26.909 INFO:tasks.workunit.client.1.smithi135.stdout:4/40: sync 2024-05-09T00:07:26.909 INFO:tasks.workunit.client.1.smithi135.stdout:9/28: sync 2024-05-09T00:07:26.909 INFO:tasks.workunit.client.1.smithi135.stdout:9/29: read d1/f2 [1906583,34315] 0 2024-05-09T00:07:26.910 INFO:tasks.workunit.client.1.smithi135.stdout:4/41: write f3 [338747,48537] 0 2024-05-09T00:07:26.911 INFO:tasks.workunit.client.1.smithi135.stdout:2/76: unlink d1/cf 0 2024-05-09T00:07:26.914 INFO:tasks.workunit.client.1.smithi135.stdout:6/91: creat d2/d1a/f24 x:0 0 0 2024-05-09T00:07:26.914 INFO:tasks.workunit.client.1.smithi135.stdout:8/33: mkdir d4/d7 0 2024-05-09T00:07:26.915 INFO:tasks.workunit.client.1.smithi135.stdout:0/39: sync 2024-05-09T00:07:26.916 INFO:tasks.workunit.client.1.smithi135.stdout:5/72: mknod db/c17 0 2024-05-09T00:07:26.916 INFO:tasks.workunit.client.1.smithi135.stdout:5/73: chown l7 24085 1 2024-05-09T00:07:26.917 INFO:tasks.workunit.client.1.smithi135.stdout:1/30: creat da/fc x:0 0 0 2024-05-09T00:07:26.917 INFO:tasks.workunit.client.1.smithi135.stdout:1/31: truncate f8 884816 0 2024-05-09T00:07:26.919 INFO:tasks.workunit.client.1.smithi135.stdout:2/77: symlink d1/d12/l16 0 2024-05-09T00:07:26.919 INFO:tasks.workunit.client.1.smithi135.stdout:2/78: write d1/f11 [754578,81935] 0 2024-05-09T00:07:26.919 INFO:tasks.workunit.client.1.smithi135.stdout:3/28: mkdir d8 0 2024-05-09T00:07:26.920 INFO:tasks.workunit.client.1.smithi135.stdout:8/34: mkdir d4/d8 0 2024-05-09T00:07:26.922 INFO:tasks.workunit.client.1.smithi135.stdout:0/40: rename d3/l6 to d3/l7 0 2024-05-09T00:07:26.922 INFO:tasks.workunit.client.1.smithi135.stdout:0/41: truncate d3/f4 710416 0 2024-05-09T00:07:26.922 INFO:tasks.workunit.client.1.smithi135.stdout:0/42: readlink d3/l7 0 2024-05-09T00:07:26.922 INFO:tasks.workunit.client.1.smithi135.stdout:0/43: rename d3 to d3/d8 22 2024-05-09T00:07:26.922 INFO:tasks.workunit.client.1.smithi135.stdout:2/79: creat d1/f17 x:0 0 0 2024-05-09T00:07:26.923 INFO:tasks.workunit.client.1.smithi135.stdout:2/80: write d1/d12/f15 [617165,19989] 0 2024-05-09T00:07:26.923 INFO:tasks.workunit.client.1.smithi135.stdout:3/29: chown l4 217 1 2024-05-09T00:07:26.923 INFO:tasks.workunit.client.1.smithi135.stdout:3/30: rename d8 to d8/d9 22 2024-05-09T00:07:26.925 INFO:tasks.workunit.client.1.smithi135.stdout:8/35: creat d4/d7/f9 x:0 0 0 2024-05-09T00:07:26.926 INFO:tasks.workunit.client.1.smithi135.stdout:3/31: creat d8/fa x:0 0 0 2024-05-09T00:07:26.926 INFO:tasks.workunit.client.1.smithi135.stdout:3/32: read - f3 zero size 2024-05-09T00:07:26.926 INFO:tasks.workunit.client.1.smithi135.stdout:3/33: dread - f3 zero size 2024-05-09T00:07:26.927 INFO:tasks.workunit.client.1.smithi135.stdout:8/36: creat d4/d8/fa x:0 0 0 2024-05-09T00:07:26.938 INFO:tasks.workunit.client.1.smithi135.stdout:3/34: symlink d8/lb 0 2024-05-09T00:07:26.938 INFO:tasks.workunit.client.1.smithi135.stdout:3/35: chown d8/lb 61368 1 2024-05-09T00:07:26.938 INFO:tasks.workunit.client.1.smithi135.stdout:8/37: creat d4/d8/fb x:0 0 0 2024-05-09T00:07:26.939 INFO:tasks.workunit.client.1.smithi135.stdout:3/36: rename d8/fa to d8/fc 0 2024-05-09T00:07:26.942 INFO:tasks.workunit.client.1.smithi135.stdout:7/84: dwrite f8 [0,4194304] 0 2024-05-09T00:07:26.954 INFO:tasks.workunit.client.1.smithi135.stdout:5/74: dwrite db/fe [0,4194304] 0 2024-05-09T00:07:26.956 INFO:tasks.workunit.client.1.smithi135.stdout:7/85: write f8 [129304,54350] 0 2024-05-09T00:07:26.958 INFO:tasks.workunit.client.1.smithi135.stdout:7/86: creat db/d13/f20 x:0 0 0 2024-05-09T00:07:26.958 INFO:tasks.workunit.client.1.smithi135.stdout:7/87: readlink l9 0 2024-05-09T00:07:26.959 INFO:tasks.workunit.client.1.smithi135.stdout:7/88: mkdir db/d21 0 2024-05-09T00:07:26.959 INFO:tasks.workunit.client.1.smithi135.stdout:7/89: fsync db/f16 0 2024-05-09T00:07:26.959 INFO:tasks.workunit.client.1.smithi135.stdout:7/90: creat db/f22 x:0 0 0 2024-05-09T00:07:26.960 INFO:tasks.workunit.client.1.smithi135.stdout:1/32: dwrite f7 [0,4194304] 0 2024-05-09T00:07:26.960 INFO:tasks.workunit.client.1.smithi135.stdout:1/33: write f8 [1652872,84674] 0 2024-05-09T00:07:26.961 INFO:tasks.workunit.client.1.smithi135.stdout:0/44: dwrite d3/f4 [0,4194304] 0 2024-05-09T00:07:26.962 INFO:tasks.workunit.client.1.smithi135.stdout:6/92: dwrite d2/d1a/f1b [0,4194304] 0 2024-05-09T00:07:26.963 INFO:tasks.workunit.client.1.smithi135.stdout:9/30: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:26.963 INFO:tasks.workunit.client.1.smithi135.stdout:2/81: dwrite d1/f17 [0,4194304] 0 2024-05-09T00:07:26.967 INFO:tasks.workunit.client.1.smithi135.stdout:1/34: creat da/db/fd x:0 0 0 2024-05-09T00:07:26.971 INFO:tasks.workunit.client.1.smithi135.stdout:6/93: creat d2/f25 x:0 0 0 2024-05-09T00:07:26.971 INFO:tasks.workunit.client.1.smithi135.stdout:6/94: write d2/da/f10 [921341,38117] 0 2024-05-09T00:07:26.975 INFO:tasks.workunit.client.1.smithi135.stdout:0/45: rename d3/l7 to d3/l9 0 2024-05-09T00:07:26.979 INFO:tasks.workunit.client.1.smithi135.stdout:1/35: rename f7 to da/db/fe 0 2024-05-09T00:07:26.980 INFO:tasks.workunit.client.1.smithi135.stdout:2/82: rmdir d1 39 2024-05-09T00:07:26.982 INFO:tasks.workunit.client.1.smithi135.stdout:8/38: fsync d4/d7/f9 0 2024-05-09T00:07:26.982 INFO:tasks.workunit.client.1.smithi135.stdout:8/39: chown l0 10992 1 2024-05-09T00:07:26.982 INFO:tasks.workunit.client.1.smithi135.stdout:8/40: chown l1 3798608 1 2024-05-09T00:07:26.984 INFO:tasks.workunit.client.1.smithi135.stdout:1/36: mknod da/cf 0 2024-05-09T00:07:26.984 INFO:tasks.workunit.client.1.smithi135.stdout:6/95: mkdir d2/da/d26 0 2024-05-09T00:07:26.985 INFO:tasks.workunit.client.1.smithi135.stdout:8/41: creat d4/d7/fc x:0 0 0 2024-05-09T00:07:26.987 INFO:tasks.workunit.client.1.smithi135.stdout:5/75: dwrite db/f12 [0,4194304] 0 2024-05-09T00:07:26.988 INFO:tasks.workunit.client.1.smithi135.stdout:0/46: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:26.988 INFO:tasks.workunit.client.1.smithi135.stdout:0/47: fsync d3/f4 0 2024-05-09T00:07:26.988 INFO:tasks.workunit.client.1.smithi135.stdout:8/42: symlink d4/ld 0 2024-05-09T00:07:26.989 INFO:tasks.workunit.client.1.smithi135.stdout:8/43: write d4/d7/f9 [262810,81572] 0 2024-05-09T00:07:26.989 INFO:tasks.workunit.client.1.smithi135.stdout:9/31: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:26.990 INFO:tasks.workunit.client.1.smithi135.stdout:5/76: truncate f9 519971 0 2024-05-09T00:07:26.992 INFO:tasks.workunit.client.1.smithi135.stdout:1/37: read f2 [3706312,34630] 0 2024-05-09T00:07:26.992 INFO:tasks.workunit.client.1.smithi135.stdout:9/32: symlink d1/l6 0 2024-05-09T00:07:26.996 INFO:tasks.workunit.client.1.smithi135.stdout:0/48: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:26.996 INFO:tasks.workunit.client.1.smithi135.stdout:1/38: rename da/fc to da/f10 0 2024-05-09T00:07:27.004 INFO:tasks.workunit.client.1.smithi135.stdout:1/39: mknod da/db/c11 0 2024-05-09T00:07:27.004 INFO:tasks.workunit.client.1.smithi135.stdout:0/49: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:27.005 INFO:tasks.workunit.client.1.smithi135.stdout:1/40: creat da/db/f12 x:0 0 0 2024-05-09T00:07:27.006 INFO:tasks.workunit.client.1.smithi135.stdout:1/41: creat da/f13 x:0 0 0 2024-05-09T00:07:27.006 INFO:tasks.workunit.client.1.smithi135.stdout:1/42: fsync da/db/fd 0 2024-05-09T00:07:27.007 INFO:tasks.workunit.client.1.smithi135.stdout:1/43: mkdir da/d14 0 2024-05-09T00:07:27.012 INFO:tasks.workunit.client.1.smithi135.stdout:1/44: truncate f4 480495 0 2024-05-09T00:07:27.012 INFO:tasks.workunit.client.1.smithi135.stdout:1/45: stat da/f10 0 2024-05-09T00:07:27.013 INFO:tasks.workunit.client.1.smithi135.stdout:0/50: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:27.013 INFO:tasks.workunit.client.1.smithi135.stdout:0/51: read d3/f4 [3743576,23844] 0 2024-05-09T00:07:27.014 INFO:tasks.workunit.client.1.smithi135.stdout:0/52: mknod d3/ca 0 2024-05-09T00:07:27.015 INFO:tasks.workunit.client.1.smithi135.stdout:0/53: creat d3/fb x:0 0 0 2024-05-09T00:07:27.016 INFO:tasks.workunit.client.1.smithi135.stdout:0/54: mknod d3/cc 0 2024-05-09T00:07:27.016 INFO:tasks.workunit.client.1.smithi135.stdout:0/55: truncate d3/fb 331824 0 2024-05-09T00:07:27.016 INFO:tasks.workunit.client.1.smithi135.stdout:0/56: fsync d3/f4 0 2024-05-09T00:07:27.017 INFO:tasks.workunit.client.1.smithi135.stdout:0/57: mkdir d3/dd 0 2024-05-09T00:07:27.017 INFO:tasks.workunit.client.1.smithi135.stdout:7/91: dwrite f8 [0,4194304] 0 2024-05-09T00:07:27.017 INFO:tasks.workunit.client.1.smithi135.stdout:0/58: write d3/f4 [518240,76036] 0 2024-05-09T00:07:27.027 INFO:tasks.workunit.client.1.smithi135.stdout:8/44: dwrite d4/f5 [0,4194304] 0 2024-05-09T00:07:27.030 INFO:tasks.workunit.client.1.smithi135.stdout:8/45: mkdir d4/d7/de 0 2024-05-09T00:07:27.030 INFO:tasks.workunit.client.1.smithi135.stdout:8/46: stat d4/d7/fc 0 2024-05-09T00:07:27.030 INFO:tasks.workunit.client.1.smithi135.stdout:9/33: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:27.030 INFO:tasks.workunit.client.1.smithi135.stdout:6/96: dwrite d2/fd [0,4194304] 0 2024-05-09T00:07:27.030 INFO:tasks.workunit.client.1.smithi135.stdout:5/77: dread f9 [0,4194304] 0 2024-05-09T00:07:27.031 INFO:tasks.workunit.client.1.smithi135.stdout:8/47: creat d4/d8/ff x:0 0 0 2024-05-09T00:07:27.031 INFO:tasks.workunit.client.1.smithi135.stdout:8/48: write d4/d8/fa [888771,45997] 0 2024-05-09T00:07:27.031 INFO:tasks.workunit.client.1.smithi135.stdout:9/34: mkdir d1/d7 0 2024-05-09T00:07:27.031 INFO:tasks.workunit.client.1.smithi135.stdout:9/35: fdatasync d1/f2 0 2024-05-09T00:07:27.032 INFO:tasks.workunit.client.1.smithi135.stdout:2/83: dwrite d1/f17 [0,4194304] 0 2024-05-09T00:07:27.032 INFO:tasks.workunit.client.1.smithi135.stdout:2/84: fdatasync d1/f7 0 2024-05-09T00:07:27.032 INFO:tasks.workunit.client.1.smithi135.stdout:2/85: stat d1/fd 0 2024-05-09T00:07:27.033 INFO:tasks.workunit.client.1.smithi135.stdout:2/86: write d1/d12/f15 [81592,11939] 0 2024-05-09T00:07:27.034 INFO:tasks.workunit.client.1.smithi135.stdout:5/78: symlink db/l18 0 2024-05-09T00:07:27.036 INFO:tasks.workunit.client.1.smithi135.stdout:6/97: dread d2/da/f10 [0,4194304] 0 2024-05-09T00:07:27.036 INFO:tasks.workunit.client.1.smithi135.stdout:9/36: rename d1/l3 to d1/d5/l8 0 2024-05-09T00:07:27.041 INFO:tasks.workunit.client.1.smithi135.stdout:0/59: dwrite d3/fb [0,4194304] 0 2024-05-09T00:07:27.042 INFO:tasks.workunit.client.1.smithi135.stdout:2/87: stat d1/c8 0 2024-05-09T00:07:27.042 INFO:tasks.workunit.client.1.smithi135.stdout:5/79: creat db/f19 x:0 0 0 2024-05-09T00:07:27.044 INFO:tasks.workunit.client.1.smithi135.stdout:6/98: creat d2/da/d1d/f27 x:0 0 0 2024-05-09T00:07:27.044 INFO:tasks.workunit.client.1.smithi135.stdout:6/99: truncate d2/d1a/d1e/f23 412331 0 2024-05-09T00:07:27.047 INFO:tasks.workunit.client.1.smithi135.stdout:4/42: sync 2024-05-09T00:07:27.047 INFO:tasks.workunit.client.1.smithi135.stdout:2/88: dread d1/f4 [4194304,4194304] 0 2024-05-09T00:07:27.047 INFO:tasks.workunit.client.1.smithi135.stdout:2/89: fdatasync d1/f11 0 2024-05-09T00:07:27.047 INFO:tasks.workunit.client.1.smithi135.stdout:2/90: write d1/f7 [4601009,42593] 0 2024-05-09T00:07:27.048 INFO:tasks.workunit.client.1.smithi135.stdout:4/43: symlink dc/lf 0 2024-05-09T00:07:27.050 INFO:tasks.workunit.client.1.smithi135.stdout:4/44: creat dc/dd/f10 x:0 0 0 2024-05-09T00:07:27.053 INFO:tasks.workunit.client.1.smithi135.stdout:4/45: write f7 [5575034,113296] 0 2024-05-09T00:07:27.054 INFO:tasks.workunit.client.1.smithi135.stdout:9/37: rename d1/d5/l8 to d1/l9 0 2024-05-09T00:07:27.055 INFO:tasks.workunit.client.1.smithi135.stdout:5/80: dread db/fd [0,4194304] 0 2024-05-09T00:07:27.055 INFO:tasks.workunit.client.1.smithi135.stdout:5/81: dread - db/f16 zero size 2024-05-09T00:07:27.055 INFO:tasks.workunit.client.1.smithi135.stdout:8/49: dwrite d4/f5 [0,4194304] 0 2024-05-09T00:07:27.056 INFO:tasks.workunit.client.1.smithi135.stdout:4/46: creat dc/dd/f11 x:0 0 0 2024-05-09T00:07:27.057 INFO:tasks.workunit.client.1.smithi135.stdout:3/37: sync 2024-05-09T00:07:27.057 INFO:tasks.workunit.client.1.smithi135.stdout:8/50: dread d4/d7/f9 [0,4194304] 0 2024-05-09T00:07:27.058 INFO:tasks.workunit.client.1.smithi135.stdout:0/60: rename l2 to d3/dd/le 0 2024-05-09T00:07:27.062 INFO:tasks.workunit.client.1.smithi135.stdout:9/38: mknod d1/ca 0 2024-05-09T00:07:27.064 INFO:tasks.workunit.client.1.smithi135.stdout:4/47: creat dc/dd/f12 x:0 0 0 2024-05-09T00:07:27.064 INFO:tasks.workunit.client.1.smithi135.stdout:4/48: dread - dc/dd/f11 zero size 2024-05-09T00:07:27.064 INFO:tasks.workunit.client.1.smithi135.stdout:4/49: dread - dc/dd/fe zero size 2024-05-09T00:07:27.064 INFO:tasks.workunit.client.1.smithi135.stdout:5/82: rmdir db 39 2024-05-09T00:07:27.065 INFO:tasks.workunit.client.1.smithi135.stdout:6/100: dwrite d2/f25 [0,4194304] 0 2024-05-09T00:07:27.066 INFO:tasks.workunit.client.1.smithi135.stdout:6/101: fsync d2/f25 0 2024-05-09T00:07:27.066 INFO:tasks.workunit.client.1.smithi135.stdout:3/38: write f0 [5377248,126993] 0 2024-05-09T00:07:27.066 INFO:tasks.workunit.client.1.smithi135.stdout:3/39: chown d8/fc 2562 1 2024-05-09T00:07:27.071 INFO:tasks.workunit.client.1.smithi135.stdout:8/51: link d4/d7/f9 d4/d7/de/f10 0 2024-05-09T00:07:27.071 INFO:tasks.workunit.client.1.smithi135.stdout:5/83: rmdir db 39 2024-05-09T00:07:27.071 INFO:tasks.workunit.client.1.smithi135.stdout:8/52: dread - d4/d8/fb zero size 2024-05-09T00:07:27.072 INFO:tasks.workunit.client.1.smithi135.stdout:8/53: dread - d4/d7/fc zero size 2024-05-09T00:07:27.072 INFO:tasks.workunit.client.1.smithi135.stdout:8/54: chown l0 866 1 2024-05-09T00:07:27.072 INFO:tasks.workunit.client.1.smithi135.stdout:5/84: write db/f10 [316546,96447] 0 2024-05-09T00:07:27.075 INFO:tasks.workunit.client.1.smithi135.stdout:6/102: symlink d2/da/l28 0 2024-05-09T00:07:27.076 INFO:tasks.workunit.client.1.smithi135.stdout:2/91: dwrite d1/f7 [0,4194304] 0 2024-05-09T00:07:27.077 INFO:tasks.workunit.client.1.smithi135.stdout:3/40: link l4 d8/ld 0 2024-05-09T00:07:27.080 INFO:tasks.workunit.client.1.smithi135.stdout:8/55: symlink d4/d7/l11 0 2024-05-09T00:07:27.082 INFO:tasks.workunit.client.1.smithi135.stdout:5/85: truncate f9 13766 0 2024-05-09T00:07:27.082 INFO:tasks.workunit.client.1.smithi135.stdout:5/86: readlink l7 0 2024-05-09T00:07:27.082 INFO:tasks.workunit.client.1.smithi135.stdout:5/87: chown db/f11 120 1 2024-05-09T00:07:27.082 INFO:tasks.workunit.client.1.smithi135.stdout:5/88: readlink db/l13 0 2024-05-09T00:07:27.082 INFO:tasks.workunit.client.1.smithi135.stdout:5/89: stat db/f10 0 2024-05-09T00:07:27.083 INFO:tasks.workunit.client.1.smithi135.stdout:6/103: mknod d2/da/c29 0 2024-05-09T00:07:27.083 INFO:tasks.workunit.client.1.smithi135.stdout:6/104: fdatasync d2/da/fb 0 2024-05-09T00:07:27.087 INFO:tasks.workunit.client.1.smithi135.stdout:2/92: mknod d1/d12/c18 0 2024-05-09T00:07:27.088 INFO:tasks.workunit.client.1.smithi135.stdout:3/41: chown c2 1402558 1 2024-05-09T00:07:27.088 INFO:tasks.workunit.client.1.smithi135.stdout:8/56: unlink d4/d7/de/f10 0 2024-05-09T00:07:27.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/42: creat d8/fe x:0 0 0 2024-05-09T00:07:27.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/43: chown l7 529 1 2024-05-09T00:07:27.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/44: read - f3 zero size 2024-05-09T00:07:27.090 INFO:tasks.workunit.client.1.smithi135.stdout:8/57: truncate d4/d7/f9 857004 0 2024-05-09T00:07:27.091 INFO:tasks.workunit.client.1.smithi135.stdout:6/105: rename d2/f7 to d2/f2a 0 2024-05-09T00:07:27.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/93: symlink d1/l19 0 2024-05-09T00:07:27.092 INFO:tasks.workunit.client.1.smithi135.stdout:8/58: mknod d4/d7/de/c12 0 2024-05-09T00:07:27.093 INFO:tasks.workunit.client.1.smithi135.stdout:0/61: dwrite d3/fb [0,4194304] 0 2024-05-09T00:07:27.093 INFO:tasks.workunit.client.1.smithi135.stdout:9/39: dwrite d1/f2 [4194304,4194304] 0 2024-05-09T00:07:27.093 INFO:tasks.workunit.client.1.smithi135.stdout:4/50: dwrite fa [0,4194304] 0 2024-05-09T00:07:27.094 INFO:tasks.workunit.client.1.smithi135.stdout:6/106: truncate d2/f9 594568 0 2024-05-09T00:07:27.095 INFO:tasks.workunit.client.1.smithi135.stdout:6/107: chown d2/da/d1d 3730453 1 2024-05-09T00:07:27.104 INFO:tasks.workunit.client.1.smithi135.stdout:4/51: symlink dc/l13 0 2024-05-09T00:07:27.104 INFO:tasks.workunit.client.1.smithi135.stdout:2/94: link d1/f7 d1/f1a 0 2024-05-09T00:07:27.104 INFO:tasks.workunit.client.1.smithi135.stdout:5/90: write f9 [745642,89517] 0 2024-05-09T00:07:27.104 INFO:tasks.workunit.client.1.smithi135.stdout:6/108: symlink d2/d1a/l2b 0 2024-05-09T00:07:27.104 INFO:tasks.workunit.client.1.smithi135.stdout:6/109: stat d2/f9 0 2024-05-09T00:07:27.105 INFO:tasks.workunit.client.1.smithi135.stdout:2/95: read d1/d12/f15 [327559,126951] 0 2024-05-09T00:07:27.105 INFO:tasks.workunit.client.1.smithi135.stdout:2/96: chown d1/l19 150 1 2024-05-09T00:07:27.105 INFO:tasks.workunit.client.1.smithi135.stdout:2/97: chown d1/c13 456 1 2024-05-09T00:07:27.105 INFO:tasks.workunit.client.1.smithi135.stdout:2/98: stat d1/d12/f15 0 2024-05-09T00:07:27.108 INFO:tasks.workunit.client.1.smithi135.stdout:4/52: write f3 [175785,102202] 0 2024-05-09T00:07:27.108 INFO:tasks.workunit.client.1.smithi135.stdout:4/53: fsync dc/dd/f10 0 2024-05-09T00:07:27.108 INFO:tasks.workunit.client.1.smithi135.stdout:4/54: chown dc/dd/f11 465 1 2024-05-09T00:07:27.108 INFO:tasks.workunit.client.1.smithi135.stdout:4/55: write dc/dd/fe [1036184,104656] 0 2024-05-09T00:07:27.109 INFO:tasks.workunit.client.1.smithi135.stdout:2/99: dread d1/f11 [0,4194304] 0 2024-05-09T00:07:27.110 INFO:tasks.workunit.client.1.smithi135.stdout:5/91: creat db/f1a x:0 0 0 2024-05-09T00:07:27.110 INFO:tasks.workunit.client.1.smithi135.stdout:5/92: readlink la 0 2024-05-09T00:07:27.110 INFO:tasks.workunit.client.1.smithi135.stdout:5/93: write db/f10 [1459143,26119] 0 2024-05-09T00:07:27.111 INFO:tasks.workunit.client.1.smithi135.stdout:4/56: rmdir dc 39 2024-05-09T00:07:27.111 INFO:tasks.workunit.client.1.smithi135.stdout:4/57: chown dc/dd/f11 42630 1 2024-05-09T00:07:27.112 INFO:tasks.workunit.client.1.smithi135.stdout:2/100: write d1/f7 [2433187,119223] 0 2024-05-09T00:07:27.114 INFO:tasks.workunit.client.1.smithi135.stdout:4/58: rmdir dc 39 2024-05-09T00:07:27.115 INFO:tasks.workunit.client.1.smithi135.stdout:1/46: sync 2024-05-09T00:07:27.115 INFO:tasks.workunit.client.1.smithi135.stdout:7/92: sync 2024-05-09T00:07:27.115 INFO:tasks.workunit.client.1.smithi135.stdout:1/47: dread - da/f10 zero size 2024-05-09T00:07:27.115 INFO:tasks.workunit.client.1.smithi135.stdout:1/48: dread - da/db/fd zero size 2024-05-09T00:07:27.116 INFO:tasks.workunit.client.1.smithi135.stdout:2/101: creat d1/d12/f1b x:0 0 0 2024-05-09T00:07:27.117 INFO:tasks.workunit.client.1.smithi135.stdout:2/102: write d1/f7 [1180037,113838] 0 2024-05-09T00:07:27.117 INFO:tasks.workunit.client.1.smithi135.stdout:4/59: creat dc/dd/f14 x:0 0 0 2024-05-09T00:07:27.118 INFO:tasks.workunit.client.1.smithi135.stdout:0/62: dwrite d3/f4 [0,4194304] 0 2024-05-09T00:07:27.119 INFO:tasks.workunit.client.1.smithi135.stdout:7/93: symlink db/d13/l23 0 2024-05-09T00:07:27.119 INFO:tasks.workunit.client.1.smithi135.stdout:7/94: fsync db/f22 0 2024-05-09T00:07:27.120 INFO:tasks.workunit.client.1.smithi135.stdout:1/49: truncate f4 221763 0 2024-05-09T00:07:27.122 INFO:tasks.workunit.client.1.smithi135.stdout:2/103: write d1/fa [1233870,93705] 0 2024-05-09T00:07:27.122 INFO:tasks.workunit.client.1.smithi135.stdout:2/104: truncate d1/f11 1220706 0 2024-05-09T00:07:27.123 INFO:tasks.workunit.client.1.smithi135.stdout:0/63: creat d3/ff x:0 0 0 2024-05-09T00:07:27.123 INFO:tasks.workunit.client.1.smithi135.stdout:0/64: write d3/ff [1017132,19906] 0 2024-05-09T00:07:27.128 INFO:tasks.workunit.client.1.smithi135.stdout:2/105: write d1/fa [2562014,38258] 0 2024-05-09T00:07:27.128 INFO:tasks.workunit.client.1.smithi135.stdout:2/106: truncate d1/f11 1799774 0 2024-05-09T00:07:27.128 INFO:tasks.workunit.client.1.smithi135.stdout:2/107: fdatasync d1/f4 0 2024-05-09T00:07:27.130 INFO:tasks.workunit.client.1.smithi135.stdout:4/60: dread fa [0,4194304] 0 2024-05-09T00:07:27.130 INFO:tasks.workunit.client.1.smithi135.stdout:4/61: read dc/dd/fe [1055418,110333] 0 2024-05-09T00:07:27.134 INFO:tasks.workunit.client.1.smithi135.stdout:3/45: dwrite f5 [0,4194304] 0 2024-05-09T00:07:27.135 INFO:tasks.workunit.client.1.smithi135.stdout:6/110: dwrite f1 [0,4194304] 0 2024-05-09T00:07:27.137 INFO:tasks.workunit.client.1.smithi135.stdout:9/40: dwrite d1/f2 [4194304,4194304] 0 2024-05-09T00:07:27.139 INFO:tasks.workunit.client.1.smithi135.stdout:4/62: dread fa [0,4194304] 0 2024-05-09T00:07:27.139 INFO:tasks.workunit.client.1.smithi135.stdout:3/46: link l7 d8/lf 0 2024-05-09T00:07:27.139 INFO:tasks.workunit.client.1.smithi135.stdout:3/47: chown d8/ld 91 1 2024-05-09T00:07:27.144 INFO:tasks.workunit.client.1.smithi135.stdout:6/111: creat d2/f2c x:0 0 0 2024-05-09T00:07:27.144 INFO:tasks.workunit.client.1.smithi135.stdout:7/95: dwrite db/d13/f20 [0,4194304] 0 2024-05-09T00:07:27.147 INFO:tasks.workunit.client.1.smithi135.stdout:1/50: dwrite da/db/f12 [0,4194304] 0 2024-05-09T00:07:27.147 INFO:tasks.workunit.client.1.smithi135.stdout:4/63: unlink dc/dd/f10 0 2024-05-09T00:07:27.147 INFO:tasks.workunit.client.1.smithi135.stdout:4/64: write dc/dd/f14 [679868,89963] 0 2024-05-09T00:07:27.148 INFO:tasks.workunit.client.1.smithi135.stdout:4/65: write dc/dd/f12 [224004,70668] 0 2024-05-09T00:07:27.148 INFO:tasks.workunit.client.1.smithi135.stdout:5/94: getdents db 0 2024-05-09T00:07:27.148 INFO:tasks.workunit.client.1.smithi135.stdout:9/41: dread d1/f2 [0,4194304] 0 2024-05-09T00:07:27.154 INFO:tasks.workunit.client.1.smithi135.stdout:7/96: creat db/d13/f24 x:0 0 0 2024-05-09T00:07:27.156 INFO:tasks.workunit.client.1.smithi135.stdout:1/51: creat da/db/f15 x:0 0 0 2024-05-09T00:07:27.156 INFO:tasks.workunit.client.1.smithi135.stdout:4/66: creat dc/dd/f15 x:0 0 0 2024-05-09T00:07:27.158 INFO:tasks.workunit.client.1.smithi135.stdout:7/97: dread db/ff [0,4194304] 0 2024-05-09T00:07:27.166 INFO:tasks.workunit.client.1.smithi135.stdout:3/48: dwrite f3 [0,4194304] 0 2024-05-09T00:07:27.167 INFO:tasks.workunit.client.1.smithi135.stdout:1/52: unlink da/db/fd 0 2024-05-09T00:07:27.167 INFO:tasks.workunit.client.1.smithi135.stdout:4/67: rename lb to dc/l16 0 2024-05-09T00:07:27.167 INFO:tasks.workunit.client.1.smithi135.stdout:7/98: unlink db/f22 0 2024-05-09T00:07:27.170 INFO:tasks.workunit.client.1.smithi135.stdout:3/49: creat d8/f10 x:0 0 0 2024-05-09T00:07:27.170 INFO:tasks.workunit.client.1.smithi135.stdout:6/112: dwrite d2/da/f10 [0,4194304] 0 2024-05-09T00:07:27.170 INFO:tasks.workunit.client.1.smithi135.stdout:6/113: chown d2/l13 335342695 1 2024-05-09T00:07:27.172 INFO:tasks.workunit.client.1.smithi135.stdout:1/53: mkdir da/db/d16 0 2024-05-09T00:07:27.172 INFO:tasks.workunit.client.1.smithi135.stdout:7/99: creat db/d13/f25 x:0 0 0 2024-05-09T00:07:27.174 INFO:tasks.workunit.client.1.smithi135.stdout:3/50: unlink d8/ld 0 2024-05-09T00:07:27.177 INFO:tasks.workunit.client.1.smithi135.stdout:9/42: dread d1/f2 [4194304,4194304] 0 2024-05-09T00:07:27.177 INFO:tasks.workunit.client.1.smithi135.stdout:9/43: write d1/f2 [8449824,70778] 0 2024-05-09T00:07:27.178 INFO:tasks.workunit.client.1.smithi135.stdout:1/54: getdents da 0 2024-05-09T00:07:27.178 INFO:tasks.workunit.client.1.smithi135.stdout:7/100: fdatasync db/dd/f1b 0 2024-05-09T00:07:27.180 INFO:tasks.workunit.client.1.smithi135.stdout:3/51: truncate f5 2868027 0 2024-05-09T00:07:27.181 INFO:tasks.workunit.client.1.smithi135.stdout:1/55: mknod da/c17 0 2024-05-09T00:07:27.181 INFO:tasks.workunit.client.1.smithi135.stdout:1/56: write f4 [480384,39022] 0 2024-05-09T00:07:27.181 INFO:tasks.workunit.client.1.smithi135.stdout:1/57: readlink - no filename 2024-05-09T00:07:27.181 INFO:tasks.workunit.client.1.smithi135.stdout:1/58: readlink - no filename 2024-05-09T00:07:27.181 INFO:tasks.workunit.client.1.smithi135.stdout:1/59: chown f4 22 1 2024-05-09T00:07:27.182 INFO:tasks.workunit.client.1.smithi135.stdout:7/101: symlink db/d13/l26 0 2024-05-09T00:07:27.182 INFO:tasks.workunit.client.1.smithi135.stdout:7/102: fsync db/d13/f24 0 2024-05-09T00:07:27.182 INFO:tasks.workunit.client.1.smithi135.stdout:7/103: write db/d13/f25 [41001,17798] 0 2024-05-09T00:07:27.183 INFO:tasks.workunit.client.1.smithi135.stdout:1/60: creat da/db/d16/f18 x:0 0 0 2024-05-09T00:07:27.183 INFO:tasks.workunit.client.1.smithi135.stdout:7/104: mknod db/d13/c27 0 2024-05-09T00:07:27.185 INFO:tasks.workunit.client.1.smithi135.stdout:7/105: creat db/f28 x:0 0 0 2024-05-09T00:07:27.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/65: dwrite d3/fb [0,4194304] 0 2024-05-09T00:07:27.187 INFO:tasks.workunit.client.1.smithi135.stdout:4/68: dwrite dc/dd/f15 [0,4194304] 0 2024-05-09T00:07:27.187 INFO:tasks.workunit.client.1.smithi135.stdout:7/106: creat db/f29 x:0 0 0 2024-05-09T00:07:27.188 INFO:tasks.workunit.client.1.smithi135.stdout:1/61: dread f4 [0,4194304] 0 2024-05-09T00:07:27.188 INFO:tasks.workunit.client.1.smithi135.stdout:6/114: dread d2/fd [0,4194304] 0 2024-05-09T00:07:27.188 INFO:tasks.workunit.client.1.smithi135.stdout:5/95: dwrite db/f19 [0,4194304] 0 2024-05-09T00:07:27.189 INFO:tasks.workunit.client.1.smithi135.stdout:6/115: write d2/f17 [1385578,59208] 0 2024-05-09T00:07:27.198 INFO:tasks.workunit.client.1.smithi135.stdout:1/62: creat da/d14/f19 x:0 0 0 2024-05-09T00:07:27.198 INFO:tasks.workunit.client.1.smithi135.stdout:1/63: dread - da/db/f15 zero size 2024-05-09T00:07:27.206 INFO:tasks.workunit.client.1.smithi135.stdout:9/44: dread d1/f2 [0,4194304] 0 2024-05-09T00:07:27.207 INFO:tasks.workunit.client.1.smithi135.stdout:1/64: rename da/db/f12 to da/d14/f1a 0 2024-05-09T00:07:27.208 INFO:tasks.workunit.client.1.smithi135.stdout:6/116: mknod d2/c2d 0 2024-05-09T00:07:27.208 INFO:tasks.workunit.client.1.smithi135.stdout:1/65: creat da/d14/f1b x:0 0 0 2024-05-09T00:07:27.210 INFO:tasks.workunit.client.1.smithi135.stdout:6/117: mkdir d2/d20/d2e 0 2024-05-09T00:07:27.210 INFO:tasks.workunit.client.1.smithi135.stdout:1/66: write da/db/fe [1462053,78984] 0 2024-05-09T00:07:27.210 INFO:tasks.workunit.client.1.smithi135.stdout:6/118: write d2/fd [2324186,19190] 0 2024-05-09T00:07:27.212 INFO:tasks.workunit.client.1.smithi135.stdout:6/119: rmdir d2/d20 39 2024-05-09T00:07:27.214 INFO:tasks.workunit.client.1.smithi135.stdout:6/120: mknod d2/c2f 0 2024-05-09T00:07:27.218 INFO:tasks.workunit.client.1.smithi135.stdout:9/45: dread d1/f2 [4194304,4194304] 0 2024-05-09T00:07:27.218 INFO:tasks.workunit.client.1.smithi135.stdout:9/46: chown d1/l4 946066852 1 2024-05-09T00:07:27.218 INFO:tasks.workunit.client.1.smithi135.stdout:9/47: creat d1/d5/fb x:0 0 0 2024-05-09T00:07:27.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/48: chown d1/d5 10 1 2024-05-09T00:07:27.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/49: write d1/f2 [1263208,113502] 0 2024-05-09T00:07:27.219 INFO:tasks.workunit.client.1.smithi135.stdout:8/59: sync 2024-05-09T00:07:27.220 INFO:tasks.workunit.client.1.smithi135.stdout:8/60: dread - d4/d7/fc zero size 2024-05-09T00:07:27.221 INFO:tasks.workunit.client.1.smithi135.stdout:4/69: dwrite dc/dd/f15 [0,4194304] 0 2024-05-09T00:07:27.222 INFO:tasks.workunit.client.1.smithi135.stdout:3/52: dwrite d8/fc [0,4194304] 0 2024-05-09T00:07:27.222 INFO:tasks.workunit.client.1.smithi135.stdout:0/66: dwrite d3/fb [0,4194304] 0 2024-05-09T00:07:27.223 INFO:tasks.workunit.client.1.smithi135.stdout:8/61: rename d4/c6 to d4/d7/c13 0 2024-05-09T00:07:27.224 INFO:tasks.workunit.client.1.smithi135.stdout:5/96: dwrite db/f1a [0,4194304] 0 2024-05-09T00:07:27.225 INFO:tasks.workunit.client.1.smithi135.stdout:4/70: creat dc/dd/f17 x:0 0 0 2024-05-09T00:07:27.225 INFO:tasks.workunit.client.1.smithi135.stdout:6/121: dread f1 [0,4194304] 0 2024-05-09T00:07:27.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/122: truncate d2/d1a/f1b 998321 0 2024-05-09T00:07:27.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/123: chown d2/d20/d2e 1 1 2024-05-09T00:07:27.229 INFO:tasks.workunit.client.1.smithi135.stdout:0/67: write d3/ff [832869,25841] 0 2024-05-09T00:07:27.230 INFO:tasks.workunit.client.1.smithi135.stdout:8/62: creat d4/d7/de/f14 x:0 0 0 2024-05-09T00:07:27.234 INFO:tasks.workunit.client.1.smithi135.stdout:5/97: mknod db/c1b 0 2024-05-09T00:07:27.235 INFO:tasks.workunit.client.1.smithi135.stdout:9/50: truncate d1/f2 476776 0 2024-05-09T00:07:27.236 INFO:tasks.workunit.client.1.smithi135.stdout:4/71: rmdir dc 39 2024-05-09T00:07:27.236 INFO:tasks.workunit.client.1.smithi135.stdout:4/72: chown dc/lf 3919389 1 2024-05-09T00:07:27.238 INFO:tasks.workunit.client.1.smithi135.stdout:3/53: dwrite f0 [4194304,4194304] 0 2024-05-09T00:07:27.239 INFO:tasks.workunit.client.1.smithi135.stdout:6/124: rename d2/da/f10 to d2/d1a/f30 0 2024-05-09T00:07:27.239 INFO:tasks.workunit.client.1.smithi135.stdout:3/54: write f0 [5584913,20061] 0 2024-05-09T00:07:27.240 INFO:tasks.workunit.client.1.smithi135.stdout:4/73: creat dc/f18 x:0 0 0 2024-05-09T00:07:27.242 INFO:tasks.workunit.client.1.smithi135.stdout:0/68: rename d3/dd/le to d3/l10 0 2024-05-09T00:07:27.243 INFO:tasks.workunit.client.1.smithi135.stdout:6/125: mknod d2/d1a/d1e/c31 0 2024-05-09T00:07:27.243 INFO:tasks.workunit.client.1.smithi135.stdout:6/126: chown d2/d1a/d1e/c31 391 1 2024-05-09T00:07:27.243 INFO:tasks.workunit.client.1.smithi135.stdout:6/127: write d2/f9 [1038074,6616] 0 2024-05-09T00:07:27.244 INFO:tasks.workunit.client.1.smithi135.stdout:4/74: creat dc/dd/f19 x:0 0 0 2024-05-09T00:07:27.244 INFO:tasks.workunit.client.1.smithi135.stdout:4/75: dread - dc/dd/f19 zero size 2024-05-09T00:07:27.244 INFO:tasks.workunit.client.1.smithi135.stdout:4/76: stat dc/dd/f12 0 2024-05-09T00:07:27.247 INFO:tasks.workunit.client.1.smithi135.stdout:5/98: rename la to db/l1c 0 2024-05-09T00:07:27.247 INFO:tasks.workunit.client.1.smithi135.stdout:8/63: getdents d4/d7/de 0 2024-05-09T00:07:27.248 INFO:tasks.workunit.client.1.smithi135.stdout:8/64: read d4/f5 [3431700,129211] 0 2024-05-09T00:07:27.248 INFO:tasks.workunit.client.1.smithi135.stdout:8/65: dread - d4/d8/fb zero size 2024-05-09T00:07:27.249 INFO:tasks.workunit.client.1.smithi135.stdout:8/66: fdatasync d4/d8/fa 0 2024-05-09T00:07:27.249 INFO:tasks.workunit.client.1.smithi135.stdout:8/67: chown d4/ld 6861975 1 2024-05-09T00:07:27.249 INFO:tasks.workunit.client.1.smithi135.stdout:8/68: dread - d4/d7/fc zero size 2024-05-09T00:07:27.249 INFO:tasks.workunit.client.1.smithi135.stdout:8/69: write d4/d8/ff [872403,112887] 0 2024-05-09T00:07:27.249 INFO:tasks.workunit.client.1.smithi135.stdout:0/69: mknod d3/c11 0 2024-05-09T00:07:27.250 INFO:tasks.workunit.client.1.smithi135.stdout:4/77: creat dc/dd/f1a x:0 0 0 2024-05-09T00:07:27.251 INFO:tasks.workunit.client.1.smithi135.stdout:6/128: dread d2/d1a/f30 [0,4194304] 0 2024-05-09T00:07:27.251 INFO:tasks.workunit.client.1.smithi135.stdout:5/99: mknod db/c1d 0 2024-05-09T00:07:27.251 INFO:tasks.workunit.client.1.smithi135.stdout:6/129: fdatasync d2/d1a/d1e/f23 0 2024-05-09T00:07:27.252 INFO:tasks.workunit.client.1.smithi135.stdout:2/108: sync 2024-05-09T00:07:27.254 INFO:tasks.workunit.client.1.smithi135.stdout:8/70: rename d4/d8/fa to d4/d8/f15 0 2024-05-09T00:07:27.254 INFO:tasks.workunit.client.1.smithi135.stdout:8/71: dread - d4/d7/de/f14 zero size 2024-05-09T00:07:27.254 INFO:tasks.workunit.client.1.smithi135.stdout:6/130: write d2/f2a [3418452,37228] 0 2024-05-09T00:07:27.256 INFO:tasks.workunit.client.1.smithi135.stdout:4/78: link dc/l16 dc/dd/l1b 0 2024-05-09T00:07:27.256 INFO:tasks.workunit.client.1.smithi135.stdout:9/51: dread d1/f2 [0,4194304] 0 2024-05-09T00:07:27.258 INFO:tasks.workunit.client.1.smithi135.stdout:5/100: symlink db/l1e 0 2024-05-09T00:07:27.259 INFO:tasks.workunit.client.1.smithi135.stdout:3/55: dwrite f5 [0,4194304] 0 2024-05-09T00:07:27.259 INFO:tasks.workunit.client.1.smithi135.stdout:0/70: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:27.259 INFO:tasks.workunit.client.1.smithi135.stdout:0/71: truncate d3/ff 1457209 0 2024-05-09T00:07:27.259 INFO:tasks.workunit.client.1.smithi135.stdout:0/72: chown d3/ff 52 1 2024-05-09T00:07:27.260 INFO:tasks.workunit.client.1.smithi135.stdout:0/73: write d3/fb [2730819,92948] 0 2024-05-09T00:07:27.260 INFO:tasks.workunit.client.1.smithi135.stdout:2/109: creat d1/f1c x:0 0 0 2024-05-09T00:07:27.260 INFO:tasks.workunit.client.1.smithi135.stdout:2/110: truncate d1/d12/f1b 384965 0 2024-05-09T00:07:27.261 INFO:tasks.workunit.client.1.smithi135.stdout:0/74: write d3/f4 [3272131,14170] 0 2024-05-09T00:07:27.262 INFO:tasks.workunit.client.1.smithi135.stdout:8/72: getdents d4 0 2024-05-09T00:07:27.263 INFO:tasks.workunit.client.1.smithi135.stdout:5/101: write f9 [512259,66608] 0 2024-05-09T00:07:27.263 INFO:tasks.workunit.client.1.smithi135.stdout:5/102: truncate db/fd 4544104 0 2024-05-09T00:07:27.264 INFO:tasks.workunit.client.1.smithi135.stdout:4/79: link dc/dd/l1b dc/dd/l1c 0 2024-05-09T00:07:27.264 INFO:tasks.workunit.client.1.smithi135.stdout:4/80: write fa [5115501,112171] 0 2024-05-09T00:07:27.267 INFO:tasks.workunit.client.1.smithi135.stdout:3/56: creat d8/f11 x:0 0 0 2024-05-09T00:07:27.272 INFO:tasks.workunit.client.1.smithi135.stdout:0/75: link d3/f4 d3/f12 0 2024-05-09T00:07:27.272 INFO:tasks.workunit.client.1.smithi135.stdout:0/76: truncate d3/f12 4970577 0 2024-05-09T00:07:27.272 INFO:tasks.workunit.client.1.smithi135.stdout:0/77: readlink d3/l10 0 2024-05-09T00:07:27.273 INFO:tasks.workunit.client.1.smithi135.stdout:0/78: write d3/fb [4760011,124681] 0 2024-05-09T00:07:27.274 INFO:tasks.workunit.client.1.smithi135.stdout:8/73: link d4/d7/fc d4/f16 0 2024-05-09T00:07:27.275 INFO:tasks.workunit.client.1.smithi135.stdout:8/74: dread d4/d7/f9 [0,4194304] 0 2024-05-09T00:07:27.275 INFO:tasks.workunit.client.1.smithi135.stdout:6/131: dwrite d2/f17 [0,4194304] 0 2024-05-09T00:07:27.276 INFO:tasks.workunit.client.1.smithi135.stdout:5/103: rename db/c14 to db/c1f 0 2024-05-09T00:07:27.276 INFO:tasks.workunit.client.1.smithi135.stdout:5/104: readlink l7 0 2024-05-09T00:07:27.276 INFO:tasks.workunit.client.1.smithi135.stdout:5/105: chown db/c1d 1448 1 2024-05-09T00:07:27.276 INFO:tasks.workunit.client.1.smithi135.stdout:6/132: read d2/f25 [535065,25166] 0 2024-05-09T00:07:27.278 INFO:tasks.workunit.client.1.smithi135.stdout:4/81: creat dc/dd/f1d x:0 0 0 2024-05-09T00:07:27.282 INFO:tasks.workunit.client.1.smithi135.stdout:3/57: rmdir d8 39 2024-05-09T00:07:27.283 INFO:tasks.workunit.client.1.smithi135.stdout:3/58: fdatasync d8/fc 0 2024-05-09T00:07:27.286 INFO:tasks.workunit.client.1.smithi135.stdout:0/79: creat d3/dd/f13 x:0 0 0 2024-05-09T00:07:27.286 INFO:tasks.workunit.client.1.smithi135.stdout:0/80: readlink d3/l9 0 2024-05-09T00:07:27.287 INFO:tasks.workunit.client.1.smithi135.stdout:0/81: readlink d3/l10 0 2024-05-09T00:07:27.287 INFO:tasks.workunit.client.1.smithi135.stdout:0/82: chown d3/fb 1 1 2024-05-09T00:07:27.288 INFO:tasks.workunit.client.1.smithi135.stdout:8/75: unlink d4/d7/l11 0 2024-05-09T00:07:27.290 INFO:tasks.workunit.client.1.smithi135.stdout:0/83: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:27.292 INFO:tasks.workunit.client.1.smithi135.stdout:5/106: dwrite db/f12 [0,4194304] 0 2024-05-09T00:07:27.293 INFO:tasks.workunit.client.1.smithi135.stdout:6/133: mknod d2/d1a/d1e/c32 0 2024-05-09T00:07:27.294 INFO:tasks.workunit.client.1.smithi135.stdout:5/107: write db/f12 [122605,67460] 0 2024-05-09T00:07:27.294 INFO:tasks.workunit.client.1.smithi135.stdout:5/108: chown db/f11 532791 1 2024-05-09T00:07:27.294 INFO:tasks.workunit.client.1.smithi135.stdout:3/59: creat d8/f12 x:0 0 0 2024-05-09T00:07:27.295 INFO:tasks.workunit.client.1.smithi135.stdout:8/76: mknod d4/d7/c17 0 2024-05-09T00:07:27.297 INFO:tasks.workunit.client.1.smithi135.stdout:6/134: mknod d2/da/d1d/c33 0 2024-05-09T00:07:27.298 INFO:tasks.workunit.client.1.smithi135.stdout:5/109: rename f1 to db/f20 0 2024-05-09T00:07:27.298 INFO:tasks.workunit.client.1.smithi135.stdout:5/110: fdatasync db/f16 0 2024-05-09T00:07:27.299 INFO:tasks.workunit.client.1.smithi135.stdout:3/60: mkdir d8/d13 0 2024-05-09T00:07:27.300 INFO:tasks.workunit.client.1.smithi135.stdout:8/77: mknod d4/d7/c18 0 2024-05-09T00:07:27.300 INFO:tasks.workunit.client.1.smithi135.stdout:8/78: write d4/d7/de/f14 [839171,123471] 0 2024-05-09T00:07:27.300 INFO:tasks.workunit.client.1.smithi135.stdout:8/79: write d4/d7/de/f14 [1146002,96057] 0 2024-05-09T00:07:27.300 INFO:tasks.workunit.client.1.smithi135.stdout:0/84: dread d3/fb [0,4194304] 0 2024-05-09T00:07:27.301 INFO:tasks.workunit.client.1.smithi135.stdout:6/135: symlink d2/da/d26/l34 0 2024-05-09T00:07:27.303 INFO:tasks.workunit.client.1.smithi135.stdout:0/85: dread d3/ff [0,4194304] 0 2024-05-09T00:07:27.303 INFO:tasks.workunit.client.1.smithi135.stdout:0/86: dread - d3/dd/f13 zero size 2024-05-09T00:07:27.303 INFO:tasks.workunit.client.1.smithi135.stdout:5/111: rename db/f19 to db/f21 0 2024-05-09T00:07:27.303 INFO:tasks.workunit.client.1.smithi135.stdout:7/107: sync 2024-05-09T00:07:27.303 INFO:tasks.workunit.client.1.smithi135.stdout:5/112: chown db/c1f 58 1 2024-05-09T00:07:27.303 INFO:tasks.workunit.client.1.smithi135.stdout:5/113: truncate db/f16 24807 0 2024-05-09T00:07:27.303 INFO:tasks.workunit.client.1.smithi135.stdout:7/108: write db/d13/f24 [45493,69972] 0 2024-05-09T00:07:27.304 INFO:tasks.workunit.client.1.smithi135.stdout:3/61: creat d8/f14 x:0 0 0 2024-05-09T00:07:27.304 INFO:tasks.workunit.client.1.smithi135.stdout:8/80: symlink d4/d7/de/l19 0 2024-05-09T00:07:27.306 INFO:tasks.workunit.client.1.smithi135.stdout:0/87: link d3/f12 d3/dd/f14 0 2024-05-09T00:07:27.306 INFO:tasks.workunit.client.1.smithi135.stdout:8/81: write d4/d7/de/f14 [234942,108886] 0 2024-05-09T00:07:27.306 INFO:tasks.workunit.client.1.smithi135.stdout:0/88: chown d3/dd/f13 181345348 1 2024-05-09T00:07:27.306 INFO:tasks.workunit.client.1.smithi135.stdout:0/89: stat d3/f12 0 2024-05-09T00:07:27.306 INFO:tasks.workunit.client.1.smithi135.stdout:8/82: truncate d4/d7/fc 224261 0 2024-05-09T00:07:27.307 INFO:tasks.workunit.client.1.smithi135.stdout:3/62: symlink d8/d13/l15 0 2024-05-09T00:07:27.309 INFO:tasks.workunit.client.1.smithi135.stdout:8/83: symlink d4/l1a 0 2024-05-09T00:07:27.309 INFO:tasks.workunit.client.1.smithi135.stdout:0/90: truncate d3/dd/f14 2460277 0 2024-05-09T00:07:27.309 INFO:tasks.workunit.client.1.smithi135.stdout:3/63: rmdir d8/d13 39 2024-05-09T00:07:27.310 INFO:tasks.workunit.client.1.smithi135.stdout:0/91: getdents d3 0 2024-05-09T00:07:27.313 INFO:tasks.workunit.client.1.smithi135.stdout:8/84: rename d4/d7/c17 to d4/d7/de/c1b 0 2024-05-09T00:07:27.314 INFO:tasks.workunit.client.1.smithi135.stdout:8/85: write d4/d8/f15 [164711,128609] 0 2024-05-09T00:07:27.316 INFO:tasks.workunit.client.1.smithi135.stdout:3/64: creat d8/d13/f16 x:0 0 0 2024-05-09T00:07:27.318 INFO:tasks.workunit.client.1.smithi135.stdout:3/65: unlink f5 0 2024-05-09T00:07:27.321 INFO:tasks.workunit.client.1.smithi135.stdout:5/114: getdents db 0 2024-05-09T00:07:27.321 INFO:tasks.workunit.client.1.smithi135.stdout:5/115: getdents db 0 2024-05-09T00:07:27.322 INFO:tasks.workunit.client.1.smithi135.stdout:6/136: dwrite d2/d1a/f30 [0,4194304] 0 2024-05-09T00:07:27.322 INFO:tasks.workunit.client.1.smithi135.stdout:5/116: rename db/c17 to db/c22 0 2024-05-09T00:07:27.325 INFO:tasks.workunit.client.1.smithi135.stdout:8/86: dread d4/d7/de/f14 [0,4194304] 0 2024-05-09T00:07:27.327 INFO:tasks.workunit.client.1.smithi135.stdout:7/109: dwrite db/d13/f20 [0,4194304] 0 2024-05-09T00:07:27.332 INFO:tasks.workunit.client.1.smithi135.stdout:6/137: dread d2/d1a/f30 [0,4194304] 0 2024-05-09T00:07:27.332 INFO:tasks.workunit.client.1.smithi135.stdout:0/92: write d3/f4 [14582,112214] 0 2024-05-09T00:07:27.333 INFO:tasks.workunit.client.1.smithi135.stdout:3/66: rmdir d8/d13 39 2024-05-09T00:07:27.338 INFO:tasks.workunit.client.1.smithi135.stdout:6/138: link d2/d1a/d1e/c32 d2/d20/c35 0 2024-05-09T00:07:27.338 INFO:tasks.workunit.client.1.smithi135.stdout:8/87: dread d4/f5 [0,4194304] 0 2024-05-09T00:07:27.339 INFO:tasks.workunit.client.1.smithi135.stdout:8/88: write d4/f16 [464859,22668] 0 2024-05-09T00:07:27.339 INFO:tasks.workunit.client.1.smithi135.stdout:8/89: truncate d4/d8/ff 1854919 0 2024-05-09T00:07:27.339 INFO:tasks.workunit.client.1.smithi135.stdout:6/139: write d2/fc [2002391,48225] 0 2024-05-09T00:07:27.340 INFO:tasks.workunit.client.1.smithi135.stdout:8/90: creat d4/d7/de/f1c x:0 0 0 2024-05-09T00:07:27.342 INFO:tasks.workunit.client.1.smithi135.stdout:8/91: creat d4/d7/f1d x:0 0 0 2024-05-09T00:07:27.342 INFO:tasks.workunit.client.1.smithi135.stdout:8/92: readlink d4/ld 0 2024-05-09T00:07:27.348 INFO:tasks.workunit.client.1.smithi135.stdout:5/117: dwrite db/f12 [0,4194304] 0 2024-05-09T00:07:27.351 INFO:tasks.workunit.client.1.smithi135.stdout:5/118: mknod db/c23 0 2024-05-09T00:07:27.351 INFO:tasks.workunit.client.1.smithi135.stdout:5/119: truncate db/fd 5530847 0 2024-05-09T00:07:27.352 INFO:tasks.workunit.client.1.smithi135.stdout:1/67: sync 2024-05-09T00:07:27.353 INFO:tasks.workunit.client.1.smithi135.stdout:1/68: readlink - no filename 2024-05-09T00:07:27.355 INFO:tasks.workunit.client.1.smithi135.stdout:1/69: write da/db/fe [3663561,3948] 0 2024-05-09T00:07:27.356 INFO:tasks.workunit.client.1.smithi135.stdout:1/70: mknod da/db/d16/c1c 0 2024-05-09T00:07:27.356 INFO:tasks.workunit.client.1.smithi135.stdout:1/71: dread - da/db/f15 zero size 2024-05-09T00:07:27.370 INFO:tasks.workunit.client.1.smithi135.stdout:5/120: dwrite db/f16 [0,4194304] 0 2024-05-09T00:07:27.370 INFO:tasks.workunit.client.1.smithi135.stdout:0/93: dwrite d3/fb [0,4194304] 0 2024-05-09T00:07:27.370 INFO:tasks.workunit.client.1.smithi135.stdout:0/94: chown d3/l9 51170415 1 2024-05-09T00:07:27.373 INFO:tasks.workunit.client.1.smithi135.stdout:5/121: rmdir db 39 2024-05-09T00:07:27.375 INFO:tasks.workunit.client.1.smithi135.stdout:5/122: mkdir db/d24 0 2024-05-09T00:07:27.378 INFO:tasks.workunit.client.1.smithi135.stdout:5/123: link db/fe db/f25 0 2024-05-09T00:07:27.378 INFO:tasks.workunit.client.1.smithi135.stdout:5/124: fdatasync db/f12 0 2024-05-09T00:07:27.379 INFO:tasks.workunit.client.1.smithi135.stdout:5/125: fsync db/f10 0 2024-05-09T00:07:27.384 INFO:tasks.workunit.client.1.smithi135.stdout:0/95: truncate d3/fb 2424864 0 2024-05-09T00:07:27.386 INFO:tasks.workunit.client.1.smithi135.stdout:0/96: creat d3/f15 x:0 0 0 2024-05-09T00:07:27.387 INFO:tasks.workunit.client.1.smithi135.stdout:0/97: creat d3/f16 x:0 0 0 2024-05-09T00:07:27.397 INFO:tasks.workunit.client.1.smithi135.stdout:3/67: dwrite d8/f12 [0,4194304] 0 2024-05-09T00:07:27.397 INFO:tasks.workunit.client.1.smithi135.stdout:3/68: chown d8/lb 56884577 1 2024-05-09T00:07:27.399 INFO:tasks.workunit.client.1.smithi135.stdout:1/72: dwrite f8 [0,4194304] 0 2024-05-09T00:07:27.399 INFO:tasks.workunit.client.1.smithi135.stdout:1/73: write da/db/d16/f18 [391223,115051] 0 2024-05-09T00:07:27.401 INFO:tasks.workunit.client.1.smithi135.stdout:5/126: dwrite db/fd [0,4194304] 0 2024-05-09T00:07:27.401 INFO:tasks.workunit.client.1.smithi135.stdout:5/127: fdatasync db/fd 0 2024-05-09T00:07:27.406 INFO:tasks.workunit.client.1.smithi135.stdout:0/98: truncate d3/fb 2731414 0 2024-05-09T00:07:27.406 INFO:tasks.workunit.client.1.smithi135.stdout:0/99: chown d3/dd 5 1 2024-05-09T00:07:27.408 INFO:tasks.workunit.client.1.smithi135.stdout:5/128: mknod db/d24/c26 0 2024-05-09T00:07:27.409 INFO:tasks.workunit.client.1.smithi135.stdout:0/100: truncate d3/f12 1844633 0 2024-05-09T00:07:27.409 INFO:tasks.workunit.client.1.smithi135.stdout:1/74: dread f9 [0,4194304] 0 2024-05-09T00:07:27.409 INFO:tasks.workunit.client.1.smithi135.stdout:8/93: dwrite d4/d7/f9 [0,4194304] 0 2024-05-09T00:07:27.410 INFO:tasks.workunit.client.1.smithi135.stdout:5/129: chown db/f11 38470 1 2024-05-09T00:07:27.412 INFO:tasks.workunit.client.1.smithi135.stdout:8/94: dread d4/d8/f15 [0,4194304] 0 2024-05-09T00:07:27.412 INFO:tasks.workunit.client.1.smithi135.stdout:8/95: truncate d4/d7/de/f1c 1022915 0 2024-05-09T00:07:27.412 INFO:tasks.workunit.client.1.smithi135.stdout:1/75: mknod da/db/d16/c1d 0 2024-05-09T00:07:27.414 INFO:tasks.workunit.client.1.smithi135.stdout:8/96: creat d4/d8/f1e x:0 0 0 2024-05-09T00:07:27.414 INFO:tasks.workunit.client.1.smithi135.stdout:1/76: dread f4 [0,4194304] 0 2024-05-09T00:07:27.415 INFO:tasks.workunit.client.1.smithi135.stdout:3/69: dwrite d8/f10 [0,4194304] 0 2024-05-09T00:07:27.418 INFO:tasks.workunit.client.1.smithi135.stdout:9/52: sync 2024-05-09T00:07:27.418 INFO:tasks.workunit.client.1.smithi135.stdout:0/101: read d3/dd/f14 [1404406,38509] 0 2024-05-09T00:07:27.418 INFO:tasks.workunit.client.1.smithi135.stdout:0/102: write d3/ff [2145722,1882] 0 2024-05-09T00:07:27.421 INFO:tasks.workunit.client.1.smithi135.stdout:5/130: dread db/f1a [0,4194304] 0 2024-05-09T00:07:27.421 INFO:tasks.workunit.client.1.smithi135.stdout:3/70: rename f1 to d8/f17 0 2024-05-09T00:07:27.422 INFO:tasks.workunit.client.1.smithi135.stdout:9/53: creat d1/d5/fc x:0 0 0 2024-05-09T00:07:27.424 INFO:tasks.workunit.client.1.smithi135.stdout:0/103: unlink d3/ff 0 2024-05-09T00:07:27.426 INFO:tasks.workunit.client.1.smithi135.stdout:5/131: truncate db/f25 1570157 0 2024-05-09T00:07:27.427 INFO:tasks.workunit.client.1.smithi135.stdout:3/71: mknod d8/d13/c18 0 2024-05-09T00:07:27.428 INFO:tasks.workunit.client.1.smithi135.stdout:9/54: rmdir d1 39 2024-05-09T00:07:27.429 INFO:tasks.workunit.client.1.smithi135.stdout:0/104: symlink d3/l17 0 2024-05-09T00:07:27.429 INFO:tasks.workunit.client.1.smithi135.stdout:0/105: read d3/dd/f14 [949534,9320] 0 2024-05-09T00:07:27.430 INFO:tasks.workunit.client.1.smithi135.stdout:0/106: write d3/f4 [2045671,33280] 0 2024-05-09T00:07:27.430 INFO:tasks.workunit.client.1.smithi135.stdout:3/72: creat d8/d13/f19 x:0 0 0 2024-05-09T00:07:27.430 INFO:tasks.workunit.client.1.smithi135.stdout:3/73: chown d8/f10 5253 1 2024-05-09T00:07:27.430 INFO:tasks.workunit.client.1.smithi135.stdout:3/74: truncate d8/f11 21278 0 2024-05-09T00:07:27.431 INFO:tasks.workunit.client.1.smithi135.stdout:0/107: creat d3/f18 x:0 0 0 2024-05-09T00:07:27.431 INFO:tasks.workunit.client.1.smithi135.stdout:3/75: mkdir d8/d1a 0 2024-05-09T00:07:27.432 INFO:tasks.workunit.client.1.smithi135.stdout:0/108: mknod d3/c19 0 2024-05-09T00:07:27.433 INFO:tasks.workunit.client.1.smithi135.stdout:3/76: unlink d8/d13/l15 0 2024-05-09T00:07:27.434 INFO:tasks.workunit.client.1.smithi135.stdout:0/109: link d3/cc d3/dd/c1a 0 2024-05-09T00:07:27.435 INFO:tasks.workunit.client.1.smithi135.stdout:3/77: unlink d8/d13/f16 0 2024-05-09T00:07:27.436 INFO:tasks.workunit.client.1.smithi135.stdout:3/78: creat d8/d13/f1b x:0 0 0 2024-05-09T00:07:27.436 INFO:tasks.workunit.client.1.smithi135.stdout:5/132: dread db/fd [0,4194304] 0 2024-05-09T00:07:27.436 INFO:tasks.workunit.client.1.smithi135.stdout:8/97: dwrite d4/d8/ff [0,4194304] 0 2024-05-09T00:07:27.437 INFO:tasks.workunit.client.1.smithi135.stdout:1/77: dwrite f8 [0,4194304] 0 2024-05-09T00:07:27.437 INFO:tasks.workunit.client.1.smithi135.stdout:5/133: symlink db/d24/l27 0 2024-05-09T00:07:27.438 INFO:tasks.workunit.client.1.smithi135.stdout:5/134: read db/f10 [124682,66697] 0 2024-05-09T00:07:27.438 INFO:tasks.workunit.client.1.smithi135.stdout:5/135: fdatasync f4 0 2024-05-09T00:07:27.440 INFO:tasks.workunit.client.1.smithi135.stdout:8/98: rename d4/d7/f1d to d4/f1f 0 2024-05-09T00:07:27.441 INFO:tasks.workunit.client.1.smithi135.stdout:0/110: dread d3/dd/f14 [0,4194304] 0 2024-05-09T00:07:27.445 INFO:tasks.workunit.client.1.smithi135.stdout:1/78: mknod da/db/c1e 0 2024-05-09T00:07:27.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/136: creat db/f28 x:0 0 0 2024-05-09T00:07:27.447 INFO:tasks.workunit.client.1.smithi135.stdout:3/79: dread d8/f11 [0,4194304] 0 2024-05-09T00:07:27.448 INFO:tasks.workunit.client.1.smithi135.stdout:8/99: creat d4/f20 x:0 0 0 2024-05-09T00:07:27.449 INFO:tasks.workunit.client.1.smithi135.stdout:8/100: readlink d4/l1a 0 2024-05-09T00:07:27.449 INFO:tasks.workunit.client.1.smithi135.stdout:8/101: chown d4/d7/de/f1c 55 1 2024-05-09T00:07:27.450 INFO:tasks.workunit.client.1.smithi135.stdout:8/102: dread d4/f16 [0,4194304] 0 2024-05-09T00:07:27.450 INFO:tasks.workunit.client.1.smithi135.stdout:0/111: rename d3/fb to d3/dd/f1b 0 2024-05-09T00:07:27.453 INFO:tasks.workunit.client.1.smithi135.stdout:3/80: write d8/f17 [494780,30094] 0 2024-05-09T00:07:27.453 INFO:tasks.workunit.client.1.smithi135.stdout:3/81: dread - d8/d13/f19 zero size 2024-05-09T00:07:27.453 INFO:tasks.workunit.client.1.smithi135.stdout:3/82: write d8/d13/f1b [493153,92296] 0 2024-05-09T00:07:27.453 INFO:tasks.workunit.client.1.smithi135.stdout:3/83: getdents d8/d1a 0 2024-05-09T00:07:27.453 INFO:tasks.workunit.client.1.smithi135.stdout:0/112: dread d3/dd/f14 [0,4194304] 0 2024-05-09T00:07:27.454 INFO:tasks.workunit.client.1.smithi135.stdout:3/84: write f0 [564438,50533] 0 2024-05-09T00:07:27.454 INFO:tasks.workunit.client.1.smithi135.stdout:3/85: stat d8/fe 0 2024-05-09T00:07:27.457 INFO:tasks.workunit.client.1.smithi135.stdout:8/103: rename d4/d7/c13 to d4/c21 0 2024-05-09T00:07:27.457 INFO:tasks.workunit.client.1.smithi135.stdout:8/104: chown d4/d8/fb 51082 1 2024-05-09T00:07:27.458 INFO:tasks.workunit.client.1.smithi135.stdout:0/113: mkdir d3/d1c 0 2024-05-09T00:07:27.459 INFO:tasks.workunit.client.1.smithi135.stdout:3/86: chown c6 7157 1 2024-05-09T00:07:27.459 INFO:tasks.workunit.client.1.smithi135.stdout:1/79: dwrite f2 [4194304,4194304] 0 2024-05-09T00:07:27.459 INFO:tasks.workunit.client.1.smithi135.stdout:3/87: dread - d8/fe zero size 2024-05-09T00:07:27.461 INFO:tasks.workunit.client.1.smithi135.stdout:8/105: mkdir d4/d22 0 2024-05-09T00:07:27.461 INFO:tasks.workunit.client.1.smithi135.stdout:8/106: readlink d4/l1a 0 2024-05-09T00:07:27.461 INFO:tasks.workunit.client.1.smithi135.stdout:8/107: fdatasync d4/d7/de/f1c 0 2024-05-09T00:07:27.463 INFO:tasks.workunit.client.1.smithi135.stdout:1/80: link f4 da/f1f 0 2024-05-09T00:07:27.466 INFO:tasks.workunit.client.1.smithi135.stdout:5/137: rename db/l13 to db/l29 0 2024-05-09T00:07:27.468 INFO:tasks.workunit.client.1.smithi135.stdout:8/108: rmdir d4/d8 39 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:1/81: rmdir da 39 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:1/82: truncate da/db/fe 5126016 0 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:1/83: fsync da/db/d16/f18 0 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:1/84: dread - da/d14/f1b zero size 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:4/82: sync 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:2/111: sync 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:2/112: chown d1/d12/c18 104098475 1 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:1/85: write f9 [4170070,3456] 0 2024-05-09T00:07:27.471 INFO:tasks.workunit.client.1.smithi135.stdout:5/138: getdents db/d24 0 2024-05-09T00:07:27.472 INFO:tasks.workunit.client.1.smithi135.stdout:2/113: write d1/f7 [1227505,107877] 0 2024-05-09T00:07:27.473 INFO:tasks.workunit.client.1.smithi135.stdout:4/83: creat dc/f1e x:0 0 0 2024-05-09T00:07:27.473 INFO:tasks.workunit.client.1.smithi135.stdout:4/84: dread - dc/dd/f11 zero size 2024-05-09T00:07:27.473 INFO:tasks.workunit.client.1.smithi135.stdout:4/85: chown dc/dd 14271 1 2024-05-09T00:07:27.473 INFO:tasks.workunit.client.1.smithi135.stdout:4/86: dread - dc/dd/f19 zero size 2024-05-09T00:07:27.473 INFO:tasks.workunit.client.1.smithi135.stdout:4/87: write dc/dd/f11 [242212,58994] 0 2024-05-09T00:07:27.475 INFO:tasks.workunit.client.1.smithi135.stdout:1/86: rmdir da/db/d16 39 2024-05-09T00:07:27.478 INFO:tasks.workunit.client.1.smithi135.stdout:5/139: symlink db/d24/l2a 0 2024-05-09T00:07:27.480 INFO:tasks.workunit.client.1.smithi135.stdout:0/114: dwrite d3/dd/f1b [0,4194304] 0 2024-05-09T00:07:27.480 INFO:tasks.workunit.client.1.smithi135.stdout:0/115: fdatasync d3/dd/f14 0 2024-05-09T00:07:27.482 INFO:tasks.workunit.client.1.smithi135.stdout:1/87: mkdir da/d14/d20 0 2024-05-09T00:07:27.482 INFO:tasks.workunit.client.1.smithi135.stdout:1/88: write f4 [665427,106523] 0 2024-05-09T00:07:27.482 INFO:tasks.workunit.client.1.smithi135.stdout:1/89: chown da/db/f15 6746 1 2024-05-09T00:07:27.483 INFO:tasks.workunit.client.1.smithi135.stdout:5/140: chown db/f20 6 1 2024-05-09T00:07:27.483 INFO:tasks.workunit.client.1.smithi135.stdout:5/141: stat db/d24/l2a 0 2024-05-09T00:07:27.487 INFO:tasks.workunit.client.1.smithi135.stdout:2/114: dread d1/fa [0,4194304] 0 2024-05-09T00:07:27.489 INFO:tasks.workunit.client.1.smithi135.stdout:5/142: dread db/fe [0,4194304] 0 2024-05-09T00:07:27.489 INFO:tasks.workunit.client.1.smithi135.stdout:5/143: fdatasync db/f28 0 2024-05-09T00:07:27.490 INFO:tasks.workunit.client.1.smithi135.stdout:2/115: symlink d1/l1d 0 2024-05-09T00:07:27.490 INFO:tasks.workunit.client.1.smithi135.stdout:2/116: chown d1/le 122905355 1 2024-05-09T00:07:27.491 INFO:tasks.workunit.client.1.smithi135.stdout:2/117: read d1/f17 [1045711,82854] 0 2024-05-09T00:07:27.491 INFO:tasks.workunit.client.1.smithi135.stdout:2/118: fdatasync d1/f1c 0 2024-05-09T00:07:27.491 INFO:tasks.workunit.client.1.smithi135.stdout:5/144: symlink db/l2b 0 2024-05-09T00:07:27.491 INFO:tasks.workunit.client.1.smithi135.stdout:5/145: chown db/f25 6 1 2024-05-09T00:07:27.493 INFO:tasks.workunit.client.1.smithi135.stdout:5/146: creat db/d24/f2c x:0 0 0 2024-05-09T00:07:27.500 INFO:tasks.workunit.client.1.smithi135.stdout:3/88: dwrite d8/d13/f19 [0,4194304] 0 2024-05-09T00:07:27.502 INFO:tasks.workunit.client.1.smithi135.stdout:3/89: mknod d8/d1a/c1c 0 2024-05-09T00:07:27.503 INFO:tasks.workunit.client.1.smithi135.stdout:3/90: link d8/fc d8/d1a/f1d 0 2024-05-09T00:07:27.504 INFO:tasks.workunit.client.1.smithi135.stdout:3/91: fdatasync d8/f11 0 2024-05-09T00:07:27.521 INFO:tasks.workunit.client.1.smithi135.stdout:0/116: dwrite d3/dd/f13 [0,4194304] 0 2024-05-09T00:07:27.523 INFO:tasks.workunit.client.1.smithi135.stdout:0/117: symlink d3/d1c/l1d 0 2024-05-09T00:07:27.524 INFO:tasks.workunit.client.1.smithi135.stdout:0/118: symlink d3/d1c/l1e 0 2024-05-09T00:07:27.525 INFO:tasks.workunit.client.1.smithi135.stdout:0/119: symlink d3/dd/l1f 0 2024-05-09T00:07:27.525 INFO:tasks.workunit.client.1.smithi135.stdout:0/120: fdatasync d3/f12 0 2024-05-09T00:07:27.525 INFO:tasks.workunit.client.1.smithi135.stdout:1/90: dwrite da/db/f15 [0,4194304] 0 2024-05-09T00:07:27.527 INFO:tasks.workunit.client.1.smithi135.stdout:0/121: mknod d3/c20 0 2024-05-09T00:07:27.527 INFO:tasks.workunit.client.1.smithi135.stdout:0/122: chown d3/l10 10 1 2024-05-09T00:07:27.530 INFO:tasks.workunit.client.1.smithi135.stdout:3/92: dwrite d8/f14 [0,4194304] 0 2024-05-09T00:07:27.530 INFO:tasks.workunit.client.1.smithi135.stdout:0/123: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:27.536 INFO:tasks.workunit.client.1.smithi135.stdout:4/88: dwrite dc/dd/f11 [0,4194304] 0 2024-05-09T00:07:27.542 INFO:tasks.workunit.client.1.smithi135.stdout:1/91: dwrite da/db/d16/f18 [0,4194304] 0 2024-05-09T00:07:27.544 INFO:tasks.workunit.client.1.smithi135.stdout:0/124: rmdir d3 39 2024-05-09T00:07:27.544 INFO:tasks.workunit.client.1.smithi135.stdout:0/125: stat d3/c20 0 2024-05-09T00:07:27.544 INFO:tasks.workunit.client.1.smithi135.stdout:2/119: dread d1/f1a [0,4194304] 0 2024-05-09T00:07:27.546 INFO:tasks.workunit.client.1.smithi135.stdout:1/92: link da/db/c1e da/d14/c21 0 2024-05-09T00:07:27.546 INFO:tasks.workunit.client.1.smithi135.stdout:1/93: fsync da/d14/f1b 0 2024-05-09T00:07:27.547 INFO:tasks.workunit.client.1.smithi135.stdout:0/126: creat d3/d1c/f21 x:0 0 0 2024-05-09T00:07:27.547 INFO:tasks.workunit.client.1.smithi135.stdout:3/93: dwrite d8/fe [0,4194304] 0 2024-05-09T00:07:27.548 INFO:tasks.workunit.client.1.smithi135.stdout:2/120: getdents d1 0 2024-05-09T00:07:27.548 INFO:tasks.workunit.client.1.smithi135.stdout:2/121: chown d1/l1d 8 1 2024-05-09T00:07:27.549 INFO:tasks.workunit.client.1.smithi135.stdout:1/94: symlink da/l22 0 2024-05-09T00:07:27.552 INFO:tasks.workunit.client.1.smithi135.stdout:3/94: write f0 [7326782,74864] 0 2024-05-09T00:07:27.553 INFO:tasks.workunit.client.1.smithi135.stdout:2/122: mknod d1/c1e 0 2024-05-09T00:07:27.554 INFO:tasks.workunit.client.1.smithi135.stdout:1/95: getdents da/db 0 2024-05-09T00:07:27.554 INFO:tasks.workunit.client.1.smithi135.stdout:1/96: dread - da/f10 zero size 2024-05-09T00:07:27.555 INFO:tasks.workunit.client.1.smithi135.stdout:2/123: truncate d1/f11 2239003 0 2024-05-09T00:07:27.556 INFO:tasks.workunit.client.1.smithi135.stdout:3/95: write d8/d13/f19 [1938360,73005] 0 2024-05-09T00:07:27.556 INFO:tasks.workunit.client.1.smithi135.stdout:1/97: creat da/db/f23 x:0 0 0 2024-05-09T00:07:27.556 INFO:tasks.workunit.client.1.smithi135.stdout:6/140: sync 2024-05-09T00:07:27.556 INFO:tasks.workunit.client.1.smithi135.stdout:7/110: sync 2024-05-09T00:07:27.557 INFO:tasks.workunit.client.1.smithi135.stdout:2/124: stat d1/l14 0 2024-05-09T00:07:27.557 INFO:tasks.workunit.client.1.smithi135.stdout:7/111: write db/dd/f14 [190459,88112] 0 2024-05-09T00:07:27.560 INFO:tasks.workunit.client.1.smithi135.stdout:3/96: rmdir d8/d13 39 2024-05-09T00:07:27.562 INFO:tasks.workunit.client.1.smithi135.stdout:1/98: mkdir da/d24 0 2024-05-09T00:07:27.562 INFO:tasks.workunit.client.1.smithi135.stdout:1/99: fsync da/db/f15 0 2024-05-09T00:07:27.562 INFO:tasks.workunit.client.1.smithi135.stdout:6/141: creat d2/d20/f36 x:0 0 0 2024-05-09T00:07:27.563 INFO:tasks.workunit.client.1.smithi135.stdout:2/125: fdatasync d1/f7 0 2024-05-09T00:07:27.564 INFO:tasks.workunit.client.1.smithi135.stdout:7/112: creat db/d13/f2a x:0 0 0 2024-05-09T00:07:27.564 INFO:tasks.workunit.client.1.smithi135.stdout:7/113: readlink l6 0 2024-05-09T00:07:27.565 INFO:tasks.workunit.client.1.smithi135.stdout:3/97: creat d8/d13/f1e x:0 0 0 2024-05-09T00:07:27.566 INFO:tasks.workunit.client.1.smithi135.stdout:1/100: symlink da/d14/d20/l25 0 2024-05-09T00:07:27.566 INFO:tasks.workunit.client.1.smithi135.stdout:1/101: truncate da/d14/f1b 126061 0 2024-05-09T00:07:27.566 INFO:tasks.workunit.client.1.smithi135.stdout:1/102: chown da 1732319090 1 2024-05-09T00:07:27.566 INFO:tasks.workunit.client.1.smithi135.stdout:4/89: dwrite fa [4194304,4194304] 0 2024-05-09T00:07:27.566 INFO:tasks.workunit.client.1.smithi135.stdout:0/127: dwrite d3/f4 [0,4194304] 0 2024-05-09T00:07:27.567 INFO:tasks.workunit.client.1.smithi135.stdout:0/128: chown d3/f12 257605686 1 2024-05-09T00:07:27.569 INFO:tasks.workunit.client.1.smithi135.stdout:3/98: mkdir d8/d13/d1f 0 2024-05-09T00:07:27.572 INFO:tasks.workunit.client.1.smithi135.stdout:2/126: fdatasync d1/f1a 0 2024-05-09T00:07:27.572 INFO:tasks.workunit.client.1.smithi135.stdout:1/103: rename da/db/f23 to da/d24/f26 0 2024-05-09T00:07:27.573 INFO:tasks.workunit.client.1.smithi135.stdout:4/90: mkdir dc/dd/d1f 0 2024-05-09T00:07:27.578 INFO:tasks.workunit.client.1.smithi135.stdout:2/127: creat d1/f1f x:0 0 0 2024-05-09T00:07:27.579 INFO:tasks.workunit.client.1.smithi135.stdout:4/91: link dc/dd/f1d dc/dd/d1f/f20 0 2024-05-09T00:07:27.580 INFO:tasks.workunit.client.1.smithi135.stdout:2/128: readlink d1/d12/l16 0 2024-05-09T00:07:27.583 INFO:tasks.workunit.client.1.smithi135.stdout:4/92: rename dc/dd/f1a to dc/dd/d1f/f21 0 2024-05-09T00:07:27.583 INFO:tasks.workunit.client.1.smithi135.stdout:4/93: read - dc/dd/d1f/f21 zero size 2024-05-09T00:07:27.583 INFO:tasks.workunit.client.1.smithi135.stdout:1/104: dread da/d14/f1b [0,4194304] 0 2024-05-09T00:07:27.583 INFO:tasks.workunit.client.1.smithi135.stdout:1/105: write da/f10 [159180,65228] 0 2024-05-09T00:07:27.583 INFO:tasks.workunit.client.1.smithi135.stdout:1/106: fsync f9 0 2024-05-09T00:07:27.584 INFO:tasks.workunit.client.1.smithi135.stdout:4/94: creat dc/dd/f22 x:0 0 0 2024-05-09T00:07:27.584 INFO:tasks.workunit.client.1.smithi135.stdout:1/107: dread da/d14/f1b [0,4194304] 0 2024-05-09T00:07:27.587 INFO:tasks.workunit.client.1.smithi135.stdout:1/108: mkdir da/d24/d27 0 2024-05-09T00:07:27.590 INFO:tasks.workunit.client.1.smithi135.stdout:4/95: write f7 [7326243,14551] 0 2024-05-09T00:07:27.591 INFO:tasks.workunit.client.1.smithi135.stdout:1/109: write da/d14/f1a [1333567,116074] 0 2024-05-09T00:07:27.594 INFO:tasks.workunit.client.1.smithi135.stdout:0/129: dwrite d3/d1c/f21 [0,4194304] 0 2024-05-09T00:07:27.594 INFO:tasks.workunit.client.1.smithi135.stdout:0/130: stat d3/l17 0 2024-05-09T00:07:27.594 INFO:tasks.workunit.client.1.smithi135.stdout:1/110: creat da/d24/d27/f28 x:0 0 0 2024-05-09T00:07:27.595 INFO:tasks.workunit.client.1.smithi135.stdout:6/142: dwrite d2/d1a/f30 [0,4194304] 0 2024-05-09T00:07:27.596 INFO:tasks.workunit.client.1.smithi135.stdout:3/99: dwrite d8/f10 [0,4194304] 0 2024-05-09T00:07:27.596 INFO:tasks.workunit.client.1.smithi135.stdout:7/114: dwrite db/dd/f1b [0,4194304] 0 2024-05-09T00:07:27.597 INFO:tasks.workunit.client.1.smithi135.stdout:0/131: unlink d3/l10 0 2024-05-09T00:07:27.597 INFO:tasks.workunit.client.1.smithi135.stdout:2/129: dread d1/f4 [0,4194304] 0 2024-05-09T00:07:27.599 INFO:tasks.workunit.client.1.smithi135.stdout:1/111: mknod da/db/c29 0 2024-05-09T00:07:27.599 INFO:tasks.workunit.client.1.smithi135.stdout:1/112: chown f8 2719 1 2024-05-09T00:07:27.602 INFO:tasks.workunit.client.1.smithi135.stdout:6/143: mkdir d2/d20/d37 0 2024-05-09T00:07:27.602 INFO:tasks.workunit.client.1.smithi135.stdout:6/144: chown d2/da/c21 78 1 2024-05-09T00:07:27.602 INFO:tasks.workunit.client.1.smithi135.stdout:1/113: dread f4 [0,4194304] 0 2024-05-09T00:07:27.602 INFO:tasks.workunit.client.1.smithi135.stdout:1/114: fsync da/db/d16/f18 0 2024-05-09T00:07:27.604 INFO:tasks.workunit.client.1.smithi135.stdout:3/100: rmdir d8 39 2024-05-09T00:07:27.610 INFO:tasks.workunit.client.1.smithi135.stdout:4/96: dwrite dc/dd/d1f/f21 [0,4194304] 0 2024-05-09T00:07:27.610 INFO:tasks.workunit.client.1.smithi135.stdout:4/97: fdatasync dc/dd/f17 0 2024-05-09T00:07:27.610 INFO:tasks.workunit.client.1.smithi135.stdout:4/98: stat f7 0 2024-05-09T00:07:27.611 INFO:tasks.workunit.client.1.smithi135.stdout:4/99: write dc/dd/fe [237719,85065] 0 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:4/100: chown dc/f18 326023 1 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:7/115: symlink db/d13/l2b 0 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:2/130: chown d1/lb 40429777 1 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:6/145: symlink d2/d1a/d1e/l38 0 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:6/146: write d2/d1a/d1e/f23 [1280908,2404] 0 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:6/147: read - d2/d20/f36 zero size 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:6/148: truncate d2/da/d1d/f27 234757 0 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:8/109: sync 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:9/55: sync 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:9/56: rename d1 to d1/d5/dd 22 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:1/115: creat da/db/f2a x:0 0 0 2024-05-09T00:07:27.612 INFO:tasks.workunit.client.1.smithi135.stdout:1/116: chown da/db/f15 863 1 2024-05-09T00:07:27.613 INFO:tasks.workunit.client.1.smithi135.stdout:3/101: creat d8/d1a/f20 x:0 0 0 2024-05-09T00:07:27.618 INFO:tasks.workunit.client.1.smithi135.stdout:4/101: symlink dc/dd/l23 0 2024-05-09T00:07:27.620 INFO:tasks.workunit.client.1.smithi135.stdout:2/131: mkdir d1/d12/d20 0 2024-05-09T00:07:27.621 INFO:tasks.workunit.client.1.smithi135.stdout:8/110: dread d4/d7/f9 [0,4194304] 0 2024-05-09T00:07:27.622 INFO:tasks.workunit.client.1.smithi135.stdout:9/57: symlink d1/d5/le 0 2024-05-09T00:07:27.623 INFO:tasks.workunit.client.1.smithi135.stdout:9/58: chown d1/ca 2 1 2024-05-09T00:07:27.624 INFO:tasks.workunit.client.1.smithi135.stdout:1/117: link da/db/fe da/d14/d20/f2b 0 2024-05-09T00:07:27.625 INFO:tasks.workunit.client.1.smithi135.stdout:1/118: write da/d14/f1b [220024,83518] 0 2024-05-09T00:07:27.625 INFO:tasks.workunit.client.1.smithi135.stdout:3/102: dread f0 [0,4194304] 0 2024-05-09T00:07:27.626 INFO:tasks.workunit.client.1.smithi135.stdout:4/102: creat dc/f24 x:0 0 0 2024-05-09T00:07:27.626 INFO:tasks.workunit.client.1.smithi135.stdout:4/103: read - dc/f18 zero size 2024-05-09T00:07:27.626 INFO:tasks.workunit.client.1.smithi135.stdout:7/116: mknod db/dd/c2c 0 2024-05-09T00:07:27.627 INFO:tasks.workunit.client.1.smithi135.stdout:2/132: truncate d1/f4 3281888 0 2024-05-09T00:07:27.627 INFO:tasks.workunit.client.1.smithi135.stdout:8/111: rmdir d4/d8 39 2024-05-09T00:07:27.628 INFO:tasks.workunit.client.1.smithi135.stdout:6/149: dread d2/da/d1d/f27 [0,4194304] 0 2024-05-09T00:07:27.628 INFO:tasks.workunit.client.1.smithi135.stdout:5/147: sync 2024-05-09T00:07:27.630 INFO:tasks.workunit.client.1.smithi135.stdout:1/119: mkdir da/d14/d20/d2c 0 2024-05-09T00:07:27.630 INFO:tasks.workunit.client.1.smithi135.stdout:1/120: truncate da/d14/f19 788754 0 2024-05-09T00:07:27.630 INFO:tasks.workunit.client.1.smithi135.stdout:1/121: fdatasync da/d24/d27/f28 0 2024-05-09T00:07:27.631 INFO:tasks.workunit.client.1.smithi135.stdout:3/103: mknod d8/c21 0 2024-05-09T00:07:27.631 INFO:tasks.workunit.client.1.smithi135.stdout:4/104: creat dc/f25 x:0 0 0 2024-05-09T00:07:27.633 INFO:tasks.workunit.client.1.smithi135.stdout:7/117: creat db/dd/f2d x:0 0 0 2024-05-09T00:07:27.634 INFO:tasks.workunit.client.1.smithi135.stdout:7/118: truncate db/d13/f24 128001 0 2024-05-09T00:07:27.634 INFO:tasks.workunit.client.1.smithi135.stdout:2/133: write d1/f1c [733458,40316] 0 2024-05-09T00:07:27.636 INFO:tasks.workunit.client.1.smithi135.stdout:8/112: creat d4/d8/f23 x:0 0 0 2024-05-09T00:07:27.637 INFO:tasks.workunit.client.1.smithi135.stdout:9/59: dwrite d1/d5/fb [0,4194304] 0 2024-05-09T00:07:27.637 INFO:tasks.workunit.client.1.smithi135.stdout:6/150: getdents d2/d20 0 2024-05-09T00:07:27.638 INFO:tasks.workunit.client.1.smithi135.stdout:9/60: dread d1/f2 [0,4194304] 0 2024-05-09T00:07:27.638 INFO:tasks.workunit.client.1.smithi135.stdout:9/61: truncate d1/d5/fc 165390 0 2024-05-09T00:07:27.639 INFO:tasks.workunit.client.1.smithi135.stdout:5/148: link db/f10 db/d24/f2d 0 2024-05-09T00:07:27.639 INFO:tasks.workunit.client.1.smithi135.stdout:5/149: chown db/f20 1 1 2024-05-09T00:07:27.639 INFO:tasks.workunit.client.1.smithi135.stdout:1/122: rmdir da 39 2024-05-09T00:07:27.640 INFO:tasks.workunit.client.1.smithi135.stdout:3/104: creat d8/d13/f22 x:0 0 0 2024-05-09T00:07:27.642 INFO:tasks.workunit.client.1.smithi135.stdout:2/134: mkdir d1/d12/d21 0 2024-05-09T00:07:27.642 INFO:tasks.workunit.client.1.smithi135.stdout:8/113: symlink d4/d7/l24 0 2024-05-09T00:07:27.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:25.902889+0000 mgr.smithi135.kkrhgf (mgr.24419) 42 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 357 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s rd, 26 MiB/s wr, 1.02k op/s 2024-05-09T00:07:27.646 INFO:tasks.workunit.client.1.smithi135.stdout:9/62: dread d1/d5/fb [0,4194304] 0 2024-05-09T00:07:27.647 INFO:tasks.workunit.client.1.smithi135.stdout:6/151: symlink d2/d1a/l39 0 2024-05-09T00:07:27.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:25.902889+0000 mgr.smithi135.kkrhgf (mgr.24419) 42 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 357 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s rd, 26 MiB/s wr, 1.02k op/s 2024-05-09T00:07:27.654 INFO:tasks.workunit.client.1.smithi135.stdout:5/150: truncate db/fe 1401165 0 2024-05-09T00:07:27.657 INFO:tasks.workunit.client.1.smithi135.stdout:7/119: rename l2 to db/dd/l2e 0 2024-05-09T00:07:27.659 INFO:tasks.workunit.client.1.smithi135.stdout:5/151: creat db/f2e x:0 0 0 2024-05-09T00:07:27.659 INFO:tasks.workunit.client.1.smithi135.stdout:5/152: read - db/f11 zero size 2024-05-09T00:07:27.662 INFO:tasks.workunit.client.1.smithi135.stdout:2/135: dwrite d1/d12/f15 [0,4194304] 0 2024-05-09T00:07:27.663 INFO:tasks.workunit.client.1.smithi135.stdout:8/114: dwrite d4/d7/fc [0,4194304] 0 2024-05-09T00:07:27.663 INFO:tasks.workunit.client.1.smithi135.stdout:6/152: dread d2/fd [0,4194304] 0 2024-05-09T00:07:27.663 INFO:tasks.workunit.client.1.smithi135.stdout:8/115: readlink l0 0 2024-05-09T00:07:27.663 INFO:tasks.workunit.client.1.smithi135.stdout:6/153: stat d2/fd 0 2024-05-09T00:07:27.664 INFO:tasks.workunit.client.1.smithi135.stdout:8/116: dread - d4/d8/fb zero size 2024-05-09T00:07:27.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/154: write d2/da/d1d/f27 [1062940,2366] 0 2024-05-09T00:07:27.664 INFO:tasks.workunit.client.1.smithi135.stdout:1/123: rename da/d14/c21 to da/d14/d20/c2d 0 2024-05-09T00:07:27.664 INFO:tasks.workunit.client.1.smithi135.stdout:1/124: chown da/d24 2079571 1 2024-05-09T00:07:27.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/155: write d2/d1a/f1b [850442,6841] 0 2024-05-09T00:07:27.665 INFO:tasks.workunit.client.1.smithi135.stdout:6/156: dread - d2/d1a/f24 zero size 2024-05-09T00:07:27.668 INFO:tasks.workunit.client.1.smithi135.stdout:9/63: write d1/d5/fb [4719595,125214] 0 2024-05-09T00:07:27.671 INFO:tasks.workunit.client.1.smithi135.stdout:3/105: rename d8/d1a/f1d to d8/f23 0 2024-05-09T00:07:27.671 INFO:tasks.workunit.client.1.smithi135.stdout:3/106: fdatasync d8/f23 0 2024-05-09T00:07:27.671 INFO:tasks.workunit.client.1.smithi135.stdout:6/157: truncate d2/fd 806367 0 2024-05-09T00:07:27.674 INFO:tasks.workunit.client.1.smithi135.stdout:9/64: mknod d1/d7/cf 0 2024-05-09T00:07:27.674 INFO:tasks.workunit.client.1.smithi135.stdout:9/65: truncate d1/f2 1460787 0 2024-05-09T00:07:27.674 INFO:tasks.workunit.client.1.smithi135.stdout:2/136: mkdir d1/d22 0 2024-05-09T00:07:27.675 INFO:tasks.workunit.client.1.smithi135.stdout:1/125: dread da/db/fe [0,4194304] 0 2024-05-09T00:07:27.676 INFO:tasks.workunit.client.1.smithi135.stdout:9/66: mkdir d1/d5/d10 0 2024-05-09T00:07:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:2/137: creat d1/d12/f23 x:0 0 0 2024-05-09T00:07:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:2/138: chown d1/d12/f23 107 1 2024-05-09T00:07:27.681 INFO:tasks.workunit.client.1.smithi135.stdout:6/158: rename d2/cf to d2/c3a 0 2024-05-09T00:07:27.681 INFO:tasks.workunit.client.1.smithi135.stdout:1/126: rmdir da/d24 39 2024-05-09T00:07:27.682 INFO:tasks.workunit.client.1.smithi135.stdout:5/153: getdents db 0 2024-05-09T00:07:27.682 INFO:tasks.workunit.client.1.smithi135.stdout:5/154: truncate db/f25 1665966 0 2024-05-09T00:07:27.684 INFO:tasks.workunit.client.1.smithi135.stdout:3/107: dread d8/f23 [0,4194304] 0 2024-05-09T00:07:27.685 INFO:tasks.workunit.client.1.smithi135.stdout:6/159: creat d2/da/f3b x:0 0 0 2024-05-09T00:07:27.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/127: mknod da/db/c2e 0 2024-05-09T00:07:27.686 INFO:tasks.workunit.client.1.smithi135.stdout:7/120: dwrite db/dd/f2d [0,4194304] 0 2024-05-09T00:07:27.687 INFO:tasks.workunit.client.1.smithi135.stdout:6/160: creat d2/da/d26/f3c x:0 0 0 2024-05-09T00:07:27.687 INFO:tasks.workunit.client.1.smithi135.stdout:5/155: write f4 [1966743,42078] 0 2024-05-09T00:07:27.689 INFO:tasks.workunit.client.1.smithi135.stdout:1/128: creat da/db/d16/f2f x:0 0 0 2024-05-09T00:07:27.689 INFO:tasks.workunit.client.1.smithi135.stdout:8/117: dwrite d4/f1f [0,4194304] 0 2024-05-09T00:07:27.691 INFO:tasks.workunit.client.1.smithi135.stdout:7/121: rmdir db/d13 39 2024-05-09T00:07:27.692 INFO:tasks.workunit.client.1.smithi135.stdout:9/67: dwrite d1/d5/fc [0,4194304] 0 2024-05-09T00:07:27.694 INFO:tasks.workunit.client.1.smithi135.stdout:6/161: mkdir d2/d20/d2e/d3d 0 2024-05-09T00:07:27.694 INFO:tasks.workunit.client.1.smithi135.stdout:6/162: chown d2/f2a 3422270 1 2024-05-09T00:07:27.695 INFO:tasks.workunit.client.1.smithi135.stdout:1/129: symlink da/db/l30 0 2024-05-09T00:07:27.695 INFO:tasks.workunit.client.1.smithi135.stdout:1/130: chown da/d14/d20 52305872 1 2024-05-09T00:07:27.695 INFO:tasks.workunit.client.1.smithi135.stdout:5/156: dread db/f10 [0,4194304] 0 2024-05-09T00:07:27.698 INFO:tasks.workunit.client.1.smithi135.stdout:6/163: dread d2/d1a/d1e/f23 [0,4194304] 0 2024-05-09T00:07:27.707 INFO:tasks.workunit.client.1.smithi135.stdout:7/122: read - db/dd/f1c zero size 2024-05-09T00:07:27.710 INFO:tasks.workunit.client.1.smithi135.stdout:9/68: creat d1/d7/f11 x:0 0 0 2024-05-09T00:07:27.710 INFO:tasks.workunit.client.1.smithi135.stdout:9/69: write d1/d7/f11 [330721,98846] 0 2024-05-09T00:07:27.710 INFO:tasks.workunit.client.1.smithi135.stdout:9/70: chown d1/l4 46042836 1 2024-05-09T00:07:27.711 INFO:tasks.workunit.client.1.smithi135.stdout:8/118: dread d4/f16 [0,4194304] 0 2024-05-09T00:07:27.711 INFO:tasks.workunit.client.1.smithi135.stdout:1/131: getdents da/d14 0 2024-05-09T00:07:27.712 INFO:tasks.workunit.client.1.smithi135.stdout:5/157: mkdir db/d24/d2f 0 2024-05-09T00:07:27.713 INFO:tasks.workunit.client.1.smithi135.stdout:5/158: dread - db/f15 zero size 2024-05-09T00:07:27.714 INFO:tasks.workunit.client.1.smithi135.stdout:8/119: symlink d4/d8/l25 0 2024-05-09T00:07:27.715 INFO:tasks.workunit.client.1.smithi135.stdout:9/71: dread d1/f2 [0,4194304] 0 2024-05-09T00:07:27.715 INFO:tasks.workunit.client.1.smithi135.stdout:1/132: symlink da/d14/d20/l31 0 2024-05-09T00:07:27.717 INFO:tasks.workunit.client.1.smithi135.stdout:5/159: symlink db/l30 0 2024-05-09T00:07:27.718 INFO:tasks.workunit.client.1.smithi135.stdout:7/123: symlink db/dd/l2f 0 2024-05-09T00:07:27.718 INFO:tasks.workunit.client.1.smithi135.stdout:7/124: chown db/d13 17438928 1 2024-05-09T00:07:27.718 INFO:tasks.workunit.client.1.smithi135.stdout:7/125: chown db/d21 1263 1 2024-05-09T00:07:27.718 INFO:tasks.workunit.client.1.smithi135.stdout:7/126: readlink db/dd/l2e 0 2024-05-09T00:07:27.719 INFO:tasks.workunit.client.1.smithi135.stdout:9/72: mknod d1/d5/c12 0 2024-05-09T00:07:27.721 INFO:tasks.workunit.client.1.smithi135.stdout:7/127: write db/d13/f20 [977269,66860] 0 2024-05-09T00:07:27.721 INFO:tasks.workunit.client.1.smithi135.stdout:2/139: dwrite d1/fa [0,4194304] 0 2024-05-09T00:07:27.721 INFO:tasks.workunit.client.1.smithi135.stdout:1/133: creat da/d14/d20/d2c/f32 x:0 0 0 2024-05-09T00:07:27.721 INFO:tasks.workunit.client.1.smithi135.stdout:9/73: creat d1/f13 x:0 0 0 2024-05-09T00:07:27.722 INFO:tasks.workunit.client.1.smithi135.stdout:3/108: dwrite d8/f23 [4194304,4194304] 0 2024-05-09T00:07:27.724 INFO:tasks.workunit.client.1.smithi135.stdout:3/109: mkdir d8/d1a/d24 0 2024-05-09T00:07:27.725 INFO:tasks.workunit.client.1.smithi135.stdout:4/105: sync 2024-05-09T00:07:27.726 INFO:tasks.workunit.client.1.smithi135.stdout:6/164: dwrite d2/da/f3b [0,4194304] 0 2024-05-09T00:07:27.726 INFO:tasks.workunit.client.1.smithi135.stdout:3/110: link l4 d8/d1a/d24/l25 0 2024-05-09T00:07:27.726 INFO:tasks.workunit.client.1.smithi135.stdout:3/111: readlink d8/lb 0 2024-05-09T00:07:27.727 INFO:tasks.workunit.client.1.smithi135.stdout:4/106: mkdir dc/d26 0 2024-05-09T00:07:27.727 INFO:tasks.workunit.client.1.smithi135.stdout:4/107: write dc/dd/f19 [878108,118335] 0 2024-05-09T00:07:27.731 INFO:tasks.workunit.client.1.smithi135.stdout:0/132: sync 2024-05-09T00:07:27.731 INFO:tasks.workunit.client.1.smithi135.stdout:1/134: dread da/f1f [0,4194304] 0 2024-05-09T00:07:27.737 INFO:tasks.workunit.client.1.smithi135.stdout:6/165: creat d2/d20/d2e/f3e x:0 0 0 2024-05-09T00:07:27.737 INFO:tasks.workunit.client.1.smithi135.stdout:3/112: creat d8/f26 x:0 0 0 2024-05-09T00:07:27.739 INFO:tasks.workunit.client.1.smithi135.stdout:3/113: symlink d8/l27 0 2024-05-09T00:07:27.741 INFO:tasks.workunit.client.1.smithi135.stdout:4/108: creat dc/f27 x:0 0 0 2024-05-09T00:07:27.742 INFO:tasks.workunit.client.1.smithi135.stdout:8/120: dwrite d4/f20 [0,4194304] 0 2024-05-09T00:07:27.747 INFO:tasks.workunit.client.1.smithi135.stdout:4/109: mkdir dc/dd/d28 0 2024-05-09T00:07:27.750 INFO:tasks.workunit.client.1.smithi135.stdout:8/121: unlink d4/f1f 0 2024-05-09T00:07:27.750 INFO:tasks.workunit.client.1.smithi135.stdout:8/122: write d4/d7/de/f1c [635211,126145] 0 2024-05-09T00:07:27.753 INFO:tasks.workunit.client.1.smithi135.stdout:2/140: dwrite d1/f1f [0,4194304] 0 2024-05-09T00:07:27.754 INFO:tasks.workunit.client.1.smithi135.stdout:6/166: dread d2/f25 [0,4194304] 0 2024-05-09T00:07:27.754 INFO:tasks.workunit.client.1.smithi135.stdout:6/167: dread - d2/da/d26/f3c zero size 2024-05-09T00:07:27.757 INFO:tasks.workunit.client.1.smithi135.stdout:2/141: truncate d1/f4 677834 0 2024-05-09T00:07:27.757 INFO:tasks.workunit.client.1.smithi135.stdout:2/142: truncate d1/f1c 1757413 0 2024-05-09T00:07:27.758 INFO:tasks.workunit.client.1.smithi135.stdout:6/168: mkdir d2/d20/d3f 0 2024-05-09T00:07:27.761 INFO:tasks.workunit.client.1.smithi135.stdout:7/128: dwrite db/d13/f2a [0,4194304] 0 2024-05-09T00:07:27.764 INFO:tasks.workunit.client.1.smithi135.stdout:5/160: dwrite db/f11 [0,4194304] 0 2024-05-09T00:07:27.765 INFO:tasks.workunit.client.1.smithi135.stdout:5/161: write db/fd [197774,49284] 0 2024-05-09T00:07:27.765 INFO:tasks.workunit.client.1.smithi135.stdout:0/133: dwrite d3/f4 [0,4194304] 0 2024-05-09T00:07:27.766 INFO:tasks.workunit.client.1.smithi135.stdout:3/114: dwrite d8/d13/f1e [0,4194304] 0 2024-05-09T00:07:27.768 INFO:tasks.workunit.client.1.smithi135.stdout:1/135: dwrite da/d14/f1a [0,4194304] 0 2024-05-09T00:07:27.768 INFO:tasks.workunit.client.1.smithi135.stdout:5/162: write db/f1a [2067854,117383] 0 2024-05-09T00:07:27.768 INFO:tasks.workunit.client.1.smithi135.stdout:4/110: dread dc/dd/f19 [0,4194304] 0 2024-05-09T00:07:27.770 INFO:tasks.workunit.client.1.smithi135.stdout:0/134: creat d3/dd/f22 x:0 0 0 2024-05-09T00:07:27.770 INFO:tasks.workunit.client.1.smithi135.stdout:0/135: write d3/dd/f22 [240534,11163] 0 2024-05-09T00:07:27.771 INFO:tasks.workunit.client.1.smithi135.stdout:0/136: chown d3/d1c/f21 314 1 2024-05-09T00:07:27.771 INFO:tasks.workunit.client.1.smithi135.stdout:6/169: dread d2/f17 [0,4194304] 0 2024-05-09T00:07:27.773 INFO:tasks.workunit.client.1.smithi135.stdout:3/115: creat d8/d1a/f28 x:0 0 0 2024-05-09T00:07:27.776 INFO:tasks.workunit.client.1.smithi135.stdout:1/136: mkdir da/d24/d27/d33 0 2024-05-09T00:07:27.776 INFO:tasks.workunit.client.1.smithi135.stdout:1/137: write f4 [1460032,105361] 0 2024-05-09T00:07:27.777 INFO:tasks.workunit.client.1.smithi135.stdout:5/163: mkdir db/d24/d2f/d31 0 2024-05-09T00:07:27.779 INFO:tasks.workunit.client.1.smithi135.stdout:4/111: mknod dc/dd/d1f/c29 0 2024-05-09T00:07:27.783 INFO:tasks.workunit.client.1.smithi135.stdout:0/137: creat d3/f23 x:0 0 0 2024-05-09T00:07:27.783 INFO:tasks.workunit.client.1.smithi135.stdout:6/170: mkdir d2/d20/d2e/d40 0 2024-05-09T00:07:27.783 INFO:tasks.workunit.client.1.smithi135.stdout:3/116: link d8/d13/f22 d8/f29 0 2024-05-09T00:07:27.783 INFO:tasks.workunit.client.1.smithi135.stdout:3/117: write d8/f11 [188268,64356] 0 2024-05-09T00:07:27.784 INFO:tasks.workunit.client.1.smithi135.stdout:3/118: chown d8/f12 7823715 1 2024-05-09T00:07:27.784 INFO:tasks.workunit.client.1.smithi135.stdout:5/164: dread db/f11 [0,4194304] 0 2024-05-09T00:07:27.784 INFO:tasks.workunit.client.1.smithi135.stdout:5/165: chown db 6 1 2024-05-09T00:07:27.784 INFO:tasks.workunit.client.1.smithi135.stdout:5/166: write db/f20 [957841,42438] 0 2024-05-09T00:07:27.785 INFO:tasks.workunit.client.1.smithi135.stdout:5/167: write f9 [869899,104530] 0 2024-05-09T00:07:27.785 INFO:tasks.workunit.client.1.smithi135.stdout:5/168: chown db/l1e 428696075 1 2024-05-09T00:07:27.785 INFO:tasks.workunit.client.1.smithi135.stdout:8/123: dwrite d4/d7/de/f1c [0,4194304] 0 2024-05-09T00:07:27.785 INFO:tasks.workunit.client.1.smithi135.stdout:1/138: creat da/db/f34 x:0 0 0 2024-05-09T00:07:27.786 INFO:tasks.workunit.client.1.smithi135.stdout:4/112: creat dc/d26/f2a x:0 0 0 2024-05-09T00:07:27.786 INFO:tasks.workunit.client.1.smithi135.stdout:4/113: fdatasync dc/dd/f11 0 2024-05-09T00:07:27.786 INFO:tasks.workunit.client.1.smithi135.stdout:1/139: write da/db/fe [3419689,50176] 0 2024-05-09T00:07:27.787 INFO:tasks.workunit.client.1.smithi135.stdout:0/138: symlink d3/d1c/l24 0 2024-05-09T00:07:27.787 INFO:tasks.workunit.client.1.smithi135.stdout:0/139: readlink d3/d1c/l24 0 2024-05-09T00:07:27.787 INFO:tasks.workunit.client.1.smithi135.stdout:0/140: readlink d3/l9 0 2024-05-09T00:07:27.791 INFO:tasks.workunit.client.1.smithi135.stdout:6/171: rmdir d2/da/d1d 39 2024-05-09T00:07:27.791 INFO:tasks.workunit.client.1.smithi135.stdout:3/119: mkdir d8/d1a/d24/d2a 0 2024-05-09T00:07:27.792 INFO:tasks.workunit.client.1.smithi135.stdout:5/169: mkdir db/d24/d32 0 2024-05-09T00:07:27.792 INFO:tasks.workunit.client.1.smithi135.stdout:5/170: fdatasync f4 0 2024-05-09T00:07:27.794 INFO:tasks.workunit.client.1.smithi135.stdout:2/143: unlink d1/f4 0 2024-05-09T00:07:27.795 INFO:tasks.workunit.client.1.smithi135.stdout:8/124: mknod d4/d7/de/c26 0 2024-05-09T00:07:27.796 INFO:tasks.workunit.client.1.smithi135.stdout:8/125: getdents d4/d22 0 2024-05-09T00:07:27.797 INFO:tasks.workunit.client.1.smithi135.stdout:5/171: write db/f1a [4141024,90558] 0 2024-05-09T00:07:27.798 INFO:tasks.workunit.client.1.smithi135.stdout:5/172: write db/f1a [1837321,33168] 0 2024-05-09T00:07:27.800 INFO:tasks.workunit.client.1.smithi135.stdout:8/126: creat d4/d22/f27 x:0 0 0 2024-05-09T00:07:27.800 INFO:tasks.workunit.client.1.smithi135.stdout:8/127: write d4/f20 [5113886,88667] 0 2024-05-09T00:07:27.804 INFO:tasks.workunit.client.1.smithi135.stdout:5/173: creat db/d24/d2f/d31/f33 x:0 0 0 2024-05-09T00:07:27.804 INFO:tasks.workunit.client.1.smithi135.stdout:5/174: chown db/c1b 32933 1 2024-05-09T00:07:27.806 INFO:tasks.workunit.client.1.smithi135.stdout:3/120: dread d8/f23 [0,4194304] 0 2024-05-09T00:07:27.806 INFO:tasks.workunit.client.1.smithi135.stdout:3/121: write d8/f26 [894525,87836] 0 2024-05-09T00:07:27.806 INFO:tasks.workunit.client.1.smithi135.stdout:8/128: mknod d4/d7/c28 0 2024-05-09T00:07:27.807 INFO:tasks.workunit.client.1.smithi135.stdout:5/175: getdents db 0 2024-05-09T00:07:27.807 INFO:tasks.workunit.client.1.smithi135.stdout:5/176: dread - db/f2e zero size 2024-05-09T00:07:27.808 INFO:tasks.workunit.client.1.smithi135.stdout:5/177: write db/d24/d2f/d31/f33 [80459,120280] 0 2024-05-09T00:07:27.808 INFO:tasks.workunit.client.1.smithi135.stdout:5/178: readlink db/l2b 0 2024-05-09T00:07:27.808 INFO:tasks.workunit.client.1.smithi135.stdout:5/179: fsync f9 0 2024-05-09T00:07:27.809 INFO:tasks.workunit.client.1.smithi135.stdout:3/122: rename d8/lf to d8/d13/l2b 0 2024-05-09T00:07:27.809 INFO:tasks.workunit.client.1.smithi135.stdout:1/140: dread f9 [0,4194304] 0 2024-05-09T00:07:27.810 INFO:tasks.workunit.client.1.smithi135.stdout:5/180: creat db/d24/f34 x:0 0 0 2024-05-09T00:07:27.813 INFO:tasks.workunit.client.1.smithi135.stdout:8/129: rename d4/l1a to d4/d22/l29 0 2024-05-09T00:07:27.814 INFO:tasks.workunit.client.1.smithi135.stdout:3/123: truncate d8/fc 5856653 0 2024-05-09T00:07:27.816 INFO:tasks.workunit.client.1.smithi135.stdout:1/141: creat da/f35 x:0 0 0 2024-05-09T00:07:27.816 INFO:tasks.workunit.client.1.smithi135.stdout:1/142: fdatasync da/db/f15 0 2024-05-09T00:07:27.818 INFO:tasks.workunit.client.1.smithi135.stdout:5/181: mknod db/d24/c35 0 2024-05-09T00:07:27.818 INFO:tasks.workunit.client.1.smithi135.stdout:4/114: fsync dc/d26/f2a 0 2024-05-09T00:07:27.821 INFO:tasks.workunit.client.1.smithi135.stdout:1/143: mkdir da/d24/d27/d33/d36 0 2024-05-09T00:07:27.822 INFO:tasks.workunit.client.1.smithi135.stdout:5/182: rename db/c23 to db/c36 0 2024-05-09T00:07:27.824 INFO:tasks.workunit.client.1.smithi135.stdout:5/183: mknod db/d24/d2f/c37 0 2024-05-09T00:07:27.824 INFO:tasks.workunit.client.1.smithi135.stdout:5/184: readlink db/l1c 0 2024-05-09T00:07:27.826 INFO:tasks.workunit.client.1.smithi135.stdout:5/185: mknod db/c38 0 2024-05-09T00:07:27.826 INFO:tasks.workunit.client.1.smithi135.stdout:5/186: write db/fd [5276739,82835] 0 2024-05-09T00:07:27.833 INFO:tasks.workunit.client.1.smithi135.stdout:1/144: dread da/d14/f1a [0,4194304] 0 2024-05-09T00:07:27.834 INFO:tasks.workunit.client.1.smithi135.stdout:1/145: link da/cf da/c37 0 2024-05-09T00:07:27.836 INFO:tasks.workunit.client.1.smithi135.stdout:2/144: dwrite d1/f1c [0,4194304] 0 2024-05-09T00:07:27.837 INFO:tasks.workunit.client.1.smithi135.stdout:2/145: rename d1/d12/f15 to d1/d12/f24 0 2024-05-09T00:07:27.837 INFO:tasks.workunit.client.1.smithi135.stdout:2/146: fsync d1/fa 0 2024-05-09T00:07:27.838 INFO:tasks.workunit.client.1.smithi135.stdout:2/147: symlink d1/d12/l25 0 2024-05-09T00:07:27.841 INFO:tasks.workunit.client.1.smithi135.stdout:4/115: dwrite dc/d26/f2a [0,4194304] 0 2024-05-09T00:07:27.841 INFO:tasks.workunit.client.1.smithi135.stdout:4/116: chown dc/dd/d1f/f20 218857 1 2024-05-09T00:07:27.842 INFO:tasks.workunit.client.1.smithi135.stdout:3/124: dwrite d8/d13/f1b [0,4194304] 0 2024-05-09T00:07:27.842 INFO:tasks.workunit.client.1.smithi135.stdout:6/172: dwrite d2/da/d26/f3c [0,4194304] 0 2024-05-09T00:07:27.845 INFO:tasks.workunit.client.1.smithi135.stdout:8/130: rmdir d4 39 2024-05-09T00:07:27.848 INFO:tasks.workunit.client.1.smithi135.stdout:8/131: dread d4/f20 [4194304,4194304] 0 2024-05-09T00:07:27.849 INFO:tasks.workunit.client.1.smithi135.stdout:5/187: getdents db/d24 0 2024-05-09T00:07:27.849 INFO:tasks.workunit.client.1.smithi135.stdout:5/188: write db/f12 [4234905,33045] 0 2024-05-09T00:07:27.852 INFO:tasks.workunit.client.1.smithi135.stdout:1/146: getdents da/d24/d27/d33 0 2024-05-09T00:07:27.855 INFO:tasks.workunit.client.1.smithi135.stdout:6/173: mknod d2/d1a/c41 0 2024-05-09T00:07:27.856 INFO:tasks.workunit.client.1.smithi135.stdout:8/132: mkdir d4/d7/d2a 0 2024-05-09T00:07:27.857 INFO:tasks.workunit.client.1.smithi135.stdout:6/174: dread d2/d1a/d1e/f23 [0,4194304] 0 2024-05-09T00:07:27.859 INFO:tasks.workunit.client.1.smithi135.stdout:6/175: mknod d2/d1a/c42 0 2024-05-09T00:07:27.859 INFO:tasks.workunit.client.1.smithi135.stdout:7/129: sync 2024-05-09T00:07:27.859 INFO:tasks.workunit.client.1.smithi135.stdout:9/74: sync 2024-05-09T00:07:27.859 INFO:tasks.workunit.client.1.smithi135.stdout:9/75: chown d1/l4 510 1 2024-05-09T00:07:27.859 INFO:tasks.workunit.client.1.smithi135.stdout:9/76: dread - d1/f13 zero size 2024-05-09T00:07:27.859 INFO:tasks.workunit.client.1.smithi135.stdout:9/77: stat d1/d5 0 2024-05-09T00:07:27.860 INFO:tasks.workunit.client.1.smithi135.stdout:7/130: creat db/f30 x:0 0 0 2024-05-09T00:07:27.861 INFO:tasks.workunit.client.1.smithi135.stdout:2/148: dwrite d1/fd [0,4194304] 0 2024-05-09T00:07:27.861 INFO:tasks.workunit.client.1.smithi135.stdout:2/149: stat d1/f1f 0 2024-05-09T00:07:27.861 INFO:tasks.workunit.client.1.smithi135.stdout:7/131: symlink db/d21/l31 0 2024-05-09T00:07:27.861 INFO:tasks.workunit.client.1.smithi135.stdout:9/78: dread d1/d7/f11 [0,4194304] 0 2024-05-09T00:07:27.862 INFO:tasks.workunit.client.1.smithi135.stdout:2/150: write d1/d12/f24 [154921,8585] 0 2024-05-09T00:07:27.862 INFO:tasks.workunit.client.1.smithi135.stdout:5/189: dread db/f1a [0,4194304] 0 2024-05-09T00:07:27.863 INFO:tasks.workunit.client.1.smithi135.stdout:9/79: mknod d1/d5/c14 0 2024-05-09T00:07:27.864 INFO:tasks.workunit.client.1.smithi135.stdout:5/190: getdents db 0 2024-05-09T00:07:27.864 INFO:tasks.workunit.client.1.smithi135.stdout:5/191: write db/d24/f2d [1550918,99179] 0 2024-05-09T00:07:27.865 INFO:tasks.workunit.client.1.smithi135.stdout:9/80: getdents d1 0 2024-05-09T00:07:27.868 INFO:tasks.workunit.client.1.smithi135.stdout:8/133: dread d4/f20 [0,4194304] 0 2024-05-09T00:07:27.869 INFO:tasks.workunit.client.1.smithi135.stdout:8/134: write d4/d22/f27 [1029205,54293] 0 2024-05-09T00:07:27.869 INFO:tasks.workunit.client.1.smithi135.stdout:8/135: readlink d4/d7/de/l19 0 2024-05-09T00:07:27.869 INFO:tasks.workunit.client.1.smithi135.stdout:2/151: write d1/f1c [3791699,55644] 0 2024-05-09T00:07:27.869 INFO:tasks.workunit.client.1.smithi135.stdout:5/192: link db/d24/c26 db/d24/c39 0 2024-05-09T00:07:27.870 INFO:tasks.workunit.client.1.smithi135.stdout:9/81: link d1/l4 d1/d5/d10/l15 0 2024-05-09T00:07:27.870 INFO:tasks.workunit.client.1.smithi135.stdout:0/141: sync 2024-05-09T00:07:27.873 INFO:tasks.workunit.client.1.smithi135.stdout:8/136: rename d4/d7/f9 to d4/f2b 0 2024-05-09T00:07:27.873 INFO:tasks.workunit.client.1.smithi135.stdout:8/137: fsync d4/f20 0 2024-05-09T00:07:27.875 INFO:tasks.workunit.client.1.smithi135.stdout:9/82: rename d1/d5/le to d1/d5/l16 0 2024-05-09T00:07:27.878 INFO:tasks.workunit.client.1.smithi135.stdout:8/138: rename d4/d8/f15 to d4/f2c 0 2024-05-09T00:07:27.883 INFO:tasks.workunit.client.1.smithi135.stdout:2/152: dread d1/f1f [0,4194304] 0 2024-05-09T00:07:27.889 INFO:tasks.workunit.client.1.smithi135.stdout:8/139: dread d4/f2b [0,4194304] 0 2024-05-09T00:07:27.889 INFO:tasks.workunit.client.1.smithi135.stdout:8/140: chown d4 201275 1 2024-05-09T00:07:27.890 INFO:tasks.workunit.client.1.smithi135.stdout:8/141: symlink d4/d8/l2d 0 2024-05-09T00:07:27.891 INFO:tasks.workunit.client.1.smithi135.stdout:8/142: creat d4/f2e x:0 0 0 2024-05-09T00:07:27.892 INFO:tasks.workunit.client.1.smithi135.stdout:8/143: creat d4/d7/f2f x:0 0 0 2024-05-09T00:07:27.893 INFO:tasks.workunit.client.1.smithi135.stdout:8/144: mknod d4/c30 0 2024-05-09T00:07:27.902 INFO:tasks.workunit.client.1.smithi135.stdout:1/147: dwrite f4 [0,4194304] 0 2024-05-09T00:07:27.902 INFO:tasks.workunit.client.1.smithi135.stdout:1/148: chown f4 488 1 2024-05-09T00:07:27.902 INFO:tasks.workunit.client.1.smithi135.stdout:1/149: readlink da/db/l30 0 2024-05-09T00:07:27.902 INFO:tasks.workunit.client.1.smithi135.stdout:6/176: dwrite d2/d1a/d1e/f23 [0,4194304] 0 2024-05-09T00:07:27.902 INFO:tasks.workunit.client.1.smithi135.stdout:6/177: write d2/d20/f36 [346592,67538] 0 2024-05-09T00:07:27.903 INFO:tasks.workunit.client.1.smithi135.stdout:7/132: dwrite db/dd/f1c [0,4194304] 0 2024-05-09T00:07:27.904 INFO:tasks.workunit.client.1.smithi135.stdout:0/142: dwrite d3/dd/f14 [0,4194304] 0 2024-05-09T00:07:27.904 INFO:tasks.workunit.client.1.smithi135.stdout:1/150: mkdir da/d14/d20/d38 0 2024-05-09T00:07:27.904 INFO:tasks.workunit.client.1.smithi135.stdout:1/151: chown da/d14/d20/d38 32719150 1 2024-05-09T00:07:27.905 INFO:tasks.workunit.client.1.smithi135.stdout:7/133: dread db/d13/f24 [0,4194304] 0 2024-05-09T00:07:27.905 INFO:tasks.workunit.client.1.smithi135.stdout:7/134: dread - db/f28 zero size 2024-05-09T00:07:27.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/145: dread d4/d8/ff [0,4194304] 0 2024-05-09T00:07:27.905 INFO:tasks.workunit.client.1.smithi135.stdout:6/178: symlink d2/d20/d2e/d3d/l43 0 2024-05-09T00:07:27.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/146: truncate d4/d8/f23 15127 0 2024-05-09T00:07:27.912 INFO:tasks.workunit.client.1.smithi135.stdout:0/143: symlink d3/d1c/l25 0 2024-05-09T00:07:27.912 INFO:tasks.workunit.client.1.smithi135.stdout:0/144: chown d3/dd/c1a 40807592 1 2024-05-09T00:07:27.912 INFO:tasks.workunit.client.1.smithi135.stdout:2/153: truncate d1/f1c 2265988 0 2024-05-09T00:07:27.912 INFO:tasks.workunit.client.1.smithi135.stdout:2/154: truncate d1/fa 4959890 0 2024-05-09T00:07:27.912 INFO:tasks.workunit.client.1.smithi135.stdout:2/155: dread - d1/d12/f23 zero size 2024-05-09T00:07:27.913 INFO:tasks.workunit.client.1.smithi135.stdout:0/145: write d3/f15 [1045164,70915] 0 2024-05-09T00:07:27.913 INFO:tasks.workunit.client.1.smithi135.stdout:1/152: creat da/d24/d27/d33/f39 x:0 0 0 2024-05-09T00:07:27.913 INFO:tasks.workunit.client.1.smithi135.stdout:1/153: fsync f9 0 2024-05-09T00:07:27.913 INFO:tasks.workunit.client.1.smithi135.stdout:9/83: rmdir d1/d5 39 2024-05-09T00:07:27.913 INFO:tasks.workunit.client.1.smithi135.stdout:9/84: chown d1/d5/c12 125874389 1 2024-05-09T00:07:27.916 INFO:tasks.workunit.client.1.smithi135.stdout:7/135: rename db/l17 to db/l32 0 2024-05-09T00:07:27.916 INFO:tasks.workunit.client.1.smithi135.stdout:7/136: chown db/l32 0 1 2024-05-09T00:07:27.916 INFO:tasks.workunit.client.1.smithi135.stdout:7/137: fdatasync db/f30 0 2024-05-09T00:07:27.919 INFO:tasks.workunit.client.1.smithi135.stdout:8/147: link d4/f2b d4/d22/f31 0 2024-05-09T00:07:27.920 INFO:tasks.workunit.client.1.smithi135.stdout:2/156: creat d1/d22/f26 x:0 0 0 2024-05-09T00:07:27.920 INFO:tasks.workunit.client.1.smithi135.stdout:2/157: fsync d1/fa 0 2024-05-09T00:07:27.921 INFO:tasks.workunit.client.1.smithi135.stdout:1/154: mkdir da/d14/d20/d38/d3a 0 2024-05-09T00:07:27.922 INFO:tasks.workunit.client.1.smithi135.stdout:9/85: creat d1/d5/d10/f17 x:0 0 0 2024-05-09T00:07:27.923 INFO:tasks.workunit.client.1.smithi135.stdout:9/86: dread - d1/f13 zero size 2024-05-09T00:07:27.923 INFO:tasks.workunit.client.1.smithi135.stdout:9/87: write d1/f13 [792432,6328] 0 2024-05-09T00:07:27.923 INFO:tasks.workunit.client.1.smithi135.stdout:8/148: symlink d4/d7/d2a/l32 0 2024-05-09T00:07:27.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/158: chown d1/f17 58 1 2024-05-09T00:07:27.927 INFO:tasks.workunit.client.1.smithi135.stdout:1/155: creat da/d24/d27/f3b x:0 0 0 2024-05-09T00:07:27.928 INFO:tasks.workunit.client.1.smithi135.stdout:9/88: symlink d1/d7/l18 0 2024-05-09T00:07:27.928 INFO:tasks.workunit.client.1.smithi135.stdout:6/179: dwrite d2/f2c [0,4194304] 0 2024-05-09T00:07:27.929 INFO:tasks.workunit.client.1.smithi135.stdout:0/146: dwrite d3/dd/f22 [0,4194304] 0 2024-05-09T00:07:27.930 INFO:tasks.workunit.client.1.smithi135.stdout:8/149: mkdir d4/d7/d33 0 2024-05-09T00:07:27.931 INFO:tasks.workunit.client.1.smithi135.stdout:2/159: mkdir d1/d12/d27 0 2024-05-09T00:07:27.932 INFO:tasks.workunit.client.1.smithi135.stdout:1/156: truncate f4 616859 0 2024-05-09T00:07:27.934 INFO:tasks.workunit.client.1.smithi135.stdout:9/89: rename d1/l6 to d1/d7/l19 0 2024-05-09T00:07:27.935 INFO:tasks.workunit.client.1.smithi135.stdout:9/90: write d1/d5/fb [2556779,52781] 0 2024-05-09T00:07:27.938 INFO:tasks.workunit.client.1.smithi135.stdout:7/138: dwrite db/dd/f14 [0,4194304] 0 2024-05-09T00:07:27.941 INFO:tasks.workunit.client.1.smithi135.stdout:9/91: fdatasync d1/f13 0 2024-05-09T00:07:27.944 INFO:tasks.workunit.client.1.smithi135.stdout:0/147: unlink d3/ca 0 2024-05-09T00:07:27.944 INFO:tasks.workunit.client.1.smithi135.stdout:0/148: fsync d3/dd/f22 0 2024-05-09T00:07:27.944 INFO:tasks.workunit.client.1.smithi135.stdout:8/150: rmdir d4/d22 39 2024-05-09T00:07:27.945 INFO:tasks.workunit.client.1.smithi135.stdout:2/160: truncate d1/fd 3482102 0 2024-05-09T00:07:27.946 INFO:tasks.workunit.client.1.smithi135.stdout:1/157: symlink da/d24/d27/d33/d36/l3c 0 2024-05-09T00:07:27.949 INFO:tasks.workunit.client.1.smithi135.stdout:6/180: dwrite d2/d1a/d1e/f23 [0,4194304] 0 2024-05-09T00:07:27.951 INFO:tasks.workunit.client.1.smithi135.stdout:9/92: unlink d1/l4 0 2024-05-09T00:07:27.953 INFO:tasks.workunit.client.1.smithi135.stdout:0/149: creat d3/dd/f26 x:0 0 0 2024-05-09T00:07:27.954 INFO:tasks.workunit.client.1.smithi135.stdout:2/161: creat d1/d22/f28 x:0 0 0 2024-05-09T00:07:27.956 INFO:tasks.workunit.client.1.smithi135.stdout:1/158: rename f8 to da/d24/f3d 0 2024-05-09T00:07:27.958 INFO:tasks.workunit.client.1.smithi135.stdout:9/93: rename d1/d5 to d1/d1a 0 2024-05-09T00:07:27.959 INFO:tasks.workunit.client.1.smithi135.stdout:9/94: fsync d1/d7/f11 0 2024-05-09T00:07:27.960 INFO:tasks.workunit.client.1.smithi135.stdout:0/150: rmdir d3/d1c 39 2024-05-09T00:07:27.961 INFO:tasks.workunit.client.1.smithi135.stdout:2/162: creat d1/d12/d20/f29 x:0 0 0 2024-05-09T00:07:27.962 INFO:tasks.workunit.client.1.smithi135.stdout:1/159: creat da/db/d16/f3e x:0 0 0 2024-05-09T00:07:27.963 INFO:tasks.workunit.client.1.smithi135.stdout:9/95: rename d1/d1a/c12 to d1/d1a/d10/c1b 0 2024-05-09T00:07:27.963 INFO:tasks.workunit.client.1.smithi135.stdout:3/125: sync 2024-05-09T00:07:27.963 INFO:tasks.workunit.client.1.smithi135.stdout:4/117: sync 2024-05-09T00:07:27.964 INFO:tasks.workunit.client.1.smithi135.stdout:8/151: dwrite d4/d8/fb [0,4194304] 0 2024-05-09T00:07:27.964 INFO:tasks.workunit.client.1.smithi135.stdout:0/151: creat d3/d1c/f27 x:0 0 0 2024-05-09T00:07:27.967 INFO:tasks.workunit.client.1.smithi135.stdout:1/160: rename da/db/f15 to da/d14/f3f 0 2024-05-09T00:07:27.967 INFO:tasks.workunit.client.1.smithi135.stdout:1/161: chown da/d14/f1a 23353 1 2024-05-09T00:07:27.967 INFO:tasks.workunit.client.1.smithi135.stdout:0/152: read d3/f12 [2710712,109285] 0 2024-05-09T00:07:27.967 INFO:tasks.workunit.client.1.smithi135.stdout:9/96: rmdir d1/d1a/d10 39 2024-05-09T00:07:27.967 INFO:tasks.workunit.client.1.smithi135.stdout:9/97: truncate d1/f13 951832 0 2024-05-09T00:07:27.967 INFO:tasks.workunit.client.1.smithi135.stdout:9/98: write d1/d1a/d10/f17 [260832,58615] 0 2024-05-09T00:07:27.968 INFO:tasks.workunit.client.1.smithi135.stdout:3/126: creat d8/d1a/d24/f2c x:0 0 0 2024-05-09T00:07:27.968 INFO:tasks.workunit.client.1.smithi135.stdout:3/127: dread - d8/d13/f22 zero size 2024-05-09T00:07:27.968 INFO:tasks.workunit.client.1.smithi135.stdout:3/128: readlink l7 0 2024-05-09T00:07:27.971 INFO:tasks.workunit.client.1.smithi135.stdout:8/152: mknod d4/d7/d33/c34 0 2024-05-09T00:07:27.974 INFO:tasks.workunit.client.1.smithi135.stdout:0/153: creat d3/f28 x:0 0 0 2024-05-09T00:07:27.975 INFO:tasks.workunit.client.1.smithi135.stdout:9/99: rename d1/d7/cf to d1/c1c 0 2024-05-09T00:07:27.976 INFO:tasks.workunit.client.1.smithi135.stdout:3/129: creat d8/d13/f2d x:0 0 0 2024-05-09T00:07:27.977 INFO:tasks.workunit.client.1.smithi135.stdout:2/163: rename d1/c8 to d1/c2a 0 2024-05-09T00:07:27.979 INFO:tasks.workunit.client.1.smithi135.stdout:5/193: sync 2024-05-09T00:07:27.980 INFO:tasks.workunit.client.1.smithi135.stdout:8/153: rename d4/d8/ff to d4/d7/de/f35 0 2024-05-09T00:07:27.980 INFO:tasks.workunit.client.1.smithi135.stdout:8/154: write d4/d8/f1e [1047551,112226] 0 2024-05-09T00:07:27.980 INFO:tasks.workunit.client.1.smithi135.stdout:4/118: dwrite dc/dd/d1f/f20 [0,4194304] 0 2024-05-09T00:07:27.980 INFO:tasks.workunit.client.1.smithi135.stdout:5/194: write db/f25 [799893,119633] 0 2024-05-09T00:07:27.982 INFO:tasks.workunit.client.1.smithi135.stdout:9/100: mknod d1/d7/c1d 0 2024-05-09T00:07:27.982 INFO:tasks.workunit.client.1.smithi135.stdout:9/101: truncate d1/f13 1180860 0 2024-05-09T00:07:27.985 INFO:tasks.workunit.client.1.smithi135.stdout:9/102: readlink d1/d1a/l16 0 2024-05-09T00:07:27.986 INFO:tasks.workunit.client.1.smithi135.stdout:9/103: fdatasync d1/d1a/fb 0 2024-05-09T00:07:27.986 INFO:tasks.workunit.client.1.smithi135.stdout:3/130: creat d8/d13/d1f/f2e x:0 0 0 2024-05-09T00:07:27.986 INFO:tasks.workunit.client.1.smithi135.stdout:2/164: mkdir d1/d12/d20/d2b 0 2024-05-09T00:07:27.986 INFO:tasks.workunit.client.1.smithi135.stdout:8/155: symlink d4/d22/l36 0 2024-05-09T00:07:27.986 INFO:tasks.workunit.client.1.smithi135.stdout:1/162: rmdir da/db/d16 39 2024-05-09T00:07:27.987 INFO:tasks.workunit.client.1.smithi135.stdout:0/154: dread d3/d1c/f21 [0,4194304] 0 2024-05-09T00:07:27.987 INFO:tasks.workunit.client.1.smithi135.stdout:4/119: mknod dc/c2b 0 2024-05-09T00:07:27.990 INFO:tasks.workunit.client.1.smithi135.stdout:5/195: mknod db/d24/c3a 0 2024-05-09T00:07:27.994 INFO:tasks.workunit.client.1.smithi135.stdout:0/155: dread d3/dd/f14 [0,4194304] 0 2024-05-09T00:07:27.994 INFO:tasks.workunit.client.1.smithi135.stdout:8/156: dread d4/d8/fb [0,4194304] 0 2024-05-09T00:07:27.994 INFO:tasks.workunit.client.1.smithi135.stdout:8/157: fdatasync d4/d8/f1e 0 2024-05-09T00:07:27.995 INFO:tasks.workunit.client.1.smithi135.stdout:8/158: readlink d4/d22/l29 0 2024-05-09T00:07:27.995 INFO:tasks.workunit.client.1.smithi135.stdout:9/104: mkdir d1/d1e 0 2024-05-09T00:07:27.995 INFO:tasks.workunit.client.1.smithi135.stdout:2/165: mknod d1/d12/d20/c2c 0 2024-05-09T00:07:27.996 INFO:tasks.workunit.client.1.smithi135.stdout:3/131: creat d8/d13/d1f/f2f x:0 0 0 2024-05-09T00:07:27.997 INFO:tasks.workunit.client.1.smithi135.stdout:1/163: truncate f2 3029731 0 2024-05-09T00:07:27.997 INFO:tasks.workunit.client.1.smithi135.stdout:1/164: chown da/db/d16/c1d 1039004 1 2024-05-09T00:07:27.997 INFO:tasks.workunit.client.1.smithi135.stdout:1/165: readlink da/l22 0 2024-05-09T00:07:27.997 INFO:tasks.workunit.client.1.smithi135.stdout:1/166: write da/db/f34 [374648,1792] 0 2024-05-09T00:07:27.997 INFO:tasks.workunit.client.1.smithi135.stdout:5/196: symlink db/l3b 0 2024-05-09T00:07:28.001 INFO:tasks.workunit.client.1.smithi135.stdout:0/156: dread d3/dd/f13 [0,4194304] 0 2024-05-09T00:07:28.003 INFO:tasks.workunit.client.1.smithi135.stdout:8/159: link d4/f2b d4/d7/d2a/f37 0 2024-05-09T00:07:28.003 INFO:tasks.workunit.client.1.smithi135.stdout:4/120: dwrite dc/dd/d1f/f20 [0,4194304] 0 2024-05-09T00:07:28.004 INFO:tasks.workunit.client.1.smithi135.stdout:9/105: rename d1/d7/l18 to d1/d1e/l1f 0 2024-05-09T00:07:28.004 INFO:tasks.workunit.client.1.smithi135.stdout:9/106: write d1/f13 [1789684,81165] 0 2024-05-09T00:07:28.005 INFO:tasks.workunit.client.1.smithi135.stdout:2/166: mkdir d1/d22/d2d 0 2024-05-09T00:07:28.008 INFO:tasks.workunit.client.1.smithi135.stdout:3/132: rmdir d8/d1a/d24/d2a 0 2024-05-09T00:07:28.008 INFO:tasks.workunit.client.1.smithi135.stdout:1/167: stat da/cf 0 2024-05-09T00:07:28.008 INFO:tasks.workunit.client.1.smithi135.stdout:1/168: fsync da/d24/f3d 0 2024-05-09T00:07:28.009 INFO:tasks.workunit.client.1.smithi135.stdout:5/197: unlink db/d24/d2f/d31/f33 0 2024-05-09T00:07:28.010 INFO:tasks.workunit.client.1.smithi135.stdout:8/160: symlink d4/d22/l38 0 2024-05-09T00:07:28.012 INFO:tasks.workunit.client.1.smithi135.stdout:4/121: creat dc/f2c x:0 0 0 2024-05-09T00:07:28.016 INFO:tasks.workunit.client.1.smithi135.stdout:2/167: readlink d1/l10 0 2024-05-09T00:07:28.017 INFO:tasks.workunit.client.1.smithi135.stdout:9/107: dwrite d1/d7/f11 [0,4194304] 0 2024-05-09T00:07:28.017 INFO:tasks.workunit.client.1.smithi135.stdout:9/108: chown d1/d7/f11 7544192 1 2024-05-09T00:07:28.018 INFO:tasks.workunit.client.1.smithi135.stdout:3/133: link d8/fc d8/d13/d1f/f30 0 2024-05-09T00:07:28.020 INFO:tasks.workunit.client.1.smithi135.stdout:1/169: mkdir da/d14/d20/d38/d3a/d40 0 2024-05-09T00:07:28.020 INFO:tasks.workunit.client.1.smithi135.stdout:1/170: chown da/d14/d20/d38 24728 1 2024-05-09T00:07:28.020 INFO:tasks.workunit.client.1.smithi135.stdout:5/198: creat db/d24/d2f/f3c x:0 0 0 2024-05-09T00:07:28.021 INFO:tasks.workunit.client.1.smithi135.stdout:1/171: write da/db/f2a [644494,116663] 0 2024-05-09T00:07:28.022 INFO:tasks.workunit.client.1.smithi135.stdout:4/122: creat dc/f2d x:0 0 0 2024-05-09T00:07:28.022 INFO:tasks.workunit.client.1.smithi135.stdout:2/168: truncate d1/f1a 598639 0 2024-05-09T00:07:28.023 INFO:tasks.workunit.client.1.smithi135.stdout:8/161: dread d4/d8/fb [0,4194304] 0 2024-05-09T00:07:28.028 INFO:tasks.workunit.client.1.smithi135.stdout:3/134: creat d8/d1a/f31 x:0 0 0 2024-05-09T00:07:28.028 INFO:tasks.workunit.client.1.smithi135.stdout:3/135: fsync d8/d13/f1e 0 2024-05-09T00:07:28.028 INFO:tasks.workunit.client.1.smithi135.stdout:3/136: write d8/d13/f2d [464107,15354] 0 2024-05-09T00:07:28.030 INFO:tasks.workunit.client.1.smithi135.stdout:5/199: truncate db/f12 1890540 0 2024-05-09T00:07:28.038 INFO:tasks.workunit.client.1.smithi135.stdout:1/172: dread da/db/fe [0,4194304] 0 2024-05-09T00:07:28.038 INFO:tasks.workunit.client.1.smithi135.stdout:4/123: rename dc/dd/d1f/c29 to dc/c2e 0 2024-05-09T00:07:28.039 INFO:tasks.workunit.client.1.smithi135.stdout:4/124: rename dc/dd to dc/dd/d1f/d2f 22 2024-05-09T00:07:28.039 INFO:tasks.workunit.client.1.smithi135.stdout:4/125: write dc/f2c [294210,76703] 0 2024-05-09T00:07:28.039 INFO:tasks.workunit.client.1.smithi135.stdout:2/169: rmdir d1/d22/d2d 0 2024-05-09T00:07:28.039 INFO:tasks.workunit.client.1.smithi135.stdout:3/137: creat d8/f32 x:0 0 0 2024-05-09T00:07:28.039 INFO:tasks.workunit.client.1.smithi135.stdout:1/173: creat da/f41 x:0 0 0 2024-05-09T00:07:28.040 INFO:tasks.workunit.client.1.smithi135.stdout:9/109: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:28.041 INFO:tasks.workunit.client.1.smithi135.stdout:8/162: dwrite d4/d7/de/f35 [0,4194304] 0 2024-05-09T00:07:28.041 INFO:tasks.workunit.client.1.smithi135.stdout:2/170: creat d1/d12/d21/f2e x:0 0 0 2024-05-09T00:07:28.042 INFO:tasks.workunit.client.1.smithi135.stdout:3/138: truncate f0 6350687 0 2024-05-09T00:07:28.044 INFO:tasks.workunit.client.1.smithi135.stdout:9/110: mkdir d1/d7/d20 0 2024-05-09T00:07:28.045 INFO:tasks.workunit.client.1.smithi135.stdout:8/163: mkdir d4/d7/d33/d39 0 2024-05-09T00:07:28.047 INFO:tasks.workunit.client.1.smithi135.stdout:3/139: mknod d8/c33 0 2024-05-09T00:07:28.048 INFO:tasks.workunit.client.1.smithi135.stdout:8/164: read d4/f16 [3028917,27392] 0 2024-05-09T00:07:28.050 INFO:tasks.workunit.client.1.smithi135.stdout:2/171: link d1/lb d1/l2f 0 2024-05-09T00:07:28.050 INFO:tasks.workunit.client.1.smithi135.stdout:2/172: write d1/f1f [4773357,79785] 0 2024-05-09T00:07:28.051 INFO:tasks.workunit.client.1.smithi135.stdout:3/140: symlink d8/l34 0 2024-05-09T00:07:28.053 INFO:tasks.workunit.client.1.smithi135.stdout:3/141: read d8/f10 [3912822,56599] 0 2024-05-09T00:07:28.053 INFO:tasks.workunit.client.1.smithi135.stdout:3/142: write d8/d1a/f20 [788565,20384] 0 2024-05-09T00:07:28.053 INFO:tasks.workunit.client.1.smithi135.stdout:3/143: truncate d8/d13/d1f/f2f 969069 0 2024-05-09T00:07:28.053 INFO:tasks.workunit.client.1.smithi135.stdout:3/144: write d8/f32 [30276,59644] 0 2024-05-09T00:07:28.054 INFO:tasks.workunit.client.1.smithi135.stdout:7/139: sync 2024-05-09T00:07:28.054 INFO:tasks.workunit.client.1.smithi135.stdout:5/200: dwrite db/d24/f34 [0,4194304] 0 2024-05-09T00:07:28.055 INFO:tasks.workunit.client.1.smithi135.stdout:2/173: mknod d1/d12/d21/c30 0 2024-05-09T00:07:28.057 INFO:tasks.workunit.client.1.smithi135.stdout:3/145: mknod d8/d13/c35 0 2024-05-09T00:07:28.059 INFO:tasks.workunit.client.1.smithi135.stdout:3/146: write d8/d13/f1e [2389664,29469] 0 2024-05-09T00:07:28.059 INFO:tasks.workunit.client.1.smithi135.stdout:3/147: chown d8/f23 834 1 2024-05-09T00:07:28.064 INFO:tasks.workunit.client.1.smithi135.stdout:5/201: creat db/d24/d2f/d31/f3d x:0 0 0 2024-05-09T00:07:28.064 INFO:tasks.workunit.client.1.smithi135.stdout:1/174: dwrite da/f13 [0,4194304] 0 2024-05-09T00:07:28.066 INFO:tasks.workunit.client.1.smithi135.stdout:2/174: creat d1/d22/f31 x:0 0 0 2024-05-09T00:07:28.068 INFO:tasks.workunit.client.1.smithi135.stdout:7/140: mkdir db/dd/d33 0 2024-05-09T00:07:28.070 INFO:tasks.workunit.client.1.smithi135.stdout:3/148: mkdir d8/d36 0 2024-05-09T00:07:28.072 INFO:tasks.workunit.client.1.smithi135.stdout:5/202: mkdir db/d3e 0 2024-05-09T00:07:28.073 INFO:tasks.workunit.client.1.smithi135.stdout:5/203: dread - db/f28 zero size 2024-05-09T00:07:28.073 INFO:tasks.workunit.client.1.smithi135.stdout:5/204: getdents db/d3e 0 2024-05-09T00:07:28.075 INFO:tasks.workunit.client.1.smithi135.stdout:9/111: dwrite d1/d1a/fc [4194304,4194304] 0 2024-05-09T00:07:28.075 INFO:tasks.workunit.client.1.smithi135.stdout:9/112: fdatasync d1/f2 0 2024-05-09T00:07:28.076 INFO:tasks.workunit.client.1.smithi135.stdout:5/205: write f4 [2563833,99469] 0 2024-05-09T00:07:28.076 INFO:tasks.workunit.client.1.smithi135.stdout:8/165: dwrite d4/d8/fb [4194304,4194304] 0 2024-05-09T00:07:28.076 INFO:tasks.workunit.client.1.smithi135.stdout:8/166: chown d4/d7/f2f 346832757 1 2024-05-09T00:07:28.077 INFO:tasks.workunit.client.1.smithi135.stdout:4/126: dwrite dc/f1e [0,4194304] 0 2024-05-09T00:07:28.077 INFO:tasks.workunit.client.1.smithi135.stdout:3/149: truncate d8/f23 666887 0 2024-05-09T00:07:28.081 INFO:tasks.workunit.client.1.smithi135.stdout:9/113: link d1/d1a/l16 d1/l21 0 2024-05-09T00:07:28.086 INFO:tasks.workunit.client.1.smithi135.stdout:7/141: mknod db/dd/c34 0 2024-05-09T00:07:28.086 INFO:tasks.workunit.client.1.smithi135.stdout:7/142: write f8 [4661446,69394] 0 2024-05-09T00:07:28.088 INFO:tasks.workunit.client.1.smithi135.stdout:4/127: symlink dc/dd/l30 0 2024-05-09T00:07:28.088 INFO:tasks.workunit.client.1.smithi135.stdout:4/128: truncate dc/dd/f17 878967 0 2024-05-09T00:07:28.088 INFO:tasks.workunit.client.1.smithi135.stdout:9/114: creat d1/d1e/f22 x:0 0 0 2024-05-09T00:07:28.088 INFO:tasks.workunit.client.1.smithi135.stdout:9/115: chown d1/d7/f11 1014132 1 2024-05-09T00:07:28.090 INFO:tasks.workunit.client.1.smithi135.stdout:7/143: dread db/d13/f24 [0,4194304] 0 2024-05-09T00:07:28.090 INFO:tasks.workunit.client.1.smithi135.stdout:7/144: write db/f29 [913986,51991] 0 2024-05-09T00:07:28.090 INFO:tasks.workunit.client.1.smithi135.stdout:7/145: stat db/ff 0 2024-05-09T00:07:28.092 INFO:tasks.workunit.client.1.smithi135.stdout:5/206: rmdir db/d3e 0 2024-05-09T00:07:28.092 INFO:tasks.workunit.client.1.smithi135.stdout:5/207: dread - db/d24/f2c zero size 2024-05-09T00:07:28.092 INFO:tasks.workunit.client.1.smithi135.stdout:5/208: stat db/f2e 0 2024-05-09T00:07:28.092 INFO:tasks.workunit.client.1.smithi135.stdout:5/209: dread - db/d24/f2c zero size 2024-05-09T00:07:28.092 INFO:tasks.workunit.client.1.smithi135.stdout:9/116: mkdir d1/d7/d20/d23 0 2024-05-09T00:07:28.092 INFO:tasks.workunit.client.1.smithi135.stdout:7/146: creat db/dd/f35 x:0 0 0 2024-05-09T00:07:28.093 INFO:tasks.workunit.client.1.smithi135.stdout:7/147: chown db/fc 40 1 2024-05-09T00:07:28.093 INFO:tasks.workunit.client.1.smithi135.stdout:7/148: dread - db/f30 zero size 2024-05-09T00:07:28.094 INFO:tasks.workunit.client.1.smithi135.stdout:5/210: mkdir db/d3f 0 2024-05-09T00:07:28.107 INFO:tasks.workunit.client.1.smithi135.stdout:9/117: dread d1/f2 [0,4194304] 0 2024-05-09T00:07:28.110 INFO:tasks.workunit.client.1.smithi135.stdout:9/118: dread d1/f13 [0,4194304] 0 2024-05-09T00:07:28.111 INFO:tasks.workunit.client.1.smithi135.stdout:7/149: dwrite db/f16 [0,4194304] 0 2024-05-09T00:07:28.112 INFO:tasks.workunit.client.1.smithi135.stdout:9/119: mkdir d1/d24 0 2024-05-09T00:07:28.118 INFO:tasks.workunit.client.1.smithi135.stdout:9/120: write d1/d1a/fb [1330656,66373] 0 2024-05-09T00:07:28.118 INFO:tasks.workunit.client.1.smithi135.stdout:9/121: stat d1/ca 0 2024-05-09T00:07:28.119 INFO:tasks.workunit.client.1.smithi135.stdout:9/122: symlink d1/d24/l25 0 2024-05-09T00:07:28.119 INFO:tasks.workunit.client.1.smithi135.stdout:9/123: truncate d1/d1a/d10/f17 1185041 0 2024-05-09T00:07:28.121 INFO:tasks.workunit.client.1.smithi135.stdout:9/124: unlink d1/d1a/c14 0 2024-05-09T00:07:28.121 INFO:tasks.workunit.client.1.smithi135.stdout:9/125: write d1/d1a/d10/f17 [1791682,36668] 0 2024-05-09T00:07:28.122 INFO:tasks.workunit.client.1.smithi135.stdout:2/175: dwrite d1/f7 [0,4194304] 0 2024-05-09T00:07:28.124 INFO:tasks.workunit.client.1.smithi135.stdout:8/167: dwrite d4/d8/f1e [0,4194304] 0 2024-05-09T00:07:28.124 INFO:tasks.workunit.client.1.smithi135.stdout:3/150: dwrite d8/f26 [0,4194304] 0 2024-05-09T00:07:28.125 INFO:tasks.workunit.client.1.smithi135.stdout:3/151: write d8/d13/f1e [1063550,15416] 0 2024-05-09T00:07:28.125 INFO:tasks.workunit.client.1.smithi135.stdout:3/152: fdatasync d8/d13/d1f/f2e 0 2024-05-09T00:07:28.125 INFO:tasks.workunit.client.1.smithi135.stdout:1/175: dwrite f9 [0,4194304] 0 2024-05-09T00:07:28.126 INFO:tasks.workunit.client.1.smithi135.stdout:4/129: dwrite dc/f18 [0,4194304] 0 2024-05-09T00:07:28.126 INFO:tasks.workunit.client.1.smithi135.stdout:2/176: creat d1/f32 x:0 0 0 2024-05-09T00:07:28.130 INFO:tasks.workunit.client.1.smithi135.stdout:8/168: unlink d4/d8/f23 0 2024-05-09T00:07:28.132 INFO:tasks.workunit.client.1.smithi135.stdout:3/153: mknod d8/d1a/c37 0 2024-05-09T00:07:28.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/211: dwrite db/f25 [0,4194304] 0 2024-05-09T00:07:28.134 INFO:tasks.workunit.client.1.smithi135.stdout:7/150: dread db/fc [0,4194304] 0 2024-05-09T00:07:28.149 INFO:tasks.workunit.client.1.smithi135.stdout:1/176: creat da/d24/d27/d33/f42 x:0 0 0 2024-05-09T00:07:28.149 INFO:tasks.workunit.client.1.smithi135.stdout:1/177: write da/f41 [1047106,74879] 0 2024-05-09T00:07:28.149 INFO:tasks.workunit.client.1.smithi135.stdout:1/178: write da/db/f34 [520325,33370] 0 2024-05-09T00:07:28.149 INFO:tasks.workunit.client.1.smithi135.stdout:2/177: creat d1/f33 x:0 0 0 2024-05-09T00:07:28.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/169: rename d4/d8/l25 to d4/d7/d33/d39/l3a 0 2024-05-09T00:07:28.150 INFO:tasks.workunit.client.1.smithi135.stdout:3/154: mknod d8/d13/c38 0 2024-05-09T00:07:28.151 INFO:tasks.workunit.client.1.smithi135.stdout:5/212: mknod db/d24/c40 0 2024-05-09T00:07:28.152 INFO:tasks.workunit.client.1.smithi135.stdout:7/151: unlink db/d13/f25 0 2024-05-09T00:07:28.152 INFO:tasks.workunit.client.1.smithi135.stdout:7/152: chown db/f16 61 1 2024-05-09T00:07:28.152 INFO:tasks.workunit.client.1.smithi135.stdout:7/153: truncate db/f16 4399341 0 2024-05-09T00:07:28.153 INFO:tasks.workunit.client.1.smithi135.stdout:1/179: mknod da/d24/d27/c43 0 2024-05-09T00:07:28.154 INFO:tasks.workunit.client.1.smithi135.stdout:2/178: link d1/c2a d1/d12/c34 0 2024-05-09T00:07:28.155 INFO:tasks.workunit.client.1.smithi135.stdout:4/130: dread dc/dd/d1f/f21 [0,4194304] 0 2024-05-09T00:07:28.155 INFO:tasks.workunit.client.1.smithi135.stdout:9/126: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:28.155 INFO:tasks.workunit.client.1.smithi135.stdout:7/154: write db/f29 [627815,68377] 0 2024-05-09T00:07:28.155 INFO:tasks.workunit.client.1.smithi135.stdout:5/213: write f4 [1455255,117934] 0 2024-05-09T00:07:28.156 INFO:tasks.workunit.client.1.smithi135.stdout:8/170: rename d4/d7/d2a/f37 to d4/d7/d33/d39/f3b 0 2024-05-09T00:07:28.157 INFO:tasks.workunit.client.1.smithi135.stdout:8/171: read d4/d8/f1e [2784864,120422] 0 2024-05-09T00:07:28.157 INFO:tasks.workunit.client.1.smithi135.stdout:3/155: creat d8/f39 x:0 0 0 2024-05-09T00:07:28.158 INFO:tasks.workunit.client.1.smithi135.stdout:2/179: symlink d1/d12/d20/d2b/l35 0 2024-05-09T00:07:28.160 INFO:tasks.workunit.client.1.smithi135.stdout:9/127: symlink d1/d7/d20/d23/l26 0 2024-05-09T00:07:28.163 INFO:tasks.workunit.client.1.smithi135.stdout:5/214: rename db/fd to db/d24/d2f/f41 0 2024-05-09T00:07:28.163 INFO:tasks.workunit.client.1.smithi135.stdout:5/215: fdatasync db/d24/d2f/d31/f3d 0 2024-05-09T00:07:28.166 INFO:tasks.workunit.client.1.smithi135.stdout:8/172: link d4/d22/l38 d4/d7/de/l3c 0 2024-05-09T00:07:28.166 INFO:tasks.workunit.client.1.smithi135.stdout:3/156: getdents d8/d13/d1f 0 2024-05-09T00:07:28.170 INFO:tasks.workunit.client.1.smithi135.stdout:2/180: link d1/f33 d1/d12/f36 0 2024-05-09T00:07:28.170 INFO:tasks.workunit.client.1.smithi135.stdout:2/181: dread - d1/d22/f26 zero size 2024-05-09T00:07:28.171 INFO:tasks.workunit.client.1.smithi135.stdout:5/216: rename db/d24/l2a to db/d3f/l42 0 2024-05-09T00:07:28.175 INFO:tasks.workunit.client.1.smithi135.stdout:9/128: dread d1/d1a/fb [0,4194304] 0 2024-05-09T00:07:28.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/217: creat db/d24/d2f/f43 x:0 0 0 2024-05-09T00:07:28.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/218: chown db/d3f 6 1 2024-05-09T00:07:28.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/219: truncate db/d24/d2f/f43 19997 0 2024-05-09T00:07:28.178 INFO:tasks.workunit.client.1.smithi135.stdout:0/157: sync 2024-05-09T00:07:28.178 INFO:tasks.workunit.client.1.smithi135.stdout:6/181: sync 2024-05-09T00:07:28.182 INFO:tasks.workunit.client.1.smithi135.stdout:9/129: rename d1/d1e to d1/d24/d27 0 2024-05-09T00:07:28.182 INFO:tasks.workunit.client.1.smithi135.stdout:9/130: read d1/f13 [1470518,63448] 0 2024-05-09T00:07:28.184 INFO:tasks.workunit.client.1.smithi135.stdout:5/220: creat db/d24/d32/f44 x:0 0 0 2024-05-09T00:07:28.184 INFO:tasks.workunit.client.1.smithi135.stdout:5/221: truncate db/d24/f2d 1688579 0 2024-05-09T00:07:28.186 INFO:tasks.workunit.client.1.smithi135.stdout:6/182: truncate d2/f17 1780438 0 2024-05-09T00:07:28.190 INFO:tasks.workunit.client.1.smithi135.stdout:0/158: mkdir d3/d1c/d29 0 2024-05-09T00:07:28.190 INFO:tasks.workunit.client.1.smithi135.stdout:0/159: chown d3/d1c/l24 2288 1 2024-05-09T00:07:28.190 INFO:tasks.workunit.client.1.smithi135.stdout:1/180: dwrite f9 [0,4194304] 0 2024-05-09T00:07:28.191 INFO:tasks.workunit.client.1.smithi135.stdout:3/157: dread d8/f12 [0,4194304] 0 2024-05-09T00:07:28.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/155: dwrite db/dd/f1b [0,4194304] 0 2024-05-09T00:07:28.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/156: fsync db/dd/f1c 0 2024-05-09T00:07:28.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/157: dread - db/dd/f35 zero size 2024-05-09T00:07:28.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/158: readlink db/d13/l23 0 2024-05-09T00:07:28.192 INFO:tasks.workunit.client.1.smithi135.stdout:5/222: rename db/l18 to db/d24/l45 0 2024-05-09T00:07:28.194 INFO:tasks.workunit.client.1.smithi135.stdout:4/131: dwrite dc/f2c [0,4194304] 0 2024-05-09T00:07:28.194 INFO:tasks.workunit.client.1.smithi135.stdout:0/160: rmdir d3/dd 39 2024-05-09T00:07:28.194 INFO:tasks.workunit.client.1.smithi135.stdout:0/161: readlink d3/l17 0 2024-05-09T00:07:28.195 INFO:tasks.workunit.client.1.smithi135.stdout:2/182: dwrite d1/f7 [0,4194304] 0 2024-05-09T00:07:28.198 INFO:tasks.workunit.client.1.smithi135.stdout:1/181: symlink da/d24/d27/l44 0 2024-05-09T00:07:28.198 INFO:tasks.workunit.client.1.smithi135.stdout:1/182: write da/db/f34 [1514460,122785] 0 2024-05-09T00:07:28.201 INFO:tasks.workunit.client.1.smithi135.stdout:3/158: truncate d8/d13/f1e 3427055 0 2024-05-09T00:07:28.201 INFO:tasks.workunit.client.1.smithi135.stdout:3/159: truncate d8/f11 393114 0 2024-05-09T00:07:28.204 INFO:tasks.workunit.client.1.smithi135.stdout:7/159: creat db/d1e/f36 x:0 0 0 2024-05-09T00:07:28.204 INFO:tasks.workunit.client.1.smithi135.stdout:8/173: getdents d4/d7/de 0 2024-05-09T00:07:28.204 INFO:tasks.workunit.client.1.smithi135.stdout:7/160: getdents db/dd/d33 0 2024-05-09T00:07:28.204 INFO:tasks.workunit.client.1.smithi135.stdout:7/161: chown db/d13/l26 3 1 2024-05-09T00:07:28.204 INFO:tasks.workunit.client.1.smithi135.stdout:7/162: write db/d13/f24 [250068,73767] 0 2024-05-09T00:07:28.204 INFO:tasks.workunit.client.1.smithi135.stdout:7/163: fsync db/dd/f1b 0 2024-05-09T00:07:28.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/223: creat db/d3f/f46 x:0 0 0 2024-05-09T00:07:28.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/162: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:28.209 INFO:tasks.workunit.client.1.smithi135.stdout:6/183: dread d2/f25 [0,4194304] 0 2024-05-09T00:07:28.209 INFO:tasks.workunit.client.1.smithi135.stdout:2/183: rename d1/f7 to d1/d12/d20/d2b/f37 0 2024-05-09T00:07:28.212 INFO:tasks.workunit.client.1.smithi135.stdout:9/131: dwrite d1/d24/d27/f22 [0,4194304] 0 2024-05-09T00:07:28.215 INFO:tasks.workunit.client.1.smithi135.stdout:3/160: mknod d8/d36/c3a 0 2024-05-09T00:07:28.220 INFO:tasks.workunit.client.1.smithi135.stdout:5/224: unlink db/f20 0 2024-05-09T00:07:28.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/184: creat d2/d20/d3f/f44 x:0 0 0 2024-05-09T00:07:28.227 INFO:tasks.workunit.client.1.smithi135.stdout:8/174: rename d4/d7/de/f1c to d4/d7/f3d 0 2024-05-09T00:07:28.227 INFO:tasks.workunit.client.1.smithi135.stdout:2/184: rename d1/d12/d21/f2e to d1/d12/d21/f38 0 2024-05-09T00:07:28.230 INFO:tasks.workunit.client.1.smithi135.stdout:1/183: dwrite da/f1f [0,4194304] 0 2024-05-09T00:07:28.231 INFO:tasks.workunit.client.1.smithi135.stdout:1/184: truncate da/db/d16/f2f 958721 0 2024-05-09T00:07:28.231 INFO:tasks.workunit.client.1.smithi135.stdout:2/185: write d1/f1a [151890,125144] 0 2024-05-09T00:07:28.231 INFO:tasks.workunit.client.1.smithi135.stdout:2/186: write d1/d22/f28 [13615,92206] 0 2024-05-09T00:07:28.232 INFO:tasks.workunit.client.1.smithi135.stdout:2/187: chown d1/f32 331 1 2024-05-09T00:07:28.232 INFO:tasks.workunit.client.1.smithi135.stdout:2/188: write d1/d22/f26 [752367,52807] 0 2024-05-09T00:07:28.232 INFO:tasks.workunit.client.1.smithi135.stdout:2/189: truncate d1/d12/d20/d2b/f37 4590048 0 2024-05-09T00:07:28.235 INFO:tasks.workunit.client.1.smithi135.stdout:9/132: creat d1/d7/f28 x:0 0 0 2024-05-09T00:07:28.235 INFO:tasks.workunit.client.1.smithi135.stdout:3/161: creat d8/d13/f3b x:0 0 0 2024-05-09T00:07:28.235 INFO:tasks.workunit.client.1.smithi135.stdout:3/162: chown d8/f23 595 1 2024-05-09T00:07:28.237 INFO:tasks.workunit.client.1.smithi135.stdout:6/185: symlink d2/d1a/l45 0 2024-05-09T00:07:28.237 INFO:tasks.workunit.client.1.smithi135.stdout:6/186: readlink d2/d1a/l39 0 2024-05-09T00:07:28.237 INFO:tasks.workunit.client.1.smithi135.stdout:6/187: write d2/f9 [370567,96810] 0 2024-05-09T00:07:28.237 INFO:tasks.workunit.client.1.smithi135.stdout:1/185: symlink da/d14/d20/d38/l45 0 2024-05-09T00:07:28.238 INFO:tasks.workunit.client.1.smithi135.stdout:1/186: write da/db/fe [4251584,98971] 0 2024-05-09T00:07:28.238 INFO:tasks.workunit.client.1.smithi135.stdout:1/187: truncate da/d24/f26 877241 0 2024-05-09T00:07:28.238 INFO:tasks.workunit.client.1.smithi135.stdout:2/190: symlink d1/d12/d21/l39 0 2024-05-09T00:07:28.238 INFO:tasks.workunit.client.1.smithi135.stdout:9/133: write d1/d1a/fc [4097183,5282] 0 2024-05-09T00:07:28.239 INFO:tasks.workunit.client.1.smithi135.stdout:3/163: mknod d8/d1a/d24/c3c 0 2024-05-09T00:07:28.240 INFO:tasks.workunit.client.1.smithi135.stdout:0/163: dwrite d3/dd/f1b [0,4194304] 0 2024-05-09T00:07:28.240 INFO:tasks.workunit.client.1.smithi135.stdout:0/164: dread - d3/dd/f26 zero size 2024-05-09T00:07:28.240 INFO:tasks.workunit.client.1.smithi135.stdout:6/188: getdents d2/da/d1d 0 2024-05-09T00:07:28.241 INFO:tasks.workunit.client.1.smithi135.stdout:3/164: write f0 [837094,118237] 0 2024-05-09T00:07:28.241 INFO:tasks.workunit.client.1.smithi135.stdout:3/165: truncate d8/f11 647984 0 2024-05-09T00:07:28.241 INFO:tasks.workunit.client.1.smithi135.stdout:3/166: stat d8/d13 0 2024-05-09T00:07:28.242 INFO:tasks.workunit.client.1.smithi135.stdout:7/164: dwrite db/d13/f24 [0,4194304] 0 2024-05-09T00:07:28.243 INFO:tasks.workunit.client.1.smithi135.stdout:1/188: truncate da/db/f2a 527707 0 2024-05-09T00:07:28.243 INFO:tasks.workunit.client.1.smithi135.stdout:2/191: symlink d1/d12/d20/l3a 0 2024-05-09T00:07:28.243 INFO:tasks.workunit.client.1.smithi135.stdout:2/192: write d1/f32 [675859,96648] 0 2024-05-09T00:07:28.244 INFO:tasks.workunit.client.1.smithi135.stdout:9/134: creat d1/d1a/f29 x:0 0 0 2024-05-09T00:07:28.245 INFO:tasks.workunit.client.1.smithi135.stdout:0/165: mknod d3/d1c/d29/c2a 0 2024-05-09T00:07:28.247 INFO:tasks.workunit.client.1.smithi135.stdout:6/189: rename d2/da/d1d/c33 to d2/d1a/c46 0 2024-05-09T00:07:28.252 INFO:tasks.workunit.client.1.smithi135.stdout:7/165: unlink l6 0 2024-05-09T00:07:28.252 INFO:tasks.workunit.client.1.smithi135.stdout:7/166: readlink db/d13/l2b 0 2024-05-09T00:07:28.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/167: write f8 [1127675,68064] 0 2024-05-09T00:07:28.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/168: truncate db/f30 148444 0 2024-05-09T00:07:28.254 INFO:tasks.workunit.client.1.smithi135.stdout:2/193: mkdir d1/d12/d20/d3b 0 2024-05-09T00:07:28.257 INFO:tasks.workunit.client.1.smithi135.stdout:0/166: link d3/d1c/l1e d3/l2b 0 2024-05-09T00:07:28.259 INFO:tasks.workunit.client.1.smithi135.stdout:1/189: rename f2 to da/d14/d20/d38/f46 0 2024-05-09T00:07:28.260 INFO:tasks.workunit.client.1.smithi135.stdout:6/190: creat d2/d20/d2e/d3d/f47 x:0 0 0 2024-05-09T00:07:28.260 INFO:tasks.workunit.client.1.smithi135.stdout:6/191: write d2/d1a/f24 [102423,12301] 0 2024-05-09T00:07:28.260 INFO:tasks.workunit.client.1.smithi135.stdout:7/169: stat l9 0 2024-05-09T00:07:28.264 INFO:tasks.workunit.client.1.smithi135.stdout:2/194: rename d1/d12/f23 to d1/d12/d27/f3c 0 2024-05-09T00:07:28.264 INFO:tasks.workunit.client.1.smithi135.stdout:2/195: write d1/f33 [636050,9600] 0 2024-05-09T00:07:28.265 INFO:tasks.workunit.client.1.smithi135.stdout:6/192: dread d2/f9 [0,4194304] 0 2024-05-09T00:07:28.266 INFO:tasks.workunit.client.1.smithi135.stdout:1/190: mknod da/d14/d20/c47 0 2024-05-09T00:07:28.267 INFO:tasks.workunit.client.1.smithi135.stdout:7/170: creat db/f37 x:0 0 0 2024-05-09T00:07:28.271 INFO:tasks.workunit.client.1.smithi135.stdout:1/191: getdents da/d24/d27/d33/d36 0 2024-05-09T00:07:28.272 INFO:tasks.workunit.client.1.smithi135.stdout:7/171: mkdir db/d38 0 2024-05-09T00:07:28.276 INFO:tasks.workunit.client.1.smithi135.stdout:6/193: dread d2/f17 [0,4194304] 0 2024-05-09T00:07:28.279 INFO:tasks.workunit.client.1.smithi135.stdout:3/167: getdents d8/d1a/d24 0 2024-05-09T00:07:28.279 INFO:tasks.workunit.client.1.smithi135.stdout:3/168: chown d8/l34 6116988 1 2024-05-09T00:07:28.279 INFO:tasks.workunit.client.1.smithi135.stdout:3/169: chown c2 240 1 2024-05-09T00:07:28.279 INFO:tasks.workunit.client.1.smithi135.stdout:3/170: chown d8/d36/c3a 2 1 2024-05-09T00:07:28.280 INFO:tasks.workunit.client.1.smithi135.stdout:0/167: dwrite d3/d1c/f27 [0,4194304] 0 2024-05-09T00:07:28.280 INFO:tasks.workunit.client.1.smithi135.stdout:0/168: dread - d3/f23 zero size 2024-05-09T00:07:28.280 INFO:tasks.workunit.client.1.smithi135.stdout:0/169: chown d3/dd/f26 3581834 1 2024-05-09T00:07:28.280 INFO:tasks.workunit.client.1.smithi135.stdout:3/171: write d8/d13/f22 [203109,51022] 0 2024-05-09T00:07:28.281 INFO:tasks.workunit.client.1.smithi135.stdout:7/172: link db/dd/l1f db/d21/l39 0 2024-05-09T00:07:28.281 INFO:tasks.workunit.client.1.smithi135.stdout:7/173: write db/ff [1073877,85868] 0 2024-05-09T00:07:28.282 INFO:tasks.workunit.client.1.smithi135.stdout:1/192: fsync da/db/f2a 0 2024-05-09T00:07:28.283 INFO:tasks.workunit.client.1.smithi135.stdout:6/194: creat d2/d20/d2e/d3d/f48 x:0 0 0 2024-05-09T00:07:28.283 INFO:tasks.workunit.client.1.smithi135.stdout:6/195: chown d2/d20/d2e/d3d/l43 719497 1 2024-05-09T00:07:28.283 INFO:tasks.workunit.client.1.smithi135.stdout:6/196: dread - d2/d20/d2e/d3d/f47 zero size 2024-05-09T00:07:28.284 INFO:tasks.workunit.client.1.smithi135.stdout:0/170: dread d3/f4 [0,4194304] 0 2024-05-09T00:07:28.287 INFO:tasks.workunit.client.1.smithi135.stdout:3/172: link d8/d1a/f31 d8/d36/f3d 0 2024-05-09T00:07:28.287 INFO:tasks.workunit.client.1.smithi135.stdout:3/173: read - d8/d1a/f28 zero size 2024-05-09T00:07:28.287 INFO:tasks.workunit.client.1.smithi135.stdout:3/174: read d8/f14 [3450755,91146] 0 2024-05-09T00:07:28.288 INFO:tasks.workunit.client.1.smithi135.stdout:3/175: write d8/d13/f1e [1437506,128722] 0 2024-05-09T00:07:28.288 INFO:tasks.workunit.client.1.smithi135.stdout:7/174: mkdir db/d1e/d3a 0 2024-05-09T00:07:28.290 INFO:tasks.workunit.client.1.smithi135.stdout:1/193: mkdir da/d24/d27/d33/d48 0 2024-05-09T00:07:28.292 INFO:tasks.workunit.client.1.smithi135.stdout:6/197: rename d2/d1a/d1e to d2/da/d49 0 2024-05-09T00:07:28.292 INFO:tasks.workunit.client.1.smithi135.stdout:6/198: chown d2/d20/d37 117979 1 2024-05-09T00:07:28.293 INFO:tasks.workunit.client.1.smithi135.stdout:1/194: dread da/d14/f1a [0,4194304] 0 2024-05-09T00:07:28.293 INFO:tasks.workunit.client.1.smithi135.stdout:0/171: mkdir d3/dd/d2c 0 2024-05-09T00:07:28.293 INFO:tasks.workunit.client.1.smithi135.stdout:0/172: dread - d3/dd/f26 zero size 2024-05-09T00:07:28.295 INFO:tasks.workunit.client.1.smithi135.stdout:3/176: link d8/d1a/d24/l25 d8/d13/l3e 0 2024-05-09T00:07:28.297 INFO:tasks.workunit.client.1.smithi135.stdout:7/175: creat db/d1e/d3a/f3b x:0 0 0 2024-05-09T00:07:28.297 INFO:tasks.workunit.client.1.smithi135.stdout:9/135: truncate d1/d1a/fc 5011794 0 2024-05-09T00:07:28.298 INFO:tasks.workunit.client.1.smithi135.stdout:1/195: dread da/d14/f1a [0,4194304] 0 2024-05-09T00:07:28.306 INFO:tasks.workunit.client.1.smithi135.stdout:6/199: write d2/da/d1d/f27 [1896646,112253] 0 2024-05-09T00:07:28.306 INFO:tasks.workunit.client.1.smithi135.stdout:3/177: link d8/f17 d8/d13/d1f/f3f 0 2024-05-09T00:07:28.307 INFO:tasks.workunit.client.1.smithi135.stdout:7/176: rmdir db/d38 0 2024-05-09T00:07:28.308 INFO:tasks.workunit.client.1.smithi135.stdout:9/136: unlink d1/d1a/d10/f17 0 2024-05-09T00:07:28.309 INFO:tasks.workunit.client.1.smithi135.stdout:1/196: symlink da/d24/d27/d33/d36/l49 0 2024-05-09T00:07:28.312 INFO:tasks.workunit.client.1.smithi135.stdout:7/177: mknod db/d21/c3c 0 2024-05-09T00:07:28.313 INFO:tasks.workunit.client.1.smithi135.stdout:1/197: symlink da/d24/d27/d33/d48/l4a 0 2024-05-09T00:07:28.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/178: rename d8/d36 to d8/d13/d1f/d40 0 2024-05-09T00:07:28.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/179: chown d8/fe 1276 1 2024-05-09T00:07:28.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/180: write d8/d1a/d24/f2c [449628,32461] 0 2024-05-09T00:07:28.315 INFO:tasks.workunit.client.1.smithi135.stdout:6/200: symlink d2/l4a 0 2024-05-09T00:07:28.316 INFO:tasks.workunit.client.1.smithi135.stdout:7/178: creat db/dd/d33/f3d x:0 0 0 2024-05-09T00:07:28.318 INFO:tasks.workunit.client.1.smithi135.stdout:3/181: mknod d8/d13/d1f/d40/c41 0 2024-05-09T00:07:28.318 INFO:tasks.workunit.client.1.smithi135.stdout:3/182: chown d8/f29 364 1 2024-05-09T00:07:28.318 INFO:tasks.workunit.client.1.smithi135.stdout:3/183: chown d8/f26 64 1 2024-05-09T00:07:28.320 INFO:tasks.workunit.client.1.smithi135.stdout:6/201: symlink d2/da/d26/l4b 0 2024-05-09T00:07:28.321 INFO:tasks.workunit.client.1.smithi135.stdout:6/202: symlink d2/da/l4c 0 2024-05-09T00:07:28.323 INFO:tasks.workunit.client.1.smithi135.stdout:6/203: read d2/da/d49/f23 [3137164,117976] 0 2024-05-09T00:07:28.325 INFO:tasks.workunit.client.1.smithi135.stdout:0/173: dwrite d3/f16 [0,4194304] 0 2024-05-09T00:07:28.328 INFO:tasks.workunit.client.1.smithi135.stdout:6/204: symlink d2/d20/d2e/d3d/l4d 0 2024-05-09T00:07:28.330 INFO:tasks.workunit.client.1.smithi135.stdout:9/137: read d1/d1a/fc [2159095,124748] 0 2024-05-09T00:07:28.330 INFO:tasks.workunit.client.1.smithi135.stdout:9/138: stat d1/d7/c1d 0 2024-05-09T00:07:28.330 INFO:tasks.workunit.client.1.smithi135.stdout:9/139: readlink d1/d7/d20/d23/l26 0 2024-05-09T00:07:28.331 INFO:tasks.workunit.client.1.smithi135.stdout:0/174: mkdir d3/dd/d2d 0 2024-05-09T00:07:28.332 INFO:tasks.workunit.client.1.smithi135.stdout:6/205: rmdir d2/da/d49 39 2024-05-09T00:07:28.333 INFO:tasks.workunit.client.1.smithi135.stdout:6/206: write f1 [850793,88966] 0 2024-05-09T00:07:28.333 INFO:tasks.workunit.client.1.smithi135.stdout:6/207: chown d2/l4a 0 1 2024-05-09T00:07:28.334 INFO:tasks.workunit.client.1.smithi135.stdout:4/132: sync 2024-05-09T00:07:28.335 INFO:tasks.workunit.client.1.smithi135.stdout:4/133: truncate fa 8231615 0 2024-05-09T00:07:28.343 INFO:tasks.workunit.client.1.smithi135.stdout:3/184: dwrite d8/f39 [0,4194304] 0 2024-05-09T00:07:28.343 INFO:tasks.workunit.client.1.smithi135.stdout:1/198: dwrite da/f13 [0,4194304] 0 2024-05-09T00:07:28.343 INFO:tasks.workunit.client.1.smithi135.stdout:1/199: chown da/d14/d20/d2c 161867510 1 2024-05-09T00:07:28.345 INFO:tasks.workunit.client.1.smithi135.stdout:1/200: creat da/f4b x:0 0 0 2024-05-09T00:07:28.345 INFO:tasks.workunit.client.1.smithi135.stdout:7/179: dwrite db/f30 [0,4194304] 0 2024-05-09T00:07:28.357 INFO:tasks.workunit.client.1.smithi135.stdout:0/175: rmdir d3 39 2024-05-09T00:07:28.374 INFO:tasks.workunit.client.1.smithi135.stdout:1/201: dwrite da/f4b [0,4194304] 0 2024-05-09T00:07:28.377 INFO:tasks.workunit.client.1.smithi135.stdout:9/140: dwrite d1/d24/d27/f22 [4194304,4194304] 0 2024-05-09T00:07:28.377 INFO:tasks.workunit.client.1.smithi135.stdout:4/134: dwrite dc/dd/f11 [0,4194304] 0 2024-05-09T00:07:28.378 INFO:tasks.workunit.client.1.smithi135.stdout:1/202: mknod da/d24/d27/d33/c4c 0 2024-05-09T00:07:28.380 INFO:tasks.workunit.client.1.smithi135.stdout:1/203: creat da/d14/d20/d38/f4d x:0 0 0 2024-05-09T00:07:28.381 INFO:tasks.workunit.client.1.smithi135.stdout:1/204: truncate da/d24/d27/f3b 124571 0 2024-05-09T00:07:28.381 INFO:tasks.workunit.client.1.smithi135.stdout:1/205: fsync da/d24/f3d 0 2024-05-09T00:07:28.382 INFO:tasks.workunit.client.1.smithi135.stdout:2/196: sync 2024-05-09T00:07:28.383 INFO:tasks.workunit.client.1.smithi135.stdout:5/225: sync 2024-05-09T00:07:28.383 INFO:tasks.workunit.client.1.smithi135.stdout:8/175: sync 2024-05-09T00:07:28.385 INFO:tasks.workunit.client.1.smithi135.stdout:2/197: rename d1/f11 to d1/d22/f3d 0 2024-05-09T00:07:28.385 INFO:tasks.workunit.client.1.smithi135.stdout:2/198: readlink d1/l10 0 2024-05-09T00:07:28.386 INFO:tasks.workunit.client.1.smithi135.stdout:5/226: creat db/d24/d32/f47 x:0 0 0 2024-05-09T00:07:28.386 INFO:tasks.workunit.client.1.smithi135.stdout:5/227: chown db/c22 8 1 2024-05-09T00:07:28.387 INFO:tasks.workunit.client.1.smithi135.stdout:5/228: readlink l3 0 2024-05-09T00:07:28.387 INFO:tasks.workunit.client.1.smithi135.stdout:5/229: fsync db/d3f/f46 0 2024-05-09T00:07:28.387 INFO:tasks.workunit.client.1.smithi135.stdout:5/230: fsync db/f21 0 2024-05-09T00:07:28.387 INFO:tasks.workunit.client.1.smithi135.stdout:8/176: write d4/d7/de/f35 [116018,48585] 0 2024-05-09T00:07:28.389 INFO:tasks.workunit.client.1.smithi135.stdout:8/177: mknod d4/d8/c3e 0 2024-05-09T00:07:28.393 INFO:tasks.workunit.client.1.smithi135.stdout:8/178: getdents d4/d7/d33 0 2024-05-09T00:07:28.393 INFO:tasks.workunit.client.1.smithi135.stdout:8/179: chown l0 18 1 2024-05-09T00:07:28.399 INFO:tasks.workunit.client.1.smithi135.stdout:8/180: symlink d4/d7/l3f 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:1/206: dread da/f41 [0,4194304] 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:1/207: write da/f35 [602955,96978] 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:5/231: dread db/f10 [0,4194304] 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:1/208: mknod da/d14/d20/d38/d3a/d40/c4e 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:7/180: dwrite db/f28 [0,4194304] 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:7/181: dread - db/f37 zero size 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:7/182: write db/ff [1022937,69110] 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:5/232: mkdir db/d24/d48 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:6/208: dwrite d2/da/f3b [0,4194304] 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:6/209: chown d2/d20/d2e/f3e 324605726 1 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:6/210: write d2/d20/d2e/f3e [653426,84839] 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:0/176: dwrite d3/dd/f26 [0,4194304] 0 2024-05-09T00:07:28.400 INFO:tasks.workunit.client.1.smithi135.stdout:6/211: write d2/fd [1142707,45076] 0 2024-05-09T00:07:28.401 INFO:tasks.workunit.client.1.smithi135.stdout:1/209: write da/f4b [4722182,110279] 0 2024-05-09T00:07:28.401 INFO:tasks.workunit.client.1.smithi135.stdout:1/210: chown da 377 1 2024-05-09T00:07:28.402 INFO:tasks.workunit.client.1.smithi135.stdout:7/183: mknod db/d1e/d3a/c3e 0 2024-05-09T00:07:28.402 INFO:tasks.workunit.client.1.smithi135.stdout:7/184: fsync db/f28 0 2024-05-09T00:07:28.402 INFO:tasks.workunit.client.1.smithi135.stdout:4/135: dwrite dc/d26/f2a [4194304,4194304] 0 2024-05-09T00:07:28.402 INFO:tasks.workunit.client.1.smithi135.stdout:5/233: creat db/d24/d2f/f49 x:0 0 0 2024-05-09T00:07:28.403 INFO:tasks.workunit.client.1.smithi135.stdout:5/234: write db/d24/d2f/f41 [2287482,114141] 0 2024-05-09T00:07:28.407 INFO:tasks.workunit.client.1.smithi135.stdout:2/199: dwrite d1/d12/d21/f38 [0,4194304] 0 2024-05-09T00:07:28.408 INFO:tasks.workunit.client.1.smithi135.stdout:6/212: mkdir d2/d20/d37/d4e 0 2024-05-09T00:07:28.408 INFO:tasks.workunit.client.1.smithi135.stdout:6/213: chown d2/da/d26/l34 2722 1 2024-05-09T00:07:28.411 INFO:tasks.workunit.client.1.smithi135.stdout:7/185: unlink db/d21/l39 0 2024-05-09T00:07:28.412 INFO:tasks.workunit.client.1.smithi135.stdout:9/141: dwrite d1/d24/d27/f22 [4194304,4194304] 0 2024-05-09T00:07:28.414 INFO:tasks.workunit.client.1.smithi135.stdout:5/235: unlink db/d3f/f46 0 2024-05-09T00:07:28.415 INFO:tasks.workunit.client.1.smithi135.stdout:4/136: dread dc/d26/f2a [4194304,4194304] 0 2024-05-09T00:07:28.416 INFO:tasks.workunit.client.1.smithi135.stdout:4/137: readlink dc/l13 0 2024-05-09T00:07:28.416 INFO:tasks.workunit.client.1.smithi135.stdout:4/138: truncate dc/dd/f22 710575 0 2024-05-09T00:07:28.418 INFO:tasks.workunit.client.1.smithi135.stdout:2/200: creat d1/d12/d20/f3e x:0 0 0 2024-05-09T00:07:28.419 INFO:tasks.workunit.client.1.smithi135.stdout:6/214: mkdir d2/d20/d3f/d4f 0 2024-05-09T00:07:28.420 INFO:tasks.workunit.client.1.smithi135.stdout:1/211: dread da/db/d16/f2f [0,4194304] 0 2024-05-09T00:07:28.423 INFO:tasks.workunit.client.1.smithi135.stdout:7/186: link l7 db/d21/l3f 0 2024-05-09T00:07:28.423 INFO:tasks.workunit.client.1.smithi135.stdout:7/187: read - db/d1e/f36 zero size 2024-05-09T00:07:28.425 INFO:tasks.workunit.client.1.smithi135.stdout:9/142: getdents d1/d24 0 2024-05-09T00:07:28.425 INFO:tasks.workunit.client.1.smithi135.stdout:9/143: readlink d1/l21 0 2024-05-09T00:07:28.425 INFO:tasks.workunit.client.1.smithi135.stdout:9/144: chown d1/l21 58699 1 2024-05-09T00:07:28.425 INFO:tasks.workunit.client.1.smithi135.stdout:9/145: write d1/d1a/f29 [391096,130315] 0 2024-05-09T00:07:28.427 INFO:tasks.workunit.client.1.smithi135.stdout:0/177: dwrite d3/f16 [0,4194304] 0 2024-05-09T00:07:28.427 INFO:tasks.workunit.client.1.smithi135.stdout:0/178: chown d3/c20 133257873 1 2024-05-09T00:07:28.432 INFO:tasks.workunit.client.1.smithi135.stdout:9/146: dread d1/d1a/fb [0,4194304] 0 2024-05-09T00:07:28.436 INFO:tasks.workunit.client.1.smithi135.stdout:9/147: write d1/d7/f11 [2492903,59907] 0 2024-05-09T00:07:28.437 INFO:tasks.workunit.client.1.smithi135.stdout:2/201: dwrite d1/fa [0,4194304] 0 2024-05-09T00:07:28.437 INFO:tasks.workunit.client.1.smithi135.stdout:2/202: read - d1/d12/d27/f3c zero size 2024-05-09T00:07:28.438 INFO:tasks.workunit.client.1.smithi135.stdout:8/181: dwrite d4/d7/de/f35 [4194304,4194304] 0 2024-05-09T00:07:28.438 INFO:tasks.workunit.client.1.smithi135.stdout:4/139: mkdir dc/d26/d31 0 2024-05-09T00:07:28.440 INFO:tasks.workunit.client.1.smithi135.stdout:6/215: getdents d2/da/d49 0 2024-05-09T00:07:28.442 INFO:tasks.workunit.client.1.smithi135.stdout:1/212: symlink da/db/l4f 0 2024-05-09T00:07:28.445 INFO:tasks.workunit.client.1.smithi135.stdout:7/188: mkdir db/d1e/d3a/d40 0 2024-05-09T00:07:28.449 INFO:tasks.workunit.client.1.smithi135.stdout:0/179: rename d3/f4 to d3/d1c/d29/f2e 0 2024-05-09T00:07:28.456 INFO:tasks.workunit.client.1.smithi135.stdout:4/140: mkdir dc/d26/d31/d32 0 2024-05-09T00:07:28.456 INFO:tasks.workunit.client.1.smithi135.stdout:4/141: chown dc/dd/l23 22363 1 2024-05-09T00:07:28.457 INFO:tasks.workunit.client.1.smithi135.stdout:4/142: chown dc/f2d 10308037 1 2024-05-09T00:07:28.457 INFO:tasks.workunit.client.1.smithi135.stdout:6/216: truncate d2/da/d49/f23 1723752 0 2024-05-09T00:07:28.459 INFO:tasks.workunit.client.1.smithi135.stdout:1/213: unlink da/db/c11 0 2024-05-09T00:07:28.459 INFO:tasks.workunit.client.1.smithi135.stdout:1/214: fdatasync da/d24/d27/d33/f42 0 2024-05-09T00:07:28.460 INFO:tasks.workunit.client.1.smithi135.stdout:9/148: dwrite d1/d24/d27/f22 [0,4194304] 0 2024-05-09T00:07:28.460 INFO:tasks.workunit.client.1.smithi135.stdout:9/149: fdatasync d1/f2 0 2024-05-09T00:07:28.460 INFO:tasks.workunit.client.1.smithi135.stdout:9/150: readlink d1/d24/l25 0 2024-05-09T00:07:28.460 INFO:tasks.workunit.client.1.smithi135.stdout:7/189: truncate f8 561778 0 2024-05-09T00:07:28.460 INFO:tasks.workunit.client.1.smithi135.stdout:7/190: fsync db/d1e/d3a/f3b 0 2024-05-09T00:07:28.462 INFO:tasks.workunit.client.1.smithi135.stdout:0/180: creat d3/dd/f2f x:0 0 0 2024-05-09T00:07:28.464 INFO:tasks.workunit.client.1.smithi135.stdout:4/143: mknod dc/dd/c33 0 2024-05-09T00:07:28.465 INFO:tasks.workunit.client.1.smithi135.stdout:6/217: symlink d2/d20/d37/d4e/l50 0 2024-05-09T00:07:28.467 INFO:tasks.workunit.client.1.smithi135.stdout:2/203: dwrite d1/f1a [0,4194304] 0 2024-05-09T00:07:28.467 INFO:tasks.workunit.client.1.smithi135.stdout:1/215: rename da/l22 to da/d14/d20/d2c/l50 0 2024-05-09T00:07:28.468 INFO:tasks.workunit.client.1.smithi135.stdout:9/151: rmdir d1/d1a/d10 39 2024-05-09T00:07:28.470 INFO:tasks.workunit.client.1.smithi135.stdout:7/191: link db/d13/c27 db/c41 0 2024-05-09T00:07:28.470 INFO:tasks.workunit.client.1.smithi135.stdout:2/204: dread d1/f33 [0,4194304] 0 2024-05-09T00:07:28.471 INFO:tasks.workunit.client.1.smithi135.stdout:0/181: link d3/c19 d3/dd/d2c/c30 0 2024-05-09T00:07:28.471 INFO:tasks.workunit.client.1.smithi135.stdout:0/182: truncate d3/d1c/f21 4820982 0 2024-05-09T00:07:28.472 INFO:tasks.workunit.client.1.smithi135.stdout:4/144: creat dc/f34 x:0 0 0 2024-05-09T00:07:28.473 INFO:tasks.workunit.client.1.smithi135.stdout:1/216: mknod da/db/d16/c51 0 2024-05-09T00:07:28.474 INFO:tasks.workunit.client.1.smithi135.stdout:7/192: creat db/f42 x:0 0 0 2024-05-09T00:07:28.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/205: creat d1/d12/d21/f3f x:0 0 0 2024-05-09T00:07:28.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/206: dread - d1/d12/d20/f29 zero size 2024-05-09T00:07:28.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/207: chown d1/l2f 5040 1 2024-05-09T00:07:28.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/208: readlink d1/l14 0 2024-05-09T00:07:28.478 INFO:tasks.workunit.client.1.smithi135.stdout:2/209: fsync d1/f33 0 2024-05-09T00:07:28.481 INFO:tasks.workunit.client.1.smithi135.stdout:4/145: unlink c2 0 2024-05-09T00:07:28.481 INFO:tasks.workunit.client.1.smithi135.stdout:6/218: symlink d2/l51 0 2024-05-09T00:07:28.481 INFO:tasks.workunit.client.1.smithi135.stdout:1/217: getdents da/d14/d20/d38/d3a/d40 0 2024-05-09T00:07:28.485 INFO:tasks.workunit.client.1.smithi135.stdout:6/219: read d2/da/f3b [331671,93549] 0 2024-05-09T00:07:28.485 INFO:tasks.workunit.client.1.smithi135.stdout:6/220: chown d2/d20/d37 345195 1 2024-05-09T00:07:28.485 INFO:tasks.workunit.client.1.smithi135.stdout:6/221: chown d2/da/f3b 1102684 1 2024-05-09T00:07:28.485 INFO:tasks.workunit.client.1.smithi135.stdout:2/210: getdents d1/d12/d20/d2b 0 2024-05-09T00:07:28.486 INFO:tasks.workunit.client.1.smithi135.stdout:1/218: mkdir da/d24/d27/d33/d52 0 2024-05-09T00:07:28.487 INFO:tasks.workunit.client.1.smithi135.stdout:3/185: sync 2024-05-09T00:07:28.488 INFO:tasks.workunit.client.1.smithi135.stdout:6/222: link d2/f2a d2/d20/d3f/f52 0 2024-05-09T00:07:28.489 INFO:tasks.workunit.client.1.smithi135.stdout:1/219: mknod da/d24/d27/d33/c53 0 2024-05-09T00:07:28.492 INFO:tasks.workunit.client.1.smithi135.stdout:6/223: write d2/d20/d3f/f52 [4066430,4798] 0 2024-05-09T00:07:28.492 INFO:tasks.workunit.client.1.smithi135.stdout:6/224: chown d2/da/d1d/f27 32227 1 2024-05-09T00:07:28.492 INFO:tasks.workunit.client.1.smithi135.stdout:6/225: chown d2/f25 0 1 2024-05-09T00:07:28.493 INFO:tasks.workunit.client.1.smithi135.stdout:3/186: rename d8/f32 to d8/f42 0 2024-05-09T00:07:28.493 INFO:tasks.workunit.client.1.smithi135.stdout:3/187: stat d8/f39 0 2024-05-09T00:07:28.497 INFO:tasks.workunit.client.1.smithi135.stdout:6/226: symlink d2/d20/d3f/l53 0 2024-05-09T00:07:28.497 INFO:tasks.workunit.client.1.smithi135.stdout:6/227: truncate d2/d20/d2e/d3d/f48 875105 0 2024-05-09T00:07:28.498 INFO:tasks.workunit.client.1.smithi135.stdout:3/188: getdents d8/d13 0 2024-05-09T00:07:28.500 INFO:tasks.workunit.client.1.smithi135.stdout:7/193: dwrite db/dd/d33/f3d [0,4194304] 0 2024-05-09T00:07:28.500 INFO:tasks.workunit.client.1.smithi135.stdout:7/194: write db/dd/f1c [5209078,106125] 0 2024-05-09T00:07:28.500 INFO:tasks.workunit.client.1.smithi135.stdout:7/195: chown l7 43708 1 2024-05-09T00:07:28.500 INFO:tasks.workunit.client.1.smithi135.stdout:7/196: fdatasync db/d13/f2a 0 2024-05-09T00:07:28.502 INFO:tasks.workunit.client.1.smithi135.stdout:6/228: creat d2/d20/d37/f54 x:0 0 0 2024-05-09T00:07:28.502 INFO:tasks.workunit.client.1.smithi135.stdout:6/229: stat d2/l4a 0 2024-05-09T00:07:28.503 INFO:tasks.workunit.client.1.smithi135.stdout:1/220: dread da/d14/f3f [0,4194304] 0 2024-05-09T00:07:28.505 INFO:tasks.workunit.client.1.smithi135.stdout:7/197: mknod db/c43 0 2024-05-09T00:07:28.511 INFO:tasks.workunit.client.1.smithi135.stdout:9/152: dwrite d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:28.514 INFO:tasks.workunit.client.1.smithi135.stdout:0/183: dwrite d3/dd/f13 [0,4194304] 0 2024-05-09T00:07:28.515 INFO:tasks.workunit.client.1.smithi135.stdout:2/211: dwrite d1/fa [4194304,4194304] 0 2024-05-09T00:07:28.515 INFO:tasks.workunit.client.1.smithi135.stdout:4/146: dwrite dc/f34 [0,4194304] 0 2024-05-09T00:07:28.515 INFO:tasks.workunit.client.1.smithi135.stdout:9/153: rmdir d1/d1a 39 2024-05-09T00:07:28.517 INFO:tasks.workunit.client.1.smithi135.stdout:0/184: truncate d3/dd/f1b 4077114 0 2024-05-09T00:07:28.520 INFO:tasks.workunit.client.1.smithi135.stdout:2/212: mkdir d1/d12/d20/d3b/d40 0 2024-05-09T00:07:28.527 INFO:tasks.workunit.client.1.smithi135.stdout:6/230: dwrite d2/d1a/f24 [0,4194304] 0 2024-05-09T00:07:28.528 INFO:tasks.workunit.client.1.smithi135.stdout:4/147: symlink dc/dd/d28/l35 0 2024-05-09T00:07:28.529 INFO:tasks.workunit.client.1.smithi135.stdout:9/154: link d1/d7/l19 d1/d7/d20/l2a 0 2024-05-09T00:07:28.529 INFO:tasks.workunit.client.1.smithi135.stdout:3/189: dwrite d8/f42 [0,4194304] 0 2024-05-09T00:07:28.530 INFO:tasks.workunit.client.1.smithi135.stdout:1/221: dwrite da/d24/d27/f28 [0,4194304] 0 2024-05-09T00:07:28.532 INFO:tasks.workunit.client.1.smithi135.stdout:0/185: rename d3/f18 to d3/f31 0 2024-05-09T00:07:28.532 INFO:tasks.workunit.client.1.smithi135.stdout:0/186: fsync d3/d1c/f21 0 2024-05-09T00:07:28.532 INFO:tasks.workunit.client.1.smithi135.stdout:2/213: mkdir d1/d12/d21/d41 0 2024-05-09T00:07:28.533 INFO:tasks.workunit.client.1.smithi135.stdout:4/148: dread f3 [0,4194304] 0 2024-05-09T00:07:28.533 INFO:tasks.workunit.client.1.smithi135.stdout:4/149: truncate dc/dd/f12 791683 0 2024-05-09T00:07:28.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/150: getdents dc 0 2024-05-09T00:07:28.542 INFO:tasks.workunit.client.1.smithi135.stdout:1/222: dread da/d24/f3d [0,4194304] 0 2024-05-09T00:07:28.544 INFO:tasks.workunit.client.1.smithi135.stdout:4/151: link dc/dd/l1c dc/dd/d28/l36 0 2024-05-09T00:07:28.545 INFO:tasks.workunit.client.1.smithi135.stdout:3/190: dread d8/f10 [0,4194304] 0 2024-05-09T00:07:28.546 INFO:tasks.workunit.client.1.smithi135.stdout:4/152: link dc/f34 dc/d26/d31/f37 0 2024-05-09T00:07:28.550 INFO:tasks.workunit.client.1.smithi135.stdout:4/153: chown dc/dd/d28 2683910 1 2024-05-09T00:07:28.550 INFO:tasks.workunit.client.1.smithi135.stdout:4/154: fsync dc/f25 0 2024-05-09T00:07:28.550 INFO:tasks.workunit.client.1.smithi135.stdout:4/155: fdatasync dc/dd/f17 0 2024-05-09T00:07:28.550 INFO:tasks.workunit.client.1.smithi135.stdout:4/156: write dc/dd/f1d [4947531,4288] 0 2024-05-09T00:07:28.551 INFO:tasks.workunit.client.1.smithi135.stdout:3/191: unlink d8/d13/c18 0 2024-05-09T00:07:28.551 INFO:tasks.workunit.client.1.smithi135.stdout:3/192: creat d8/d13/d1f/f43 x:0 0 0 2024-05-09T00:07:28.551 INFO:tasks.workunit.client.1.smithi135.stdout:3/193: truncate d8/f11 993634 0 2024-05-09T00:07:28.552 INFO:tasks.workunit.client.1.smithi135.stdout:3/194: mkdir d8/d1a/d44 0 2024-05-09T00:07:28.554 INFO:tasks.workunit.client.1.smithi135.stdout:5/236: sync 2024-05-09T00:07:28.558 INFO:tasks.workunit.client.1.smithi135.stdout:5/237: mknod db/d24/c4a 0 2024-05-09T00:07:28.558 INFO:tasks.workunit.client.1.smithi135.stdout:5/238: read - db/f28 zero size 2024-05-09T00:07:28.559 INFO:tasks.workunit.client.1.smithi135.stdout:5/239: creat db/d24/d2f/f4b x:0 0 0 2024-05-09T00:07:28.561 INFO:tasks.workunit.client.1.smithi135.stdout:9/155: dwrite d1/d24/d27/f22 [4194304,4194304] 0 2024-05-09T00:07:28.561 INFO:tasks.workunit.client.1.smithi135.stdout:6/231: dwrite d2/f17 [0,4194304] 0 2024-05-09T00:07:28.562 INFO:tasks.workunit.client.1.smithi135.stdout:9/156: write d1/d7/f11 [2498509,110270] 0 2024-05-09T00:07:28.562 INFO:tasks.workunit.client.1.smithi135.stdout:8/182: sync 2024-05-09T00:07:28.565 INFO:tasks.workunit.client.1.smithi135.stdout:5/240: write db/f12 [707347,101792] 0 2024-05-09T00:07:28.565 INFO:tasks.workunit.client.1.smithi135.stdout:5/241: chown db/d24/d2f/d31/f3d 29181615 1 2024-05-09T00:07:28.565 INFO:tasks.workunit.client.1.smithi135.stdout:2/214: dwrite d1/d12/f1b [0,4194304] 0 2024-05-09T00:07:28.566 INFO:tasks.workunit.client.1.smithi135.stdout:8/183: link d4/d7/d33/c34 d4/d7/de/c40 0 2024-05-09T00:07:28.568 INFO:tasks.workunit.client.1.smithi135.stdout:5/242: creat db/d24/d48/f4c x:0 0 0 2024-05-09T00:07:28.568 INFO:tasks.workunit.client.1.smithi135.stdout:3/195: rmdir d8/d13/d1f 39 2024-05-09T00:07:28.571 INFO:tasks.workunit.client.1.smithi135.stdout:0/187: dwrite d3/dd/f26 [0,4194304] 0 2024-05-09T00:07:28.571 INFO:tasks.workunit.client.1.smithi135.stdout:0/188: chown d3/d1c 42 1 2024-05-09T00:07:28.571 INFO:tasks.workunit.client.1.smithi135.stdout:0/189: chown d3/d1c/l25 64858310 1 2024-05-09T00:07:28.571 INFO:tasks.workunit.client.1.smithi135.stdout:0/190: readlink d3/l17 0 2024-05-09T00:07:28.572 INFO:tasks.workunit.client.1.smithi135.stdout:4/157: dwrite dc/dd/f12 [0,4194304] 0 2024-05-09T00:07:28.572 INFO:tasks.workunit.client.1.smithi135.stdout:4/158: truncate dc/f24 771837 0 2024-05-09T00:07:28.572 INFO:tasks.workunit.client.1.smithi135.stdout:2/215: creat d1/d12/d21/f42 x:0 0 0 2024-05-09T00:07:28.573 INFO:tasks.workunit.client.1.smithi135.stdout:8/184: creat d4/f41 x:0 0 0 2024-05-09T00:07:28.575 INFO:tasks.workunit.client.1.smithi135.stdout:5/243: link db/d24/d2f/f4b db/d3f/f4d 0 2024-05-09T00:07:28.575 INFO:tasks.workunit.client.1.smithi135.stdout:5/244: readlink l3 0 2024-05-09T00:07:28.577 INFO:tasks.workunit.client.1.smithi135.stdout:0/191: getdents d3 0 2024-05-09T00:07:28.580 INFO:tasks.workunit.client.1.smithi135.stdout:8/185: truncate d4/d7/de/f35 3018664 0 2024-05-09T00:07:28.580 INFO:tasks.workunit.client.1.smithi135.stdout:3/196: dread d8/f17 [0,4194304] 0 2024-05-09T00:07:28.580 INFO:tasks.workunit.client.1.smithi135.stdout:3/197: dread - d8/d13/d1f/d40/f3d zero size 2024-05-09T00:07:28.582 INFO:tasks.workunit.client.1.smithi135.stdout:8/186: mkdir d4/d7/de/d42 0 2024-05-09T00:07:28.582 INFO:tasks.workunit.client.1.smithi135.stdout:6/232: dwrite d2/f17 [0,4194304] 0 2024-05-09T00:07:28.583 INFO:tasks.workunit.client.1.smithi135.stdout:8/187: symlink d4/d7/d33/d39/l43 0 2024-05-09T00:07:28.583 INFO:tasks.workunit.client.1.smithi135.stdout:8/188: readlink d4/d22/l36 0 2024-05-09T00:07:28.583 INFO:tasks.workunit.client.1.smithi135.stdout:4/159: dread dc/d26/f2a [0,4194304] 0 2024-05-09T00:07:28.583 INFO:tasks.workunit.client.1.smithi135.stdout:6/233: creat d2/da/d26/f55 x:0 0 0 2024-05-09T00:07:28.584 INFO:tasks.workunit.client.1.smithi135.stdout:6/234: mknod d2/da/d49/c56 0 2024-05-09T00:07:28.588 INFO:tasks.workunit.client.1.smithi135.stdout:5/245: rmdir db/d3f 39 2024-05-09T00:07:28.592 INFO:tasks.workunit.client.1.smithi135.stdout:5/246: rmdir db/d3f 39 2024-05-09T00:07:28.594 INFO:tasks.workunit.client.1.smithi135.stdout:6/235: dread d2/fd [0,4194304] 0 2024-05-09T00:07:28.595 INFO:tasks.workunit.client.1.smithi135.stdout:3/198: dread f0 [4194304,4194304] 0 2024-05-09T00:07:28.596 INFO:tasks.workunit.client.1.smithi135.stdout:8/189: dread d4/f2b [0,4194304] 0 2024-05-09T00:07:28.597 INFO:tasks.workunit.client.1.smithi135.stdout:5/247: symlink db/d24/d2f/l4e 0 2024-05-09T00:07:28.597 INFO:tasks.workunit.client.1.smithi135.stdout:3/199: write d8/d13/f1e [68841,25425] 0 2024-05-09T00:07:28.599 INFO:tasks.workunit.client.1.smithi135.stdout:6/236: unlink d2/da/d1d/f27 0 2024-05-09T00:07:28.599 INFO:tasks.workunit.client.1.smithi135.stdout:6/237: chown d2/f2c 190460085 1 2024-05-09T00:07:28.599 INFO:tasks.workunit.client.1.smithi135.stdout:0/192: dwrite d3/dd/f2f [0,4194304] 0 2024-05-09T00:07:28.601 INFO:tasks.workunit.client.1.smithi135.stdout:8/190: write d4/f5 [3309786,23654] 0 2024-05-09T00:07:28.601 INFO:tasks.workunit.client.1.smithi135.stdout:3/200: unlink d8/d1a/d24/f2c 0 2024-05-09T00:07:28.602 INFO:tasks.workunit.client.1.smithi135.stdout:6/238: mkdir d2/da/d26/d57 0 2024-05-09T00:07:28.602 INFO:tasks.workunit.client.1.smithi135.stdout:6/239: write d2/fd [2181462,67113] 0 2024-05-09T00:07:28.602 INFO:tasks.workunit.client.1.smithi135.stdout:6/240: stat d2/d1a/f24 0 2024-05-09T00:07:28.602 INFO:tasks.workunit.client.1.smithi135.stdout:6/241: truncate d2/d20/d3f/f44 1034473 0 2024-05-09T00:07:28.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/193: rmdir d3 39 2024-05-09T00:07:28.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/194: write d3/f28 [919811,1216] 0 2024-05-09T00:07:28.604 INFO:tasks.workunit.client.1.smithi135.stdout:8/191: mknod d4/d7/de/c44 0 2024-05-09T00:07:28.605 INFO:tasks.workunit.client.1.smithi135.stdout:3/201: symlink d8/d13/d1f/d40/l45 0 2024-05-09T00:07:28.606 INFO:tasks.workunit.client.1.smithi135.stdout:6/242: creat d2/f58 x:0 0 0 2024-05-09T00:07:28.607 INFO:tasks.workunit.client.1.smithi135.stdout:6/243: getdents d2/da/d26/d57 0 2024-05-09T00:07:28.607 INFO:tasks.workunit.client.1.smithi135.stdout:6/244: truncate d2/d20/d3f/f44 1148751 0 2024-05-09T00:07:28.607 INFO:tasks.workunit.client.1.smithi135.stdout:6/245: chown d2/d20 468846 1 2024-05-09T00:07:28.607 INFO:tasks.workunit.client.1.smithi135.stdout:0/195: stat d3/l2b 0 2024-05-09T00:07:28.607 INFO:tasks.workunit.client.1.smithi135.stdout:3/202: creat d8/d13/f46 x:0 0 0 2024-05-09T00:07:28.608 INFO:tasks.workunit.client.1.smithi135.stdout:6/246: mkdir d2/da/d26/d57/d59 0 2024-05-09T00:07:28.609 INFO:tasks.workunit.client.1.smithi135.stdout:6/247: write d2/da/fb [3127904,38812] 0 2024-05-09T00:07:28.610 INFO:tasks.workunit.client.1.smithi135.stdout:3/203: mkdir d8/d13/d1f/d40/d47 0 2024-05-09T00:07:28.611 INFO:tasks.workunit.client.1.smithi135.stdout:8/192: dread d4/f2c [0,4194304] 0 2024-05-09T00:07:28.611 INFO:tasks.workunit.client.1.smithi135.stdout:8/193: chown d4/f20 0 1 2024-05-09T00:07:28.611 INFO:tasks.workunit.client.1.smithi135.stdout:8/194: truncate d4/d22/f31 5011114 0 2024-05-09T00:07:28.611 INFO:tasks.workunit.client.1.smithi135.stdout:8/195: chown d4/d22/l36 62 1 2024-05-09T00:07:28.611 INFO:tasks.workunit.client.1.smithi135.stdout:3/204: creat d8/d13/d1f/f48 x:0 0 0 2024-05-09T00:07:28.611 INFO:tasks.workunit.client.1.smithi135.stdout:3/205: chown d8/d13/d1f/d40/c41 4061672 1 2024-05-09T00:07:28.612 INFO:tasks.workunit.client.1.smithi135.stdout:3/206: write d8/f39 [4446469,117076] 0 2024-05-09T00:07:28.612 INFO:tasks.workunit.client.1.smithi135.stdout:4/160: dwrite dc/f27 [0,4194304] 0 2024-05-09T00:07:28.613 INFO:tasks.workunit.client.1.smithi135.stdout:9/157: dwrite d1/d7/f11 [0,4194304] 0 2024-05-09T00:07:28.614 INFO:tasks.workunit.client.1.smithi135.stdout:5/248: dwrite db/f1a [0,4194304] 0 2024-05-09T00:07:28.616 INFO:tasks.workunit.client.1.smithi135.stdout:4/161: mkdir dc/dd/d28/d38 0 2024-05-09T00:07:28.617 INFO:tasks.workunit.client.1.smithi135.stdout:4/162: write dc/d26/d31/f37 [2597476,11481] 0 2024-05-09T00:07:28.620 INFO:tasks.workunit.client.1.smithi135.stdout:9/158: rename d1/d7/d20/d23/l26 to d1/d1a/l2b 0 2024-05-09T00:07:28.620 INFO:tasks.workunit.client.1.smithi135.stdout:9/159: dread - d1/d7/f28 zero size 2024-05-09T00:07:28.623 INFO:tasks.workunit.client.1.smithi135.stdout:5/249: mkdir db/d24/d48/d4f 0 2024-05-09T00:07:28.625 INFO:tasks.workunit.client.1.smithi135.stdout:8/196: dread d4/d8/fb [4194304,4194304] 0 2024-05-09T00:07:28.625 INFO:tasks.workunit.client.1.smithi135.stdout:8/197: chown d4 1 1 2024-05-09T00:07:28.625 INFO:tasks.workunit.client.1.smithi135.stdout:5/250: symlink db/d24/l50 0 2024-05-09T00:07:28.627 INFO:tasks.workunit.client.1.smithi135.stdout:5/251: creat db/d24/d32/f51 x:0 0 0 2024-05-09T00:07:28.628 INFO:tasks.workunit.client.1.smithi135.stdout:9/160: dread d1/d1a/fb [0,4194304] 0 2024-05-09T00:07:28.629 INFO:tasks.workunit.client.1.smithi135.stdout:5/252: rmdir db/d24/d48/d4f 0 2024-05-09T00:07:28.632 INFO:tasks.workunit.client.1.smithi135.stdout:0/196: truncate d3/dd/f2f 342126 0 2024-05-09T00:07:28.632 INFO:tasks.workunit.client.1.smithi135.stdout:0/197: chown d3/d1c/l25 318584 1 2024-05-09T00:07:28.633 INFO:tasks.workunit.client.1.smithi135.stdout:5/253: mkdir db/d52 0 2024-05-09T00:07:28.633 INFO:tasks.workunit.client.1.smithi135.stdout:0/198: creat d3/dd/f32 x:0 0 0 2024-05-09T00:07:28.636 INFO:tasks.workunit.client.1.smithi135.stdout:6/248: dwrite d2/d20/d3f/f52 [0,4194304] 0 2024-05-09T00:07:28.636 INFO:tasks.workunit.client.1.smithi135.stdout:4/163: dwrite f7 [0,4194304] 0 2024-05-09T00:07:28.636 INFO:tasks.workunit.client.1.smithi135.stdout:6/249: stat d2/d20/d2e/d3d/l43 0 2024-05-09T00:07:28.636 INFO:tasks.workunit.client.1.smithi135.stdout:4/164: fdatasync dc/f1e 0 2024-05-09T00:07:28.636 INFO:tasks.workunit.client.1.smithi135.stdout:4/165: stat dc/dd/f15 0 2024-05-09T00:07:28.637 INFO:tasks.workunit.client.1.smithi135.stdout:8/198: write d4/f5 [1648236,84889] 0 2024-05-09T00:07:28.639 INFO:tasks.workunit.client.1.smithi135.stdout:8/199: dread d4/d22/f27 [0,4194304] 0 2024-05-09T00:07:28.639 INFO:tasks.workunit.client.1.smithi135.stdout:8/200: fdatasync d4/d7/de/f14 0 2024-05-09T00:07:28.641 INFO:tasks.workunit.client.1.smithi135.stdout:6/250: creat d2/da/d49/f5a x:0 0 0 2024-05-09T00:07:28.643 INFO:tasks.workunit.client.1.smithi135.stdout:8/201: mkdir d4/d7/de/d45 0 2024-05-09T00:07:28.643 INFO:tasks.workunit.client.1.smithi135.stdout:8/202: readlink d4/d7/l3f 0 2024-05-09T00:07:28.645 INFO:tasks.workunit.client.1.smithi135.stdout:8/203: creat d4/f46 x:0 0 0 2024-05-09T00:07:28.647 INFO:tasks.workunit.client.1.smithi135.stdout:8/204: creat d4/d7/d33/d39/f47 x:0 0 0 2024-05-09T00:07:28.650 INFO:tasks.workunit.client.1.smithi135.stdout:9/161: rename d1/d7 to d1/d1a/d2c 0 2024-05-09T00:07:28.651 INFO:tasks.workunit.client.1.smithi135.stdout:9/162: truncate d1/d1a/d2c/f28 175055 0 2024-05-09T00:07:28.651 INFO:tasks.workunit.client.1.smithi135.stdout:9/163: fdatasync d1/d1a/d2c/f28 0 2024-05-09T00:07:28.652 INFO:tasks.workunit.client.1.smithi135.stdout:5/254: rename db/d3f/l42 to db/d24/d2f/l53 0 2024-05-09T00:07:28.652 INFO:tasks.workunit.client.1.smithi135.stdout:5/255: truncate db/d24/d32/f47 109105 0 2024-05-09T00:07:28.654 INFO:tasks.workunit.client.1.smithi135.stdout:4/166: rename dc/dd/d28 to dc/d26/d31/d32/d39 0 2024-05-09T00:07:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:5/256: write f4 [2894964,78635] 0 2024-05-09T00:07:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:6/251: dread d2/da/f3b [0,4194304] 0 2024-05-09T00:07:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:6/252: write d2/d20/d2e/d3d/f48 [86758,30910] 0 2024-05-09T00:07:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:3/207: dwrite d8/d13/f1e [0,4194304] 0 2024-05-09T00:07:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:7/198: sync 2024-05-09T00:07:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:7/199: chown db/f30 30 1 2024-05-09T00:07:28.659 INFO:tasks.workunit.client.1.smithi135.stdout:6/253: read d2/fc [2983969,22257] 0 2024-05-09T00:07:28.659 INFO:tasks.workunit.client.1.smithi135.stdout:6/254: stat d2/da/c21 0 2024-05-09T00:07:28.662 INFO:tasks.workunit.client.1.smithi135.stdout:3/208: link d8/d13/f19 d8/d13/f49 0 2024-05-09T00:07:28.662 INFO:tasks.workunit.client.1.smithi135.stdout:3/209: fdatasync d8/d13/f22 0 2024-05-09T00:07:28.665 INFO:tasks.workunit.client.1.smithi135.stdout:7/200: symlink db/d21/l44 0 2024-05-09T00:07:28.667 INFO:tasks.workunit.client.1.smithi135.stdout:3/210: creat d8/d13/d1f/d40/d47/f4a x:0 0 0 2024-05-09T00:07:28.669 INFO:tasks.workunit.client.1.smithi135.stdout:9/164: dwrite d1/f13 [0,4194304] 0 2024-05-09T00:07:28.669 INFO:tasks.workunit.client.1.smithi135.stdout:7/201: link db/d13/l23 db/d13/l45 0 2024-05-09T00:07:28.670 INFO:tasks.workunit.client.1.smithi135.stdout:3/211: mkdir d8/d1a/d44/d4b 0 2024-05-09T00:07:28.670 INFO:tasks.workunit.client.1.smithi135.stdout:3/212: fdatasync f0 0 2024-05-09T00:07:28.673 INFO:tasks.workunit.client.1.smithi135.stdout:8/205: fsync d4/d7/d33/d39/f47 0 2024-05-09T00:07:28.673 INFO:tasks.workunit.client.1.smithi135.stdout:8/206: dread - d4/d7/d33/d39/f47 zero size 2024-05-09T00:07:28.674 INFO:tasks.workunit.client.1.smithi135.stdout:9/165: mkdir d1/d1a/d2c/d2d 0 2024-05-09T00:07:28.675 INFO:tasks.workunit.client.1.smithi135.stdout:3/213: symlink d8/d13/l4c 0 2024-05-09T00:07:28.678 INFO:tasks.workunit.client.1.smithi135.stdout:9/166: symlink d1/d1a/d2c/d20/l2e 0 2024-05-09T00:07:28.680 INFO:tasks.workunit.client.1.smithi135.stdout:4/167: dwrite dc/f1e [0,4194304] 0 2024-05-09T00:07:28.680 INFO:tasks.workunit.client.1.smithi135.stdout:4/168: fsync dc/dd/f22 0 2024-05-09T00:07:28.680 INFO:tasks.workunit.client.1.smithi135.stdout:4/169: fsync dc/f1e 0 2024-05-09T00:07:28.684 INFO:tasks.workunit.client.1.smithi135.stdout:1/223: sync 2024-05-09T00:07:28.684 INFO:tasks.workunit.client.1.smithi135.stdout:4/170: symlink dc/d26/d31/l3a 0 2024-05-09T00:07:28.695 INFO:tasks.workunit.client.1.smithi135.stdout:8/207: dwrite d4/f20 [0,4194304] 0 2024-05-09T00:07:28.695 INFO:tasks.workunit.client.1.smithi135.stdout:7/202: dwrite db/f16 [0,4194304] 0 2024-05-09T00:07:28.696 INFO:tasks.workunit.client.1.smithi135.stdout:7/203: write db/dd/f35 [861080,55888] 0 2024-05-09T00:07:28.696 INFO:tasks.workunit.client.1.smithi135.stdout:9/167: dread d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:28.696 INFO:tasks.workunit.client.1.smithi135.stdout:3/214: dwrite d8/d13/f22 [0,4194304] 0 2024-05-09T00:07:28.698 INFO:tasks.workunit.client.1.smithi135.stdout:8/208: dread d4/d7/de/f14 [0,4194304] 0 2024-05-09T00:07:28.698 INFO:tasks.workunit.client.1.smithi135.stdout:7/204: unlink db/d13/f20 0 2024-05-09T00:07:28.699 INFO:tasks.workunit.client.1.smithi135.stdout:7/205: readlink db/d13/l26 0 2024-05-09T00:07:28.699 INFO:tasks.workunit.client.1.smithi135.stdout:7/206: fdatasync db/f16 0 2024-05-09T00:07:28.699 INFO:tasks.workunit.client.1.smithi135.stdout:9/168: truncate d1/d1a/fb 2100500 0 2024-05-09T00:07:28.700 INFO:tasks.workunit.client.1.smithi135.stdout:7/207: fsync db/dd/f35 0 2024-05-09T00:07:28.700 INFO:tasks.workunit.client.1.smithi135.stdout:7/208: write db/d1e/f36 [508155,107920] 0 2024-05-09T00:07:28.701 INFO:tasks.workunit.client.1.smithi135.stdout:7/209: write db/dd/f35 [29935,86135] 0 2024-05-09T00:07:28.701 INFO:tasks.workunit.client.1.smithi135.stdout:7/210: dread - db/f42 zero size 2024-05-09T00:07:28.705 INFO:tasks.workunit.client.1.smithi135.stdout:4/171: dread dc/dd/f11 [0,4194304] 0 2024-05-09T00:07:28.705 INFO:tasks.workunit.client.1.smithi135.stdout:9/169: rename d1/d1a/fc to d1/d1a/d2c/d20/f2f 0 2024-05-09T00:07:28.705 INFO:tasks.workunit.client.1.smithi135.stdout:9/170: chown d1/d1a/d2c/f28 205 1 2024-05-09T00:07:28.708 INFO:tasks.workunit.client.1.smithi135.stdout:3/215: dread d8/f42 [0,4194304] 0 2024-05-09T00:07:28.708 INFO:tasks.workunit.client.1.smithi135.stdout:3/216: dread - d8/d1a/f28 zero size 2024-05-09T00:07:28.708 INFO:tasks.workunit.client.1.smithi135.stdout:3/217: dread - d8/d13/f3b zero size 2024-05-09T00:07:28.713 INFO:tasks.workunit.client.1.smithi135.stdout:9/171: rmdir d1/d1a/d2c/d20/d23 0 2024-05-09T00:07:28.713 INFO:tasks.workunit.client.1.smithi135.stdout:9/172: chown d1/d1a/d2c/d20/l2e 268 1 2024-05-09T00:07:28.723 INFO:tasks.workunit.client.1.smithi135.stdout:1/224: dwrite da/d24/f3d [0,4194304] 0 2024-05-09T00:07:28.724 INFO:tasks.workunit.client.1.smithi135.stdout:1/225: symlink da/l54 0 2024-05-09T00:07:28.731 INFO:tasks.workunit.client.1.smithi135.stdout:4/172: dwrite dc/f34 [0,4194304] 0 2024-05-09T00:07:28.733 INFO:tasks.workunit.client.1.smithi135.stdout:4/173: symlink dc/d26/d31/d32/d39/l3b 0 2024-05-09T00:07:28.735 INFO:tasks.workunit.client.1.smithi135.stdout:7/211: dwrite f8 [0,4194304] 0 2024-05-09T00:07:28.735 INFO:tasks.workunit.client.1.smithi135.stdout:7/212: mkdir db/d1e/d46 0 2024-05-09T00:07:28.736 INFO:tasks.workunit.client.1.smithi135.stdout:1/226: dread f4 [0,4194304] 0 2024-05-09T00:07:28.736 INFO:tasks.workunit.client.1.smithi135.stdout:3/218: truncate d8/d13/f22 3898267 0 2024-05-09T00:07:28.738 INFO:tasks.workunit.client.1.smithi135.stdout:1/227: symlink da/db/l55 0 2024-05-09T00:07:28.738 INFO:tasks.workunit.client.1.smithi135.stdout:1/228: fdatasync da/db/d16/f2f 0 2024-05-09T00:07:28.739 INFO:tasks.workunit.client.1.smithi135.stdout:1/229: write da/d14/f3f [1427012,28113] 0 2024-05-09T00:07:28.739 INFO:tasks.workunit.client.1.smithi135.stdout:1/230: write da/db/f2a [1249818,86966] 0 2024-05-09T00:07:28.739 INFO:tasks.workunit.client.1.smithi135.stdout:1/231: chown f9 692278 1 2024-05-09T00:07:28.740 INFO:tasks.workunit.client.1.smithi135.stdout:3/219: creat d8/d13/d1f/d40/d47/f4d x:0 0 0 2024-05-09T00:07:28.743 INFO:tasks.workunit.client.1.smithi135.stdout:1/232: dread da/f1f [0,4194304] 0 2024-05-09T00:07:28.745 INFO:tasks.workunit.client.1.smithi135.stdout:7/213: dread db/d13/f2a [0,4194304] 0 2024-05-09T00:07:28.745 INFO:tasks.workunit.client.1.smithi135.stdout:1/233: link da/d14/f1b da/d24/d27/d33/d52/f56 0 2024-05-09T00:07:28.745 INFO:tasks.workunit.client.1.smithi135.stdout:1/234: fdatasync da/d24/d27/d33/f39 0 2024-05-09T00:07:28.746 INFO:tasks.workunit.client.1.smithi135.stdout:7/214: dread db/ff [0,4194304] 0 2024-05-09T00:07:28.746 INFO:tasks.workunit.client.1.smithi135.stdout:7/215: dread - db/d1e/d3a/f3b zero size 2024-05-09T00:07:28.747 INFO:tasks.workunit.client.1.smithi135.stdout:7/216: write db/f37 [423266,10062] 0 2024-05-09T00:07:28.747 INFO:tasks.workunit.client.1.smithi135.stdout:1/235: mknod da/d24/d27/d33/d48/c57 0 2024-05-09T00:07:28.748 INFO:tasks.workunit.client.1.smithi135.stdout:7/217: rename db/fc to db/f47 0 2024-05-09T00:07:28.748 INFO:tasks.workunit.client.1.smithi135.stdout:7/218: truncate db/dd/f35 1716444 0 2024-05-09T00:07:28.749 INFO:tasks.workunit.client.1.smithi135.stdout:7/219: mknod db/d1e/d3a/c48 0 2024-05-09T00:07:28.751 INFO:tasks.workunit.client.1.smithi135.stdout:4/174: truncate dc/d26/d31/f37 3264205 0 2024-05-09T00:07:28.753 INFO:tasks.workunit.client.1.smithi135.stdout:1/236: dread da/f13 [0,4194304] 0 2024-05-09T00:07:28.753 INFO:tasks.workunit.client.1.smithi135.stdout:1/237: chown da/db/d16/f2f 0 1 2024-05-09T00:07:28.754 INFO:tasks.workunit.client.1.smithi135.stdout:2/216: sync 2024-05-09T00:07:28.757 INFO:tasks.workunit.client.1.smithi135.stdout:7/220: symlink db/dd/l49 0 2024-05-09T00:07:28.757 INFO:tasks.workunit.client.1.smithi135.stdout:7/221: chown db/d1e/d46 384045190 1 2024-05-09T00:07:28.757 INFO:tasks.workunit.client.1.smithi135.stdout:3/220: rmdir d8 39 2024-05-09T00:07:28.759 INFO:tasks.workunit.client.1.smithi135.stdout:4/175: rename dc/dd/f12 to dc/d26/d31/f3c 0 2024-05-09T00:07:28.759 INFO:tasks.workunit.client.1.smithi135.stdout:4/176: truncate dc/f2d 429213 0 2024-05-09T00:07:28.760 INFO:tasks.workunit.client.1.smithi135.stdout:1/238: creat da/d14/d20/d38/f58 x:0 0 0 2024-05-09T00:07:28.761 INFO:tasks.workunit.client.1.smithi135.stdout:2/217: creat d1/d22/f43 x:0 0 0 2024-05-09T00:07:28.762 INFO:tasks.workunit.client.1.smithi135.stdout:3/221: creat d8/d13/d1f/f4e x:0 0 0 2024-05-09T00:07:28.764 INFO:tasks.workunit.client.1.smithi135.stdout:7/222: dread db/dd/d33/f3d [0,4194304] 0 2024-05-09T00:07:28.764 INFO:tasks.workunit.client.1.smithi135.stdout:7/223: write db/f28 [5161734,109496] 0 2024-05-09T00:07:28.764 INFO:tasks.workunit.client.1.smithi135.stdout:4/177: rename dc/dd/fe to dc/dd/f3d 0 2024-05-09T00:07:28.764 INFO:tasks.workunit.client.1.smithi135.stdout:4/178: write dc/dd/f19 [1202549,99330] 0 2024-05-09T00:07:28.765 INFO:tasks.workunit.client.1.smithi135.stdout:1/239: rmdir da/d24/d27/d33/d48 39 2024-05-09T00:07:28.767 INFO:tasks.workunit.client.1.smithi135.stdout:2/218: rename d1/c1e to d1/d12/d20/d3b/c44 0 2024-05-09T00:07:28.768 INFO:tasks.workunit.client.1.smithi135.stdout:3/222: mkdir d8/d1a/d44/d4f 0 2024-05-09T00:07:28.770 INFO:tasks.workunit.client.1.smithi135.stdout:0/199: sync 2024-05-09T00:07:28.770 INFO:tasks.workunit.client.1.smithi135.stdout:7/224: mknod db/d1e/d3a/d40/c4a 0 2024-05-09T00:07:28.772 INFO:tasks.workunit.client.1.smithi135.stdout:2/219: truncate d1/d12/d20/d2b/f37 1038 0 2024-05-09T00:07:28.774 INFO:tasks.workunit.client.1.smithi135.stdout:4/179: rmdir dc/d26 39 2024-05-09T00:07:28.775 INFO:tasks.workunit.client.1.smithi135.stdout:3/223: creat d8/d1a/d24/f50 x:0 0 0 2024-05-09T00:07:28.776 INFO:tasks.workunit.client.1.smithi135.stdout:0/200: creat d3/d1c/f33 x:0 0 0 2024-05-09T00:07:28.777 INFO:tasks.workunit.client.1.smithi135.stdout:7/225: truncate db/f16 1081530 0 2024-05-09T00:07:28.779 INFO:tasks.workunit.client.1.smithi135.stdout:2/220: rename d1/d12/f36 to d1/d12/d20/d3b/d40/f45 0 2024-05-09T00:07:28.780 INFO:tasks.workunit.client.1.smithi135.stdout:4/180: getdents dc/dd/d1f 0 2024-05-09T00:07:28.783 INFO:tasks.workunit.client.1.smithi135.stdout:0/201: rename d3/f28 to d3/f34 0 2024-05-09T00:07:28.784 INFO:tasks.workunit.client.1.smithi135.stdout:7/226: chown db/dd/l11 0 1 2024-05-09T00:07:28.784 INFO:tasks.workunit.client.1.smithi135.stdout:3/224: dread d8/d13/f19 [0,4194304] 0 2024-05-09T00:07:28.787 INFO:tasks.workunit.client.1.smithi135.stdout:8/209: sync 2024-05-09T00:07:28.787 INFO:tasks.workunit.client.1.smithi135.stdout:6/255: sync 2024-05-09T00:07:28.787 INFO:tasks.workunit.client.1.smithi135.stdout:9/173: sync 2024-05-09T00:07:28.787 INFO:tasks.workunit.client.1.smithi135.stdout:5/257: sync 2024-05-09T00:07:28.787 INFO:tasks.workunit.client.1.smithi135.stdout:4/181: creat dc/d26/d31/f3e x:0 0 0 2024-05-09T00:07:28.788 INFO:tasks.workunit.client.1.smithi135.stdout:4/182: write dc/f2d [348512,17280] 0 2024-05-09T00:07:28.788 INFO:tasks.workunit.client.1.smithi135.stdout:4/183: readlink dc/d26/d31/d32/d39/l3b 0 2024-05-09T00:07:28.788 INFO:tasks.workunit.client.1.smithi135.stdout:4/184: stat dc/dd/l23 0 2024-05-09T00:07:28.788 INFO:tasks.workunit.client.1.smithi135.stdout:4/185: dread - dc/f25 zero size 2024-05-09T00:07:28.789 INFO:tasks.workunit.client.1.smithi135.stdout:9/174: dread d1/d1a/fb [0,4194304] 0 2024-05-09T00:07:28.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/202: rename d3/d1c/l25 to d3/dd/l35 0 2024-05-09T00:07:28.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/203: fsync d3/dd/f2f 0 2024-05-09T00:07:28.790 INFO:tasks.workunit.client.1.smithi135.stdout:0/204: fdatasync d3/dd/f22 0 2024-05-09T00:07:28.790 INFO:tasks.workunit.client.1.smithi135.stdout:9/175: write d1/d24/d27/f22 [5512588,92131] 0 2024-05-09T00:07:28.791 INFO:tasks.workunit.client.1.smithi135.stdout:7/227: truncate db/d13/f24 83433 0 2024-05-09T00:07:28.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/256: rmdir d2/d20/d2e/d40 0 2024-05-09T00:07:28.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/257: fdatasync d2/d20/f36 0 2024-05-09T00:07:28.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/258: readlink d2/da/d26/l34 0 2024-05-09T00:07:28.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/259: fdatasync d2/f25 0 2024-05-09T00:07:28.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/260: chown d2/d1a/l2b 205 1 2024-05-09T00:07:28.796 INFO:tasks.workunit.client.1.smithi135.stdout:0/205: write d3/f16 [1902400,36247] 0 2024-05-09T00:07:28.797 INFO:tasks.workunit.client.1.smithi135.stdout:5/258: symlink db/d52/l54 0 2024-05-09T00:07:28.797 INFO:tasks.workunit.client.1.smithi135.stdout:5/259: stat db/d24/d2f/f49 0 2024-05-09T00:07:28.797 INFO:tasks.workunit.client.1.smithi135.stdout:3/225: rmdir d8/d1a/d24 39 2024-05-09T00:07:28.801 INFO:tasks.workunit.client.1.smithi135.stdout:2/221: dwrite d1/d22/f43 [0,4194304] 0 2024-05-09T00:07:28.801 INFO:tasks.workunit.client.1.smithi135.stdout:2/222: chown d1/c2a 25 1 2024-05-09T00:07:28.802 INFO:tasks.workunit.client.1.smithi135.stdout:2/223: write d1/fd [31802,13193] 0 2024-05-09T00:07:28.804 INFO:tasks.workunit.client.1.smithi135.stdout:8/210: rename d4/f5 to d4/d7/d33/d39/f48 0 2024-05-09T00:07:28.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/176: rmdir d1/d24 39 2024-05-09T00:07:28.805 INFO:tasks.workunit.client.1.smithi135.stdout:6/261: creat d2/da/d49/f5b x:0 0 0 2024-05-09T00:07:28.805 INFO:tasks.workunit.client.1.smithi135.stdout:0/206: creat d3/d1c/f36 x:0 0 0 2024-05-09T00:07:28.805 INFO:tasks.workunit.client.1.smithi135.stdout:0/207: write d3/dd/f32 [767827,113813] 0 2024-05-09T00:07:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:5/260: creat db/d24/d48/f55 x:0 0 0 2024-05-09T00:07:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:5/261: fsync db/f2e 0 2024-05-09T00:07:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:5/262: stat db/d24/d2f/f4b 0 2024-05-09T00:07:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:3/226: mkdir d8/d13/d51 0 2024-05-09T00:07:28.819 INFO:tasks.workunit.client.1.smithi135.stdout:2/224: link d1/d22/f3d d1/d12/d20/f46 0 2024-05-09T00:07:28.819 INFO:tasks.workunit.client.1.smithi135.stdout:2/225: write d1/d12/d20/d3b/d40/f45 [239110,41702] 0 2024-05-09T00:07:28.822 INFO:tasks.workunit.client.1.smithi135.stdout:0/208: dread d3/f16 [0,4194304] 0 2024-05-09T00:07:28.822 INFO:tasks.workunit.client.1.smithi135.stdout:0/209: write d3/dd/f2f [1111617,88191] 0 2024-05-09T00:07:28.822 INFO:tasks.workunit.client.1.smithi135.stdout:0/210: stat d3/f16 0 2024-05-09T00:07:28.822 INFO:tasks.workunit.client.1.smithi135.stdout:4/186: rename dc/d26/d31/f37 to dc/dd/f3f 0 2024-05-09T00:07:28.823 INFO:tasks.workunit.client.1.smithi135.stdout:6/262: truncate d2/da/d26/f3c 1017724 0 2024-05-09T00:07:28.825 INFO:tasks.workunit.client.1.smithi135.stdout:4/187: write dc/dd/f3f [197820,71865] 0 2024-05-09T00:07:28.825 INFO:tasks.workunit.client.1.smithi135.stdout:5/263: rmdir db/d24/d32 39 2024-05-09T00:07:28.825 INFO:tasks.workunit.client.1.smithi135.stdout:5/264: dread - db/d24/d32/f44 zero size 2024-05-09T00:07:28.825 INFO:tasks.workunit.client.1.smithi135.stdout:9/177: dwrite d1/d1a/d2c/f11 [0,4194304] 0 2024-05-09T00:07:28.825 INFO:tasks.workunit.client.1.smithi135.stdout:9/178: stat d1/d24/l25 0 2024-05-09T00:07:28.826 INFO:tasks.workunit.client.1.smithi135.stdout:8/211: dwrite d4/d8/fb [4194304,4194304] 0 2024-05-09T00:07:28.827 INFO:tasks.workunit.client.1.smithi135.stdout:3/227: mkdir d8/d13/d1f/d40/d52 0 2024-05-09T00:07:28.827 INFO:tasks.workunit.client.1.smithi135.stdout:3/228: readlink d8/d13/l2b 0 2024-05-09T00:07:28.827 INFO:tasks.workunit.client.1.smithi135.stdout:8/212: write d4/d7/fc [2465513,63584] 0 2024-05-09T00:07:28.827 INFO:tasks.workunit.client.1.smithi135.stdout:8/213: write d4/f41 [864695,93097] 0 2024-05-09T00:07:28.828 INFO:tasks.workunit.client.1.smithi135.stdout:8/214: dread d4/f2b [4194304,4194304] 0 2024-05-09T00:07:28.829 INFO:tasks.workunit.client.1.smithi135.stdout:2/226: creat d1/f47 x:0 0 0 2024-05-09T00:07:28.831 INFO:tasks.workunit.client.1.smithi135.stdout:0/211: symlink d3/d1c/d29/l37 0 2024-05-09T00:07:28.831 INFO:tasks.workunit.client.1.smithi135.stdout:0/212: write d3/d1c/f33 [768993,86810] 0 2024-05-09T00:07:28.834 INFO:tasks.workunit.client.1.smithi135.stdout:6/263: symlink d2/d20/l5c 0 2024-05-09T00:07:28.834 INFO:tasks.workunit.client.1.smithi135.stdout:5/265: symlink db/d24/d2f/l56 0 2024-05-09T00:07:28.836 INFO:tasks.workunit.client.1.smithi135.stdout:3/229: mkdir d8/d1a/d44/d4f/d53 0 2024-05-09T00:07:28.837 INFO:tasks.workunit.client.1.smithi135.stdout:1/240: sync 2024-05-09T00:07:28.838 INFO:tasks.workunit.client.1.smithi135.stdout:2/227: creat d1/d12/f48 x:0 0 0 2024-05-09T00:07:28.839 INFO:tasks.workunit.client.1.smithi135.stdout:4/188: dread dc/f34 [0,4194304] 0 2024-05-09T00:07:28.839 INFO:tasks.workunit.client.1.smithi135.stdout:0/213: creat d3/dd/d2c/f38 x:0 0 0 2024-05-09T00:07:28.841 INFO:tasks.workunit.client.1.smithi135.stdout:8/215: fdatasync d4/d7/fc 0 2024-05-09T00:07:28.841 INFO:tasks.workunit.client.1.smithi135.stdout:8/216: fsync d4/d7/d33/d39/f48 0 2024-05-09T00:07:28.841 INFO:tasks.workunit.client.1.smithi135.stdout:5/266: creat db/d3f/f57 x:0 0 0 2024-05-09T00:07:28.843 INFO:tasks.workunit.client.1.smithi135.stdout:9/179: dwrite d1/d1a/d2c/d20/f2f [4194304,4194304] 0 2024-05-09T00:07:28.844 INFO:tasks.workunit.client.1.smithi135.stdout:3/230: rename d8/fc to d8/d13/d1f/d40/d52/f54 0 2024-05-09T00:07:28.846 INFO:tasks.workunit.client.1.smithi135.stdout:2/228: symlink d1/d12/d20/l49 0 2024-05-09T00:07:28.849 INFO:tasks.workunit.client.1.smithi135.stdout:0/214: symlink d3/dd/d2c/l39 0 2024-05-09T00:07:28.851 INFO:tasks.workunit.client.1.smithi135.stdout:8/217: symlink d4/d7/d2a/l49 0 2024-05-09T00:07:28.852 INFO:tasks.workunit.client.1.smithi135.stdout:8/218: chown d4/d22/l38 113311103 1 2024-05-09T00:07:28.855 INFO:tasks.workunit.client.1.smithi135.stdout:5/267: creat db/d24/d32/f58 x:0 0 0 2024-05-09T00:07:28.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/241: rename da/d24/f3d to da/d24/d27/d33/d36/f59 0 2024-05-09T00:07:28.866 INFO:tasks.workunit.client.1.smithi135.stdout:3/231: mknod d8/d13/d1f/d40/c55 0 2024-05-09T00:07:28.867 INFO:tasks.workunit.client.1.smithi135.stdout:8/219: mkdir d4/d7/d4a 0 2024-05-09T00:07:28.869 INFO:tasks.workunit.client.1.smithi135.stdout:5/268: link l7 db/d24/l59 0 2024-05-09T00:07:28.871 INFO:tasks.workunit.client.1.smithi135.stdout:4/189: rename dc/dd/l1b to dc/d26/d31/l40 0 2024-05-09T00:07:28.872 INFO:tasks.workunit.client.1.smithi135.stdout:1/242: symlink da/db/d16/l5a 0 2024-05-09T00:07:28.874 INFO:tasks.workunit.client.1.smithi135.stdout:8/220: mknod d4/d7/de/d45/c4b 0 2024-05-09T00:07:28.874 INFO:tasks.workunit.client.1.smithi135.stdout:8/221: chown d4/d7/d33/d39/f3b 25927924 1 2024-05-09T00:07:28.874 INFO:tasks.workunit.client.1.smithi135.stdout:1/243: write da/d24/d27/d33/d36/f59 [2063143,93448] 0 2024-05-09T00:07:28.874 INFO:tasks.workunit.client.1.smithi135.stdout:1/244: truncate da/f10 543061 0 2024-05-09T00:07:28.874 INFO:tasks.workunit.client.1.smithi135.stdout:1/245: truncate da/d14/f1a 4413823 0 2024-05-09T00:07:28.876 INFO:tasks.workunit.client.1.smithi135.stdout:3/232: rename d8/d13/l2b to d8/d1a/d24/l56 0 2024-05-09T00:07:28.876 INFO:tasks.workunit.client.1.smithi135.stdout:3/233: chown d8/d13/d1f/d40/c41 1926423 1 2024-05-09T00:07:28.876 INFO:tasks.workunit.client.1.smithi135.stdout:3/234: fdatasync d8/d13/d1f/f30 0 2024-05-09T00:07:28.877 INFO:tasks.workunit.client.1.smithi135.stdout:6/264: dwrite d2/d20/d3f/f44 [0,4194304] 0 2024-05-09T00:07:28.877 INFO:tasks.workunit.client.1.smithi135.stdout:9/180: dwrite d1/d1a/d2c/f11 [0,4194304] 0 2024-05-09T00:07:28.877 INFO:tasks.workunit.client.1.smithi135.stdout:9/181: fsync d1/f2 0 2024-05-09T00:07:28.877 INFO:tasks.workunit.client.1.smithi135.stdout:2/229: dwrite d1/d22/f28 [0,4194304] 0 2024-05-09T00:07:28.877 INFO:tasks.workunit.client.1.smithi135.stdout:4/190: creat dc/d26/d31/f41 x:0 0 0 2024-05-09T00:07:28.878 INFO:tasks.workunit.client.1.smithi135.stdout:0/215: dwrite d3/f34 [0,4194304] 0 2024-05-09T00:07:28.878 INFO:tasks.workunit.client.1.smithi135.stdout:1/246: getdents da/d24/d27/d33/d48 0 2024-05-09T00:07:28.879 INFO:tasks.workunit.client.1.smithi135.stdout:1/247: chown da/d14/d20/d2c/l50 5 1 2024-05-09T00:07:28.879 INFO:tasks.workunit.client.1.smithi135.stdout:0/216: chown d3/d1c/d29/l37 542569 1 2024-05-09T00:07:28.879 INFO:tasks.workunit.client.1.smithi135.stdout:1/248: stat da/d24/d27 0 2024-05-09T00:07:28.879 INFO:tasks.workunit.client.1.smithi135.stdout:0/217: truncate d3/f23 193106 0 2024-05-09T00:07:28.880 INFO:tasks.workunit.client.1.smithi135.stdout:3/235: mknod d8/d1a/d44/d4f/d53/c57 0 2024-05-09T00:07:28.881 INFO:tasks.workunit.client.1.smithi135.stdout:9/182: read d1/f13 [955569,62268] 0 2024-05-09T00:07:28.881 INFO:tasks.workunit.client.1.smithi135.stdout:5/269: dread db/f11 [0,4194304] 0 2024-05-09T00:07:28.885 INFO:tasks.workunit.client.1.smithi135.stdout:3/236: write d8/fe [3191799,40299] 0 2024-05-09T00:07:28.889 INFO:tasks.workunit.client.1.smithi135.stdout:6/265: truncate f1 3504279 0 2024-05-09T00:07:28.889 INFO:tasks.workunit.client.1.smithi135.stdout:4/191: dread dc/d26/f2a [4194304,4194304] 0 2024-05-09T00:07:28.898 INFO:tasks.workunit.client.1.smithi135.stdout:9/183: rename d1/ca to d1/d24/d27/c30 0 2024-05-09T00:07:28.898 INFO:tasks.workunit.client.1.smithi135.stdout:9/184: truncate d1/d1a/d2c/f28 692656 0 2024-05-09T00:07:28.899 INFO:tasks.workunit.client.1.smithi135.stdout:5/270: mknod db/d3f/c5a 0 2024-05-09T00:07:28.902 INFO:tasks.workunit.client.1.smithi135.stdout:8/222: dwrite d4/d7/f3d [4194304,4194304] 0 2024-05-09T00:07:28.902 INFO:tasks.workunit.client.1.smithi135.stdout:4/192: dread dc/f1e [0,4194304] 0 2024-05-09T00:07:28.902 INFO:tasks.workunit.client.1.smithi135.stdout:5/271: unlink db/l29 0 2024-05-09T00:07:28.903 INFO:tasks.workunit.client.1.smithi135.stdout:0/218: dwrite d3/f15 [0,4194304] 0 2024-05-09T00:07:28.903 INFO:tasks.workunit.client.1.smithi135.stdout:0/219: write d3/dd/f2f [1380520,92441] 0 2024-05-09T00:07:28.904 INFO:tasks.workunit.client.1.smithi135.stdout:8/223: dread d4/d7/de/f14 [0,4194304] 0 2024-05-09T00:07:28.905 INFO:tasks.workunit.client.1.smithi135.stdout:9/185: write d1/d24/d27/f22 [7218917,92984] 0 2024-05-09T00:07:28.905 INFO:tasks.workunit.client.1.smithi135.stdout:4/193: write dc/f2c [24971,96419] 0 2024-05-09T00:07:28.905 INFO:tasks.workunit.client.1.smithi135.stdout:4/194: chown dc/dd/d1f/f20 0 1 2024-05-09T00:07:28.905 INFO:tasks.workunit.client.1.smithi135.stdout:4/195: getdents dc/dd/d1f 0 2024-05-09T00:07:28.909 INFO:tasks.workunit.client.1.smithi135.stdout:8/224: creat d4/d7/d4a/f4c x:0 0 0 2024-05-09T00:07:28.911 INFO:tasks.workunit.client.1.smithi135.stdout:2/230: truncate d1/d12/d20/d3b/d40/f45 244380 0 2024-05-09T00:07:28.912 INFO:tasks.workunit.client.1.smithi135.stdout:5/272: dread db/f10 [0,4194304] 0 2024-05-09T00:07:28.912 INFO:tasks.workunit.client.1.smithi135.stdout:0/220: fdatasync d3/d1c/f33 0 2024-05-09T00:07:28.912 INFO:tasks.workunit.client.1.smithi135.stdout:4/196: creat dc/f42 x:0 0 0 2024-05-09T00:07:28.912 INFO:tasks.workunit.client.1.smithi135.stdout:7/228: sync 2024-05-09T00:07:28.913 INFO:tasks.workunit.client.1.smithi135.stdout:1/249: dwrite da/d24/d27/d33/f39 [0,4194304] 0 2024-05-09T00:07:28.913 INFO:tasks.workunit.client.1.smithi135.stdout:2/231: write d1/f1c [1735581,87687] 0 2024-05-09T00:07:28.914 INFO:tasks.workunit.client.1.smithi135.stdout:0/221: getdents d3/d1c 0 2024-05-09T00:07:28.916 INFO:tasks.workunit.client.1.smithi135.stdout:4/197: mknod dc/d26/d31/d32/d39/c43 0 2024-05-09T00:07:28.916 INFO:tasks.workunit.client.1.smithi135.stdout:1/250: dread da/f10 [0,4194304] 0 2024-05-09T00:07:28.917 INFO:tasks.workunit.client.1.smithi135.stdout:7/229: creat db/dd/f4b x:0 0 0 2024-05-09T00:07:28.917 INFO:tasks.workunit.client.1.smithi135.stdout:7/230: dread - db/dd/f4b zero size 2024-05-09T00:07:28.921 INFO:tasks.workunit.client.1.smithi135.stdout:8/225: dread d4/d8/f1e [0,4194304] 0 2024-05-09T00:07:28.923 INFO:tasks.workunit.client.1.smithi135.stdout:2/232: creat d1/d12/d21/f4a x:0 0 0 2024-05-09T00:07:28.923 INFO:tasks.workunit.client.1.smithi135.stdout:2/233: readlink d1/d12/l16 0 2024-05-09T00:07:28.924 INFO:tasks.workunit.client.1.smithi135.stdout:6/266: dwrite d2/da/d49/f23 [0,4194304] 0 2024-05-09T00:07:28.925 INFO:tasks.workunit.client.1.smithi135.stdout:0/222: truncate d3/d1c/d29/f2e 3746704 0 2024-05-09T00:07:28.927 INFO:tasks.workunit.client.1.smithi135.stdout:4/198: symlink dc/l44 0 2024-05-09T00:07:28.928 INFO:tasks.workunit.client.1.smithi135.stdout:6/267: dread d2/d1a/f1b [0,4194304] 0 2024-05-09T00:07:28.930 INFO:tasks.workunit.client.1.smithi135.stdout:9/186: dwrite d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:28.930 INFO:tasks.workunit.client.1.smithi135.stdout:5/273: dwrite db/f11 [4194304,4194304] 0 2024-05-09T00:07:28.930 INFO:tasks.workunit.client.1.smithi135.stdout:1/251: rmdir da/d14/d20/d38 39 2024-05-09T00:07:28.934 INFO:tasks.workunit.client.1.smithi135.stdout:7/231: rename db/d1e/d46 to db/d1e/d3a/d40/d4c 0 2024-05-09T00:07:28.939 INFO:tasks.workunit.client.1.smithi135.stdout:8/226: mknod d4/d7/d4a/c4d 0 2024-05-09T00:07:28.939 INFO:tasks.workunit.client.1.smithi135.stdout:2/234: rmdir d1/d12/d27 39 2024-05-09T00:07:28.941 INFO:tasks.workunit.client.1.smithi135.stdout:0/223: mkdir d3/d1c/d3a 0 2024-05-09T00:07:28.941 INFO:tasks.workunit.client.1.smithi135.stdout:0/224: dread - d3/d1c/f36 zero size 2024-05-09T00:07:28.944 INFO:tasks.workunit.client.1.smithi135.stdout:5/274: mkdir db/d24/d32/d5b 0 2024-05-09T00:07:28.944 INFO:tasks.workunit.client.1.smithi135.stdout:5/275: fsync db/d24/d2f/d31/f3d 0 2024-05-09T00:07:28.944 INFO:tasks.workunit.client.1.smithi135.stdout:5/276: read - db/f15 zero size 2024-05-09T00:07:28.944 INFO:tasks.workunit.client.1.smithi135.stdout:6/268: dwrite d2/f25 [0,4194304] 0 2024-05-09T00:07:28.944 INFO:tasks.workunit.client.1.smithi135.stdout:6/269: fsync d2/d1a/f30 0 2024-05-09T00:07:28.945 INFO:tasks.workunit.client.1.smithi135.stdout:1/252: symlink da/d24/d27/d33/d36/l5b 0 2024-05-09T00:07:28.945 INFO:tasks.workunit.client.1.smithi135.stdout:1/253: read f4 [1230486,124786] 0 2024-05-09T00:07:28.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/199: rename dc/d26/d31/d32/d39/d38 to dc/d26/d31/d32/d45 0 2024-05-09T00:07:28.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/200: readlink dc/dd/l30 0 2024-05-09T00:07:28.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/201: dread - dc/f42 zero size 2024-05-09T00:07:28.953 INFO:tasks.workunit.client.1.smithi135.stdout:7/232: symlink db/d1e/d3a/d40/d4c/l4d 0 2024-05-09T00:07:28.954 INFO:tasks.workunit.client.1.smithi135.stdout:3/237: truncate d8/fe 3733538 0 2024-05-09T00:07:28.955 INFO:tasks.workunit.client.1.smithi135.stdout:8/227: truncate d4/d7/de/f35 478341 0 2024-05-09T00:07:28.956 INFO:tasks.workunit.client.1.smithi135.stdout:2/235: chown d1/l19 51288572 1 2024-05-09T00:07:28.958 INFO:tasks.workunit.client.1.smithi135.stdout:0/225: creat d3/f3b x:0 0 0 2024-05-09T00:07:28.958 INFO:tasks.workunit.client.1.smithi135.stdout:0/226: chown d3 3 1 2024-05-09T00:07:28.960 INFO:tasks.workunit.client.1.smithi135.stdout:5/277: creat db/d3f/f5c x:0 0 0 2024-05-09T00:07:28.960 INFO:tasks.workunit.client.1.smithi135.stdout:5/278: chown db/c1b 46452 1 2024-05-09T00:07:28.961 INFO:tasks.workunit.client.1.smithi135.stdout:1/254: mkdir da/d14/d5c 0 2024-05-09T00:07:28.963 INFO:tasks.workunit.client.1.smithi135.stdout:9/187: rename d1/d24/d27/f22 to d1/d1a/d2c/d2d/f31 0 2024-05-09T00:07:28.964 INFO:tasks.workunit.client.1.smithi135.stdout:7/233: rmdir db/d13 39 2024-05-09T00:07:28.966 INFO:tasks.workunit.client.1.smithi135.stdout:3/238: mkdir d8/d1a/d44/d4f/d58 0 2024-05-09T00:07:28.967 INFO:tasks.workunit.client.1.smithi135.stdout:2/236: mknod d1/d12/d20/d3b/d40/c4b 0 2024-05-09T00:07:28.967 INFO:tasks.workunit.client.1.smithi135.stdout:2/237: fsync d1/d12/d20/d2b/f37 0 2024-05-09T00:07:28.968 INFO:tasks.workunit.client.1.smithi135.stdout:0/227: symlink d3/dd/d2d/l3c 0 2024-05-09T00:07:28.971 INFO:tasks.workunit.client.1.smithi135.stdout:6/270: dwrite d2/f17 [0,4194304] 0 2024-05-09T00:07:28.974 INFO:tasks.workunit.client.1.smithi135.stdout:9/188: dread d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:28.975 INFO:tasks.workunit.client.1.smithi135.stdout:5/279: mkdir db/d5d 0 2024-05-09T00:07:28.975 INFO:tasks.workunit.client.1.smithi135.stdout:1/255: rename da/db/c1e to da/d14/d20/d38/d3a/c5d 0 2024-05-09T00:07:28.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/239: mkdir d8/d1a/d44/d4b/d59 0 2024-05-09T00:07:28.975 INFO:tasks.workunit.client.1.smithi135.stdout:0/228: creat d3/dd/d2c/f3d x:0 0 0 2024-05-09T00:07:28.975 INFO:tasks.workunit.client.1.smithi135.stdout:0/229: chown d3/dd/d2c/l39 45 1 2024-05-09T00:07:28.975 INFO:tasks.workunit.client.1.smithi135.stdout:0/230: chown d3/d1c/f36 0 1 2024-05-09T00:07:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:4/202: dwrite dc/f2d [0,4194304] 0 2024-05-09T00:07:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:7/234: dread db/dd/f1c [0,4194304] 0 2024-05-09T00:07:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:4/203: fsync dc/dd/f17 0 2024-05-09T00:07:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:7/235: chown db/c41 63 1 2024-05-09T00:07:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:7/236: fdatasync f8 0 2024-05-09T00:07:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:7/237: chown db/c10 6 1 2024-05-09T00:07:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:7/238: truncate db/d13/f24 92297 0 2024-05-09T00:07:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:7/239: truncate db/dd/f2d 5123625 0 2024-05-09T00:07:28.977 INFO:tasks.workunit.client.1.smithi135.stdout:7/240: chown db/d13/c27 0 1 2024-05-09T00:07:28.979 INFO:tasks.workunit.client.1.smithi135.stdout:9/189: write d1/d1a/d2c/d2d/f31 [468217,92217] 0 2024-05-09T00:07:28.980 INFO:tasks.workunit.client.1.smithi135.stdout:5/280: rename db/d24/d48 to db/d24/d2f/d31/d5e 0 2024-05-09T00:07:28.981 INFO:tasks.workunit.client.1.smithi135.stdout:9/190: write d1/d1a/d2c/f11 [1073848,71515] 0 2024-05-09T00:07:28.981 INFO:tasks.workunit.client.1.smithi135.stdout:1/256: rmdir da/d24/d27/d33/d36 39 2024-05-09T00:07:28.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/238: dwrite d1/fa [4194304,4194304] 0 2024-05-09T00:07:28.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/239: write d1/d22/f28 [4912432,71632] 0 2024-05-09T00:07:28.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/240: chown d1/d12/d21/f3f 7386757 1 2024-05-09T00:07:28.984 INFO:tasks.workunit.client.1.smithi135.stdout:3/240: link d8/d13/l4c d8/d1a/d44/d4b/d59/l5a 0 2024-05-09T00:07:28.984 INFO:tasks.workunit.client.1.smithi135.stdout:3/241: readlink d8/l34 0 2024-05-09T00:07:28.985 INFO:tasks.workunit.client.1.smithi135.stdout:0/231: read d3/f23 [165466,2075] 0 2024-05-09T00:07:28.988 INFO:tasks.workunit.client.1.smithi135.stdout:7/241: getdents db/d21 0 2024-05-09T00:07:28.992 INFO:tasks.workunit.client.1.smithi135.stdout:4/204: rename dc/l13 to dc/d26/d31/d32/l46 0 2024-05-09T00:07:28.996 INFO:tasks.workunit.client.1.smithi135.stdout:1/257: mknod da/d14/c5e 0 2024-05-09T00:07:28.997 INFO:tasks.workunit.client.1.smithi135.stdout:1/258: dread - da/db/d16/f3e zero size 2024-05-09T00:07:29.002 INFO:tasks.workunit.client.1.smithi135.stdout:0/232: dwrite d3/dd/f32 [0,4194304] 0 2024-05-09T00:07:29.003 INFO:tasks.workunit.client.1.smithi135.stdout:3/242: mknod d8/c5b 0 2024-05-09T00:07:29.005 INFO:tasks.workunit.client.1.smithi135.stdout:9/191: rename d1/d1a/d2c/d20/f2f to d1/d1a/d2c/d2d/f32 0 2024-05-09T00:07:29.005 INFO:tasks.workunit.client.1.smithi135.stdout:9/192: readlink d1/d1a/l2b 0 2024-05-09T00:07:29.005 INFO:tasks.workunit.client.1.smithi135.stdout:7/242: dread db/dd/f14 [0,4194304] 0 2024-05-09T00:07:29.006 INFO:tasks.workunit.client.1.smithi135.stdout:7/243: read db/f37 [172031,23965] 0 2024-05-09T00:07:29.009 INFO:tasks.workunit.client.1.smithi135.stdout:3/243: dread f0 [4194304,4194304] 0 2024-05-09T00:07:29.012 INFO:tasks.workunit.client.1.smithi135.stdout:0/233: dread d3/dd/f1b [0,4194304] 0 2024-05-09T00:07:29.012 INFO:tasks.workunit.client.1.smithi135.stdout:0/234: fdatasync d3/d1c/f33 0 2024-05-09T00:07:29.019 INFO:tasks.workunit.client.1.smithi135.stdout:8/228: dwrite d4/d7/de/f35 [0,4194304] 0 2024-05-09T00:07:29.019 INFO:tasks.workunit.client.1.smithi135.stdout:8/229: chown d4/d7/de/c44 1309 1 2024-05-09T00:07:29.019 INFO:tasks.workunit.client.1.smithi135.stdout:2/241: dwrite d1/d12/d20/d3b/d40/f45 [0,4194304] 0 2024-05-09T00:07:29.019 INFO:tasks.workunit.client.1.smithi135.stdout:2/242: chown d1/d12/d20/f29 61 1 2024-05-09T00:07:29.019 INFO:tasks.workunit.client.1.smithi135.stdout:2/243: chown d1/fd 186222658 1 2024-05-09T00:07:29.019 INFO:tasks.workunit.client.1.smithi135.stdout:8/230: write d4/d8/fb [1516129,55930] 0 2024-05-09T00:07:29.019 INFO:tasks.workunit.client.1.smithi135.stdout:8/231: write d4/d22/f27 [1119621,124482] 0 2024-05-09T00:07:29.019 INFO:tasks.workunit.client.1.smithi135.stdout:8/232: write d4/d22/f27 [1856120,125870] 0 2024-05-09T00:07:29.020 INFO:tasks.workunit.client.1.smithi135.stdout:8/233: fdatasync d4/d22/f31 0 2024-05-09T00:07:29.020 INFO:tasks.workunit.client.1.smithi135.stdout:5/281: dread db/d24/d32/f47 [0,4194304] 0 2024-05-09T00:07:29.020 INFO:tasks.workunit.client.1.smithi135.stdout:1/259: getdents da 0 2024-05-09T00:07:29.020 INFO:tasks.workunit.client.1.smithi135.stdout:1/260: write da/d14/f19 [1294401,69838] 0 2024-05-09T00:07:29.021 INFO:tasks.workunit.client.1.smithi135.stdout:1/261: write da/d14/d20/d38/f4d [127171,19056] 0 2024-05-09T00:07:29.025 INFO:tasks.workunit.client.1.smithi135.stdout:4/205: rename dc/f1e to dc/d26/d31/d32/d39/f47 0 2024-05-09T00:07:29.027 INFO:tasks.workunit.client.1.smithi135.stdout:8/234: dread d4/d7/fc [0,4194304] 0 2024-05-09T00:07:29.027 INFO:tasks.workunit.client.1.smithi135.stdout:9/193: mkdir d1/d1a/d2c/d2d/d33 0 2024-05-09T00:07:29.029 INFO:tasks.workunit.client.1.smithi135.stdout:3/244: mknod d8/c5c 0 2024-05-09T00:07:29.030 INFO:tasks.workunit.client.1.smithi135.stdout:0/235: symlink d3/dd/d2d/l3e 0 2024-05-09T00:07:29.031 INFO:tasks.workunit.client.1.smithi135.stdout:3/245: write d8/f10 [2265531,20727] 0 2024-05-09T00:07:29.035 INFO:tasks.workunit.client.1.smithi135.stdout:2/244: unlink d1/d12/d20/d3b/d40/f45 0 2024-05-09T00:07:29.035 INFO:tasks.workunit.client.1.smithi135.stdout:2/245: stat d1/d12/d20/d3b 0 2024-05-09T00:07:29.036 INFO:tasks.workunit.client.1.smithi135.stdout:5/282: creat db/d3f/f5f x:0 0 0 2024-05-09T00:07:29.037 INFO:tasks.workunit.client.1.smithi135.stdout:1/262: rmdir da/d24/d27/d33/d36 39 2024-05-09T00:07:29.041 INFO:tasks.workunit.client.1.smithi135.stdout:7/244: rename db/dd/l1f to db/d1e/l4e 0 2024-05-09T00:07:29.042 INFO:tasks.workunit.client.1.smithi135.stdout:9/194: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:29.044 INFO:tasks.workunit.client.1.smithi135.stdout:2/246: readlink d1/l1d 0 2024-05-09T00:07:29.044 INFO:tasks.workunit.client.1.smithi135.stdout:2/247: fsync d1/fa 0 2024-05-09T00:07:29.044 INFO:tasks.workunit.client.1.smithi135.stdout:2/248: write d1/d22/f31 [991010,17833] 0 2024-05-09T00:07:29.048 INFO:tasks.workunit.client.1.smithi135.stdout:4/206: rename dc/f18 to dc/d26/d31/d32/d39/f48 0 2024-05-09T00:07:29.051 INFO:tasks.workunit.client.1.smithi135.stdout:9/195: rmdir d1/d1a/d2c/d2d/d33 0 2024-05-09T00:07:29.054 INFO:tasks.workunit.client.1.smithi135.stdout:8/235: rename d4/d7/d33/c34 to d4/d22/c4e 0 2024-05-09T00:07:29.055 INFO:tasks.workunit.client.1.smithi135.stdout:4/207: symlink dc/d26/d31/d32/l49 0 2024-05-09T00:07:29.055 INFO:tasks.workunit.client.1.smithi135.stdout:4/208: chown dc/d26/d31/d32/d39/l36 1 1 2024-05-09T00:07:29.056 INFO:tasks.workunit.client.1.smithi135.stdout:9/196: creat d1/d1a/d2c/d20/f34 x:0 0 0 2024-05-09T00:07:29.058 INFO:tasks.workunit.client.1.smithi135.stdout:1/263: dwrite da/d14/d20/d2c/f32 [0,4194304] 0 2024-05-09T00:07:29.058 INFO:tasks.workunit.client.1.smithi135.stdout:2/249: dwrite d1/fa [4194304,4194304] 0 2024-05-09T00:07:29.059 INFO:tasks.workunit.client.1.smithi135.stdout:0/236: rename d3/d1c to d3/dd/d3f 0 2024-05-09T00:07:29.059 INFO:tasks.workunit.client.1.smithi135.stdout:0/237: stat d3/dd/d3f/l24 0 2024-05-09T00:07:29.061 INFO:tasks.workunit.client.1.smithi135.stdout:8/236: rmdir d4/d7/de/d42 0 2024-05-09T00:07:29.063 INFO:tasks.workunit.client.1.smithi135.stdout:4/209: rmdir dc/d26/d31/d32 39 2024-05-09T00:07:29.063 INFO:tasks.workunit.client.1.smithi135.stdout:4/210: readlink dc/d26/d31/d32/l49 0 2024-05-09T00:07:29.064 INFO:tasks.workunit.client.1.smithi135.stdout:4/211: write dc/dd/f11 [1780671,30356] 0 2024-05-09T00:07:29.064 INFO:tasks.workunit.client.1.smithi135.stdout:9/197: truncate d1/d1a/fb 1583637 0 2024-05-09T00:07:29.065 INFO:tasks.workunit.client.1.smithi135.stdout:9/198: chown d1/d1a/d2c/l19 2896360 1 2024-05-09T00:07:29.068 INFO:tasks.workunit.client.1.smithi135.stdout:1/264: symlink da/db/d16/l5f 0 2024-05-09T00:07:29.070 INFO:tasks.workunit.client.1.smithi135.stdout:9/199: dread d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:29.072 INFO:tasks.workunit.client.1.smithi135.stdout:7/245: rename db/f28 to db/d1e/d3a/d40/d4c/f4f 0 2024-05-09T00:07:29.074 INFO:tasks.workunit.client.1.smithi135.stdout:0/238: creat d3/dd/d2d/f40 x:0 0 0 2024-05-09T00:07:29.076 INFO:tasks.workunit.client.1.smithi135.stdout:8/237: unlink d4/d7/c28 0 2024-05-09T00:07:29.079 INFO:tasks.workunit.client.1.smithi135.stdout:4/212: mkdir dc/d4a 0 2024-05-09T00:07:29.080 INFO:tasks.workunit.client.1.smithi135.stdout:1/265: creat da/d24/d27/d33/f60 x:0 0 0 2024-05-09T00:07:29.082 INFO:tasks.workunit.client.1.smithi135.stdout:2/250: rename d1/d12/d20/l49 to d1/d12/d27/l4c 0 2024-05-09T00:07:29.084 INFO:tasks.workunit.client.1.smithi135.stdout:7/246: rmdir db/dd/d33 39 2024-05-09T00:07:29.089 INFO:tasks.workunit.client.1.smithi135.stdout:8/238: symlink d4/d8/l4f 0 2024-05-09T00:07:29.090 INFO:tasks.workunit.client.1.smithi135.stdout:8/239: write d4/f41 [10904,19876] 0 2024-05-09T00:07:29.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/251: mknod d1/d12/d27/c4d 0 2024-05-09T00:07:29.093 INFO:tasks.workunit.client.1.smithi135.stdout:7/247: symlink db/d1e/l50 0 2024-05-09T00:07:29.094 INFO:tasks.workunit.client.1.smithi135.stdout:8/240: symlink d4/d7/d2a/l50 0 2024-05-09T00:07:29.098 INFO:tasks.workunit.client.1.smithi135.stdout:8/241: rmdir d4/d7/d33/d39 39 2024-05-09T00:07:29.098 INFO:tasks.workunit.client.1.smithi135.stdout:8/242: dread - d4/d7/f2f zero size 2024-05-09T00:07:29.100 INFO:tasks.workunit.client.1.smithi135.stdout:2/252: mknod d1/c4e 0 2024-05-09T00:07:29.105 INFO:tasks.workunit.client.1.smithi135.stdout:9/200: rename d1/d1a/fb to d1/d24/f35 0 2024-05-09T00:07:29.109 INFO:tasks.workunit.client.1.smithi135.stdout:7/248: dwrite db/f16 [0,4194304] 0 2024-05-09T00:07:29.109 INFO:tasks.workunit.client.1.smithi135.stdout:1/266: rename da/d24/d27/f3b to da/db/f61 0 2024-05-09T00:07:29.109 INFO:tasks.workunit.client.1.smithi135.stdout:1/267: dread - da/db/d16/f3e zero size 2024-05-09T00:07:29.109 INFO:tasks.workunit.client.1.smithi135.stdout:7/249: write db/d1e/d3a/f3b [779969,52532] 0 2024-05-09T00:07:29.109 INFO:tasks.workunit.client.1.smithi135.stdout:1/268: chown da/d14/d20/d38/l45 3234583 1 2024-05-09T00:07:29.111 INFO:tasks.workunit.client.1.smithi135.stdout:9/201: mknod d1/d1a/d2c/d20/c36 0 2024-05-09T00:07:29.111 INFO:tasks.workunit.client.1.smithi135.stdout:9/202: fsync d1/d1a/f29 0 2024-05-09T00:07:29.111 INFO:tasks.workunit.client.1.smithi135.stdout:1/269: getdents da/d14 0 2024-05-09T00:07:29.111 INFO:tasks.workunit.client.1.smithi135.stdout:0/239: rmdir d3/dd 39 2024-05-09T00:07:29.111 INFO:tasks.workunit.client.1.smithi135.stdout:0/240: read - d3/f31 zero size 2024-05-09T00:07:29.113 INFO:tasks.workunit.client.1.smithi135.stdout:9/203: mknod d1/d24/c37 0 2024-05-09T00:07:29.113 INFO:tasks.workunit.client.1.smithi135.stdout:9/204: fsync d1/d1a/d2c/d2d/f31 0 2024-05-09T00:07:29.114 INFO:tasks.workunit.client.1.smithi135.stdout:1/270: link da/d14/f19 da/f62 0 2024-05-09T00:07:29.114 INFO:tasks.workunit.client.1.smithi135.stdout:4/213: getdents dc 0 2024-05-09T00:07:29.114 INFO:tasks.workunit.client.1.smithi135.stdout:4/214: chown dc/f25 124 1 2024-05-09T00:07:29.115 INFO:tasks.workunit.client.1.smithi135.stdout:4/215: readlink l8 0 2024-05-09T00:07:29.115 INFO:tasks.workunit.client.1.smithi135.stdout:0/241: rmdir d3/dd/d3f/d29 39 2024-05-09T00:07:29.115 INFO:tasks.workunit.client.1.smithi135.stdout:0/242: chown d3/dd/d3f/f36 1479669 1 2024-05-09T00:07:29.116 INFO:tasks.workunit.client.1.smithi135.stdout:9/205: symlink d1/d1a/d2c/d20/l38 0 2024-05-09T00:07:29.117 INFO:tasks.workunit.client.1.smithi135.stdout:1/271: creat da/f63 x:0 0 0 2024-05-09T00:07:29.117 INFO:tasks.workunit.client.1.smithi135.stdout:4/216: read dc/f27 [3450369,91073] 0 2024-05-09T00:07:29.118 INFO:tasks.workunit.client.1.smithi135.stdout:0/243: creat d3/dd/d3f/f41 x:0 0 0 2024-05-09T00:07:29.120 INFO:tasks.workunit.client.1.smithi135.stdout:9/206: link d1/d1a/d2c/l19 d1/d24/l39 0 2024-05-09T00:07:29.120 INFO:tasks.workunit.client.1.smithi135.stdout:9/207: dread - d1/d1a/d2c/d20/f34 zero size 2024-05-09T00:07:29.121 INFO:tasks.workunit.client.1.smithi135.stdout:1/272: creat da/db/f64 x:0 0 0 2024-05-09T00:07:29.121 INFO:tasks.workunit.client.1.smithi135.stdout:8/243: rmdir d4 39 2024-05-09T00:07:29.122 INFO:tasks.workunit.client.1.smithi135.stdout:0/244: mknod d3/dd/d3f/c42 0 2024-05-09T00:07:29.122 INFO:tasks.workunit.client.1.smithi135.stdout:0/245: truncate d3/dd/d2c/f38 716830 0 2024-05-09T00:07:29.124 INFO:tasks.workunit.client.1.smithi135.stdout:9/208: rename d1/d24/l25 to d1/d1a/d2c/l3a 0 2024-05-09T00:07:29.124 INFO:tasks.workunit.client.1.smithi135.stdout:1/273: dread da/f10 [0,4194304] 0 2024-05-09T00:07:29.125 INFO:tasks.workunit.client.1.smithi135.stdout:8/244: creat d4/d22/f51 x:0 0 0 2024-05-09T00:07:29.125 INFO:tasks.workunit.client.1.smithi135.stdout:7/250: dwrite db/dd/f4b [0,4194304] 0 2024-05-09T00:07:29.127 INFO:tasks.workunit.client.1.smithi135.stdout:9/209: rmdir d1/d1a/d2c 39 2024-05-09T00:07:29.127 INFO:tasks.workunit.client.1.smithi135.stdout:9/210: readlink d1/d1a/d2c/d20/l2e 0 2024-05-09T00:07:29.128 INFO:tasks.workunit.client.1.smithi135.stdout:1/274: creat da/d24/d27/d33/d36/f65 x:0 0 0 2024-05-09T00:07:29.130 INFO:tasks.workunit.client.1.smithi135.stdout:8/245: rename d4/d22/f31 to d4/d7/f52 0 2024-05-09T00:07:29.131 INFO:tasks.workunit.client.1.smithi135.stdout:6/271: sync 2024-05-09T00:07:29.131 INFO:tasks.workunit.client.1.smithi135.stdout:6/272: chown d2/da/d26/l34 5173 1 2024-05-09T00:07:29.131 INFO:tasks.workunit.client.1.smithi135.stdout:8/246: write d4/f41 [185329,62260] 0 2024-05-09T00:07:29.134 INFO:tasks.workunit.client.1.smithi135.stdout:7/251: mknod db/c51 0 2024-05-09T00:07:29.134 INFO:tasks.workunit.client.1.smithi135.stdout:7/252: chown db/dd/c2c 1402 1 2024-05-09T00:07:29.134 INFO:tasks.workunit.client.1.smithi135.stdout:7/253: chown db/d1e/d3a/c3e 534 1 2024-05-09T00:07:29.137 INFO:tasks.workunit.client.1.smithi135.stdout:9/211: link d1/d1a/d2c/d2d/f31 d1/d1a/d2c/d2d/f3b 0 2024-05-09T00:07:29.137 INFO:tasks.workunit.client.1.smithi135.stdout:9/212: fdatasync d1/f13 0 2024-05-09T00:07:29.138 INFO:tasks.workunit.client.1.smithi135.stdout:6/273: symlink d2/d20/d37/l5d 0 2024-05-09T00:07:29.140 INFO:tasks.workunit.client.1.smithi135.stdout:8/247: symlink d4/d7/de/d45/l53 0 2024-05-09T00:07:29.141 INFO:tasks.workunit.client.1.smithi135.stdout:7/254: creat db/d1e/d3a/f52 x:0 0 0 2024-05-09T00:07:29.142 INFO:tasks.workunit.client.1.smithi135.stdout:0/246: rmdir d3 39 2024-05-09T00:07:29.142 INFO:tasks.workunit.client.1.smithi135.stdout:0/247: write d3/dd/f1b [4236634,41854] 0 2024-05-09T00:07:29.142 INFO:tasks.workunit.client.1.smithi135.stdout:0/248: fdatasync d3/dd/f14 0 2024-05-09T00:07:29.143 INFO:tasks.workunit.client.1.smithi135.stdout:6/274: creat d2/da/d1d/f5e x:0 0 0 2024-05-09T00:07:29.144 INFO:tasks.workunit.client.1.smithi135.stdout:9/213: dread d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:29.144 INFO:tasks.workunit.client.1.smithi135.stdout:9/214: fdatasync d1/d1a/d2c/d20/f34 0 2024-05-09T00:07:29.144 INFO:tasks.workunit.client.1.smithi135.stdout:1/275: dwrite da/d14/f1a [4194304,4194304] 0 2024-05-09T00:07:29.147 INFO:tasks.workunit.client.1.smithi135.stdout:7/255: unlink db/d1e/l50 0 2024-05-09T00:07:29.147 INFO:tasks.workunit.client.1.smithi135.stdout:6/275: truncate d2/f2a 2130426 0 2024-05-09T00:07:29.148 INFO:tasks.workunit.client.1.smithi135.stdout:8/248: getdents d4/d7 0 2024-05-09T00:07:29.149 INFO:tasks.workunit.client.1.smithi135.stdout:8/249: readlink d4/d7/de/d45/l53 0 2024-05-09T00:07:29.150 INFO:tasks.workunit.client.1.smithi135.stdout:1/276: creat da/d14/d20/f66 x:0 0 0 2024-05-09T00:07:29.151 INFO:tasks.workunit.client.1.smithi135.stdout:1/277: write da/db/fe [3849921,130655] 0 2024-05-09T00:07:29.153 INFO:tasks.workunit.client.1.smithi135.stdout:9/215: mkdir d1/d1a/d10/d3c 0 2024-05-09T00:07:29.153 INFO:tasks.workunit.client.1.smithi135.stdout:7/256: getdents db 0 2024-05-09T00:07:29.153 INFO:tasks.workunit.client.1.smithi135.stdout:7/257: chown db/dd/f2d 195996127 1 2024-05-09T00:07:29.154 INFO:tasks.workunit.client.1.smithi135.stdout:8/250: symlink d4/d7/d33/d39/l54 0 2024-05-09T00:07:29.155 INFO:tasks.workunit.client.1.smithi135.stdout:1/278: symlink da/d24/d27/d33/l67 0 2024-05-09T00:07:29.155 INFO:tasks.workunit.client.1.smithi135.stdout:1/279: dread - da/d24/d27/d33/f60 zero size 2024-05-09T00:07:29.156 INFO:tasks.workunit.client.1.smithi135.stdout:1/280: readlink da/db/d16/l5f 0 2024-05-09T00:07:29.157 INFO:tasks.workunit.client.1.smithi135.stdout:9/216: write d1/f13 [738396,110409] 0 2024-05-09T00:07:29.161 INFO:tasks.workunit.client.1.smithi135.stdout:0/249: dwrite d3/dd/f32 [0,4194304] 0 2024-05-09T00:07:29.163 INFO:tasks.workunit.client.1.smithi135.stdout:8/251: creat d4/d7/d33/f55 x:0 0 0 2024-05-09T00:07:29.163 INFO:tasks.workunit.client.1.smithi135.stdout:8/252: read - d4/d7/d33/d39/f47 zero size 2024-05-09T00:07:29.163 INFO:tasks.workunit.client.1.smithi135.stdout:8/253: chown d4/d8/c3e 187573 1 2024-05-09T00:07:29.164 INFO:tasks.workunit.client.1.smithi135.stdout:9/217: mkdir d1/d1a/d3d 0 2024-05-09T00:07:29.164 INFO:tasks.workunit.client.1.smithi135.stdout:9/218: readlink d1/d1a/d2c/d20/l38 0 2024-05-09T00:07:29.166 INFO:tasks.workunit.client.1.smithi135.stdout:8/254: write d4/d7/fc [2206254,17261] 0 2024-05-09T00:07:29.166 INFO:tasks.workunit.client.1.smithi135.stdout:8/255: chown d4/d7/de 37855811 1 2024-05-09T00:07:29.167 INFO:tasks.workunit.client.1.smithi135.stdout:8/256: getdents d4 0 2024-05-09T00:07:29.169 INFO:tasks.workunit.client.1.smithi135.stdout:8/257: mkdir d4/d7/d2a/d56 0 2024-05-09T00:07:29.171 INFO:tasks.workunit.client.1.smithi135.stdout:6/276: dwrite d2/d1a/f30 [0,4194304] 0 2024-05-09T00:07:29.173 INFO:tasks.workunit.client.1.smithi135.stdout:7/258: dwrite db/ff [0,4194304] 0 2024-05-09T00:07:29.173 INFO:tasks.workunit.client.1.smithi135.stdout:9/219: getdents d1/d1a/d10 0 2024-05-09T00:07:29.176 INFO:tasks.workunit.client.1.smithi135.stdout:8/258: getdents d4/d7/d33/d39 0 2024-05-09T00:07:29.176 INFO:tasks.workunit.client.1.smithi135.stdout:8/259: read - d4/d22/f51 zero size 2024-05-09T00:07:29.176 INFO:tasks.workunit.client.1.smithi135.stdout:8/260: read d4/f2b [4657661,120766] 0 2024-05-09T00:07:29.178 INFO:tasks.workunit.client.1.smithi135.stdout:7/259: creat db/d1e/d3a/d40/d4c/f53 x:0 0 0 2024-05-09T00:07:29.178 INFO:tasks.workunit.client.1.smithi135.stdout:7/260: rename db to db/dd/d33/d54 22 2024-05-09T00:07:29.178 INFO:tasks.workunit.client.1.smithi135.stdout:7/261: stat db/ff 0 2024-05-09T00:07:29.179 INFO:tasks.workunit.client.1.smithi135.stdout:9/220: getdents d1/d1a/d2c/d20 0 2024-05-09T00:07:29.181 INFO:tasks.workunit.client.1.smithi135.stdout:7/262: creat db/d1e/d3a/d40/f55 x:0 0 0 2024-05-09T00:07:29.182 INFO:tasks.workunit.client.1.smithi135.stdout:7/263: write db/d13/f24 [4015,78378] 0 2024-05-09T00:07:29.185 INFO:tasks.workunit.client.1.smithi135.stdout:9/221: rename d1/d1a/d2c/d20/c36 to d1/d1a/d10/c3e 0 2024-05-09T00:07:29.185 INFO:tasks.workunit.client.1.smithi135.stdout:9/222: chown d1/d1a/d2c/l19 2022 1 2024-05-09T00:07:29.187 INFO:tasks.workunit.client.1.smithi135.stdout:7/264: rename db/d1e/l4e to db/dd/d33/l56 0 2024-05-09T00:07:29.188 INFO:tasks.workunit.client.1.smithi135.stdout:7/265: creat db/d13/f57 x:0 0 0 2024-05-09T00:07:29.188 INFO:tasks.workunit.client.1.smithi135.stdout:3/246: sync 2024-05-09T00:07:29.188 INFO:tasks.workunit.client.1.smithi135.stdout:5/283: sync 2024-05-09T00:07:29.189 INFO:tasks.workunit.client.1.smithi135.stdout:6/277: dread d2/f25 [0,4194304] 0 2024-05-09T00:07:29.189 INFO:tasks.workunit.client.1.smithi135.stdout:8/261: dread d4/d7/d33/d39/f48 [0,4194304] 0 2024-05-09T00:07:29.189 INFO:tasks.workunit.client.1.smithi135.stdout:7/266: mkdir db/dd/d33/d58 0 2024-05-09T00:07:29.190 INFO:tasks.workunit.client.1.smithi135.stdout:3/247: write d8/f42 [2375894,110653] 0 2024-05-09T00:07:29.190 INFO:tasks.workunit.client.1.smithi135.stdout:3/248: fdatasync d8/f14 0 2024-05-09T00:07:29.190 INFO:tasks.workunit.client.1.smithi135.stdout:3/249: write d8/d13/f46 [105520,118810] 0 2024-05-09T00:07:29.190 INFO:tasks.workunit.client.1.smithi135.stdout:9/223: write d1/d1a/d2c/d2d/f3b [1870617,116673] 0 2024-05-09T00:07:29.190 INFO:tasks.workunit.client.1.smithi135.stdout:9/224: write d1/f13 [4436835,34319] 0 2024-05-09T00:07:29.190 INFO:tasks.workunit.client.1.smithi135.stdout:9/225: fdatasync d1/f2 0 2024-05-09T00:07:29.191 INFO:tasks.workunit.client.1.smithi135.stdout:5/284: truncate db/fe 2752625 0 2024-05-09T00:07:29.192 INFO:tasks.workunit.client.1.smithi135.stdout:7/267: symlink db/d21/l59 0 2024-05-09T00:07:29.193 INFO:tasks.workunit.client.1.smithi135.stdout:1/281: dwrite f9 [0,4194304] 0 2024-05-09T00:07:29.195 INFO:tasks.workunit.client.1.smithi135.stdout:7/268: write f8 [1743382,38630] 0 2024-05-09T00:07:29.195 INFO:tasks.workunit.client.1.smithi135.stdout:7/269: write db/f37 [1239536,8445] 0 2024-05-09T00:07:29.196 INFO:tasks.workunit.client.1.smithi135.stdout:3/250: link d8/d13/d1f/d40/d52/f54 d8/d1a/d44/d4f/d53/f5d 0 2024-05-09T00:07:29.197 INFO:tasks.workunit.client.1.smithi135.stdout:0/250: dwrite d3/f3b [0,4194304] 0 2024-05-09T00:07:29.197 INFO:tasks.workunit.client.1.smithi135.stdout:9/226: fdatasync d1/f13 0 2024-05-09T00:07:29.198 INFO:tasks.workunit.client.1.smithi135.stdout:6/278: mkdir d2/d5f 0 2024-05-09T00:07:29.203 INFO:tasks.workunit.client.1.smithi135.stdout:1/282: rename f4 to da/d14/d20/d38/d3a/d40/f68 0 2024-05-09T00:07:29.203 INFO:tasks.workunit.client.1.smithi135.stdout:1/283: write da/d24/f26 [1064267,44330] 0 2024-05-09T00:07:29.205 INFO:tasks.workunit.client.1.smithi135.stdout:8/262: dwrite d4/f46 [0,4194304] 0 2024-05-09T00:07:29.205 INFO:tasks.workunit.client.1.smithi135.stdout:8/263: fdatasync d4/d7/f52 0 2024-05-09T00:07:29.206 INFO:tasks.workunit.client.1.smithi135.stdout:8/264: write d4/d22/f51 [679443,33586] 0 2024-05-09T00:07:29.206 INFO:tasks.workunit.client.1.smithi135.stdout:8/265: write d4/d7/d33/f55 [605494,69124] 0 2024-05-09T00:07:29.208 INFO:tasks.workunit.client.1.smithi135.stdout:3/251: symlink d8/d13/d1f/d40/d47/l5e 0 2024-05-09T00:07:29.218 INFO:tasks.workunit.client.1.smithi135.stdout:0/251: truncate d3/dd/d3f/d29/f2e 275820 0 2024-05-09T00:07:29.222 INFO:tasks.workunit.client.1.smithi135.stdout:6/279: unlink d2/da/d49/f5b 0 2024-05-09T00:07:29.227 INFO:tasks.workunit.client.1.smithi135.stdout:3/252: rmdir d8/d13/d1f 39 2024-05-09T00:07:29.227 INFO:tasks.workunit.client.1.smithi135.stdout:3/253: chown d8/l27 404204 1 2024-05-09T00:07:29.228 INFO:tasks.workunit.client.1.smithi135.stdout:6/280: mkdir d2/da/d26/d57/d60 0 2024-05-09T00:07:29.228 INFO:tasks.workunit.client.1.smithi135.stdout:7/270: dwrite db/f16 [0,4194304] 0 2024-05-09T00:07:29.229 INFO:tasks.workunit.client.1.smithi135.stdout:7/271: chown db/f30 125080 1 2024-05-09T00:07:29.229 INFO:tasks.workunit.client.1.smithi135.stdout:3/254: mknod d8/d13/d51/c5f 0 2024-05-09T00:07:29.230 INFO:tasks.workunit.client.1.smithi135.stdout:6/281: symlink d2/da/d26/d57/d60/l61 0 2024-05-09T00:07:29.232 INFO:tasks.workunit.client.1.smithi135.stdout:7/272: rename db/d13/l45 to db/d1e/d3a/d40/l5a 0 2024-05-09T00:07:29.233 INFO:tasks.workunit.client.1.smithi135.stdout:3/255: creat d8/d1a/d44/d4b/f60 x:0 0 0 2024-05-09T00:07:29.234 INFO:tasks.workunit.client.1.smithi135.stdout:3/256: stat d8/d13/f3b 0 2024-05-09T00:07:29.234 INFO:tasks.workunit.client.1.smithi135.stdout:6/282: mkdir d2/da/d26/d57/d59/d62 0 2024-05-09T00:07:29.234 INFO:tasks.workunit.client.1.smithi135.stdout:7/273: mkdir db/d5b 0 2024-05-09T00:07:29.235 INFO:tasks.workunit.client.1.smithi135.stdout:6/283: rmdir d2/d20/d37 39 2024-05-09T00:07:29.237 INFO:tasks.workunit.client.1.smithi135.stdout:7/274: link db/f30 db/d5b/f5c 0 2024-05-09T00:07:29.239 INFO:tasks.workunit.client.1.smithi135.stdout:2/253: sync 2024-05-09T00:07:29.239 INFO:tasks.workunit.client.1.smithi135.stdout:2/254: readlink d1/l19 0 2024-05-09T00:07:29.239 INFO:tasks.workunit.client.1.smithi135.stdout:3/257: dread d8/d13/f46 [0,4194304] 0 2024-05-09T00:07:29.240 INFO:tasks.workunit.client.1.smithi135.stdout:1/284: dwrite da/f4b [0,4194304] 0 2024-05-09T00:07:29.240 INFO:tasks.workunit.client.1.smithi135.stdout:0/252: dwrite d3/f34 [4194304,4194304] 0 2024-05-09T00:07:29.241 INFO:tasks.workunit.client.1.smithi135.stdout:6/284: rename d2/da/f18 to d2/da/d26/d57/d59/f63 0 2024-05-09T00:07:29.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/275: symlink db/d21/l5d 0 2024-05-09T00:07:29.244 INFO:tasks.workunit.client.1.smithi135.stdout:3/258: unlink d8/f29 0 2024-05-09T00:07:29.245 INFO:tasks.workunit.client.1.smithi135.stdout:3/259: write f3 [4188933,84792] 0 2024-05-09T00:07:29.246 INFO:tasks.workunit.client.1.smithi135.stdout:1/285: mknod da/d14/c69 0 2024-05-09T00:07:29.247 INFO:tasks.workunit.client.1.smithi135.stdout:1/286: chown da/d24/d27/d33/l67 276 1 2024-05-09T00:07:29.247 INFO:tasks.workunit.client.1.smithi135.stdout:1/287: readlink da/db/d16/l5a 0 2024-05-09T00:07:29.247 INFO:tasks.workunit.client.1.smithi135.stdout:1/288: chown da/d24/d27/d33/f39 1 1 2024-05-09T00:07:29.247 INFO:tasks.workunit.client.1.smithi135.stdout:1/289: dread - da/db/d16/f3e zero size 2024-05-09T00:07:29.250 INFO:tasks.workunit.client.1.smithi135.stdout:6/285: truncate d2/da/d49/f23 1002447 0 2024-05-09T00:07:29.252 INFO:tasks.workunit.client.1.smithi135.stdout:8/266: dwrite d4/f46 [0,4194304] 0 2024-05-09T00:07:29.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/276: truncate f8 3525785 0 2024-05-09T00:07:29.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/277: write db/d1e/d3a/f3b [833597,61704] 0 2024-05-09T00:07:29.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/278: chown db/d21/l44 5138313 1 2024-05-09T00:07:29.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/279: rename db/d1e/d3a/d40/d4c to db/d1e/d3a/d40/d4c/d5e 22 2024-05-09T00:07:29.256 INFO:tasks.workunit.client.1.smithi135.stdout:1/290: creat da/d24/d27/d33/f6a x:0 0 0 2024-05-09T00:07:29.261 INFO:tasks.workunit.client.1.smithi135.stdout:8/267: creat d4/d7/de/f57 x:0 0 0 2024-05-09T00:07:29.270 INFO:tasks.workunit.client.1.smithi135.stdout:7/280: rmdir db/d1e 39 2024-05-09T00:07:29.270 INFO:tasks.workunit.client.1.smithi135.stdout:2/255: dwrite d1/d12/f48 [0,4194304] 0 2024-05-09T00:07:29.271 INFO:tasks.workunit.client.1.smithi135.stdout:2/256: chown d1/d12/d21 1380519552 1 2024-05-09T00:07:29.271 INFO:tasks.workunit.client.1.smithi135.stdout:2/257: fsync d1/f1c 0 2024-05-09T00:07:29.271 INFO:tasks.workunit.client.1.smithi135.stdout:7/281: read db/dd/d33/f3d [1516650,8487] 0 2024-05-09T00:07:29.271 INFO:tasks.workunit.client.1.smithi135.stdout:6/286: dwrite d2/da/d26/f55 [0,4194304] 0 2024-05-09T00:07:29.273 INFO:tasks.workunit.client.1.smithi135.stdout:5/285: dwrite db/fe [0,4194304] 0 2024-05-09T00:07:29.276 INFO:tasks.workunit.client.1.smithi135.stdout:7/282: creat db/d1e/d3a/f5f x:0 0 0 2024-05-09T00:07:29.276 INFO:tasks.workunit.client.1.smithi135.stdout:2/258: mkdir d1/d12/d20/d3b/d4f 0 2024-05-09T00:07:29.277 INFO:tasks.workunit.client.1.smithi135.stdout:2/259: write d1/d22/f3d [1121393,67554] 0 2024-05-09T00:07:29.279 INFO:tasks.workunit.client.1.smithi135.stdout:6/287: rmdir d2/da/d26 39 2024-05-09T00:07:29.285 INFO:tasks.workunit.client.1.smithi135.stdout:5/286: symlink db/d5d/l60 0 2024-05-09T00:07:29.285 INFO:tasks.workunit.client.1.smithi135.stdout:3/260: dwrite d8/d13/d1f/d40/d47/f4a [0,4194304] 0 2024-05-09T00:07:29.286 INFO:tasks.workunit.client.1.smithi135.stdout:8/268: dwrite d4/f20 [4194304,4194304] 0 2024-05-09T00:07:29.289 INFO:tasks.workunit.client.1.smithi135.stdout:2/260: symlink d1/d12/d20/d2b/l50 0 2024-05-09T00:07:29.291 INFO:tasks.workunit.client.1.smithi135.stdout:5/287: creat db/d3f/f61 x:0 0 0 2024-05-09T00:07:29.291 INFO:tasks.workunit.client.1.smithi135.stdout:6/288: dread d2/d1a/f30 [0,4194304] 0 2024-05-09T00:07:29.292 INFO:tasks.workunit.client.1.smithi135.stdout:6/289: fdatasync d2/da/d26/d57/d59/f63 0 2024-05-09T00:07:29.293 INFO:tasks.workunit.client.1.smithi135.stdout:3/261: symlink d8/d1a/d44/d4b/l61 0 2024-05-09T00:07:29.294 INFO:tasks.workunit.client.1.smithi135.stdout:7/283: dwrite db/dd/f1b [0,4194304] 0 2024-05-09T00:07:29.294 INFO:tasks.workunit.client.1.smithi135.stdout:7/284: chown db/dd/c2c 31240982 1 2024-05-09T00:07:29.295 INFO:tasks.workunit.client.1.smithi135.stdout:7/285: write db/dd/f2d [3951744,75730] 0 2024-05-09T00:07:29.295 INFO:tasks.workunit.client.1.smithi135.stdout:7/286: truncate db/d1e/d3a/f5f 840147 0 2024-05-09T00:07:29.296 INFO:tasks.workunit.client.1.smithi135.stdout:7/287: read db/dd/f35 [150236,77505] 0 2024-05-09T00:07:29.296 INFO:tasks.workunit.client.1.smithi135.stdout:2/261: getdents d1/d12 0 2024-05-09T00:07:29.296 INFO:tasks.workunit.client.1.smithi135.stdout:2/262: write d1/d12/d20/f29 [783332,40736] 0 2024-05-09T00:07:29.297 INFO:tasks.workunit.client.1.smithi135.stdout:5/288: mkdir db/d24/d2f/d62 0 2024-05-09T00:07:29.298 INFO:tasks.workunit.client.1.smithi135.stdout:6/290: creat d2/da/d49/f64 x:0 0 0 2024-05-09T00:07:29.299 INFO:tasks.workunit.client.1.smithi135.stdout:3/262: mkdir d8/d13/d1f/d62 0 2024-05-09T00:07:29.299 INFO:tasks.workunit.client.1.smithi135.stdout:3/263: fdatasync d8/d13/d1f/f48 0 2024-05-09T00:07:29.301 INFO:tasks.workunit.client.1.smithi135.stdout:4/217: sync 2024-05-09T00:07:29.302 INFO:tasks.workunit.client.1.smithi135.stdout:7/288: mkdir db/d21/d60 0 2024-05-09T00:07:29.302 INFO:tasks.workunit.client.1.smithi135.stdout:7/289: read db/d1e/f36 [570142,109743] 0 2024-05-09T00:07:29.303 INFO:tasks.workunit.client.1.smithi135.stdout:2/263: creat d1/d12/d20/f51 x:0 0 0 2024-05-09T00:07:29.303 INFO:tasks.workunit.client.1.smithi135.stdout:2/264: write d1/fd [3798385,25332] 0 2024-05-09T00:07:29.303 INFO:tasks.workunit.client.1.smithi135.stdout:2/265: write d1/d12/d21/f4a [707358,27891] 0 2024-05-09T00:07:29.305 INFO:tasks.workunit.client.1.smithi135.stdout:3/264: getdents d8/d13/d1f/d40/d52 0 2024-05-09T00:07:29.305 INFO:tasks.workunit.client.1.smithi135.stdout:8/269: dwrite d4/d7/d33/d39/f48 [0,4194304] 0 2024-05-09T00:07:29.306 INFO:tasks.workunit.client.1.smithi135.stdout:4/218: creat dc/f4b x:0 0 0 2024-05-09T00:07:29.306 INFO:tasks.workunit.client.1.smithi135.stdout:5/289: dread f4 [0,4194304] 0 2024-05-09T00:07:29.306 INFO:tasks.workunit.client.1.smithi135.stdout:5/290: write db/f2e [364882,105814] 0 2024-05-09T00:07:29.307 INFO:tasks.workunit.client.1.smithi135.stdout:7/290: creat db/dd/d33/f61 x:0 0 0 2024-05-09T00:07:29.307 INFO:tasks.workunit.client.1.smithi135.stdout:7/291: fdatasync db/d5b/f5c 0 2024-05-09T00:07:29.309 INFO:tasks.workunit.client.1.smithi135.stdout:6/291: mknod d2/c65 0 2024-05-09T00:07:29.314 INFO:tasks.workunit.client.1.smithi135.stdout:5/291: dread f4 [0,4194304] 0 2024-05-09T00:07:29.314 INFO:tasks.workunit.client.1.smithi135.stdout:5/292: chown db/l2b 285 1 2024-05-09T00:07:29.315 INFO:tasks.workunit.client.1.smithi135.stdout:2/266: dread d1/f33 [0,4194304] 0 2024-05-09T00:07:29.316 INFO:tasks.workunit.client.1.smithi135.stdout:8/270: creat d4/f58 x:0 0 0 2024-05-09T00:07:29.318 INFO:tasks.workunit.client.1.smithi135.stdout:4/219: creat dc/d26/d31/d32/f4c x:0 0 0 2024-05-09T00:07:29.320 INFO:tasks.workunit.client.1.smithi135.stdout:7/292: getdents db/d13 0 2024-05-09T00:07:29.323 INFO:tasks.workunit.client.1.smithi135.stdout:6/292: rename d2/c15 to d2/da/c66 0 2024-05-09T00:07:29.323 INFO:tasks.workunit.client.1.smithi135.stdout:6/293: fdatasync d2/d1a/f1b 0 2024-05-09T00:07:29.325 INFO:tasks.workunit.client.1.smithi135.stdout:3/265: dwrite d8/d13/d1f/f48 [0,4194304] 0 2024-05-09T00:07:29.325 INFO:tasks.workunit.client.1.smithi135.stdout:5/293: mkdir db/d24/d2f/d31/d5e/d63 0 2024-05-09T00:07:29.326 INFO:tasks.workunit.client.1.smithi135.stdout:2/267: mknod d1/d12/d21/c52 0 2024-05-09T00:07:29.326 INFO:tasks.workunit.client.1.smithi135.stdout:2/268: chown d1/d12/d21/l39 1 1 2024-05-09T00:07:29.326 INFO:tasks.workunit.client.1.smithi135.stdout:2/269: chown d1/d12/d20/d3b 123 1 2024-05-09T00:07:29.327 INFO:tasks.workunit.client.1.smithi135.stdout:8/271: mknod d4/d7/d2a/d56/c59 0 2024-05-09T00:07:29.328 INFO:tasks.workunit.client.1.smithi135.stdout:8/272: write d4/f2b [2305830,88264] 0 2024-05-09T00:07:29.328 INFO:tasks.workunit.client.1.smithi135.stdout:4/220: truncate fa 7370549 0 2024-05-09T00:07:29.329 INFO:tasks.workunit.client.1.smithi135.stdout:8/273: write d4/d7/fc [1509408,5992] 0 2024-05-09T00:07:29.329 INFO:tasks.workunit.client.1.smithi135.stdout:4/221: write f7 [8229269,63063] 0 2024-05-09T00:07:29.329 INFO:tasks.workunit.client.1.smithi135.stdout:8/274: truncate d4/d22/f51 990325 0 2024-05-09T00:07:29.329 INFO:tasks.workunit.client.1.smithi135.stdout:7/293: creat db/f62 x:0 0 0 2024-05-09T00:07:29.331 INFO:tasks.workunit.client.1.smithi135.stdout:9/227: sync 2024-05-09T00:07:29.331 INFO:tasks.workunit.client.1.smithi135.stdout:3/266: rmdir d8/d1a/d44/d4f 39 2024-05-09T00:07:29.332 INFO:tasks.workunit.client.1.smithi135.stdout:3/267: write d8/fe [2886893,66289] 0 2024-05-09T00:07:29.333 INFO:tasks.workunit.client.1.smithi135.stdout:5/294: getdents db 0 2024-05-09T00:07:29.333 INFO:tasks.workunit.client.1.smithi135.stdout:5/295: chown db/d24/d2f/d31 645633 1 2024-05-09T00:07:29.335 INFO:tasks.workunit.client.1.smithi135.stdout:2/270: symlink d1/d12/d20/d2b/l53 0 2024-05-09T00:07:29.344 INFO:tasks.workunit.client.1.smithi135.stdout:8/275: symlink d4/d7/l5a 0 2024-05-09T00:07:29.345 INFO:tasks.workunit.client.1.smithi135.stdout:8/276: truncate d4/d7/de/f57 830308 0 2024-05-09T00:07:29.345 INFO:tasks.workunit.client.1.smithi135.stdout:8/277: getdents d4/d7/d33/d39 0 2024-05-09T00:07:29.345 INFO:tasks.workunit.client.1.smithi135.stdout:7/294: mkdir db/d1e/d63 0 2024-05-09T00:07:29.345 INFO:tasks.workunit.client.1.smithi135.stdout:9/228: rmdir d1/d1a/d2c/d2d 39 2024-05-09T00:07:29.346 INFO:tasks.workunit.client.1.smithi135.stdout:3/268: mkdir d8/d13/d51/d63 0 2024-05-09T00:07:29.346 INFO:tasks.workunit.client.1.smithi135.stdout:3/269: fdatasync d8/f26 0 2024-05-09T00:07:29.347 INFO:tasks.workunit.client.1.smithi135.stdout:3/270: write d8/d13/d1f/d40/d47/f4d [772175,31156] 0 2024-05-09T00:07:29.347 INFO:tasks.workunit.client.1.smithi135.stdout:5/296: creat db/d5d/f64 x:0 0 0 2024-05-09T00:07:29.349 INFO:tasks.workunit.client.1.smithi135.stdout:2/271: rename d1/d22/f3d to d1/d12/d20/f54 0 2024-05-09T00:07:29.349 INFO:tasks.workunit.client.1.smithi135.stdout:2/272: readlink d1/l2f 0 2024-05-09T00:07:29.349 INFO:tasks.workunit.client.1.smithi135.stdout:2/273: stat d1/f1f 0 2024-05-09T00:07:29.352 INFO:tasks.workunit.client.1.smithi135.stdout:7/295: truncate db/d5b/f5c 2439869 0 2024-05-09T00:07:29.353 INFO:tasks.workunit.client.1.smithi135.stdout:7/296: fdatasync db/ff 0 2024-05-09T00:07:29.354 INFO:tasks.workunit.client.1.smithi135.stdout:9/229: getdents d1/d24 0 2024-05-09T00:07:29.354 INFO:tasks.workunit.client.1.smithi135.stdout:9/230: write d1/d1a/d2c/f11 [4506169,21660] 0 2024-05-09T00:07:29.354 INFO:tasks.workunit.client.1.smithi135.stdout:9/231: chown d1/d1a/d10/l15 21525 1 2024-05-09T00:07:29.355 INFO:tasks.workunit.client.1.smithi135.stdout:3/271: creat d8/d13/d51/d63/f64 x:0 0 0 2024-05-09T00:07:29.355 INFO:tasks.workunit.client.1.smithi135.stdout:3/272: write d8/d13/d1f/f2e [186934,127550] 0 2024-05-09T00:07:29.357 INFO:tasks.workunit.client.1.smithi135.stdout:5/297: rmdir db/d24/d2f/d31/d5e/d63 0 2024-05-09T00:07:29.358 INFO:tasks.workunit.client.1.smithi135.stdout:5/298: fsync db/d3f/f5c 0 2024-05-09T00:07:29.359 INFO:tasks.workunit.client.1.smithi135.stdout:4/222: dwrite dc/d26/d31/f3c [0,4194304] 0 2024-05-09T00:07:29.359 INFO:tasks.workunit.client.1.smithi135.stdout:8/278: dread d4/d7/f3d [4194304,4194304] 0 2024-05-09T00:07:29.359 INFO:tasks.workunit.client.1.smithi135.stdout:9/232: write d1/d1a/d2c/d2d/f3b [3580614,17802] 0 2024-05-09T00:07:29.360 INFO:tasks.workunit.client.1.smithi135.stdout:8/279: write d4/d22/f51 [478424,108372] 0 2024-05-09T00:07:29.362 INFO:tasks.workunit.client.1.smithi135.stdout:4/223: symlink dc/d26/d31/d32/d39/l4d 0 2024-05-09T00:07:29.362 INFO:tasks.workunit.client.1.smithi135.stdout:4/224: chown dc/d26/d31/f3e 192788583 1 2024-05-09T00:07:29.363 INFO:tasks.workunit.client.1.smithi135.stdout:5/299: symlink db/d24/d2f/l65 0 2024-05-09T00:07:29.363 INFO:tasks.workunit.client.1.smithi135.stdout:5/300: fsync db/fe 0 2024-05-09T00:07:29.363 INFO:tasks.workunit.client.1.smithi135.stdout:5/301: chown db/d52 5 1 2024-05-09T00:07:29.366 INFO:tasks.workunit.client.1.smithi135.stdout:8/280: symlink d4/d7/l5b 0 2024-05-09T00:07:29.366 INFO:tasks.workunit.client.1.smithi135.stdout:8/281: stat d4/d8 0 2024-05-09T00:07:29.367 INFO:tasks.workunit.client.1.smithi135.stdout:4/225: dread dc/f24 [0,4194304] 0 2024-05-09T00:07:29.367 INFO:tasks.workunit.client.1.smithi135.stdout:8/282: mknod d4/d7/de/d45/c5c 0 2024-05-09T00:07:29.368 INFO:tasks.workunit.client.1.smithi135.stdout:4/226: mkdir dc/d26/d4e 0 2024-05-09T00:07:29.371 INFO:tasks.workunit.client.1.smithi135.stdout:4/227: read dc/f2d [3825428,83182] 0 2024-05-09T00:07:29.386 INFO:tasks.workunit.client.1.smithi135.stdout:7/297: dwrite f8 [0,4194304] 0 2024-05-09T00:07:29.386 INFO:tasks.workunit.client.1.smithi135.stdout:7/298: write db/f42 [378083,75725] 0 2024-05-09T00:07:29.386 INFO:tasks.workunit.client.1.smithi135.stdout:5/302: dwrite db/d24/f34 [0,4194304] 0 2024-05-09T00:07:29.386 INFO:tasks.workunit.client.1.smithi135.stdout:2/274: dwrite d1/d12/d20/f29 [0,4194304] 0 2024-05-09T00:07:29.386 INFO:tasks.workunit.client.1.smithi135.stdout:2/275: readlink d1/d12/d20/d2b/l50 0 2024-05-09T00:07:29.387 INFO:tasks.workunit.client.1.smithi135.stdout:7/299: getdents db/d1e/d3a/d40 0 2024-05-09T00:07:29.394 INFO:tasks.workunit.client.1.smithi135.stdout:2/276: rename d1/d12/d20/f3e to d1/d12/d20/d2b/f55 0 2024-05-09T00:07:29.394 INFO:tasks.workunit.client.1.smithi135.stdout:2/277: chown d1/d12/d20/d2b/f55 13781 1 2024-05-09T00:07:29.394 INFO:tasks.workunit.client.1.smithi135.stdout:2/278: readlink d1/d12/d21/l39 0 2024-05-09T00:07:29.396 INFO:tasks.workunit.client.1.smithi135.stdout:7/300: creat db/d5b/f64 x:0 0 0 2024-05-09T00:07:29.396 INFO:tasks.workunit.client.1.smithi135.stdout:7/301: chown l7 7 1 2024-05-09T00:07:29.397 INFO:tasks.workunit.client.1.smithi135.stdout:2/279: mkdir d1/d12/d20/d2b/d56 0 2024-05-09T00:07:29.399 INFO:tasks.workunit.client.1.smithi135.stdout:5/303: write db/d24/f34 [1316432,62656] 0 2024-05-09T00:07:29.399 INFO:tasks.workunit.client.1.smithi135.stdout:5/304: fsync db/d24/d32/f44 0 2024-05-09T00:07:29.399 INFO:tasks.workunit.client.1.smithi135.stdout:7/302: creat db/dd/f65 x:0 0 0 2024-05-09T00:07:29.399 INFO:tasks.workunit.client.1.smithi135.stdout:7/303: write db/d13/f57 [493711,86794] 0 2024-05-09T00:07:29.401 INFO:tasks.workunit.client.1.smithi135.stdout:2/280: mkdir d1/d12/d21/d57 0 2024-05-09T00:07:29.401 INFO:tasks.workunit.client.1.smithi135.stdout:4/228: dwrite dc/d26/d31/d32/d39/f47 [0,4194304] 0 2024-05-09T00:07:29.401 INFO:tasks.workunit.client.1.smithi135.stdout:5/305: rmdir db/d24/d2f 39 2024-05-09T00:07:29.403 INFO:tasks.workunit.client.1.smithi135.stdout:2/281: creat d1/d12/d21/d57/f58 x:0 0 0 2024-05-09T00:07:29.405 INFO:tasks.workunit.client.1.smithi135.stdout:4/229: rename dc/f34 to dc/d26/f4f 0 2024-05-09T00:07:29.407 INFO:tasks.workunit.client.1.smithi135.stdout:2/282: truncate d1/fa 6447104 0 2024-05-09T00:07:29.409 INFO:tasks.workunit.client.1.smithi135.stdout:4/230: unlink l8 0 2024-05-09T00:07:29.413 INFO:tasks.workunit.client.1.smithi135.stdout:0/253: sync 2024-05-09T00:07:29.414 INFO:tasks.workunit.client.1.smithi135.stdout:4/231: dread f3 [0,4194304] 0 2024-05-09T00:07:29.414 INFO:tasks.workunit.client.1.smithi135.stdout:7/304: dwrite db/dd/f35 [0,4194304] 0 2024-05-09T00:07:29.415 INFO:tasks.workunit.client.1.smithi135.stdout:0/254: mkdir d3/dd/d3f/d43 0 2024-05-09T00:07:29.420 INFO:tasks.workunit.client.1.smithi135.stdout:2/283: dread d1/d12/d21/f38 [0,4194304] 0 2024-05-09T00:07:29.421 INFO:tasks.workunit.client.1.smithi135.stdout:4/232: unlink dc/d26/d31/d32/d39/f47 0 2024-05-09T00:07:29.425 INFO:tasks.workunit.client.1.smithi135.stdout:7/305: dread db/f47 [0,4194304] 0 2024-05-09T00:07:29.425 INFO:tasks.workunit.client.1.smithi135.stdout:7/306: chown db/d21/l44 38616 1 2024-05-09T00:07:29.425 INFO:tasks.workunit.client.1.smithi135.stdout:2/284: dread d1/d12/d21/f38 [0,4194304] 0 2024-05-09T00:07:29.425 INFO:tasks.workunit.client.1.smithi135.stdout:4/233: creat dc/d4a/f50 x:0 0 0 2024-05-09T00:07:29.425 INFO:tasks.workunit.client.1.smithi135.stdout:5/306: dwrite db/d24/d2f/d31/d5e/f55 [0,4194304] 0 2024-05-09T00:07:29.427 INFO:tasks.workunit.client.1.smithi135.stdout:7/307: symlink db/dd/d33/l66 0 2024-05-09T00:07:29.430 INFO:tasks.workunit.client.1.smithi135.stdout:2/285: stat d1/c13 0 2024-05-09T00:07:29.433 INFO:tasks.workunit.client.1.smithi135.stdout:5/307: link db/d24/d2f/l4e db/d24/d32/d5b/l66 0 2024-05-09T00:07:29.433 INFO:tasks.workunit.client.1.smithi135.stdout:5/308: write db/d24/d2f/d31/d5e/f4c [945254,7754] 0 2024-05-09T00:07:29.433 INFO:tasks.workunit.client.1.smithi135.stdout:2/286: mknod d1/d12/d20/d2b/c59 0 2024-05-09T00:07:29.433 INFO:tasks.workunit.client.1.smithi135.stdout:2/287: readlink d1/l2f 0 2024-05-09T00:07:29.434 INFO:tasks.workunit.client.1.smithi135.stdout:5/309: mknod db/d5d/c67 0 2024-05-09T00:07:29.436 INFO:tasks.workunit.client.1.smithi135.stdout:2/288: creat d1/d12/f5a x:0 0 0 2024-05-09T00:07:29.436 INFO:tasks.workunit.client.1.smithi135.stdout:2/289: chown d1/fa 7967327 1 2024-05-09T00:07:29.436 INFO:tasks.workunit.client.1.smithi135.stdout:2/290: truncate d1/d12/d20/d2b/f37 629030 0 2024-05-09T00:07:29.436 INFO:tasks.workunit.client.1.smithi135.stdout:0/255: dwrite d3/dd/d3f/f33 [0,4194304] 0 2024-05-09T00:07:29.436 INFO:tasks.workunit.client.1.smithi135.stdout:0/256: dread - d3/dd/d3f/f41 zero size 2024-05-09T00:07:29.436 INFO:tasks.workunit.client.1.smithi135.stdout:0/257: chown d3/f34 995739 1 2024-05-09T00:07:29.444 INFO:tasks.workunit.client.1.smithi135.stdout:5/310: rmdir db/d5d 39 2024-05-09T00:07:29.445 INFO:tasks.workunit.client.1.smithi135.stdout:5/311: chown db/d24/c26 0 1 2024-05-09T00:07:29.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/312: creat db/d5d/f68 x:0 0 0 2024-05-09T00:07:29.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/313: chown db/cc 542700956 1 2024-05-09T00:07:29.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/314: dread - db/d5d/f64 zero size 2024-05-09T00:07:29.450 INFO:tasks.workunit.client.1.smithi135.stdout:5/315: creat db/d24/d2f/d31/d5e/f69 x:0 0 0 2024-05-09T00:07:29.456 INFO:tasks.workunit.client.1.smithi135.stdout:2/291: dwrite d1/fa [0,4194304] 0 2024-05-09T00:07:29.457 INFO:tasks.workunit.client.1.smithi135.stdout:7/308: dwrite db/d13/f57 [0,4194304] 0 2024-05-09T00:07:29.458 INFO:tasks.workunit.client.1.smithi135.stdout:2/292: write d1/f1c [1029548,127485] 0 2024-05-09T00:07:29.458 INFO:tasks.workunit.client.1.smithi135.stdout:2/293: fsync d1/d12/d21/d57/f58 0 2024-05-09T00:07:29.459 INFO:tasks.workunit.client.1.smithi135.stdout:2/294: readlink d1/l2f 0 2024-05-09T00:07:29.459 INFO:tasks.workunit.client.1.smithi135.stdout:2/295: write d1/d12/f48 [3676437,124118] 0 2024-05-09T00:07:29.460 INFO:tasks.workunit.client.1.smithi135.stdout:7/309: mkdir db/d1e/d3a/d40/d4c/d67 0 2024-05-09T00:07:29.461 INFO:tasks.workunit.client.1.smithi135.stdout:2/296: mknod d1/d12/d27/c5b 0 2024-05-09T00:07:29.461 INFO:tasks.workunit.client.1.smithi135.stdout:2/297: fsync d1/d12/d21/f42 0 2024-05-09T00:07:29.462 INFO:tasks.workunit.client.1.smithi135.stdout:7/310: mkdir db/dd/d33/d68 0 2024-05-09T00:07:29.462 INFO:tasks.workunit.client.1.smithi135.stdout:7/311: truncate db/d1e/d3a/d40/f55 269981 0 2024-05-09T00:07:29.462 INFO:tasks.workunit.client.1.smithi135.stdout:7/312: write db/f62 [157177,44779] 0 2024-05-09T00:07:29.462 INFO:tasks.workunit.client.1.smithi135.stdout:7/313: readlink db/d13/l18 0 2024-05-09T00:07:29.463 INFO:tasks.workunit.client.1.smithi135.stdout:2/298: mkdir d1/d12/d21/d41/d5c 0 2024-05-09T00:07:29.464 INFO:tasks.workunit.client.1.smithi135.stdout:7/314: unlink db/d1e/d3a/f5f 0 2024-05-09T00:07:29.465 INFO:tasks.workunit.client.1.smithi135.stdout:7/315: unlink db/dd/f1b 0 2024-05-09T00:07:29.466 INFO:tasks.workunit.client.1.smithi135.stdout:7/316: truncate f8 520390 0 2024-05-09T00:07:29.467 INFO:tasks.workunit.client.1.smithi135.stdout:7/317: write db/d1e/f36 [675680,88005] 0 2024-05-09T00:07:29.467 INFO:tasks.workunit.client.1.smithi135.stdout:7/318: write db/d1e/f36 [1163007,61907] 0 2024-05-09T00:07:29.467 INFO:tasks.workunit.client.1.smithi135.stdout:7/319: chown db/dd/f14 480 1 2024-05-09T00:07:29.467 INFO:tasks.workunit.client.1.smithi135.stdout:7/320: mkdir db/dd/d33/d69 0 2024-05-09T00:07:29.468 INFO:tasks.workunit.client.1.smithi135.stdout:7/321: creat db/d1e/d3a/d40/f6a x:0 0 0 2024-05-09T00:07:29.468 INFO:tasks.workunit.client.1.smithi135.stdout:7/322: readlink db/d21/l44 0 2024-05-09T00:07:29.470 INFO:tasks.workunit.client.1.smithi135.stdout:7/323: creat db/d1e/d3a/d40/d4c/f6b x:0 0 0 2024-05-09T00:07:29.471 INFO:tasks.workunit.client.1.smithi135.stdout:0/258: dwrite d3/dd/d3f/f41 [0,4194304] 0 2024-05-09T00:07:29.471 INFO:tasks.workunit.client.1.smithi135.stdout:5/316: dwrite db/d5d/f64 [0,4194304] 0 2024-05-09T00:07:29.471 INFO:tasks.workunit.client.1.smithi135.stdout:7/324: write db/f30 [12825,56080] 0 2024-05-09T00:07:29.476 INFO:tasks.workunit.client.1.smithi135.stdout:0/259: mknod d3/dd/d2d/c44 0 2024-05-09T00:07:29.478 INFO:tasks.workunit.client.1.smithi135.stdout:7/325: mknod db/d1e/c6c 0 2024-05-09T00:07:29.479 INFO:tasks.workunit.client.1.smithi135.stdout:0/260: rmdir d3/dd/d2c 39 2024-05-09T00:07:29.480 INFO:tasks.workunit.client.1.smithi135.stdout:7/326: rmdir db/d13 39 2024-05-09T00:07:29.480 INFO:tasks.workunit.client.1.smithi135.stdout:7/327: stat db/d21/c3c 0 2024-05-09T00:07:29.481 INFO:tasks.workunit.client.1.smithi135.stdout:0/261: mknod d3/dd/d3f/d43/c45 0 2024-05-09T00:07:29.483 INFO:tasks.workunit.client.1.smithi135.stdout:7/328: rmdir db/d21/d60 0 2024-05-09T00:07:29.483 INFO:tasks.workunit.client.1.smithi135.stdout:7/329: chown db/d5b/f64 110 1 2024-05-09T00:07:29.483 INFO:tasks.workunit.client.1.smithi135.stdout:7/330: dread - db/d1e/d3a/d40/d4c/f53 zero size 2024-05-09T00:07:29.484 INFO:tasks.workunit.client.1.smithi135.stdout:5/317: dwrite db/f15 [0,4194304] 0 2024-05-09T00:07:29.484 INFO:tasks.workunit.client.1.smithi135.stdout:5/318: fdatasync db/d24/d2f/f43 0 2024-05-09T00:07:29.484 INFO:tasks.workunit.client.1.smithi135.stdout:5/319: truncate db/f2e 1131228 0 2024-05-09T00:07:29.485 INFO:tasks.workunit.client.1.smithi135.stdout:7/331: rename db/d1e/d3a/d40/d4c/l4d to db/dd/d33/d58/l6d 0 2024-05-09T00:07:29.489 INFO:tasks.workunit.client.1.smithi135.stdout:0/262: dread d3/f16 [0,4194304] 0 2024-05-09T00:07:29.489 INFO:tasks.workunit.client.1.smithi135.stdout:0/263: read - d3/dd/d2d/f40 zero size 2024-05-09T00:07:29.489 INFO:tasks.workunit.client.1.smithi135.stdout:5/320: creat db/d24/d32/d5b/f6a x:0 0 0 2024-05-09T00:07:29.489 INFO:tasks.workunit.client.1.smithi135.stdout:5/321: write db/fe [4289704,105590] 0 2024-05-09T00:07:29.489 INFO:tasks.workunit.client.1.smithi135.stdout:5/322: write db/d3f/f57 [343355,115675] 0 2024-05-09T00:07:29.490 INFO:tasks.workunit.client.1.smithi135.stdout:5/323: chown db/d24/c4a 72 1 2024-05-09T00:07:29.490 INFO:tasks.workunit.client.1.smithi135.stdout:7/332: creat db/d1e/d3a/d40/d4c/d67/f6e x:0 0 0 2024-05-09T00:07:29.492 INFO:tasks.workunit.client.1.smithi135.stdout:0/264: rename d3/dd/d2c to d3/dd/d3f/d3a/d46 0 2024-05-09T00:07:29.493 INFO:tasks.workunit.client.1.smithi135.stdout:5/324: creat db/d52/f6b x:0 0 0 2024-05-09T00:07:29.493 INFO:tasks.workunit.client.1.smithi135.stdout:6/294: sync 2024-05-09T00:07:29.493 INFO:tasks.workunit.client.1.smithi135.stdout:1/291: sync 2024-05-09T00:07:29.494 INFO:tasks.workunit.client.1.smithi135.stdout:7/333: rmdir db/d13 39 2024-05-09T00:07:29.494 INFO:tasks.workunit.client.1.smithi135.stdout:7/334: readlink db/d1e/d3a/d40/l5a 0 2024-05-09T00:07:29.494 INFO:tasks.workunit.client.1.smithi135.stdout:7/335: chown db/d13/l2b 603146243 1 2024-05-09T00:07:29.494 INFO:tasks.workunit.client.1.smithi135.stdout:7/336: fdatasync db/dd/f1c 0 2024-05-09T00:07:29.494 INFO:tasks.workunit.client.1.smithi135.stdout:1/292: dread da/f10 [0,4194304] 0 2024-05-09T00:07:29.495 INFO:tasks.workunit.client.1.smithi135.stdout:0/265: truncate d3/dd/d3f/f27 3604291 0 2024-05-09T00:07:29.495 INFO:tasks.workunit.client.1.smithi135.stdout:0/266: fsync d3/dd/d2d/f40 0 2024-05-09T00:07:29.502 INFO:tasks.workunit.client.1.smithi135.stdout:0/267: read d3/dd/d3f/f21 [2930479,2217] 0 2024-05-09T00:07:29.502 INFO:tasks.workunit.client.1.smithi135.stdout:0/268: chown d3/dd/f13 797187 1 2024-05-09T00:07:29.502 INFO:tasks.workunit.client.1.smithi135.stdout:0/269: stat d3/dd/d3f/f33 0 2024-05-09T00:07:29.504 INFO:tasks.workunit.client.1.smithi135.stdout:6/295: dread d2/da/f3b [0,4194304] 0 2024-05-09T00:07:29.507 INFO:tasks.workunit.client.1.smithi135.stdout:6/296: write d2/da/fb [2181579,15484] 0 2024-05-09T00:07:29.508 INFO:tasks.workunit.client.1.smithi135.stdout:6/297: write d2/da/d49/f64 [344480,124400] 0 2024-05-09T00:07:29.512 INFO:tasks.workunit.client.1.smithi135.stdout:6/298: write d2/d20/d3f/f52 [735429,85629] 0 2024-05-09T00:07:29.514 INFO:tasks.workunit.client.1.smithi135.stdout:6/299: creat d2/da/d49/f67 x:0 0 0 2024-05-09T00:07:29.516 INFO:tasks.workunit.client.1.smithi135.stdout:6/300: mknod d2/da/d49/c68 0 2024-05-09T00:07:29.516 INFO:tasks.workunit.client.1.smithi135.stdout:6/301: readlink d2/l51 0 2024-05-09T00:07:29.516 INFO:tasks.workunit.client.1.smithi135.stdout:6/302: truncate d2/d1a/f30 5152247 0 2024-05-09T00:07:29.518 INFO:tasks.workunit.client.1.smithi135.stdout:6/303: mkdir d2/da/d1d/d69 0 2024-05-09T00:07:29.518 INFO:tasks.workunit.client.1.smithi135.stdout:6/304: write d2/d20/d37/f54 [789655,56533] 0 2024-05-09T00:07:29.518 INFO:tasks.workunit.client.1.smithi135.stdout:6/305: write d2/f25 [5117278,5761] 0 2024-05-09T00:07:29.520 INFO:tasks.workunit.client.1.smithi135.stdout:6/306: creat d2/d20/d37/d4e/f6a x:0 0 0 2024-05-09T00:07:29.520 INFO:tasks.workunit.client.1.smithi135.stdout:6/307: write d2/d20/d2e/d3d/f48 [1517001,24985] 0 2024-05-09T00:07:29.529 INFO:tasks.workunit.client.1.smithi135.stdout:7/337: dwrite db/dd/f4b [0,4194304] 0 2024-05-09T00:07:29.530 INFO:tasks.workunit.client.1.smithi135.stdout:5/325: dwrite db/d3f/f5f [0,4194304] 0 2024-05-09T00:07:29.530 INFO:tasks.workunit.client.1.smithi135.stdout:1/293: dwrite da/db/f61 [0,4194304] 0 2024-05-09T00:07:29.530 INFO:tasks.workunit.client.1.smithi135.stdout:6/308: fdatasync d2/f2a 0 2024-05-09T00:07:29.530 INFO:tasks.workunit.client.1.smithi135.stdout:0/270: dwrite d3/dd/d3f/f36 [0,4194304] 0 2024-05-09T00:07:29.534 INFO:tasks.workunit.client.1.smithi135.stdout:0/271: write d3/dd/f22 [1181286,111553] 0 2024-05-09T00:07:29.537 INFO:tasks.workunit.client.1.smithi135.stdout:5/326: dread db/f2e [0,4194304] 0 2024-05-09T00:07:29.537 INFO:tasks.workunit.client.1.smithi135.stdout:5/327: truncate db/d3f/f61 885215 0 2024-05-09T00:07:29.538 INFO:tasks.workunit.client.1.smithi135.stdout:6/309: dread d2/d1a/f30 [0,4194304] 0 2024-05-09T00:07:29.539 INFO:tasks.workunit.client.1.smithi135.stdout:0/272: link d3/f34 d3/dd/d3f/d29/f47 0 2024-05-09T00:07:29.539 INFO:tasks.workunit.client.1.smithi135.stdout:6/310: write d2/d20/f36 [1028541,10952] 0 2024-05-09T00:07:29.544 INFO:tasks.workunit.client.1.smithi135.stdout:0/273: rename d3/dd/f13 to d3/dd/d3f/d3a/f48 0 2024-05-09T00:07:29.546 INFO:tasks.workunit.client.1.smithi135.stdout:1/294: dread da/f13 [0,4194304] 0 2024-05-09T00:07:29.547 INFO:tasks.workunit.client.1.smithi135.stdout:1/295: readlink da/db/l30 0 2024-05-09T00:07:29.548 INFO:tasks.workunit.client.1.smithi135.stdout:6/311: rename d2/d1a/c42 to d2/d1a/c6b 0 2024-05-09T00:07:29.552 INFO:tasks.workunit.client.1.smithi135.stdout:6/312: link d2/f58 d2/da/d26/d57/f6c 0 2024-05-09T00:07:29.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/313: dread d2/fc [4194304,4194304] 0 2024-05-09T00:07:29.558 INFO:tasks.workunit.client.1.smithi135.stdout:6/314: creat d2/d5f/f6d x:0 0 0 2024-05-09T00:07:29.558 INFO:tasks.workunit.client.1.smithi135.stdout:6/315: chown d2/l13 470115 1 2024-05-09T00:07:29.558 INFO:tasks.workunit.client.1.smithi135.stdout:7/338: dwrite db/d1e/d3a/d40/d4c/d67/f6e [0,4194304] 0 2024-05-09T00:07:29.560 INFO:tasks.workunit.client.1.smithi135.stdout:5/328: dwrite db/d3f/f5f [0,4194304] 0 2024-05-09T00:07:29.560 INFO:tasks.workunit.client.1.smithi135.stdout:5/329: getdents db 0 2024-05-09T00:07:29.563 INFO:tasks.workunit.client.1.smithi135.stdout:4/234: sync 2024-05-09T00:07:29.563 INFO:tasks.workunit.client.1.smithi135.stdout:9/233: sync 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:3/273: sync 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:3/274: chown d8/d13/d1f/d40/f3d 990 1 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:3/275: readlink d8/d13/l3e 0 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:8/283: sync 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:8/284: chown d4/d7/d33/d39/l54 949679 1 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:8/285: chown d4/d7/d2a 10558 1 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:0/274: dwrite d3/dd/d2d/f40 [0,4194304] 0 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:0/275: write d3/dd/d3f/d3a/d46/f3d [363474,62402] 0 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:2/299: sync 2024-05-09T00:07:29.566 INFO:tasks.workunit.client.1.smithi135.stdout:7/339: truncate db/f47 450713 0 2024-05-09T00:07:29.567 INFO:tasks.workunit.client.1.smithi135.stdout:6/316: dread d2/da/d49/f64 [0,4194304] 0 2024-05-09T00:07:29.568 INFO:tasks.workunit.client.1.smithi135.stdout:4/235: creat dc/d26/d31/d32/f51 x:0 0 0 2024-05-09T00:07:29.568 INFO:tasks.workunit.client.1.smithi135.stdout:4/236: fsync dc/f27 0 2024-05-09T00:07:29.569 INFO:tasks.workunit.client.1.smithi135.stdout:3/276: unlink d8/c21 0 2024-05-09T00:07:29.571 INFO:tasks.workunit.client.1.smithi135.stdout:3/277: dread d8/d13/d1f/f2e [0,4194304] 0 2024-05-09T00:07:29.572 INFO:tasks.workunit.client.1.smithi135.stdout:3/278: readlink d8/d13/d1f/d40/l45 0 2024-05-09T00:07:29.572 INFO:tasks.workunit.client.1.smithi135.stdout:0/276: creat d3/dd/d2d/f49 x:0 0 0 2024-05-09T00:07:29.573 INFO:tasks.workunit.client.1.smithi135.stdout:0/277: truncate d3/dd/f14 1142580 0 2024-05-09T00:07:29.573 INFO:tasks.workunit.client.1.smithi135.stdout:0/278: fdatasync d3/dd/d3f/d3a/f48 0 2024-05-09T00:07:29.574 INFO:tasks.workunit.client.1.smithi135.stdout:2/300: symlink d1/d12/d20/d2b/d56/l5d 0 2024-05-09T00:07:29.574 INFO:tasks.workunit.client.1.smithi135.stdout:1/296: dwrite da/f62 [0,4194304] 0 2024-05-09T00:07:29.574 INFO:tasks.workunit.client.1.smithi135.stdout:2/301: fsync d1/d12/f1b 0 2024-05-09T00:07:29.575 INFO:tasks.workunit.client.1.smithi135.stdout:7/340: creat db/d13/f6f x:0 0 0 2024-05-09T00:07:29.580 INFO:tasks.workunit.client.1.smithi135.stdout:8/286: dread d4/f20 [0,4194304] 0 2024-05-09T00:07:29.583 INFO:tasks.workunit.client.1.smithi135.stdout:8/287: dread d4/d22/f51 [0,4194304] 0 2024-05-09T00:07:29.585 INFO:tasks.workunit.client.1.smithi135.stdout:3/279: creat d8/d1a/d44/d4b/d59/f65 x:0 0 0 2024-05-09T00:07:29.585 INFO:tasks.workunit.client.1.smithi135.stdout:8/288: dread d4/d7/de/f14 [0,4194304] 0 2024-05-09T00:07:29.585 INFO:tasks.workunit.client.1.smithi135.stdout:8/289: stat d4/d7/f52 0 2024-05-09T00:07:29.590 INFO:tasks.workunit.client.1.smithi135.stdout:0/279: link d3/f16 d3/dd/d3f/d3a/f4a 0 2024-05-09T00:07:29.594 INFO:tasks.workunit.client.1.smithi135.stdout:2/302: creat d1/d12/d20/d3b/d40/f5e x:0 0 0 2024-05-09T00:07:29.596 INFO:tasks.workunit.client.1.smithi135.stdout:7/341: truncate db/d5b/f5c 1138745 0 2024-05-09T00:07:29.596 INFO:tasks.workunit.client.1.smithi135.stdout:7/342: stat db 0 2024-05-09T00:07:29.598 INFO:tasks.workunit.client.1.smithi135.stdout:3/280: mknod d8/d1a/c66 0 2024-05-09T00:07:29.598 INFO:tasks.workunit.client.1.smithi135.stdout:7/343: write db/dd/f2d [2552303,65054] 0 2024-05-09T00:07:29.598 INFO:tasks.workunit.client.1.smithi135.stdout:7/344: chown db/d1e/d3a/d40/f6a 7626 1 2024-05-09T00:07:29.600 INFO:tasks.workunit.client.1.smithi135.stdout:8/290: unlink d4/f46 0 2024-05-09T00:07:29.600 INFO:tasks.workunit.client.1.smithi135.stdout:8/291: fsync d4/f2b 0 2024-05-09T00:07:29.601 INFO:tasks.workunit.client.1.smithi135.stdout:0/280: mknod d3/dd/d2d/c4b 0 2024-05-09T00:07:29.601 INFO:tasks.workunit.client.1.smithi135.stdout:0/281: chown d3/dd/d2d/l3c 527078660 1 2024-05-09T00:07:29.606 INFO:tasks.workunit.client.1.smithi135.stdout:4/237: dwrite f7 [4194304,4194304] 0 2024-05-09T00:07:29.606 INFO:tasks.workunit.client.1.smithi135.stdout:1/297: dwrite da/f13 [0,4194304] 0 2024-05-09T00:07:29.606 INFO:tasks.workunit.client.1.smithi135.stdout:1/298: fsync da/db/fe 0 2024-05-09T00:07:29.606 INFO:tasks.workunit.client.1.smithi135.stdout:1/299: chown da/d24/d27/d33/d36 10 1 2024-05-09T00:07:29.606 INFO:tasks.workunit.client.1.smithi135.stdout:1/300: readlink da/d24/d27/d33/d36/l5b 0 2024-05-09T00:07:29.608 INFO:tasks.workunit.client.1.smithi135.stdout:3/281: creat d8/d1a/d44/d4f/d53/f67 x:0 0 0 2024-05-09T00:07:29.608 INFO:tasks.workunit.client.1.smithi135.stdout:2/303: creat d1/d12/d20/d3b/f5f x:0 0 0 2024-05-09T00:07:29.608 INFO:tasks.workunit.client.1.smithi135.stdout:7/345: mknod db/d1e/c70 0 2024-05-09T00:07:29.608 INFO:tasks.workunit.client.1.smithi135.stdout:0/282: mkdir d3/dd/d2d/d4c 0 2024-05-09T00:07:29.608 INFO:tasks.workunit.client.1.smithi135.stdout:3/282: write d8/d13/d1f/d40/d47/f4d [1623916,105281] 0 2024-05-09T00:07:29.608 INFO:tasks.workunit.client.1.smithi135.stdout:3/283: read d8/d13/f46 [157834,60348] 0 2024-05-09T00:07:29.608 INFO:tasks.workunit.client.1.smithi135.stdout:9/234: dwrite d1/d1a/d2c/d2d/f3b [0,4194304] 0 2024-05-09T00:07:29.614 INFO:tasks.workunit.client.1.smithi135.stdout:1/301: getdents da/db/d16 0 2024-05-09T00:07:29.616 INFO:tasks.workunit.client.1.smithi135.stdout:8/292: dwrite d4/d22/f27 [0,4194304] 0 2024-05-09T00:07:29.616 INFO:tasks.workunit.client.1.smithi135.stdout:8/293: stat d4/d7/l5a 0 2024-05-09T00:07:29.617 INFO:tasks.workunit.client.1.smithi135.stdout:2/304: creat d1/d12/d20/f60 x:0 0 0 2024-05-09T00:07:29.617 INFO:tasks.workunit.client.1.smithi135.stdout:8/294: write d4/f16 [2022482,1237] 0 2024-05-09T00:07:29.619 INFO:tasks.workunit.client.1.smithi135.stdout:7/346: creat db/d5b/f71 x:0 0 0 2024-05-09T00:07:29.619 INFO:tasks.workunit.client.1.smithi135.stdout:7/347: chown db/d13/f24 276983118 1 2024-05-09T00:07:29.620 INFO:tasks.workunit.client.1.smithi135.stdout:7/348: readlink db/d21/l44 0 2024-05-09T00:07:29.620 INFO:tasks.workunit.client.1.smithi135.stdout:7/349: readlink db/dd/l2f 0 2024-05-09T00:07:29.621 INFO:tasks.workunit.client.1.smithi135.stdout:0/283: rmdir d3/dd/d3f/d3a/d46 39 2024-05-09T00:07:29.621 INFO:tasks.workunit.client.1.smithi135.stdout:0/284: read d3/dd/d3f/d3a/d46/f3d [306589,38562] 0 2024-05-09T00:07:29.622 INFO:tasks.workunit.client.1.smithi135.stdout:7/350: write db/dd/f4b [2749043,121196] 0 2024-05-09T00:07:29.627 INFO:tasks.workunit.client.1.smithi135.stdout:3/284: dwrite d8/d13/d1f/f30 [0,4194304] 0 2024-05-09T00:07:29.628 INFO:tasks.workunit.client.1.smithi135.stdout:4/238: unlink dc/d26/d31/d32/d39/l36 0 2024-05-09T00:07:29.633 INFO:tasks.workunit.client.1.smithi135.stdout:1/302: link da/f63 da/d14/d5c/f6b 0 2024-05-09T00:07:29.634 INFO:tasks.workunit.client.1.smithi135.stdout:1/303: readlink da/d24/d27/d33/d48/l4a 0 2024-05-09T00:07:29.637 INFO:tasks.workunit.client.1.smithi135.stdout:2/305: dwrite d1/f1f [4194304,4194304] 0 2024-05-09T00:07:29.638 INFO:tasks.workunit.client.1.smithi135.stdout:8/295: mknod d4/c5d 0 2024-05-09T00:07:29.638 INFO:tasks.workunit.client.1.smithi135.stdout:8/296: truncate d4/f58 104198 0 2024-05-09T00:07:29.638 INFO:tasks.workunit.client.1.smithi135.stdout:8/297: chown d4/d7/de/d45/c4b 38 1 2024-05-09T00:07:29.639 INFO:tasks.workunit.client.1.smithi135.stdout:2/306: write d1/d12/d20/f29 [2042219,4945] 0 2024-05-09T00:07:29.642 INFO:tasks.workunit.client.1.smithi135.stdout:0/285: unlink d3/f16 0 2024-05-09T00:07:29.642 INFO:tasks.workunit.client.1.smithi135.stdout:7/351: link db/dd/d33/d58/l6d db/d1e/l72 0 2024-05-09T00:07:29.644 INFO:tasks.workunit.client.1.smithi135.stdout:7/352: write db/d13/f2a [3479073,98552] 0 2024-05-09T00:07:29.644 INFO:tasks.workunit.client.1.smithi135.stdout:7/353: fsync db/f16 0 2024-05-09T00:07:29.644 INFO:tasks.workunit.client.1.smithi135.stdout:7/354: stat db/dd/f65 0 2024-05-09T00:07:29.644 INFO:tasks.workunit.client.1.smithi135.stdout:7/355: chown db/d13/f6f 55808 1 2024-05-09T00:07:29.644 INFO:tasks.workunit.client.1.smithi135.stdout:7/356: readlink db/dd/d33/l66 0 2024-05-09T00:07:29.644 INFO:tasks.workunit.client.1.smithi135.stdout:0/286: dread d3/dd/d3f/d29/f2e [0,4194304] 0 2024-05-09T00:07:29.644 INFO:tasks.workunit.client.1.smithi135.stdout:9/235: mknod d1/d1a/d10/c3f 0 2024-05-09T00:07:29.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:27.903274+0000 mgr.smithi135.kkrhgf (mgr.24419) 43 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 357 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s rd, 22 MiB/s wr, 363 op/s 2024-05-09T00:07:29.646 INFO:tasks.workunit.client.1.smithi135.stdout:4/239: mknod dc/d4a/c52 0 2024-05-09T00:07:29.646 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:27.903274+0000 mgr.smithi135.kkrhgf (mgr.24419) 43 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 357 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s rd, 22 MiB/s wr, 363 op/s 2024-05-09T00:07:29.649 INFO:tasks.workunit.client.1.smithi135.stdout:3/285: dwrite d8/d1a/f31 [0,4194304] 0 2024-05-09T00:07:29.650 INFO:tasks.workunit.client.1.smithi135.stdout:1/304: link da/d14/d20/d2c/f32 da/db/d16/f6c 0 2024-05-09T00:07:29.652 INFO:tasks.workunit.client.1.smithi135.stdout:8/298: mknod d4/d7/d2a/d56/c5e 0 2024-05-09T00:07:29.652 INFO:tasks.workunit.client.1.smithi135.stdout:8/299: dread - d4/d7/f2f zero size 2024-05-09T00:07:29.653 INFO:tasks.workunit.client.1.smithi135.stdout:2/307: readlink d1/le 0 2024-05-09T00:07:29.656 INFO:tasks.workunit.client.1.smithi135.stdout:7/357: unlink db/d21/l31 0 2024-05-09T00:07:29.658 INFO:tasks.workunit.client.1.smithi135.stdout:0/287: getdents d3/dd/d3f/d43 0 2024-05-09T00:07:29.661 INFO:tasks.workunit.client.1.smithi135.stdout:9/236: getdents d1 0 2024-05-09T00:07:29.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/308: dread d1/d22/f43 [0,4194304] 0 2024-05-09T00:07:29.677 INFO:tasks.workunit.client.1.smithi135.stdout:3/286: symlink d8/d1a/d44/l68 0 2024-05-09T00:07:29.679 INFO:tasks.workunit.client.1.smithi135.stdout:1/305: getdents da/d14/d5c 0 2024-05-09T00:07:29.682 INFO:tasks.workunit.client.1.smithi135.stdout:8/300: unlink d4/d7/de/c1b 0 2024-05-09T00:07:29.685 INFO:tasks.workunit.client.1.smithi135.stdout:7/358: creat db/d13/f73 x:0 0 0 2024-05-09T00:07:29.685 INFO:tasks.workunit.client.1.smithi135.stdout:7/359: fdatasync db/dd/f4b 0 2024-05-09T00:07:29.685 INFO:tasks.workunit.client.1.smithi135.stdout:7/360: chown db/d5b 27757 1 2024-05-09T00:07:29.686 INFO:tasks.workunit.client.1.smithi135.stdout:7/361: truncate db/d1e/d3a/d40/d4c/f53 277833 0 2024-05-09T00:07:29.687 INFO:tasks.workunit.client.1.smithi135.stdout:0/288: symlink d3/dd/l4d 0 2024-05-09T00:07:29.687 INFO:tasks.workunit.client.1.smithi135.stdout:7/362: dread db/f37 [0,4194304] 0 2024-05-09T00:07:29.688 INFO:tasks.workunit.client.1.smithi135.stdout:7/363: write db/d13/f2a [5230524,89019] 0 2024-05-09T00:07:29.688 INFO:tasks.workunit.client.1.smithi135.stdout:7/364: chown db/d1e/d3a/c3e 8384241 1 2024-05-09T00:07:29.688 INFO:tasks.workunit.client.1.smithi135.stdout:9/237: mknod d1/d1a/d10/d3c/c40 0 2024-05-09T00:07:29.690 INFO:tasks.workunit.client.1.smithi135.stdout:2/309: rmdir d1/d12/d20 39 2024-05-09T00:07:29.695 INFO:tasks.workunit.client.1.smithi135.stdout:1/306: creat da/d24/d27/d33/f6d x:0 0 0 2024-05-09T00:07:29.698 INFO:tasks.workunit.client.1.smithi135.stdout:8/301: symlink d4/l5f 0 2024-05-09T00:07:29.700 INFO:tasks.workunit.client.1.smithi135.stdout:0/289: creat d3/dd/f4e x:0 0 0 2024-05-09T00:07:29.701 INFO:tasks.workunit.client.1.smithi135.stdout:3/287: dwrite d8/d1a/f31 [0,4194304] 0 2024-05-09T00:07:29.701 INFO:tasks.workunit.client.1.smithi135.stdout:3/288: dread - d8/d13/d1f/f43 zero size 2024-05-09T00:07:29.701 INFO:tasks.workunit.client.1.smithi135.stdout:3/289: write f3 [4499259,91386] 0 2024-05-09T00:07:29.755 INFO:tasks.workunit.client.1.smithi135.stdout:7/365: symlink db/dd/d33/d68/l74 0 2024-05-09T00:07:29.755 INFO:tasks.workunit.client.1.smithi135.stdout:7/366: readlink db/dd/l2f 0 2024-05-09T00:07:29.755 INFO:tasks.workunit.client.1.smithi135.stdout:7/367: chown db/d13/l26 17435746 1 2024-05-09T00:07:29.773 INFO:tasks.workunit.client.1.smithi135.stdout:7/368: dwrite db/d5b/f5c [0,4194304] 0 2024-05-09T00:07:29.792 INFO:tasks.workunit.client.1.smithi135.stdout:2/310: symlink d1/d12/d21/d41/d5c/l61 0 2024-05-09T00:07:29.794 INFO:tasks.workunit.client.1.smithi135.stdout:0/290: creat d3/f4f x:0 0 0 2024-05-09T00:07:29.794 INFO:tasks.workunit.client.1.smithi135.stdout:0/291: readlink d3/dd/d2d/l3e 0 2024-05-09T00:07:29.796 INFO:tasks.workunit.client.1.smithi135.stdout:5/330: sync 2024-05-09T00:07:29.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/317: sync 2024-05-09T00:07:29.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/318: readlink d2/da/d26/d57/d60/l61 0 2024-05-09T00:07:29.803 INFO:tasks.workunit.client.1.smithi135.stdout:9/238: rename d1/d1a/d2c/d20/f34 to d1/d1a/d10/f41 0 2024-05-09T00:07:29.806 INFO:tasks.workunit.client.1.smithi135.stdout:7/369: creat db/dd/d33/d69/f75 x:0 0 0 2024-05-09T00:07:29.806 INFO:tasks.workunit.client.1.smithi135.stdout:0/292: dread d3/dd/d3f/f33 [0,4194304] 0 2024-05-09T00:07:29.807 INFO:tasks.workunit.client.1.smithi135.stdout:0/293: write d3/dd/d2d/f40 [149809,97983] 0 2024-05-09T00:07:29.807 INFO:tasks.workunit.client.1.smithi135.stdout:0/294: getdents d3/dd/d2d/d4c 0 2024-05-09T00:07:29.809 INFO:tasks.workunit.client.1.smithi135.stdout:2/311: creat d1/d12/d27/f62 x:0 0 0 2024-05-09T00:07:29.809 INFO:tasks.workunit.client.1.smithi135.stdout:2/312: stat d1/d12/c18 0 2024-05-09T00:07:29.811 INFO:tasks.workunit.client.1.smithi135.stdout:5/331: link db/d24/d2f/l56 db/l6c 0 2024-05-09T00:07:29.814 INFO:tasks.workunit.client.1.smithi135.stdout:6/319: dwrite d2/f9 [0,4194304] 0 2024-05-09T00:07:29.815 INFO:tasks.workunit.client.1.smithi135.stdout:6/320: write d2/da/d26/f3c [959513,79129] 0 2024-05-09T00:07:29.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/290: rename d8/d13/d1f/d40/d47 to d8/d1a/d44/d4b/d69 0 2024-05-09T00:07:29.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/291: write d8/d1a/d44/d4b/d69/f4d [86400,114385] 0 2024-05-09T00:07:29.821 INFO:tasks.workunit.client.1.smithi135.stdout:7/370: symlink db/d1e/d3a/d40/d4c/d67/l76 0 2024-05-09T00:07:29.824 INFO:tasks.workunit.client.1.smithi135.stdout:6/321: dread d2/fc [0,4194304] 0 2024-05-09T00:07:29.824 INFO:tasks.workunit.client.1.smithi135.stdout:2/313: mkdir d1/d22/d63 0 2024-05-09T00:07:29.826 INFO:tasks.workunit.client.1.smithi135.stdout:5/332: creat db/d5d/f6d x:0 0 0 2024-05-09T00:07:29.826 INFO:tasks.workunit.client.1.smithi135.stdout:5/333: dread - db/d5d/f6d zero size 2024-05-09T00:07:29.827 INFO:tasks.workunit.client.1.smithi135.stdout:6/322: dread d2/fc [0,4194304] 0 2024-05-09T00:07:29.827 INFO:tasks.workunit.client.1.smithi135.stdout:0/295: dwrite d3/dd/d3f/f33 [0,4194304] 0 2024-05-09T00:07:29.827 INFO:tasks.workunit.client.1.smithi135.stdout:6/323: chown d2/d20/d37/d4e/f6a 871746481 1 2024-05-09T00:07:29.829 INFO:tasks.workunit.client.1.smithi135.stdout:3/292: mkdir d8/d1a/d44/d4f/d53/d6a 0 2024-05-09T00:07:29.830 INFO:tasks.workunit.client.1.smithi135.stdout:3/293: write d8/d1a/d44/d4b/f60 [714954,24101] 0 2024-05-09T00:07:29.833 INFO:tasks.workunit.client.1.smithi135.stdout:2/314: creat d1/d12/d20/d3b/d4f/f64 x:0 0 0 2024-05-09T00:07:29.835 INFO:tasks.workunit.client.1.smithi135.stdout:5/334: getdents db/d24/d2f/d31 0 2024-05-09T00:07:29.835 INFO:tasks.workunit.client.1.smithi135.stdout:4/240: sync 2024-05-09T00:07:29.836 INFO:tasks.workunit.client.1.smithi135.stdout:0/296: dread d3/f15 [0,4194304] 0 2024-05-09T00:07:29.838 INFO:tasks.workunit.client.1.smithi135.stdout:6/324: symlink d2/d20/d3f/l6e 0 2024-05-09T00:07:29.838 INFO:tasks.workunit.client.1.smithi135.stdout:8/302: sync 2024-05-09T00:07:29.838 INFO:tasks.workunit.client.1.smithi135.stdout:1/307: sync 2024-05-09T00:07:29.838 INFO:tasks.workunit.client.1.smithi135.stdout:1/308: dread - da/d24/d27/d33/f60 zero size 2024-05-09T00:07:29.842 INFO:tasks.workunit.client.1.smithi135.stdout:3/294: creat d8/d13/d1f/f6b x:0 0 0 2024-05-09T00:07:29.843 INFO:tasks.workunit.client.1.smithi135.stdout:9/239: unlink d1/d1a/d10/f41 0 2024-05-09T00:07:29.845 INFO:tasks.workunit.client.1.smithi135.stdout:5/335: mkdir db/d24/d2f/d31/d6e 0 2024-05-09T00:07:29.847 INFO:tasks.workunit.client.1.smithi135.stdout:7/371: rmdir db/dd/d33 39 2024-05-09T00:07:29.848 INFO:tasks.workunit.client.1.smithi135.stdout:4/241: creat dc/dd/d1f/f53 x:0 0 0 2024-05-09T00:07:29.848 INFO:tasks.workunit.client.1.smithi135.stdout:8/303: dread d4/d22/f27 [0,4194304] 0 2024-05-09T00:07:29.849 INFO:tasks.workunit.client.1.smithi135.stdout:6/325: dread d2/f2c [0,4194304] 0 2024-05-09T00:07:29.849 INFO:tasks.workunit.client.1.smithi135.stdout:2/315: dwrite d1/d22/f43 [0,4194304] 0 2024-05-09T00:07:29.850 INFO:tasks.workunit.client.1.smithi135.stdout:0/297: write d3/dd/d3f/d3a/f48 [2217244,112591] 0 2024-05-09T00:07:29.851 INFO:tasks.workunit.client.1.smithi135.stdout:1/309: creat da/d24/d27/f6e x:0 0 0 2024-05-09T00:07:29.853 INFO:tasks.workunit.client.1.smithi135.stdout:3/295: mknod d8/d13/c6c 0 2024-05-09T00:07:29.854 INFO:tasks.workunit.client.1.smithi135.stdout:3/296: write d8/f11 [360637,78107] 0 2024-05-09T00:07:29.855 INFO:tasks.workunit.client.1.smithi135.stdout:9/240: creat d1/d1a/f42 x:0 0 0 2024-05-09T00:07:29.857 INFO:tasks.workunit.client.1.smithi135.stdout:5/336: mknod db/d24/d2f/d62/c6f 0 2024-05-09T00:07:29.859 INFO:tasks.workunit.client.1.smithi135.stdout:7/372: unlink db/dd/f1c 0 2024-05-09T00:07:29.860 INFO:tasks.workunit.client.1.smithi135.stdout:4/242: creat dc/d26/d4e/f54 x:0 0 0 2024-05-09T00:07:29.863 INFO:tasks.workunit.client.1.smithi135.stdout:8/304: link d4/d7/de/d45/c4b d4/d7/d33/d39/c60 0 2024-05-09T00:07:29.865 INFO:tasks.workunit.client.1.smithi135.stdout:6/326: creat d2/da/d26/d57/d60/f6f x:0 0 0 2024-05-09T00:07:29.869 INFO:tasks.workunit.client.1.smithi135.stdout:3/297: dwrite d8/d13/f2d [0,4194304] 0 2024-05-09T00:07:29.871 INFO:tasks.workunit.client.1.smithi135.stdout:1/310: mkdir da/d24/d27/d33/d48/d6f 0 2024-05-09T00:07:29.872 INFO:tasks.workunit.client.1.smithi135.stdout:2/316: rmdir d1 39 2024-05-09T00:07:29.873 INFO:tasks.workunit.client.1.smithi135.stdout:2/317: fdatasync d1/d12/f5a 0 2024-05-09T00:07:29.873 INFO:tasks.workunit.client.1.smithi135.stdout:2/318: write d1/d12/d27/f62 [389087,26130] 0 2024-05-09T00:07:29.873 INFO:tasks.workunit.client.1.smithi135.stdout:9/241: rmdir d1/d1a/d2c/d2d 39 2024-05-09T00:07:29.875 INFO:tasks.workunit.client.1.smithi135.stdout:5/337: mknod db/d24/d32/c70 0 2024-05-09T00:07:29.879 INFO:tasks.workunit.client.1.smithi135.stdout:7/373: rename db/d13/l2b to db/d1e/d3a/d40/l77 0 2024-05-09T00:07:29.884 INFO:tasks.workunit.client.1.smithi135.stdout:8/305: creat d4/d7/d2a/d56/f61 x:0 0 0 2024-05-09T00:07:29.886 INFO:tasks.workunit.client.1.smithi135.stdout:6/327: symlink d2/d20/d37/d4e/l70 0 2024-05-09T00:07:29.893 INFO:tasks.workunit.client.1.smithi135.stdout:1/311: mkdir da/db/d70 0 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:0/298: dwrite d3/dd/d3f/d3a/d46/f38 [0,4194304] 0 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:0/299: readlink d3/dd/d2d/l3e 0 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:9/242: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:9/243: chown d1/d1a/d2c/f28 89804 1 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:9/244: chown d1/d1a/d2c/c1d 4251795 1 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:9/245: getdents d1/d1a/d3d 0 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:9/246: chown d1 151738120 1 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:9/247: fdatasync d1/d1a/d2c/d2d/f31 0 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:9/248: stat d1/d1a/d2c 0 2024-05-09T00:07:29.894 INFO:tasks.workunit.client.1.smithi135.stdout:9/249: fsync d1/d1a/d2c/f28 0 2024-05-09T00:07:29.895 INFO:tasks.workunit.client.1.smithi135.stdout:0/300: read d3/dd/d2d/f40 [1736341,96096] 0 2024-05-09T00:07:29.895 INFO:tasks.workunit.client.1.smithi135.stdout:0/301: fsync d3/dd/d3f/d3a/d46/f3d 0 2024-05-09T00:07:29.895 INFO:tasks.workunit.client.1.smithi135.stdout:2/319: mknod d1/d12/d20/d3b/d40/c65 0 2024-05-09T00:07:29.895 INFO:tasks.workunit.client.1.smithi135.stdout:2/320: write d1/d12/d21/f42 [9259,56959] 0 2024-05-09T00:07:29.916 INFO:tasks.workunit.client.1.smithi135.stdout:5/338: mknod db/c71 0 2024-05-09T00:07:29.916 INFO:tasks.workunit.client.1.smithi135.stdout:5/339: write db/d24/f2d [132004,63822] 0 2024-05-09T00:07:29.916 INFO:tasks.workunit.client.1.smithi135.stdout:5/340: chown db/d24/d2f/c37 79958 1 2024-05-09T00:07:29.919 INFO:tasks.workunit.client.1.smithi135.stdout:7/374: mkdir db/dd/d33/d69/d78 0 2024-05-09T00:07:29.922 INFO:tasks.workunit.client.1.smithi135.stdout:4/243: mkdir dc/d26/d31/d32/d55 0 2024-05-09T00:07:29.924 INFO:tasks.workunit.client.1.smithi135.stdout:8/306: symlink d4/d22/l62 0 2024-05-09T00:07:29.926 INFO:tasks.workunit.client.1.smithi135.stdout:6/328: stat d2/da/d49/c32 0 2024-05-09T00:07:29.928 INFO:tasks.workunit.client.1.smithi135.stdout:1/312: mkdir da/d24/d27/d33/d52/d71 0 2024-05-09T00:07:29.931 INFO:tasks.workunit.client.1.smithi135.stdout:7/375: dwrite db/d1e/d3a/f52 [0,4194304] 0 2024-05-09T00:07:29.932 INFO:tasks.workunit.client.1.smithi135.stdout:8/307: dread d4/d7/d33/d39/f3b [0,4194304] 0 2024-05-09T00:07:29.934 INFO:tasks.workunit.client.1.smithi135.stdout:8/308: write d4/d7/f3d [2051462,21829] 0 2024-05-09T00:07:29.934 INFO:tasks.workunit.client.1.smithi135.stdout:8/309: write d4/d7/f2f [225782,42380] 0 2024-05-09T00:07:29.934 INFO:tasks.workunit.client.1.smithi135.stdout:8/310: write d4/f2c [1255614,41108] 0 2024-05-09T00:07:29.934 INFO:tasks.workunit.client.1.smithi135.stdout:9/250: rename d1/d1a/d3d to d1/d1a/d10/d3c/d43 0 2024-05-09T00:07:29.936 INFO:tasks.workunit.client.1.smithi135.stdout:0/302: creat d3/dd/f50 x:0 0 0 2024-05-09T00:07:29.937 INFO:tasks.workunit.client.1.smithi135.stdout:2/321: mknod d1/d12/d20/d3b/c66 0 2024-05-09T00:07:29.944 INFO:tasks.workunit.client.1.smithi135.stdout:5/341: read - db/d24/d2f/d31/d5e/f69 zero size 2024-05-09T00:07:29.944 INFO:tasks.workunit.client.1.smithi135.stdout:4/244: creat dc/d26/d4e/f56 x:0 0 0 2024-05-09T00:07:29.946 INFO:tasks.workunit.client.1.smithi135.stdout:1/313: rmdir da/d14/d20/d38 39 2024-05-09T00:07:29.951 INFO:tasks.workunit.client.1.smithi135.stdout:7/376: symlink db/d1e/d3a/d40/d4c/d67/l79 0 2024-05-09T00:07:29.952 INFO:tasks.workunit.client.1.smithi135.stdout:0/303: dwrite d3/dd/d2d/f49 [0,4194304] 0 2024-05-09T00:07:29.955 INFO:tasks.workunit.client.1.smithi135.stdout:8/311: symlink d4/l63 0 2024-05-09T00:07:29.956 INFO:tasks.workunit.client.1.smithi135.stdout:8/312: write d4/d22/f27 [1443691,125200] 0 2024-05-09T00:07:29.956 INFO:tasks.workunit.client.1.smithi135.stdout:8/313: fdatasync d4/d8/f1e 0 2024-05-09T00:07:29.956 INFO:tasks.workunit.client.1.smithi135.stdout:8/314: chown d4/d7/de/d45/c4b 5934569 1 2024-05-09T00:07:29.958 INFO:tasks.workunit.client.1.smithi135.stdout:9/251: rename d1/d24/d27 to d1/d24/d44 0 2024-05-09T00:07:29.960 INFO:tasks.workunit.client.1.smithi135.stdout:0/304: dread d3/dd/d2d/f49 [0,4194304] 0 2024-05-09T00:07:29.960 INFO:tasks.workunit.client.1.smithi135.stdout:0/305: write d3/f4f [1043163,118201] 0 2024-05-09T00:07:29.961 INFO:tasks.workunit.client.1.smithi135.stdout:2/322: mkdir d1/d12/d20/d2b/d56/d67 0 2024-05-09T00:07:29.961 INFO:tasks.workunit.client.1.smithi135.stdout:2/323: fsync d1/d12/f48 0 2024-05-09T00:07:29.964 INFO:tasks.workunit.client.1.smithi135.stdout:5/342: creat db/d24/f72 x:0 0 0 2024-05-09T00:07:29.967 INFO:tasks.workunit.client.1.smithi135.stdout:4/245: unlink dc/dd/f15 0 2024-05-09T00:07:29.968 INFO:tasks.workunit.client.1.smithi135.stdout:4/246: write dc/dd/f11 [518160,77225] 0 2024-05-09T00:07:29.968 INFO:tasks.workunit.client.1.smithi135.stdout:4/247: fdatasync fa 0 2024-05-09T00:07:29.969 INFO:tasks.workunit.client.1.smithi135.stdout:6/329: rename d2/l51 to d2/l71 0 2024-05-09T00:07:29.971 INFO:tasks.workunit.client.1.smithi135.stdout:1/314: link da/db/d16/l5f da/d14/d20/d38/l72 0 2024-05-09T00:07:29.971 INFO:tasks.workunit.client.1.smithi135.stdout:1/315: write da/d14/d20/f66 [363338,123926] 0 2024-05-09T00:07:29.973 INFO:tasks.workunit.client.1.smithi135.stdout:7/377: symlink db/dd/d33/d69/l7a 0 2024-05-09T00:07:29.973 INFO:tasks.workunit.client.1.smithi135.stdout:3/298: sync 2024-05-09T00:07:29.973 INFO:tasks.workunit.client.1.smithi135.stdout:3/299: chown d8/c33 123598 1 2024-05-09T00:07:29.977 INFO:tasks.workunit.client.1.smithi135.stdout:5/343: dwrite db/d24/d2f/f3c [0,4194304] 0 2024-05-09T00:07:29.980 INFO:tasks.workunit.client.1.smithi135.stdout:5/344: dread f9 [0,4194304] 0 2024-05-09T00:07:29.985 INFO:tasks.workunit.client.1.smithi135.stdout:9/252: rename d1/d1a/d2c/c1d to d1/d1a/d2c/d20/c45 0 2024-05-09T00:07:29.985 INFO:tasks.workunit.client.1.smithi135.stdout:0/306: creat d3/dd/f51 x:0 0 0 2024-05-09T00:07:29.985 INFO:tasks.workunit.client.1.smithi135.stdout:0/307: fsync d3/dd/d3f/f36 0 2024-05-09T00:07:29.985 INFO:tasks.workunit.client.1.smithi135.stdout:0/308: stat d3/c20 0 2024-05-09T00:07:29.985 INFO:tasks.workunit.client.1.smithi135.stdout:0/309: chown d3/dd/f2f 24786881 1 2024-05-09T00:07:29.986 INFO:tasks.workunit.client.1.smithi135.stdout:2/324: creat d1/d12/d20/f68 x:0 0 0 2024-05-09T00:07:29.990 INFO:tasks.workunit.client.1.smithi135.stdout:4/248: link dc/f2c dc/d26/d31/d32/d55/f57 0 2024-05-09T00:07:29.991 INFO:tasks.workunit.client.1.smithi135.stdout:4/249: truncate dc/d4a/f50 728874 0 2024-05-09T00:07:29.992 INFO:tasks.workunit.client.1.smithi135.stdout:6/330: creat d2/da/d26/d57/d60/f72 x:0 0 0 2024-05-09T00:07:29.992 INFO:tasks.workunit.client.1.smithi135.stdout:6/331: chown d2/c65 1209475 1 2024-05-09T00:07:29.992 INFO:tasks.workunit.client.1.smithi135.stdout:6/332: stat d2/f2c 0 2024-05-09T00:07:29.994 INFO:tasks.workunit.client.1.smithi135.stdout:1/316: mkdir da/d73 0 2024-05-09T00:07:29.996 INFO:tasks.workunit.client.1.smithi135.stdout:7/378: creat db/d1e/d63/f7b x:0 0 0 2024-05-09T00:07:29.996 INFO:tasks.workunit.client.1.smithi135.stdout:8/315: dwrite d4/f2c [0,4194304] 0 2024-05-09T00:07:29.997 INFO:tasks.workunit.client.1.smithi135.stdout:8/316: stat d4/d7/d2a/d56/c59 0 2024-05-09T00:07:29.998 INFO:tasks.workunit.client.1.smithi135.stdout:3/300: dwrite d8/d13/f49 [0,4194304] 0 2024-05-09T00:07:30.001 INFO:tasks.workunit.client.1.smithi135.stdout:5/345: rmdir db/d5d 39 2024-05-09T00:07:30.001 INFO:tasks.workunit.client.1.smithi135.stdout:5/346: write db/d24/d2f/f4b [644227,81888] 0 2024-05-09T00:07:30.001 INFO:tasks.workunit.client.1.smithi135.stdout:5/347: read db/d24/f34 [376024,36863] 0 2024-05-09T00:07:30.001 INFO:tasks.workunit.client.1.smithi135.stdout:2/325: dread d1/d12/d21/f42 [0,4194304] 0 2024-05-09T00:07:30.002 INFO:tasks.workunit.client.1.smithi135.stdout:9/253: mknod d1/d1a/c46 0 2024-05-09T00:07:30.006 INFO:tasks.workunit.client.1.smithi135.stdout:0/310: creat d3/dd/d3f/d3a/d46/f52 x:0 0 0 2024-05-09T00:07:30.006 INFO:tasks.workunit.client.1.smithi135.stdout:0/311: fdatasync d3/f12 0 2024-05-09T00:07:30.006 INFO:tasks.workunit.client.1.smithi135.stdout:0/312: chown d3/f3b 1422892 1 2024-05-09T00:07:30.006 INFO:tasks.workunit.client.1.smithi135.stdout:8/317: dread d4/d22/f27 [0,4194304] 0 2024-05-09T00:07:30.008 INFO:tasks.workunit.client.1.smithi135.stdout:4/250: creat dc/d4a/f58 x:0 0 0 2024-05-09T00:07:30.008 INFO:tasks.workunit.client.1.smithi135.stdout:4/251: write dc/dd/f3f [3451233,92877] 0 2024-05-09T00:07:30.010 INFO:tasks.workunit.client.1.smithi135.stdout:6/333: link d2/d1a/c1f d2/da/d26/d57/d60/c73 0 2024-05-09T00:07:30.010 INFO:tasks.workunit.client.1.smithi135.stdout:6/334: chown d2/d20/d3f 224 1 2024-05-09T00:07:30.015 INFO:tasks.workunit.client.1.smithi135.stdout:1/317: link da/d24/d27/d33/f6a da/d14/d20/d38/f74 0 2024-05-09T00:07:30.019 INFO:tasks.workunit.client.1.smithi135.stdout:1/318: write da/f62 [696895,101145] 0 2024-05-09T00:07:30.019 INFO:tasks.workunit.client.1.smithi135.stdout:7/379: creat db/d1e/f7c x:0 0 0 2024-05-09T00:07:30.021 INFO:tasks.workunit.client.1.smithi135.stdout:2/326: dwrite d1/d12/f1b [0,4194304] 0 2024-05-09T00:07:30.026 INFO:tasks.workunit.client.1.smithi135.stdout:3/301: rename d8/d1a to d8/d6d 0 2024-05-09T00:07:30.026 INFO:tasks.workunit.client.1.smithi135.stdout:3/302: write d8/d6d/f28 [359505,76997] 0 2024-05-09T00:07:30.029 INFO:tasks.workunit.client.1.smithi135.stdout:5/348: mkdir db/d24/d2f/d62/d73 0 2024-05-09T00:07:30.030 INFO:tasks.workunit.client.1.smithi135.stdout:2/327: read d1/d12/d20/f29 [4089024,10986] 0 2024-05-09T00:07:30.030 INFO:tasks.workunit.client.1.smithi135.stdout:2/328: dread - d1/d12/d20/f68 zero size 2024-05-09T00:07:30.031 INFO:tasks.workunit.client.1.smithi135.stdout:0/313: creat d3/dd/d3f/d43/f53 x:0 0 0 2024-05-09T00:07:30.031 INFO:tasks.workunit.client.1.smithi135.stdout:0/314: dread - d3/dd/f50 zero size 2024-05-09T00:07:30.032 INFO:tasks.workunit.client.1.smithi135.stdout:0/315: write d3/dd/d2d/f49 [393656,71111] 0 2024-05-09T00:07:30.032 INFO:tasks.workunit.client.1.smithi135.stdout:9/254: dwrite d1/d1a/d2c/d2d/f31 [0,4194304] 0 2024-05-09T00:07:30.032 INFO:tasks.workunit.client.1.smithi135.stdout:9/255: chown d1/d1a/d2c/d2d 144538694 1 2024-05-09T00:07:30.034 INFO:tasks.workunit.client.1.smithi135.stdout:8/318: symlink d4/d22/l64 0 2024-05-09T00:07:30.035 INFO:tasks.workunit.client.1.smithi135.stdout:2/329: dread d1/d22/f26 [0,4194304] 0 2024-05-09T00:07:30.035 INFO:tasks.workunit.client.1.smithi135.stdout:2/330: fdatasync d1/d12/d27/f62 0 2024-05-09T00:07:30.035 INFO:tasks.workunit.client.1.smithi135.stdout:8/319: write d4/d7/de/f35 [2386623,14407] 0 2024-05-09T00:07:30.035 INFO:tasks.workunit.client.1.smithi135.stdout:8/320: stat d4/d8/f1e 0 2024-05-09T00:07:30.037 INFO:tasks.workunit.client.1.smithi135.stdout:4/252: truncate dc/dd/d1f/f21 1685614 0 2024-05-09T00:07:30.051 INFO:tasks.workunit.client.1.smithi135.stdout:9/256: dread d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:30.052 INFO:tasks.workunit.client.1.smithi135.stdout:7/380: mknod db/d1e/d3a/d40/c7d 0 2024-05-09T00:07:30.060 INFO:tasks.workunit.client.1.smithi135.stdout:5/349: rename db/d24/d2f/d31/d5e/f4c to db/d24/d2f/d31/d6e/f74 0 2024-05-09T00:07:30.060 INFO:tasks.workunit.client.1.smithi135.stdout:5/350: chown db/d24/l59 14 1 2024-05-09T00:07:30.061 INFO:tasks.workunit.client.1.smithi135.stdout:5/351: write db/d3f/f4d [1696276,38853] 0 2024-05-09T00:07:30.061 INFO:tasks.workunit.client.1.smithi135.stdout:5/352: fdatasync db/d24/f2c 0 2024-05-09T00:07:30.062 INFO:tasks.workunit.client.1.smithi135.stdout:1/319: dwrite da/d24/d27/d33/f6d [0,4194304] 0 2024-05-09T00:07:30.066 INFO:tasks.workunit.client.1.smithi135.stdout:9/257: dread d1/d1a/d2c/d2d/f32 [0,4194304] 0 2024-05-09T00:07:30.072 INFO:tasks.workunit.client.1.smithi135.stdout:4/253: creat dc/dd/d1f/f59 x:0 0 0 2024-05-09T00:07:30.074 INFO:tasks.workunit.client.1.smithi135.stdout:5/353: rmdir db/d5d 39 2024-05-09T00:07:30.074 INFO:tasks.workunit.client.1.smithi135.stdout:5/354: write db/d24/d32/f58 [81538,79501] 0 2024-05-09T00:07:30.074 INFO:tasks.workunit.client.1.smithi135.stdout:5/355: chown db/d24/f2d 0 1 2024-05-09T00:07:30.077 INFO:tasks.workunit.client.1.smithi135.stdout:1/320: mkdir da/d14/d20/d38/d3a/d40/d75 0 2024-05-09T00:07:30.077 INFO:tasks.workunit.client.1.smithi135.stdout:1/321: chown da/d24/d27/d33/d48/l4a 1015658 1 2024-05-09T00:07:30.078 INFO:tasks.workunit.client.1.smithi135.stdout:4/254: rmdir dc/d4a 39 2024-05-09T00:07:30.079 INFO:tasks.workunit.client.1.smithi135.stdout:5/356: mknod db/d3f/c75 0 2024-05-09T00:07:30.080 INFO:tasks.workunit.client.1.smithi135.stdout:1/322: mknod da/d24/d27/d33/d52/d71/c76 0 2024-05-09T00:07:30.084 INFO:tasks.workunit.client.1.smithi135.stdout:1/323: symlink da/d14/d20/d38/d3a/d40/d75/l77 0 2024-05-09T00:07:30.085 INFO:tasks.workunit.client.1.smithi135.stdout:3/303: dwrite d8/d6d/f31 [0,4194304] 0 2024-05-09T00:07:30.087 INFO:tasks.workunit.client.1.smithi135.stdout:9/258: dread d1/d1a/d2c/f11 [0,4194304] 0 2024-05-09T00:07:30.087 INFO:tasks.workunit.client.1.smithi135.stdout:1/324: rename da/db/fe to da/d73/f78 0 2024-05-09T00:07:30.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/304: symlink d8/d6d/d44/d4f/l6e 0 2024-05-09T00:07:30.090 INFO:tasks.workunit.client.1.smithi135.stdout:4/255: dread dc/dd/d1f/f20 [0,4194304] 0 2024-05-09T00:07:30.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/305: chown d8/f26 2 1 2024-05-09T00:07:30.090 INFO:tasks.workunit.client.1.smithi135.stdout:8/321: dwrite d4/d7/f3d [4194304,4194304] 0 2024-05-09T00:07:30.092 INFO:tasks.workunit.client.1.smithi135.stdout:9/259: creat d1/d24/f47 x:0 0 0 2024-05-09T00:07:30.093 INFO:tasks.workunit.client.1.smithi135.stdout:1/325: mknod da/d24/d27/d33/d48/c79 0 2024-05-09T00:07:30.094 INFO:tasks.workunit.client.1.smithi135.stdout:3/306: rmdir d8/d6d/d44 39 2024-05-09T00:07:30.094 INFO:tasks.workunit.client.1.smithi135.stdout:4/256: write f7 [3600672,94615] 0 2024-05-09T00:07:30.097 INFO:tasks.workunit.client.1.smithi135.stdout:8/322: rename d4/d7/f3d to d4/d7/d4a/f65 0 2024-05-09T00:07:30.097 INFO:tasks.workunit.client.1.smithi135.stdout:9/260: stat d1/d24/d44/c30 0 2024-05-09T00:07:30.097 INFO:tasks.workunit.client.1.smithi135.stdout:9/261: readlink d1/d1a/l2b 0 2024-05-09T00:07:30.097 INFO:tasks.workunit.client.1.smithi135.stdout:1/326: symlink da/d14/d20/d2c/l7a 0 2024-05-09T00:07:30.098 INFO:tasks.workunit.client.1.smithi135.stdout:7/381: dwrite db/d1e/d3a/d40/d4c/d67/f6e [0,4194304] 0 2024-05-09T00:07:30.099 INFO:tasks.workunit.client.1.smithi135.stdout:2/331: dwrite d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:30.099 INFO:tasks.workunit.client.1.smithi135.stdout:7/382: chown db/c43 16150 1 2024-05-09T00:07:30.099 INFO:tasks.workunit.client.1.smithi135.stdout:5/357: dwrite db/f28 [0,4194304] 0 2024-05-09T00:07:30.100 INFO:tasks.workunit.client.1.smithi135.stdout:0/316: dwrite d3/f15 [0,4194304] 0 2024-05-09T00:07:30.100 INFO:tasks.workunit.client.1.smithi135.stdout:3/307: mkdir d8/d13/d51/d6f 0 2024-05-09T00:07:30.100 INFO:tasks.workunit.client.1.smithi135.stdout:1/327: write da/d73/f78 [3736587,91298] 0 2024-05-09T00:07:30.101 INFO:tasks.workunit.client.1.smithi135.stdout:1/328: chown da/d73/f78 953372827 1 2024-05-09T00:07:30.102 INFO:tasks.workunit.client.1.smithi135.stdout:4/257: mkdir dc/dd/d1f/d5a 0 2024-05-09T00:07:30.104 INFO:tasks.workunit.client.1.smithi135.stdout:8/323: unlink c3 0 2024-05-09T00:07:30.108 INFO:tasks.workunit.client.1.smithi135.stdout:9/262: rename d1/d1a/d10/d3c/c40 to d1/d1a/d2c/d2d/c48 0 2024-05-09T00:07:30.111 INFO:tasks.workunit.client.1.smithi135.stdout:1/329: dread da/f1f [0,4194304] 0 2024-05-09T00:07:30.111 INFO:tasks.workunit.client.1.smithi135.stdout:1/330: fdatasync da/d24/f26 0 2024-05-09T00:07:30.112 INFO:tasks.workunit.client.1.smithi135.stdout:7/383: mkdir db/d1e/d3a/d40/d7e 0 2024-05-09T00:07:30.116 INFO:tasks.workunit.client.1.smithi135.stdout:2/332: creat d1/d12/d20/d2b/d56/f69 x:0 0 0 2024-05-09T00:07:30.122 INFO:tasks.workunit.client.1.smithi135.stdout:8/324: dwrite d4/d7/d33/f55 [0,4194304] 0 2024-05-09T00:07:30.123 INFO:tasks.workunit.client.1.smithi135.stdout:8/325: chown d4/d7/l5b 113 1 2024-05-09T00:07:30.124 INFO:tasks.workunit.client.1.smithi135.stdout:8/326: dread d4/d7/f2f [0,4194304] 0 2024-05-09T00:07:30.127 INFO:tasks.workunit.client.1.smithi135.stdout:8/327: read d4/d22/f27 [716329,68888] 0 2024-05-09T00:07:30.128 INFO:tasks.workunit.client.1.smithi135.stdout:8/328: chown d4/d7/de/c40 57 1 2024-05-09T00:07:30.130 INFO:tasks.workunit.client.1.smithi135.stdout:8/329: read d4/f2b [1372822,75930] 0 2024-05-09T00:07:30.130 INFO:tasks.workunit.client.1.smithi135.stdout:8/330: chown d4/d7/d4a 0 1 2024-05-09T00:07:30.133 INFO:tasks.workunit.client.1.smithi135.stdout:0/317: mkdir d3/dd/d3f/d29/d54 0 2024-05-09T00:07:30.135 INFO:tasks.workunit.client.1.smithi135.stdout:5/358: dwrite db/d24/d2f/f3c [0,4194304] 0 2024-05-09T00:07:30.136 INFO:tasks.workunit.client.1.smithi135.stdout:9/263: dwrite d1/f13 [0,4194304] 0 2024-05-09T00:07:30.138 INFO:tasks.workunit.client.1.smithi135.stdout:4/258: rename dc/dd/f19 to dc/dd/d1f/d5a/f5b 0 2024-05-09T00:07:30.138 INFO:tasks.workunit.client.1.smithi135.stdout:4/259: truncate dc/d26/d4e/f54 247217 0 2024-05-09T00:07:30.139 INFO:tasks.workunit.client.1.smithi135.stdout:3/308: rename d8/f39 to d8/f70 0 2024-05-09T00:07:30.141 INFO:tasks.workunit.client.1.smithi135.stdout:1/331: mknod da/d14/d20/d38/d3a/d40/d75/c7b 0 2024-05-09T00:07:30.143 INFO:tasks.workunit.client.1.smithi135.stdout:1/332: write da/db/f61 [962676,124370] 0 2024-05-09T00:07:30.145 INFO:tasks.workunit.client.1.smithi135.stdout:7/384: symlink db/d1e/d3a/d40/d4c/l7f 0 2024-05-09T00:07:30.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/331: mknod d4/d22/c66 0 2024-05-09T00:07:30.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/332: readlink d4/d7/de/l3c 0 2024-05-09T00:07:30.154 INFO:tasks.workunit.client.1.smithi135.stdout:2/333: dwrite d1/d22/f43 [4194304,4194304] 0 2024-05-09T00:07:30.156 INFO:tasks.workunit.client.1.smithi135.stdout:4/260: creat dc/d26/d31/d32/f5c x:0 0 0 2024-05-09T00:07:30.156 INFO:tasks.workunit.client.1.smithi135.stdout:4/261: chown dc/d26/d4e 0 1 2024-05-09T00:07:30.157 INFO:tasks.workunit.client.1.smithi135.stdout:9/264: dwrite d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:30.157 INFO:tasks.workunit.client.1.smithi135.stdout:0/318: dwrite d3/dd/f50 [0,4194304] 0 2024-05-09T00:07:30.158 INFO:tasks.workunit.client.1.smithi135.stdout:0/319: truncate d3/dd/d3f/d3a/d46/f52 327502 0 2024-05-09T00:07:30.158 INFO:tasks.workunit.client.1.smithi135.stdout:3/309: rename d8/d13/d1f/d40/l45 to d8/d13/d1f/d40/l71 0 2024-05-09T00:07:30.159 INFO:tasks.workunit.client.1.smithi135.stdout:1/333: creat da/d14/d20/f7c x:0 0 0 2024-05-09T00:07:30.162 INFO:tasks.workunit.client.1.smithi135.stdout:7/385: creat db/dd/d33/d69/f80 x:0 0 0 2024-05-09T00:07:30.162 INFO:tasks.workunit.client.1.smithi135.stdout:7/386: write db/d5b/f71 [383178,74546] 0 2024-05-09T00:07:30.162 INFO:tasks.workunit.client.1.smithi135.stdout:7/387: rename db/dd/d33/d68 to db/dd/d33/d68/d81 22 2024-05-09T00:07:30.162 INFO:tasks.workunit.client.1.smithi135.stdout:7/388: write db/d13/f2a [5566922,34060] 0 2024-05-09T00:07:30.162 INFO:tasks.workunit.client.1.smithi135.stdout:7/389: dread - db/dd/f65 zero size 2024-05-09T00:07:30.162 INFO:tasks.workunit.client.1.smithi135.stdout:7/390: dread - db/d1e/d3a/d40/f6a zero size 2024-05-09T00:07:30.163 INFO:tasks.workunit.client.1.smithi135.stdout:8/333: mkdir d4/d7/d2a/d67 0 2024-05-09T00:07:30.163 INFO:tasks.workunit.client.1.smithi135.stdout:4/262: dread dc/f27 [0,4194304] 0 2024-05-09T00:07:30.165 INFO:tasks.workunit.client.1.smithi135.stdout:5/359: dread db/d3f/f61 [0,4194304] 0 2024-05-09T00:07:30.168 INFO:tasks.workunit.client.1.smithi135.stdout:2/334: link d1/f1c d1/d12/d20/d3b/d4f/f6a 0 2024-05-09T00:07:30.173 INFO:tasks.workunit.client.1.smithi135.stdout:9/265: truncate d1/d1a/d2c/d2d/f3b 6265037 0 2024-05-09T00:07:30.174 INFO:tasks.workunit.client.1.smithi135.stdout:5/360: dread db/d24/d2f/d31/d5e/f55 [0,4194304] 0 2024-05-09T00:07:30.175 INFO:tasks.workunit.client.1.smithi135.stdout:5/361: chown db/d3f/c5a 115965056 1 2024-05-09T00:07:30.175 INFO:tasks.workunit.client.1.smithi135.stdout:5/362: write db/d3f/f61 [1778866,45235] 0 2024-05-09T00:07:30.178 INFO:tasks.workunit.client.1.smithi135.stdout:0/320: getdents d3 0 2024-05-09T00:07:30.181 INFO:tasks.workunit.client.1.smithi135.stdout:3/310: creat d8/d6d/d44/f72 x:0 0 0 2024-05-09T00:07:30.181 INFO:tasks.workunit.client.1.smithi135.stdout:9/266: dread d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:30.183 INFO:tasks.workunit.client.1.smithi135.stdout:1/334: mkdir da/d24/d27/d33/d7d 0 2024-05-09T00:07:30.190 INFO:tasks.workunit.client.1.smithi135.stdout:8/334: rename d4/d7/de/d45/l53 to d4/d7/d2a/l68 0 2024-05-09T00:07:30.190 INFO:tasks.workunit.client.1.smithi135.stdout:8/335: write d4/f58 [815826,83884] 0 2024-05-09T00:07:30.191 INFO:tasks.workunit.client.1.smithi135.stdout:5/363: dwrite db/f25 [0,4194304] 0 2024-05-09T00:07:30.191 INFO:tasks.workunit.client.1.smithi135.stdout:5/364: chown db/d52/l54 175 1 2024-05-09T00:07:30.192 INFO:tasks.workunit.client.1.smithi135.stdout:2/335: symlink d1/d12/d21/l6b 0 2024-05-09T00:07:30.194 INFO:tasks.workunit.client.1.smithi135.stdout:0/321: link d3/dd/d3f/d3a/d46/l39 d3/dd/d3f/l55 0 2024-05-09T00:07:30.194 INFO:tasks.workunit.client.1.smithi135.stdout:0/322: readlink d3/dd/d2d/l3e 0 2024-05-09T00:07:30.196 INFO:tasks.workunit.client.1.smithi135.stdout:8/336: dread d4/f2b [0,4194304] 0 2024-05-09T00:07:30.196 INFO:tasks.workunit.client.1.smithi135.stdout:3/311: unlink d8/l27 0 2024-05-09T00:07:30.198 INFO:tasks.workunit.client.1.smithi135.stdout:9/267: creat d1/d1a/d2c/d2d/f49 x:0 0 0 2024-05-09T00:07:30.199 INFO:tasks.workunit.client.1.smithi135.stdout:5/365: dread db/d24/d2f/f41 [0,4194304] 0 2024-05-09T00:07:30.199 INFO:tasks.workunit.client.1.smithi135.stdout:5/366: readlink db/d24/d2f/l65 0 2024-05-09T00:07:30.201 INFO:tasks.workunit.client.1.smithi135.stdout:8/337: dread d4/f58 [0,4194304] 0 2024-05-09T00:07:30.201 INFO:tasks.workunit.client.1.smithi135.stdout:6/335: sync 2024-05-09T00:07:30.203 INFO:tasks.workunit.client.1.smithi135.stdout:2/336: rename d1/d12/d21/d57/f58 to d1/d12/d21/d57/f6c 0 2024-05-09T00:07:30.207 INFO:tasks.workunit.client.1.smithi135.stdout:9/268: symlink d1/d1a/d2c/d2d/l4a 0 2024-05-09T00:07:30.211 INFO:tasks.workunit.client.1.smithi135.stdout:4/263: rename dc/f2c to dc/d26/d31/f5d 0 2024-05-09T00:07:30.214 INFO:tasks.workunit.client.1.smithi135.stdout:5/367: creat db/d24/d32/d5b/f76 x:0 0 0 2024-05-09T00:07:30.216 INFO:tasks.workunit.client.1.smithi135.stdout:8/338: link d4/d22/l62 d4/d22/l69 0 2024-05-09T00:07:30.218 INFO:tasks.workunit.client.1.smithi135.stdout:6/336: unlink d2/f2a 0 2024-05-09T00:07:30.218 INFO:tasks.workunit.client.1.smithi135.stdout:3/312: dwrite d8/f14 [0,4194304] 0 2024-05-09T00:07:30.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/323: dwrite d3/f15 [4194304,4194304] 0 2024-05-09T00:07:30.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/324: truncate d3/dd/d3f/d3a/d46/f52 1286204 0 2024-05-09T00:07:30.220 INFO:tasks.workunit.client.1.smithi135.stdout:2/337: mkdir d1/d12/d21/d41/d6d 0 2024-05-09T00:07:30.221 INFO:tasks.workunit.client.1.smithi135.stdout:9/269: dread d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:30.221 INFO:tasks.workunit.client.1.smithi135.stdout:0/325: read d3/dd/d3f/d29/f47 [1285735,45721] 0 2024-05-09T00:07:30.223 INFO:tasks.workunit.client.1.smithi135.stdout:1/335: rename da/d14/d20/d38/f74 to da/d14/d20/d2c/f7e 0 2024-05-09T00:07:30.223 INFO:tasks.workunit.client.1.smithi135.stdout:1/336: stat da/db/d16/c1c 0 2024-05-09T00:07:30.224 INFO:tasks.workunit.client.1.smithi135.stdout:8/339: dread d4/f20 [0,4194304] 0 2024-05-09T00:07:30.224 INFO:tasks.workunit.client.1.smithi135.stdout:8/340: chown d4/d7/d4a/f4c 3462 1 2024-05-09T00:07:30.225 INFO:tasks.workunit.client.1.smithi135.stdout:4/264: symlink dc/dd/d1f/d5a/l5e 0 2024-05-09T00:07:30.227 INFO:tasks.workunit.client.1.smithi135.stdout:5/368: mknod db/d24/d2f/d31/d6e/c77 0 2024-05-09T00:07:30.229 INFO:tasks.workunit.client.1.smithi135.stdout:6/337: symlink d2/da/d1d/d69/l74 0 2024-05-09T00:07:30.231 INFO:tasks.workunit.client.1.smithi135.stdout:3/313: symlink d8/d6d/d44/d4b/l73 0 2024-05-09T00:07:30.232 INFO:tasks.workunit.client.1.smithi135.stdout:3/314: chown d8/d6d/c37 501467 1 2024-05-09T00:07:30.232 INFO:tasks.workunit.client.1.smithi135.stdout:3/315: readlink d8/d6d/d44/d4b/l73 0 2024-05-09T00:07:30.232 INFO:tasks.workunit.client.1.smithi135.stdout:3/316: chown d8/d6d/d24/f50 7 1 2024-05-09T00:07:30.232 INFO:tasks.workunit.client.1.smithi135.stdout:3/317: truncate d8/d6d/d44/d4b/d59/f65 641846 0 2024-05-09T00:07:30.238 INFO:tasks.workunit.client.1.smithi135.stdout:9/270: creat d1/d1a/d10/d3c/f4b x:0 0 0 2024-05-09T00:07:30.239 INFO:tasks.workunit.client.1.smithi135.stdout:0/326: symlink d3/dd/d2d/d4c/l56 0 2024-05-09T00:07:30.239 INFO:tasks.workunit.client.1.smithi135.stdout:0/327: fsync d3/dd/d2d/f40 0 2024-05-09T00:07:30.239 INFO:tasks.workunit.client.1.smithi135.stdout:7/391: getdents db/dd/d33/d69 0 2024-05-09T00:07:30.242 INFO:tasks.workunit.client.1.smithi135.stdout:5/369: dread db/f11 [0,4194304] 0 2024-05-09T00:07:30.242 INFO:tasks.workunit.client.1.smithi135.stdout:5/370: stat db/d24/d2f 0 2024-05-09T00:07:30.245 INFO:tasks.workunit.client.1.smithi135.stdout:1/337: mkdir da/d14/d20/d2c/d7f 0 2024-05-09T00:07:30.246 INFO:tasks.workunit.client.1.smithi135.stdout:8/341: symlink d4/d7/de/d45/l6a 0 2024-05-09T00:07:30.247 INFO:tasks.workunit.client.1.smithi135.stdout:8/342: dread d4/d7/de/f14 [0,4194304] 0 2024-05-09T00:07:30.248 INFO:tasks.workunit.client.1.smithi135.stdout:9/271: unlink d1/c1c 0 2024-05-09T00:07:30.251 INFO:tasks.workunit.client.1.smithi135.stdout:0/328: symlink d3/dd/d3f/d29/l57 0 2024-05-09T00:07:30.253 INFO:tasks.workunit.client.1.smithi135.stdout:2/338: dwrite d1/d12/f24 [0,4194304] 0 2024-05-09T00:07:30.253 INFO:tasks.workunit.client.1.smithi135.stdout:2/339: truncate d1/d12/d20/f60 908995 0 2024-05-09T00:07:30.254 INFO:tasks.workunit.client.1.smithi135.stdout:7/392: creat db/dd/d33/f82 x:0 0 0 2024-05-09T00:07:30.254 INFO:tasks.workunit.client.1.smithi135.stdout:5/371: dread db/f25 [0,4194304] 0 2024-05-09T00:07:30.257 INFO:tasks.workunit.client.1.smithi135.stdout:1/338: unlink da/d14/f1b 0 2024-05-09T00:07:30.261 INFO:tasks.workunit.client.1.smithi135.stdout:4/265: dwrite dc/d26/f2a [0,4194304] 0 2024-05-09T00:07:30.261 INFO:tasks.workunit.client.1.smithi135.stdout:4/266: chown dc/dd/c33 11005993 1 2024-05-09T00:07:30.261 INFO:tasks.workunit.client.1.smithi135.stdout:3/318: dwrite d8/d13/f1e [0,4194304] 0 2024-05-09T00:07:30.263 INFO:tasks.workunit.client.1.smithi135.stdout:8/343: rename d4/d7/de/f57 to d4/d8/f6b 0 2024-05-09T00:07:30.264 INFO:tasks.workunit.client.1.smithi135.stdout:6/338: dwrite d2/d20/d2e/d3d/f48 [0,4194304] 0 2024-05-09T00:07:30.264 INFO:tasks.workunit.client.1.smithi135.stdout:4/267: dread dc/dd/d1f/f20 [4194304,4194304] 0 2024-05-09T00:07:30.264 INFO:tasks.workunit.client.1.smithi135.stdout:3/319: write d8/d13/d1f/d40/d52/f54 [1367972,30285] 0 2024-05-09T00:07:30.267 INFO:tasks.workunit.client.1.smithi135.stdout:7/393: creat db/dd/d33/d69/f83 x:0 0 0 2024-05-09T00:07:30.270 INFO:tasks.workunit.client.1.smithi135.stdout:1/339: creat da/d24/d27/d33/d52/f80 x:0 0 0 2024-05-09T00:07:30.277 INFO:tasks.workunit.client.1.smithi135.stdout:2/340: dwrite d1/d12/d27/f62 [0,4194304] 0 2024-05-09T00:07:30.277 INFO:tasks.workunit.client.1.smithi135.stdout:0/329: dwrite d3/dd/f32 [0,4194304] 0 2024-05-09T00:07:30.280 INFO:tasks.workunit.client.1.smithi135.stdout:2/341: write d1/d12/d20/d2b/f37 [283936,73398] 0 2024-05-09T00:07:30.283 INFO:tasks.workunit.client.1.smithi135.stdout:6/339: dwrite d2/fc [0,4194304] 0 2024-05-09T00:07:30.297 INFO:tasks.workunit.client.1.smithi135.stdout:5/372: dwrite db/d24/d32/f58 [0,4194304] 0 2024-05-09T00:07:30.297 INFO:tasks.workunit.client.1.smithi135.stdout:5/373: chown db/d24/d2f/d62/d73 839 1 2024-05-09T00:07:30.301 INFO:tasks.workunit.client.1.smithi135.stdout:0/330: dwrite d3/dd/f26 [0,4194304] 0 2024-05-09T00:07:30.304 INFO:tasks.workunit.client.1.smithi135.stdout:8/344: unlink d4/d7/d33/d39/l54 0 2024-05-09T00:07:30.304 INFO:tasks.workunit.client.1.smithi135.stdout:8/345: chown d4/d7/l24 28939 1 2024-05-09T00:07:30.304 INFO:tasks.workunit.client.1.smithi135.stdout:8/346: chown d4/l5f 13630 1 2024-05-09T00:07:30.305 INFO:tasks.workunit.client.1.smithi135.stdout:8/347: write d4/f16 [2953832,107073] 0 2024-05-09T00:07:30.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/320: creat d8/d13/d1f/f74 x:0 0 0 2024-05-09T00:07:30.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/321: chown d8/d6d/d44/d4b/d59/l5a 0 1 2024-05-09T00:07:30.318 INFO:tasks.workunit.client.1.smithi135.stdout:7/394: mkdir db/d1e/d3a/d40/d84 0 2024-05-09T00:07:30.318 INFO:tasks.workunit.client.1.smithi135.stdout:7/395: stat db/d13/l18 0 2024-05-09T00:07:30.318 INFO:tasks.workunit.client.1.smithi135.stdout:8/348: dwrite d4/d22/f51 [0,4194304] 0 2024-05-09T00:07:30.320 INFO:tasks.workunit.client.1.smithi135.stdout:1/340: creat da/d73/f81 x:0 0 0 2024-05-09T00:07:30.326 INFO:tasks.workunit.client.1.smithi135.stdout:2/342: rmdir d1/d12/d20/d3b/d4f 39 2024-05-09T00:07:30.326 INFO:tasks.workunit.client.1.smithi135.stdout:2/343: chown d1/f33 4241 1 2024-05-09T00:07:30.326 INFO:tasks.workunit.client.1.smithi135.stdout:2/344: readlink d1/l1d 0 2024-05-09T00:07:30.327 INFO:tasks.workunit.client.1.smithi135.stdout:2/345: write d1/d12/d27/f62 [3903276,49307] 0 2024-05-09T00:07:30.340 INFO:tasks.workunit.client.1.smithi135.stdout:0/331: mkdir d3/dd/d3f/d58 0 2024-05-09T00:07:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:4/268: rename dc/dd/d1f to dc/d26/d31/d32/d55/d5f 0 2024-05-09T00:07:30.347 INFO:tasks.workunit.client.1.smithi135.stdout:6/340: getdents d2/da/d1d/d69 0 2024-05-09T00:07:30.349 INFO:tasks.workunit.client.1.smithi135.stdout:2/346: dwrite d1/f1a [0,4194304] 0 2024-05-09T00:07:30.349 INFO:tasks.workunit.client.1.smithi135.stdout:1/341: dwrite f9 [0,4194304] 0 2024-05-09T00:07:30.350 INFO:tasks.workunit.client.1.smithi135.stdout:1/342: read da/d73/f78 [3815847,103370] 0 2024-05-09T00:07:30.361 INFO:tasks.workunit.client.1.smithi135.stdout:9/272: getdents d1 0 2024-05-09T00:07:30.368 INFO:tasks.workunit.client.1.smithi135.stdout:9/273: dread d1/f13 [0,4194304] 0 2024-05-09T00:07:30.370 INFO:tasks.workunit.client.1.smithi135.stdout:1/343: dwrite da/d14/f19 [0,4194304] 0 2024-05-09T00:07:30.376 INFO:tasks.workunit.client.1.smithi135.stdout:7/396: creat db/d1e/d3a/d40/d84/f85 x:0 0 0 2024-05-09T00:07:30.383 INFO:tasks.workunit.client.1.smithi135.stdout:0/332: mknod d3/dd/c59 0 2024-05-09T00:07:30.387 INFO:tasks.workunit.client.1.smithi135.stdout:0/333: dread d3/dd/d2d/f49 [0,4194304] 0 2024-05-09T00:07:30.388 INFO:tasks.workunit.client.1.smithi135.stdout:3/322: rename d8/d6d/d44/d4f to d8/d13/d75 0 2024-05-09T00:07:30.390 INFO:tasks.workunit.client.1.smithi135.stdout:4/269: readlink dc/d26/d31/l3a 0 2024-05-09T00:07:30.394 INFO:tasks.workunit.client.1.smithi135.stdout:6/341: truncate d2/f17 1703095 0 2024-05-09T00:07:30.394 INFO:tasks.workunit.client.1.smithi135.stdout:6/342: readlink d2/da/d26/l4b 0 2024-05-09T00:07:30.396 INFO:tasks.workunit.client.1.smithi135.stdout:2/347: unlink d1/d12/d20/l3a 0 2024-05-09T00:07:30.406 INFO:tasks.workunit.client.1.smithi135.stdout:9/274: creat d1/f4c x:0 0 0 2024-05-09T00:07:30.409 INFO:tasks.workunit.client.1.smithi135.stdout:1/344: creat da/d14/d20/d38/d3a/d40/f82 x:0 0 0 2024-05-09T00:07:30.410 INFO:tasks.workunit.client.1.smithi135.stdout:3/323: dwrite d8/f11 [0,4194304] 0 2024-05-09T00:07:30.415 INFO:tasks.workunit.client.1.smithi135.stdout:7/397: creat db/dd/d33/d69/f86 x:0 0 0 2024-05-09T00:07:30.419 INFO:tasks.workunit.client.1.smithi135.stdout:4/270: mknod dc/d26/c60 0 2024-05-09T00:07:30.424 INFO:tasks.workunit.client.1.smithi135.stdout:2/348: rename d1/d12/d21/d41/d5c to d1/d12/d21/d41/d6d/d6e 0 2024-05-09T00:07:30.426 INFO:tasks.workunit.client.1.smithi135.stdout:9/275: symlink d1/d1a/l4d 0 2024-05-09T00:07:30.426 INFO:tasks.workunit.client.1.smithi135.stdout:9/276: write d1/f13 [5048799,105263] 0 2024-05-09T00:07:30.433 INFO:tasks.workunit.client.1.smithi135.stdout:2/349: dread d1/d12/d20/d2b/f37 [0,4194304] 0 2024-05-09T00:07:30.436 INFO:tasks.workunit.client.1.smithi135.stdout:3/324: unlink d8/c5c 0 2024-05-09T00:07:30.440 INFO:tasks.workunit.client.1.smithi135.stdout:0/334: mknod d3/dd/d3f/d3a/c5a 0 2024-05-09T00:07:30.443 INFO:tasks.workunit.client.1.smithi135.stdout:4/271: creat dc/f61 x:0 0 0 2024-05-09T00:07:30.443 INFO:tasks.workunit.client.1.smithi135.stdout:4/272: fsync dc/dd/f3f 0 2024-05-09T00:07:30.446 INFO:tasks.workunit.client.1.smithi135.stdout:6/343: symlink d2/d20/d3f/d4f/l75 0 2024-05-09T00:07:30.450 INFO:tasks.workunit.client.1.smithi135.stdout:2/350: dwrite d1/d12/d20/f51 [0,4194304] 0 2024-05-09T00:07:30.451 INFO:tasks.workunit.client.1.smithi135.stdout:9/277: symlink d1/d24/d44/l4e 0 2024-05-09T00:07:30.455 INFO:tasks.workunit.client.1.smithi135.stdout:3/325: rename d8/d13/f49 to d8/d13/d75/d58/f76 0 2024-05-09T00:07:30.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/335: unlink d3/dd/d3f/f36 0 2024-05-09T00:07:30.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/336: chown d3/dd/d2d/c44 0 1 2024-05-09T00:07:30.460 INFO:tasks.workunit.client.1.smithi135.stdout:0/337: write d3/dd/d3f/f41 [714950,117369] 0 2024-05-09T00:07:30.460 INFO:tasks.workunit.client.1.smithi135.stdout:0/338: chown d3/dd/f14 26 1 2024-05-09T00:07:30.469 INFO:tasks.workunit.client.1.smithi135.stdout:3/326: rmdir d8/d6d/d44/d4b/d59 39 2024-05-09T00:07:30.474 INFO:tasks.workunit.client.1.smithi135.stdout:0/339: link d3/dd/d3f/d3a/f48 d3/dd/d3f/f5b 0 2024-05-09T00:07:30.474 INFO:tasks.workunit.client.1.smithi135.stdout:0/340: readlink d3/dd/l1f 0 2024-05-09T00:07:30.476 INFO:tasks.workunit.client.1.smithi135.stdout:4/273: symlink dc/d26/d31/l62 0 2024-05-09T00:07:30.483 INFO:tasks.workunit.client.1.smithi135.stdout:0/341: dread d3/dd/d3f/f27 [0,4194304] 0 2024-05-09T00:07:30.483 INFO:tasks.workunit.client.1.smithi135.stdout:0/342: truncate d3/dd/d3f/d3a/d46/f52 2116942 0 2024-05-09T00:07:30.483 INFO:tasks.workunit.client.1.smithi135.stdout:0/343: fdatasync d3/dd/d3f/f5b 0 2024-05-09T00:07:30.484 INFO:tasks.workunit.client.1.smithi135.stdout:4/274: dread fa [0,4194304] 0 2024-05-09T00:07:30.485 INFO:tasks.workunit.client.1.smithi135.stdout:0/344: creat d3/dd/d3f/d58/f5c x:0 0 0 2024-05-09T00:07:30.486 INFO:tasks.workunit.client.1.smithi135.stdout:0/345: stat d3/l17 0 2024-05-09T00:07:30.486 INFO:tasks.workunit.client.1.smithi135.stdout:0/346: readlink d3/dd/l1f 0 2024-05-09T00:07:30.486 INFO:tasks.workunit.client.1.smithi135.stdout:0/347: write d3/dd/d2d/f40 [1807848,101550] 0 2024-05-09T00:07:30.487 INFO:tasks.workunit.client.1.smithi135.stdout:4/275: creat dc/d26/d31/d32/d55/d5f/d5a/f63 x:0 0 0 2024-05-09T00:07:30.487 INFO:tasks.workunit.client.1.smithi135.stdout:4/276: truncate dc/d26/d4e/f56 1046650 0 2024-05-09T00:07:30.488 INFO:tasks.workunit.client.1.smithi135.stdout:4/277: fdatasync dc/dd/f3d 0 2024-05-09T00:07:30.490 INFO:tasks.workunit.client.1.smithi135.stdout:0/348: mknod d3/dd/c5d 0 2024-05-09T00:07:30.490 INFO:tasks.workunit.client.1.smithi135.stdout:0/349: chown d3/dd/d3f/f41 12 1 2024-05-09T00:07:30.493 INFO:tasks.workunit.client.1.smithi135.stdout:4/278: symlink dc/d26/d31/d32/d39/l64 0 2024-05-09T00:07:30.496 INFO:tasks.workunit.client.1.smithi135.stdout:4/279: mknod dc/d26/c65 0 2024-05-09T00:07:30.504 INFO:tasks.workunit.client.1.smithi135.stdout:4/280: rename dc/d26/d31/d32/d39/c43 to dc/d26/d31/d32/d39/c66 0 2024-05-09T00:07:30.506 INFO:tasks.workunit.client.1.smithi135.stdout:4/281: creat dc/d26/d31/d32/f67 x:0 0 0 2024-05-09T00:07:30.511 INFO:tasks.workunit.client.1.smithi135.stdout:4/282: dread dc/d26/d4e/f56 [0,4194304] 0 2024-05-09T00:07:30.526 INFO:tasks.workunit.client.1.smithi135.stdout:4/283: dwrite dc/d26/d31/d32/d55/d5f/f20 [0,4194304] 0 2024-05-09T00:07:30.526 INFO:tasks.workunit.client.1.smithi135.stdout:4/284: stat dc/d26/d31/d32/d55/d5f/d5a/f63 0 2024-05-09T00:07:30.526 INFO:tasks.workunit.client.1.smithi135.stdout:4/285: read - dc/d4a/f58 zero size 2024-05-09T00:07:30.526 INFO:tasks.workunit.client.1.smithi135.stdout:4/286: truncate dc/f25 836667 0 2024-05-09T00:07:30.527 INFO:tasks.workunit.client.1.smithi135.stdout:1/345: read da/d24/d27/d33/d52/f56 [184667,71468] 0 2024-05-09T00:07:30.537 INFO:tasks.workunit.client.1.smithi135.stdout:1/346: rmdir da/d24/d27/d33/d52/d71 39 2024-05-09T00:07:30.552 INFO:tasks.workunit.client.1.smithi135.stdout:1/347: dwrite da/f13 [4194304,4194304] 0 2024-05-09T00:07:30.552 INFO:tasks.workunit.client.1.smithi135.stdout:1/348: write da/d24/d27/d33/d52/f56 [1190836,374] 0 2024-05-09T00:07:30.566 INFO:tasks.workunit.client.1.smithi135.stdout:6/344: rename d2/d20/d2e/f3e to d2/f76 0 2024-05-09T00:07:30.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/351: rename d1/d12/c18 to d1/d12/d21/d41/c6f 0 2024-05-09T00:07:30.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/352: chown d1/d12/d20/d2b/l53 320435437 1 2024-05-09T00:07:30.573 INFO:tasks.workunit.client.1.smithi135.stdout:9/278: rename d1/d24/l39 to d1/l4f 0 2024-05-09T00:07:30.575 INFO:tasks.workunit.client.1.smithi135.stdout:1/349: dwrite da/d24/d27/d33/f6d [0,4194304] 0 2024-05-09T00:07:30.577 INFO:tasks.workunit.client.1.smithi135.stdout:6/345: link f1 d2/f77 0 2024-05-09T00:07:30.579 INFO:tasks.workunit.client.1.smithi135.stdout:6/346: dread d2/d20/f36 [0,4194304] 0 2024-05-09T00:07:30.584 INFO:tasks.workunit.client.1.smithi135.stdout:0/350: rename d3/dd/f22 to d3/f5e 0 2024-05-09T00:07:30.584 INFO:tasks.workunit.client.1.smithi135.stdout:8/349: sync 2024-05-09T00:07:30.584 INFO:tasks.workunit.client.1.smithi135.stdout:5/374: sync 2024-05-09T00:07:30.589 INFO:tasks.workunit.client.1.smithi135.stdout:0/351: mknod d3/dd/d3f/d3a/d46/c5f 0 2024-05-09T00:07:30.596 INFO:tasks.workunit.client.1.smithi135.stdout:0/352: creat d3/dd/d2d/d4c/f60 x:0 0 0 2024-05-09T00:07:30.597 INFO:tasks.workunit.client.1.smithi135.stdout:0/353: chown d3/f12 0 1 2024-05-09T00:07:30.599 INFO:tasks.workunit.client.1.smithi135.stdout:4/287: rename dc/d26/d31/f41 to dc/d26/d31/d32/d39/f68 0 2024-05-09T00:07:30.600 INFO:tasks.workunit.client.1.smithi135.stdout:4/288: fsync dc/d26/d4e/f54 0 2024-05-09T00:07:30.600 INFO:tasks.workunit.client.1.smithi135.stdout:4/289: read - dc/d26/d31/d32/d39/f68 zero size 2024-05-09T00:07:30.600 INFO:tasks.workunit.client.1.smithi135.stdout:4/290: truncate dc/d26/d31/d32/d55/d5f/d5a/f63 428457 0 2024-05-09T00:07:30.600 INFO:tasks.workunit.client.1.smithi135.stdout:4/291: chown dc/dd/f17 1 1 2024-05-09T00:07:30.602 INFO:tasks.workunit.client.1.smithi135.stdout:8/350: rename l0 to d4/d7/d33/d39/l6c 0 2024-05-09T00:07:30.602 INFO:tasks.workunit.client.1.smithi135.stdout:8/351: chown d4/f2b 29507707 1 2024-05-09T00:07:30.602 INFO:tasks.workunit.client.1.smithi135.stdout:8/352: fsync d4/d7/d33/f55 0 2024-05-09T00:07:30.603 INFO:tasks.workunit.client.1.smithi135.stdout:5/375: dwrite db/d24/d2f/d31/d6e/f74 [0,4194304] 0 2024-05-09T00:07:30.613 INFO:tasks.workunit.client.1.smithi135.stdout:0/354: dread d3/dd/f32 [0,4194304] 0 2024-05-09T00:07:30.613 INFO:tasks.workunit.client.1.smithi135.stdout:5/376: symlink db/d24/d2f/l78 0 2024-05-09T00:07:30.613 INFO:tasks.workunit.client.1.smithi135.stdout:5/377: write db/d24/d32/d5b/f76 [871406,61432] 0 2024-05-09T00:07:30.615 INFO:tasks.workunit.client.1.smithi135.stdout:8/353: dread d4/d7/d33/d39/f48 [0,4194304] 0 2024-05-09T00:07:30.616 INFO:tasks.workunit.client.1.smithi135.stdout:0/355: dread d3/dd/f2f [0,4194304] 0 2024-05-09T00:07:30.617 INFO:tasks.workunit.client.1.smithi135.stdout:0/356: fdatasync d3/dd/d3f/d3a/d46/f52 0 2024-05-09T00:07:30.617 INFO:tasks.workunit.client.1.smithi135.stdout:0/357: readlink d3/l2b 0 2024-05-09T00:07:30.617 INFO:tasks.workunit.client.1.smithi135.stdout:8/354: read d4/f41 [548645,68751] 0 2024-05-09T00:07:30.618 INFO:tasks.workunit.client.1.smithi135.stdout:0/358: mknod d3/dd/d3f/d29/d54/c61 0 2024-05-09T00:07:30.621 INFO:tasks.workunit.client.1.smithi135.stdout:8/355: rmdir d4/d7/d4a 39 2024-05-09T00:07:30.622 INFO:tasks.workunit.client.1.smithi135.stdout:8/356: chown d4/d7/d33/d39/l3a 3316 1 2024-05-09T00:07:30.622 INFO:tasks.workunit.client.1.smithi135.stdout:8/357: dread d4/d7/f52 [4194304,4194304] 0 2024-05-09T00:07:30.624 INFO:tasks.workunit.client.1.smithi135.stdout:0/359: creat d3/dd/f62 x:0 0 0 2024-05-09T00:07:30.625 INFO:tasks.workunit.client.1.smithi135.stdout:8/358: write d4/f16 [2666022,83963] 0 2024-05-09T00:07:30.626 INFO:tasks.workunit.client.1.smithi135.stdout:0/360: creat d3/dd/d3f/d58/f63 x:0 0 0 2024-05-09T00:07:30.629 INFO:tasks.workunit.client.1.smithi135.stdout:8/359: mknod d4/d7/d2a/c6d 0 2024-05-09T00:07:30.631 INFO:tasks.workunit.client.1.smithi135.stdout:5/378: dwrite db/d24/d32/f58 [0,4194304] 0 2024-05-09T00:07:30.631 INFO:tasks.workunit.client.1.smithi135.stdout:5/379: truncate db/d24/d2f/d31/d5e/f69 712444 0 2024-05-09T00:07:30.631 INFO:tasks.workunit.client.1.smithi135.stdout:5/380: chown db 998203 1 2024-05-09T00:07:30.631 INFO:tasks.workunit.client.1.smithi135.stdout:0/361: unlink d3/dd/f50 0 2024-05-09T00:07:30.633 INFO:tasks.workunit.client.1.smithi135.stdout:8/360: dread d4/d7/f2f [0,4194304] 0 2024-05-09T00:07:30.634 INFO:tasks.workunit.client.1.smithi135.stdout:5/381: creat db/d24/d32/f79 x:0 0 0 2024-05-09T00:07:30.634 INFO:tasks.workunit.client.1.smithi135.stdout:5/382: chown db/d5d/f64 683675162 1 2024-05-09T00:07:30.634 INFO:tasks.workunit.client.1.smithi135.stdout:5/383: chown db/f1a 126112 1 2024-05-09T00:07:30.635 INFO:tasks.workunit.client.1.smithi135.stdout:5/384: fdatasync db/d24/f34 0 2024-05-09T00:07:30.637 INFO:tasks.workunit.client.1.smithi135.stdout:0/362: unlink d3/dd/d2d/d4c/l56 0 2024-05-09T00:07:30.638 INFO:tasks.workunit.client.1.smithi135.stdout:8/361: symlink d4/d7/de/d45/l6e 0 2024-05-09T00:07:30.643 INFO:tasks.workunit.client.1.smithi135.stdout:5/385: symlink db/d24/d2f/l7a 0 2024-05-09T00:07:30.644 INFO:tasks.workunit.client.1.smithi135.stdout:0/363: mkdir d3/d64 0 2024-05-09T00:07:30.646 INFO:tasks.workunit.client.1.smithi135.stdout:8/362: creat d4/d7/d2a/f6f x:0 0 0 2024-05-09T00:07:30.650 INFO:tasks.workunit.client.1.smithi135.stdout:0/364: dread d3/dd/d3f/d3a/d46/f52 [0,4194304] 0 2024-05-09T00:07:30.656 INFO:tasks.workunit.client.1.smithi135.stdout:5/386: dwrite db/d24/d2f/f49 [0,4194304] 0 2024-05-09T00:07:30.657 INFO:tasks.workunit.client.1.smithi135.stdout:5/387: fsync db/d24/d2f/f4b 0 2024-05-09T00:07:30.660 INFO:tasks.workunit.client.1.smithi135.stdout:1/350: truncate da/d24/d27/d33/d52/f56 236172 0 2024-05-09T00:07:30.660 INFO:tasks.workunit.client.1.smithi135.stdout:1/351: stat da/d24/d27 0 2024-05-09T00:07:30.662 INFO:tasks.workunit.client.1.smithi135.stdout:5/388: symlink db/d24/d2f/d62/d73/l7b 0 2024-05-09T00:07:30.663 INFO:tasks.workunit.client.1.smithi135.stdout:1/352: mkdir da/d14/d5c/d83 0 2024-05-09T00:07:30.666 INFO:tasks.workunit.client.1.smithi135.stdout:5/389: rmdir db/d52 39 2024-05-09T00:07:30.666 INFO:tasks.workunit.client.1.smithi135.stdout:5/390: stat db/d24/c3a 0 2024-05-09T00:07:30.667 INFO:tasks.workunit.client.1.smithi135.stdout:1/353: symlink da/d14/d20/d38/d3a/d40/l84 0 2024-05-09T00:07:30.668 INFO:tasks.workunit.client.1.smithi135.stdout:3/327: sync 2024-05-09T00:07:30.668 INFO:tasks.workunit.client.1.smithi135.stdout:7/398: sync 2024-05-09T00:07:30.669 INFO:tasks.workunit.client.1.smithi135.stdout:5/391: creat db/d52/f7c x:0 0 0 2024-05-09T00:07:30.671 INFO:tasks.workunit.client.1.smithi135.stdout:3/328: mknod d8/d13/d51/d6f/c77 0 2024-05-09T00:07:30.674 INFO:tasks.workunit.client.1.smithi135.stdout:3/329: creat d8/d6d/f78 x:0 0 0 2024-05-09T00:07:30.674 INFO:tasks.workunit.client.1.smithi135.stdout:8/363: dwrite d4/f2c [0,4194304] 0 2024-05-09T00:07:30.677 INFO:tasks.workunit.client.1.smithi135.stdout:3/330: symlink d8/l79 0 2024-05-09T00:07:30.678 INFO:tasks.workunit.client.1.smithi135.stdout:8/364: link d4/d7/d33/f55 d4/d7/d33/d39/f70 0 2024-05-09T00:07:30.679 INFO:tasks.workunit.client.1.smithi135.stdout:5/392: dread db/d24/d2f/d31/d5e/f55 [0,4194304] 0 2024-05-09T00:07:30.681 INFO:tasks.workunit.client.1.smithi135.stdout:8/365: link d4/d7/l3f d4/d7/d33/d39/l71 0 2024-05-09T00:07:30.688 INFO:tasks.workunit.client.1.smithi135.stdout:4/292: rename dc/d26/d31/d32 to dc/d4a/d69 0 2024-05-09T00:07:30.689 INFO:tasks.workunit.client.1.smithi135.stdout:4/293: write dc/d26/d4e/f54 [865467,121750] 0 2024-05-09T00:07:30.689 INFO:tasks.workunit.client.1.smithi135.stdout:4/294: truncate dc/f42 766700 0 2024-05-09T00:07:30.691 INFO:tasks.workunit.client.1.smithi135.stdout:0/365: rename d3/f15 to d3/dd/d2d/f65 0 2024-05-09T00:07:30.693 INFO:tasks.workunit.client.1.smithi135.stdout:4/295: unlink dc/dd/l23 0 2024-05-09T00:07:30.695 INFO:tasks.workunit.client.1.smithi135.stdout:7/399: rename db/f62 to db/dd/d33/d69/d78/f87 0 2024-05-09T00:07:30.697 INFO:tasks.workunit.client.1.smithi135.stdout:0/366: symlink d3/dd/d2d/d4c/l66 0 2024-05-09T00:07:30.698 INFO:tasks.workunit.client.1.smithi135.stdout:0/367: write d3/dd/d3f/f21 [2898694,25794] 0 2024-05-09T00:07:30.698 INFO:tasks.workunit.client.1.smithi135.stdout:0/368: write d3/dd/d2d/d4c/f60 [301813,107188] 0 2024-05-09T00:07:30.700 INFO:tasks.workunit.client.1.smithi135.stdout:4/296: dread dc/d4a/d69/d55/d5f/f20 [0,4194304] 0 2024-05-09T00:07:30.700 INFO:tasks.workunit.client.1.smithi135.stdout:4/297: fsync dc/f2d 0 2024-05-09T00:07:30.701 INFO:tasks.workunit.client.1.smithi135.stdout:3/331: rename d8/d13/c6c to d8/d6d/d24/c7a 0 2024-05-09T00:07:30.701 INFO:tasks.workunit.client.1.smithi135.stdout:3/332: fdatasync d8/d6d/f31 0 2024-05-09T00:07:30.702 INFO:tasks.workunit.client.1.smithi135.stdout:0/369: symlink d3/d64/l67 0 2024-05-09T00:07:30.702 INFO:tasks.workunit.client.1.smithi135.stdout:0/370: chown d3/dd/d3f/d29/l57 489603202 1 2024-05-09T00:07:30.702 INFO:tasks.workunit.client.1.smithi135.stdout:0/371: stat d3/dd/c59 0 2024-05-09T00:07:30.705 INFO:tasks.workunit.client.1.smithi135.stdout:5/393: rename db/d3f/c5a to db/d24/d2f/d31/d5e/c7d 0 2024-05-09T00:07:30.707 INFO:tasks.workunit.client.1.smithi135.stdout:3/333: mkdir d8/d13/d51/d6f/d7b 0 2024-05-09T00:07:30.708 INFO:tasks.workunit.client.1.smithi135.stdout:4/298: dread dc/dd/f22 [0,4194304] 0 2024-05-09T00:07:30.710 INFO:tasks.workunit.client.1.smithi135.stdout:7/400: dwrite db/f37 [0,4194304] 0 2024-05-09T00:07:30.710 INFO:tasks.workunit.client.1.smithi135.stdout:5/394: mkdir db/d5d/d7e 0 2024-05-09T00:07:30.712 INFO:tasks.workunit.client.1.smithi135.stdout:3/334: mknod d8/d13/d1f/d40/c7c 0 2024-05-09T00:07:30.713 INFO:tasks.workunit.client.1.smithi135.stdout:4/299: mknod dc/d4a/c6a 0 2024-05-09T00:07:30.714 INFO:tasks.workunit.client.1.smithi135.stdout:4/300: fdatasync f3 0 2024-05-09T00:07:30.729 INFO:tasks.workunit.client.1.smithi135.stdout:7/401: mknod db/d1e/d3a/d40/c88 0 2024-05-09T00:07:30.730 INFO:tasks.workunit.client.1.smithi135.stdout:7/402: truncate db/d1e/f36 2204072 0 2024-05-09T00:07:30.731 INFO:tasks.workunit.client.1.smithi135.stdout:3/335: dwrite d8/d13/f1e [0,4194304] 0 2024-05-09T00:07:30.731 INFO:tasks.workunit.client.1.smithi135.stdout:3/336: truncate d8/d6d/f28 1354649 0 2024-05-09T00:07:30.731 INFO:tasks.workunit.client.1.smithi135.stdout:5/395: rename db/f25 to db/f7f 0 2024-05-09T00:07:30.736 INFO:tasks.workunit.client.1.smithi135.stdout:0/372: dwrite d3/dd/f1b [4194304,4194304] 0 2024-05-09T00:07:30.737 INFO:tasks.workunit.client.1.smithi135.stdout:5/396: symlink db/d24/d32/l80 0 2024-05-09T00:07:30.737 INFO:tasks.workunit.client.1.smithi135.stdout:5/397: fsync db/d3f/f61 0 2024-05-09T00:07:30.741 INFO:tasks.workunit.client.1.smithi135.stdout:4/301: rename dc/d26/d31/f3e to dc/d4a/d69/d55/d5f/f6b 0 2024-05-09T00:07:30.742 INFO:tasks.workunit.client.1.smithi135.stdout:7/403: dwrite db/f42 [0,4194304] 0 2024-05-09T00:07:30.743 INFO:tasks.workunit.client.1.smithi135.stdout:0/373: creat d3/dd/d2d/f68 x:0 0 0 2024-05-09T00:07:30.745 INFO:tasks.workunit.client.1.smithi135.stdout:4/302: rename dc/c2b to dc/d4a/d69/d45/c6c 0 2024-05-09T00:07:30.745 INFO:tasks.workunit.client.1.smithi135.stdout:5/398: dread db/f7f [0,4194304] 0 2024-05-09T00:07:30.753 INFO:tasks.workunit.client.1.smithi135.stdout:0/374: creat d3/dd/d3f/d43/f69 x:0 0 0 2024-05-09T00:07:30.758 INFO:tasks.workunit.client.1.smithi135.stdout:4/303: mkdir dc/d4a/d69/d55/d6d 0 2024-05-09T00:07:30.758 INFO:tasks.workunit.client.1.smithi135.stdout:7/404: dread db/d1e/d3a/d40/d4c/f53 [0,4194304] 0 2024-05-09T00:07:30.765 INFO:tasks.workunit.client.1.smithi135.stdout:7/405: link db/d1e/d3a/d40/l5a db/d13/l89 0 2024-05-09T00:07:30.767 INFO:tasks.workunit.client.1.smithi135.stdout:4/304: dread dc/f42 [0,4194304] 0 2024-05-09T00:07:30.770 INFO:tasks.workunit.client.1.smithi135.stdout:4/305: unlink dc/d4a/d69/d55/d5f/d5a/f63 0 2024-05-09T00:07:30.771 INFO:tasks.workunit.client.1.smithi135.stdout:1/354: dwrite da/d24/d27/d33/d52/f56 [0,4194304] 0 2024-05-09T00:07:30.771 INFO:tasks.workunit.client.1.smithi135.stdout:1/355: readlink da/d24/d27/d33/d36/l49 0 2024-05-09T00:07:30.771 INFO:tasks.workunit.client.1.smithi135.stdout:5/399: dwrite db/d24/f34 [0,4194304] 0 2024-05-09T00:07:30.772 INFO:tasks.workunit.client.1.smithi135.stdout:5/400: write db/d24/d2f/f41 [3833042,83794] 0 2024-05-09T00:07:30.773 INFO:tasks.workunit.client.1.smithi135.stdout:5/401: write db/f12 [1927648,1281] 0 2024-05-09T00:07:30.775 INFO:tasks.workunit.client.1.smithi135.stdout:4/306: rename f3 to dc/d26/d4e/f6e 0 2024-05-09T00:07:30.777 INFO:tasks.workunit.client.1.smithi135.stdout:3/337: getdents d8 0 2024-05-09T00:07:30.781 INFO:tasks.workunit.client.1.smithi135.stdout:5/402: write db/d24/d2f/d31/d6e/f74 [2578564,80391] 0 2024-05-09T00:07:30.781 INFO:tasks.workunit.client.1.smithi135.stdout:5/403: truncate db/f12 2366937 0 2024-05-09T00:07:30.784 INFO:tasks.workunit.client.1.smithi135.stdout:8/366: rmdir d4/d7/d33/d39 39 2024-05-09T00:07:30.787 INFO:tasks.workunit.client.1.smithi135.stdout:4/307: rmdir dc/d4a/d69/d45 39 2024-05-09T00:07:30.788 INFO:tasks.workunit.client.1.smithi135.stdout:3/338: rename d8/d13/d75/d53/f5d to d8/d13/d1f/d40/d52/f7d 0 2024-05-09T00:07:30.788 INFO:tasks.workunit.client.1.smithi135.stdout:7/406: dwrite db/d13/f24 [0,4194304] 0 2024-05-09T00:07:30.788 INFO:tasks.workunit.client.1.smithi135.stdout:3/339: fsync d8/d6d/d44/d4b/d59/f65 0 2024-05-09T00:07:30.789 INFO:tasks.workunit.client.1.smithi135.stdout:3/340: fsync f0 0 2024-05-09T00:07:30.789 INFO:tasks.workunit.client.1.smithi135.stdout:3/341: readlink d8/lb 0 2024-05-09T00:07:30.790 INFO:tasks.workunit.client.1.smithi135.stdout:3/342: fdatasync d8/d13/d1f/f43 0 2024-05-09T00:07:30.792 INFO:tasks.workunit.client.1.smithi135.stdout:9/279: sync 2024-05-09T00:07:30.792 INFO:tasks.workunit.client.1.smithi135.stdout:2/353: sync 2024-05-09T00:07:30.792 INFO:tasks.workunit.client.1.smithi135.stdout:2/354: chown d1/f1f 6227 1 2024-05-09T00:07:30.797 INFO:tasks.workunit.client.1.smithi135.stdout:3/343: mkdir d8/d6d/d44/d4b/d7e 0 2024-05-09T00:07:30.798 INFO:tasks.workunit.client.1.smithi135.stdout:3/344: write d8/d13/f1b [2709006,8065] 0 2024-05-09T00:07:30.799 INFO:tasks.workunit.client.1.smithi135.stdout:5/404: dread db/d24/d2f/d31/d5e/f69 [0,4194304] 0 2024-05-09T00:07:30.800 INFO:tasks.workunit.client.1.smithi135.stdout:1/356: dwrite da/d14/d20/d38/f4d [0,4194304] 0 2024-05-09T00:07:30.801 INFO:tasks.workunit.client.1.smithi135.stdout:9/280: mknod d1/d1a/d2c/d20/c50 0 2024-05-09T00:07:30.802 INFO:tasks.workunit.client.1.smithi135.stdout:8/367: dwrite d4/f2e [0,4194304] 0 2024-05-09T00:07:30.803 INFO:tasks.workunit.client.1.smithi135.stdout:2/355: mknod d1/d12/d20/d3b/c70 0 2024-05-09T00:07:30.803 INFO:tasks.workunit.client.1.smithi135.stdout:2/356: chown d1/c2a 5166095 1 2024-05-09T00:07:30.803 INFO:tasks.workunit.client.1.smithi135.stdout:2/357: read - d1/f47 zero size 2024-05-09T00:07:30.805 INFO:tasks.workunit.client.1.smithi135.stdout:4/308: rename dc/f25 to dc/d26/d31/f6f 0 2024-05-09T00:07:30.806 INFO:tasks.workunit.client.1.smithi135.stdout:4/309: chown dc/d26/f2a 252 1 2024-05-09T00:07:30.806 INFO:tasks.workunit.client.1.smithi135.stdout:4/310: write dc/f4b [221714,42946] 0 2024-05-09T00:07:30.806 INFO:tasks.workunit.client.1.smithi135.stdout:4/311: dread - dc/d4a/d69/d55/d5f/f6b zero size 2024-05-09T00:07:30.807 INFO:tasks.workunit.client.1.smithi135.stdout:7/407: mknod db/dd/c8a 0 2024-05-09T00:07:30.812 INFO:tasks.workunit.client.1.smithi135.stdout:5/405: creat db/d24/d2f/d31/f81 x:0 0 0 2024-05-09T00:07:30.812 INFO:tasks.workunit.client.1.smithi135.stdout:5/406: fsync db/d24/d32/d5b/f76 0 2024-05-09T00:07:30.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/345: dread d8/d13/f22 [0,4194304] 0 2024-05-09T00:07:30.816 INFO:tasks.workunit.client.1.smithi135.stdout:1/357: symlink da/db/d16/l85 0 2024-05-09T00:07:30.817 INFO:tasks.workunit.client.1.smithi135.stdout:1/358: truncate da/d24/d27/d33/d36/f65 626347 0 2024-05-09T00:07:30.818 INFO:tasks.workunit.client.1.smithi135.stdout:3/346: dread d8/d6d/f28 [0,4194304] 0 2024-05-09T00:07:30.818 INFO:tasks.workunit.client.1.smithi135.stdout:3/347: fdatasync d8/d6d/f20 0 2024-05-09T00:07:30.818 INFO:tasks.workunit.client.1.smithi135.stdout:3/348: fdatasync d8/f23 0 2024-05-09T00:07:30.818 INFO:tasks.workunit.client.1.smithi135.stdout:9/281: creat d1/d1a/f51 x:0 0 0 2024-05-09T00:07:30.819 INFO:tasks.workunit.client.1.smithi135.stdout:9/282: dread - d1/d1a/f51 zero size 2024-05-09T00:07:30.819 INFO:tasks.workunit.client.1.smithi135.stdout:9/283: chown d1/d1a/f42 1 1 2024-05-09T00:07:30.822 INFO:tasks.workunit.client.1.smithi135.stdout:9/284: dread d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:30.823 INFO:tasks.workunit.client.1.smithi135.stdout:6/347: sync 2024-05-09T00:07:30.825 INFO:tasks.workunit.client.1.smithi135.stdout:8/368: getdents d4/d7/d2a/d56 0 2024-05-09T00:07:30.829 INFO:tasks.workunit.client.1.smithi135.stdout:2/358: unlink d1/lb 0 2024-05-09T00:07:30.829 INFO:tasks.workunit.client.1.smithi135.stdout:2/359: fsync d1/d12/d20/d3b/d4f/f64 0 2024-05-09T00:07:30.832 INFO:tasks.workunit.client.1.smithi135.stdout:4/312: creat dc/d4a/d69/f70 x:0 0 0 2024-05-09T00:07:30.836 INFO:tasks.workunit.client.1.smithi135.stdout:7/408: rename db/dd/d33/d69/f83 to db/d21/f8b 0 2024-05-09T00:07:30.839 INFO:tasks.workunit.client.1.smithi135.stdout:5/407: creat db/d5d/d7e/f82 x:0 0 0 2024-05-09T00:07:30.840 INFO:tasks.workunit.client.1.smithi135.stdout:4/313: dread dc/dd/f3f [0,4194304] 0 2024-05-09T00:07:30.841 INFO:tasks.workunit.client.1.smithi135.stdout:4/314: write dc/dd/f14 [1012610,24913] 0 2024-05-09T00:07:30.841 INFO:tasks.workunit.client.1.smithi135.stdout:4/315: truncate dc/d4a/d69/f67 861469 0 2024-05-09T00:07:30.843 INFO:tasks.workunit.client.1.smithi135.stdout:1/359: unlink da/d14/f19 0 2024-05-09T00:07:30.846 INFO:tasks.workunit.client.1.smithi135.stdout:3/349: truncate d8/d13/f2d 2869288 0 2024-05-09T00:07:30.846 INFO:tasks.workunit.client.1.smithi135.stdout:3/350: chown d8/d13/f46 0 1 2024-05-09T00:07:30.849 INFO:tasks.workunit.client.1.smithi135.stdout:9/285: mknod d1/d1a/c52 0 2024-05-09T00:07:30.853 INFO:tasks.workunit.client.1.smithi135.stdout:6/348: mkdir d2/da/d1d/d69/d78 0 2024-05-09T00:07:30.853 INFO:tasks.workunit.client.1.smithi135.stdout:7/409: dwrite db/d1e/d3a/d40/f55 [0,4194304] 0 2024-05-09T00:07:30.853 INFO:tasks.workunit.client.1.smithi135.stdout:7/410: readlink db/dd/d33/l66 0 2024-05-09T00:07:30.858 INFO:tasks.workunit.client.1.smithi135.stdout:8/369: rename d4/d8/fb to d4/d22/f72 0 2024-05-09T00:07:30.859 INFO:tasks.workunit.client.1.smithi135.stdout:5/408: creat db/d24/d2f/d62/d73/f83 x:0 0 0 2024-05-09T00:07:30.859 INFO:tasks.workunit.client.1.smithi135.stdout:5/409: fsync f4 0 2024-05-09T00:07:30.861 INFO:tasks.workunit.client.1.smithi135.stdout:4/316: unlink dc/d4a/d69/d45/c6c 0 2024-05-09T00:07:30.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/360: mkdir da/d14/d20/d38/d86 0 2024-05-09T00:07:30.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/361: readlink da/d24/d27/l44 0 2024-05-09T00:07:30.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/362: chown da/d14/d20/d38/l72 16 1 2024-05-09T00:07:30.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/363: write da/d14/d20/d38/d3a/d40/f82 [679801,110362] 0 2024-05-09T00:07:30.866 INFO:tasks.workunit.client.1.smithi135.stdout:0/375: rmdir d3/dd 39 2024-05-09T00:07:30.867 INFO:tasks.workunit.client.1.smithi135.stdout:9/286: dwrite d1/d24/f35 [0,4194304] 0 2024-05-09T00:07:30.868 INFO:tasks.workunit.client.1.smithi135.stdout:3/351: mknod d8/d13/d1f/d62/c7f 0 2024-05-09T00:07:30.868 INFO:tasks.workunit.client.1.smithi135.stdout:3/352: fdatasync d8/d13/f2d 0 2024-05-09T00:07:30.868 INFO:tasks.workunit.client.1.smithi135.stdout:3/353: readlink d8/l79 0 2024-05-09T00:07:30.873 INFO:tasks.workunit.client.1.smithi135.stdout:2/360: rename d1/fa to d1/d12/d20/d2b/f71 0 2024-05-09T00:07:30.874 INFO:tasks.workunit.client.1.smithi135.stdout:3/354: dread f3 [0,4194304] 0 2024-05-09T00:07:30.875 INFO:tasks.workunit.client.1.smithi135.stdout:8/370: symlink d4/d7/d2a/l73 0 2024-05-09T00:07:30.876 INFO:tasks.workunit.client.1.smithi135.stdout:6/349: dwrite d2/d20/d2e/d3d/f48 [0,4194304] 0 2024-05-09T00:07:30.878 INFO:tasks.workunit.client.1.smithi135.stdout:4/317: mkdir dc/d71 0 2024-05-09T00:07:30.880 INFO:tasks.workunit.client.1.smithi135.stdout:1/364: truncate da/db/f61 711307 0 2024-05-09T00:07:30.884 INFO:tasks.workunit.client.1.smithi135.stdout:0/376: link d3/dd/d3f/f33 d3/dd/d2d/f6a 0 2024-05-09T00:07:30.884 INFO:tasks.workunit.client.1.smithi135.stdout:0/377: fdatasync d3/f3b 0 2024-05-09T00:07:30.885 INFO:tasks.workunit.client.1.smithi135.stdout:2/361: dread d1/d12/d20/f29 [0,4194304] 0 2024-05-09T00:07:30.885 INFO:tasks.workunit.client.1.smithi135.stdout:9/287: truncate d1/d1a/d2c/f11 100744 0 2024-05-09T00:07:30.888 INFO:tasks.workunit.client.1.smithi135.stdout:7/411: rename db/dd/c2c to db/d1e/d3a/d40/d7e/c8c 0 2024-05-09T00:07:30.889 INFO:tasks.workunit.client.1.smithi135.stdout:7/412: stat db/dd/d33/d68/l74 0 2024-05-09T00:07:30.890 INFO:tasks.workunit.client.1.smithi135.stdout:8/371: dread d4/d7/d33/d39/f48 [0,4194304] 0 2024-05-09T00:07:30.894 INFO:tasks.workunit.client.1.smithi135.stdout:4/318: symlink dc/dd/l72 0 2024-05-09T00:07:30.896 INFO:tasks.workunit.client.1.smithi135.stdout:1/365: truncate da/d14/f3f 2441164 0 2024-05-09T00:07:30.899 INFO:tasks.workunit.client.1.smithi135.stdout:2/362: rmdir d1/d12/d20/d2b/d56 39 2024-05-09T00:07:30.904 INFO:tasks.workunit.client.1.smithi135.stdout:9/288: creat d1/d1a/d2c/f53 x:0 0 0 2024-05-09T00:07:30.910 INFO:tasks.workunit.client.1.smithi135.stdout:7/413: getdents db 0 2024-05-09T00:07:30.914 INFO:tasks.workunit.client.1.smithi135.stdout:7/414: read db/dd/d33/d69/d78/f87 [80406,87215] 0 2024-05-09T00:07:30.914 INFO:tasks.workunit.client.1.smithi135.stdout:4/319: symlink dc/l73 0 2024-05-09T00:07:30.916 INFO:tasks.workunit.client.1.smithi135.stdout:1/366: creat da/d24/d27/d33/d52/d71/f87 x:0 0 0 2024-05-09T00:07:30.917 INFO:tasks.workunit.client.1.smithi135.stdout:7/415: read db/d1e/d3a/d40/d4c/d67/f6e [2750609,41395] 0 2024-05-09T00:07:30.918 INFO:tasks.workunit.client.1.smithi135.stdout:2/363: mkdir d1/d12/d20/d2b/d56/d72 0 2024-05-09T00:07:30.920 INFO:tasks.workunit.client.1.smithi135.stdout:1/367: write da/db/d16/f18 [2804820,121793] 0 2024-05-09T00:07:30.920 INFO:tasks.workunit.client.1.smithi135.stdout:1/368: write da/d73/f81 [274689,42673] 0 2024-05-09T00:07:30.920 INFO:tasks.workunit.client.1.smithi135.stdout:1/369: stat da/d73 0 2024-05-09T00:07:30.921 INFO:tasks.workunit.client.1.smithi135.stdout:9/289: mkdir d1/d24/d44/d54 0 2024-05-09T00:07:30.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/372: dwrite d4/f2b [4194304,4194304] 0 2024-05-09T00:07:30.923 INFO:tasks.workunit.client.1.smithi135.stdout:4/320: dread dc/f24 [0,4194304] 0 2024-05-09T00:07:30.923 INFO:tasks.workunit.client.1.smithi135.stdout:0/378: dwrite d3/dd/d3f/d3a/d46/f52 [0,4194304] 0 2024-05-09T00:07:30.924 INFO:tasks.workunit.client.1.smithi135.stdout:6/350: dwrite d2/d20/d3f/f44 [0,4194304] 0 2024-05-09T00:07:30.924 INFO:tasks.workunit.client.1.smithi135.stdout:6/351: chown d2/da/d49/f5a 4768718 1 2024-05-09T00:07:30.926 INFO:tasks.workunit.client.1.smithi135.stdout:7/416: creat db/dd/d33/d58/f8d x:0 0 0 2024-05-09T00:07:30.929 INFO:tasks.workunit.client.1.smithi135.stdout:2/364: link d1/le d1/d12/d20/d3b/l73 0 2024-05-09T00:07:30.933 INFO:tasks.workunit.client.1.smithi135.stdout:8/373: dread d4/f2c [0,4194304] 0 2024-05-09T00:07:30.933 INFO:tasks.workunit.client.1.smithi135.stdout:8/374: fdatasync d4/f41 0 2024-05-09T00:07:30.933 INFO:tasks.workunit.client.1.smithi135.stdout:8/375: chown d4/d7 1 1 2024-05-09T00:07:30.933 INFO:tasks.workunit.client.1.smithi135.stdout:6/352: dread d2/f77 [0,4194304] 0 2024-05-09T00:07:30.933 INFO:tasks.workunit.client.1.smithi135.stdout:6/353: fdatasync d2/da/d49/f23 0 2024-05-09T00:07:30.934 INFO:tasks.workunit.client.1.smithi135.stdout:6/354: readlink d2/l1c 0 2024-05-09T00:07:30.935 INFO:tasks.workunit.client.1.smithi135.stdout:6/355: read d2/da/d26/f55 [1783257,71175] 0 2024-05-09T00:07:30.935 INFO:tasks.workunit.client.1.smithi135.stdout:6/356: fdatasync d2/f9 0 2024-05-09T00:07:30.936 INFO:tasks.workunit.client.1.smithi135.stdout:4/321: symlink dc/d4a/l74 0 2024-05-09T00:07:30.937 INFO:tasks.workunit.client.1.smithi135.stdout:0/379: mknod d3/d64/c6b 0 2024-05-09T00:07:30.939 INFO:tasks.workunit.client.1.smithi135.stdout:7/417: creat db/d1e/d3a/d40/d4c/f8e x:0 0 0 2024-05-09T00:07:30.941 INFO:tasks.workunit.client.1.smithi135.stdout:2/365: link d1/l14 d1/d12/d20/d2b/l74 0 2024-05-09T00:07:30.942 INFO:tasks.workunit.client.1.smithi135.stdout:2/366: write d1/d12/d20/d3b/d4f/f64 [2589480,32644] 0 2024-05-09T00:07:30.943 INFO:tasks.workunit.client.1.smithi135.stdout:2/367: write d1/d12/d20/d2b/f37 [4180046,15965] 0 2024-05-09T00:07:30.943 INFO:tasks.workunit.client.1.smithi135.stdout:2/368: readlink d1/d12/d21/l39 0 2024-05-09T00:07:30.943 INFO:tasks.workunit.client.1.smithi135.stdout:2/369: readlink d1/d12/d21/l39 0 2024-05-09T00:07:30.943 INFO:tasks.workunit.client.1.smithi135.stdout:2/370: readlink d1/l2f 0 2024-05-09T00:07:30.944 INFO:tasks.workunit.client.1.smithi135.stdout:2/371: dread - d1/d12/d20/d2b/d56/f69 zero size 2024-05-09T00:07:30.944 INFO:tasks.workunit.client.1.smithi135.stdout:6/357: unlink d2/f2c 0 2024-05-09T00:07:30.945 INFO:tasks.workunit.client.1.smithi135.stdout:6/358: write d2/d1a/f1b [1632230,36011] 0 2024-05-09T00:07:30.945 INFO:tasks.workunit.client.1.smithi135.stdout:6/359: readlink d2/d20/d37/l5d 0 2024-05-09T00:07:30.967 INFO:tasks.workunit.client.1.smithi135.stdout:5/410: rename db/d24/d2f to db/d84 0 2024-05-09T00:07:30.969 INFO:tasks.workunit.client.1.smithi135.stdout:0/380: creat d3/dd/f6c x:0 0 0 2024-05-09T00:07:30.978 INFO:tasks.workunit.client.1.smithi135.stdout:7/418: dwrite db/f37 [0,4194304] 0 2024-05-09T00:07:30.979 INFO:tasks.workunit.client.1.smithi135.stdout:4/322: dwrite dc/d4a/d69/d39/f48 [0,4194304] 0 2024-05-09T00:07:30.979 INFO:tasks.workunit.client.1.smithi135.stdout:4/323: truncate dc/f61 912619 0 2024-05-09T00:07:30.982 INFO:tasks.workunit.client.1.smithi135.stdout:7/419: dread db/f29 [0,4194304] 0 2024-05-09T00:07:30.988 INFO:tasks.workunit.client.1.smithi135.stdout:9/290: write d1/d1a/d2c/f11 [1110759,7859] 0 2024-05-09T00:07:30.990 INFO:tasks.workunit.client.1.smithi135.stdout:2/372: creat d1/d12/d21/d41/d6d/d6e/f75 x:0 0 0 2024-05-09T00:07:30.999 INFO:tasks.workunit.client.1.smithi135.stdout:3/355: rename d8/d6d/d44/d4b/d7e to d8/d13/d51/d6f/d7b/d80 0 2024-05-09T00:07:30.999 INFO:tasks.workunit.client.1.smithi135.stdout:1/370: rename da/d14/d20 to da/d14/d20/d88 22 2024-05-09T00:07:31.000 INFO:tasks.workunit.client.1.smithi135.stdout:3/356: write d8/d6d/d44/d4b/d69/f4a [872698,104045] 0 2024-05-09T00:07:31.000 INFO:tasks.workunit.client.1.smithi135.stdout:5/411: creat db/d5d/d7e/f85 x:0 0 0 2024-05-09T00:07:31.001 INFO:tasks.workunit.client.1.smithi135.stdout:3/357: write d8/d13/f2d [599829,119574] 0 2024-05-09T00:07:31.015 INFO:tasks.workunit.client.1.smithi135.stdout:9/291: unlink d1/d24/c37 0 2024-05-09T00:07:31.016 INFO:tasks.workunit.client.1.smithi135.stdout:9/292: fsync d1/d1a/d2c/d2d/f31 0 2024-05-09T00:07:31.016 INFO:tasks.workunit.client.1.smithi135.stdout:9/293: chown d1/d1a/d2c/d2d/c48 1652244101 1 2024-05-09T00:07:31.016 INFO:tasks.workunit.client.1.smithi135.stdout:2/373: stat d1/d12/d20/f46 0 2024-05-09T00:07:31.017 INFO:tasks.workunit.client.1.smithi135.stdout:2/374: readlink d1/d12/d20/d2b/d56/l5d 0 2024-05-09T00:07:31.021 INFO:tasks.workunit.client.1.smithi135.stdout:6/360: rename d2/da/d26/d57/d60/l61 to d2/da/d26/l79 0 2024-05-09T00:07:31.023 INFO:tasks.workunit.client.1.smithi135.stdout:1/371: write da/d14/d20/d38/d3a/d40/f82 [1024996,96271] 0 2024-05-09T00:07:31.028 INFO:tasks.workunit.client.1.smithi135.stdout:5/412: symlink db/d84/d31/d5e/l86 0 2024-05-09T00:07:31.032 INFO:tasks.workunit.client.1.smithi135.stdout:5/413: dread db/d3f/f4d [0,4194304] 0 2024-05-09T00:07:31.032 INFO:tasks.workunit.client.1.smithi135.stdout:3/358: truncate d8/d13/d1f/f2f 7236 0 2024-05-09T00:07:31.033 INFO:tasks.workunit.client.1.smithi135.stdout:3/359: write d8/d13/d1f/f30 [952732,46398] 0 2024-05-09T00:07:31.034 INFO:tasks.workunit.client.1.smithi135.stdout:6/361: dwrite d2/da/d26/d57/d60/f72 [0,4194304] 0 2024-05-09T00:07:31.035 INFO:tasks.workunit.client.1.smithi135.stdout:9/294: creat d1/d24/d44/d54/f55 x:0 0 0 2024-05-09T00:07:31.037 INFO:tasks.workunit.client.1.smithi135.stdout:2/375: link d1/d12/d20/f68 d1/d12/d20/d2b/d56/f76 0 2024-05-09T00:07:31.040 INFO:tasks.workunit.client.1.smithi135.stdout:5/414: unlink db/d24/d32/f51 0 2024-05-09T00:07:31.043 INFO:tasks.workunit.client.1.smithi135.stdout:3/360: unlink d8/d13/d1f/d40/c7c 0 2024-05-09T00:07:31.044 INFO:tasks.workunit.client.1.smithi135.stdout:1/372: dread da/d24/d27/d33/d52/f56 [0,4194304] 0 2024-05-09T00:07:31.051 INFO:tasks.workunit.client.1.smithi135.stdout:6/362: mkdir d2/d1a/d7a 0 2024-05-09T00:07:31.054 INFO:tasks.workunit.client.1.smithi135.stdout:2/376: write d1/d22/f26 [312036,105875] 0 2024-05-09T00:07:31.055 INFO:tasks.workunit.client.1.smithi135.stdout:3/361: truncate d8/d6d/f31 586156 0 2024-05-09T00:07:31.057 INFO:tasks.workunit.client.1.smithi135.stdout:1/373: fdatasync da/f1f 0 2024-05-09T00:07:31.062 INFO:tasks.workunit.client.1.smithi135.stdout:6/363: link d2/d1a/c46 d2/d20/d2e/c7b 0 2024-05-09T00:07:31.063 INFO:tasks.workunit.client.1.smithi135.stdout:9/295: link d1/d1a/l4d d1/d1a/d10/l56 0 2024-05-09T00:07:31.066 INFO:tasks.workunit.client.1.smithi135.stdout:3/362: getdents d8/d13/d1f/d40/d52 0 2024-05-09T00:07:31.066 INFO:tasks.workunit.client.1.smithi135.stdout:3/363: write d8/d13/d51/d63/f64 [286253,68036] 0 2024-05-09T00:07:31.070 INFO:tasks.workunit.client.1.smithi135.stdout:9/296: symlink d1/d24/d44/d54/l57 0 2024-05-09T00:07:31.072 INFO:tasks.workunit.client.1.smithi135.stdout:1/374: dwrite da/d24/d27/d33/d52/f56 [0,4194304] 0 2024-05-09T00:07:31.072 INFO:tasks.workunit.client.1.smithi135.stdout:1/375: stat da/d14/d20/d38/d3a/d40/d75/l77 0 2024-05-09T00:07:31.073 INFO:tasks.workunit.client.1.smithi135.stdout:1/376: chown da/d24/d27/d33/d36/l49 160864 1 2024-05-09T00:07:31.073 INFO:tasks.workunit.client.1.smithi135.stdout:1/377: dread - da/d24/d27/f6e zero size 2024-05-09T00:07:31.073 INFO:tasks.workunit.client.1.smithi135.stdout:1/378: readlink da/d24/d27/d33/l67 0 2024-05-09T00:07:31.073 INFO:tasks.workunit.client.1.smithi135.stdout:2/377: truncate d1/fd 651108 0 2024-05-09T00:07:31.075 INFO:tasks.workunit.client.1.smithi135.stdout:3/364: creat d8/d13/d75/d53/f81 x:0 0 0 2024-05-09T00:07:31.078 INFO:tasks.workunit.client.1.smithi135.stdout:9/297: symlink d1/d1a/d10/d3c/d43/l58 0 2024-05-09T00:07:31.082 INFO:tasks.workunit.client.1.smithi135.stdout:1/379: chown da/c37 17722229 1 2024-05-09T00:07:31.083 INFO:tasks.workunit.client.1.smithi135.stdout:1/380: write da/d24/d27/f28 [188866,64537] 0 2024-05-09T00:07:31.086 INFO:tasks.workunit.client.1.smithi135.stdout:2/378: symlink d1/d22/l77 0 2024-05-09T00:07:31.086 INFO:tasks.workunit.client.1.smithi135.stdout:9/298: dread d1/d24/f35 [0,4194304] 0 2024-05-09T00:07:31.086 INFO:tasks.workunit.client.1.smithi135.stdout:9/299: write d1/d1a/f51 [559462,86885] 0 2024-05-09T00:07:31.086 INFO:tasks.workunit.client.1.smithi135.stdout:9/300: write d1/d1a/d2c/f53 [877353,121675] 0 2024-05-09T00:07:31.086 INFO:tasks.workunit.client.1.smithi135.stdout:9/301: write d1/d1a/d2c/f11 [1681087,78801] 0 2024-05-09T00:07:31.091 INFO:tasks.workunit.client.1.smithi135.stdout:2/379: mknod d1/d12/d21/d57/c78 0 2024-05-09T00:07:31.095 INFO:tasks.workunit.client.1.smithi135.stdout:3/365: dwrite d8/f23 [0,4194304] 0 2024-05-09T00:07:31.096 INFO:tasks.workunit.client.1.smithi135.stdout:1/381: truncate da/db/f61 254353 0 2024-05-09T00:07:31.100 INFO:tasks.workunit.client.1.smithi135.stdout:2/380: mknod d1/d12/d21/c79 0 2024-05-09T00:07:31.103 INFO:tasks.workunit.client.1.smithi135.stdout:9/302: dwrite d1/d24/f47 [0,4194304] 0 2024-05-09T00:07:31.110 INFO:tasks.workunit.client.1.smithi135.stdout:3/366: mknod d8/d6d/d44/d4b/d69/c82 0 2024-05-09T00:07:31.113 INFO:tasks.workunit.client.1.smithi135.stdout:8/376: sync 2024-05-09T00:07:31.113 INFO:tasks.workunit.client.1.smithi135.stdout:8/377: chown d4/d7/l5b 220 1 2024-05-09T00:07:31.113 INFO:tasks.workunit.client.1.smithi135.stdout:8/378: read d4/d7/d33/d39/f48 [656837,110723] 0 2024-05-09T00:07:31.113 INFO:tasks.workunit.client.1.smithi135.stdout:8/379: truncate d4/d7/f2f 1217404 0 2024-05-09T00:07:31.115 INFO:tasks.workunit.client.1.smithi135.stdout:1/382: dwrite da/d24/d27/d33/d52/f56 [0,4194304] 0 2024-05-09T00:07:31.117 INFO:tasks.workunit.client.1.smithi135.stdout:2/381: creat d1/d12/d20/d2b/d56/d67/f7a x:0 0 0 2024-05-09T00:07:31.121 INFO:tasks.workunit.client.1.smithi135.stdout:9/303: rename d1/d1a/d2c/d2d/f49 to d1/f59 0 2024-05-09T00:07:31.123 INFO:tasks.workunit.client.1.smithi135.stdout:8/380: creat d4/d7/f74 x:0 0 0 2024-05-09T00:07:31.124 INFO:tasks.workunit.client.1.smithi135.stdout:3/367: dwrite d8/d13/d1f/f4e [0,4194304] 0 2024-05-09T00:07:31.128 INFO:tasks.workunit.client.1.smithi135.stdout:9/304: creat d1/f5a x:0 0 0 2024-05-09T00:07:31.131 INFO:tasks.workunit.client.1.smithi135.stdout:8/381: creat d4/d7/d2a/d67/f75 x:0 0 0 2024-05-09T00:07:31.131 INFO:tasks.workunit.client.1.smithi135.stdout:8/382: write d4/f41 [1366890,124619] 0 2024-05-09T00:07:31.137 INFO:tasks.workunit.client.1.smithi135.stdout:3/368: truncate d8/f12 3619504 0 2024-05-09T00:07:31.138 INFO:tasks.workunit.client.1.smithi135.stdout:3/369: write d8/d13/d1f/f48 [1217064,123929] 0 2024-05-09T00:07:31.139 INFO:tasks.workunit.client.1.smithi135.stdout:0/381: sync 2024-05-09T00:07:31.144 INFO:tasks.workunit.client.1.smithi135.stdout:1/383: link da/cf da/d24/d27/d33/d7d/c89 0 2024-05-09T00:07:31.146 INFO:tasks.workunit.client.1.smithi135.stdout:1/384: write da/d14/d20/d38/f4d [427193,64865] 0 2024-05-09T00:07:31.147 INFO:tasks.workunit.client.1.smithi135.stdout:3/370: dread d8/f26 [0,4194304] 0 2024-05-09T00:07:31.151 INFO:tasks.workunit.client.1.smithi135.stdout:0/382: link d3/dd/f14 d3/dd/d3f/d58/f6d 0 2024-05-09T00:07:31.156 INFO:tasks.workunit.client.1.smithi135.stdout:8/383: dwrite d4/f20 [4194304,4194304] 0 2024-05-09T00:07:31.162 INFO:tasks.workunit.client.1.smithi135.stdout:8/384: mkdir d4/d7/de/d45/d76 0 2024-05-09T00:07:31.163 INFO:tasks.workunit.client.1.smithi135.stdout:8/385: read d4/d7/d33/d39/f70 [3825414,5824] 0 2024-05-09T00:07:31.168 INFO:tasks.workunit.client.1.smithi135.stdout:8/386: symlink d4/d7/d2a/d67/l77 0 2024-05-09T00:07:31.168 INFO:tasks.workunit.client.1.smithi135.stdout:9/305: dwrite d1/d1a/d2c/f11 [0,4194304] 0 2024-05-09T00:07:31.169 INFO:tasks.workunit.client.1.smithi135.stdout:9/306: read d1/d1a/f51 [29183,58940] 0 2024-05-09T00:07:31.169 INFO:tasks.workunit.client.1.smithi135.stdout:3/371: dwrite f3 [0,4194304] 0 2024-05-09T00:07:31.169 INFO:tasks.workunit.client.1.smithi135.stdout:0/383: dread d3/dd/d2d/f40 [0,4194304] 0 2024-05-09T00:07:31.169 INFO:tasks.workunit.client.1.smithi135.stdout:3/372: write d8/d6d/f78 [91155,111487] 0 2024-05-09T00:07:31.171 INFO:tasks.workunit.client.1.smithi135.stdout:3/373: write d8/f11 [2887634,30335] 0 2024-05-09T00:07:31.171 INFO:tasks.workunit.client.1.smithi135.stdout:3/374: write d8/d6d/d24/f50 [25048,64736] 0 2024-05-09T00:07:31.171 INFO:tasks.workunit.client.1.smithi135.stdout:3/375: chown d8/c33 1039644434 1 2024-05-09T00:07:31.171 INFO:tasks.workunit.client.1.smithi135.stdout:8/387: creat d4/d7/de/d45/d76/f78 x:0 0 0 2024-05-09T00:07:31.173 INFO:tasks.workunit.client.1.smithi135.stdout:3/376: dread d8/d6d/f31 [0,4194304] 0 2024-05-09T00:07:31.173 INFO:tasks.workunit.client.1.smithi135.stdout:1/385: dwrite da/f35 [0,4194304] 0 2024-05-09T00:07:31.174 INFO:tasks.workunit.client.1.smithi135.stdout:9/307: symlink d1/d1a/l5b 0 2024-05-09T00:07:31.177 INFO:tasks.workunit.client.1.smithi135.stdout:0/384: creat d3/dd/d2d/f6e x:0 0 0 2024-05-09T00:07:31.177 INFO:tasks.workunit.client.1.smithi135.stdout:0/385: dread - d3/dd/d3f/d43/f53 zero size 2024-05-09T00:07:31.180 INFO:tasks.workunit.client.1.smithi135.stdout:8/388: symlink d4/d7/l79 0 2024-05-09T00:07:31.181 INFO:tasks.workunit.client.1.smithi135.stdout:8/389: write d4/d7/de/f35 [621173,2096] 0 2024-05-09T00:07:31.182 INFO:tasks.workunit.client.1.smithi135.stdout:3/377: symlink d8/d13/d1f/l83 0 2024-05-09T00:07:31.184 INFO:tasks.workunit.client.1.smithi135.stdout:7/420: sync 2024-05-09T00:07:31.184 INFO:tasks.workunit.client.1.smithi135.stdout:4/324: sync 2024-05-09T00:07:31.184 INFO:tasks.workunit.client.1.smithi135.stdout:7/421: truncate db/dd/d33/d69/d78/f87 545125 0 2024-05-09T00:07:31.184 INFO:tasks.workunit.client.1.smithi135.stdout:7/422: write db/dd/d33/f3d [4896934,10016] 0 2024-05-09T00:07:31.185 INFO:tasks.workunit.client.1.smithi135.stdout:7/423: write db/ff [790764,50626] 0 2024-05-09T00:07:31.186 INFO:tasks.workunit.client.1.smithi135.stdout:1/386: write da/f10 [1298910,124700] 0 2024-05-09T00:07:31.188 INFO:tasks.workunit.client.1.smithi135.stdout:3/378: dread d8/fe [0,4194304] 0 2024-05-09T00:07:31.188 INFO:tasks.workunit.client.1.smithi135.stdout:9/308: mkdir d1/d1a/d10/d3c/d5c 0 2024-05-09T00:07:31.190 INFO:tasks.workunit.client.1.smithi135.stdout:0/386: dread d3/f23 [0,4194304] 0 2024-05-09T00:07:31.191 INFO:tasks.workunit.client.1.smithi135.stdout:8/390: creat d4/d7/de/d45/f7a x:0 0 0 2024-05-09T00:07:31.191 INFO:tasks.workunit.client.1.smithi135.stdout:8/391: chown d4/d7/d33/d39/c60 27838448 1 2024-05-09T00:07:31.192 INFO:tasks.workunit.client.1.smithi135.stdout:8/392: chown d4/f2b 8373190 1 2024-05-09T00:07:31.192 INFO:tasks.workunit.client.1.smithi135.stdout:8/393: truncate d4/f2c 5206318 0 2024-05-09T00:07:31.198 INFO:tasks.workunit.client.1.smithi135.stdout:4/325: write dc/d26/d31/f3c [3009180,61580] 0 2024-05-09T00:07:31.199 INFO:tasks.workunit.client.1.smithi135.stdout:5/415: sync 2024-05-09T00:07:31.199 INFO:tasks.workunit.client.1.smithi135.stdout:6/364: sync 2024-05-09T00:07:31.199 INFO:tasks.workunit.client.1.smithi135.stdout:6/365: chown d2/d1a 535320 1 2024-05-09T00:07:31.199 INFO:tasks.workunit.client.1.smithi135.stdout:6/366: truncate d2/da/d49/f67 343784 0 2024-05-09T00:07:31.204 INFO:tasks.workunit.client.1.smithi135.stdout:8/394: dwrite d4/d7/de/f14 [0,4194304] 0 2024-05-09T00:07:31.212 INFO:tasks.workunit.client.1.smithi135.stdout:7/424: rename db/d1e/d3a/d40/d4c/d67/f6e to db/dd/d33/d58/f8f 0 2024-05-09T00:07:31.220 INFO:tasks.workunit.client.1.smithi135.stdout:3/379: mkdir d8/d13/d51/d6f/d7b/d80/d84 0 2024-05-09T00:07:31.223 INFO:tasks.workunit.client.1.smithi135.stdout:9/309: getdents d1/d1a/d2c 0 2024-05-09T00:07:31.223 INFO:tasks.workunit.client.1.smithi135.stdout:9/310: chown d1/f59 231753 1 2024-05-09T00:07:31.227 INFO:tasks.workunit.client.1.smithi135.stdout:0/387: rename d3/dd/d2d/l3e to d3/dd/d2d/l6f 0 2024-05-09T00:07:31.227 INFO:tasks.workunit.client.1.smithi135.stdout:0/388: chown d3/dd/d3f 72 1 2024-05-09T00:07:31.227 INFO:tasks.workunit.client.1.smithi135.stdout:4/326: dwrite dc/d26/d31/f3c [0,4194304] 0 2024-05-09T00:07:31.232 INFO:tasks.workunit.client.1.smithi135.stdout:5/416: creat db/d84/d31/d6e/f87 x:0 0 0 2024-05-09T00:07:31.234 INFO:tasks.workunit.client.1.smithi135.stdout:6/367: mkdir d2/d20/d37/d4e/d7c 0 2024-05-09T00:07:31.242 INFO:tasks.workunit.client.1.smithi135.stdout:9/311: dwrite d1/f4c [0,4194304] 0 2024-05-09T00:07:31.243 INFO:tasks.workunit.client.1.smithi135.stdout:9/312: write d1/d1a/d2c/f11 [540912,97757] 0 2024-05-09T00:07:31.246 INFO:tasks.workunit.client.1.smithi135.stdout:7/425: getdents db/d1e/d3a/d40/d84 0 2024-05-09T00:07:31.246 INFO:tasks.workunit.client.1.smithi135.stdout:7/426: chown db/d21/l3f 26 1 2024-05-09T00:07:31.247 INFO:tasks.workunit.client.1.smithi135.stdout:6/368: dread d2/d1a/f24 [0,4194304] 0 2024-05-09T00:07:31.247 INFO:tasks.workunit.client.1.smithi135.stdout:6/369: chown d2/d20/d3f/f44 769462412 1 2024-05-09T00:07:31.248 INFO:tasks.workunit.client.1.smithi135.stdout:1/387: truncate da/d73/f81 17355 0 2024-05-09T00:07:31.251 INFO:tasks.workunit.client.1.smithi135.stdout:3/380: mkdir d8/d13/d51/d6f/d7b/d85 0 2024-05-09T00:07:31.251 INFO:tasks.workunit.client.1.smithi135.stdout:3/381: chown d8/d6d/d24/l56 35368 1 2024-05-09T00:07:31.253 INFO:tasks.workunit.client.1.smithi135.stdout:5/417: dwrite db/d5d/f68 [0,4194304] 0 2024-05-09T00:07:31.253 INFO:tasks.workunit.client.1.smithi135.stdout:0/389: symlink d3/dd/d2d/l70 0 2024-05-09T00:07:31.254 INFO:tasks.workunit.client.1.smithi135.stdout:0/390: read d3/dd/f1b [7307453,103648] 0 2024-05-09T00:07:31.254 INFO:tasks.workunit.client.1.smithi135.stdout:0/391: chown d3/f34 1520344 1 2024-05-09T00:07:31.256 INFO:tasks.workunit.client.1.smithi135.stdout:4/327: dread dc/dd/f22 [0,4194304] 0 2024-05-09T00:07:31.257 INFO:tasks.workunit.client.1.smithi135.stdout:4/328: read dc/dd/f22 [162887,121533] 0 2024-05-09T00:07:31.275 INFO:tasks.workunit.client.1.smithi135.stdout:5/418: dwrite db/fe [0,4194304] 0 2024-05-09T00:07:31.276 INFO:tasks.workunit.client.1.smithi135.stdout:5/419: fdatasync db/d3f/f5c 0 2024-05-09T00:07:31.276 INFO:tasks.workunit.client.1.smithi135.stdout:0/392: dwrite d3/dd/d3f/f5b [4194304,4194304] 0 2024-05-09T00:07:31.276 INFO:tasks.workunit.client.1.smithi135.stdout:0/393: readlink d3/l17 0 2024-05-09T00:07:31.282 INFO:tasks.workunit.client.1.smithi135.stdout:0/394: dread d3/f5e [0,4194304] 0 2024-05-09T00:07:31.291 INFO:tasks.workunit.client.1.smithi135.stdout:5/420: dwrite db/f12 [0,4194304] 0 2024-05-09T00:07:31.306 INFO:tasks.workunit.client.1.smithi135.stdout:7/427: mknod db/dd/d33/d58/c90 0 2024-05-09T00:07:31.308 INFO:tasks.workunit.client.1.smithi135.stdout:6/370: symlink d2/da/d26/d57/d59/d62/l7d 0 2024-05-09T00:07:31.311 INFO:tasks.workunit.client.1.smithi135.stdout:3/382: creat d8/d13/d51/f86 x:0 0 0 2024-05-09T00:07:31.317 INFO:tasks.workunit.client.1.smithi135.stdout:4/329: mknod dc/dd/c75 0 2024-05-09T00:07:31.323 INFO:tasks.workunit.client.1.smithi135.stdout:1/388: dwrite da/f13 [0,4194304] 0 2024-05-09T00:07:31.324 INFO:tasks.workunit.client.1.smithi135.stdout:0/395: rename d3/dd/d3f/d3a/d46/f52 to d3/dd/d3f/d58/f71 0 2024-05-09T00:07:31.329 INFO:tasks.workunit.client.1.smithi135.stdout:5/421: read - db/d84/d31/f3d zero size 2024-05-09T00:07:31.329 INFO:tasks.workunit.client.1.smithi135.stdout:2/382: sync 2024-05-09T00:07:31.333 INFO:tasks.workunit.client.1.smithi135.stdout:7/428: mknod db/d1e/d3a/d40/d4c/d67/c91 0 2024-05-09T00:07:31.335 INFO:tasks.workunit.client.1.smithi135.stdout:6/371: symlink d2/d1a/l7e 0 2024-05-09T00:07:31.337 INFO:tasks.workunit.client.1.smithi135.stdout:3/383: rmdir d8/d13/d51/d6f/d7b/d80 39 2024-05-09T00:07:31.340 INFO:tasks.workunit.client.1.smithi135.stdout:1/389: chown da/f63 3777 1 2024-05-09T00:07:31.340 INFO:tasks.workunit.client.1.smithi135.stdout:3/384: write d8/d13/f19 [766776,48461] 0 2024-05-09T00:07:31.343 INFO:tasks.workunit.client.1.smithi135.stdout:4/330: rename dc/f61 to dc/d4a/f76 0 2024-05-09T00:07:31.344 INFO:tasks.workunit.client.1.smithi135.stdout:0/396: rmdir d3/dd/d3f/d58 39 2024-05-09T00:07:31.344 INFO:tasks.workunit.client.1.smithi135.stdout:0/397: chown d3/dd/c59 113 1 2024-05-09T00:07:31.349 INFO:tasks.workunit.client.1.smithi135.stdout:7/429: dwrite db/d1e/f7c [0,4194304] 0 2024-05-09T00:07:31.349 INFO:tasks.workunit.client.1.smithi135.stdout:5/422: dwrite db/d3f/f5c [0,4194304] 0 2024-05-09T00:07:31.350 INFO:tasks.workunit.client.1.smithi135.stdout:6/372: mkdir d2/d20/d3f/d4f/d7f 0 2024-05-09T00:07:31.350 INFO:tasks.workunit.client.1.smithi135.stdout:6/373: truncate d2/da/d26/d57/d60/f6f 483331 0 2024-05-09T00:07:31.352 INFO:tasks.workunit.client.1.smithi135.stdout:1/390: creat da/d14/d20/d38/d3a/d40/f8a x:0 0 0 2024-05-09T00:07:31.352 INFO:tasks.workunit.client.1.smithi135.stdout:1/391: chown da/d14/d20/d38/d3a/d40/l84 1048 1 2024-05-09T00:07:31.354 INFO:tasks.workunit.client.1.smithi135.stdout:3/385: creat d8/d13/d75/f87 x:0 0 0 2024-05-09T00:07:31.354 INFO:tasks.workunit.client.1.smithi135.stdout:3/386: write d8/d6d/d44/d4b/d59/f65 [496392,40756] 0 2024-05-09T00:07:31.354 INFO:tasks.workunit.client.1.smithi135.stdout:3/387: chown d8/d13/d1f/f3f 7 1 2024-05-09T00:07:31.356 INFO:tasks.workunit.client.1.smithi135.stdout:4/331: link dc/d26/c65 dc/c77 0 2024-05-09T00:07:31.358 INFO:tasks.workunit.client.1.smithi135.stdout:0/398: link d3/f12 d3/dd/d3f/f72 0 2024-05-09T00:07:31.358 INFO:tasks.workunit.client.1.smithi135.stdout:0/399: chown d3/dd/d3f/d29 25 1 2024-05-09T00:07:31.364 INFO:tasks.workunit.client.1.smithi135.stdout:7/430: symlink db/l92 0 2024-05-09T00:07:31.365 INFO:tasks.workunit.client.1.smithi135.stdout:7/431: fsync db/d13/f6f 0 2024-05-09T00:07:31.365 INFO:tasks.workunit.client.1.smithi135.stdout:7/432: write db/dd/d33/f61 [40476,27566] 0 2024-05-09T00:07:31.365 INFO:tasks.workunit.client.1.smithi135.stdout:7/433: readlink db/dd/d33/l66 0 2024-05-09T00:07:31.365 INFO:tasks.workunit.client.1.smithi135.stdout:7/434: chown db/d21/l44 3992 1 2024-05-09T00:07:31.370 INFO:tasks.workunit.client.1.smithi135.stdout:5/423: creat db/d24/d32/d5b/f88 x:0 0 0 2024-05-09T00:07:31.373 INFO:tasks.workunit.client.1.smithi135.stdout:6/374: rename d2/da/d49/l38 to d2/d20/d3f/d4f/l80 0 2024-05-09T00:07:31.373 INFO:tasks.workunit.client.1.smithi135.stdout:0/400: dwrite d3/dd/d3f/d3a/f48 [4194304,4194304] 0 2024-05-09T00:07:31.375 INFO:tasks.workunit.client.1.smithi135.stdout:9/313: truncate d1/d1a/d2c/f11 1903961 0 2024-05-09T00:07:31.381 INFO:tasks.workunit.client.1.smithi135.stdout:7/435: getdents db/dd 0 2024-05-09T00:07:31.381 INFO:tasks.workunit.client.1.smithi135.stdout:7/436: chown f8 1787254101 1 2024-05-09T00:07:31.387 INFO:tasks.workunit.client.1.smithi135.stdout:3/388: dwrite d8/d13/f19 [0,4194304] 0 2024-05-09T00:07:31.389 INFO:tasks.workunit.client.1.smithi135.stdout:0/401: rmdir d3/dd/d3f/d29 39 2024-05-09T00:07:31.389 INFO:tasks.workunit.client.1.smithi135.stdout:0/402: write d3/dd/f32 [5020230,27705] 0 2024-05-09T00:07:31.391 INFO:tasks.workunit.client.1.smithi135.stdout:0/403: dread d3/f4f [0,4194304] 0 2024-05-09T00:07:31.392 INFO:tasks.workunit.client.1.smithi135.stdout:9/314: creat d1/d1a/d2c/f5d x:0 0 0 2024-05-09T00:07:31.396 INFO:tasks.workunit.client.1.smithi135.stdout:5/424: rename db/d24/d32/f58 to db/d84/d31/f89 0 2024-05-09T00:07:31.399 INFO:tasks.workunit.client.1.smithi135.stdout:3/389: mkdir d8/d13/d51/d6f/d7b/d85/d88 0 2024-05-09T00:07:31.399 INFO:tasks.workunit.client.1.smithi135.stdout:3/390: readlink d8/l34 0 2024-05-09T00:07:31.400 INFO:tasks.workunit.client.1.smithi135.stdout:3/391: chown d8/d13/d1f/f30 943727 1 2024-05-09T00:07:31.402 INFO:tasks.workunit.client.1.smithi135.stdout:0/404: getdents d3/dd 0 2024-05-09T00:07:31.404 INFO:tasks.workunit.client.1.smithi135.stdout:9/315: rename d1/d1a/d2c/l19 to d1/d24/d44/l5e 0 2024-05-09T00:07:31.407 INFO:tasks.workunit.client.1.smithi135.stdout:5/425: mknod db/d84/d31/d5e/c8a 0 2024-05-09T00:07:31.407 INFO:tasks.workunit.client.1.smithi135.stdout:5/426: fsync db/d5d/d7e/f82 0 2024-05-09T00:07:31.407 INFO:tasks.workunit.client.1.smithi135.stdout:5/427: read db/d3f/f4d [751129,26943] 0 2024-05-09T00:07:31.409 INFO:tasks.workunit.client.1.smithi135.stdout:3/392: unlink d8/d13/d1f/d40/l71 0 2024-05-09T00:07:31.409 INFO:tasks.workunit.client.1.smithi135.stdout:3/393: fdatasync d8/f17 0 2024-05-09T00:07:31.409 INFO:tasks.workunit.client.1.smithi135.stdout:3/394: fdatasync d8/d6d/d44/d4b/d69/f4a 0 2024-05-09T00:07:31.409 INFO:tasks.workunit.client.1.smithi135.stdout:3/395: stat c2 0 2024-05-09T00:07:31.416 INFO:tasks.workunit.client.1.smithi135.stdout:0/405: mknod d3/dd/d2d/d4c/c73 0 2024-05-09T00:07:31.419 INFO:tasks.workunit.client.1.smithi135.stdout:9/316: creat d1/d1a/d10/d3c/d5c/f5f x:0 0 0 2024-05-09T00:07:31.419 INFO:tasks.workunit.client.1.smithi135.stdout:9/317: write d1/f13 [4921358,84059] 0 2024-05-09T00:07:31.421 INFO:tasks.workunit.client.1.smithi135.stdout:3/396: mkdir d8/d13/d51/d63/d89 0 2024-05-09T00:07:31.422 INFO:tasks.workunit.client.1.smithi135.stdout:3/397: write d8/d13/d75/d53/f81 [574298,114814] 0 2024-05-09T00:07:31.424 INFO:tasks.workunit.client.1.smithi135.stdout:0/406: symlink d3/dd/d3f/d58/l74 0 2024-05-09T00:07:31.427 INFO:tasks.workunit.client.1.smithi135.stdout:0/407: dread d3/dd/f2f [0,4194304] 0 2024-05-09T00:07:31.431 INFO:tasks.workunit.client.1.smithi135.stdout:9/318: mknod d1/d24/c60 0 2024-05-09T00:07:31.433 INFO:tasks.workunit.client.1.smithi135.stdout:3/398: dread d8/d13/d75/d58/f76 [0,4194304] 0 2024-05-09T00:07:31.434 INFO:tasks.workunit.client.1.smithi135.stdout:3/399: read d8/d13/f2d [836018,34751] 0 2024-05-09T00:07:31.434 INFO:tasks.workunit.client.1.smithi135.stdout:0/408: creat d3/dd/d3f/f75 x:0 0 0 2024-05-09T00:07:31.437 INFO:tasks.workunit.client.1.smithi135.stdout:3/400: creat d8/d13/d75/d58/f8a x:0 0 0 2024-05-09T00:07:31.437 INFO:tasks.workunit.client.1.smithi135.stdout:3/401: write d8/f42 [5121602,69000] 0 2024-05-09T00:07:31.438 INFO:tasks.workunit.client.1.smithi135.stdout:7/437: getdents db 0 2024-05-09T00:07:31.441 INFO:tasks.workunit.client.1.smithi135.stdout:5/428: dwrite db/d84/f4b [0,4194304] 0 2024-05-09T00:07:31.441 INFO:tasks.workunit.client.1.smithi135.stdout:5/429: readlink db/l3b 0 2024-05-09T00:07:31.442 INFO:tasks.workunit.client.1.smithi135.stdout:7/438: write db/f42 [1862052,117472] 0 2024-05-09T00:07:31.447 INFO:tasks.workunit.client.1.smithi135.stdout:3/402: mknod d8/d6d/c8b 0 2024-05-09T00:07:31.447 INFO:tasks.workunit.client.1.smithi135.stdout:3/403: fsync d8/f70 0 2024-05-09T00:07:31.448 INFO:tasks.workunit.client.1.smithi135.stdout:3/404: write d8/d13/f1e [2764201,37188] 0 2024-05-09T00:07:31.452 INFO:tasks.workunit.client.1.smithi135.stdout:6/375: rmdir d2/da 39 2024-05-09T00:07:31.456 INFO:tasks.workunit.client.1.smithi135.stdout:8/395: sync 2024-05-09T00:07:31.456 INFO:tasks.workunit.client.1.smithi135.stdout:8/396: fdatasync d4/d7/de/f35 0 2024-05-09T00:07:31.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/409: dwrite d3/dd/d3f/f27 [0,4194304] 0 2024-05-09T00:07:31.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/410: dread - d3/dd/d3f/d58/f5c zero size 2024-05-09T00:07:31.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/411: truncate d3/f23 318559 0 2024-05-09T00:07:31.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/412: read d3/dd/d3f/d29/f47 [6749204,18214] 0 2024-05-09T00:07:31.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/413: chown d3/dd/d3f/l1d 904551 1 2024-05-09T00:07:31.461 INFO:tasks.workunit.client.1.smithi135.stdout:7/439: dwrite db/f16 [0,4194304] 0 2024-05-09T00:07:31.465 INFO:tasks.workunit.client.1.smithi135.stdout:6/376: dread d2/da/f3b [0,4194304] 0 2024-05-09T00:07:31.465 INFO:tasks.workunit.client.1.smithi135.stdout:6/377: readlink d2/da/l28 0 2024-05-09T00:07:31.465 INFO:tasks.workunit.client.1.smithi135.stdout:6/378: chown d2/da/c21 3193 1 2024-05-09T00:07:31.471 INFO:tasks.workunit.client.1.smithi135.stdout:6/379: truncate d2/f25 2037145 0 2024-05-09T00:07:31.473 INFO:tasks.workunit.client.1.smithi135.stdout:6/380: getdents d2/d20/d37 0 2024-05-09T00:07:31.478 INFO:tasks.workunit.client.1.smithi135.stdout:6/381: creat d2/d1a/f81 x:0 0 0 2024-05-09T00:07:31.478 INFO:tasks.workunit.client.1.smithi135.stdout:6/382: write d2/f76 [308723,69509] 0 2024-05-09T00:07:31.488 INFO:tasks.workunit.client.1.smithi135.stdout:5/430: dwrite db/d24/d32/d5b/f88 [0,4194304] 0 2024-05-09T00:07:31.488 INFO:tasks.workunit.client.1.smithi135.stdout:5/431: chown db/d84/f4b 15 1 2024-05-09T00:07:31.488 INFO:tasks.workunit.client.1.smithi135.stdout:5/432: write db/d3f/f61 [1610067,31893] 0 2024-05-09T00:07:31.489 INFO:tasks.workunit.client.1.smithi135.stdout:5/433: write db/d84/d31/f3d [265348,27490] 0 2024-05-09T00:07:31.499 INFO:tasks.workunit.client.1.smithi135.stdout:0/414: dwrite d3/f12 [0,4194304] 0 2024-05-09T00:07:31.546 INFO:tasks.workunit.client.1.smithi135.stdout:8/397: dwrite d4/d7/d33/f55 [4194304,4194304] 0 2024-05-09T00:07:31.546 INFO:tasks.workunit.client.1.smithi135.stdout:8/398: fsync d4/d7/fc 0 2024-05-09T00:07:31.549 INFO:tasks.workunit.client.1.smithi135.stdout:7/440: dwrite db/f30 [0,4194304] 0 2024-05-09T00:07:31.549 INFO:tasks.workunit.client.1.smithi135.stdout:6/383: getdents d2/da/d49 0 2024-05-09T00:07:31.549 INFO:tasks.workunit.client.1.smithi135.stdout:6/384: write d2/da/d1d/f5e [9716,77942] 0 2024-05-09T00:07:31.550 INFO:tasks.workunit.client.1.smithi135.stdout:6/385: read d2/f9 [1260998,112222] 0 2024-05-09T00:07:31.550 INFO:tasks.workunit.client.1.smithi135.stdout:6/386: getdents d2/d1a/d7a 0 2024-05-09T00:07:31.550 INFO:tasks.workunit.client.1.smithi135.stdout:6/387: chown d2/d5f/f6d 24196 1 2024-05-09T00:07:31.555 INFO:tasks.workunit.client.1.smithi135.stdout:7/441: dread db/dd/f35 [0,4194304] 0 2024-05-09T00:07:31.582 INFO:tasks.workunit.client.1.smithi135.stdout:7/442: dwrite db/d1e/d3a/f52 [0,4194304] 0 2024-05-09T00:07:31.587 INFO:tasks.workunit.client.1.smithi135.stdout:5/434: creat db/d84/d31/d6e/f8b x:0 0 0 2024-05-09T00:07:31.587 INFO:tasks.workunit.client.1.smithi135.stdout:5/435: chown db/d84/d31/d6e/c77 188 1 2024-05-09T00:07:31.592 INFO:tasks.workunit.client.1.smithi135.stdout:8/399: mknod d4/d7/d33/d39/c7b 0 2024-05-09T00:07:31.597 INFO:tasks.workunit.client.1.smithi135.stdout:5/436: dread db/f7f [0,4194304] 0 2024-05-09T00:07:31.598 INFO:tasks.workunit.client.1.smithi135.stdout:5/437: write db/d3f/f4d [3015857,128385] 0 2024-05-09T00:07:31.599 INFO:tasks.workunit.client.1.smithi135.stdout:6/388: getdents d2/d20/d2e/d3d 0 2024-05-09T00:07:31.606 INFO:tasks.workunit.client.1.smithi135.stdout:7/443: mknod db/d1e/d3a/c93 0 2024-05-09T00:07:31.608 INFO:tasks.workunit.client.1.smithi135.stdout:8/400: rename d4/f41 to d4/d7/d2a/d56/f7c 0 2024-05-09T00:07:31.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/383: sync 2024-05-09T00:07:31.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/384: dread - d1/d12/d20/d2b/f55 zero size 2024-05-09T00:07:31.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/385: read - d1/d12/d20/d3b/d40/f5e zero size 2024-05-09T00:07:31.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/386: chown d1/d12/d20/d3b/d4f/f64 507449 1 2024-05-09T00:07:31.611 INFO:tasks.workunit.client.1.smithi135.stdout:6/389: mkdir d2/da/d1d/d69/d78/d82 0 2024-05-09T00:07:31.612 INFO:tasks.workunit.client.1.smithi135.stdout:6/390: write d2/f9 [2667418,114095] 0 2024-05-09T00:07:31.613 INFO:tasks.workunit.client.1.smithi135.stdout:7/444: getdents db/dd/d33/d69/d78 0 2024-05-09T00:07:31.613 INFO:tasks.workunit.client.1.smithi135.stdout:7/445: truncate db/dd/d33/f3d 5229033 0 2024-05-09T00:07:31.614 INFO:tasks.workunit.client.1.smithi135.stdout:8/401: creat d4/d7/de/f7d x:0 0 0 2024-05-09T00:07:31.615 INFO:tasks.workunit.client.1.smithi135.stdout:5/438: dwrite db/d84/d31/d5e/f69 [0,4194304] 0 2024-05-09T00:07:31.615 INFO:tasks.workunit.client.1.smithi135.stdout:5/439: write db/d24/d32/f44 [589142,91652] 0 2024-05-09T00:07:31.615 INFO:tasks.workunit.client.1.smithi135.stdout:5/440: readlink db/d84/l4e 0 2024-05-09T00:07:31.615 INFO:tasks.workunit.client.1.smithi135.stdout:5/441: chown db/d3f/f5f 3660 1 2024-05-09T00:07:31.616 INFO:tasks.workunit.client.1.smithi135.stdout:8/402: write d4/f16 [3670759,73240] 0 2024-05-09T00:07:31.617 INFO:tasks.workunit.client.1.smithi135.stdout:2/387: getdents d1/d12/d21/d41/d6d/d6e 0 2024-05-09T00:07:31.620 INFO:tasks.workunit.client.1.smithi135.stdout:6/391: mknod d2/da/c83 0 2024-05-09T00:07:31.622 INFO:tasks.workunit.client.1.smithi135.stdout:7/446: mkdir db/d1e/d94 0 2024-05-09T00:07:31.630 INFO:tasks.workunit.client.1.smithi135.stdout:5/442: dread db/d84/f43 [0,4194304] 0 2024-05-09T00:07:31.631 INFO:tasks.workunit.client.1.smithi135.stdout:5/443: write db/d24/f2c [87246,54730] 0 2024-05-09T00:07:31.631 INFO:tasks.workunit.client.1.smithi135.stdout:5/444: write db/f11 [3818356,8771] 0 2024-05-09T00:07:31.632 INFO:tasks.workunit.client.1.smithi135.stdout:2/388: creat d1/d12/d21/d57/f7b x:0 0 0 2024-05-09T00:07:31.635 INFO:tasks.workunit.client.1.smithi135.stdout:2/389: read d1/fd [274384,30544] 0 2024-05-09T00:07:31.640 INFO:tasks.workunit.client.1.smithi135.stdout:2/390: mkdir d1/d12/d20/d2b/d7c 0 2024-05-09T00:07:31.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:29.903899+0000 mgr.smithi135.kkrhgf (mgr.24419) 44 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 839 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 98 MiB/s wr, 484 op/s 2024-05-09T00:07:31.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:29.903899+0000 mgr.smithi135.kkrhgf (mgr.24419) 44 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 839 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 98 MiB/s wr, 484 op/s 2024-05-09T00:07:31.647 INFO:tasks.workunit.client.1.smithi135.stdout:6/392: dwrite d2/f58 [0,4194304] 0 2024-05-09T00:07:31.650 INFO:tasks.workunit.client.1.smithi135.stdout:7/447: dwrite db/d1e/d3a/d40/d4c/f53 [0,4194304] 0 2024-05-09T00:07:31.650 INFO:tasks.workunit.client.1.smithi135.stdout:5/445: dwrite db/d84/f3c [0,4194304] 0 2024-05-09T00:07:31.654 INFO:tasks.workunit.client.1.smithi135.stdout:6/393: creat d2/da/d1d/d69/d78/f84 x:0 0 0 2024-05-09T00:07:31.657 INFO:tasks.workunit.client.1.smithi135.stdout:4/332: sync 2024-05-09T00:07:31.657 INFO:tasks.workunit.client.1.smithi135.stdout:1/392: sync 2024-05-09T00:07:31.657 INFO:tasks.workunit.client.1.smithi135.stdout:9/319: sync 2024-05-09T00:07:31.657 INFO:tasks.workunit.client.1.smithi135.stdout:4/333: stat dc/d4a/f76 0 2024-05-09T00:07:31.659 INFO:tasks.workunit.client.1.smithi135.stdout:7/448: mknod db/dd/d33/d69/d78/c95 0 2024-05-09T00:07:31.660 INFO:tasks.workunit.client.1.smithi135.stdout:3/405: sync 2024-05-09T00:07:31.660 INFO:tasks.workunit.client.1.smithi135.stdout:3/406: chown d8/d6d/d24/c3c 506484118 1 2024-05-09T00:07:31.660 INFO:tasks.workunit.client.1.smithi135.stdout:0/415: sync 2024-05-09T00:07:31.660 INFO:tasks.workunit.client.1.smithi135.stdout:0/416: chown d3/dd/d3f/d43/f53 58484402 1 2024-05-09T00:07:31.660 INFO:tasks.workunit.client.1.smithi135.stdout:0/417: chown d3/dd/d3f/d3a/d46/c5f 1224233 1 2024-05-09T00:07:31.660 INFO:tasks.workunit.client.1.smithi135.stdout:2/391: dwrite d1/d12/d21/d41/d6d/d6e/f75 [0,4194304] 0 2024-05-09T00:07:31.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/394: dread d2/f58 [0,4194304] 0 2024-05-09T00:07:31.668 INFO:tasks.workunit.client.1.smithi135.stdout:9/320: unlink d1/d24/d44/l1f 0 2024-05-09T00:07:31.668 INFO:tasks.workunit.client.1.smithi135.stdout:9/321: chown d1/d1a/d2c/f5d 65431126 1 2024-05-09T00:07:31.668 INFO:tasks.workunit.client.1.smithi135.stdout:9/322: readlink d1/d1a/l4d 0 2024-05-09T00:07:31.670 INFO:tasks.workunit.client.1.smithi135.stdout:9/323: dread d1/d1a/f51 [0,4194304] 0 2024-05-09T00:07:31.673 INFO:tasks.workunit.client.1.smithi135.stdout:1/393: creat da/d14/d20/d38/d3a/f8b x:0 0 0 2024-05-09T00:07:31.675 INFO:tasks.workunit.client.1.smithi135.stdout:7/449: unlink db/d1e/d3a/d40/c4a 0 2024-05-09T00:07:31.675 INFO:tasks.workunit.client.1.smithi135.stdout:7/450: fdatasync db/d1e/d3a/d40/d84/f85 0 2024-05-09T00:07:31.675 INFO:tasks.workunit.client.1.smithi135.stdout:7/451: write f8 [535307,52890] 0 2024-05-09T00:07:31.677 INFO:tasks.workunit.client.1.smithi135.stdout:3/407: symlink d8/l8c 0 2024-05-09T00:07:31.678 INFO:tasks.workunit.client.1.smithi135.stdout:3/408: fsync f3 0 2024-05-09T00:07:31.682 INFO:tasks.workunit.client.1.smithi135.stdout:0/418: link d3/dd/f1b d3/dd/d3f/f76 0 2024-05-09T00:07:31.685 INFO:tasks.workunit.client.1.smithi135.stdout:6/395: dwrite d2/da/d49/f23 [0,4194304] 0 2024-05-09T00:07:31.685 INFO:tasks.workunit.client.1.smithi135.stdout:6/396: truncate d2/da/d1d/d69/d78/f84 716127 0 2024-05-09T00:07:31.687 INFO:tasks.workunit.client.1.smithi135.stdout:2/392: write d1/f17 [5120470,28339] 0 2024-05-09T00:07:31.689 INFO:tasks.workunit.client.1.smithi135.stdout:9/324: dwrite d1/f5a [0,4194304] 0 2024-05-09T00:07:31.690 INFO:tasks.workunit.client.1.smithi135.stdout:4/334: mknod dc/d26/d31/c78 0 2024-05-09T00:07:31.693 INFO:tasks.workunit.client.1.smithi135.stdout:1/394: write da/f4b [3257461,95888] 0 2024-05-09T00:07:31.695 INFO:tasks.workunit.client.1.smithi135.stdout:7/452: symlink db/d13/l96 0 2024-05-09T00:07:31.697 INFO:tasks.workunit.client.1.smithi135.stdout:3/409: creat d8/d13/d51/d6f/d7b/d80/d84/f8d x:0 0 0 2024-05-09T00:07:31.700 INFO:tasks.workunit.client.1.smithi135.stdout:0/419: dwrite d3/dd/d3f/d3a/d46/f38 [0,4194304] 0 2024-05-09T00:07:31.703 INFO:tasks.workunit.client.1.smithi135.stdout:6/397: mknod d2/da/d1d/d69/d78/c85 0 2024-05-09T00:07:31.703 INFO:tasks.workunit.client.1.smithi135.stdout:6/398: chown d2/f25 197 1 2024-05-09T00:07:31.710 INFO:tasks.workunit.client.1.smithi135.stdout:9/325: rename d1/f4c to d1/d1a/d10/d3c/d5c/f61 0 2024-05-09T00:07:31.714 INFO:tasks.workunit.client.1.smithi135.stdout:2/393: dread d1/f1c [0,4194304] 0 2024-05-09T00:07:31.714 INFO:tasks.workunit.client.1.smithi135.stdout:2/394: chown d1/d12/l25 4355 1 2024-05-09T00:07:31.714 INFO:tasks.workunit.client.1.smithi135.stdout:1/395: symlink da/d24/d27/d33/d36/l8c 0 2024-05-09T00:07:31.714 INFO:tasks.workunit.client.1.smithi135.stdout:1/396: read - da/d14/d20/d38/f58 zero size 2024-05-09T00:07:31.716 INFO:tasks.workunit.client.1.smithi135.stdout:0/420: rmdir d3/d64 39 2024-05-09T00:07:31.716 INFO:tasks.workunit.client.1.smithi135.stdout:0/421: write d3/dd/d2d/f68 [840432,66253] 0 2024-05-09T00:07:31.722 INFO:tasks.workunit.client.1.smithi135.stdout:3/410: dwrite d8/d13/d75/f87 [0,4194304] 0 2024-05-09T00:07:31.723 INFO:tasks.workunit.client.1.smithi135.stdout:7/453: dwrite db/dd/f4b [0,4194304] 0 2024-05-09T00:07:31.726 INFO:tasks.workunit.client.1.smithi135.stdout:9/326: mknod d1/d1a/d10/d3c/d43/c62 0 2024-05-09T00:07:31.726 INFO:tasks.workunit.client.1.smithi135.stdout:9/327: fdatasync d1/d1a/d10/d3c/d5c/f61 0 2024-05-09T00:07:31.728 INFO:tasks.workunit.client.1.smithi135.stdout:2/395: mknod d1/d12/d20/d2b/d56/d72/c7d 0 2024-05-09T00:07:31.731 INFO:tasks.workunit.client.1.smithi135.stdout:1/397: mkdir da/d24/d27/d33/d52/d71/d8d 0 2024-05-09T00:07:31.731 INFO:tasks.workunit.client.1.smithi135.stdout:1/398: write da/d14/d20/d38/d3a/d40/f8a [903609,101426] 0 2024-05-09T00:07:31.731 INFO:tasks.workunit.client.1.smithi135.stdout:1/399: readlink da/d24/d27/d33/d48/l4a 0 2024-05-09T00:07:31.731 INFO:tasks.workunit.client.1.smithi135.stdout:1/400: chown da/db/f2a 237 1 2024-05-09T00:07:31.734 INFO:tasks.workunit.client.1.smithi135.stdout:0/422: rmdir d3/dd/d3f/d3a/d46 39 2024-05-09T00:07:31.736 INFO:tasks.workunit.client.1.smithi135.stdout:6/399: mkdir d2/da/d1d/d86 0 2024-05-09T00:07:31.736 INFO:tasks.workunit.client.1.smithi135.stdout:9/328: dread d1/d1a/d2c/d2d/f31 [0,4194304] 0 2024-05-09T00:07:31.736 INFO:tasks.workunit.client.1.smithi135.stdout:9/329: fdatasync d1/d24/f47 0 2024-05-09T00:07:31.742 INFO:tasks.workunit.client.1.smithi135.stdout:3/411: creat d8/d13/d51/d6f/d7b/d85/f8e x:0 0 0 2024-05-09T00:07:31.746 INFO:tasks.workunit.client.1.smithi135.stdout:7/454: mknod db/d5b/c97 0 2024-05-09T00:07:31.748 INFO:tasks.workunit.client.1.smithi135.stdout:6/400: dread d2/d1a/f24 [0,4194304] 0 2024-05-09T00:07:31.749 INFO:tasks.workunit.client.1.smithi135.stdout:2/396: creat d1/d12/d20/d3b/f7e x:0 0 0 2024-05-09T00:07:31.751 INFO:tasks.workunit.client.1.smithi135.stdout:1/401: creat da/d14/d20/d38/f8e x:0 0 0 2024-05-09T00:07:31.753 INFO:tasks.workunit.client.1.smithi135.stdout:0/423: link d3/dd/f26 d3/dd/d3f/d29/f77 0 2024-05-09T00:07:31.756 INFO:tasks.workunit.client.1.smithi135.stdout:3/412: creat d8/d13/d51/d6f/d7b/d85/f8f x:0 0 0 2024-05-09T00:07:31.760 INFO:tasks.workunit.client.1.smithi135.stdout:7/455: mkdir db/d21/d98 0 2024-05-09T00:07:31.761 INFO:tasks.workunit.client.1.smithi135.stdout:7/456: write db/dd/f35 [2570139,100358] 0 2024-05-09T00:07:31.763 INFO:tasks.workunit.client.1.smithi135.stdout:6/401: rename d2/d1a/f30 to d2/da/d1d/d69/f87 0 2024-05-09T00:07:31.765 INFO:tasks.workunit.client.1.smithi135.stdout:9/330: unlink d1/d1a/d10/d3c/d5c/f61 0 2024-05-09T00:07:31.767 INFO:tasks.workunit.client.1.smithi135.stdout:2/397: fsync d1/f1a 0 2024-05-09T00:07:31.771 INFO:tasks.workunit.client.1.smithi135.stdout:7/457: symlink db/d1e/d94/l99 0 2024-05-09T00:07:31.774 INFO:tasks.workunit.client.1.smithi135.stdout:1/402: rename da/d24/d27/d33/f42 to da/d14/d5c/f8f 0 2024-05-09T00:07:31.775 INFO:tasks.workunit.client.1.smithi135.stdout:9/331: creat d1/d1a/d10/d3c/d5c/f63 x:0 0 0 2024-05-09T00:07:31.777 INFO:tasks.workunit.client.1.smithi135.stdout:2/398: mknod d1/d12/d20/d3b/d40/c7f 0 2024-05-09T00:07:31.778 INFO:tasks.workunit.client.1.smithi135.stdout:3/413: dwrite d8/d13/f1e [4194304,4194304] 0 2024-05-09T00:07:31.779 INFO:tasks.workunit.client.1.smithi135.stdout:1/403: link da/d24/d27/d33/d36/l3c da/d14/d20/d38/d3a/d40/l90 0 2024-05-09T00:07:31.781 INFO:tasks.workunit.client.1.smithi135.stdout:9/332: unlink d1/d1a/d10/d3c/d43/c62 0 2024-05-09T00:07:31.783 INFO:tasks.workunit.client.1.smithi135.stdout:2/399: creat d1/d12/d20/f80 x:0 0 0 2024-05-09T00:07:31.783 INFO:tasks.workunit.client.1.smithi135.stdout:2/400: read - d1/d12/d20/d2b/d56/f69 zero size 2024-05-09T00:07:31.783 INFO:tasks.workunit.client.1.smithi135.stdout:2/401: dread - d1/d12/d20/d2b/f55 zero size 2024-05-09T00:07:31.789 INFO:tasks.workunit.client.1.smithi135.stdout:1/404: creat da/d14/d5c/f91 x:0 0 0 2024-05-09T00:07:31.792 INFO:tasks.workunit.client.1.smithi135.stdout:6/402: dwrite d2/da/d26/d57/d59/f63 [0,4194304] 0 2024-05-09T00:07:31.793 INFO:tasks.workunit.client.1.smithi135.stdout:7/458: dwrite db/dd/d33/d69/f86 [0,4194304] 0 2024-05-09T00:07:31.794 INFO:tasks.workunit.client.1.smithi135.stdout:8/403: sync 2024-05-09T00:07:31.796 INFO:tasks.workunit.client.1.smithi135.stdout:8/404: write d4/d7/d33/d39/f48 [3694457,123154] 0 2024-05-09T00:07:31.798 INFO:tasks.workunit.client.1.smithi135.stdout:5/446: sync 2024-05-09T00:07:31.803 INFO:tasks.workunit.client.1.smithi135.stdout:7/459: creat db/d1e/d94/f9a x:0 0 0 2024-05-09T00:07:31.810 INFO:tasks.workunit.client.1.smithi135.stdout:8/405: unlink d4/d7/de/l3c 0 2024-05-09T00:07:31.811 INFO:tasks.workunit.client.1.smithi135.stdout:8/406: read - d4/d7/d2a/f6f zero size 2024-05-09T00:07:31.811 INFO:tasks.workunit.client.1.smithi135.stdout:7/460: mknod db/dd/d33/d68/c9b 0 2024-05-09T00:07:31.813 INFO:tasks.workunit.client.1.smithi135.stdout:3/414: rename d8/d13/d51/d6f to d8/d6d/d44/d4b/d59/d90 0 2024-05-09T00:07:31.814 INFO:tasks.workunit.client.1.smithi135.stdout:3/415: write d8/d13/d1f/f30 [864163,76958] 0 2024-05-09T00:07:31.814 INFO:tasks.workunit.client.1.smithi135.stdout:3/416: read d8/d13/d75/d58/f76 [2553816,39053] 0 2024-05-09T00:07:31.814 INFO:tasks.workunit.client.1.smithi135.stdout:3/417: truncate d8/d13/d1f/d40/f3d 867781 0 2024-05-09T00:07:31.816 INFO:tasks.workunit.client.1.smithi135.stdout:6/403: dwrite d2/da/d26/f3c [0,4194304] 0 2024-05-09T00:07:31.816 INFO:tasks.workunit.client.1.smithi135.stdout:6/404: chown d2/d1a/f81 568908 1 2024-05-09T00:07:31.818 INFO:tasks.workunit.client.1.smithi135.stdout:1/405: rename da/d24/d27/d33/d36/f59 to da/d14/d5c/d83/f92 0 2024-05-09T00:07:31.818 INFO:tasks.workunit.client.1.smithi135.stdout:1/406: fsync da/d14/d20/f7c 0 2024-05-09T00:07:31.822 INFO:tasks.workunit.client.1.smithi135.stdout:4/335: sync 2024-05-09T00:07:31.822 INFO:tasks.workunit.client.1.smithi135.stdout:3/418: rmdir d8 39 2024-05-09T00:07:31.826 INFO:tasks.workunit.client.1.smithi135.stdout:6/405: symlink d2/d20/d37/d4e/l88 0 2024-05-09T00:07:31.829 INFO:tasks.workunit.client.1.smithi135.stdout:8/407: rename d4/c30 to d4/d7/de/c7e 0 2024-05-09T00:07:31.829 INFO:tasks.workunit.client.1.smithi135.stdout:8/408: read d4/d22/f51 [1894651,23834] 0 2024-05-09T00:07:31.830 INFO:tasks.workunit.client.1.smithi135.stdout:8/409: write d4/d7/de/d45/d76/f78 [752030,25012] 0 2024-05-09T00:07:31.832 INFO:tasks.workunit.client.1.smithi135.stdout:1/407: mkdir da/d24/d27/d33/d48/d6f/d93 0 2024-05-09T00:07:31.837 INFO:tasks.workunit.client.1.smithi135.stdout:4/336: mkdir dc/dd/d79 0 2024-05-09T00:07:31.837 INFO:tasks.workunit.client.1.smithi135.stdout:6/406: mkdir d2/da/d1d/d69/d89 0 2024-05-09T00:07:31.837 INFO:tasks.workunit.client.1.smithi135.stdout:6/407: fdatasync d2/d5f/f6d 0 2024-05-09T00:07:31.837 INFO:tasks.workunit.client.1.smithi135.stdout:4/337: read dc/f42 [694812,55352] 0 2024-05-09T00:07:31.839 INFO:tasks.workunit.client.1.smithi135.stdout:8/410: rename d4/d7/d4a/f4c to d4/d7/d33/f7f 0 2024-05-09T00:07:31.840 INFO:tasks.workunit.client.1.smithi135.stdout:3/419: dwrite d8/d13/f46 [0,4194304] 0 2024-05-09T00:07:31.840 INFO:tasks.workunit.client.1.smithi135.stdout:3/420: truncate d8/d6d/d44/d4b/d69/f4a 5017841 0 2024-05-09T00:07:31.840 INFO:tasks.workunit.client.1.smithi135.stdout:3/421: fdatasync d8/f70 0 2024-05-09T00:07:31.840 INFO:tasks.workunit.client.1.smithi135.stdout:3/422: chown d8/d6d/d44/d4b/l73 1946 1 2024-05-09T00:07:31.841 INFO:tasks.workunit.client.1.smithi135.stdout:9/333: rmdir d1/d1a/d10/d3c/d43 39 2024-05-09T00:07:31.841 INFO:tasks.workunit.client.1.smithi135.stdout:1/408: symlink da/db/d70/l94 0 2024-05-09T00:07:31.842 INFO:tasks.workunit.client.1.smithi135.stdout:1/409: fdatasync da/d14/d5c/d83/f92 0 2024-05-09T00:07:31.843 INFO:tasks.workunit.client.1.smithi135.stdout:6/408: creat d2/d1a/d7a/f8a x:0 0 0 2024-05-09T00:07:31.843 INFO:tasks.workunit.client.1.smithi135.stdout:6/409: dread - d2/d5f/f6d zero size 2024-05-09T00:07:31.845 INFO:tasks.workunit.client.1.smithi135.stdout:4/338: rename dc/dd/c75 to dc/d4a/c7a 0 2024-05-09T00:07:31.846 INFO:tasks.workunit.client.1.smithi135.stdout:9/334: dread d1/d1a/d2c/d2d/f31 [0,4194304] 0 2024-05-09T00:07:31.847 INFO:tasks.workunit.client.1.smithi135.stdout:8/411: mknod d4/d22/c80 0 2024-05-09T00:07:31.858 INFO:tasks.workunit.client.1.smithi135.stdout:6/410: dwrite d2/da/d49/f64 [0,4194304] 0 2024-05-09T00:07:31.858 INFO:tasks.workunit.client.1.smithi135.stdout:6/411: readlink d2/l71 0 2024-05-09T00:07:31.859 INFO:tasks.workunit.client.1.smithi135.stdout:3/423: link d8/d13/d1f/f43 d8/d13/f91 0 2024-05-09T00:07:31.862 INFO:tasks.workunit.client.1.smithi135.stdout:4/339: dwrite dc/d4a/d69/d55/d5f/f6b [0,4194304] 0 2024-05-09T00:07:31.865 INFO:tasks.workunit.client.1.smithi135.stdout:9/335: symlink d1/d1a/d2c/d2d/l64 0 2024-05-09T00:07:31.865 INFO:tasks.workunit.client.1.smithi135.stdout:9/336: chown d1/d1a/d2c/f28 1925405916 1 2024-05-09T00:07:31.869 INFO:tasks.workunit.client.1.smithi135.stdout:8/412: mknod d4/d7/de/d45/d76/c81 0 2024-05-09T00:07:31.869 INFO:tasks.workunit.client.1.smithi135.stdout:0/424: sync 2024-05-09T00:07:31.872 INFO:tasks.workunit.client.1.smithi135.stdout:3/424: dread f0 [0,4194304] 0 2024-05-09T00:07:31.872 INFO:tasks.workunit.client.1.smithi135.stdout:3/425: truncate d8/d13/d51/f86 698409 0 2024-05-09T00:07:31.875 INFO:tasks.workunit.client.1.smithi135.stdout:6/412: rename d2/da/d26/d57/d59/f63 to d2/d20/d37/d4e/f8b 0 2024-05-09T00:07:31.880 INFO:tasks.workunit.client.1.smithi135.stdout:4/340: creat dc/d4a/d69/f7b x:0 0 0 2024-05-09T00:07:31.886 INFO:tasks.workunit.client.1.smithi135.stdout:8/413: mknod d4/d22/c82 0 2024-05-09T00:07:31.888 INFO:tasks.workunit.client.1.smithi135.stdout:0/425: truncate d3/dd/d3f/d29/f47 3105767 0 2024-05-09T00:07:31.898 INFO:tasks.workunit.client.1.smithi135.stdout:0/426: symlink d3/dd/d3f/d29/d54/l78 0 2024-05-09T00:07:31.900 INFO:tasks.workunit.client.1.smithi135.stdout:8/414: dread d4/d22/f72 [4194304,4194304] 0 2024-05-09T00:07:31.900 INFO:tasks.workunit.client.1.smithi135.stdout:1/410: dwrite da/f41 [0,4194304] 0 2024-05-09T00:07:31.900 INFO:tasks.workunit.client.1.smithi135.stdout:8/415: write d4/d7/d33/d39/f3b [9136205,127670] 0 2024-05-09T00:07:31.901 INFO:tasks.workunit.client.1.smithi135.stdout:6/413: dwrite d2/da/d49/f5a [0,4194304] 0 2024-05-09T00:07:31.901 INFO:tasks.workunit.client.1.smithi135.stdout:6/414: chown d2/d1a/l39 1142420781 1 2024-05-09T00:07:31.901 INFO:tasks.workunit.client.1.smithi135.stdout:6/415: read d2/f17 [577828,23860] 0 2024-05-09T00:07:31.904 INFO:tasks.workunit.client.1.smithi135.stdout:4/341: dwrite dc/f24 [0,4194304] 0 2024-05-09T00:07:31.904 INFO:tasks.workunit.client.1.smithi135.stdout:4/342: truncate dc/f42 1642487 0 2024-05-09T00:07:31.904 INFO:tasks.workunit.client.1.smithi135.stdout:6/416: read d2/da/d26/d57/d60/f72 [3038747,41958] 0 2024-05-09T00:07:31.904 INFO:tasks.workunit.client.1.smithi135.stdout:6/417: fsync d2/d20/d37/f54 0 2024-05-09T00:07:31.907 INFO:tasks.workunit.client.1.smithi135.stdout:0/427: dread d3/dd/d3f/f41 [0,4194304] 0 2024-05-09T00:07:31.907 INFO:tasks.workunit.client.1.smithi135.stdout:0/428: write d3/dd/d3f/d43/f53 [925626,122615] 0 2024-05-09T00:07:31.908 INFO:tasks.workunit.client.1.smithi135.stdout:0/429: write d3/dd/d3f/d29/f2e [4880983,35681] 0 2024-05-09T00:07:31.910 INFO:tasks.workunit.client.1.smithi135.stdout:8/416: creat d4/d8/f83 x:0 0 0 2024-05-09T00:07:31.910 INFO:tasks.workunit.client.1.smithi135.stdout:2/402: sync 2024-05-09T00:07:31.921 INFO:tasks.workunit.client.1.smithi135.stdout:1/411: creat da/db/f95 x:0 0 0 2024-05-09T00:07:31.921 INFO:tasks.workunit.client.1.smithi135.stdout:1/412: truncate f9 4535778 0 2024-05-09T00:07:31.921 INFO:tasks.workunit.client.1.smithi135.stdout:3/426: getdents d8/d13 0 2024-05-09T00:07:31.923 INFO:tasks.workunit.client.1.smithi135.stdout:4/343: symlink dc/d4a/d69/l7c 0 2024-05-09T00:07:31.925 INFO:tasks.workunit.client.1.smithi135.stdout:6/418: mknod d2/d20/d37/d4e/d7c/c8c 0 2024-05-09T00:07:31.927 INFO:tasks.workunit.client.1.smithi135.stdout:8/417: creat d4/d7/d33/d39/f84 x:0 0 0 2024-05-09T00:07:31.930 INFO:tasks.workunit.client.1.smithi135.stdout:2/403: write d1/f1f [7872783,129150] 0 2024-05-09T00:07:31.932 INFO:tasks.workunit.client.1.smithi135.stdout:2/404: write d1/d12/f24 [526506,19818] 0 2024-05-09T00:07:31.932 INFO:tasks.workunit.client.1.smithi135.stdout:2/405: truncate d1/d12/d20/d3b/d40/f5e 230023 0 2024-05-09T00:07:31.932 INFO:tasks.workunit.client.1.smithi135.stdout:5/447: sync 2024-05-09T00:07:31.932 INFO:tasks.workunit.client.1.smithi135.stdout:1/413: mkdir da/d14/d20/d38/d3a/d40/d96 0 2024-05-09T00:07:31.934 INFO:tasks.workunit.client.1.smithi135.stdout:3/427: rmdir d8/d6d/d44/d4b/d59/d90/d7b/d80 39 2024-05-09T00:07:31.936 INFO:tasks.workunit.client.1.smithi135.stdout:4/344: read dc/dd/f17 [211742,48829] 0 2024-05-09T00:07:31.938 INFO:tasks.workunit.client.1.smithi135.stdout:8/418: symlink d4/d7/d2a/d67/l85 0 2024-05-09T00:07:31.940 INFO:tasks.workunit.client.1.smithi135.stdout:2/406: creat d1/d22/f81 x:0 0 0 2024-05-09T00:07:31.940 INFO:tasks.workunit.client.1.smithi135.stdout:2/407: write d1/d22/f26 [1218420,5618] 0 2024-05-09T00:07:31.945 INFO:tasks.workunit.client.1.smithi135.stdout:1/414: unlink da/d24/d27/d33/f6a 0 2024-05-09T00:07:31.945 INFO:tasks.workunit.client.1.smithi135.stdout:1/415: fdatasync da/f1f 0 2024-05-09T00:07:31.946 INFO:tasks.workunit.client.1.smithi135.stdout:1/416: truncate da/d14/d20/d38/d3a/f8b 603826 0 2024-05-09T00:07:31.947 INFO:tasks.workunit.client.1.smithi135.stdout:6/419: dwrite d2/da/f3b [0,4194304] 0 2024-05-09T00:07:31.948 INFO:tasks.workunit.client.1.smithi135.stdout:3/428: mkdir d8/d13/d51/d92 0 2024-05-09T00:07:31.948 INFO:tasks.workunit.client.1.smithi135.stdout:0/430: dwrite d3/f12 [0,4194304] 0 2024-05-09T00:07:31.948 INFO:tasks.workunit.client.1.smithi135.stdout:0/431: write d3/dd/d3f/d58/f5c [764464,78599] 0 2024-05-09T00:07:31.948 INFO:tasks.workunit.client.1.smithi135.stdout:0/432: read d3/dd/d3f/d58/f5c [98823,44467] 0 2024-05-09T00:07:31.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/345: mknod dc/c7d 0 2024-05-09T00:07:31.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/346: truncate dc/d4a/f50 1725312 0 2024-05-09T00:07:31.951 INFO:tasks.workunit.client.1.smithi135.stdout:7/461: sync 2024-05-09T00:07:31.953 INFO:tasks.workunit.client.1.smithi135.stdout:8/419: symlink d4/d7/de/d45/l86 0 2024-05-09T00:07:31.955 INFO:tasks.workunit.client.1.smithi135.stdout:2/408: creat d1/d12/d20/d2b/d56/d67/f82 x:0 0 0 2024-05-09T00:07:31.955 INFO:tasks.workunit.client.1.smithi135.stdout:5/448: dwrite db/f7f [0,4194304] 0 2024-05-09T00:07:31.955 INFO:tasks.workunit.client.1.smithi135.stdout:5/449: truncate db/d5d/d7e/f82 745667 0 2024-05-09T00:07:31.955 INFO:tasks.workunit.client.1.smithi135.stdout:5/450: chown db/d3f/f5c 30734774 1 2024-05-09T00:07:31.955 INFO:tasks.workunit.client.1.smithi135.stdout:5/451: write db/d24/d32/d5b/f6a [926412,34726] 0 2024-05-09T00:07:31.955 INFO:tasks.workunit.client.1.smithi135.stdout:5/452: write db/d84/f43 [746648,93241] 0 2024-05-09T00:07:31.955 INFO:tasks.workunit.client.1.smithi135.stdout:2/409: read d1/d12/d21/d41/d6d/d6e/f75 [2376456,27812] 0 2024-05-09T00:07:31.957 INFO:tasks.workunit.client.1.smithi135.stdout:1/417: getdents da/d14/d20 0 2024-05-09T00:07:31.961 INFO:tasks.workunit.client.1.smithi135.stdout:4/347: dread dc/f2d [0,4194304] 0 2024-05-09T00:07:31.962 INFO:tasks.workunit.client.1.smithi135.stdout:6/420: creat d2/d20/d2e/f8d x:0 0 0 2024-05-09T00:07:31.963 INFO:tasks.workunit.client.1.smithi135.stdout:6/421: write d2/f77 [3031517,78767] 0 2024-05-09T00:07:31.964 INFO:tasks.workunit.client.1.smithi135.stdout:7/462: dwrite db/ff [0,4194304] 0 2024-05-09T00:07:31.965 INFO:tasks.workunit.client.1.smithi135.stdout:3/429: link d8/d13/d1f/f2e d8/d6d/d44/d4b/d59/d90/d7b/d85/d88/f93 0 2024-05-09T00:07:31.965 INFO:tasks.workunit.client.1.smithi135.stdout:3/430: chown d8/d13/d51/d63 430 1 2024-05-09T00:07:31.973 INFO:tasks.workunit.client.1.smithi135.stdout:7/463: dread db/f16 [0,4194304] 0 2024-05-09T00:07:31.983 INFO:tasks.workunit.client.1.smithi135.stdout:0/433: rename d3/f5e to d3/f79 0 2024-05-09T00:07:31.986 INFO:tasks.workunit.client.1.smithi135.stdout:8/420: symlink d4/d7/d33/d39/l87 0 2024-05-09T00:07:31.991 INFO:tasks.workunit.client.1.smithi135.stdout:5/453: creat db/d24/f8c x:0 0 0 2024-05-09T00:07:31.994 INFO:tasks.workunit.client.1.smithi135.stdout:2/410: mknod d1/d12/d20/d3b/d4f/c83 0 2024-05-09T00:07:31.997 INFO:tasks.workunit.client.1.smithi135.stdout:1/418: creat da/d14/d20/f97 x:0 0 0 2024-05-09T00:07:32.000 INFO:tasks.workunit.client.1.smithi135.stdout:4/348: creat dc/dd/f7e x:0 0 0 2024-05-09T00:07:32.001 INFO:tasks.workunit.client.1.smithi135.stdout:4/349: write fa [894509,48211] 0 2024-05-09T00:07:32.005 INFO:tasks.workunit.client.1.smithi135.stdout:6/422: creat d2/da/d1d/d69/d89/f8e x:0 0 0 2024-05-09T00:07:32.006 INFO:tasks.workunit.client.1.smithi135.stdout:6/423: write d2/da/d26/d57/d60/f72 [1150407,38107] 0 2024-05-09T00:07:32.010 INFO:tasks.workunit.client.1.smithi135.stdout:3/431: link d8/f26 d8/d6d/d44/d4b/d59/d90/f94 0 2024-05-09T00:07:32.013 INFO:tasks.workunit.client.1.smithi135.stdout:7/464: creat db/dd/d33/d68/f9c x:0 0 0 2024-05-09T00:07:32.013 INFO:tasks.workunit.client.1.smithi135.stdout:7/465: dread - db/d1e/d3a/d40/d4c/f8e zero size 2024-05-09T00:07:32.014 INFO:tasks.workunit.client.1.smithi135.stdout:0/434: mknod d3/dd/d3f/c7a 0 2024-05-09T00:07:32.015 INFO:tasks.workunit.client.1.smithi135.stdout:3/432: dread d8/d13/f2d [0,4194304] 0 2024-05-09T00:07:32.016 INFO:tasks.workunit.client.1.smithi135.stdout:8/421: mkdir d4/d8/d88 0 2024-05-09T00:07:32.017 INFO:tasks.workunit.client.1.smithi135.stdout:5/454: mknod db/c8d 0 2024-05-09T00:07:32.022 INFO:tasks.workunit.client.1.smithi135.stdout:1/419: creat da/d24/d27/d33/f98 x:0 0 0 2024-05-09T00:07:32.023 INFO:tasks.workunit.client.1.smithi135.stdout:5/455: dread db/d24/d32/d5b/f6a [0,4194304] 0 2024-05-09T00:07:32.030 INFO:tasks.workunit.client.1.smithi135.stdout:4/350: getdents dc/d4a/d69/d55/d5f/d5a 0 2024-05-09T00:07:32.033 INFO:tasks.workunit.client.1.smithi135.stdout:9/337: sync 2024-05-09T00:07:32.039 INFO:tasks.workunit.client.1.smithi135.stdout:6/424: mknod d2/d20/d3f/d4f/d7f/c8f 0 2024-05-09T00:07:32.039 INFO:tasks.workunit.client.1.smithi135.stdout:7/466: creat db/dd/d33/f9d x:0 0 0 2024-05-09T00:07:32.040 INFO:tasks.workunit.client.1.smithi135.stdout:7/467: fsync db/f29 0 2024-05-09T00:07:32.040 INFO:tasks.workunit.client.1.smithi135.stdout:7/468: dread - db/dd/d33/d69/f75 zero size 2024-05-09T00:07:32.042 INFO:tasks.workunit.client.1.smithi135.stdout:0/435: creat d3/dd/f7b x:0 0 0 2024-05-09T00:07:32.042 INFO:tasks.workunit.client.1.smithi135.stdout:0/436: readlink d3/dd/d2d/l6f 0 2024-05-09T00:07:32.043 INFO:tasks.workunit.client.1.smithi135.stdout:3/433: creat d8/d13/d51/d92/f95 x:0 0 0 2024-05-09T00:07:32.045 INFO:tasks.workunit.client.1.smithi135.stdout:8/422: creat d4/f89 x:0 0 0 2024-05-09T00:07:32.045 INFO:tasks.workunit.client.1.smithi135.stdout:8/423: chown d4/d7/f52 79321200 1 2024-05-09T00:07:32.048 INFO:tasks.workunit.client.1.smithi135.stdout:2/411: rename d1/c2a to d1/d12/d20/c84 0 2024-05-09T00:07:32.048 INFO:tasks.workunit.client.1.smithi135.stdout:2/412: read - d1/d12/d20/f80 zero size 2024-05-09T00:07:32.048 INFO:tasks.workunit.client.1.smithi135.stdout:2/413: chown d1/d12/d20/d3b/f5f 399904 1 2024-05-09T00:07:32.049 INFO:tasks.workunit.client.1.smithi135.stdout:4/351: dwrite dc/d4a/d69/d55/d5f/d5a/f5b [0,4194304] 0 2024-05-09T00:07:32.050 INFO:tasks.workunit.client.1.smithi135.stdout:5/456: dwrite db/d5d/f68 [0,4194304] 0 2024-05-09T00:07:32.050 INFO:tasks.workunit.client.1.smithi135.stdout:5/457: write db/d84/d31/d6e/f8b [745312,38490] 0 2024-05-09T00:07:32.050 INFO:tasks.workunit.client.1.smithi135.stdout:5/458: chown db/d84/f3c 254812 1 2024-05-09T00:07:32.050 INFO:tasks.workunit.client.1.smithi135.stdout:4/352: write fa [1096537,80175] 0 2024-05-09T00:07:32.050 INFO:tasks.workunit.client.1.smithi135.stdout:1/420: getdents da/db/d16 0 2024-05-09T00:07:32.051 INFO:tasks.workunit.client.1.smithi135.stdout:1/421: write da/f10 [1129270,83469] 0 2024-05-09T00:07:32.051 INFO:tasks.workunit.client.1.smithi135.stdout:1/422: truncate da/d24/d27/d33/d52/d71/f87 206399 0 2024-05-09T00:07:32.054 INFO:tasks.workunit.client.1.smithi135.stdout:4/353: dread dc/d26/d4e/f54 [0,4194304] 0 2024-05-09T00:07:32.055 INFO:tasks.workunit.client.1.smithi135.stdout:6/425: write d2/d20/d3f/f52 [439668,113443] 0 2024-05-09T00:07:32.059 INFO:tasks.workunit.client.1.smithi135.stdout:7/469: unlink db/f16 0 2024-05-09T00:07:32.059 INFO:tasks.workunit.client.1.smithi135.stdout:0/437: truncate d3/dd/d2d/f68 29261 0 2024-05-09T00:07:32.062 INFO:tasks.workunit.client.1.smithi135.stdout:8/424: dwrite d4/d7/d2a/d56/f7c [0,4194304] 0 2024-05-09T00:07:32.064 INFO:tasks.workunit.client.1.smithi135.stdout:3/434: creat d8/d13/d75/f96 x:0 0 0 2024-05-09T00:07:32.064 INFO:tasks.workunit.client.1.smithi135.stdout:3/435: chown d8/d6d/d44/d4b/d59/d90/d7b/d85/f8e 0 1 2024-05-09T00:07:32.065 INFO:tasks.workunit.client.1.smithi135.stdout:0/438: dread d3/dd/f2f [0,4194304] 0 2024-05-09T00:07:32.067 INFO:tasks.workunit.client.1.smithi135.stdout:2/414: link d1/d12/d20/d2b/d56/l5d d1/d12/d21/d41/d6d/l85 0 2024-05-09T00:07:32.067 INFO:tasks.workunit.client.1.smithi135.stdout:2/415: fsync d1/d12/d27/f62 0 2024-05-09T00:07:32.076 INFO:tasks.workunit.client.1.smithi135.stdout:8/425: dread d4/f16 [0,4194304] 0 2024-05-09T00:07:32.078 INFO:tasks.workunit.client.1.smithi135.stdout:6/426: dwrite d2/f58 [0,4194304] 0 2024-05-09T00:07:32.078 INFO:tasks.workunit.client.1.smithi135.stdout:5/459: dwrite db/d84/f43 [0,4194304] 0 2024-05-09T00:07:32.082 INFO:tasks.workunit.client.1.smithi135.stdout:0/439: dwrite d3/dd/f32 [4194304,4194304] 0 2024-05-09T00:07:32.091 INFO:tasks.workunit.client.1.smithi135.stdout:4/354: mkdir dc/d7f 0 2024-05-09T00:07:32.091 INFO:tasks.workunit.client.1.smithi135.stdout:7/470: unlink db/dd/d33/d58/c90 0 2024-05-09T00:07:32.095 INFO:tasks.workunit.client.1.smithi135.stdout:5/460: dwrite db/d24/d32/d5b/f76 [0,4194304] 0 2024-05-09T00:07:32.098 INFO:tasks.workunit.client.1.smithi135.stdout:3/436: rename d8/d13/d1f/d40/f3d to d8/d6d/d44/d4b/d59/d90/f97 0 2024-05-09T00:07:32.102 INFO:tasks.workunit.client.1.smithi135.stdout:2/416: mkdir d1/d12/d20/d2b/d56/d86 0 2024-05-09T00:07:32.104 INFO:tasks.workunit.client.1.smithi135.stdout:8/426: creat d4/d22/f8a x:0 0 0 2024-05-09T00:07:32.110 INFO:tasks.workunit.client.1.smithi135.stdout:5/461: dwrite db/f21 [4194304,4194304] 0 2024-05-09T00:07:32.110 INFO:tasks.workunit.client.1.smithi135.stdout:6/427: unlink d2/d20/d37/d4e/l88 0 2024-05-09T00:07:32.111 INFO:tasks.workunit.client.1.smithi135.stdout:6/428: write d2/da/d49/f23 [3293107,109972] 0 2024-05-09T00:07:32.112 INFO:tasks.workunit.client.1.smithi135.stdout:6/429: write d2/f25 [385502,130886] 0 2024-05-09T00:07:32.113 INFO:tasks.workunit.client.1.smithi135.stdout:0/440: getdents d3/dd/d2d 0 2024-05-09T00:07:32.116 INFO:tasks.workunit.client.1.smithi135.stdout:1/423: chown da/d14/d20/d2c/l7a 3 1 2024-05-09T00:07:32.118 INFO:tasks.workunit.client.1.smithi135.stdout:4/355: creat dc/dd/f80 x:0 0 0 2024-05-09T00:07:32.120 INFO:tasks.workunit.client.1.smithi135.stdout:7/471: creat db/dd/d33/f9e x:0 0 0 2024-05-09T00:07:32.120 INFO:tasks.workunit.client.1.smithi135.stdout:7/472: dread - db/d1e/d94/f9a zero size 2024-05-09T00:07:32.121 INFO:tasks.workunit.client.1.smithi135.stdout:7/473: read - db/d13/f73 zero size 2024-05-09T00:07:32.121 INFO:tasks.workunit.client.1.smithi135.stdout:6/430: dread d2/d1a/f24 [0,4194304] 0 2024-05-09T00:07:32.132 INFO:tasks.workunit.client.1.smithi135.stdout:3/437: mknod d8/d13/d1f/d62/c98 0 2024-05-09T00:07:32.136 INFO:tasks.workunit.client.1.smithi135.stdout:2/417: rename d1/f17 to d1/d12/d20/d2b/d56/d72/f87 0 2024-05-09T00:07:32.139 INFO:tasks.workunit.client.1.smithi135.stdout:8/427: rmdir d4/d7/d33 39 2024-05-09T00:07:32.140 INFO:tasks.workunit.client.1.smithi135.stdout:8/428: chown d4/d8/l4f 1 1 2024-05-09T00:07:32.140 INFO:tasks.workunit.client.1.smithi135.stdout:8/429: readlink d4/d7/l5a 0 2024-05-09T00:07:32.147 INFO:tasks.workunit.client.1.smithi135.stdout:2/418: dread d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:32.147 INFO:tasks.workunit.client.1.smithi135.stdout:5/462: unlink db/f16 0 2024-05-09T00:07:32.147 INFO:tasks.workunit.client.1.smithi135.stdout:5/463: chown db/d24/c4a 215842 1 2024-05-09T00:07:32.148 INFO:tasks.workunit.client.1.smithi135.stdout:8/430: dread d4/d7/d33/d39/f48 [0,4194304] 0 2024-05-09T00:07:32.150 INFO:tasks.workunit.client.1.smithi135.stdout:0/441: mkdir d3/dd/d3f/d29/d7c 0 2024-05-09T00:07:32.152 INFO:tasks.workunit.client.1.smithi135.stdout:1/424: chown da/f62 309876 1 2024-05-09T00:07:32.155 INFO:tasks.workunit.client.1.smithi135.stdout:4/356: symlink dc/l81 0 2024-05-09T00:07:32.158 INFO:tasks.workunit.client.1.smithi135.stdout:6/431: symlink d2/d20/d37/d4e/l90 0 2024-05-09T00:07:32.158 INFO:tasks.workunit.client.1.smithi135.stdout:0/442: dread d3/dd/d3f/f5b [4194304,4194304] 0 2024-05-09T00:07:32.160 INFO:tasks.workunit.client.1.smithi135.stdout:0/443: dread d3/dd/d3f/d3a/d46/f3d [0,4194304] 0 2024-05-09T00:07:32.160 INFO:tasks.workunit.client.1.smithi135.stdout:3/438: creat d8/d13/d1f/f99 x:0 0 0 2024-05-09T00:07:32.161 INFO:tasks.workunit.client.1.smithi135.stdout:3/439: write d8/d13/d1f/f6b [618116,113924] 0 2024-05-09T00:07:32.161 INFO:tasks.workunit.client.1.smithi135.stdout:3/440: write d8/d13/f1b [4590294,26351] 0 2024-05-09T00:07:32.161 INFO:tasks.workunit.client.1.smithi135.stdout:0/444: write d3/dd/d2d/f65 [3582082,57772] 0 2024-05-09T00:07:32.163 INFO:tasks.workunit.client.1.smithi135.stdout:7/474: rename db/d13/l23 to db/d1e/d3a/d40/d4c/d67/l9f 0 2024-05-09T00:07:32.165 INFO:tasks.workunit.client.1.smithi135.stdout:7/475: write db/d1e/d3a/f52 [315036,30898] 0 2024-05-09T00:07:32.165 INFO:tasks.workunit.client.1.smithi135.stdout:5/464: unlink db/d24/l59 0 2024-05-09T00:07:32.168 INFO:tasks.workunit.client.1.smithi135.stdout:0/445: dread d3/dd/f32 [4194304,4194304] 0 2024-05-09T00:07:32.168 INFO:tasks.workunit.client.1.smithi135.stdout:8/431: rmdir d4/d8/d88 0 2024-05-09T00:07:32.171 INFO:tasks.workunit.client.1.smithi135.stdout:4/357: readlink dc/d4a/d69/d39/l35 0 2024-05-09T00:07:32.174 INFO:tasks.workunit.client.1.smithi135.stdout:3/441: link d8/d6d/d24/l56 d8/d13/d1f/d40/d52/l9a 0 2024-05-09T00:07:32.174 INFO:tasks.workunit.client.1.smithi135.stdout:8/432: dread d4/d22/f72 [0,4194304] 0 2024-05-09T00:07:32.176 INFO:tasks.workunit.client.1.smithi135.stdout:2/419: rename d1/d12/d20/f29 to d1/d12/d20/d2b/d56/d86/f88 0 2024-05-09T00:07:32.177 INFO:tasks.workunit.client.1.smithi135.stdout:1/425: dread da/d14/d20/d2c/f32 [0,4194304] 0 2024-05-09T00:07:32.179 INFO:tasks.workunit.client.1.smithi135.stdout:7/476: creat db/d1e/d3a/d40/d4c/d67/fa0 x:0 0 0 2024-05-09T00:07:32.181 INFO:tasks.workunit.client.1.smithi135.stdout:5/465: getdents db/d84/d31/d6e 0 2024-05-09T00:07:32.182 INFO:tasks.workunit.client.1.smithi135.stdout:5/466: chown db/f15 56785 1 2024-05-09T00:07:32.184 INFO:tasks.workunit.client.1.smithi135.stdout:0/446: mkdir d3/dd/d2d/d7d 0 2024-05-09T00:07:32.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/447: dread - d3/dd/f7b zero size 2024-05-09T00:07:32.187 INFO:tasks.workunit.client.1.smithi135.stdout:4/358: rmdir dc/d4a/d69/d55/d5f/d5a 39 2024-05-09T00:07:32.187 INFO:tasks.workunit.client.1.smithi135.stdout:4/359: fdatasync dc/d4a/f58 0 2024-05-09T00:07:32.187 INFO:tasks.workunit.client.1.smithi135.stdout:9/338: sync 2024-05-09T00:07:32.190 INFO:tasks.workunit.client.1.smithi135.stdout:3/442: mkdir d8/d13/d75/d9b 0 2024-05-09T00:07:32.198 INFO:tasks.workunit.client.1.smithi135.stdout:2/420: dwrite d1/d12/d20/f68 [0,4194304] 0 2024-05-09T00:07:32.198 INFO:tasks.workunit.client.1.smithi135.stdout:9/339: dread d1/f5a [0,4194304] 0 2024-05-09T00:07:32.198 INFO:tasks.workunit.client.1.smithi135.stdout:9/340: read - d1/d1a/d10/d3c/f4b zero size 2024-05-09T00:07:32.200 INFO:tasks.workunit.client.1.smithi135.stdout:7/477: dwrite db/d1e/d94/f9a [0,4194304] 0 2024-05-09T00:07:32.201 INFO:tasks.workunit.client.1.smithi135.stdout:6/432: rename d2/da/d1d/d69/d78/d82 to d2/da/d49/d91 0 2024-05-09T00:07:32.202 INFO:tasks.workunit.client.1.smithi135.stdout:1/426: read da/d24/d27/d33/d52/d71/f87 [197261,2249] 0 2024-05-09T00:07:32.202 INFO:tasks.workunit.client.1.smithi135.stdout:6/433: fsync d2/da/d49/f23 0 2024-05-09T00:07:32.203 INFO:tasks.workunit.client.1.smithi135.stdout:7/478: write db/ff [1001202,23295] 0 2024-05-09T00:07:32.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/467: unlink db/c1d 0 2024-05-09T00:07:32.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/468: fsync db/d24/d32/f47 0 2024-05-09T00:07:32.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/448: unlink d3/dd/d3f/d3a/d46/l39 0 2024-05-09T00:07:32.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/449: dread - d3/dd/d3f/d58/f63 zero size 2024-05-09T00:07:32.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/450: readlink d3/l9 0 2024-05-09T00:07:32.208 INFO:tasks.workunit.client.1.smithi135.stdout:4/360: truncate f7 286420 0 2024-05-09T00:07:32.212 INFO:tasks.workunit.client.1.smithi135.stdout:6/434: dread d2/da/d26/f55 [0,4194304] 0 2024-05-09T00:07:32.213 INFO:tasks.workunit.client.1.smithi135.stdout:3/443: creat d8/d6d/d44/d4b/d59/d90/f9c x:0 0 0 2024-05-09T00:07:32.219 INFO:tasks.workunit.client.1.smithi135.stdout:5/469: dwrite db/d84/d31/d6e/f87 [0,4194304] 0 2024-05-09T00:07:32.220 INFO:tasks.workunit.client.1.smithi135.stdout:2/421: creat d1/d12/d20/d2b/d56/f89 x:0 0 0 2024-05-09T00:07:32.224 INFO:tasks.workunit.client.1.smithi135.stdout:9/341: rmdir d1/d1a/d10 39 2024-05-09T00:07:32.226 INFO:tasks.workunit.client.1.smithi135.stdout:8/433: rmdir d4 39 2024-05-09T00:07:32.226 INFO:tasks.workunit.client.1.smithi135.stdout:8/434: chown d4/ld 31823201 1 2024-05-09T00:07:32.227 INFO:tasks.workunit.client.1.smithi135.stdout:4/361: dwrite dc/dd/f3f [0,4194304] 0 2024-05-09T00:07:32.234 INFO:tasks.workunit.client.1.smithi135.stdout:1/427: creat da/d14/d20/d2c/f99 x:0 0 0 2024-05-09T00:07:32.235 INFO:tasks.workunit.client.1.smithi135.stdout:2/422: dread d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:32.236 INFO:tasks.workunit.client.1.smithi135.stdout:5/470: dwrite db/d24/d32/f44 [0,4194304] 0 2024-05-09T00:07:32.238 INFO:tasks.workunit.client.1.smithi135.stdout:7/479: creat db/d21/d98/fa1 x:0 0 0 2024-05-09T00:07:32.238 INFO:tasks.workunit.client.1.smithi135.stdout:7/480: write db/d5b/f64 [907439,72944] 0 2024-05-09T00:07:32.239 INFO:tasks.workunit.client.1.smithi135.stdout:0/451: creat d3/dd/d3f/f7e x:0 0 0 2024-05-09T00:07:32.242 INFO:tasks.workunit.client.1.smithi135.stdout:6/435: mkdir d2/da/d49/d92 0 2024-05-09T00:07:32.243 INFO:tasks.workunit.client.1.smithi135.stdout:3/444: creat d8/d6d/d44/d4b/d59/d90/f9d x:0 0 0 2024-05-09T00:07:32.250 INFO:tasks.workunit.client.1.smithi135.stdout:9/342: symlink d1/d24/d44/l65 0 2024-05-09T00:07:32.253 INFO:tasks.workunit.client.1.smithi135.stdout:8/435: mkdir d4/d22/d8b 0 2024-05-09T00:07:32.253 INFO:tasks.workunit.client.1.smithi135.stdout:0/452: dread d3/dd/d3f/f33 [0,4194304] 0 2024-05-09T00:07:32.253 INFO:tasks.workunit.client.1.smithi135.stdout:0/453: chown d3/dd/d3f/d43 457879597 1 2024-05-09T00:07:32.258 INFO:tasks.workunit.client.1.smithi135.stdout:6/436: dwrite f1 [0,4194304] 0 2024-05-09T00:07:32.259 INFO:tasks.workunit.client.1.smithi135.stdout:4/362: truncate dc/dd/f3d 222646 0 2024-05-09T00:07:32.259 INFO:tasks.workunit.client.1.smithi135.stdout:4/363: fsync dc/dd/f80 0 2024-05-09T00:07:32.263 INFO:tasks.workunit.client.1.smithi135.stdout:2/423: rename d1/d12/f1b to d1/d12/d20/d3b/d40/f8a 0 2024-05-09T00:07:32.263 INFO:tasks.workunit.client.1.smithi135.stdout:1/428: rename da to da/d14/d20/d38/d86/d9a 22 2024-05-09T00:07:32.265 INFO:tasks.workunit.client.1.smithi135.stdout:2/424: dread d1/d22/f31 [0,4194304] 0 2024-05-09T00:07:32.268 INFO:tasks.workunit.client.1.smithi135.stdout:1/429: dread da/d14/d20/d2c/f32 [0,4194304] 0 2024-05-09T00:07:32.273 INFO:tasks.workunit.client.1.smithi135.stdout:5/471: mknod db/d24/c8e 0 2024-05-09T00:07:32.273 INFO:tasks.workunit.client.1.smithi135.stdout:7/481: symlink db/la2 0 2024-05-09T00:07:32.273 INFO:tasks.workunit.client.1.smithi135.stdout:5/472: dread - db/d52/f6b zero size 2024-05-09T00:07:32.274 INFO:tasks.workunit.client.1.smithi135.stdout:3/445: creat d8/d13/d75/d58/f9e x:0 0 0 2024-05-09T00:07:32.276 INFO:tasks.workunit.client.1.smithi135.stdout:9/343: mkdir d1/d24/d44/d54/d66 0 2024-05-09T00:07:32.278 INFO:tasks.workunit.client.1.smithi135.stdout:8/436: creat d4/d22/f8c x:0 0 0 2024-05-09T00:07:32.280 INFO:tasks.workunit.client.1.smithi135.stdout:6/437: dwrite d2/da/d49/f67 [0,4194304] 0 2024-05-09T00:07:32.281 INFO:tasks.workunit.client.1.smithi135.stdout:4/364: dwrite dc/d26/d4e/f6e [0,4194304] 0 2024-05-09T00:07:32.296 INFO:tasks.workunit.client.1.smithi135.stdout:4/365: dwrite dc/f24 [0,4194304] 0 2024-05-09T00:07:32.306 INFO:tasks.workunit.client.1.smithi135.stdout:2/425: rmdir d1/d12/d20/d2b/d56/d72 39 2024-05-09T00:07:32.308 INFO:tasks.workunit.client.1.smithi135.stdout:1/430: creat da/d24/d27/f9b x:0 0 0 2024-05-09T00:07:32.308 INFO:tasks.workunit.client.1.smithi135.stdout:1/431: write da/db/f95 [597082,113196] 0 2024-05-09T00:07:32.308 INFO:tasks.workunit.client.1.smithi135.stdout:1/432: fdatasync da/f10 0 2024-05-09T00:07:32.308 INFO:tasks.workunit.client.1.smithi135.stdout:1/433: dread - da/d14/d5c/f91 zero size 2024-05-09T00:07:32.308 INFO:tasks.workunit.client.1.smithi135.stdout:1/434: write da/d14/d20/f97 [345455,10231] 0 2024-05-09T00:07:32.309 INFO:tasks.workunit.client.1.smithi135.stdout:5/473: rename db/d24/c3a to db/d24/d32/c8f 0 2024-05-09T00:07:32.311 INFO:tasks.workunit.client.1.smithi135.stdout:7/482: mkdir db/d1e/d3a/d40/d4c/da3 0 2024-05-09T00:07:32.311 INFO:tasks.workunit.client.1.smithi135.stdout:7/483: fsync db/dd/d33/d58/f8f 0 2024-05-09T00:07:32.314 INFO:tasks.workunit.client.1.smithi135.stdout:3/446: rmdir d8/d6d 39 2024-05-09T00:07:32.317 INFO:tasks.workunit.client.1.smithi135.stdout:9/344: link d1/d1a/d10/d3c/d5c/f63 d1/d1a/f67 0 2024-05-09T00:07:32.322 INFO:tasks.workunit.client.1.smithi135.stdout:6/438: symlink d2/da/d26/l93 0 2024-05-09T00:07:32.323 INFO:tasks.workunit.client.1.smithi135.stdout:6/439: chown d2/da/d1d 24 1 2024-05-09T00:07:32.329 INFO:tasks.workunit.client.1.smithi135.stdout:2/426: link d1/d12/f5a d1/d12/d20/d3b/d40/f8b 0 2024-05-09T00:07:32.331 INFO:tasks.workunit.client.1.smithi135.stdout:6/440: dread d2/da/d26/f3c [0,4194304] 0 2024-05-09T00:07:32.332 INFO:tasks.workunit.client.1.smithi135.stdout:1/435: symlink da/d14/d5c/l9c 0 2024-05-09T00:07:32.333 INFO:tasks.workunit.client.1.smithi135.stdout:8/437: rename d4/d7/d33/d39/l6c to d4/d7/d2a/d56/l8d 0 2024-05-09T00:07:32.335 INFO:tasks.workunit.client.1.smithi135.stdout:5/474: creat db/d84/d31/f90 x:0 0 0 2024-05-09T00:07:32.340 INFO:tasks.workunit.client.1.smithi135.stdout:1/436: dread da/d24/d27/f28 [0,4194304] 0 2024-05-09T00:07:32.345 INFO:tasks.workunit.client.1.smithi135.stdout:3/447: creat d8/d6d/d44/d4b/d59/d90/d7b/d80/f9f x:0 0 0 2024-05-09T00:07:32.349 INFO:tasks.workunit.client.1.smithi135.stdout:3/448: dread d8/d13/d75/d53/f81 [0,4194304] 0 2024-05-09T00:07:32.350 INFO:tasks.workunit.client.1.smithi135.stdout:9/345: creat d1/d1a/d10/f68 x:0 0 0 2024-05-09T00:07:32.350 INFO:tasks.workunit.client.1.smithi135.stdout:4/366: mkdir dc/d26/d31/d82 0 2024-05-09T00:07:32.353 INFO:tasks.workunit.client.1.smithi135.stdout:2/427: mknod d1/d22/c8c 0 2024-05-09T00:07:32.355 INFO:tasks.workunit.client.1.smithi135.stdout:6/441: dwrite d2/da/d26/d57/f6c [4194304,4194304] 0 2024-05-09T00:07:32.357 INFO:tasks.workunit.client.1.smithi135.stdout:8/438: rename d4/d22/l29 to d4/d7/d33/d39/l8e 0 2024-05-09T00:07:32.358 INFO:tasks.workunit.client.1.smithi135.stdout:6/442: read d2/fc [3406200,22147] 0 2024-05-09T00:07:32.359 INFO:tasks.workunit.client.1.smithi135.stdout:3/449: rmdir d8/d13/d51/d92 39 2024-05-09T00:07:32.359 INFO:tasks.workunit.client.1.smithi135.stdout:1/437: dwrite da/f1f [0,4194304] 0 2024-05-09T00:07:32.359 INFO:tasks.workunit.client.1.smithi135.stdout:5/475: dwrite db/d24/f34 [0,4194304] 0 2024-05-09T00:07:32.361 INFO:tasks.workunit.client.1.smithi135.stdout:9/346: truncate d1/f2 3310038 0 2024-05-09T00:07:32.363 INFO:tasks.workunit.client.1.smithi135.stdout:1/438: dread da/db/f34 [0,4194304] 0 2024-05-09T00:07:32.364 INFO:tasks.workunit.client.1.smithi135.stdout:1/439: write da/d24/d27/f28 [1354097,66548] 0 2024-05-09T00:07:32.366 INFO:tasks.workunit.client.1.smithi135.stdout:2/428: link d1/d12/d21/d57/f7b d1/d12/f8d 0 2024-05-09T00:07:32.369 INFO:tasks.workunit.client.1.smithi135.stdout:0/454: sync 2024-05-09T00:07:32.370 INFO:tasks.workunit.client.1.smithi135.stdout:8/439: creat d4/d7/f8f x:0 0 0 2024-05-09T00:07:32.370 INFO:tasks.workunit.client.1.smithi135.stdout:8/440: fdatasync d4/d22/f27 0 2024-05-09T00:07:32.372 INFO:tasks.workunit.client.1.smithi135.stdout:3/450: mkdir d8/d6d/d44/d4b/da0 0 2024-05-09T00:07:32.376 INFO:tasks.workunit.client.1.smithi135.stdout:5/476: rename db/d52 to db/d24/d32/d5b/d91 0 2024-05-09T00:07:32.376 INFO:tasks.workunit.client.1.smithi135.stdout:4/367: dwrite dc/d26/f4f [0,4194304] 0 2024-05-09T00:07:32.379 INFO:tasks.workunit.client.1.smithi135.stdout:1/440: creat da/d24/d27/d33/d52/d71/d8d/f9d x:0 0 0 2024-05-09T00:07:32.380 INFO:tasks.workunit.client.1.smithi135.stdout:2/429: symlink d1/d12/d21/l8e 0 2024-05-09T00:07:32.381 INFO:tasks.workunit.client.1.smithi135.stdout:2/430: write d1/d12/f24 [1802423,28563] 0 2024-05-09T00:07:32.383 INFO:tasks.workunit.client.1.smithi135.stdout:4/368: dread dc/d4a/d69/d55/d5f/d5a/f5b [0,4194304] 0 2024-05-09T00:07:32.383 INFO:tasks.workunit.client.1.smithi135.stdout:4/369: stat dc/dd 0 2024-05-09T00:07:32.389 INFO:tasks.workunit.client.1.smithi135.stdout:8/441: getdents d4/d22 0 2024-05-09T00:07:32.512 INFO:tasks.workunit.client.1.smithi135.stdout:9/347: rename d1/f5a to d1/d24/d44/d54/f69 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:9/348: chown d1/d24/d44/d54/l57 14100 1 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:5/477: mkdir db/d84/d31/d6e/d92 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:2/431: creat d1/d12/d20/d2b/f8f x:0 0 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:0/455: write d3/dd/d3f/f7e [405629,16497] 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:4/370: creat dc/d4a/d69/d55/d5f/f83 x:0 0 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:4/371: fsync dc/dd/f22 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:8/442: symlink d4/l90 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:3/451: rename d8/d13/d51/d63/f64 to d8/d6d/fa1 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:3/452: readlink d8/d13/d1f/l83 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:3/453: write d8/d6d/d44/d4b/d69/f4d [1730006,118644] 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:9/349: unlink d1/d1a/d2c/d2d/f31 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:9/350: read - d1/d1a/d10/d3c/d5c/f63 zero size 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:5/478: mknod db/d84/c93 0 2024-05-09T00:07:32.513 INFO:tasks.workunit.client.1.smithi135.stdout:5/479: dread db/d24/d32/d5b/f6a [0,4194304] 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:4/372: creat dc/d4a/d69/d55/d5f/f84 x:0 0 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:4/373: getdents dc/d4a/d69/d55/d5f/d5a 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:8/443: link d4/d7/d2a/c6d d4/d7/d33/d39/c91 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:1/441: rename da/d24/d27/d33/c53 to da/d24/d27/d33/d7d/c9e 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:1/442: truncate da/d24/d27/d33/d36/f65 1471783 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:1/443: write da/f35 [3355888,69440] 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:3/454: symlink d8/d6d/d44/d4b/d59/d90/d7b/la2 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:7/484: sync 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:0/456: creat d3/dd/d3f/d29/f7f x:0 0 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:4/374: rmdir dc/d26 39 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:8/444: link d4/d7/de/c7e d4/d7/d2a/d56/c92 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:8/445: write d4/d7/d2a/d56/f61 [180123,95802] 0 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:6/443: sync 2024-05-09T00:07:32.514 INFO:tasks.workunit.client.1.smithi135.stdout:5/480: rename db/d84/d31/f81 to db/f94 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:1/444: mknod da/d24/d27/d33/d48/c9f 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:9/351: rmdir d1/d1a 39 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:3/455: creat d8/d13/d75/d53/fa3 x:0 0 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:3/456: read d8/d6d/f28 [1255202,47748] 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:3/457: chown d8/d6d/d24/c3c 5 1 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:3/458: chown d8/d13/d75/d58/f76 121 1 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:3/459: write d8/d13/d1f/f30 [4994384,66936] 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:3/460: chown d8/d13/f1b 776 1 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:7/485: getdents db/d1e/d3a/d40/d7e 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:7/486: stat db/dd/f65 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:8/446: mknod d4/d7/d33/c93 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:6/444: getdents d2/d1a 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:5/481: dwrite db/d84/d31/d5e/f69 [4194304,4194304] 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:1/445: rename da/d24/d27/d33/d36/l3c to da/d14/d20/d38/d3a/la0 0 2024-05-09T00:07:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:9/352: creat d1/d1a/d10/f6a x:0 0 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:3/461: creat d8/d13/d1f/fa4 x:0 0 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:7/487: symlink db/d1e/la4 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:7/488: readlink db/la2 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:7/489: write db/d1e/f36 [805908,120450] 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:2/432: sync 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:2/433: dread - d1/d12/d27/f3c zero size 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:0/457: symlink d3/dd/d3f/d58/l80 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:0/458: write d3/dd/d2d/f6e [43011,61721] 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:5/482: dwrite db/d24/d32/f47 [0,4194304] 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:4/375: link dc/d4a/d69/d55/d5f/f84 dc/d26/d31/f85 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:8/447: creat d4/f94 x:0 0 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:6/445: link d2/d20/d37/l5d d2/d20/d3f/d4f/d7f/l94 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:1/446: link da/d14/d20/d38/d3a/la0 da/d24/d27/d33/d36/la1 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:1/447: readlink da/db/d16/l85 0 2024-05-09T00:07:32.516 INFO:tasks.workunit.client.1.smithi135.stdout:9/353: truncate d1/d24/f35 1838351 0 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:3/462: symlink d8/d6d/la5 0 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:2/434: link d1/d12/d20/d2b/d56/d72/f87 d1/d12/d20/d2b/f90 0 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:2/435: chown d1/d12/d27/f3c 45777 1 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:0/459: dwrite d3/dd/d3f/d29/f2e [0,4194304] 0 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:0/460: chown d3/dd/d3f/d29/f47 684868 1 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:4/376: dwrite dc/d4a/d69/f51 [0,4194304] 0 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:5/483: mknod db/d24/c95 0 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:8/448: rename d4/d7/fc to d4/d7/de/f95 0 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:8/449: chown d4/d7/de 200291 1 2024-05-09T00:07:32.517 INFO:tasks.workunit.client.1.smithi135.stdout:8/450: read - d4/d7/d33/d39/f84 zero size 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:1/448: mknod da/d24/d27/d33/ca2 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:0/461: dwrite d3/f31 [0,4194304] 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:9/354: creat d1/d1a/d10/d3c/d5c/f6b x:0 0 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:2/436: getdents d1/d12/d20/d2b/d56/d86 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:4/377: mkdir dc/d71/d86 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:5/484: mkdir db/d96 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:5/485: fsync db/d24/f72 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:6/446: rename d2/da/c21 to d2/d20/d37/d4e/d7c/c95 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:6/447: chown d2/d1a/d7a 14851 1 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:1/449: getdents da/db 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:1/450: write da/d24/d27/d33/d52/d71/d8d/f9d [208458,106432] 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:8/451: dread d4/f20 [4194304,4194304] 0 2024-05-09T00:07:32.518 INFO:tasks.workunit.client.1.smithi135.stdout:8/452: chown d4/d22/f72 11644 1 2024-05-09T00:07:32.519 INFO:tasks.workunit.client.1.smithi135.stdout:0/462: unlink d3/l9 0 2024-05-09T00:07:32.519 INFO:tasks.workunit.client.1.smithi135.stdout:9/355: mkdir d1/d1a/d10/d3c/d5c/d6c 0 2024-05-09T00:07:32.519 INFO:tasks.workunit.client.1.smithi135.stdout:4/378: truncate dc/d26/d31/f3c 755566 0 2024-05-09T00:07:32.519 INFO:tasks.workunit.client.1.smithi135.stdout:4/379: fdatasync dc/dd/f1d 0 2024-05-09T00:07:32.520 INFO:tasks.workunit.client.1.smithi135.stdout:4/380: chown dc/d4a/d69/d55/d5f/f59 45 1 2024-05-09T00:07:32.520 INFO:tasks.workunit.client.1.smithi135.stdout:5/486: getdents db/d5d/d7e 0 2024-05-09T00:07:32.520 INFO:tasks.workunit.client.1.smithi135.stdout:3/463: rename d8/d13/d51/d92/f95 to d8/d13/d75/d58/fa6 0 2024-05-09T00:07:32.520 INFO:tasks.workunit.client.1.smithi135.stdout:6/448: creat d2/f96 x:0 0 0 2024-05-09T00:07:32.520 INFO:tasks.workunit.client.1.smithi135.stdout:6/449: chown d2/d20/d3f 58793097 1 2024-05-09T00:07:32.522 INFO:tasks.workunit.client.1.smithi135.stdout:1/451: mknod da/db/ca3 0 2024-05-09T00:07:32.523 INFO:tasks.workunit.client.1.smithi135.stdout:8/453: mkdir d4/d7/d2a/d96 0 2024-05-09T00:07:32.524 INFO:tasks.workunit.client.1.smithi135.stdout:8/454: fdatasync d4/d7/f74 0 2024-05-09T00:07:32.524 INFO:tasks.workunit.client.1.smithi135.stdout:8/455: stat d4/d22/f51 0 2024-05-09T00:07:32.528 INFO:tasks.workunit.client.1.smithi135.stdout:9/356: chown d1/d1a/d2c/d2d/l4a 1530 1 2024-05-09T00:07:32.528 INFO:tasks.workunit.client.1.smithi135.stdout:9/357: fdatasync d1/d1a/d10/d3c/f4b 0 2024-05-09T00:07:32.529 INFO:tasks.workunit.client.1.smithi135.stdout:4/381: mknod dc/d26/d4e/c87 0 2024-05-09T00:07:32.532 INFO:tasks.workunit.client.1.smithi135.stdout:2/437: rename d1/f1f to d1/d12/d20/d3b/f91 0 2024-05-09T00:07:32.533 INFO:tasks.workunit.client.1.smithi135.stdout:2/438: write d1/d12/d20/d2b/f90 [4120347,74236] 0 2024-05-09T00:07:32.534 INFO:tasks.workunit.client.1.smithi135.stdout:1/452: symlink da/d24/d27/d33/d52/d71/d8d/la4 0 2024-05-09T00:07:32.535 INFO:tasks.workunit.client.1.smithi135.stdout:3/464: dwrite d8/d13/d1f/f4e [0,4194304] 0 2024-05-09T00:07:32.535 INFO:tasks.workunit.client.1.smithi135.stdout:3/465: readlink d8/d6d/d44/d4b/d69/l5e 0 2024-05-09T00:07:32.539 INFO:tasks.workunit.client.1.smithi135.stdout:4/382: link dc/d26/d31/c78 dc/d26/d31/d82/c88 0 2024-05-09T00:07:32.541 INFO:tasks.workunit.client.1.smithi135.stdout:5/487: rename db/c8d to db/d84/d62/c97 0 2024-05-09T00:07:32.541 INFO:tasks.workunit.client.1.smithi135.stdout:6/450: dwrite d2/d1a/f1b [0,4194304] 0 2024-05-09T00:07:32.542 INFO:tasks.workunit.client.1.smithi135.stdout:5/488: write db/d84/f4b [3877665,33254] 0 2024-05-09T00:07:32.543 INFO:tasks.workunit.client.1.smithi135.stdout:5/489: write db/f1a [4666356,65010] 0 2024-05-09T00:07:32.543 INFO:tasks.workunit.client.1.smithi135.stdout:2/439: creat d1/d12/d21/d41/d6d/f92 x:0 0 0 2024-05-09T00:07:32.543 INFO:tasks.workunit.client.1.smithi135.stdout:0/463: symlink d3/dd/d3f/d3a/l81 0 2024-05-09T00:07:32.548 INFO:tasks.workunit.client.1.smithi135.stdout:3/466: symlink d8/d13/d75/la7 0 2024-05-09T00:07:32.551 INFO:tasks.workunit.client.1.smithi135.stdout:8/456: rename d4/f2e to d4/d7/de/d45/d76/f97 0 2024-05-09T00:07:32.552 INFO:tasks.workunit.client.1.smithi135.stdout:8/457: dread d4/d7/f2f [0,4194304] 0 2024-05-09T00:07:32.552 INFO:tasks.workunit.client.1.smithi135.stdout:6/451: creat d2/da/d1d/d69/d78/f97 x:0 0 0 2024-05-09T00:07:32.554 INFO:tasks.workunit.client.1.smithi135.stdout:5/490: truncate db/d84/d31/d5e/f55 455758 0 2024-05-09T00:07:32.555 INFO:tasks.workunit.client.1.smithi135.stdout:5/491: chown db/d3f/f5c 6658 1 2024-05-09T00:07:32.556 INFO:tasks.workunit.client.1.smithi135.stdout:0/464: unlink d3/dd/l35 0 2024-05-09T00:07:32.556 INFO:tasks.workunit.client.1.smithi135.stdout:0/465: fdatasync d3/dd/d2d/f6a 0 2024-05-09T00:07:32.558 INFO:tasks.workunit.client.1.smithi135.stdout:3/467: link d8/d13/d75/d53/f67 d8/fa8 0 2024-05-09T00:07:32.558 INFO:tasks.workunit.client.1.smithi135.stdout:3/468: readlink d8/d13/d1f/d40/d52/l9a 0 2024-05-09T00:07:32.559 INFO:tasks.workunit.client.1.smithi135.stdout:3/469: read d8/f12 [212722,21893] 0 2024-05-09T00:07:32.559 INFO:tasks.workunit.client.1.smithi135.stdout:3/470: chown d8/d6d/d44/d4b/l61 828655 1 2024-05-09T00:07:32.559 INFO:tasks.workunit.client.1.smithi135.stdout:9/358: rmdir d1 39 2024-05-09T00:07:32.561 INFO:tasks.workunit.client.1.smithi135.stdout:2/440: dwrite d1/d12/d20/d3b/d40/f8b [0,4194304] 0 2024-05-09T00:07:32.562 INFO:tasks.workunit.client.1.smithi135.stdout:2/441: write d1/d12/d20/d2b/d56/d86/f88 [4580369,17138] 0 2024-05-09T00:07:32.564 INFO:tasks.workunit.client.1.smithi135.stdout:5/492: creat db/d24/f98 x:0 0 0 2024-05-09T00:07:32.564 INFO:tasks.workunit.client.1.smithi135.stdout:5/493: dread - db/d5d/d7e/f85 zero size 2024-05-09T00:07:32.564 INFO:tasks.workunit.client.1.smithi135.stdout:5/494: chown db/d24/d32/d5b/d91/f7c 11735314 1 2024-05-09T00:07:32.565 INFO:tasks.workunit.client.1.smithi135.stdout:0/466: mknod d3/dd/d3f/d58/c82 0 2024-05-09T00:07:32.566 INFO:tasks.workunit.client.1.smithi135.stdout:3/471: creat d8/d13/d1f/d62/fa9 x:0 0 0 2024-05-09T00:07:32.566 INFO:tasks.workunit.client.1.smithi135.stdout:4/383: dwrite dc/d4a/d69/d55/d5f/f20 [4194304,4194304] 0 2024-05-09T00:07:32.568 INFO:tasks.workunit.client.1.smithi135.stdout:1/453: rename da/c37 to da/db/ca5 0 2024-05-09T00:07:32.568 INFO:tasks.workunit.client.1.smithi135.stdout:1/454: fdatasync da/f1f 0 2024-05-09T00:07:32.569 INFO:tasks.workunit.client.1.smithi135.stdout:6/452: mknod d2/da/d1d/c98 0 2024-05-09T00:07:32.569 INFO:tasks.workunit.client.1.smithi135.stdout:7/490: sync 2024-05-09T00:07:32.575 INFO:tasks.workunit.client.1.smithi135.stdout:8/458: dwrite d4/d22/f8c [0,4194304] 0 2024-05-09T00:07:32.575 INFO:tasks.workunit.client.1.smithi135.stdout:8/459: stat d4/l90 0 2024-05-09T00:07:32.575 INFO:tasks.workunit.client.1.smithi135.stdout:5/495: getdents db/d24/d32 0 2024-05-09T00:07:32.575 INFO:tasks.workunit.client.1.smithi135.stdout:2/442: creat d1/d22/d63/f93 x:0 0 0 2024-05-09T00:07:32.576 INFO:tasks.workunit.client.1.smithi135.stdout:5/496: write db/d24/f34 [115004,91210] 0 2024-05-09T00:07:32.577 INFO:tasks.workunit.client.1.smithi135.stdout:4/384: creat dc/d26/d31/d82/f89 x:0 0 0 2024-05-09T00:07:32.577 INFO:tasks.workunit.client.1.smithi135.stdout:4/385: chown dc/d4a/d69/d55/d5f 0 1 2024-05-09T00:07:32.579 INFO:tasks.workunit.client.1.smithi135.stdout:9/359: getdents d1 0 2024-05-09T00:07:32.581 INFO:tasks.workunit.client.1.smithi135.stdout:3/472: rename d8/d6d/d44/d4b/d59/d90/d7b/d85 to d8/d6d/d44/d4b/da0/daa 0 2024-05-09T00:07:32.581 INFO:tasks.workunit.client.1.smithi135.stdout:3/473: fsync d8/d13/d1f/fa4 0 2024-05-09T00:07:32.581 INFO:tasks.workunit.client.1.smithi135.stdout:3/474: chown d8/d6d/d44 113098355 1 2024-05-09T00:07:32.582 INFO:tasks.workunit.client.1.smithi135.stdout:5/497: read db/f1a [3572424,85722] 0 2024-05-09T00:07:32.583 INFO:tasks.workunit.client.1.smithi135.stdout:6/453: symlink d2/da/d49/l99 0 2024-05-09T00:07:32.584 INFO:tasks.workunit.client.1.smithi135.stdout:6/454: write d2/f58 [7307433,41958] 0 2024-05-09T00:07:32.585 INFO:tasks.workunit.client.1.smithi135.stdout:7/491: dwrite db/dd/d33/f61 [0,4194304] 0 2024-05-09T00:07:32.589 INFO:tasks.workunit.client.1.smithi135.stdout:0/467: getdents d3/dd/d3f/d43 0 2024-05-09T00:07:32.589 INFO:tasks.workunit.client.1.smithi135.stdout:2/443: mkdir d1/d12/d20/d2b/d94 0 2024-05-09T00:07:32.589 INFO:tasks.workunit.client.1.smithi135.stdout:2/444: chown d1/d12/d20/d2b/d56/d86/f88 7251 1 2024-05-09T00:07:32.592 INFO:tasks.workunit.client.1.smithi135.stdout:9/360: creat d1/d1a/d2c/f6d x:0 0 0 2024-05-09T00:07:32.595 INFO:tasks.workunit.client.1.smithi135.stdout:8/460: rename d4/d7/de/d45/c5c to d4/d7/d2a/d67/c98 0 2024-05-09T00:07:32.595 INFO:tasks.workunit.client.1.smithi135.stdout:8/461: chown d4/d7/f8f 8681 1 2024-05-09T00:07:32.597 INFO:tasks.workunit.client.1.smithi135.stdout:3/475: truncate d8/d13/d1f/f3f 1794426 0 2024-05-09T00:07:32.601 INFO:tasks.workunit.client.1.smithi135.stdout:3/476: dread d8/d6d/d44/d4b/da0/daa/d88/f93 [0,4194304] 0 2024-05-09T00:07:32.601 INFO:tasks.workunit.client.1.smithi135.stdout:4/386: dwrite dc/d4a/f58 [0,4194304] 0 2024-05-09T00:07:32.601 INFO:tasks.workunit.client.1.smithi135.stdout:4/387: chown dc/dd/l72 3 1 2024-05-09T00:07:32.601 INFO:tasks.workunit.client.1.smithi135.stdout:3/477: fdatasync d8/d6d/d44/d4b/da0/daa/f8e 0 2024-05-09T00:07:32.601 INFO:tasks.workunit.client.1.smithi135.stdout:3/478: dread - d8/d13/d1f/f43 zero size 2024-05-09T00:07:32.602 INFO:tasks.workunit.client.1.smithi135.stdout:0/468: mknod d3/dd/c83 0 2024-05-09T00:07:32.603 INFO:tasks.workunit.client.1.smithi135.stdout:2/445: creat d1/d12/d21/d57/f95 x:0 0 0 2024-05-09T00:07:32.603 INFO:tasks.workunit.client.1.smithi135.stdout:9/361: getdents d1/d24/d44/d54 0 2024-05-09T00:07:32.604 INFO:tasks.workunit.client.1.smithi135.stdout:1/455: dwrite da/db/f34 [0,4194304] 0 2024-05-09T00:07:32.605 INFO:tasks.workunit.client.1.smithi135.stdout:1/456: dread - da/d24/d27/f6e zero size 2024-05-09T00:07:32.606 INFO:tasks.workunit.client.1.smithi135.stdout:5/498: rename db/d84/d31/d6e/f74 to db/d84/d62/f99 0 2024-05-09T00:07:32.607 INFO:tasks.workunit.client.1.smithi135.stdout:8/462: creat d4/d7/de/d45/d76/f99 x:0 0 0 2024-05-09T00:07:32.607 INFO:tasks.workunit.client.1.smithi135.stdout:8/463: chown d4/d7/d33/d39/c60 14905375 1 2024-05-09T00:07:32.607 INFO:tasks.workunit.client.1.smithi135.stdout:8/464: chown d4/d7/d2a/d56/f61 14 1 2024-05-09T00:07:32.615 INFO:tasks.workunit.client.1.smithi135.stdout:7/492: dwrite db/dd/f14 [0,4194304] 0 2024-05-09T00:07:32.615 INFO:tasks.workunit.client.1.smithi135.stdout:0/469: mkdir d3/dd/d2d/d4c/d84 0 2024-05-09T00:07:32.621 INFO:tasks.workunit.client.1.smithi135.stdout:2/446: creat d1/d12/d20/f96 x:0 0 0 2024-05-09T00:07:32.621 INFO:tasks.workunit.client.1.smithi135.stdout:2/447: chown d1/d22/d63/f93 100 1 2024-05-09T00:07:32.624 INFO:tasks.workunit.client.1.smithi135.stdout:5/499: dread db/d84/d31/d5e/f69 [4194304,4194304] 0 2024-05-09T00:07:32.625 INFO:tasks.workunit.client.1.smithi135.stdout:8/465: rmdir d4/d7/de/d45 39 2024-05-09T00:07:32.626 INFO:tasks.workunit.client.1.smithi135.stdout:2/448: write d1/d12/d20/d3b/d40/f8b [903615,123477] 0 2024-05-09T00:07:32.627 INFO:tasks.workunit.client.1.smithi135.stdout:4/388: dwrite dc/f2d [0,4194304] 0 2024-05-09T00:07:32.631 INFO:tasks.workunit.client.1.smithi135.stdout:5/500: creat db/d96/f9a x:0 0 0 2024-05-09T00:07:32.631 INFO:tasks.workunit.client.1.smithi135.stdout:4/389: dread dc/d26/d31/f3c [0,4194304] 0 2024-05-09T00:07:32.632 INFO:tasks.workunit.client.1.smithi135.stdout:0/470: write d3/dd/d3f/f41 [204330,117658] 0 2024-05-09T00:07:32.632 INFO:tasks.workunit.client.1.smithi135.stdout:1/457: rename da/d24/d27/d33/ca2 to da/db/d16/ca6 0 2024-05-09T00:07:32.632 INFO:tasks.workunit.client.1.smithi135.stdout:1/458: chown da/d14/d20 13 1 2024-05-09T00:07:32.634 INFO:tasks.workunit.client.1.smithi135.stdout:8/466: rename d4/d7/de/l19 to d4/d7/de/l9a 0 2024-05-09T00:07:32.639 INFO:tasks.workunit.client.1.smithi135.stdout:2/449: getdents d1/d12/d21/d41/d6d 0 2024-05-09T00:07:32.640 INFO:tasks.workunit.client.1.smithi135.stdout:8/467: symlink d4/d7/d2a/d96/l9b 0 2024-05-09T00:07:32.640 INFO:tasks.workunit.client.1.smithi135.stdout:7/493: dwrite db/dd/d33/f61 [0,4194304] 0 2024-05-09T00:07:32.640 INFO:tasks.workunit.client.1.smithi135.stdout:7/494: readlink db/la2 0 2024-05-09T00:07:32.640 INFO:tasks.workunit.client.1.smithi135.stdout:7/495: chown f8 3816 1 2024-05-09T00:07:32.640 INFO:tasks.workunit.client.1.smithi135.stdout:7/496: chown db/l32 404 1 2024-05-09T00:07:32.640 INFO:tasks.workunit.client.1.smithi135.stdout:4/390: truncate dc/d4a/d69/d55/d5f/f20 714811 0 2024-05-09T00:07:32.641 INFO:tasks.workunit.client.1.smithi135.stdout:4/391: dread - dc/dd/f80 zero size 2024-05-09T00:07:32.641 INFO:tasks.workunit.client.1.smithi135.stdout:3/479: dwrite d8/d13/d1f/f6b [0,4194304] 0 2024-05-09T00:07:32.642 INFO:tasks.workunit.client.1.smithi135.stdout:7/497: write db/d1e/d3a/f52 [3205850,104628] 0 2024-05-09T00:07:32.643 INFO:tasks.workunit.client.1.smithi135.stdout:2/450: creat d1/d22/d63/f97 x:0 0 0 2024-05-09T00:07:32.643 INFO:tasks.workunit.client.0.smithi026.stdout:2/0: sync 2024-05-09T00:07:32.643 INFO:tasks.workunit.client.0.smithi026.stdout:2/1: dwrite - no filename 2024-05-09T00:07:32.645 INFO:tasks.workunit.client.1.smithi135.stdout:8/468: mkdir d4/d7/d4a/d9c 0 2024-05-09T00:07:32.646 INFO:tasks.workunit.client.0.smithi026.stdout:2/2: symlink l0 0 2024-05-09T00:07:32.647 INFO:tasks.workunit.client.1.smithi135.stdout:0/471: dread d3/dd/d3f/d29/f2e [0,4194304] 0 2024-05-09T00:07:32.649 INFO:tasks.workunit.client.1.smithi135.stdout:0/472: read d3/dd/d3f/d3a/f48 [6259397,3544] 0 2024-05-09T00:07:32.651 INFO:tasks.workunit.client.1.smithi135.stdout:3/480: creat d8/d6d/d44/d4b/da0/fab x:0 0 0 2024-05-09T00:07:32.651 INFO:tasks.workunit.client.1.smithi135.stdout:3/481: fsync d8/f26 0 2024-05-09T00:07:32.651 INFO:tasks.workunit.client.1.smithi135.stdout:0/473: write d3/dd/f1b [6690780,106404] 0 2024-05-09T00:07:32.714 INFO:tasks.workunit.client.1.smithi135.stdout:3/482: rename d8/d13/d1f/f3f to d8/d13/d75/fac 0 2024-05-09T00:07:32.714 INFO:tasks.workunit.client.1.smithi135.stdout:3/483: chown d8/d6d/d44/d4b/d69/f4d 6 1 2024-05-09T00:07:32.714 INFO:tasks.workunit.client.1.smithi135.stdout:9/362: dwrite d1/d1a/d2c/d2d/f3b [0,4194304] 0 2024-05-09T00:07:32.716 INFO:tasks.workunit.client.1.smithi135.stdout:0/474: symlink d3/d64/l85 0 2024-05-09T00:07:32.719 INFO:tasks.workunit.client.1.smithi135.stdout:1/459: dwrite da/d14/d20/d2c/f99 [0,4194304] 0 2024-05-09T00:07:32.722 INFO:tasks.workunit.client.1.smithi135.stdout:2/451: dwrite d1/d12/d21/d57/f6c [0,4194304] 0 2024-05-09T00:07:32.722 INFO:tasks.workunit.client.1.smithi135.stdout:7/498: dwrite db/d13/f57 [0,4194304] 0 2024-05-09T00:07:32.722 INFO:tasks.workunit.client.1.smithi135.stdout:7/499: write db/d21/f8b [719007,35567] 0 2024-05-09T00:07:32.722 INFO:tasks.workunit.client.1.smithi135.stdout:8/469: dwrite d4/d7/de/f35 [0,4194304] 0 2024-05-09T00:07:32.722 INFO:tasks.workunit.client.1.smithi135.stdout:7/500: chown db/l1d 15610264 1 2024-05-09T00:07:32.722 INFO:tasks.workunit.client.1.smithi135.stdout:3/484: link d8/d6d/d44/d4b/d69/f4a d8/d13/d1f/fad 0 2024-05-09T00:07:32.724 INFO:tasks.workunit.client.1.smithi135.stdout:4/392: dwrite dc/d4a/d69/f5c [0,4194304] 0 2024-05-09T00:07:32.727 INFO:tasks.workunit.client.1.smithi135.stdout:4/393: write dc/dd/f11 [1977173,128108] 0 2024-05-09T00:07:32.728 INFO:tasks.workunit.client.1.smithi135.stdout:1/460: rmdir da/d24/d27/d33 39 2024-05-09T00:07:32.738 INFO:tasks.workunit.client.1.smithi135.stdout:4/394: dread dc/d4a/d69/f51 [0,4194304] 0 2024-05-09T00:07:32.738 INFO:tasks.workunit.client.1.smithi135.stdout:9/363: dwrite d1/d1a/d2c/f11 [0,4194304] 0 2024-05-09T00:07:32.738 INFO:tasks.workunit.client.1.smithi135.stdout:7/501: mkdir db/dd/d33/da5 0 2024-05-09T00:07:32.739 INFO:tasks.workunit.client.1.smithi135.stdout:8/470: mknod d4/d7/d33/d39/c9d 0 2024-05-09T00:07:32.739 INFO:tasks.workunit.client.1.smithi135.stdout:8/471: write d4/f94 [843009,38106] 0 2024-05-09T00:07:32.744 INFO:tasks.workunit.client.1.smithi135.stdout:0/475: dwrite d3/dd/f4e [0,4194304] 0 2024-05-09T00:07:32.745 INFO:tasks.workunit.client.1.smithi135.stdout:6/455: sync 2024-05-09T00:07:32.746 INFO:tasks.workunit.client.1.smithi135.stdout:4/395: dread dc/d26/d4e/f56 [0,4194304] 0 2024-05-09T00:07:32.746 INFO:tasks.workunit.client.1.smithi135.stdout:4/396: write dc/d26/d31/f6f [305772,62188] 0 2024-05-09T00:07:32.746 INFO:tasks.workunit.client.1.smithi135.stdout:4/397: getdents dc/d4a/d69/d55/d5f/d5a 0 2024-05-09T00:07:32.746 INFO:tasks.workunit.client.1.smithi135.stdout:4/398: fdatasync dc/d4a/d69/f4c 0 2024-05-09T00:07:32.746 INFO:tasks.workunit.client.1.smithi135.stdout:2/452: dwrite d1/d12/d20/d2b/d56/f76 [0,4194304] 0 2024-05-09T00:07:32.747 INFO:tasks.workunit.client.1.smithi135.stdout:1/461: dwrite da/d14/d5c/f6b [0,4194304] 0 2024-05-09T00:07:32.748 INFO:tasks.workunit.client.1.smithi135.stdout:9/364: mkdir d1/d24/d44/d54/d66/d6e 0 2024-05-09T00:07:32.748 INFO:tasks.workunit.client.1.smithi135.stdout:1/462: dread da/d73/f81 [0,4194304] 0 2024-05-09T00:07:32.750 INFO:tasks.workunit.client.1.smithi135.stdout:7/502: creat db/d1e/d3a/d40/d4c/fa6 x:0 0 0 2024-05-09T00:07:32.751 INFO:tasks.workunit.client.1.smithi135.stdout:8/472: creat d4/d7/d2a/d96/f9e x:0 0 0 2024-05-09T00:07:32.755 INFO:tasks.workunit.client.1.smithi135.stdout:0/476: rename d3/dd/d2d/l6f to d3/dd/l86 0 2024-05-09T00:07:32.755 INFO:tasks.workunit.client.1.smithi135.stdout:0/477: readlink d3/d64/l85 0 2024-05-09T00:07:32.755 INFO:tasks.workunit.client.1.smithi135.stdout:0/478: stat d3/dd/f7b 0 2024-05-09T00:07:32.758 INFO:tasks.workunit.client.1.smithi135.stdout:2/453: dread d1/d12/d21/d41/d6d/d6e/f75 [0,4194304] 0 2024-05-09T00:07:32.759 INFO:tasks.workunit.client.1.smithi135.stdout:5/501: sync 2024-05-09T00:07:32.760 INFO:tasks.workunit.client.1.smithi135.stdout:4/399: dwrite dc/d4a/d69/d55/d5f/f20 [0,4194304] 0 2024-05-09T00:07:32.760 INFO:tasks.workunit.client.1.smithi135.stdout:9/365: symlink d1/d24/d44/d54/l6f 0 2024-05-09T00:07:32.762 INFO:tasks.workunit.client.1.smithi135.stdout:1/463: mknod da/d24/d27/d33/d48/d6f/ca7 0 2024-05-09T00:07:32.762 INFO:tasks.workunit.client.1.smithi135.stdout:8/473: mkdir d4/d7/d2a/d9f 0 2024-05-09T00:07:32.769 INFO:tasks.workunit.client.1.smithi135.stdout:2/454: dread d1/d12/d20/d2b/f37 [0,4194304] 0 2024-05-09T00:07:32.769 INFO:tasks.workunit.client.1.smithi135.stdout:2/455: write d1/d12/f8d [908390,94854] 0 2024-05-09T00:07:32.771 INFO:tasks.workunit.client.1.smithi135.stdout:7/503: rename db/d1e/c6c to db/d1e/d63/ca7 0 2024-05-09T00:07:32.771 INFO:tasks.workunit.client.1.smithi135.stdout:0/479: creat d3/dd/d3f/d29/d54/f87 x:0 0 0 2024-05-09T00:07:32.772 INFO:tasks.workunit.client.1.smithi135.stdout:6/456: link d2/da/d26/l34 d2/d20/d3f/l9a 0 2024-05-09T00:07:32.772 INFO:tasks.workunit.client.1.smithi135.stdout:8/474: truncate d4/d7/d4a/f65 4098469 0 2024-05-09T00:07:32.772 INFO:tasks.workunit.client.1.smithi135.stdout:6/457: write d2/f76 [565258,46634] 0 2024-05-09T00:07:32.773 INFO:tasks.workunit.client.1.smithi135.stdout:6/458: readlink d2/l71 0 2024-05-09T00:07:32.773 INFO:tasks.workunit.client.1.smithi135.stdout:6/459: fsync d2/da/d26/d57/d60/f72 0 2024-05-09T00:07:32.775 INFO:tasks.workunit.client.1.smithi135.stdout:2/456: rename d1/d12/d20/f96 to d1/d12/d20/d3b/d4f/f98 0 2024-05-09T00:07:32.775 INFO:tasks.workunit.client.1.smithi135.stdout:6/460: write d2/da/d26/f3c [479097,119294] 0 2024-05-09T00:07:32.776 INFO:tasks.workunit.client.1.smithi135.stdout:4/400: mknod dc/d4a/d69/d39/c8a 0 2024-05-09T00:07:32.779 INFO:tasks.workunit.client.1.smithi135.stdout:2/457: truncate d1/d22/f43 785615 0 2024-05-09T00:07:32.779 INFO:tasks.workunit.client.1.smithi135.stdout:2/458: fsync d1/d12/d21/f38 0 2024-05-09T00:07:32.779 INFO:tasks.workunit.client.1.smithi135.stdout:6/461: creat d2/da/d1d/d69/d89/f9b x:0 0 0 2024-05-09T00:07:32.781 INFO:tasks.workunit.client.1.smithi135.stdout:4/401: symlink dc/d4a/d69/d45/l8b 0 2024-05-09T00:07:32.781 INFO:tasks.workunit.client.1.smithi135.stdout:4/402: write dc/d4a/f50 [1722443,91367] 0 2024-05-09T00:07:32.782 INFO:tasks.workunit.client.1.smithi135.stdout:2/459: creat d1/d12/d20/f99 x:0 0 0 2024-05-09T00:07:32.783 INFO:tasks.workunit.client.1.smithi135.stdout:8/475: dread d4/d7/d33/d39/f48 [0,4194304] 0 2024-05-09T00:07:32.783 INFO:tasks.workunit.client.1.smithi135.stdout:6/462: rmdir d2/da/d49/d91 0 2024-05-09T00:07:32.785 INFO:tasks.workunit.client.1.smithi135.stdout:2/460: truncate d1/d12/d27/f62 2716836 0 2024-05-09T00:07:32.785 INFO:tasks.workunit.client.1.smithi135.stdout:2/461: truncate d1/d12/d21/d57/f95 358106 0 2024-05-09T00:07:32.786 INFO:tasks.workunit.client.1.smithi135.stdout:8/476: mknod d4/d7/d4a/d9c/ca0 0 2024-05-09T00:07:32.786 INFO:tasks.workunit.client.1.smithi135.stdout:7/504: dread db/dd/d33/d69/f86 [0,4194304] 0 2024-05-09T00:07:32.787 INFO:tasks.workunit.client.1.smithi135.stdout:7/505: chown db/dd/d33/f9d 1982672 1 2024-05-09T00:07:32.787 INFO:tasks.workunit.client.1.smithi135.stdout:7/506: dread - db/dd/f65 zero size 2024-05-09T00:07:32.787 INFO:tasks.workunit.client.1.smithi135.stdout:7/507: fsync db/d1e/d63/f7b 0 2024-05-09T00:07:32.787 INFO:tasks.workunit.client.1.smithi135.stdout:7/508: write db/d13/f73 [522977,108726] 0 2024-05-09T00:07:32.787 INFO:tasks.workunit.client.1.smithi135.stdout:6/463: creat d2/da/d1d/d69/f9c x:0 0 0 2024-05-09T00:07:32.788 INFO:tasks.workunit.client.1.smithi135.stdout:8/477: rmdir d4/d7/de/d45 39 2024-05-09T00:07:32.789 INFO:tasks.workunit.client.1.smithi135.stdout:6/464: write d2/d1a/f1b [2943823,164] 0 2024-05-09T00:07:32.789 INFO:tasks.workunit.client.1.smithi135.stdout:6/465: chown f1 323 1 2024-05-09T00:07:32.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/480: dread d3/dd/f26 [0,4194304] 0 2024-05-09T00:07:32.790 INFO:tasks.workunit.client.1.smithi135.stdout:2/462: link d1/f47 d1/d12/d21/d41/d6d/d6e/f9a 0 2024-05-09T00:07:32.791 INFO:tasks.workunit.client.1.smithi135.stdout:2/463: chown d1/d12/d20/f68 0 1 2024-05-09T00:07:32.792 INFO:tasks.workunit.client.1.smithi135.stdout:8/478: truncate d4/d22/f8c 3796073 0 2024-05-09T00:07:32.792 INFO:tasks.workunit.client.1.smithi135.stdout:8/479: stat d4/d7/d2a/d67/l77 0 2024-05-09T00:07:32.792 INFO:tasks.workunit.client.1.smithi135.stdout:8/480: chown d4/d7/de/d45/d76/f97 40604 1 2024-05-09T00:07:32.792 INFO:tasks.workunit.client.1.smithi135.stdout:5/502: dwrite db/d24/d32/d5b/f76 [0,4194304] 0 2024-05-09T00:07:32.792 INFO:tasks.workunit.client.1.smithi135.stdout:5/503: dread - db/d24/f8c zero size 2024-05-09T00:07:32.793 INFO:tasks.workunit.client.1.smithi135.stdout:9/366: dwrite d1/d1a/d2c/f6d [0,4194304] 0 2024-05-09T00:07:32.793 INFO:tasks.workunit.client.1.smithi135.stdout:9/367: stat d1/d1a/d2c/d2d/f3b 0 2024-05-09T00:07:32.793 INFO:tasks.workunit.client.1.smithi135.stdout:9/368: dread - d1/f59 zero size 2024-05-09T00:07:32.793 INFO:tasks.workunit.client.1.smithi135.stdout:0/481: mknod d3/dd/d2d/d7d/c88 0 2024-05-09T00:07:32.793 INFO:tasks.workunit.client.1.smithi135.stdout:1/464: dwrite da/d14/d5c/d83/f92 [0,4194304] 0 2024-05-09T00:07:32.793 INFO:tasks.workunit.client.1.smithi135.stdout:1/465: chown da/d24/d27/d33/d52/d71/d8d 9046476 1 2024-05-09T00:07:32.795 INFO:tasks.workunit.client.1.smithi135.stdout:8/481: creat d4/d7/d4a/fa1 x:0 0 0 2024-05-09T00:07:32.795 INFO:tasks.workunit.client.1.smithi135.stdout:8/482: fsync d4/d22/f72 0 2024-05-09T00:07:32.795 INFO:tasks.workunit.client.1.smithi135.stdout:8/483: chown d4/l63 408 1 2024-05-09T00:07:32.795 INFO:tasks.workunit.client.1.smithi135.stdout:8/484: fdatasync d4/d7/de/f14 0 2024-05-09T00:07:32.796 INFO:tasks.workunit.client.1.smithi135.stdout:5/504: creat db/d96/f9b x:0 0 0 2024-05-09T00:07:32.796 INFO:tasks.workunit.client.1.smithi135.stdout:5/505: dread - db/d24/f72 zero size 2024-05-09T00:07:32.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/466: dread d2/f76 [0,4194304] 0 2024-05-09T00:07:32.796 INFO:tasks.workunit.client.1.smithi135.stdout:5/506: chown db/d3f/c75 112712638 1 2024-05-09T00:07:32.802 INFO:tasks.workunit.client.1.smithi135.stdout:2/464: symlink d1/l9b 0 2024-05-09T00:07:32.803 INFO:tasks.workunit.client.1.smithi135.stdout:9/369: dread d1/d24/d44/d54/f69 [0,4194304] 0 2024-05-09T00:07:32.803 INFO:tasks.workunit.client.1.smithi135.stdout:9/370: fdatasync d1/d1a/d10/d3c/d5c/f63 0 2024-05-09T00:07:32.803 INFO:tasks.workunit.client.1.smithi135.stdout:9/371: dread - d1/d1a/d2c/f5d zero size 2024-05-09T00:07:32.804 INFO:tasks.workunit.client.1.smithi135.stdout:8/485: mkdir d4/d8/da2 0 2024-05-09T00:07:32.806 INFO:tasks.workunit.client.1.smithi135.stdout:5/507: mkdir db/d84/d62/d73/d9c 0 2024-05-09T00:07:32.806 INFO:tasks.workunit.client.1.smithi135.stdout:0/482: dread d3/f3b [0,4194304] 0 2024-05-09T00:07:32.806 INFO:tasks.workunit.client.1.smithi135.stdout:0/483: chown d3/f4f 3656696 1 2024-05-09T00:07:32.807 INFO:tasks.workunit.client.1.smithi135.stdout:1/466: symlink da/db/d70/la8 0 2024-05-09T00:07:32.807 INFO:tasks.workunit.client.1.smithi135.stdout:3/485: sync 2024-05-09T00:07:32.810 INFO:tasks.workunit.client.1.smithi135.stdout:2/465: link d1/d12/d21/l6b d1/d12/d21/d41/d6d/l9c 0 2024-05-09T00:07:32.812 INFO:tasks.workunit.client.1.smithi135.stdout:9/372: mknod d1/d1a/d2c/c70 0 2024-05-09T00:07:32.813 INFO:tasks.workunit.client.1.smithi135.stdout:9/373: write d1/f13 [1950906,56564] 0 2024-05-09T00:07:32.813 INFO:tasks.workunit.client.1.smithi135.stdout:9/374: chown d1/d1a/f42 27749 1 2024-05-09T00:07:32.814 INFO:tasks.workunit.client.1.smithi135.stdout:5/508: mknod db/d24/c9d 0 2024-05-09T00:07:32.815 INFO:tasks.workunit.client.1.smithi135.stdout:0/484: creat d3/dd/f89 x:0 0 0 2024-05-09T00:07:32.815 INFO:tasks.workunit.client.1.smithi135.stdout:0/485: fsync d3/dd/d3f/d3a/d46/f38 0 2024-05-09T00:07:32.816 INFO:tasks.workunit.client.1.smithi135.stdout:1/467: truncate da/f63 3635339 0 2024-05-09T00:07:32.818 INFO:tasks.workunit.client.1.smithi135.stdout:2/466: symlink d1/d12/d20/d2b/d56/d86/l9d 0 2024-05-09T00:07:32.820 INFO:tasks.workunit.client.1.smithi135.stdout:9/375: dread d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:32.820 INFO:tasks.workunit.client.1.smithi135.stdout:3/486: dwrite d8/d6d/fa1 [0,4194304] 0 2024-05-09T00:07:32.820 INFO:tasks.workunit.client.1.smithi135.stdout:3/487: dread - d8/d6d/d44/d4b/da0/fab zero size 2024-05-09T00:07:32.822 INFO:tasks.workunit.client.1.smithi135.stdout:4/403: rename dc/d4a/d69/d45 to dc/d4a/d8c 0 2024-05-09T00:07:32.823 INFO:tasks.workunit.client.1.smithi135.stdout:5/509: symlink db/d96/l9e 0 2024-05-09T00:07:32.823 INFO:tasks.workunit.client.1.smithi135.stdout:5/510: write db/d3f/f57 [424026,47333] 0 2024-05-09T00:07:32.824 INFO:tasks.workunit.client.1.smithi135.stdout:0/486: symlink d3/dd/d2d/d4c/l8a 0 2024-05-09T00:07:32.826 INFO:tasks.workunit.client.1.smithi135.stdout:1/468: symlink da/d14/d20/d38/d3a/d40/d96/la9 0 2024-05-09T00:07:32.826 INFO:tasks.workunit.client.1.smithi135.stdout:1/469: truncate da/d24/d27/d33/d52/d71/d8d/f9d 1266555 0 2024-05-09T00:07:32.829 INFO:tasks.workunit.client.1.smithi135.stdout:9/376: creat d1/d24/d44/d54/d66/f71 x:0 0 0 2024-05-09T00:07:32.832 INFO:tasks.workunit.client.1.smithi135.stdout:3/488: truncate d8/fe 2055484 0 2024-05-09T00:07:32.835 INFO:tasks.workunit.client.1.smithi135.stdout:7/509: rename db/dd/d33/d69 to db/da8 0 2024-05-09T00:07:32.836 INFO:tasks.workunit.client.1.smithi135.stdout:4/404: mknod dc/dd/c8d 0 2024-05-09T00:07:32.838 INFO:tasks.workunit.client.1.smithi135.stdout:0/487: unlink d3/dd/f89 0 2024-05-09T00:07:32.840 INFO:tasks.workunit.client.1.smithi135.stdout:1/470: creat da/d24/d27/d33/d52/d71/faa x:0 0 0 2024-05-09T00:07:32.841 INFO:tasks.workunit.client.1.smithi135.stdout:9/377: symlink d1/d1a/d10/d3c/l72 0 2024-05-09T00:07:32.845 INFO:tasks.workunit.client.1.smithi135.stdout:4/405: read dc/f24 [2198891,6928] 0 2024-05-09T00:07:32.845 INFO:tasks.workunit.client.1.smithi135.stdout:3/489: dread d8/d13/d1f/f6b [0,4194304] 0 2024-05-09T00:07:32.845 INFO:tasks.workunit.client.1.smithi135.stdout:3/490: chown d8/d13/f22 1154666 1 2024-05-09T00:07:32.848 INFO:tasks.workunit.client.1.smithi135.stdout:6/467: rename d2/da/d49/d92 to d2/d20/d37/d4e/d9d 0 2024-05-09T00:07:32.848 INFO:tasks.workunit.client.1.smithi135.stdout:7/510: creat db/da8/fa9 x:0 0 0 2024-05-09T00:07:32.848 INFO:tasks.workunit.client.1.smithi135.stdout:0/488: truncate d3/dd/d3f/d29/f47 157320 0 2024-05-09T00:07:32.848 INFO:tasks.workunit.client.1.smithi135.stdout:9/378: creat d1/d1a/d2c/d2d/f73 x:0 0 0 2024-05-09T00:07:32.851 INFO:tasks.workunit.client.1.smithi135.stdout:4/406: mknod dc/d4a/d69/d55/d5f/d5a/c8e 0 2024-05-09T00:07:32.851 INFO:tasks.workunit.client.1.smithi135.stdout:3/491: rmdir d8/d6d/d44/d4b 39 2024-05-09T00:07:32.853 INFO:tasks.workunit.client.1.smithi135.stdout:6/468: dread d2/d20/d37/f54 [0,4194304] 0 2024-05-09T00:07:32.855 INFO:tasks.workunit.client.1.smithi135.stdout:8/486: rename d4/d7/d33/d39/l71 to d4/d7/d2a/la3 0 2024-05-09T00:07:32.855 INFO:tasks.workunit.client.1.smithi135.stdout:1/471: dwrite da/d14/f3f [0,4194304] 0 2024-05-09T00:07:32.855 INFO:tasks.workunit.client.1.smithi135.stdout:7/511: symlink db/d1e/d3a/d40/d4c/da3/laa 0 2024-05-09T00:07:32.856 INFO:tasks.workunit.client.1.smithi135.stdout:1/472: write da/d24/d27/f28 [917989,13780] 0 2024-05-09T00:07:32.856 INFO:tasks.workunit.client.1.smithi135.stdout:4/407: symlink dc/d4a/d69/d55/d6d/l8f 0 2024-05-09T00:07:32.857 INFO:tasks.workunit.client.1.smithi135.stdout:4/408: fsync dc/d26/d31/f5d 0 2024-05-09T00:07:32.857 INFO:tasks.workunit.client.1.smithi135.stdout:3/492: getdents d8/d6d/d44/d4b/d59 0 2024-05-09T00:07:32.860 INFO:tasks.workunit.client.1.smithi135.stdout:3/493: write d8/f10 [911503,71142] 0 2024-05-09T00:07:32.860 INFO:tasks.workunit.client.1.smithi135.stdout:3/494: write d8/d13/d75/d58/f8a [168953,66034] 0 2024-05-09T00:07:32.861 INFO:tasks.workunit.client.1.smithi135.stdout:5/511: rename db/d84/d31/d6e to db/d84/d62/d73/d9c/d9f 0 2024-05-09T00:07:32.861 INFO:tasks.workunit.client.1.smithi135.stdout:2/467: getdents d1/d12/d20/d2b/d56/d86 0 2024-05-09T00:07:32.863 INFO:tasks.workunit.client.1.smithi135.stdout:8/487: mkdir d4/d7/da4 0 2024-05-09T00:07:32.864 INFO:tasks.workunit.client.1.smithi135.stdout:8/488: chown d4/d7/d2a/d56/l8d 1428 1 2024-05-09T00:07:32.866 INFO:tasks.workunit.client.1.smithi135.stdout:7/512: mknod db/d21/cab 0 2024-05-09T00:07:32.871 INFO:tasks.workunit.client.1.smithi135.stdout:1/473: creat da/d24/d27/d33/d52/d71/d8d/fab x:0 0 0 2024-05-09T00:07:32.874 INFO:tasks.workunit.client.1.smithi135.stdout:4/409: rmdir dc/d4a/d69/d39 39 2024-05-09T00:07:32.878 INFO:tasks.workunit.client.1.smithi135.stdout:6/469: dwrite d2/da/d26/f55 [4194304,4194304] 0 2024-05-09T00:07:32.882 INFO:tasks.workunit.client.1.smithi135.stdout:2/468: dwrite d1/d12/d20/d2b/d56/f76 [4194304,4194304] 0 2024-05-09T00:07:32.883 INFO:tasks.workunit.client.1.smithi135.stdout:2/469: truncate d1/d12/d27/f3c 764954 0 2024-05-09T00:07:32.888 INFO:tasks.workunit.client.1.smithi135.stdout:3/495: truncate d8/d13/d1f/f6b 3550719 0 2024-05-09T00:07:32.889 INFO:tasks.workunit.client.1.smithi135.stdout:3/496: chown d8/d13/d75/d58/f9e 2990 1 2024-05-09T00:07:32.890 INFO:tasks.workunit.client.1.smithi135.stdout:0/489: rename d3/dd/d3f/d3a/c5a to d3/dd/d3f/d58/c8b 0 2024-05-09T00:07:32.892 INFO:tasks.workunit.client.1.smithi135.stdout:7/513: unlink db/da8/l7a 0 2024-05-09T00:07:32.892 INFO:tasks.workunit.client.1.smithi135.stdout:7/514: truncate db/dd/f65 403035 0 2024-05-09T00:07:32.892 INFO:tasks.workunit.client.1.smithi135.stdout:7/515: read db/d13/f73 [405507,77192] 0 2024-05-09T00:07:32.893 INFO:tasks.workunit.client.1.smithi135.stdout:5/512: dwrite db/d96/f9b [0,4194304] 0 2024-05-09T00:07:32.893 INFO:tasks.workunit.client.1.smithi135.stdout:1/474: symlink da/d24/d27/d33/d48/d6f/d93/lac 0 2024-05-09T00:07:32.893 INFO:tasks.workunit.client.1.smithi135.stdout:1/475: dread - da/d14/d20/d38/f8e zero size 2024-05-09T00:07:32.894 INFO:tasks.workunit.client.1.smithi135.stdout:4/410: mkdir dc/d71/d90 0 2024-05-09T00:07:32.894 INFO:tasks.workunit.client.1.smithi135.stdout:4/411: readlink dc/d4a/d69/d39/l64 0 2024-05-09T00:07:32.896 INFO:tasks.workunit.client.1.smithi135.stdout:4/412: write dc/d26/d31/f3c [33671,102218] 0 2024-05-09T00:07:32.898 INFO:tasks.workunit.client.1.smithi135.stdout:6/470: symlink d2/d20/d2e/l9e 0 2024-05-09T00:07:32.898 INFO:tasks.workunit.client.1.smithi135.stdout:6/471: readlink d2/le 0 2024-05-09T00:07:32.898 INFO:tasks.workunit.client.1.smithi135.stdout:6/472: readlink d2/d1a/l45 0 2024-05-09T00:07:32.900 INFO:tasks.workunit.client.1.smithi135.stdout:3/497: creat d8/d6d/fae x:0 0 0 2024-05-09T00:07:32.900 INFO:tasks.workunit.client.1.smithi135.stdout:3/498: chown d8/d6d/f78 1056 1 2024-05-09T00:07:32.900 INFO:tasks.workunit.client.1.smithi135.stdout:3/499: read d8/d13/d1f/f30 [1998521,28912] 0 2024-05-09T00:07:32.903 INFO:tasks.workunit.client.1.smithi135.stdout:8/489: rename d4/d7/l24 to d4/d7/d2a/la5 0 2024-05-09T00:07:32.904 INFO:tasks.workunit.client.1.smithi135.stdout:0/490: fsync d3/dd/d3f/f21 0 2024-05-09T00:07:32.904 INFO:tasks.workunit.client.1.smithi135.stdout:0/491: write d3/dd/f26 [4937763,59823] 0 2024-05-09T00:07:32.904 INFO:tasks.workunit.client.1.smithi135.stdout:7/516: dwrite db/d1e/d3a/d40/d4c/fa6 [0,4194304] 0 2024-05-09T00:07:32.911 INFO:tasks.workunit.client.1.smithi135.stdout:5/513: creat db/d84/d62/d73/d9c/d9f/d92/fa0 x:0 0 0 2024-05-09T00:07:32.912 INFO:tasks.workunit.client.1.smithi135.stdout:1/476: mknod da/d24/cad 0 2024-05-09T00:07:32.914 INFO:tasks.workunit.client.1.smithi135.stdout:6/473: creat d2/d1a/f9f x:0 0 0 2024-05-09T00:07:32.915 INFO:tasks.workunit.client.1.smithi135.stdout:3/500: unlink d8/d13/d1f/f74 0 2024-05-09T00:07:32.916 INFO:tasks.workunit.client.1.smithi135.stdout:2/470: rename d1/d12/c34 to d1/d12/d21/d57/c9e 0 2024-05-09T00:07:32.917 INFO:tasks.workunit.client.1.smithi135.stdout:2/471: readlink d1/d12/d21/l6b 0 2024-05-09T00:07:32.917 INFO:tasks.workunit.client.1.smithi135.stdout:8/490: mkdir d4/d8/da2/da6 0 2024-05-09T00:07:32.921 INFO:tasks.workunit.client.1.smithi135.stdout:7/517: creat db/dd/d33/da5/fac x:0 0 0 2024-05-09T00:07:32.921 INFO:tasks.workunit.client.1.smithi135.stdout:7/518: dread - db/dd/d33/f9d zero size 2024-05-09T00:07:32.923 INFO:tasks.workunit.client.1.smithi135.stdout:5/514: creat db/d84/d62/fa1 x:0 0 0 2024-05-09T00:07:32.924 INFO:tasks.workunit.client.1.smithi135.stdout:1/477: chown da/d14/d20/f7c 20 1 2024-05-09T00:07:32.926 INFO:tasks.workunit.client.1.smithi135.stdout:4/413: dread dc/d4a/f76 [0,4194304] 0 2024-05-09T00:07:32.926 INFO:tasks.workunit.client.1.smithi135.stdout:4/414: write dc/d4a/d69/d55/d5f/f83 [461239,61207] 0 2024-05-09T00:07:32.927 INFO:tasks.workunit.client.1.smithi135.stdout:6/474: creat d2/d20/d2e/fa0 x:0 0 0 2024-05-09T00:07:32.928 INFO:tasks.workunit.client.1.smithi135.stdout:3/501: dwrite d8/d13/d75/d53/f67 [0,4194304] 0 2024-05-09T00:07:32.928 INFO:tasks.workunit.client.1.smithi135.stdout:3/502: readlink d8/d6d/la5 0 2024-05-09T00:07:32.929 INFO:tasks.workunit.client.1.smithi135.stdout:0/492: rename d3/c19 to d3/d64/c8c 0 2024-05-09T00:07:32.930 INFO:tasks.workunit.client.1.smithi135.stdout:2/472: creat d1/d12/d21/f9f x:0 0 0 2024-05-09T00:07:32.930 INFO:tasks.workunit.client.1.smithi135.stdout:0/493: dread d3/f4f [0,4194304] 0 2024-05-09T00:07:32.931 INFO:tasks.workunit.client.1.smithi135.stdout:7/519: rename db/d1e/d3a/d40/d4c/d67/l9f to db/d1e/d3a/d40/d4c/d67/lad 0 2024-05-09T00:07:32.932 INFO:tasks.workunit.client.1.smithi135.stdout:7/520: write db/ff [3105146,72801] 0 2024-05-09T00:07:32.932 INFO:tasks.workunit.client.1.smithi135.stdout:5/515: link db/d84/f43 db/d24/d32/d5b/d91/fa2 0 2024-05-09T00:07:32.934 INFO:tasks.workunit.client.1.smithi135.stdout:0/494: write d3/dd/d2d/f6a [1045635,88805] 0 2024-05-09T00:07:32.935 INFO:tasks.workunit.client.1.smithi135.stdout:4/415: creat dc/d71/f91 x:0 0 0 2024-05-09T00:07:32.939 INFO:tasks.workunit.client.1.smithi135.stdout:3/503: symlink d8/d13/d75/d53/d6a/laf 0 2024-05-09T00:07:32.939 INFO:tasks.workunit.client.1.smithi135.stdout:3/504: readlink l4 0 2024-05-09T00:07:32.940 INFO:tasks.workunit.client.1.smithi135.stdout:3/505: readlink d8/d6d/d24/l25 0 2024-05-09T00:07:32.941 INFO:tasks.workunit.client.1.smithi135.stdout:8/491: rename d4/d7/de/d45/c4b to d4/d22/ca7 0 2024-05-09T00:07:32.942 INFO:tasks.workunit.client.1.smithi135.stdout:2/473: truncate d1/d12/d20/d3b/d40/f8b 3066370 0 2024-05-09T00:07:32.943 INFO:tasks.workunit.client.1.smithi135.stdout:7/521: creat db/d13/fae x:0 0 0 2024-05-09T00:07:32.943 INFO:tasks.workunit.client.1.smithi135.stdout:1/478: mknod da/cae 0 2024-05-09T00:07:32.943 INFO:tasks.workunit.client.1.smithi135.stdout:1/479: fdatasync da/db/d16/f2f 0 2024-05-09T00:07:32.944 INFO:tasks.workunit.client.1.smithi135.stdout:1/480: write da/db/d16/f2f [350915,85319] 0 2024-05-09T00:07:32.944 INFO:tasks.workunit.client.1.smithi135.stdout:9/379: sync 2024-05-09T00:07:32.944 INFO:tasks.workunit.client.1.smithi135.stdout:0/495: readlink d3/dd/d3f/l1e 0 2024-05-09T00:07:32.946 INFO:tasks.workunit.client.1.smithi135.stdout:6/475: dwrite d2/da/f3b [4194304,4194304] 0 2024-05-09T00:07:32.946 INFO:tasks.workunit.client.1.smithi135.stdout:5/516: dread db/d3f/f4d [0,4194304] 0 2024-05-09T00:07:32.947 INFO:tasks.workunit.client.1.smithi135.stdout:3/506: symlink d8/d13/d75/d58/lb0 0 2024-05-09T00:07:32.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/416: rename dc/d26/c65 to dc/d4a/d69/c92 0 2024-05-09T00:07:32.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/417: getdents dc/d7f 0 2024-05-09T00:07:32.951 INFO:tasks.workunit.client.1.smithi135.stdout:6/476: write d2/da/d49/f23 [3580985,114859] 0 2024-05-09T00:07:32.953 INFO:tasks.workunit.client.1.smithi135.stdout:8/492: symlink d4/d7/d2a/la8 0 2024-05-09T00:07:32.955 INFO:tasks.workunit.client.1.smithi135.stdout:7/522: creat db/da8/faf x:0 0 0 2024-05-09T00:07:32.955 INFO:tasks.workunit.client.1.smithi135.stdout:9/380: mknod d1/d24/d44/d54/c74 0 2024-05-09T00:07:32.977 INFO:tasks.workunit.client.1.smithi135.stdout:9/381: dread d1/d1a/d2c/f53 [0,4194304] 0 2024-05-09T00:07:32.990 INFO:tasks.workunit.client.1.smithi135.stdout:3/507: getdents d8/d13/d1f/d62 0 2024-05-09T00:07:32.990 INFO:tasks.workunit.client.1.smithi135.stdout:6/477: symlink d2/d1a/d7a/la1 0 2024-05-09T00:07:32.990 INFO:tasks.workunit.client.1.smithi135.stdout:8/493: rename d4/f2c to d4/d8/da2/fa9 0 2024-05-09T00:07:32.994 INFO:tasks.workunit.client.1.smithi135.stdout:2/474: dwrite d1/d12/f24 [0,4194304] 0 2024-05-09T00:07:32.994 INFO:tasks.workunit.client.1.smithi135.stdout:1/481: dwrite da/d14/d20/d2c/f32 [0,4194304] 0 2024-05-09T00:07:32.994 INFO:tasks.workunit.client.1.smithi135.stdout:1/482: chown da/d14/c5e 50395 1 2024-05-09T00:07:32.998 INFO:tasks.workunit.client.1.smithi135.stdout:5/517: dwrite db/d24/f2d [0,4194304] 0 2024-05-09T00:07:32.998 INFO:tasks.workunit.client.1.smithi135.stdout:4/418: dwrite dc/d26/d31/f85 [0,4194304] 0 2024-05-09T00:07:32.999 INFO:tasks.workunit.client.1.smithi135.stdout:7/523: symlink db/d1e/d3a/d40/lb0 0 2024-05-09T00:07:33.005 INFO:tasks.workunit.client.1.smithi135.stdout:3/508: rmdir d8/d6d/d44/d4b/d59/d90/d7b 39 2024-05-09T00:07:33.005 INFO:tasks.workunit.client.1.smithi135.stdout:3/509: chown d8/f11 246363 1 2024-05-09T00:07:33.005 INFO:tasks.workunit.client.1.smithi135.stdout:3/510: chown d8/l8c 1 1 2024-05-09T00:07:33.006 INFO:tasks.workunit.client.1.smithi135.stdout:7/524: read db/dd/f2d [4280802,50795] 0 2024-05-09T00:07:33.011 INFO:tasks.workunit.client.1.smithi135.stdout:8/494: rename d4/d7/de/d45/d76/c81 to d4/d7/de/d45/caa 0 2024-05-09T00:07:33.016 INFO:tasks.workunit.client.1.smithi135.stdout:2/475: write d1/d22/f43 [39352,123624] 0 2024-05-09T00:07:33.016 INFO:tasks.workunit.client.1.smithi135.stdout:9/382: dwrite d1/d1a/d2c/f11 [0,4194304] 0 2024-05-09T00:07:33.019 INFO:tasks.workunit.client.1.smithi135.stdout:1/483: dwrite da/d14/d20/d38/f8e [0,4194304] 0 2024-05-09T00:07:33.019 INFO:tasks.workunit.client.1.smithi135.stdout:2/476: write d1/d12/d20/d3b/d40/f8a [2074929,104562] 0 2024-05-09T00:07:33.022 INFO:tasks.workunit.client.1.smithi135.stdout:2/477: dread d1/d22/f26 [0,4194304] 0 2024-05-09T00:07:33.026 INFO:tasks.workunit.client.1.smithi135.stdout:4/419: unlink dc/c7d 0 2024-05-09T00:07:33.027 INFO:tasks.workunit.client.1.smithi135.stdout:7/525: truncate db/f30 3782974 0 2024-05-09T00:07:33.029 INFO:tasks.workunit.client.1.smithi135.stdout:9/383: mknod d1/d1a/d2c/d20/c75 0 2024-05-09T00:07:33.029 INFO:tasks.workunit.client.1.smithi135.stdout:9/384: chown d1/d1a/f29 659165955 1 2024-05-09T00:07:33.032 INFO:tasks.workunit.client.1.smithi135.stdout:6/478: dwrite d2/d1a/f81 [0,4194304] 0 2024-05-09T00:07:33.032 INFO:tasks.workunit.client.1.smithi135.stdout:5/518: dwrite db/d3f/f57 [0,4194304] 0 2024-05-09T00:07:33.033 INFO:tasks.workunit.client.1.smithi135.stdout:8/495: dwrite d4/d7/f2f [0,4194304] 0 2024-05-09T00:07:33.033 INFO:tasks.workunit.client.1.smithi135.stdout:8/496: chown d4/c21 1761087 1 2024-05-09T00:07:33.033 INFO:tasks.workunit.client.1.smithi135.stdout:2/478: symlink d1/d12/d20/d2b/d94/la0 0 2024-05-09T00:07:33.036 INFO:tasks.workunit.client.1.smithi135.stdout:4/420: mkdir dc/d26/d93 0 2024-05-09T00:07:33.036 INFO:tasks.workunit.client.1.smithi135.stdout:3/511: dwrite d8/d6d/d24/f50 [0,4194304] 0 2024-05-09T00:07:33.037 INFO:tasks.workunit.client.1.smithi135.stdout:9/385: truncate d1/d1a/d2c/f28 1566800 0 2024-05-09T00:07:33.037 INFO:tasks.workunit.client.1.smithi135.stdout:9/386: truncate d1/d1a/d2c/d2d/f73 543889 0 2024-05-09T00:07:33.038 INFO:tasks.workunit.client.1.smithi135.stdout:9/387: stat d1/d1a/d2c 0 2024-05-09T00:07:33.038 INFO:tasks.workunit.client.1.smithi135.stdout:9/388: write d1/d1a/f67 [790426,129353] 0 2024-05-09T00:07:33.040 INFO:tasks.workunit.client.1.smithi135.stdout:6/479: mknod d2/d20/ca2 0 2024-05-09T00:07:33.042 INFO:tasks.workunit.client.1.smithi135.stdout:1/484: truncate da/d14/d20/f66 57713 0 2024-05-09T00:07:33.042 INFO:tasks.workunit.client.1.smithi135.stdout:1/485: chown da/d24/d27/d33/d36 1468446022 1 2024-05-09T00:07:33.045 INFO:tasks.workunit.client.1.smithi135.stdout:5/519: creat db/d5d/fa3 x:0 0 0 2024-05-09T00:07:33.045 INFO:tasks.workunit.client.1.smithi135.stdout:5/520: chown db/d84/d62/d73 15 1 2024-05-09T00:07:33.047 INFO:tasks.workunit.client.1.smithi135.stdout:8/497: mkdir d4/d8/da2/dab 0 2024-05-09T00:07:33.049 INFO:tasks.workunit.client.1.smithi135.stdout:2/479: creat d1/d12/d20/d2b/d7c/fa1 x:0 0 0 2024-05-09T00:07:33.049 INFO:tasks.workunit.client.1.smithi135.stdout:2/480: truncate d1/d12/d20/d2b/d56/d67/f82 841421 0 2024-05-09T00:07:33.051 INFO:tasks.workunit.client.1.smithi135.stdout:4/421: rename dc/dd/f3f to dc/d4a/d69/d55/d6d/f94 0 2024-05-09T00:07:33.056 INFO:tasks.workunit.client.1.smithi135.stdout:3/512: creat d8/d13/d51/d92/fb1 x:0 0 0 2024-05-09T00:07:33.057 INFO:tasks.workunit.client.1.smithi135.stdout:3/513: write d8/d6d/d44/d4b/d69/f4d [2636296,72760] 0 2024-05-09T00:07:33.058 INFO:tasks.workunit.client.1.smithi135.stdout:7/526: dwrite db/d13/f2a [4194304,4194304] 0 2024-05-09T00:07:33.058 INFO:tasks.workunit.client.1.smithi135.stdout:6/480: dwrite d2/fc [0,4194304] 0 2024-05-09T00:07:33.058 INFO:tasks.workunit.client.1.smithi135.stdout:9/389: mknod d1/d24/d44/d54/c76 0 2024-05-09T00:07:33.059 INFO:tasks.workunit.client.1.smithi135.stdout:1/486: creat da/d24/d27/faf x:0 0 0 2024-05-09T00:07:33.059 INFO:tasks.workunit.client.1.smithi135.stdout:8/498: creat d4/d7/de/d45/fac x:0 0 0 2024-05-09T00:07:33.061 INFO:tasks.workunit.client.1.smithi135.stdout:2/481: creat d1/d12/d21/d57/fa2 x:0 0 0 2024-05-09T00:07:33.063 INFO:tasks.workunit.client.1.smithi135.stdout:5/521: rename db/d5d/f64 to db/d5d/d7e/fa4 0 2024-05-09T00:07:33.064 INFO:tasks.workunit.client.1.smithi135.stdout:4/422: mknod dc/d71/d86/c95 0 2024-05-09T00:07:33.064 INFO:tasks.workunit.client.1.smithi135.stdout:7/527: dread db/dd/f35 [0,4194304] 0 2024-05-09T00:07:33.064 INFO:tasks.workunit.client.1.smithi135.stdout:7/528: write db/d1e/d3a/d40/d4c/d67/fa0 [814735,73961] 0 2024-05-09T00:07:33.065 INFO:tasks.workunit.client.1.smithi135.stdout:9/390: write d1/d1a/d2c/f6d [65982,101926] 0 2024-05-09T00:07:33.067 INFO:tasks.workunit.client.1.smithi135.stdout:7/529: dread db/d13/f73 [0,4194304] 0 2024-05-09T00:07:33.068 INFO:tasks.workunit.client.1.smithi135.stdout:6/481: rmdir d2/d20/d37/d4e 39 2024-05-09T00:07:33.070 INFO:tasks.workunit.client.1.smithi135.stdout:1/487: rename da/d24/d27/d33/f6d to da/d24/d27/d33/fb0 0 2024-05-09T00:07:33.072 INFO:tasks.workunit.client.1.smithi135.stdout:8/499: symlink d4/d7/da4/lad 0 2024-05-09T00:07:33.074 INFO:tasks.workunit.client.1.smithi135.stdout:2/482: mkdir d1/d12/da3 0 2024-05-09T00:07:33.074 INFO:tasks.workunit.client.1.smithi135.stdout:2/483: fdatasync d1/d12/d20/f99 0 2024-05-09T00:07:33.074 INFO:tasks.workunit.client.1.smithi135.stdout:5/522: mknod db/d84/d62/ca5 0 2024-05-09T00:07:33.077 INFO:tasks.workunit.client.1.smithi135.stdout:4/423: unlink dc/d26/d31/f85 0 2024-05-09T00:07:33.078 INFO:tasks.workunit.client.1.smithi135.stdout:9/391: getdents d1/d1a/d10/d3c/d5c 0 2024-05-09T00:07:33.078 INFO:tasks.workunit.client.1.smithi135.stdout:9/392: write d1/d1a/f51 [1486949,95315] 0 2024-05-09T00:07:33.080 INFO:tasks.workunit.client.1.smithi135.stdout:7/530: link db/d21/f8b db/d21/fb1 0 2024-05-09T00:07:33.080 INFO:tasks.workunit.client.1.smithi135.stdout:7/531: truncate db/f47 1211962 0 2024-05-09T00:07:33.081 INFO:tasks.workunit.client.1.smithi135.stdout:7/532: write db/d1e/f36 [1081875,83983] 0 2024-05-09T00:07:33.082 INFO:tasks.workunit.client.1.smithi135.stdout:7/533: read - db/d13/fae zero size 2024-05-09T00:07:33.082 INFO:tasks.workunit.client.1.smithi135.stdout:7/534: chown db/dd/d33/d58/f8f 17851 1 2024-05-09T00:07:33.082 INFO:tasks.workunit.client.1.smithi135.stdout:7/535: chown db/d1e/d3a/d40/d4c/d67 375 1 2024-05-09T00:07:33.082 INFO:tasks.workunit.client.1.smithi135.stdout:7/536: write db/d1e/d3a/d40/f6a [443747,13337] 0 2024-05-09T00:07:33.085 INFO:tasks.workunit.client.1.smithi135.stdout:3/514: dwrite d8/f70 [0,4194304] 0 2024-05-09T00:07:33.085 INFO:tasks.workunit.client.1.smithi135.stdout:8/500: dread d4/f20 [0,4194304] 0 2024-05-09T00:07:33.085 INFO:tasks.workunit.client.1.smithi135.stdout:3/515: readlink d8/l8c 0 2024-05-09T00:07:33.086 INFO:tasks.workunit.client.1.smithi135.stdout:8/501: fdatasync d4/d7/d33/f7f 0 2024-05-09T00:07:33.086 INFO:tasks.workunit.client.1.smithi135.stdout:8/502: dread - d4/d7/f8f zero size 2024-05-09T00:07:33.090 INFO:tasks.workunit.client.1.smithi135.stdout:2/484: rmdir d1/d12/d20/d2b/d7c 39 2024-05-09T00:07:33.091 INFO:tasks.workunit.client.1.smithi135.stdout:5/523: dread db/f7f [0,4194304] 0 2024-05-09T00:07:33.093 INFO:tasks.workunit.client.1.smithi135.stdout:0/496: sync 2024-05-09T00:07:33.098 INFO:tasks.workunit.client.1.smithi135.stdout:3/516: symlink d8/d6d/d44/d4b/d59/d90/d7b/d80/lb2 0 2024-05-09T00:07:33.098 INFO:tasks.workunit.client.1.smithi135.stdout:3/517: write d8/d13/f22 [4035709,123024] 0 2024-05-09T00:07:33.098 INFO:tasks.workunit.client.1.smithi135.stdout:8/503: symlink d4/d7/d2a/d67/lae 0 2024-05-09T00:07:33.099 INFO:tasks.workunit.client.1.smithi135.stdout:2/485: symlink d1/d12/d20/la4 0 2024-05-09T00:07:33.099 INFO:tasks.workunit.client.1.smithi135.stdout:2/486: write d1/d12/d20/d3b/d40/f5e [122827,17795] 0 2024-05-09T00:07:33.100 INFO:tasks.workunit.client.1.smithi135.stdout:9/393: mknod d1/d1a/d10/c77 0 2024-05-09T00:07:33.100 INFO:tasks.workunit.client.1.smithi135.stdout:0/497: dread d3/dd/d3f/f21 [0,4194304] 0 2024-05-09T00:07:33.100 INFO:tasks.workunit.client.1.smithi135.stdout:0/498: truncate d3/f23 593031 0 2024-05-09T00:07:33.101 INFO:tasks.workunit.client.1.smithi135.stdout:4/424: dread dc/d26/f2a [4194304,4194304] 0 2024-05-09T00:07:33.101 INFO:tasks.workunit.client.1.smithi135.stdout:6/482: dwrite d2/fd [0,4194304] 0 2024-05-09T00:07:33.101 INFO:tasks.workunit.client.1.smithi135.stdout:7/537: dread db/dd/f14 [0,4194304] 0 2024-05-09T00:07:33.101 INFO:tasks.workunit.client.1.smithi135.stdout:5/524: creat db/d84/d31/d5e/fa6 x:0 0 0 2024-05-09T00:07:33.102 INFO:tasks.workunit.client.1.smithi135.stdout:5/525: chown db/d24 3 1 2024-05-09T00:07:33.102 INFO:tasks.workunit.client.1.smithi135.stdout:3/518: creat d8/d6d/d44/d4b/da0/fb3 x:0 0 0 2024-05-09T00:07:33.102 INFO:tasks.workunit.client.1.smithi135.stdout:5/526: write db/d24/d32/f79 [220456,91181] 0 2024-05-09T00:07:33.102 INFO:tasks.workunit.client.1.smithi135.stdout:8/504: getdents d4/d7/d2a/d56 0 2024-05-09T00:07:33.103 INFO:tasks.workunit.client.1.smithi135.stdout:2/487: creat d1/d12/d20/d2b/fa5 x:0 0 0 2024-05-09T00:07:33.108 INFO:tasks.workunit.client.1.smithi135.stdout:6/483: creat d2/d20/d3f/d4f/fa3 x:0 0 0 2024-05-09T00:07:33.109 INFO:tasks.workunit.client.1.smithi135.stdout:7/538: creat db/d1e/d94/fb2 x:0 0 0 2024-05-09T00:07:33.114 INFO:tasks.workunit.client.1.smithi135.stdout:5/527: link db/d24/c35 db/d84/ca7 0 2024-05-09T00:07:33.114 INFO:tasks.workunit.client.1.smithi135.stdout:5/528: chown db/d84/d62/ca5 15775325 1 2024-05-09T00:07:33.114 INFO:tasks.workunit.client.1.smithi135.stdout:5/529: write db/d84/d62/d73/f83 [734608,68104] 0 2024-05-09T00:07:33.114 INFO:tasks.workunit.client.1.smithi135.stdout:8/505: creat d4/d7/d2a/faf x:0 0 0 2024-05-09T00:07:33.115 INFO:tasks.workunit.client.1.smithi135.stdout:8/506: write d4/d7/d2a/faf [8570,20363] 0 2024-05-09T00:07:33.115 INFO:tasks.workunit.client.1.smithi135.stdout:8/507: chown d4/d7/de/d45/l86 3 1 2024-05-09T00:07:33.115 INFO:tasks.workunit.client.1.smithi135.stdout:2/488: truncate d1/d22/f28 4166123 0 2024-05-09T00:07:33.115 INFO:tasks.workunit.client.1.smithi135.stdout:3/519: dread d8/d13/d1f/f30 [0,4194304] 0 2024-05-09T00:07:33.118 INFO:tasks.workunit.client.1.smithi135.stdout:4/425: unlink dc/d26/d31/l40 0 2024-05-09T00:07:33.118 INFO:tasks.workunit.client.1.smithi135.stdout:9/394: dwrite d1/f2 [0,4194304] 0 2024-05-09T00:07:33.120 INFO:tasks.workunit.client.1.smithi135.stdout:6/484: mkdir d2/da/d49/da4 0 2024-05-09T00:07:33.122 INFO:tasks.workunit.client.1.smithi135.stdout:9/395: read d1/d1a/f29 [1343508,111947] 0 2024-05-09T00:07:33.122 INFO:tasks.workunit.client.1.smithi135.stdout:7/539: creat db/d21/fb3 x:0 0 0 2024-05-09T00:07:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:5/530: symlink db/d3f/la8 0 2024-05-09T00:07:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:8/508: symlink d4/d22/d8b/lb0 0 2024-05-09T00:07:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:5/531: chown db/d84/f41 315 1 2024-05-09T00:07:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:8/509: dread - d4/d7/d2a/f6f zero size 2024-05-09T00:07:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:8/510: readlink d4/d7/d2a/d56/l8d 0 2024-05-09T00:07:33.125 INFO:tasks.workunit.client.1.smithi135.stdout:2/489: symlink d1/d12/d20/d2b/d94/la6 0 2024-05-09T00:07:33.127 INFO:tasks.workunit.client.1.smithi135.stdout:3/520: rename d8/d6d/d44/d4b/d59/f65 to d8/fb4 0 2024-05-09T00:07:33.127 INFO:tasks.workunit.client.1.smithi135.stdout:3/521: write d8/d6d/d44/d4b/d59/d90/f9c [638900,122733] 0 2024-05-09T00:07:33.128 INFO:tasks.workunit.client.1.smithi135.stdout:8/511: fdatasync d4/d7/d2a/faf 0 2024-05-09T00:07:33.128 INFO:tasks.workunit.client.1.smithi135.stdout:4/426: rmdir dc/d4a/d69/d39 39 2024-05-09T00:07:33.132 INFO:tasks.workunit.client.1.smithi135.stdout:7/540: getdents db/dd/d33/d68 0 2024-05-09T00:07:33.132 INFO:tasks.workunit.client.1.smithi135.stdout:7/541: chown db/dd/d33/f82 120984924 1 2024-05-09T00:07:33.132 INFO:tasks.workunit.client.1.smithi135.stdout:7/542: getdents db/d1e/d3a/d40/d7e 0 2024-05-09T00:07:33.132 INFO:tasks.workunit.client.1.smithi135.stdout:7/543: truncate db/d21/fb3 763787 0 2024-05-09T00:07:33.134 INFO:tasks.workunit.client.1.smithi135.stdout:5/532: mknod db/d24/d32/ca9 0 2024-05-09T00:07:33.134 INFO:tasks.workunit.client.1.smithi135.stdout:2/490: truncate d1/f32 1444219 0 2024-05-09T00:07:33.136 INFO:tasks.workunit.client.1.smithi135.stdout:8/512: symlink d4/d7/d33/d39/lb1 0 2024-05-09T00:07:33.138 INFO:tasks.workunit.client.1.smithi135.stdout:5/533: write db/d84/f3c [373398,35591] 0 2024-05-09T00:07:33.138 INFO:tasks.workunit.client.1.smithi135.stdout:5/534: chown db/d24/c40 6396 1 2024-05-09T00:07:33.139 INFO:tasks.workunit.client.1.smithi135.stdout:7/544: symlink db/d1e/d3a/d40/d4c/da3/lb4 0 2024-05-09T00:07:33.140 INFO:tasks.workunit.client.1.smithi135.stdout:8/513: mknod d4/d7/d2a/d9f/cb2 0 2024-05-09T00:07:33.142 INFO:tasks.workunit.client.1.smithi135.stdout:4/427: rename dc/dd/d79 to dc/d26/d31/d96 0 2024-05-09T00:07:33.143 INFO:tasks.workunit.client.1.smithi135.stdout:9/396: dread d1/d1a/d2c/d2d/f32 [4194304,4194304] 0 2024-05-09T00:07:33.144 INFO:tasks.workunit.client.1.smithi135.stdout:6/485: dwrite d2/da/f3b [0,4194304] 0 2024-05-09T00:07:33.144 INFO:tasks.workunit.client.1.smithi135.stdout:6/486: dread - d2/da/d1d/d69/d89/f8e zero size 2024-05-09T00:07:33.144 INFO:tasks.workunit.client.1.smithi135.stdout:0/499: dwrite d3/dd/d3f/d3a/f4a [0,4194304] 0 2024-05-09T00:07:33.144 INFO:tasks.workunit.client.1.smithi135.stdout:0/500: chown d3/f34 0 1 2024-05-09T00:07:33.144 INFO:tasks.workunit.client.1.smithi135.stdout:0/501: write d3/dd/d3f/d58/f63 [957658,80515] 0 2024-05-09T00:07:33.144 INFO:tasks.workunit.client.1.smithi135.stdout:5/535: symlink db/d96/laa 0 2024-05-09T00:07:33.145 INFO:tasks.workunit.client.1.smithi135.stdout:7/545: mkdir db/dd/d33/d58/db5 0 2024-05-09T00:07:33.147 INFO:tasks.workunit.client.1.smithi135.stdout:0/502: dread d3/dd/d3f/d29/f2e [0,4194304] 0 2024-05-09T00:07:33.148 INFO:tasks.workunit.client.1.smithi135.stdout:0/503: write d3/dd/f7b [194101,82198] 0 2024-05-09T00:07:33.148 INFO:tasks.workunit.client.1.smithi135.stdout:2/491: mknod d1/ca7 0 2024-05-09T00:07:33.148 INFO:tasks.workunit.client.1.smithi135.stdout:2/492: chown d1/d12/d20/d2b/d56/d72/c7d 181351 1 2024-05-09T00:07:33.148 INFO:tasks.workunit.client.1.smithi135.stdout:5/536: write db/f28 [2441587,18205] 0 2024-05-09T00:07:33.148 INFO:tasks.workunit.client.1.smithi135.stdout:5/537: fdatasync db/d5d/d7e/f85 0 2024-05-09T00:07:33.151 INFO:tasks.workunit.client.1.smithi135.stdout:4/428: unlink dc/d4a/d69/d55/d5f/f59 0 2024-05-09T00:07:33.153 INFO:tasks.workunit.client.1.smithi135.stdout:9/397: mknod d1/d1a/d10/d3c/c78 0 2024-05-09T00:07:33.154 INFO:tasks.workunit.client.1.smithi135.stdout:6/487: getdents d2/da/d26/d57/d59 0 2024-05-09T00:07:33.161 INFO:tasks.workunit.client.1.smithi135.stdout:8/514: dwrite d4/d22/f72 [4194304,4194304] 0 2024-05-09T00:07:33.175 INFO:tasks.workunit.client.1.smithi135.stdout:7/546: creat db/dd/d33/d68/fb6 x:0 0 0 2024-05-09T00:07:33.176 INFO:tasks.workunit.client.1.smithi135.stdout:0/504: truncate d3/dd/d3f/d58/f6d 4361908 0 2024-05-09T00:07:33.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/538: dwrite db/d24/f98 [0,4194304] 0 2024-05-09T00:07:33.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/539: truncate db/d24/d32/d5b/d91/f7c 561736 0 2024-05-09T00:07:33.177 INFO:tasks.workunit.client.1.smithi135.stdout:8/515: dwrite d4/f20 [8388608,4194304] 0 2024-05-09T00:07:33.178 INFO:tasks.workunit.client.1.smithi135.stdout:2/493: stat d1/d12/d20/c84 0 2024-05-09T00:07:33.180 INFO:tasks.workunit.client.1.smithi135.stdout:9/398: symlink d1/d1a/d10/d3c/d5c/l79 0 2024-05-09T00:07:33.182 INFO:tasks.workunit.client.1.smithi135.stdout:6/488: rename d2/d20/d3f/d4f/fa3 to d2/d20/d37/d4e/d7c/fa5 0 2024-05-09T00:07:33.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/547: creat db/dd/fb7 x:0 0 0 2024-05-09T00:07:33.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/548: truncate db/d13/fae 190823 0 2024-05-09T00:07:33.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/549: stat db/dd/c34 0 2024-05-09T00:07:33.193 INFO:tasks.workunit.client.1.smithi135.stdout:0/505: dwrite d3/dd/d3f/f41 [0,4194304] 0 2024-05-09T00:07:33.193 INFO:tasks.workunit.client.1.smithi135.stdout:0/506: chown d3/dd/d2d/d4c/l66 44570440 1 2024-05-09T00:07:33.196 INFO:tasks.workunit.client.1.smithi135.stdout:5/540: mknod db/d84/cab 0 2024-05-09T00:07:33.196 INFO:tasks.workunit.client.1.smithi135.stdout:5/541: chown db/d24/d32/d5b/f76 1 1 2024-05-09T00:07:33.196 INFO:tasks.workunit.client.1.smithi135.stdout:5/542: write db/d84/d31/f90 [783337,52420] 0 2024-05-09T00:07:33.196 INFO:tasks.workunit.client.1.smithi135.stdout:5/543: write db/d84/d31/d5e/fa6 [883633,123685] 0 2024-05-09T00:07:33.197 INFO:tasks.workunit.client.1.smithi135.stdout:8/516: creat d4/d7/d2a/d67/fb3 x:0 0 0 2024-05-09T00:07:33.199 INFO:tasks.workunit.client.1.smithi135.stdout:9/399: symlink d1/d24/l7a 0 2024-05-09T00:07:33.199 INFO:tasks.workunit.client.1.smithi135.stdout:9/400: readlink d1/d24/d44/d54/l6f 0 2024-05-09T00:07:33.199 INFO:tasks.workunit.client.1.smithi135.stdout:9/401: write d1/f59 [220960,116850] 0 2024-05-09T00:07:33.200 INFO:tasks.workunit.client.1.smithi135.stdout:6/489: mkdir d2/da/d49/da6 0 2024-05-09T00:07:33.201 INFO:tasks.workunit.client.1.smithi135.stdout:7/550: creat db/d1e/d94/fb8 x:0 0 0 2024-05-09T00:07:33.202 INFO:tasks.workunit.client.1.smithi135.stdout:7/551: read db/f37 [977246,30354] 0 2024-05-09T00:07:33.203 INFO:tasks.workunit.client.1.smithi135.stdout:0/507: getdents d3/dd/d3f/d29 0 2024-05-09T00:07:33.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/544: rename db/d5d/d7e to db/d5d/dac 0 2024-05-09T00:07:33.207 INFO:tasks.workunit.client.1.smithi135.stdout:6/490: link d2/d20/d2e/l9e d2/da/d49/da4/la7 0 2024-05-09T00:07:33.210 INFO:tasks.workunit.client.1.smithi135.stdout:7/552: creat db/d1e/d3a/d40/d7e/fb9 x:0 0 0 2024-05-09T00:07:33.210 INFO:tasks.workunit.client.1.smithi135.stdout:7/553: truncate db/d5b/f64 1809475 0 2024-05-09T00:07:33.210 INFO:tasks.workunit.client.1.smithi135.stdout:7/554: fdatasync db/d1e/d3a/d40/f55 0 2024-05-09T00:07:33.210 INFO:tasks.workunit.client.1.smithi135.stdout:0/508: chown d3/dd/d3f/l1d 3484 1 2024-05-09T00:07:33.214 INFO:tasks.workunit.client.1.smithi135.stdout:9/402: mknod d1/d1a/d10/c7b 0 2024-05-09T00:07:33.215 INFO:tasks.workunit.client.1.smithi135.stdout:9/403: chown d1/d24/d44/l65 3 1 2024-05-09T00:07:33.215 INFO:tasks.workunit.client.1.smithi135.stdout:0/509: mkdir d3/d64/d8d 0 2024-05-09T00:07:33.221 INFO:tasks.workunit.client.1.smithi135.stdout:7/555: read db/d1e/f36 [1798494,121846] 0 2024-05-09T00:07:33.221 INFO:tasks.workunit.client.1.smithi135.stdout:6/491: dread d2/da/f3b [0,4194304] 0 2024-05-09T00:07:33.221 INFO:tasks.workunit.client.1.smithi135.stdout:7/556: write db/d1e/d94/fb2 [293269,47163] 0 2024-05-09T00:07:33.221 INFO:tasks.workunit.client.1.smithi135.stdout:6/492: write d2/da/d1d/d69/d78/f97 [859395,46359] 0 2024-05-09T00:07:33.222 INFO:tasks.workunit.client.1.smithi135.stdout:8/517: dwrite d4/d7/d2a/d56/f61 [0,4194304] 0 2024-05-09T00:07:33.223 INFO:tasks.workunit.client.1.smithi135.stdout:8/518: readlink d4/d22/l62 0 2024-05-09T00:07:33.223 INFO:tasks.workunit.client.1.smithi135.stdout:6/493: rmdir d2/d1a 39 2024-05-09T00:07:33.226 INFO:tasks.workunit.client.1.smithi135.stdout:8/519: symlink d4/d7/lb4 0 2024-05-09T00:07:33.226 INFO:tasks.workunit.client.1.smithi135.stdout:8/520: fdatasync d4/d7/d2a/faf 0 2024-05-09T00:07:33.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/494: getdents d2/d5f 0 2024-05-09T00:07:33.228 INFO:tasks.workunit.client.1.smithi135.stdout:1/488: sync 2024-05-09T00:07:33.228 INFO:tasks.workunit.client.1.smithi135.stdout:1/489: write da/d24/d27/d33/f98 [856058,91013] 0 2024-05-09T00:07:33.228 INFO:tasks.workunit.client.1.smithi135.stdout:1/490: dread - da/d24/d27/faf zero size 2024-05-09T00:07:33.229 INFO:tasks.workunit.client.1.smithi135.stdout:6/495: truncate d2/d20/d3f/f44 3236633 0 2024-05-09T00:07:33.230 INFO:tasks.workunit.client.1.smithi135.stdout:1/491: chown da/db/c29 169931 1 2024-05-09T00:07:33.230 INFO:tasks.workunit.client.1.smithi135.stdout:8/521: dread d4/f58 [0,4194304] 0 2024-05-09T00:07:33.231 INFO:tasks.workunit.client.1.smithi135.stdout:6/496: mkdir d2/da/d26/d57/d59/d62/da8 0 2024-05-09T00:07:33.231 INFO:tasks.workunit.client.1.smithi135.stdout:6/497: fdatasync d2/d20/d2e/d3d/f48 0 2024-05-09T00:07:33.232 INFO:tasks.workunit.client.1.smithi135.stdout:1/492: link da/d24/d27/d33/fb0 da/db/d16/fb1 0 2024-05-09T00:07:33.233 INFO:tasks.workunit.client.1.smithi135.stdout:8/522: creat d4/d7/d2a/fb5 x:0 0 0 2024-05-09T00:07:33.234 INFO:tasks.workunit.client.1.smithi135.stdout:1/493: creat da/d14/d20/fb2 x:0 0 0 2024-05-09T00:07:33.236 INFO:tasks.workunit.client.1.smithi135.stdout:6/498: link d2/da/d1d/d69/l74 d2/d20/d3f/la9 0 2024-05-09T00:07:33.236 INFO:tasks.workunit.client.1.smithi135.stdout:2/494: dwrite d1/f33 [4194304,4194304] 0 2024-05-09T00:07:33.236 INFO:tasks.workunit.client.1.smithi135.stdout:2/495: fdatasync d1/d12/d20/d3b/d4f/f6a 0 2024-05-09T00:07:33.237 INFO:tasks.workunit.client.1.smithi135.stdout:1/494: creat da/d73/fb3 x:0 0 0 2024-05-09T00:07:33.237 INFO:tasks.workunit.client.1.smithi135.stdout:1/495: chown da/d14/d20/f66 30902585 1 2024-05-09T00:07:33.238 INFO:tasks.workunit.client.1.smithi135.stdout:6/499: link d2/d20/d2e/fa0 d2/d20/d37/d4e/faa 0 2024-05-09T00:07:33.240 INFO:tasks.workunit.client.1.smithi135.stdout:2/496: creat d1/d12/d20/d2b/d56/d67/fa8 x:0 0 0 2024-05-09T00:07:33.241 INFO:tasks.workunit.client.1.smithi135.stdout:2/497: fdatasync d1/f32 0 2024-05-09T00:07:33.241 INFO:tasks.workunit.client.1.smithi135.stdout:1/496: truncate da/d14/d20/f2b 5723298 0 2024-05-09T00:07:33.242 INFO:tasks.workunit.client.1.smithi135.stdout:2/498: symlink d1/d22/d63/la9 0 2024-05-09T00:07:33.244 INFO:tasks.workunit.client.1.smithi135.stdout:1/497: symlink da/d14/d20/d38/d3a/d40/d75/lb4 0 2024-05-09T00:07:33.245 INFO:tasks.workunit.client.1.smithi135.stdout:6/500: rename d2/d20/d3f/f52 to d2/da/d1d/fab 0 2024-05-09T00:07:33.245 INFO:tasks.workunit.client.1.smithi135.stdout:6/501: write d2/da/d1d/d69/d89/f9b [279414,92760] 0 2024-05-09T00:07:33.252 INFO:tasks.workunit.client.1.smithi135.stdout:6/502: dread d2/da/f3b [0,4194304] 0 2024-05-09T00:07:33.252 INFO:tasks.workunit.client.1.smithi135.stdout:6/503: readlink d2/da/l4c 0 2024-05-09T00:07:33.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/557: dwrite db/da8/f86 [0,4194304] 0 2024-05-09T00:07:33.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/558: fdatasync db/da8/f80 0 2024-05-09T00:07:33.254 INFO:tasks.workunit.client.1.smithi135.stdout:6/504: symlink d2/da/d26/d57/d59/lac 0 2024-05-09T00:07:33.256 INFO:tasks.workunit.client.1.smithi135.stdout:5/545: dwrite db/f94 [0,4194304] 0 2024-05-09T00:07:33.256 INFO:tasks.workunit.client.1.smithi135.stdout:9/404: dwrite d1/d1a/d2c/d2d/f32 [8388608,4194304] 0 2024-05-09T00:07:33.256 INFO:tasks.workunit.client.1.smithi135.stdout:6/505: write d2/da/d1d/d69/d78/f97 [314879,79368] 0 2024-05-09T00:07:33.256 INFO:tasks.workunit.client.1.smithi135.stdout:7/559: symlink db/dd/d33/d58/lba 0 2024-05-09T00:07:33.269 INFO:tasks.workunit.client.1.smithi135.stdout:8/523: dwrite d4/d7/f74 [0,4194304] 0 2024-05-09T00:07:33.270 INFO:tasks.workunit.client.1.smithi135.stdout:0/510: dwrite d3/f12 [0,4194304] 0 2024-05-09T00:07:33.270 INFO:tasks.workunit.client.1.smithi135.stdout:1/498: dwrite da/d14/d20/d38/d3a/d40/f82 [0,4194304] 0 2024-05-09T00:07:33.271 INFO:tasks.workunit.client.1.smithi135.stdout:2/499: dwrite d1/d12/d20/d2b/d56/f76 [0,4194304] 0 2024-05-09T00:07:33.272 INFO:tasks.workunit.client.1.smithi135.stdout:7/560: dread db/d1e/d94/fb2 [0,4194304] 0 2024-05-09T00:07:33.298 INFO:tasks.workunit.client.1.smithi135.stdout:2/500: dwrite d1/d12/d20/d2b/d56/d86/f88 [0,4194304] 0 2024-05-09T00:07:33.299 INFO:tasks.workunit.client.1.smithi135.stdout:2/501: dread d1/d22/f26 [0,4194304] 0 2024-05-09T00:07:33.306 INFO:tasks.workunit.client.1.smithi135.stdout:2/502: dread d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:33.310 INFO:tasks.workunit.client.1.smithi135.stdout:5/546: truncate db/d24/d32/f47 3828588 0 2024-05-09T00:07:33.311 INFO:tasks.workunit.client.1.smithi135.stdout:9/405: truncate d1/d24/f47 1770664 0 2024-05-09T00:07:33.318 INFO:tasks.workunit.client.1.smithi135.stdout:8/524: mknod d4/d7/de/d45/cb6 0 2024-05-09T00:07:33.320 INFO:tasks.workunit.client.1.smithi135.stdout:0/511: creat d3/dd/d3f/d43/f8e x:0 0 0 2024-05-09T00:07:33.321 INFO:tasks.workunit.client.1.smithi135.stdout:1/499: truncate da/d14/d20/d38/d3a/d40/f68 2908075 0 2024-05-09T00:07:33.322 INFO:tasks.workunit.client.1.smithi135.stdout:7/561: rmdir db/dd/d33/da5 39 2024-05-09T00:07:33.323 INFO:tasks.workunit.client.1.smithi135.stdout:2/503: mknod d1/d12/caa 0 2024-05-09T00:07:33.324 INFO:tasks.workunit.client.1.smithi135.stdout:5/547: symlink db/d84/d62/d73/d9c/d9f/lad 0 2024-05-09T00:07:33.326 INFO:tasks.workunit.client.1.smithi135.stdout:6/506: rename d2/d20/d3f/l6e to d2/d20/d3f/d4f/d7f/lad 0 2024-05-09T00:07:33.330 INFO:tasks.workunit.client.1.smithi135.stdout:0/512: creat d3/dd/d2d/d7d/f8f x:0 0 0 2024-05-09T00:07:33.330 INFO:tasks.workunit.client.1.smithi135.stdout:1/500: mknod da/d73/cb5 0 2024-05-09T00:07:33.330 INFO:tasks.workunit.client.1.smithi135.stdout:7/562: truncate db/d1e/f7c 2931253 0 2024-05-09T00:07:33.331 INFO:tasks.workunit.client.1.smithi135.stdout:8/525: rename d4/d7/d2a/l73 to d4/d8/da2/dab/lb7 0 2024-05-09T00:07:33.332 INFO:tasks.workunit.client.1.smithi135.stdout:6/507: symlink d2/da/d49/lae 0 2024-05-09T00:07:33.332 INFO:tasks.workunit.client.1.smithi135.stdout:6/508: stat d2/l4a 0 2024-05-09T00:07:33.335 INFO:tasks.workunit.client.1.smithi135.stdout:3/522: sync 2024-05-09T00:07:33.335 INFO:tasks.workunit.client.1.smithi135.stdout:2/504: dread d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:33.336 INFO:tasks.workunit.client.1.smithi135.stdout:0/513: symlink d3/dd/d2d/d4c/d84/l90 0 2024-05-09T00:07:33.336 INFO:tasks.workunit.client.1.smithi135.stdout:0/514: chown d3/c11 229457813 1 2024-05-09T00:07:33.338 INFO:tasks.workunit.client.1.smithi135.stdout:7/563: rename db/d13/f6f to db/da8/fbb 0 2024-05-09T00:07:33.338 INFO:tasks.workunit.client.1.smithi135.stdout:8/526: mkdir d4/d8/da2/da6/db8 0 2024-05-09T00:07:33.339 INFO:tasks.workunit.client.1.smithi135.stdout:1/501: mknod da/d14/d20/d2c/cb6 0 2024-05-09T00:07:33.341 INFO:tasks.workunit.client.1.smithi135.stdout:2/505: truncate d1/d12/d20/d3b/d4f/f6a 811623 0 2024-05-09T00:07:33.347 INFO:tasks.workunit.client.1.smithi135.stdout:0/515: creat d3/dd/d3f/d3a/d46/f91 x:0 0 0 2024-05-09T00:07:33.347 INFO:tasks.workunit.client.1.smithi135.stdout:7/564: link db/dd/d33/d68/c9b db/d21/d98/cbc 0 2024-05-09T00:07:33.347 INFO:tasks.workunit.client.1.smithi135.stdout:0/516: dread - d3/dd/f6c zero size 2024-05-09T00:07:33.347 INFO:tasks.workunit.client.1.smithi135.stdout:2/506: chown d1/l1d 8947 1 2024-05-09T00:07:33.347 INFO:tasks.workunit.client.1.smithi135.stdout:2/507: chown d1/d12/d20/d2b/f37 3175 1 2024-05-09T00:07:33.347 INFO:tasks.workunit.client.1.smithi135.stdout:4/429: sync 2024-05-09T00:07:33.347 INFO:tasks.workunit.client.1.smithi135.stdout:0/517: write d3/f34 [341809,50848] 0 2024-05-09T00:07:33.348 INFO:tasks.workunit.client.1.smithi135.stdout:7/565: creat db/d1e/d3a/d40/d4c/d67/fbd x:0 0 0 2024-05-09T00:07:33.350 INFO:tasks.workunit.client.1.smithi135.stdout:0/518: truncate d3/dd/d3f/d43/f53 25531 0 2024-05-09T00:07:33.351 INFO:tasks.workunit.client.1.smithi135.stdout:2/508: write d1/d12/d20/d2b/d56/f76 [225893,72149] 0 2024-05-09T00:07:33.351 INFO:tasks.workunit.client.1.smithi135.stdout:2/509: dread - d1/d12/d20/d3b/f5f zero size 2024-05-09T00:07:33.351 INFO:tasks.workunit.client.1.smithi135.stdout:4/430: creat dc/d4a/d69/d55/d5f/f97 x:0 0 0 2024-05-09T00:07:33.355 INFO:tasks.workunit.client.1.smithi135.stdout:0/519: rmdir d3/dd/d3f/d58 39 2024-05-09T00:07:33.355 INFO:tasks.workunit.client.1.smithi135.stdout:2/510: creat d1/d12/d20/d2b/d94/fab x:0 0 0 2024-05-09T00:07:33.355 INFO:tasks.workunit.client.1.smithi135.stdout:2/511: stat d1/ca7 0 2024-05-09T00:07:33.355 INFO:tasks.workunit.client.1.smithi135.stdout:0/520: write d3/dd/f6c [1007729,66683] 0 2024-05-09T00:07:33.355 INFO:tasks.workunit.client.1.smithi135.stdout:0/521: chown d3/dd/d3f/d29/d54 9 1 2024-05-09T00:07:33.356 INFO:tasks.workunit.client.1.smithi135.stdout:0/522: fsync d3/dd/d3f/f41 0 2024-05-09T00:07:33.358 INFO:tasks.workunit.client.1.smithi135.stdout:4/431: link dc/d26/d31/l62 dc/d26/d31/d82/l98 0 2024-05-09T00:07:33.358 INFO:tasks.workunit.client.1.smithi135.stdout:5/548: dwrite db/d24/d32/d5b/f76 [0,4194304] 0 2024-05-09T00:07:33.358 INFO:tasks.workunit.client.1.smithi135.stdout:5/549: chown db/d24/d32/l80 275282 1 2024-05-09T00:07:33.359 INFO:tasks.workunit.client.1.smithi135.stdout:2/512: rename d1/d12/d20/d2b/d7c/fa1 to d1/d12/d20/d2b/fac 0 2024-05-09T00:07:33.359 INFO:tasks.workunit.client.1.smithi135.stdout:2/513: truncate d1/d12/d20/d2b/d56/d67/f7a 688620 0 2024-05-09T00:07:33.360 INFO:tasks.workunit.client.1.smithi135.stdout:5/550: mknod db/d5d/dac/cae 0 2024-05-09T00:07:33.362 INFO:tasks.workunit.client.1.smithi135.stdout:0/523: rename d3/dd/d2d/d4c/l8a to d3/dd/l92 0 2024-05-09T00:07:33.362 INFO:tasks.workunit.client.1.smithi135.stdout:3/523: dread d8/d13/d1f/fad [0,4194304] 0 2024-05-09T00:07:33.362 INFO:tasks.workunit.client.1.smithi135.stdout:4/432: link dc/d26/d4e/f54 dc/d26/d31/f99 0 2024-05-09T00:07:33.363 INFO:tasks.workunit.client.1.smithi135.stdout:5/551: write f4 [2634785,95978] 0 2024-05-09T00:07:33.363 INFO:tasks.workunit.client.1.smithi135.stdout:5/552: stat db/d24/d32/d5b/d91/f7c 0 2024-05-09T00:07:33.363 INFO:tasks.workunit.client.1.smithi135.stdout:5/553: chown l3 15044152 1 2024-05-09T00:07:33.363 INFO:tasks.workunit.client.1.smithi135.stdout:7/566: dread db/f30 [0,4194304] 0 2024-05-09T00:07:33.364 INFO:tasks.workunit.client.1.smithi135.stdout:2/514: rename d1/f1a to d1/d12/d20/d2b/d56/d86/fad 0 2024-05-09T00:07:33.364 INFO:tasks.workunit.client.1.smithi135.stdout:2/515: readlink d1/d12/d21/l6b 0 2024-05-09T00:07:33.365 INFO:tasks.workunit.client.1.smithi135.stdout:9/406: dwrite d1/f59 [0,4194304] 0 2024-05-09T00:07:33.365 INFO:tasks.workunit.client.1.smithi135.stdout:0/524: rmdir d3/dd/d3f 39 2024-05-09T00:07:33.366 INFO:tasks.workunit.client.1.smithi135.stdout:4/433: truncate dc/d26/d4e/f6e 2175721 0 2024-05-09T00:07:33.369 INFO:tasks.workunit.client.1.smithi135.stdout:7/567: symlink db/d21/lbe 0 2024-05-09T00:07:33.369 INFO:tasks.workunit.client.1.smithi135.stdout:7/568: write db/d1e/d3a/d40/d4c/d67/fbd [892971,125055] 0 2024-05-09T00:07:33.369 INFO:tasks.workunit.client.1.smithi135.stdout:7/569: write db/da8/d78/f87 [600763,111477] 0 2024-05-09T00:07:33.371 INFO:tasks.workunit.client.1.smithi135.stdout:3/524: rename d8/d13/d75/d53/f67 to d8/d13/d1f/d40/fb5 0 2024-05-09T00:07:33.372 INFO:tasks.workunit.client.1.smithi135.stdout:0/525: creat d3/dd/d3f/d43/f93 x:0 0 0 2024-05-09T00:07:33.375 INFO:tasks.workunit.client.1.smithi135.stdout:5/554: dread db/d84/d62/d73/d9c/d9f/f87 [0,4194304] 0 2024-05-09T00:07:33.375 INFO:tasks.workunit.client.1.smithi135.stdout:9/407: dread d1/d24/f47 [0,4194304] 0 2024-05-09T00:07:33.375 INFO:tasks.workunit.client.1.smithi135.stdout:4/434: creat dc/d26/d31/f9a x:0 0 0 2024-05-09T00:07:33.378 INFO:tasks.workunit.client.1.smithi135.stdout:8/527: dwrite d4/d22/f27 [4194304,4194304] 0 2024-05-09T00:07:33.378 INFO:tasks.workunit.client.1.smithi135.stdout:8/528: fsync d4/d22/f72 0 2024-05-09T00:07:33.378 INFO:tasks.workunit.client.1.smithi135.stdout:7/570: truncate db/da8/f86 2667110 0 2024-05-09T00:07:33.380 INFO:tasks.workunit.client.1.smithi135.stdout:3/525: symlink d8/d13/d1f/d40/lb6 0 2024-05-09T00:07:33.381 INFO:tasks.workunit.client.1.smithi135.stdout:6/509: dwrite d2/d20/d2e/d3d/f47 [0,4194304] 0 2024-05-09T00:07:33.382 INFO:tasks.workunit.client.1.smithi135.stdout:5/555: creat db/d84/faf x:0 0 0 2024-05-09T00:07:33.382 INFO:tasks.workunit.client.1.smithi135.stdout:5/556: fsync db/d3f/f5f 0 2024-05-09T00:07:33.384 INFO:tasks.workunit.client.1.smithi135.stdout:9/408: unlink d1/d1a/d2c/d20/l38 0 2024-05-09T00:07:33.384 INFO:tasks.workunit.client.1.smithi135.stdout:9/409: write d1/d1a/d10/d3c/d5c/f63 [1404036,83501] 0 2024-05-09T00:07:33.384 INFO:tasks.workunit.client.1.smithi135.stdout:1/502: dwrite da/db/d16/f18 [4194304,4194304] 0 2024-05-09T00:07:33.385 INFO:tasks.workunit.client.1.smithi135.stdout:0/526: dread d3/dd/f6c [0,4194304] 0 2024-05-09T00:07:33.385 INFO:tasks.workunit.client.1.smithi135.stdout:4/435: creat dc/d4a/d69/d39/f9b x:0 0 0 2024-05-09T00:07:33.389 INFO:tasks.workunit.client.1.smithi135.stdout:8/529: unlink d4/d7/d33/d39/c9d 0 2024-05-09T00:07:33.389 INFO:tasks.workunit.client.1.smithi135.stdout:5/557: dread db/d3f/f5f [0,4194304] 0 2024-05-09T00:07:33.389 INFO:tasks.workunit.client.1.smithi135.stdout:5/558: dread - db/d84/d62/fa1 zero size 2024-05-09T00:07:33.390 INFO:tasks.workunit.client.1.smithi135.stdout:2/516: dwrite d1/d12/d21/d41/d6d/f92 [0,4194304] 0 2024-05-09T00:07:33.390 INFO:tasks.workunit.client.1.smithi135.stdout:2/517: chown d1/d12/d21/d57/f95 3 1 2024-05-09T00:07:33.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/571: symlink db/d1e/d3a/d40/d7e/lbf 0 2024-05-09T00:07:33.392 INFO:tasks.workunit.client.1.smithi135.stdout:3/526: unlink d8/d13/d75/d53/fa3 0 2024-05-09T00:07:33.393 INFO:tasks.workunit.client.1.smithi135.stdout:3/527: chown d8/d6d/c8b 359421 1 2024-05-09T00:07:33.395 INFO:tasks.workunit.client.1.smithi135.stdout:0/527: dread d3/dd/f32 [0,4194304] 0 2024-05-09T00:07:33.395 INFO:tasks.workunit.client.1.smithi135.stdout:0/528: chown d3/d64/l85 713826144 1 2024-05-09T00:07:33.398 INFO:tasks.workunit.client.1.smithi135.stdout:6/510: truncate d2/d1a/f1b 4055697 0 2024-05-09T00:07:33.398 INFO:tasks.workunit.client.1.smithi135.stdout:6/511: chown d2/l1c 1512 1 2024-05-09T00:07:33.398 INFO:tasks.workunit.client.1.smithi135.stdout:9/410: symlink d1/d24/d44/d54/d66/l7c 0 2024-05-09T00:07:33.400 INFO:tasks.workunit.client.1.smithi135.stdout:1/503: mkdir da/d14/d20/d38/d3a/db7 0 2024-05-09T00:07:33.404 INFO:tasks.workunit.client.1.smithi135.stdout:8/530: symlink d4/d8/da2/lb9 0 2024-05-09T00:07:33.405 INFO:tasks.workunit.client.1.smithi135.stdout:4/436: dread - dc/d71/f91 zero size 2024-05-09T00:07:33.405 INFO:tasks.workunit.client.1.smithi135.stdout:5/559: mkdir db/d24/db0 0 2024-05-09T00:07:33.408 INFO:tasks.workunit.client.1.smithi135.stdout:1/504: read da/f1f [237150,7540] 0 2024-05-09T00:07:33.409 INFO:tasks.workunit.client.1.smithi135.stdout:0/529: rmdir d3/dd/d2d/d4c/d84 39 2024-05-09T00:07:33.409 INFO:tasks.workunit.client.1.smithi135.stdout:0/530: fdatasync d3/dd/f14 0 2024-05-09T00:07:33.410 INFO:tasks.workunit.client.1.smithi135.stdout:6/512: rename d2/d1a/c1f to d2/d1a/d7a/caf 0 2024-05-09T00:07:33.414 INFO:tasks.workunit.client.1.smithi135.stdout:5/560: mknod db/d3f/cb1 0 2024-05-09T00:07:33.415 INFO:tasks.workunit.client.1.smithi135.stdout:1/505: unlink da/d24/f26 0 2024-05-09T00:07:33.417 INFO:tasks.workunit.client.1.smithi135.stdout:0/531: mkdir d3/dd/d2d/d94 0 2024-05-09T00:07:33.419 INFO:tasks.workunit.client.1.smithi135.stdout:8/531: rename d4/d7/d33/d39/l43 to d4/d7/d2a/d9f/lba 0 2024-05-09T00:07:33.419 INFO:tasks.workunit.client.1.smithi135.stdout:8/532: chown d4/d8 28067 1 2024-05-09T00:07:33.420 INFO:tasks.workunit.client.1.smithi135.stdout:6/513: rmdir d2/d20/d3f 39 2024-05-09T00:07:33.421 INFO:tasks.workunit.client.1.smithi135.stdout:4/437: dread dc/dd/f22 [0,4194304] 0 2024-05-09T00:07:33.424 INFO:tasks.workunit.client.1.smithi135.stdout:3/528: dwrite d8/d6d/f78 [0,4194304] 0 2024-05-09T00:07:33.425 INFO:tasks.workunit.client.1.smithi135.stdout:1/506: creat da/d24/d27/d33/d7d/fb8 x:0 0 0 2024-05-09T00:07:33.426 INFO:tasks.workunit.client.1.smithi135.stdout:5/561: creat db/d84/fb2 x:0 0 0 2024-05-09T00:07:33.426 INFO:tasks.workunit.client.1.smithi135.stdout:7/572: dwrite db/f29 [0,4194304] 0 2024-05-09T00:07:33.426 INFO:tasks.workunit.client.1.smithi135.stdout:0/532: rmdir d3/dd/d3f/d29 39 2024-05-09T00:07:33.426 INFO:tasks.workunit.client.1.smithi135.stdout:2/518: dwrite d1/d12/f8d [0,4194304] 0 2024-05-09T00:07:33.429 INFO:tasks.workunit.client.1.smithi135.stdout:4/438: rename dc/d26/d31/l3a to dc/d26/d31/d82/l9c 0 2024-05-09T00:07:33.429 INFO:tasks.workunit.client.1.smithi135.stdout:4/439: read dc/dd/f17 [76694,101332] 0 2024-05-09T00:07:33.432 INFO:tasks.workunit.client.1.smithi135.stdout:3/529: creat d8/d6d/d24/fb7 x:0 0 0 2024-05-09T00:07:33.433 INFO:tasks.workunit.client.1.smithi135.stdout:1/507: symlink da/d14/d20/d38/d3a/d40/d75/lb9 0 2024-05-09T00:07:33.434 INFO:tasks.workunit.client.1.smithi135.stdout:5/562: creat db/d3f/fb3 x:0 0 0 2024-05-09T00:07:33.434 INFO:tasks.workunit.client.1.smithi135.stdout:5/563: chown db/d24/c26 10 1 2024-05-09T00:07:33.439 INFO:tasks.workunit.client.1.smithi135.stdout:7/573: link db/d1e/d3a/c3e db/d21/d98/cc0 0 2024-05-09T00:07:33.439 INFO:tasks.workunit.client.1.smithi135.stdout:7/574: write db/dd/d33/da5/fac [898429,108490] 0 2024-05-09T00:07:33.439 INFO:tasks.workunit.client.1.smithi135.stdout:7/575: readlink db/d13/l18 0 2024-05-09T00:07:33.441 INFO:tasks.workunit.client.1.smithi135.stdout:0/533: unlink d3/dd/f14 0 2024-05-09T00:07:33.441 INFO:tasks.workunit.client.1.smithi135.stdout:0/534: readlink d3/dd/l86 0 2024-05-09T00:07:33.441 INFO:tasks.workunit.client.1.smithi135.stdout:0/535: fsync d3/dd/d2d/f65 0 2024-05-09T00:07:33.442 INFO:tasks.workunit.client.1.smithi135.stdout:0/536: dread - d3/dd/d2d/d7d/f8f zero size 2024-05-09T00:07:33.442 INFO:tasks.workunit.client.1.smithi135.stdout:9/411: getdents d1/d1a/d2c/d20 0 2024-05-09T00:07:33.442 INFO:tasks.workunit.client.1.smithi135.stdout:8/533: dwrite d4/f89 [0,4194304] 0 2024-05-09T00:07:33.449 INFO:tasks.workunit.client.1.smithi135.stdout:4/440: getdents dc/d4a/d8c 0 2024-05-09T00:07:33.451 INFO:tasks.workunit.client.1.smithi135.stdout:5/564: dwrite db/f11 [8388608,4194304] 0 2024-05-09T00:07:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:3/530: symlink d8/d13/d1f/d40/d52/lb8 0 2024-05-09T00:07:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:5/565: write db/d24/d32/d5b/f88 [3303030,51464] 0 2024-05-09T00:07:33.454 INFO:tasks.workunit.client.1.smithi135.stdout:7/576: mknod db/d1e/d3a/cc1 0 2024-05-09T00:07:33.454 INFO:tasks.workunit.client.1.smithi135.stdout:7/577: chown db/dd/d33/f3d 27440 1 2024-05-09T00:07:33.458 INFO:tasks.workunit.client.1.smithi135.stdout:9/412: mknod d1/d24/d44/d54/d66/c7d 0 2024-05-09T00:07:33.461 INFO:tasks.workunit.client.1.smithi135.stdout:8/534: mknod d4/d7/d2a/d67/cbb 0 2024-05-09T00:07:33.472 INFO:tasks.workunit.client.1.smithi135.stdout:3/531: mkdir d8/d13/d51/d63/db9 0 2024-05-09T00:07:33.473 INFO:tasks.workunit.client.1.smithi135.stdout:1/508: symlink da/d14/d20/lba 0 2024-05-09T00:07:33.477 INFO:tasks.workunit.client.1.smithi135.stdout:7/578: unlink db/dd/d33/f61 0 2024-05-09T00:07:33.478 INFO:tasks.workunit.client.1.smithi135.stdout:8/535: dwrite d4/d7/de/d45/f7a [0,4194304] 0 2024-05-09T00:07:33.480 INFO:tasks.workunit.client.1.smithi135.stdout:9/413: rename d1/d1a/d2c/c70 to d1/d1a/d10/d3c/d43/c7e 0 2024-05-09T00:07:33.481 INFO:tasks.workunit.client.1.smithi135.stdout:7/579: mknod db/dd/d33/d68/cc2 0 2024-05-09T00:07:33.487 INFO:tasks.workunit.client.1.smithi135.stdout:9/414: mkdir d1/d24/d44/d7f 0 2024-05-09T00:07:33.488 INFO:tasks.workunit.client.1.smithi135.stdout:8/536: read d4/f58 [647463,2997] 0 2024-05-09T00:07:33.489 INFO:tasks.workunit.client.1.smithi135.stdout:7/580: creat db/d1e/d3a/d40/d4c/fc3 x:0 0 0 2024-05-09T00:07:33.491 INFO:tasks.workunit.client.1.smithi135.stdout:9/415: symlink d1/d24/d44/d54/d66/l80 0 2024-05-09T00:07:33.493 INFO:tasks.workunit.client.1.smithi135.stdout:8/537: rename d4/d7/d2a/l50 to d4/d8/lbc 0 2024-05-09T00:07:33.494 INFO:tasks.workunit.client.1.smithi135.stdout:7/581: creat db/d21/fc4 x:0 0 0 2024-05-09T00:07:33.496 INFO:tasks.workunit.client.1.smithi135.stdout:8/538: rmdir d4/d22 39 2024-05-09T00:07:33.496 INFO:tasks.workunit.client.1.smithi135.stdout:0/537: rmdir d3/dd 39 2024-05-09T00:07:33.504 INFO:tasks.workunit.client.1.smithi135.stdout:3/532: dwrite d8/f23 [4194304,4194304] 0 2024-05-09T00:07:33.505 INFO:tasks.workunit.client.1.smithi135.stdout:0/538: write d3/dd/d2d/f6a [1314243,106663] 0 2024-05-09T00:07:33.505 INFO:tasks.workunit.client.1.smithi135.stdout:0/539: stat d3/dd/f32 0 2024-05-09T00:07:33.505 INFO:tasks.workunit.client.1.smithi135.stdout:0/540: chown d3/cc 107472181 1 2024-05-09T00:07:33.505 INFO:tasks.workunit.client.1.smithi135.stdout:9/416: dread d1/f13 [0,4194304] 0 2024-05-09T00:07:33.505 INFO:tasks.workunit.client.1.smithi135.stdout:3/533: symlink d8/d6d/d44/d4b/da0/daa/d88/lba 0 2024-05-09T00:07:33.506 INFO:tasks.workunit.client.1.smithi135.stdout:0/541: mknod d3/d64/c95 0 2024-05-09T00:07:33.507 INFO:tasks.workunit.client.1.smithi135.stdout:9/417: stat d1/d1a/d10/l15 0 2024-05-09T00:07:33.507 INFO:tasks.workunit.client.1.smithi135.stdout:3/534: getdents d8/d6d/d44/d4b/d59/d90 0 2024-05-09T00:07:33.508 INFO:tasks.workunit.client.1.smithi135.stdout:9/418: creat d1/d24/d44/d7f/f81 x:0 0 0 2024-05-09T00:07:33.509 INFO:tasks.workunit.client.1.smithi135.stdout:3/535: rmdir d8/d13/d75/d53/d6a 39 2024-05-09T00:07:33.509 INFO:tasks.workunit.client.1.smithi135.stdout:3/536: readlink d8/d13/d75/la7 0 2024-05-09T00:07:33.509 INFO:tasks.workunit.client.1.smithi135.stdout:9/419: creat d1/d1a/d2c/d2d/f82 x:0 0 0 2024-05-09T00:07:33.510 INFO:tasks.workunit.client.1.smithi135.stdout:3/537: creat d8/d6d/d44/d4b/d59/d90/d7b/d80/fbb x:0 0 0 2024-05-09T00:07:33.511 INFO:tasks.workunit.client.1.smithi135.stdout:9/420: rename d1/f13 to d1/d1a/d10/d3c/d43/f83 0 2024-05-09T00:07:33.511 INFO:tasks.workunit.client.1.smithi135.stdout:9/421: fdatasync d1/d1a/d2c/d2d/f82 0 2024-05-09T00:07:33.522 INFO:tasks.workunit.client.1.smithi135.stdout:7/582: dwrite f8 [0,4194304] 0 2024-05-09T00:07:33.523 INFO:tasks.workunit.client.1.smithi135.stdout:7/583: getdents db/dd/d33/da5 0 2024-05-09T00:07:33.523 INFO:tasks.workunit.client.1.smithi135.stdout:7/584: chown c0 890 1 2024-05-09T00:07:33.523 INFO:tasks.workunit.client.1.smithi135.stdout:1/509: dwrite f9 [0,4194304] 0 2024-05-09T00:07:33.523 INFO:tasks.workunit.client.1.smithi135.stdout:1/510: chown da/d24/d27/d33/d52/d71/d8d/fab 14 1 2024-05-09T00:07:33.523 INFO:tasks.workunit.client.1.smithi135.stdout:0/542: dwrite d3/dd/d3f/d29/f77 [4194304,4194304] 0 2024-05-09T00:07:33.524 INFO:tasks.workunit.client.1.smithi135.stdout:1/511: mknod da/d14/d20/cbb 0 2024-05-09T00:07:33.524 INFO:tasks.workunit.client.1.smithi135.stdout:7/585: dread db/d21/fb1 [0,4194304] 0 2024-05-09T00:07:33.524 INFO:tasks.workunit.client.1.smithi135.stdout:7/586: stat db/d1e/f7c 0 2024-05-09T00:07:33.532 INFO:tasks.workunit.client.1.smithi135.stdout:1/512: dread da/f63 [0,4194304] 0 2024-05-09T00:07:33.533 INFO:tasks.workunit.client.1.smithi135.stdout:1/513: mknod da/d14/d20/d38/d3a/d40/d75/cbc 0 2024-05-09T00:07:33.534 INFO:tasks.workunit.client.1.smithi135.stdout:1/514: symlink da/d24/d27/d33/d52/d71/lbd 0 2024-05-09T00:07:33.536 INFO:tasks.workunit.client.1.smithi135.stdout:1/515: rename da/d24/d27/d33/d52/d71/lbd to da/db/d16/lbe 0 2024-05-09T00:07:33.536 INFO:tasks.workunit.client.1.smithi135.stdout:1/516: chown da/d24/d27/faf 252825869 1 2024-05-09T00:07:33.536 INFO:tasks.workunit.client.1.smithi135.stdout:1/517: fdatasync da/d14/d20/d2c/f32 0 2024-05-09T00:07:33.537 INFO:tasks.workunit.client.1.smithi135.stdout:1/518: fdatasync da/d14/d20/f66 0 2024-05-09T00:07:33.537 INFO:tasks.workunit.client.1.smithi135.stdout:1/519: truncate da/d24/d27/d33/f39 4455699 0 2024-05-09T00:07:33.537 INFO:tasks.workunit.client.1.smithi135.stdout:3/538: dwrite d8/d13/f22 [0,4194304] 0 2024-05-09T00:07:33.537 INFO:tasks.workunit.client.1.smithi135.stdout:9/422: dwrite d1/d24/f35 [0,4194304] 0 2024-05-09T00:07:33.537 INFO:tasks.workunit.client.1.smithi135.stdout:9/423: write d1/d1a/d2c/f6d [4342141,107381] 0 2024-05-09T00:07:33.537 INFO:tasks.workunit.client.1.smithi135.stdout:9/424: truncate d1/d24/d44/d54/f55 391697 0 2024-05-09T00:07:33.537 INFO:tasks.workunit.client.1.smithi135.stdout:1/520: mknod da/d24/d27/d33/cbf 0 2024-05-09T00:07:33.544 INFO:tasks.workunit.client.1.smithi135.stdout:7/587: dwrite db/d1e/d3a/d40/f55 [0,4194304] 0 2024-05-09T00:07:33.548 INFO:tasks.workunit.client.1.smithi135.stdout:3/539: rmdir d8/d6d/d44/d4b 39 2024-05-09T00:07:33.548 INFO:tasks.workunit.client.1.smithi135.stdout:9/425: creat d1/d1a/d2c/f84 x:0 0 0 2024-05-09T00:07:33.553 INFO:tasks.workunit.client.1.smithi135.stdout:7/588: creat db/d1e/fc5 x:0 0 0 2024-05-09T00:07:33.554 INFO:tasks.workunit.client.1.smithi135.stdout:3/540: symlink d8/d13/d51/lbc 0 2024-05-09T00:07:33.555 INFO:tasks.workunit.client.1.smithi135.stdout:9/426: symlink d1/d1a/d10/d3c/d43/l85 0 2024-05-09T00:07:33.556 INFO:tasks.workunit.client.1.smithi135.stdout:9/427: getdents d1/d24/d44/d54/d66 0 2024-05-09T00:07:33.558 INFO:tasks.workunit.client.1.smithi135.stdout:9/428: mkdir d1/d24/d86 0 2024-05-09T00:07:33.558 INFO:tasks.workunit.client.1.smithi135.stdout:9/429: fsync d1/d24/d44/d54/f55 0 2024-05-09T00:07:33.560 INFO:tasks.workunit.client.1.smithi135.stdout:1/521: dwrite da/d24/d27/f28 [0,4194304] 0 2024-05-09T00:07:33.561 INFO:tasks.workunit.client.1.smithi135.stdout:1/522: fsync da/d24/d27/faf 0 2024-05-09T00:07:33.568 INFO:tasks.workunit.client.1.smithi135.stdout:3/541: dread d8/d13/f22 [0,4194304] 0 2024-05-09T00:07:33.568 INFO:tasks.workunit.client.1.smithi135.stdout:0/543: dwrite d3/dd/d3f/f72 [0,4194304] 0 2024-05-09T00:07:33.572 INFO:tasks.workunit.client.1.smithi135.stdout:9/430: write d1/d1a/d2c/f6d [644050,107655] 0 2024-05-09T00:07:33.573 INFO:tasks.workunit.client.1.smithi135.stdout:9/431: stat d1/d1a/d10 0 2024-05-09T00:07:33.573 INFO:tasks.workunit.client.1.smithi135.stdout:1/523: dread da/db/d16/f6c [0,4194304] 0 2024-05-09T00:07:33.573 INFO:tasks.workunit.client.1.smithi135.stdout:3/542: unlink d8/d13/l3e 0 2024-05-09T00:07:33.574 INFO:tasks.workunit.client.1.smithi135.stdout:0/544: creat d3/dd/d2d/f96 x:0 0 0 2024-05-09T00:07:33.574 INFO:tasks.workunit.client.1.smithi135.stdout:1/524: unlink da/d14/d20/f66 0 2024-05-09T00:07:33.577 INFO:tasks.workunit.client.1.smithi135.stdout:0/545: rmdir d3/dd/d2d/d94 0 2024-05-09T00:07:33.584 INFO:tasks.workunit.client.1.smithi135.stdout:1/525: dread da/db/f34 [0,4194304] 0 2024-05-09T00:07:33.586 INFO:tasks.workunit.client.1.smithi135.stdout:2/519: sync 2024-05-09T00:07:33.586 INFO:tasks.workunit.client.1.smithi135.stdout:6/514: sync 2024-05-09T00:07:33.586 INFO:tasks.workunit.client.1.smithi135.stdout:1/526: creat da/d24/d27/d33/d7d/fc0 x:0 0 0 2024-05-09T00:07:33.587 INFO:tasks.workunit.client.1.smithi135.stdout:6/515: mknod d2/d5f/cb0 0 2024-05-09T00:07:33.589 INFO:tasks.workunit.client.1.smithi135.stdout:2/520: creat d1/d12/d20/d2b/d56/d72/fae x:0 0 0 2024-05-09T00:07:33.590 INFO:tasks.workunit.client.1.smithi135.stdout:1/527: link da/d14/d20/d38/l45 da/d14/d20/d38/d86/lc1 0 2024-05-09T00:07:33.591 INFO:tasks.workunit.client.1.smithi135.stdout:6/516: rename d2/l1c to d2/da/d1d/d86/lb1 0 2024-05-09T00:07:33.591 INFO:tasks.workunit.client.1.smithi135.stdout:6/517: write d2/d20/f36 [1990287,114269] 0 2024-05-09T00:07:33.592 INFO:tasks.workunit.client.1.smithi135.stdout:2/521: truncate d1/d22/f28 1179083 0 2024-05-09T00:07:33.592 INFO:tasks.workunit.client.1.smithi135.stdout:2/522: chown d1/d12/d20/d3b/d40/f8a 701330 1 2024-05-09T00:07:33.593 INFO:tasks.workunit.client.1.smithi135.stdout:1/528: unlink da/d14/d20/d38/l72 0 2024-05-09T00:07:33.593 INFO:tasks.workunit.client.1.smithi135.stdout:1/529: fsync da/d24/d27/d33/d7d/fb8 0 2024-05-09T00:07:33.593 INFO:tasks.workunit.client.1.smithi135.stdout:1/530: stat da/d14/d5c/f6b 0 2024-05-09T00:07:33.594 INFO:tasks.workunit.client.1.smithi135.stdout:6/518: mknod d2/d20/d2e/cb2 0 2024-05-09T00:07:33.595 INFO:tasks.workunit.client.1.smithi135.stdout:7/589: dwrite db/da8/f80 [0,4194304] 0 2024-05-09T00:07:33.596 INFO:tasks.workunit.client.1.smithi135.stdout:7/590: readlink db/d1e/d3a/d40/d4c/d67/l76 0 2024-05-09T00:07:33.596 INFO:tasks.workunit.client.1.smithi135.stdout:2/523: link d1/d12/d20/d2b/d56/d86/l9d d1/d12/d20/laf 0 2024-05-09T00:07:33.596 INFO:tasks.workunit.client.1.smithi135.stdout:1/531: getdents da/d24/d27/d33/d52/d71/d8d 0 2024-05-09T00:07:33.597 INFO:tasks.workunit.client.1.smithi135.stdout:6/519: rename d2/d20/d3f/d4f/d7f/c8f to d2/da/d26/d57/d59/d62/da8/cb3 0 2024-05-09T00:07:33.600 INFO:tasks.workunit.client.1.smithi135.stdout:2/524: creat d1/d12/d21/d41/d6d/d6e/fb0 x:0 0 0 2024-05-09T00:07:33.601 INFO:tasks.workunit.client.1.smithi135.stdout:1/532: creat da/d14/d20/d38/d3a/d40/d75/fc2 x:0 0 0 2024-05-09T00:07:33.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/546: dwrite d3/dd/d2d/f49 [0,4194304] 0 2024-05-09T00:07:33.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/547: chown d3/dd/d2d/f68 7 1 2024-05-09T00:07:33.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/548: dread - d3/dd/d3f/d29/d54/f87 zero size 2024-05-09T00:07:33.603 INFO:tasks.workunit.client.1.smithi135.stdout:7/591: rename db/f47 to db/dd/d33/da5/fc6 0 2024-05-09T00:07:33.603 INFO:tasks.workunit.client.1.smithi135.stdout:6/520: symlink d2/da/d49/da6/lb4 0 2024-05-09T00:07:33.604 INFO:tasks.workunit.client.1.smithi135.stdout:2/525: mkdir d1/d12/d21/db1 0 2024-05-09T00:07:33.605 INFO:tasks.workunit.client.1.smithi135.stdout:9/432: dwrite d1/d1a/d10/d3c/d43/f83 [0,4194304] 0 2024-05-09T00:07:33.605 INFO:tasks.workunit.client.1.smithi135.stdout:1/533: mknod da/d24/cc3 0 2024-05-09T00:07:33.606 INFO:tasks.workunit.client.1.smithi135.stdout:0/549: getdents d3 0 2024-05-09T00:07:33.606 INFO:tasks.workunit.client.1.smithi135.stdout:3/543: dwrite d8/f23 [0,4194304] 0 2024-05-09T00:07:33.608 INFO:tasks.workunit.client.1.smithi135.stdout:7/592: mkdir db/dd/d33/d58/dc7 0 2024-05-09T00:07:33.608 INFO:tasks.workunit.client.1.smithi135.stdout:7/593: fdatasync db/d1e/d3a/d40/d84/f85 0 2024-05-09T00:07:33.608 INFO:tasks.workunit.client.1.smithi135.stdout:7/594: readlink db/d13/l26 0 2024-05-09T00:07:33.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/526: creat d1/d12/d20/d2b/d56/d72/fb2 x:0 0 0 2024-05-09T00:07:33.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/527: fdatasync d1/d12/d21/d41/d6d/f92 0 2024-05-09T00:07:33.612 INFO:tasks.workunit.client.1.smithi135.stdout:9/433: rename d1/d1a/d10/d3c/d5c/d6c to d1/d24/d44/d54/d66/d87 0 2024-05-09T00:07:33.612 INFO:tasks.workunit.client.1.smithi135.stdout:6/521: dread d2/d1a/f1b [0,4194304] 0 2024-05-09T00:07:33.613 INFO:tasks.workunit.client.1.smithi135.stdout:1/534: mknod da/d24/cc4 0 2024-05-09T00:07:33.614 INFO:tasks.workunit.client.1.smithi135.stdout:0/550: getdents d3/dd/d2d 0 2024-05-09T00:07:33.614 INFO:tasks.workunit.client.1.smithi135.stdout:0/551: write d3/dd/f6c [1857954,111773] 0 2024-05-09T00:07:33.618 INFO:tasks.workunit.client.1.smithi135.stdout:7/595: mkdir db/d1e/d3a/d40/d4c/d67/dc8 0 2024-05-09T00:07:33.620 INFO:tasks.workunit.client.1.smithi135.stdout:7/596: dread db/d21/f8b [0,4194304] 0 2024-05-09T00:07:33.620 INFO:tasks.workunit.client.1.smithi135.stdout:7/597: readlink db/l92 0 2024-05-09T00:07:33.622 INFO:tasks.workunit.client.1.smithi135.stdout:3/544: rename d8/d13/d1f/f43 to d8/d6d/d44/d4b/d59/d90/d7b/d80/fbd 0 2024-05-09T00:07:33.624 INFO:tasks.workunit.client.1.smithi135.stdout:9/434: rmdir d1/d1a/d10/d3c 39 2024-05-09T00:07:33.624 INFO:tasks.workunit.client.1.smithi135.stdout:2/528: dwrite d1/d12/d20/d3b/f5f [0,4194304] 0 2024-05-09T00:07:33.624 INFO:tasks.workunit.client.1.smithi135.stdout:2/529: truncate d1/d12/d20/d2b/d56/d67/f7a 1689534 0 2024-05-09T00:07:33.625 INFO:tasks.workunit.client.1.smithi135.stdout:6/522: symlink d2/da/d26/d57/lb5 0 2024-05-09T00:07:33.626 INFO:tasks.workunit.client.1.smithi135.stdout:1/535: link da/d73/f78 da/d14/d20/d38/d3a/d40/fc5 0 2024-05-09T00:07:33.628 INFO:tasks.workunit.client.1.smithi135.stdout:0/552: symlink d3/dd/d2d/l97 0 2024-05-09T00:07:33.629 INFO:tasks.workunit.client.1.smithi135.stdout:7/598: creat db/da8/fc9 x:0 0 0 2024-05-09T00:07:33.630 INFO:tasks.workunit.client.1.smithi135.stdout:7/599: write db/dd/f14 [968608,71072] 0 2024-05-09T00:07:33.630 INFO:tasks.workunit.client.1.smithi135.stdout:7/600: getdents db/d1e/d3a/d40/d4c/d67/dc8 0 2024-05-09T00:07:33.630 INFO:tasks.workunit.client.1.smithi135.stdout:9/435: getdents d1/d24/d44/d54 0 2024-05-09T00:07:33.634 INFO:tasks.workunit.client.1.smithi135.stdout:2/530: rename d1/d12/d20/d3b/d40/f8b to d1/d12/fb3 0 2024-05-09T00:07:33.634 INFO:tasks.workunit.client.1.smithi135.stdout:1/536: fdatasync da/db/f64 0 2024-05-09T00:07:33.634 INFO:tasks.workunit.client.1.smithi135.stdout:4/441: sync 2024-05-09T00:07:33.635 INFO:tasks.workunit.client.1.smithi135.stdout:3/545: dwrite d8/d13/d75/d58/fa6 [0,4194304] 0 2024-05-09T00:07:33.635 INFO:tasks.workunit.client.1.smithi135.stdout:3/546: readlink d8/d13/d1f/d40/lb6 0 2024-05-09T00:07:33.636 INFO:tasks.workunit.client.1.smithi135.stdout:0/553: rename d3/dd/f6c to d3/dd/f98 0 2024-05-09T00:07:33.636 INFO:tasks.workunit.client.1.smithi135.stdout:0/554: write d3/f23 [1245373,105918] 0 2024-05-09T00:07:33.636 INFO:tasks.workunit.client.1.smithi135.stdout:0/555: write d3/dd/d3f/d58/f6d [4489806,21867] 0 2024-05-09T00:07:33.636 INFO:tasks.workunit.client.1.smithi135.stdout:2/531: dread d1/d12/d20/d2b/f90 [4194304,4194304] 0 2024-05-09T00:07:33.640 INFO:tasks.workunit.client.1.smithi135.stdout:7/601: mkdir db/dd/dca 0 2024-05-09T00:07:33.642 INFO:tasks.workunit.client.1.smithi135.stdout:9/436: creat d1/d1a/f88 x:0 0 0 2024-05-09T00:07:33.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:31.904332+0000 mgr.smithi135.kkrhgf (mgr.24419) 45 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 839 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 94 MiB/s wr, 157 op/s 2024-05-09T00:07:33.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:33.108878+0000 mon.smithi135 (mon.1) 59 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:07:33.645 INFO:tasks.workunit.client.1.smithi135.stdout:0/556: dread d3/dd/d3f/d58/f71 [0,4194304] 0 2024-05-09T00:07:33.645 INFO:tasks.workunit.client.1.smithi135.stdout:6/523: rename d2/d1a/c46 to d2/da/d1d/d69/cb6 0 2024-05-09T00:07:33.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:31.904332+0000 mgr.smithi135.kkrhgf (mgr.24419) 45 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 839 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 94 MiB/s wr, 157 op/s 2024-05-09T00:07:33.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:33.108878+0000 mon.smithi135 (mon.1) 59 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:07:33.648 INFO:tasks.workunit.client.1.smithi135.stdout:4/442: dwrite dc/d26/d4e/f56 [0,4194304] 0 2024-05-09T00:07:33.648 INFO:tasks.workunit.client.1.smithi135.stdout:4/443: fsync f7 0 2024-05-09T00:07:33.648 INFO:tasks.workunit.client.1.smithi135.stdout:2/532: mkdir d1/d12/d21/d41/d6d/db4 0 2024-05-09T00:07:33.649 INFO:tasks.workunit.client.1.smithi135.stdout:4/444: write dc/dd/f14 [946610,82648] 0 2024-05-09T00:07:33.650 INFO:tasks.workunit.client.1.smithi135.stdout:9/437: mkdir d1/d1a/d89 0 2024-05-09T00:07:33.651 INFO:tasks.workunit.client.1.smithi135.stdout:5/566: sync 2024-05-09T00:07:33.651 INFO:tasks.workunit.client.1.smithi135.stdout:8/539: sync 2024-05-09T00:07:33.651 INFO:tasks.workunit.client.1.smithi135.stdout:5/567: fdatasync db/d84/f49 0 2024-05-09T00:07:33.651 INFO:tasks.workunit.client.1.smithi135.stdout:5/568: write db/d3f/f61 [2737296,36108] 0 2024-05-09T00:07:33.651 INFO:tasks.workunit.client.1.smithi135.stdout:5/569: stat db/d24/d32/d5b/f76 0 2024-05-09T00:07:33.652 INFO:tasks.workunit.client.1.smithi135.stdout:8/540: write d4/d7/d2a/d56/f61 [1502566,68725] 0 2024-05-09T00:07:33.652 INFO:tasks.workunit.client.1.smithi135.stdout:1/537: rename da/d24/d27/d33/d48/d6f to da/d14/d20/d38/d3a/db7/dc6 0 2024-05-09T00:07:33.653 INFO:tasks.workunit.client.1.smithi135.stdout:6/524: getdents d2/d20 0 2024-05-09T00:07:33.657 INFO:tasks.workunit.client.1.smithi135.stdout:4/445: mkdir dc/d26/d93/d9d 0 2024-05-09T00:07:33.664 INFO:tasks.workunit.client.1.smithi135.stdout:0/557: unlink d3/dd/d3f/c7a 0 2024-05-09T00:07:33.665 INFO:tasks.workunit.client.1.smithi135.stdout:5/570: creat db/d84/d62/d73/d9c/d9f/fb4 x:0 0 0 2024-05-09T00:07:33.665 INFO:tasks.workunit.client.1.smithi135.stdout:5/571: write f4 [2676555,34333] 0 2024-05-09T00:07:33.667 INFO:tasks.workunit.client.1.smithi135.stdout:8/541: unlink d4/d7/d4a/fa1 0 2024-05-09T00:07:33.668 INFO:tasks.workunit.client.1.smithi135.stdout:8/542: write d4/d7/d2a/d67/f75 [624649,49610] 0 2024-05-09T00:07:33.669 INFO:tasks.workunit.client.1.smithi135.stdout:3/547: rename d8/d13/d1f/f48 to d8/d6d/d44/d4b/d59/fbe 0 2024-05-09T00:07:33.671 INFO:tasks.workunit.client.1.smithi135.stdout:1/538: creat da/d14/d20/fc7 x:0 0 0 2024-05-09T00:07:33.673 INFO:tasks.workunit.client.1.smithi135.stdout:6/525: mknod d2/da/d26/d57/d59/d62/cb7 0 2024-05-09T00:07:33.673 INFO:tasks.workunit.client.1.smithi135.stdout:6/526: chown d2/da/d1d/d86 1361130 1 2024-05-09T00:07:33.677 INFO:tasks.workunit.client.1.smithi135.stdout:7/602: rename db/d5b/f5c to db/d1e/fcb 0 2024-05-09T00:07:33.677 INFO:tasks.workunit.client.1.smithi135.stdout:7/603: write db/da8/d78/f87 [1124811,106795] 0 2024-05-09T00:07:33.677 INFO:tasks.workunit.client.1.smithi135.stdout:7/604: truncate db/da8/fc9 1022349 0 2024-05-09T00:07:33.677 INFO:tasks.workunit.client.1.smithi135.stdout:5/572: dread db/f94 [0,4194304] 0 2024-05-09T00:07:33.678 INFO:tasks.workunit.client.1.smithi135.stdout:8/543: rename d4/d7/de/d45/l6e to d4/d7/d2a/d56/lbd 0 2024-05-09T00:07:33.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/527: write d2/da/d26/d57/f6c [3205029,40433] 0 2024-05-09T00:07:33.680 INFO:tasks.workunit.client.1.smithi135.stdout:4/446: dwrite dc/d4a/d69/d55/d5f/f83 [0,4194304] 0 2024-05-09T00:07:33.680 INFO:tasks.workunit.client.1.smithi135.stdout:2/533: dwrite d1/d12/d21/d57/fa2 [0,4194304] 0 2024-05-09T00:07:33.681 INFO:tasks.workunit.client.1.smithi135.stdout:7/605: mknod db/dd/d33/d58/ccc 0 2024-05-09T00:07:33.681 INFO:tasks.workunit.client.1.smithi135.stdout:7/606: write db/d1e/d3a/d40/f6a [660282,55207] 0 2024-05-09T00:07:33.682 INFO:tasks.workunit.client.1.smithi135.stdout:9/438: dwrite d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:33.682 INFO:tasks.workunit.client.1.smithi135.stdout:5/573: rmdir db/d3f 39 2024-05-09T00:07:33.683 INFO:tasks.workunit.client.1.smithi135.stdout:7/607: write db/dd/d33/da5/fc6 [293515,30723] 0 2024-05-09T00:07:33.683 INFO:tasks.workunit.client.1.smithi135.stdout:7/608: fdatasync db/d1e/d94/f9a 0 2024-05-09T00:07:33.684 INFO:tasks.workunit.client.1.smithi135.stdout:8/544: link d4/d7/f2f d4/d7/d2a/d56/fbe 0 2024-05-09T00:07:33.689 INFO:tasks.workunit.client.1.smithi135.stdout:8/545: dread d4/d7/de/d45/d76/f78 [0,4194304] 0 2024-05-09T00:07:33.692 INFO:tasks.workunit.client.1.smithi135.stdout:6/528: rename d2/d20/d2e/d3d/f48 to d2/d20/d37/d4e/d9d/fb8 0 2024-05-09T00:07:33.692 INFO:tasks.workunit.client.1.smithi135.stdout:6/529: fsync d2/da/f3b 0 2024-05-09T00:07:33.698 INFO:tasks.workunit.client.1.smithi135.stdout:7/609: link db/dd/d33/da5/fac db/d1e/d3a/d40/d4c/da3/fcd 0 2024-05-09T00:07:33.698 INFO:tasks.workunit.client.1.smithi135.stdout:7/610: stat db/dd/l11 0 2024-05-09T00:07:33.698 INFO:tasks.workunit.client.1.smithi135.stdout:9/439: symlink d1/d1a/d2c/d2d/l8a 0 2024-05-09T00:07:33.700 INFO:tasks.workunit.client.1.smithi135.stdout:8/546: dread d4/d7/d33/d39/f70 [0,4194304] 0 2024-05-09T00:07:33.701 INFO:tasks.workunit.client.1.smithi135.stdout:3/548: dwrite d8/f10 [4194304,4194304] 0 2024-05-09T00:07:33.701 INFO:tasks.workunit.client.1.smithi135.stdout:3/549: chown d8/d13/d1f/d40/fb5 15868662 1 2024-05-09T00:07:33.701 INFO:tasks.workunit.client.1.smithi135.stdout:9/440: rmdir d1/d24/d44/d54/d66 39 2024-05-09T00:07:33.701 INFO:tasks.workunit.client.1.smithi135.stdout:9/441: truncate d1/d1a/d2c/d2d/f73 1113465 0 2024-05-09T00:07:33.701 INFO:tasks.workunit.client.1.smithi135.stdout:9/442: stat d1/d1a/d2c/d20/c75 0 2024-05-09T00:07:33.701 INFO:tasks.workunit.client.1.smithi135.stdout:9/443: readlink d1/d1a/d2c/l3a 0 2024-05-09T00:07:33.701 INFO:tasks.workunit.client.1.smithi135.stdout:9/444: readlink d1/d1a/d2c/d20/l2e 0 2024-05-09T00:07:33.704 INFO:tasks.workunit.client.1.smithi135.stdout:7/611: mknod db/dd/d33/d58/dc7/cce 0 2024-05-09T00:07:33.707 INFO:tasks.workunit.client.1.smithi135.stdout:3/550: link d8/d13/d75/d58/f8a d8/d6d/d44/d4b/d59/d90/d7b/fbf 0 2024-05-09T00:07:33.709 INFO:tasks.workunit.client.1.smithi135.stdout:9/445: rename d1/d1a/l4d to d1/d24/d86/l8b 0 2024-05-09T00:07:33.711 INFO:tasks.workunit.client.1.smithi135.stdout:8/547: write d4/d7/d33/d39/f70 [5795528,43455] 0 2024-05-09T00:07:33.711 INFO:tasks.workunit.client.1.smithi135.stdout:8/548: dread - d4/d7/d2a/f6f zero size 2024-05-09T00:07:33.711 INFO:tasks.workunit.client.1.smithi135.stdout:3/551: write d8/d13/f1b [2056846,30714] 0 2024-05-09T00:07:33.712 INFO:tasks.workunit.client.1.smithi135.stdout:3/552: chown d8/d6d/d44/d4b/da0/daa 1 1 2024-05-09T00:07:33.712 INFO:tasks.workunit.client.1.smithi135.stdout:7/612: rename db/c43 to db/dd/ccf 0 2024-05-09T00:07:33.712 INFO:tasks.workunit.client.1.smithi135.stdout:7/613: readlink db/d13/l18 0 2024-05-09T00:07:33.714 INFO:tasks.workunit.client.1.smithi135.stdout:8/549: creat d4/d8/da2/da6/db8/fbf x:0 0 0 2024-05-09T00:07:33.714 INFO:tasks.workunit.client.1.smithi135.stdout:8/550: chown d4/d7/d2a/d56/f7c 132118 1 2024-05-09T00:07:33.715 INFO:tasks.workunit.client.1.smithi135.stdout:3/553: rmdir d8/d13/d51/d92 39 2024-05-09T00:07:33.717 INFO:tasks.workunit.client.1.smithi135.stdout:6/530: getdents d2/d20/d2e/d3d 0 2024-05-09T00:07:33.718 INFO:tasks.workunit.client.1.smithi135.stdout:7/614: mkdir db/d21/dd0 0 2024-05-09T00:07:33.719 INFO:tasks.workunit.client.1.smithi135.stdout:0/558: dwrite d3/dd/d3f/d58/f6d [0,4194304] 0 2024-05-09T00:07:33.720 INFO:tasks.workunit.client.1.smithi135.stdout:4/447: dwrite dc/d4a/d69/d55/d5f/f97 [0,4194304] 0 2024-05-09T00:07:33.720 INFO:tasks.workunit.client.1.smithi135.stdout:4/448: chown l4 95122 1 2024-05-09T00:07:33.721 INFO:tasks.workunit.client.1.smithi135.stdout:8/551: symlink d4/d8/da2/lc0 0 2024-05-09T00:07:33.721 INFO:tasks.workunit.client.1.smithi135.stdout:8/552: fsync d4/d22/f27 0 2024-05-09T00:07:33.722 INFO:tasks.workunit.client.1.smithi135.stdout:8/553: write d4/f58 [1299910,12678] 0 2024-05-09T00:07:33.722 INFO:tasks.workunit.client.1.smithi135.stdout:3/554: creat d8/d6d/d44/d4b/d59/d90/d7b/fc0 x:0 0 0 2024-05-09T00:07:33.723 INFO:tasks.workunit.client.1.smithi135.stdout:1/539: dwrite da/d24/d27/d33/fb0 [0,4194304] 0 2024-05-09T00:07:33.724 INFO:tasks.workunit.client.1.smithi135.stdout:7/615: unlink db/dd/d33/d58/l6d 0 2024-05-09T00:07:33.724 INFO:tasks.workunit.client.1.smithi135.stdout:7/616: dread - db/da8/fbb zero size 2024-05-09T00:07:33.727 INFO:tasks.workunit.client.1.smithi135.stdout:5/574: dwrite db/d3f/f57 [0,4194304] 0 2024-05-09T00:07:33.727 INFO:tasks.workunit.client.1.smithi135.stdout:2/534: dwrite d1/d12/d20/d2b/f37 [0,4194304] 0 2024-05-09T00:07:33.727 INFO:tasks.workunit.client.1.smithi135.stdout:5/575: fdatasync db/d24/f34 0 2024-05-09T00:07:33.727 INFO:tasks.workunit.client.1.smithi135.stdout:5/576: write f9 [1440072,60546] 0 2024-05-09T00:07:33.729 INFO:tasks.workunit.client.1.smithi135.stdout:8/554: mknod d4/d7/d2a/d96/cc1 0 2024-05-09T00:07:33.732 INFO:tasks.workunit.client.1.smithi135.stdout:3/555: creat d8/d6d/d44/d4b/da0/daa/fc1 x:0 0 0 2024-05-09T00:07:33.732 INFO:tasks.workunit.client.1.smithi135.stdout:7/617: creat db/dd/d33/d58/db5/fd1 x:0 0 0 2024-05-09T00:07:33.733 INFO:tasks.workunit.client.1.smithi135.stdout:3/556: mkdir d8/d6d/d44/d4b/dc2 0 2024-05-09T00:07:33.737 INFO:tasks.workunit.client.1.smithi135.stdout:3/557: mknod d8/d6d/d44/d4b/d59/cc3 0 2024-05-09T00:07:33.737 INFO:tasks.workunit.client.1.smithi135.stdout:3/558: getdents d8/d13/d51/d63/d89 0 2024-05-09T00:07:33.737 INFO:tasks.workunit.client.1.smithi135.stdout:7/618: creat db/fd2 x:0 0 0 2024-05-09T00:07:33.737 INFO:tasks.workunit.client.1.smithi135.stdout:7/619: chown db/d1e/d3a/d40/c88 59316 1 2024-05-09T00:07:33.739 INFO:tasks.workunit.client.1.smithi135.stdout:3/559: creat d8/d6d/d44/d4b/d59/d90/d7b/d80/fc4 x:0 0 0 2024-05-09T00:07:33.740 INFO:tasks.workunit.client.1.smithi135.stdout:7/620: mkdir db/dd/d33/dd3 0 2024-05-09T00:07:33.740 INFO:tasks.workunit.client.1.smithi135.stdout:7/621: fdatasync db/dd/fb7 0 2024-05-09T00:07:33.742 INFO:tasks.workunit.client.1.smithi135.stdout:3/560: rename d8/f17 to d8/d6d/d44/d4b/d59/d90/fc5 0 2024-05-09T00:07:33.743 INFO:tasks.workunit.client.1.smithi135.stdout:3/561: truncate d8/d6d/f20 869069 0 2024-05-09T00:07:33.743 INFO:tasks.workunit.client.1.smithi135.stdout:3/562: write d8/d6d/d44/d4b/da0/daa/f8f [70327,5026] 0 2024-05-09T00:07:33.745 INFO:tasks.workunit.client.1.smithi135.stdout:7/622: rmdir db/d13 39 2024-05-09T00:07:33.746 INFO:tasks.workunit.client.1.smithi135.stdout:9/446: dwrite d1/d1a/f42 [0,4194304] 0 2024-05-09T00:07:33.751 INFO:tasks.workunit.client.1.smithi135.stdout:3/563: symlink d8/d13/d51/d63/db9/lc6 0 2024-05-09T00:07:33.751 INFO:tasks.workunit.client.1.smithi135.stdout:7/623: symlink db/d1e/d3a/d40/d4c/d67/ld4 0 2024-05-09T00:07:33.751 INFO:tasks.workunit.client.1.smithi135.stdout:3/564: readlink d8/d6d/d44/d4b/d69/l5e 0 2024-05-09T00:07:33.760 INFO:tasks.workunit.client.1.smithi135.stdout:3/565: symlink d8/d13/d51/d63/db9/lc7 0 2024-05-09T00:07:33.760 INFO:tasks.workunit.client.1.smithi135.stdout:6/531: dread d2/f58 [0,4194304] 0 2024-05-09T00:07:33.763 INFO:tasks.workunit.client.1.smithi135.stdout:9/447: rename d1/d24/d44/l4e to d1/d1a/d2c/d2d/l8c 0 2024-05-09T00:07:33.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/449: dwrite dc/d26/d4e/f56 [4194304,4194304] 0 2024-05-09T00:07:33.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/450: dread - dc/d4a/d69/d39/f68 zero size 2024-05-09T00:07:33.763 INFO:tasks.workunit.client.1.smithi135.stdout:3/566: mknod d8/d13/d75/d53/d6a/cc8 0 2024-05-09T00:07:33.763 INFO:tasks.workunit.client.1.smithi135.stdout:9/448: rmdir d1/d1a/d10/d3c/d5c 39 2024-05-09T00:07:33.765 INFO:tasks.workunit.client.1.smithi135.stdout:6/532: rename d2/da/d26/l93 to d2/da/d26/d57/d59/lb9 0 2024-05-09T00:07:33.766 INFO:tasks.workunit.client.1.smithi135.stdout:4/451: mkdir dc/d4a/d69/d55/d5f/d5a/d9e 0 2024-05-09T00:07:33.775 INFO:tasks.workunit.client.1.smithi135.stdout:3/567: mkdir d8/d6d/d44/d4b/da0/daa/dc9 0 2024-05-09T00:07:33.783 INFO:tasks.workunit.client.1.smithi135.stdout:6/533: dwrite d2/d1a/f24 [0,4194304] 0 2024-05-09T00:07:33.783 INFO:tasks.workunit.client.1.smithi135.stdout:6/534: write d2/f96 [907966,38631] 0 2024-05-09T00:07:33.783 INFO:tasks.workunit.client.1.smithi135.stdout:6/535: truncate d2/da/d1d/d69/f9c 216027 0 2024-05-09T00:07:33.784 INFO:tasks.workunit.client.1.smithi135.stdout:6/536: stat d2/da/d1d/d69/cb6 0 2024-05-09T00:07:33.784 INFO:tasks.workunit.client.1.smithi135.stdout:6/537: truncate d2/da/d26/f55 6648891 0 2024-05-09T00:07:33.786 INFO:tasks.workunit.client.1.smithi135.stdout:1/540: dwrite da/d14/d20/d38/d3a/f8b [0,4194304] 0 2024-05-09T00:07:33.787 INFO:tasks.workunit.client.1.smithi135.stdout:5/577: dwrite db/d84/f49 [0,4194304] 0 2024-05-09T00:07:33.788 INFO:tasks.workunit.client.1.smithi135.stdout:2/535: dwrite d1/d12/d21/f4a [0,4194304] 0 2024-05-09T00:07:33.788 INFO:tasks.workunit.client.1.smithi135.stdout:7/624: dwrite db/d21/d98/fa1 [0,4194304] 0 2024-05-09T00:07:33.788 INFO:tasks.workunit.client.1.smithi135.stdout:7/625: write db/dd/d33/d68/f9c [894476,14330] 0 2024-05-09T00:07:33.788 INFO:tasks.workunit.client.1.smithi135.stdout:8/555: dwrite d4/f89 [4194304,4194304] 0 2024-05-09T00:07:33.788 INFO:tasks.workunit.client.1.smithi135.stdout:4/452: dwrite dc/d26/f2a [0,4194304] 0 2024-05-09T00:07:33.791 INFO:tasks.workunit.client.1.smithi135.stdout:8/556: write d4/d7/de/f35 [274512,127853] 0 2024-05-09T00:07:33.791 INFO:tasks.workunit.client.1.smithi135.stdout:8/557: dread - d4/d7/de/d45/d76/f99 zero size 2024-05-09T00:07:33.791 INFO:tasks.workunit.client.1.smithi135.stdout:1/541: mknod da/d14/d20/d38/d3a/d40/d96/cc8 0 2024-05-09T00:07:33.793 INFO:tasks.workunit.client.1.smithi135.stdout:5/578: getdents db/d84 0 2024-05-09T00:07:33.795 INFO:tasks.workunit.client.1.smithi135.stdout:6/538: dread d2/da/d49/f23 [0,4194304] 0 2024-05-09T00:07:33.795 INFO:tasks.workunit.client.1.smithi135.stdout:5/579: read db/d3f/f57 [2968717,2084] 0 2024-05-09T00:07:33.796 INFO:tasks.workunit.client.1.smithi135.stdout:2/536: rename d1/d12/d20/d2b/d56/d67 to d1/d12/d20/d2b/d7c/db5 0 2024-05-09T00:07:33.796 INFO:tasks.workunit.client.1.smithi135.stdout:2/537: chown d1/d12/d21 47952 1 2024-05-09T00:07:33.798 INFO:tasks.workunit.client.1.smithi135.stdout:7/626: read - db/d1e/d3a/d40/d7e/fb9 zero size 2024-05-09T00:07:33.803 INFO:tasks.workunit.client.1.smithi135.stdout:1/542: dread da/d14/d5c/d83/f92 [0,4194304] 0 2024-05-09T00:07:33.803 INFO:tasks.workunit.client.1.smithi135.stdout:1/543: truncate da/d24/d27/d33/d52/d71/d8d/fab 84323 0 2024-05-09T00:07:33.904 INFO:tasks.workunit.client.1.smithi135.stdout:8/558: truncate d4/d7/f74 1437921 0 2024-05-09T00:07:33.906 INFO:tasks.workunit.client.1.smithi135.stdout:6/539: rmdir d2/d1a/d7a 39 2024-05-09T00:07:33.906 INFO:tasks.workunit.client.1.smithi135.stdout:6/540: chown d2/d20/d3f/f44 63 1 2024-05-09T00:07:33.908 INFO:tasks.workunit.client.1.smithi135.stdout:5/580: unlink db/d24/d32/f79 0 2024-05-09T00:07:33.908 INFO:tasks.workunit.client.1.smithi135.stdout:5/581: fsync db/d24/f98 0 2024-05-09T00:07:33.908 INFO:tasks.workunit.client.1.smithi135.stdout:5/582: write db/d24/f8c [1006653,124690] 0 2024-05-09T00:07:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:5/583: dread - db/d96/f9a zero size 2024-05-09T00:07:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:5/584: fdatasync db/d24/f34 0 2024-05-09T00:07:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:8/559: dread d4/d7/d33/f55 [0,4194304] 0 2024-05-09T00:07:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:8/560: write d4/d7/d33/d39/f48 [5105064,90564] 0 2024-05-09T00:07:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:8/561: chown d4/d8/da2/lc0 1 1 2024-05-09T00:07:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:8/562: write d4/d7/d2a/fb5 [167973,66764] 0 2024-05-09T00:07:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:2/538: mknod d1/d12/d20/d2b/d56/d72/cb6 0 2024-05-09T00:07:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:7/627: chown db/d1e/d94 54905 1 2024-05-09T00:07:33.914 INFO:tasks.workunit.client.1.smithi135.stdout:4/453: symlink dc/d4a/d69/d39/l9f 0 2024-05-09T00:07:33.916 INFO:tasks.workunit.client.1.smithi135.stdout:6/541: creat d2/d5f/fba x:0 0 0 2024-05-09T00:07:33.916 INFO:tasks.workunit.client.1.smithi135.stdout:6/542: chown d2/da/d26/d57/d59/lb9 442 1 2024-05-09T00:07:33.918 INFO:tasks.workunit.client.1.smithi135.stdout:5/585: creat db/d24/fb5 x:0 0 0 2024-05-09T00:07:33.920 INFO:tasks.workunit.client.1.smithi135.stdout:8/563: unlink d4/d7/d33/d39/c60 0 2024-05-09T00:07:33.922 INFO:tasks.workunit.client.1.smithi135.stdout:2/539: rename d1/d12/d20/d2b/f8f to d1/d12/d20/d3b/d40/fb7 0 2024-05-09T00:07:33.923 INFO:tasks.workunit.client.1.smithi135.stdout:6/543: creat d2/da/d26/d57/d59/d62/fbb x:0 0 0 2024-05-09T00:07:33.926 INFO:tasks.workunit.client.1.smithi135.stdout:5/586: unlink db/d96/f9b 0 2024-05-09T00:07:33.931 INFO:tasks.workunit.client.1.smithi135.stdout:8/564: dread d4/f89 [0,4194304] 0 2024-05-09T00:07:33.931 INFO:tasks.workunit.client.1.smithi135.stdout:7/628: rename db/d21/d98/fa1 to db/fd5 0 2024-05-09T00:07:33.931 INFO:tasks.workunit.client.1.smithi135.stdout:2/540: mknod d1/d12/d20/cb8 0 2024-05-09T00:07:33.931 INFO:tasks.workunit.client.1.smithi135.stdout:6/544: rename d2/da/c12 to d2/d20/d37/d4e/cbc 0 2024-05-09T00:07:33.931 INFO:tasks.workunit.client.1.smithi135.stdout:7/629: getdents db/d1e/d3a/d40 0 2024-05-09T00:07:33.933 INFO:tasks.workunit.client.1.smithi135.stdout:2/541: creat d1/d12/d20/d2b/d56/d72/fb9 x:0 0 0 2024-05-09T00:07:33.933 INFO:tasks.workunit.client.1.smithi135.stdout:2/542: stat d1/d12/d20/d3b/d4f/f6a 0 2024-05-09T00:07:33.933 INFO:tasks.workunit.client.1.smithi135.stdout:6/545: mkdir d2/d20/d3f/d4f/d7f/dbd 0 2024-05-09T00:07:33.935 INFO:tasks.workunit.client.1.smithi135.stdout:5/587: rename db/f11 to db/d5d/fb6 0 2024-05-09T00:07:33.936 INFO:tasks.workunit.client.1.smithi135.stdout:7/630: getdents db/d1e 0 2024-05-09T00:07:33.937 INFO:tasks.workunit.client.1.smithi135.stdout:2/543: symlink d1/d12/d21/d41/d6d/lba 0 2024-05-09T00:07:33.938 INFO:tasks.workunit.client.1.smithi135.stdout:6/546: creat d2/da/d26/d57/d60/fbe x:0 0 0 2024-05-09T00:07:33.940 INFO:tasks.workunit.client.1.smithi135.stdout:7/631: rename db/c41 to db/cd6 0 2024-05-09T00:07:33.941 INFO:tasks.workunit.client.1.smithi135.stdout:6/547: creat d2/d20/d2e/fbf x:0 0 0 2024-05-09T00:07:33.942 INFO:tasks.workunit.client.1.smithi135.stdout:7/632: creat db/dd/d33/d58/fd7 x:0 0 0 2024-05-09T00:07:33.943 INFO:tasks.workunit.client.1.smithi135.stdout:5/588: dread db/f7f [0,4194304] 0 2024-05-09T00:07:33.944 INFO:tasks.workunit.client.1.smithi135.stdout:6/548: write d2/d1a/f1b [3959331,82694] 0 2024-05-09T00:07:33.944 INFO:tasks.workunit.client.1.smithi135.stdout:7/633: rename db/dd/f65 to db/d21/dd0/fd8 0 2024-05-09T00:07:33.944 INFO:tasks.workunit.client.1.smithi135.stdout:7/634: chown db/d1e/d3a/d40/d4c/l7f 23473658 1 2024-05-09T00:07:33.944 INFO:tasks.workunit.client.1.smithi135.stdout:7/635: fdatasync db/d1e/fcb 0 2024-05-09T00:07:33.946 INFO:tasks.workunit.client.1.smithi135.stdout:5/589: symlink db/d84/d62/d73/lb7 0 2024-05-09T00:07:33.947 INFO:tasks.workunit.client.1.smithi135.stdout:6/549: getdents d2/da/d26/d57/d59/d62/da8 0 2024-05-09T00:07:33.949 INFO:tasks.workunit.client.1.smithi135.stdout:7/636: creat db/d21/fd9 x:0 0 0 2024-05-09T00:07:33.950 INFO:tasks.workunit.client.1.smithi135.stdout:5/590: getdents db/d84/d31/d5e 0 2024-05-09T00:07:33.952 INFO:tasks.workunit.client.1.smithi135.stdout:6/550: creat d2/da/d26/fc0 x:0 0 0 2024-05-09T00:07:33.954 INFO:tasks.workunit.client.1.smithi135.stdout:6/551: dread d2/f96 [0,4194304] 0 2024-05-09T00:07:33.957 INFO:tasks.workunit.client.1.smithi135.stdout:6/552: symlink d2/d1a/lc1 0 2024-05-09T00:07:33.957 INFO:tasks.workunit.client.1.smithi135.stdout:6/553: fdatasync d2/d5f/f6d 0 2024-05-09T00:07:33.957 INFO:tasks.workunit.client.1.smithi135.stdout:6/554: read - d2/d20/d2e/fa0 zero size 2024-05-09T00:07:33.957 INFO:tasks.workunit.client.1.smithi135.stdout:5/591: dread db/d24/d32/f47 [0,4194304] 0 2024-05-09T00:07:33.957 INFO:tasks.workunit.client.1.smithi135.stdout:5/592: write db/d84/faf [262387,59450] 0 2024-05-09T00:07:33.959 INFO:tasks.workunit.client.1.smithi135.stdout:6/555: symlink d2/da/d26/d57/d59/d62/da8/lc2 0 2024-05-09T00:07:33.959 INFO:tasks.workunit.client.1.smithi135.stdout:0/559: sync 2024-05-09T00:07:33.962 INFO:tasks.workunit.client.1.smithi135.stdout:9/449: sync 2024-05-09T00:07:33.962 INFO:tasks.workunit.client.1.smithi135.stdout:1/544: sync 2024-05-09T00:07:33.962 INFO:tasks.workunit.client.1.smithi135.stdout:3/568: sync 2024-05-09T00:07:33.963 INFO:tasks.workunit.client.1.smithi135.stdout:6/556: rename d2/d20/d3f/l9a to d2/da/d1d/lc3 0 2024-05-09T00:07:33.963 INFO:tasks.workunit.client.1.smithi135.stdout:9/450: symlink d1/d24/d44/d7f/l8d 0 2024-05-09T00:07:33.963 INFO:tasks.workunit.client.1.smithi135.stdout:9/451: chown d1/d24/d44/d54/l57 13386713 1 2024-05-09T00:07:33.964 INFO:tasks.workunit.client.1.smithi135.stdout:3/569: read d8/d13/d51/f86 [458751,129798] 0 2024-05-09T00:07:33.965 INFO:tasks.workunit.client.1.smithi135.stdout:5/593: dread db/d84/f3c [0,4194304] 0 2024-05-09T00:07:33.965 INFO:tasks.workunit.client.1.smithi135.stdout:9/452: creat d1/d1a/d2c/f8e x:0 0 0 2024-05-09T00:07:33.965 INFO:tasks.workunit.client.1.smithi135.stdout:9/453: dread - d1/d1a/d2c/f84 zero size 2024-05-09T00:07:33.967 INFO:tasks.workunit.client.1.smithi135.stdout:3/570: getdents d8/d13/d75/d53 0 2024-05-09T00:07:33.967 INFO:tasks.workunit.client.1.smithi135.stdout:3/571: truncate d8/d13/d51/d92/fb1 50340 0 2024-05-09T00:07:33.967 INFO:tasks.workunit.client.1.smithi135.stdout:6/557: symlink d2/lc4 0 2024-05-09T00:07:33.968 INFO:tasks.workunit.client.1.smithi135.stdout:5/594: mknod db/d24/db0/cb8 0 2024-05-09T00:07:33.968 INFO:tasks.workunit.client.1.smithi135.stdout:5/595: chown db/f21 64448909 1 2024-05-09T00:07:33.969 INFO:tasks.workunit.client.1.smithi135.stdout:9/454: stat d1/d1a/d2c/d2d/c48 0 2024-05-09T00:07:33.970 INFO:tasks.workunit.client.1.smithi135.stdout:3/572: creat d8/d6d/d44/d4b/d69/fca x:0 0 0 2024-05-09T00:07:33.972 INFO:tasks.workunit.client.1.smithi135.stdout:6/558: getdents d2/d1a/d7a 0 2024-05-09T00:07:33.974 INFO:tasks.workunit.client.1.smithi135.stdout:9/455: unlink d1/d1a/d2c/d20/l2a 0 2024-05-09T00:07:33.974 INFO:tasks.workunit.client.1.smithi135.stdout:9/456: truncate d1/d24/f47 2365381 0 2024-05-09T00:07:33.974 INFO:tasks.workunit.client.1.smithi135.stdout:9/457: readlink d1/d1a/d2c/d2d/l4a 0 2024-05-09T00:07:33.976 INFO:tasks.workunit.client.1.smithi135.stdout:9/458: symlink d1/d1a/d2c/l8f 0 2024-05-09T00:07:33.978 INFO:tasks.workunit.client.1.smithi135.stdout:7/637: dwrite db/fd5 [4194304,4194304] 0 2024-05-09T00:07:33.978 INFO:tasks.workunit.client.1.smithi135.stdout:9/459: creat d1/d1a/d10/f90 x:0 0 0 2024-05-09T00:07:33.981 INFO:tasks.workunit.client.1.smithi135.stdout:1/545: dwrite da/db/f34 [0,4194304] 0 2024-05-09T00:07:33.987 INFO:tasks.workunit.client.1.smithi135.stdout:7/638: creat db/dd/d33/dd3/fda x:0 0 0 2024-05-09T00:07:33.989 INFO:tasks.workunit.client.1.smithi135.stdout:9/460: creat d1/d1a/d89/f91 x:0 0 0 2024-05-09T00:07:33.999 INFO:tasks.workunit.client.1.smithi135.stdout:5/596: dwrite db/d24/d32/d5b/d91/f7c [0,4194304] 0 2024-05-09T00:07:33.999 INFO:tasks.workunit.client.1.smithi135.stdout:0/560: dwrite d3/f23 [0,4194304] 0 2024-05-09T00:07:34.000 INFO:tasks.workunit.client.1.smithi135.stdout:0/561: chown d3/f23 54000758 1 2024-05-09T00:07:34.000 INFO:tasks.workunit.client.1.smithi135.stdout:5/597: chown db/d24/db0/cb8 64326998 1 2024-05-09T00:07:34.001 INFO:tasks.workunit.client.1.smithi135.stdout:1/546: dwrite da/d14/d20/f2b [4194304,4194304] 0 2024-05-09T00:07:34.002 INFO:tasks.workunit.client.1.smithi135.stdout:5/598: dread db/d84/d31/f90 [0,4194304] 0 2024-05-09T00:07:34.006 INFO:tasks.workunit.client.1.smithi135.stdout:0/562: write d3/dd/d3f/f33 [5045399,18140] 0 2024-05-09T00:07:34.006 INFO:tasks.workunit.client.1.smithi135.stdout:0/563: readlink d3/dd/d3f/d58/l74 0 2024-05-09T00:07:34.007 INFO:tasks.workunit.client.1.smithi135.stdout:0/564: write d3/dd/d3f/d58/f5c [304471,85271] 0 2024-05-09T00:07:34.008 INFO:tasks.workunit.client.1.smithi135.stdout:7/639: dread db/d1e/d94/f9a [0,4194304] 0 2024-05-09T00:07:34.009 INFO:tasks.workunit.client.1.smithi135.stdout:6/559: dread d2/d1a/f81 [0,4194304] 0 2024-05-09T00:07:34.009 INFO:tasks.workunit.client.1.smithi135.stdout:3/573: dwrite d8/d6d/d44/d4b/d69/fca [0,4194304] 0 2024-05-09T00:07:34.009 INFO:tasks.workunit.client.1.smithi135.stdout:3/574: chown d8/d13/d51/d63 21757 1 2024-05-09T00:07:34.011 INFO:tasks.workunit.client.1.smithi135.stdout:1/547: symlink da/d14/d20/d38/d3a/d40/lc9 0 2024-05-09T00:07:34.012 INFO:tasks.workunit.client.1.smithi135.stdout:5/599: truncate f9 1112305 0 2024-05-09T00:07:34.014 INFO:tasks.workunit.client.1.smithi135.stdout:0/565: creat d3/dd/d3f/d29/d54/f99 x:0 0 0 2024-05-09T00:07:34.019 INFO:tasks.workunit.client.1.smithi135.stdout:7/640: dread db/fd5 [4194304,4194304] 0 2024-05-09T00:07:34.019 INFO:tasks.workunit.client.1.smithi135.stdout:7/641: truncate db/fd2 873154 0 2024-05-09T00:07:34.020 INFO:tasks.workunit.client.1.smithi135.stdout:6/560: mknod d2/d20/d2e/cc5 0 2024-05-09T00:07:34.022 INFO:tasks.workunit.client.1.smithi135.stdout:3/575: creat d8/d13/d1f/d40/d52/fcb x:0 0 0 2024-05-09T00:07:34.024 INFO:tasks.workunit.client.1.smithi135.stdout:1/548: creat da/d24/fca x:0 0 0 2024-05-09T00:07:34.025 INFO:tasks.workunit.client.1.smithi135.stdout:0/566: write d3/dd/d2d/f40 [3304266,30830] 0 2024-05-09T00:07:34.027 INFO:tasks.workunit.client.1.smithi135.stdout:6/561: creat d2/da/d49/fc6 x:0 0 0 2024-05-09T00:07:34.029 INFO:tasks.workunit.client.1.smithi135.stdout:3/576: rename d8/d6d/d44/d4b/da0/fab to d8/d13/fcc 0 2024-05-09T00:07:34.030 INFO:tasks.workunit.client.1.smithi135.stdout:5/600: dwrite db/f15 [0,4194304] 0 2024-05-09T00:07:34.030 INFO:tasks.workunit.client.1.smithi135.stdout:5/601: stat db/d24/db0/cb8 0 2024-05-09T00:07:34.031 INFO:tasks.workunit.client.1.smithi135.stdout:1/549: creat da/d14/d5c/d83/fcb x:0 0 0 2024-05-09T00:07:34.034 INFO:tasks.workunit.client.1.smithi135.stdout:6/562: creat d2/da/d49/da4/fc7 x:0 0 0 2024-05-09T00:07:34.034 INFO:tasks.workunit.client.1.smithi135.stdout:6/563: fsync d2/da/d1d/f5e 0 2024-05-09T00:07:34.034 INFO:tasks.workunit.client.1.smithi135.stdout:6/564: dread - d2/d20/d37/d4e/f6a zero size 2024-05-09T00:07:34.035 INFO:tasks.workunit.client.1.smithi135.stdout:3/577: creat d8/d13/d1f/d40/fcd x:0 0 0 2024-05-09T00:07:34.036 INFO:tasks.workunit.client.1.smithi135.stdout:5/602: truncate db/d3f/f4d 2371303 0 2024-05-09T00:07:34.036 INFO:tasks.workunit.client.1.smithi135.stdout:5/603: fdatasync f4 0 2024-05-09T00:07:34.037 INFO:tasks.workunit.client.1.smithi135.stdout:4/454: sync 2024-05-09T00:07:34.037 INFO:tasks.workunit.client.1.smithi135.stdout:4/455: getdents dc/d26/d31/d96 0 2024-05-09T00:07:34.037 INFO:tasks.workunit.client.1.smithi135.stdout:7/642: dwrite db/d1e/d94/fb2 [0,4194304] 0 2024-05-09T00:07:34.038 INFO:tasks.workunit.client.1.smithi135.stdout:6/565: creat d2/da/d1d/fc8 x:0 0 0 2024-05-09T00:07:34.040 INFO:tasks.workunit.client.1.smithi135.stdout:3/578: symlink d8/d13/d1f/d40/lce 0 2024-05-09T00:07:34.040 INFO:tasks.workunit.client.1.smithi135.stdout:5/604: creat db/fb9 x:0 0 0 2024-05-09T00:07:34.041 INFO:tasks.workunit.client.1.smithi135.stdout:5/605: write db/d3f/f57 [3563595,88342] 0 2024-05-09T00:07:34.044 INFO:tasks.workunit.client.1.smithi135.stdout:1/550: rename da/db/l55 to da/d24/d27/d33/d7d/lcc 0 2024-05-09T00:07:34.044 INFO:tasks.workunit.client.1.smithi135.stdout:1/551: truncate da/d24/d27/d33/d52/d71/faa 1022792 0 2024-05-09T00:07:34.045 INFO:tasks.workunit.client.1.smithi135.stdout:6/566: creat d2/da/d1d/d69/d78/fc9 x:0 0 0 2024-05-09T00:07:34.046 INFO:tasks.workunit.client.1.smithi135.stdout:3/579: symlink d8/d6d/d44/d4b/d59/d90/lcf 0 2024-05-09T00:07:34.049 INFO:tasks.workunit.client.1.smithi135.stdout:1/552: mknod da/d14/d5c/d83/ccd 0 2024-05-09T00:07:34.051 INFO:tasks.workunit.client.1.smithi135.stdout:6/567: unlink d2/d20/d2e/d3d/f47 0 2024-05-09T00:07:34.053 INFO:tasks.workunit.client.1.smithi135.stdout:3/580: rename d8/d13/d75/f96 to d8/d13/d75/d53/d6a/fd0 0 2024-05-09T00:07:34.056 INFO:tasks.workunit.client.1.smithi135.stdout:6/568: rename d2/d20/d37/d4e/f8b to d2/d20/d3f/d4f/d7f/fca 0 2024-05-09T00:07:34.057 INFO:tasks.workunit.client.1.smithi135.stdout:3/581: link d8/d6d/c8b d8/d13/d51/d63/cd1 0 2024-05-09T00:07:34.059 INFO:tasks.workunit.client.1.smithi135.stdout:6/569: unlink d2/da/d1d/d86/lb1 0 2024-05-09T00:07:34.060 INFO:tasks.workunit.client.1.smithi135.stdout:3/582: getdents d8/d6d/d44/d4b/da0 0 2024-05-09T00:07:34.062 INFO:tasks.workunit.client.1.smithi135.stdout:6/570: symlink d2/da/d1d/d69/d89/lcb 0 2024-05-09T00:07:34.071 INFO:tasks.workunit.client.1.smithi135.stdout:3/583: mknod d8/d6d/d44/d4b/d59/d90/d7b/cd2 0 2024-05-09T00:07:34.071 INFO:tasks.workunit.client.1.smithi135.stdout:7/643: dwrite db/d1e/d3a/d40/d4c/fc3 [0,4194304] 0 2024-05-09T00:07:34.072 INFO:tasks.workunit.client.1.smithi135.stdout:5/606: dwrite db/f7f [0,4194304] 0 2024-05-09T00:07:34.072 INFO:tasks.workunit.client.1.smithi135.stdout:1/553: dread da/f41 [0,4194304] 0 2024-05-09T00:07:34.072 INFO:tasks.workunit.client.1.smithi135.stdout:5/607: dread db/d24/d32/d5b/f6a [0,4194304] 0 2024-05-09T00:07:34.072 INFO:tasks.workunit.client.1.smithi135.stdout:5/608: readlink db/d84/d31/d5e/l86 0 2024-05-09T00:07:34.072 INFO:tasks.workunit.client.1.smithi135.stdout:4/456: dwrite dc/d4a/d69/d55/d5f/f84 [0,4194304] 0 2024-05-09T00:07:34.073 INFO:tasks.workunit.client.1.smithi135.stdout:6/571: dread d2/d20/d3f/d4f/d7f/fca [0,4194304] 0 2024-05-09T00:07:34.074 INFO:tasks.workunit.client.1.smithi135.stdout:4/457: mknod dc/d4a/d69/ca0 0 2024-05-09T00:07:34.075 INFO:tasks.workunit.client.1.smithi135.stdout:0/567: dwrite d3/dd/d3f/d58/f71 [0,4194304] 0 2024-05-09T00:07:34.075 INFO:tasks.workunit.client.1.smithi135.stdout:3/584: dread d8/f11 [0,4194304] 0 2024-05-09T00:07:34.075 INFO:tasks.workunit.client.1.smithi135.stdout:0/568: getdents d3/dd/d3f/d29/d7c 0 2024-05-09T00:07:34.075 INFO:tasks.workunit.client.1.smithi135.stdout:7/644: dread db/d21/dd0/fd8 [0,4194304] 0 2024-05-09T00:07:34.076 INFO:tasks.workunit.client.1.smithi135.stdout:6/572: symlink d2/da/d26/d57/lcc 0 2024-05-09T00:07:34.076 INFO:tasks.workunit.client.1.smithi135.stdout:6/573: write d2/d20/d37/d4e/faa [825452,61089] 0 2024-05-09T00:07:34.076 INFO:tasks.workunit.client.1.smithi135.stdout:6/574: chown d2/da/d26/l34 190482044 1 2024-05-09T00:07:34.078 INFO:tasks.workunit.client.1.smithi135.stdout:4/458: unlink dc/d4a/f76 0 2024-05-09T00:07:34.088 INFO:tasks.workunit.client.1.smithi135.stdout:3/585: unlink d8/lb 0 2024-05-09T00:07:34.089 INFO:tasks.workunit.client.1.smithi135.stdout:3/586: write d8/d13/d75/d58/f76 [2753954,915] 0 2024-05-09T00:07:34.089 INFO:tasks.workunit.client.1.smithi135.stdout:3/587: fdatasync d8/fa8 0 2024-05-09T00:07:34.089 INFO:tasks.workunit.client.1.smithi135.stdout:3/588: stat d8/d13/d75/d53/d6a/fd0 0 2024-05-09T00:07:34.092 INFO:tasks.workunit.client.1.smithi135.stdout:5/609: dwrite db/d84/f43 [0,4194304] 0 2024-05-09T00:07:34.092 INFO:tasks.workunit.client.1.smithi135.stdout:7/645: rename db/d5b/c97 to db/d21/d98/cdb 0 2024-05-09T00:07:34.097 INFO:tasks.workunit.client.1.smithi135.stdout:6/575: getdents d2 0 2024-05-09T00:07:34.097 INFO:tasks.workunit.client.1.smithi135.stdout:6/576: fsync d2/d5f/fba 0 2024-05-09T00:07:34.098 INFO:tasks.workunit.client.1.smithi135.stdout:6/577: write d2/f58 [3034850,24274] 0 2024-05-09T00:07:34.099 INFO:tasks.workunit.client.1.smithi135.stdout:0/569: mkdir d3/dd/d2d/d4c/d84/d9a 0 2024-05-09T00:07:34.099 INFO:tasks.workunit.client.1.smithi135.stdout:0/570: chown d3/c20 506 1 2024-05-09T00:07:34.099 INFO:tasks.workunit.client.1.smithi135.stdout:0/571: write d3/dd/d3f/d29/f7f [563140,6338] 0 2024-05-09T00:07:34.102 INFO:tasks.workunit.client.1.smithi135.stdout:6/578: unlink d2/d1a/f81 0 2024-05-09T00:07:34.103 INFO:tasks.workunit.client.1.smithi135.stdout:4/459: symlink dc/d4a/d69/d39/la1 0 2024-05-09T00:07:34.104 INFO:tasks.workunit.client.1.smithi135.stdout:4/460: read dc/d4a/d69/d55/d5f/f83 [930072,38278] 0 2024-05-09T00:07:34.104 INFO:tasks.workunit.client.1.smithi135.stdout:4/461: chown dc/dd/f3d 482579471 1 2024-05-09T00:07:34.104 INFO:tasks.workunit.client.1.smithi135.stdout:4/462: chown dc/d4a/d69/d55/d5f/f21 5305932 1 2024-05-09T00:07:34.105 INFO:tasks.workunit.client.1.smithi135.stdout:0/572: symlink d3/dd/d2d/d4c/d84/l9b 0 2024-05-09T00:07:34.107 INFO:tasks.workunit.client.1.smithi135.stdout:7/646: dread db/d13/f2a [0,4194304] 0 2024-05-09T00:07:34.107 INFO:tasks.workunit.client.1.smithi135.stdout:1/554: dwrite da/f41 [0,4194304] 0 2024-05-09T00:07:34.108 INFO:tasks.workunit.client.1.smithi135.stdout:6/579: symlink d2/da/d1d/d86/lcd 0 2024-05-09T00:07:34.108 INFO:tasks.workunit.client.1.smithi135.stdout:6/580: write d2/d5f/f6d [941360,59514] 0 2024-05-09T00:07:34.108 INFO:tasks.workunit.client.1.smithi135.stdout:6/581: chown d2/da/f3b 24234 1 2024-05-09T00:07:34.109 INFO:tasks.workunit.client.1.smithi135.stdout:4/463: creat dc/d26/d4e/fa2 x:0 0 0 2024-05-09T00:07:34.110 INFO:tasks.workunit.client.1.smithi135.stdout:3/589: dread d8/d13/f19 [0,4194304] 0 2024-05-09T00:07:34.112 INFO:tasks.workunit.client.1.smithi135.stdout:8/565: sync 2024-05-09T00:07:34.112 INFO:tasks.workunit.client.1.smithi135.stdout:2/544: sync 2024-05-09T00:07:34.113 INFO:tasks.workunit.client.1.smithi135.stdout:9/461: sync 2024-05-09T00:07:34.113 INFO:tasks.workunit.client.1.smithi135.stdout:9/462: chown d1/d1a/d10/f90 17 1 2024-05-09T00:07:34.113 INFO:tasks.workunit.client.1.smithi135.stdout:9/463: readlink d1/d1a/d10/l56 0 2024-05-09T00:07:34.114 INFO:tasks.workunit.client.1.smithi135.stdout:0/573: write d3/dd/d2d/f96 [60638,104739] 0 2024-05-09T00:07:34.119 INFO:tasks.workunit.client.1.smithi135.stdout:6/582: mkdir d2/da/d49/da4/dce 0 2024-05-09T00:07:34.119 INFO:tasks.workunit.client.1.smithi135.stdout:2/545: mkdir d1/d12/d20/d2b/dbb 0 2024-05-09T00:07:34.119 INFO:tasks.workunit.client.1.smithi135.stdout:9/464: rmdir d1/d24/d44/d7f 39 2024-05-09T00:07:34.121 INFO:tasks.workunit.client.1.smithi135.stdout:3/590: rmdir d8/d13/d1f/d62 39 2024-05-09T00:07:34.122 INFO:tasks.workunit.client.1.smithi135.stdout:0/574: rename d3/dd/f51 to d3/dd/d3f/d29/f9c 0 2024-05-09T00:07:34.123 INFO:tasks.workunit.client.1.smithi135.stdout:1/555: mkdir da/dce 0 2024-05-09T00:07:34.123 INFO:tasks.workunit.client.1.smithi135.stdout:6/583: symlink d2/da/d1d/d69/d89/lcf 0 2024-05-09T00:07:34.127 INFO:tasks.workunit.client.1.smithi135.stdout:0/575: creat d3/dd/d3f/d3a/d46/f9d x:0 0 0 2024-05-09T00:07:34.127 INFO:tasks.workunit.client.1.smithi135.stdout:1/556: symlink da/d14/d20/d38/d86/lcf 0 2024-05-09T00:07:34.128 INFO:tasks.workunit.client.1.smithi135.stdout:6/584: symlink d2/d1a/ld0 0 2024-05-09T00:07:34.130 INFO:tasks.workunit.client.1.smithi135.stdout:6/585: write d2/f96 [456585,80835] 0 2024-05-09T00:07:34.130 INFO:tasks.workunit.client.1.smithi135.stdout:1/557: mkdir da/d24/dd0 0 2024-05-09T00:07:34.131 INFO:tasks.workunit.client.1.smithi135.stdout:0/576: rename d3/dd/d2d/d7d to d3/d9e 0 2024-05-09T00:07:34.132 INFO:tasks.workunit.client.1.smithi135.stdout:9/465: dread d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:34.132 INFO:tasks.workunit.client.1.smithi135.stdout:9/466: fdatasync d1/f59 0 2024-05-09T00:07:34.132 INFO:tasks.workunit.client.1.smithi135.stdout:9/467: chown d1/d1a/d2c/l3a 8018828 1 2024-05-09T00:07:34.132 INFO:tasks.workunit.client.1.smithi135.stdout:9/468: fsync d1/d1a/f42 0 2024-05-09T00:07:34.132 INFO:tasks.workunit.client.1.smithi135.stdout:6/586: link d2/d20/d3f/la9 d2/d20/d37/ld1 0 2024-05-09T00:07:34.134 INFO:tasks.workunit.client.1.smithi135.stdout:1/558: creat da/d14/d20/d38/d86/fd1 x:0 0 0 2024-05-09T00:07:34.134 INFO:tasks.workunit.client.1.smithi135.stdout:1/559: truncate da/d73/f81 393726 0 2024-05-09T00:07:34.134 INFO:tasks.workunit.client.1.smithi135.stdout:0/577: write d3/dd/f4e [2433576,15050] 0 2024-05-09T00:07:34.139 INFO:tasks.workunit.client.1.smithi135.stdout:9/469: creat d1/d1a/d2c/d20/f92 x:0 0 0 2024-05-09T00:07:34.139 INFO:tasks.workunit.client.1.smithi135.stdout:7/647: dwrite db/d1e/fc5 [0,4194304] 0 2024-05-09T00:07:34.139 INFO:tasks.workunit.client.1.smithi135.stdout:6/587: link d2/l4a d2/d20/d3f/d4f/d7f/ld2 0 2024-05-09T00:07:34.139 INFO:tasks.workunit.client.1.smithi135.stdout:3/591: dread d8/d13/d1f/f6b [0,4194304] 0 2024-05-09T00:07:34.139 INFO:tasks.workunit.client.1.smithi135.stdout:8/566: dwrite d4/d7/d2a/d67/fb3 [0,4194304] 0 2024-05-09T00:07:34.139 INFO:tasks.workunit.client.1.smithi135.stdout:6/588: write d2/da/d1d/fc8 [603378,122234] 0 2024-05-09T00:07:34.140 INFO:tasks.workunit.client.1.smithi135.stdout:4/464: dwrite dc/d26/d31/f6f [0,4194304] 0 2024-05-09T00:07:34.143 INFO:tasks.workunit.client.1.smithi135.stdout:7/648: mknod db/dd/d33/d58/db5/cdc 0 2024-05-09T00:07:34.143 INFO:tasks.workunit.client.1.smithi135.stdout:1/560: rename da/db/ca3 to da/d14/d20/d2c/cd2 0 2024-05-09T00:07:34.145 INFO:tasks.workunit.client.1.smithi135.stdout:8/567: mkdir d4/d7/d2a/d96/dc2 0 2024-05-09T00:07:34.145 INFO:tasks.workunit.client.1.smithi135.stdout:8/568: readlink d4/l5f 0 2024-05-09T00:07:34.145 INFO:tasks.workunit.client.1.smithi135.stdout:8/569: chown d4/d7/d33/d39/lb1 6 1 2024-05-09T00:07:34.148 INFO:tasks.workunit.client.1.smithi135.stdout:1/561: creat da/d14/fd3 x:0 0 0 2024-05-09T00:07:34.151 INFO:tasks.workunit.client.1.smithi135.stdout:8/570: creat d4/d7/d4a/d9c/fc3 x:0 0 0 2024-05-09T00:07:34.151 INFO:tasks.workunit.client.1.smithi135.stdout:8/571: dread - d4/d22/f8a zero size 2024-05-09T00:07:34.152 INFO:tasks.workunit.client.1.smithi135.stdout:8/572: readlink d4/d7/d2a/d56/lbd 0 2024-05-09T00:07:34.152 INFO:tasks.workunit.client.1.smithi135.stdout:9/470: dread d1/d1a/d2c/f6d [0,4194304] 0 2024-05-09T00:07:34.152 INFO:tasks.workunit.client.1.smithi135.stdout:8/573: truncate d4/d7/d4a/f65 846637 0 2024-05-09T00:07:34.153 INFO:tasks.workunit.client.1.smithi135.stdout:8/574: chown d4/d7/d2a 7085457 1 2024-05-09T00:07:34.153 INFO:tasks.workunit.client.1.smithi135.stdout:8/575: dread - d4/d7/de/f7d zero size 2024-05-09T00:07:34.153 INFO:tasks.workunit.client.1.smithi135.stdout:9/471: mknod d1/d1a/d2c/c93 0 2024-05-09T00:07:34.154 INFO:tasks.workunit.client.1.smithi135.stdout:8/576: creat d4/d7/da4/fc4 x:0 0 0 2024-05-09T00:07:34.155 INFO:tasks.workunit.client.1.smithi135.stdout:7/649: dread db/dd/d33/da5/fc6 [0,4194304] 0 2024-05-09T00:07:34.155 INFO:tasks.workunit.client.1.smithi135.stdout:7/650: chown db/dd/d33/d58/db5 661477996 1 2024-05-09T00:07:34.156 INFO:tasks.workunit.client.1.smithi135.stdout:9/472: unlink d1/d1a/d2c/d20/c45 0 2024-05-09T00:07:34.158 INFO:tasks.workunit.client.1.smithi135.stdout:7/651: link db/d1e/d3a/cc1 db/d21/cdd 0 2024-05-09T00:07:34.161 INFO:tasks.workunit.client.1.smithi135.stdout:8/577: write d4/d7/f52 [4681067,85102] 0 2024-05-09T00:07:34.162 INFO:tasks.workunit.client.1.smithi135.stdout:8/578: write d4/d7/d2a/d67/f75 [480739,5695] 0 2024-05-09T00:07:34.168 INFO:tasks.workunit.client.1.smithi135.stdout:0/578: dwrite d3/f4f [0,4194304] 0 2024-05-09T00:07:34.169 INFO:tasks.workunit.client.1.smithi135.stdout:0/579: write d3/dd/f98 [2774356,90481] 0 2024-05-09T00:07:34.169 INFO:tasks.workunit.client.1.smithi135.stdout:6/589: dwrite d2/d20/d3f/d4f/d7f/fca [0,4194304] 0 2024-05-09T00:07:34.169 INFO:tasks.workunit.client.1.smithi135.stdout:4/465: dwrite dc/d26/d31/f99 [0,4194304] 0 2024-05-09T00:07:34.173 INFO:tasks.workunit.client.1.smithi135.stdout:0/580: getdents d3/dd/d3f/d29 0 2024-05-09T00:07:34.174 INFO:tasks.workunit.client.1.smithi135.stdout:2/546: dwrite d1/d12/d20/d2b/d56/d72/fb9 [0,4194304] 0 2024-05-09T00:07:34.183 INFO:tasks.workunit.client.1.smithi135.stdout:9/473: dwrite d1/d24/f47 [0,4194304] 0 2024-05-09T00:07:34.184 INFO:tasks.workunit.client.1.smithi135.stdout:8/579: dwrite d4/d7/da4/fc4 [0,4194304] 0 2024-05-09T00:07:34.184 INFO:tasks.workunit.client.1.smithi135.stdout:8/580: dread - d4/d7/de/f7d zero size 2024-05-09T00:07:34.185 INFO:tasks.workunit.client.1.smithi135.stdout:8/581: dread - d4/d7/d33/d39/f47 zero size 2024-05-09T00:07:34.185 INFO:tasks.workunit.client.1.smithi135.stdout:6/590: link d2/da/f3b d2/da/d26/d57/d60/fd3 0 2024-05-09T00:07:34.187 INFO:tasks.workunit.client.1.smithi135.stdout:4/466: creat dc/d4a/d69/d55/fa3 x:0 0 0 2024-05-09T00:07:34.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/547: symlink d1/d12/d21/d41/d6d/db4/lbc 0 2024-05-09T00:07:34.192 INFO:tasks.workunit.client.1.smithi135.stdout:9/474: unlink d1/d1a/f88 0 2024-05-09T00:07:34.192 INFO:tasks.workunit.client.1.smithi135.stdout:9/475: truncate d1/d1a/d2c/f8e 1037645 0 2024-05-09T00:07:34.193 INFO:tasks.workunit.client.1.smithi135.stdout:7/652: dwrite db/da8/f80 [0,4194304] 0 2024-05-09T00:07:34.196 INFO:tasks.workunit.client.1.smithi135.stdout:8/582: mkdir d4/d7/de/d45/dc5 0 2024-05-09T00:07:34.197 INFO:tasks.workunit.client.1.smithi135.stdout:6/591: symlink d2/da/d49/ld4 0 2024-05-09T00:07:34.198 INFO:tasks.workunit.client.1.smithi135.stdout:0/581: dwrite d3/dd/d3f/d58/f63 [0,4194304] 0 2024-05-09T00:07:34.199 INFO:tasks.workunit.client.1.smithi135.stdout:0/582: read - d3/dd/d3f/d43/f93 zero size 2024-05-09T00:07:34.199 INFO:tasks.workunit.client.1.smithi135.stdout:2/548: mkdir d1/d12/d21/d57/dbd 0 2024-05-09T00:07:34.199 INFO:tasks.workunit.client.1.smithi135.stdout:2/549: readlink d1/d12/d20/d2b/l74 0 2024-05-09T00:07:34.199 INFO:tasks.workunit.client.1.smithi135.stdout:7/653: mkdir db/dd/d33/d68/dde 0 2024-05-09T00:07:34.203 INFO:tasks.workunit.client.1.smithi135.stdout:8/583: mkdir d4/dc6 0 2024-05-09T00:07:34.203 INFO:tasks.workunit.client.1.smithi135.stdout:8/584: truncate d4/d7/de/d45/f7a 4914568 0 2024-05-09T00:07:34.204 INFO:tasks.workunit.client.1.smithi135.stdout:8/585: write d4/d7/d33/d39/f3b [2462934,19406] 0 2024-05-09T00:07:34.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/562: write da/d24/d27/d33/d52/f80 [12517,47234] 0 2024-05-09T00:07:34.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/563: write da/d24/d27/d33/d36/f65 [1994757,61891] 0 2024-05-09T00:07:34.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/564: dread - da/d24/d27/d33/f60 zero size 2024-05-09T00:07:34.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/583: getdents d3/dd/d3f 0 2024-05-09T00:07:34.210 INFO:tasks.workunit.client.1.smithi135.stdout:2/550: rename d1/d12/d20/d2b/d56/f76 to d1/d12/d21/d41/d6d/db4/fbe 0 2024-05-09T00:07:34.212 INFO:tasks.workunit.client.1.smithi135.stdout:7/654: link db/d1e/d94/f9a db/dd/d33/d58/db5/fdf 0 2024-05-09T00:07:34.212 INFO:tasks.workunit.client.1.smithi135.stdout:9/476: dwrite d1/d1a/d2c/f5d [0,4194304] 0 2024-05-09T00:07:34.214 INFO:tasks.workunit.client.1.smithi135.stdout:0/584: mknod d3/dd/d3f/d29/d7c/c9f 0 2024-05-09T00:07:34.215 INFO:tasks.workunit.client.1.smithi135.stdout:7/655: creat db/d1e/d3a/d40/d7e/fe0 x:0 0 0 2024-05-09T00:07:34.218 INFO:tasks.workunit.client.1.smithi135.stdout:1/565: dread da/d14/d20/d38/f8e [0,4194304] 0 2024-05-09T00:07:34.219 INFO:tasks.workunit.client.1.smithi135.stdout:0/585: mknod d3/dd/d3f/d58/ca0 0 2024-05-09T00:07:34.219 INFO:tasks.workunit.client.1.smithi135.stdout:0/586: truncate d3/dd/d2d/f40 4694850 0 2024-05-09T00:07:34.220 INFO:tasks.workunit.client.1.smithi135.stdout:8/586: dwrite d4/d7/de/f35 [0,4194304] 0 2024-05-09T00:07:34.224 INFO:tasks.workunit.client.1.smithi135.stdout:1/566: dread da/db/f61 [0,4194304] 0 2024-05-09T00:07:34.225 INFO:tasks.workunit.client.1.smithi135.stdout:1/567: read da/d14/d20/f97 [60929,65649] 0 2024-05-09T00:07:34.230 INFO:tasks.workunit.client.1.smithi135.stdout:1/568: write da/d14/d20/d2c/f99 [317290,3659] 0 2024-05-09T00:07:34.230 INFO:tasks.workunit.client.1.smithi135.stdout:0/587: dread d3/dd/d3f/d3a/f48 [0,4194304] 0 2024-05-09T00:07:34.230 INFO:tasks.workunit.client.1.smithi135.stdout:1/569: write da/d24/d27/d33/d52/d71/faa [1892342,19986] 0 2024-05-09T00:07:34.230 INFO:tasks.workunit.client.1.smithi135.stdout:1/570: fsync da/f62 0 2024-05-09T00:07:34.230 INFO:tasks.workunit.client.1.smithi135.stdout:1/571: readlink da/d24/d27/d33/d36/l5b 0 2024-05-09T00:07:34.233 INFO:tasks.workunit.client.1.smithi135.stdout:0/588: write d3/dd/d2d/f65 [356208,30100] 0 2024-05-09T00:07:34.234 INFO:tasks.workunit.client.1.smithi135.stdout:9/477: truncate d1/d1a/d2c/f8e 161784 0 2024-05-09T00:07:34.236 INFO:tasks.workunit.client.1.smithi135.stdout:1/572: mknod da/d24/d27/d33/cd4 0 2024-05-09T00:07:34.236 INFO:tasks.workunit.client.1.smithi135.stdout:1/573: chown da/d14/fd3 7554 1 2024-05-09T00:07:34.236 INFO:tasks.workunit.client.1.smithi135.stdout:5/610: sync 2024-05-09T00:07:34.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/478: link d1/d1a/d2c/d20/f92 d1/d1a/d10/d3c/d43/f94 0 2024-05-09T00:07:34.240 INFO:tasks.workunit.client.1.smithi135.stdout:1/574: creat da/d73/fd5 x:0 0 0 2024-05-09T00:07:34.244 INFO:tasks.workunit.client.1.smithi135.stdout:3/592: sync 2024-05-09T00:07:34.247 INFO:tasks.workunit.client.1.smithi135.stdout:5/611: creat db/d84/d62/d73/fba x:0 0 0 2024-05-09T00:07:34.247 INFO:tasks.workunit.client.1.smithi135.stdout:0/589: mknod d3/dd/d3f/d3a/ca1 0 2024-05-09T00:07:34.247 INFO:tasks.workunit.client.1.smithi135.stdout:1/575: stat da/db/f95 0 2024-05-09T00:07:34.248 INFO:tasks.workunit.client.1.smithi135.stdout:5/612: creat db/d84/d31/fbb x:0 0 0 2024-05-09T00:07:34.248 INFO:tasks.workunit.client.1.smithi135.stdout:7/656: dwrite db/da8/d78/f87 [0,4194304] 0 2024-05-09T00:07:34.248 INFO:tasks.workunit.client.1.smithi135.stdout:0/590: creat d3/d9e/fa2 x:0 0 0 2024-05-09T00:07:34.249 INFO:tasks.workunit.client.1.smithi135.stdout:7/657: write db/d1e/d3a/d40/d4c/f4f [4447405,112854] 0 2024-05-09T00:07:34.249 INFO:tasks.workunit.client.1.smithi135.stdout:1/576: creat da/d14/d20/d38/d3a/d40/fd6 x:0 0 0 2024-05-09T00:07:34.249 INFO:tasks.workunit.client.1.smithi135.stdout:5/613: symlink db/d24/d32/lbc 0 2024-05-09T00:07:34.252 INFO:tasks.workunit.client.1.smithi135.stdout:0/591: dread d3/dd/d3f/f72 [4194304,4194304] 0 2024-05-09T00:07:34.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/658: unlink db/d1e/d94/fb2 0 2024-05-09T00:07:34.254 INFO:tasks.workunit.client.1.smithi135.stdout:5/614: rename db/d84/cab to db/d5d/cbd 0 2024-05-09T00:07:34.255 INFO:tasks.workunit.client.1.smithi135.stdout:0/592: mkdir d3/dd/d3f/d43/da3 0 2024-05-09T00:07:34.256 INFO:tasks.workunit.client.1.smithi135.stdout:7/659: rename db/dd/c34 to db/d1e/d3a/d40/ce1 0 2024-05-09T00:07:34.257 INFO:tasks.workunit.client.1.smithi135.stdout:7/660: read db/d13/fae [59153,14413] 0 2024-05-09T00:07:34.257 INFO:tasks.workunit.client.1.smithi135.stdout:0/593: mkdir d3/dd/d3f/d3a/da4 0 2024-05-09T00:07:34.258 INFO:tasks.workunit.client.1.smithi135.stdout:7/661: creat db/d21/dd0/fe2 x:0 0 0 2024-05-09T00:07:34.262 INFO:tasks.workunit.client.1.smithi135.stdout:1/577: dread da/d14/d20/d38/f8e [0,4194304] 0 2024-05-09T00:07:34.263 INFO:tasks.workunit.client.1.smithi135.stdout:9/479: dwrite d1/d1a/d10/d3c/f4b [0,4194304] 0 2024-05-09T00:07:34.265 INFO:tasks.workunit.client.1.smithi135.stdout:2/551: dwrite d1/d12/d20/d2b/d56/d86/f88 [0,4194304] 0 2024-05-09T00:07:34.270 INFO:tasks.workunit.client.1.smithi135.stdout:8/587: dwrite d4/d7/d2a/d56/f7c [0,4194304] 0 2024-05-09T00:07:34.270 INFO:tasks.workunit.client.1.smithi135.stdout:8/588: write d4/d7/d2a/fb5 [307006,47520] 0 2024-05-09T00:07:34.270 INFO:tasks.workunit.client.1.smithi135.stdout:8/589: write d4/d7/de/f95 [5183766,128991] 0 2024-05-09T00:07:34.270 INFO:tasks.workunit.client.1.smithi135.stdout:8/590: write d4/d7/d4a/d9c/fc3 [347385,83673] 0 2024-05-09T00:07:34.274 INFO:tasks.workunit.client.1.smithi135.stdout:2/552: creat d1/d12/d21/d41/d6d/d6e/fbf x:0 0 0 2024-05-09T00:07:34.275 INFO:tasks.workunit.client.1.smithi135.stdout:2/553: write d1/d22/d63/f97 [1022771,82575] 0 2024-05-09T00:07:34.287 INFO:tasks.workunit.client.1.smithi135.stdout:5/615: dwrite db/d84/d62/f99 [0,4194304] 0 2024-05-09T00:07:34.288 INFO:tasks.workunit.client.1.smithi135.stdout:1/578: dwrite da/d14/d5c/d83/fcb [0,4194304] 0 2024-05-09T00:07:34.292 INFO:tasks.workunit.client.1.smithi135.stdout:1/579: link da/db/d70/la8 da/d24/d27/d33/d48/ld7 0 2024-05-09T00:07:34.293 INFO:tasks.workunit.client.1.smithi135.stdout:0/594: dwrite d3/d9e/fa2 [0,4194304] 0 2024-05-09T00:07:34.293 INFO:tasks.workunit.client.1.smithi135.stdout:0/595: write d3/dd/d3f/f75 [281098,23239] 0 2024-05-09T00:07:34.295 INFO:tasks.workunit.client.1.smithi135.stdout:8/591: dwrite d4/d7/d2a/d56/fbe [0,4194304] 0 2024-05-09T00:07:34.297 INFO:tasks.workunit.client.1.smithi135.stdout:2/554: dwrite d1/d12/d21/f38 [0,4194304] 0 2024-05-09T00:07:34.301 INFO:tasks.workunit.client.1.smithi135.stdout:1/580: rmdir da/d14/d20/d38/d3a/d40 39 2024-05-09T00:07:34.303 INFO:tasks.workunit.client.1.smithi135.stdout:0/596: getdents d3/dd/d2d 0 2024-05-09T00:07:34.305 INFO:tasks.workunit.client.1.smithi135.stdout:1/581: creat da/db/fd8 x:0 0 0 2024-05-09T00:07:34.305 INFO:tasks.workunit.client.1.smithi135.stdout:1/582: fsync da/d14/d20/d38/f4d 0 2024-05-09T00:07:34.306 INFO:tasks.workunit.client.1.smithi135.stdout:1/583: dread - da/d73/fd5 zero size 2024-05-09T00:07:34.306 INFO:tasks.workunit.client.1.smithi135.stdout:0/597: creat d3/dd/d3f/d29/d7c/fa5 x:0 0 0 2024-05-09T00:07:34.307 INFO:tasks.workunit.client.1.smithi135.stdout:8/592: dread d4/d7/de/d45/d76/f97 [0,4194304] 0 2024-05-09T00:07:34.307 INFO:tasks.workunit.client.1.smithi135.stdout:1/584: unlink da/d24/d27/d33/d36/f65 0 2024-05-09T00:07:34.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/598: creat d3/dd/d3f/d43/da3/fa6 x:0 0 0 2024-05-09T00:07:34.308 INFO:tasks.workunit.client.1.smithi135.stdout:8/593: truncate d4/d8/f6b 482106 0 2024-05-09T00:07:34.309 INFO:tasks.workunit.client.1.smithi135.stdout:0/599: read d3/dd/f26 [5265999,106425] 0 2024-05-09T00:07:34.309 INFO:tasks.workunit.client.1.smithi135.stdout:9/480: dwrite d1/d1a/f51 [0,4194304] 0 2024-05-09T00:07:34.310 INFO:tasks.workunit.client.1.smithi135.stdout:8/594: link d4/d7/de/c7e d4/d8/da2/da6/cc7 0 2024-05-09T00:07:34.311 INFO:tasks.workunit.client.1.smithi135.stdout:5/616: dwrite db/d84/f41 [0,4194304] 0 2024-05-09T00:07:34.315 INFO:tasks.workunit.client.1.smithi135.stdout:9/481: rename d1/l9 to d1/d24/l95 0 2024-05-09T00:07:34.315 INFO:tasks.workunit.client.1.smithi135.stdout:9/482: dread - d1/d1a/d10/d3c/d5c/f6b zero size 2024-05-09T00:07:34.316 INFO:tasks.workunit.client.1.smithi135.stdout:5/617: mkdir db/d84/d62/d73/dbe 0 2024-05-09T00:07:34.316 INFO:tasks.workunit.client.1.smithi135.stdout:5/618: write db/f12 [4703107,70927] 0 2024-05-09T00:07:34.317 INFO:tasks.workunit.client.1.smithi135.stdout:5/619: write db/d5d/dac/f82 [756357,11649] 0 2024-05-09T00:07:34.317 INFO:tasks.workunit.client.1.smithi135.stdout:5/620: truncate db/d84/d62/d73/d9c/d9f/d92/fa0 26994 0 2024-05-09T00:07:34.317 INFO:tasks.workunit.client.1.smithi135.stdout:8/595: rename d4/d8/da2/da6/db8/fbf to d4/d7/de/d45/fc8 0 2024-05-09T00:07:34.318 INFO:tasks.workunit.client.1.smithi135.stdout:9/483: creat d1/d24/d86/f96 x:0 0 0 2024-05-09T00:07:34.319 INFO:tasks.workunit.client.1.smithi135.stdout:9/484: fsync d1/d1a/d2c/d2d/f73 0 2024-05-09T00:07:34.319 INFO:tasks.workunit.client.1.smithi135.stdout:9/485: fdatasync d1/d1a/f67 0 2024-05-09T00:07:34.320 INFO:tasks.workunit.client.1.smithi135.stdout:5/621: mkdir db/d96/dbf 0 2024-05-09T00:07:34.320 INFO:tasks.workunit.client.1.smithi135.stdout:5/622: chown db/c1f 65813976 1 2024-05-09T00:07:34.321 INFO:tasks.workunit.client.1.smithi135.stdout:8/596: creat d4/d7/de/fc9 x:0 0 0 2024-05-09T00:07:34.321 INFO:tasks.workunit.client.1.smithi135.stdout:8/597: chown d4/d7/de/c7e 4433 1 2024-05-09T00:07:34.323 INFO:tasks.workunit.client.1.smithi135.stdout:9/486: rename d1/d24/d44/d54/d66/d87 to d1/d24/d86/d97 0 2024-05-09T00:07:34.324 INFO:tasks.workunit.client.1.smithi135.stdout:8/598: creat d4/d7/fca x:0 0 0 2024-05-09T00:07:34.324 INFO:tasks.workunit.client.1.smithi135.stdout:4/467: sync 2024-05-09T00:07:34.324 INFO:tasks.workunit.client.1.smithi135.stdout:0/600: dread d3/dd/f2f [0,4194304] 0 2024-05-09T00:07:34.325 INFO:tasks.workunit.client.1.smithi135.stdout:8/599: unlink d4/d7/d4a/f65 0 2024-05-09T00:07:34.326 INFO:tasks.workunit.client.1.smithi135.stdout:4/468: rmdir dc/d71/d86 39 2024-05-09T00:07:34.331 INFO:tasks.workunit.client.1.smithi135.stdout:8/600: link d4/f16 d4/d8/da2/da6/db8/fcb 0 2024-05-09T00:07:34.332 INFO:tasks.workunit.client.1.smithi135.stdout:5/623: dread db/d84/d31/d5e/f69 [4194304,4194304] 0 2024-05-09T00:07:34.334 INFO:tasks.workunit.client.1.smithi135.stdout:5/624: write db/d24/d32/f44 [2268432,100009] 0 2024-05-09T00:07:34.334 INFO:tasks.workunit.client.1.smithi135.stdout:5/625: truncate db/d24/f8c 1811175 0 2024-05-09T00:07:34.334 INFO:tasks.workunit.client.1.smithi135.stdout:8/601: rename d4/f16 to d4/d7/de/d45/dc5/fcc 0 2024-05-09T00:07:34.334 INFO:tasks.workunit.client.1.smithi135.stdout:8/602: readlink d4/d7/d33/d39/l3a 0 2024-05-09T00:07:34.334 INFO:tasks.workunit.client.1.smithi135.stdout:4/469: dread dc/d4a/d69/f51 [0,4194304] 0 2024-05-09T00:07:34.335 INFO:tasks.workunit.client.1.smithi135.stdout:9/487: dread d1/d1a/d2c/d2d/f3b [4194304,4194304] 0 2024-05-09T00:07:34.337 INFO:tasks.workunit.client.1.smithi135.stdout:5/626: mkdir db/d84/d62/d73/d9c/d9f/dc0 0 2024-05-09T00:07:34.338 INFO:tasks.workunit.client.1.smithi135.stdout:8/603: write d4/d7/d33/d39/f70 [6940601,77419] 0 2024-05-09T00:07:34.338 INFO:tasks.workunit.client.1.smithi135.stdout:8/604: fsync d4/f20 0 2024-05-09T00:07:34.343 INFO:tasks.workunit.client.1.smithi135.stdout:5/627: creat db/d24/db0/fc1 x:0 0 0 2024-05-09T00:07:34.357 INFO:tasks.workunit.client.1.smithi135.stdout:5/628: dread db/d84/f41 [0,4194304] 0 2024-05-09T00:07:34.360 INFO:tasks.workunit.client.1.smithi135.stdout:2/555: dwrite d1/d22/d63/f97 [0,4194304] 0 2024-05-09T00:07:34.363 INFO:tasks.workunit.client.1.smithi135.stdout:2/556: mknod d1/d12/cc0 0 2024-05-09T00:07:34.364 INFO:tasks.workunit.client.1.smithi135.stdout:2/557: truncate d1/d12/f8d 2016902 0 2024-05-09T00:07:34.369 INFO:tasks.workunit.client.1.smithi135.stdout:2/558: dread d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:34.370 INFO:tasks.workunit.client.1.smithi135.stdout:2/559: creat d1/d12/d20/d3b/d40/fc1 x:0 0 0 2024-05-09T00:07:34.374 INFO:tasks.workunit.client.1.smithi135.stdout:2/560: write d1/d12/d21/f4a [2512290,38996] 0 2024-05-09T00:07:34.375 INFO:tasks.workunit.client.1.smithi135.stdout:2/561: creat d1/d12/da3/fc2 x:0 0 0 2024-05-09T00:07:34.381 INFO:tasks.workunit.client.1.smithi135.stdout:2/562: dread d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:34.381 INFO:tasks.workunit.client.1.smithi135.stdout:9/488: dwrite d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:34.381 INFO:tasks.workunit.client.1.smithi135.stdout:2/563: fsync d1/d12/d20/f60 0 2024-05-09T00:07:34.381 INFO:tasks.workunit.client.1.smithi135.stdout:9/489: stat d1/d1a 0 2024-05-09T00:07:34.381 INFO:tasks.workunit.client.1.smithi135.stdout:2/564: chown d1/d12/d21/f38 0 1 2024-05-09T00:07:34.382 INFO:tasks.workunit.client.1.smithi135.stdout:1/585: dwrite da/d24/d27/d33/f39 [0,4194304] 0 2024-05-09T00:07:34.382 INFO:tasks.workunit.client.1.smithi135.stdout:0/601: dwrite d3/dd/d2d/f68 [0,4194304] 0 2024-05-09T00:07:34.382 INFO:tasks.workunit.client.1.smithi135.stdout:8/605: dwrite d4/d7/f74 [0,4194304] 0 2024-05-09T00:07:34.382 INFO:tasks.workunit.client.1.smithi135.stdout:4/470: dwrite dc/d4a/d69/f4c [0,4194304] 0 2024-05-09T00:07:34.382 INFO:tasks.workunit.client.1.smithi135.stdout:5/629: dwrite db/d3f/f61 [0,4194304] 0 2024-05-09T00:07:34.383 INFO:tasks.workunit.client.1.smithi135.stdout:9/490: creat d1/d1a/d2c/d20/f98 x:0 0 0 2024-05-09T00:07:34.384 INFO:tasks.workunit.client.1.smithi135.stdout:9/491: write d1/d1a/d2c/d2d/f82 [241209,8923] 0 2024-05-09T00:07:34.384 INFO:tasks.workunit.client.1.smithi135.stdout:1/586: symlink da/d14/d5c/ld9 0 2024-05-09T00:07:34.392 INFO:tasks.workunit.client.1.smithi135.stdout:5/630: dread db/d24/d32/d5b/f76 [0,4194304] 0 2024-05-09T00:07:34.400 INFO:tasks.workunit.client.1.smithi135.stdout:8/606: creat d4/d7/de/d45/dc5/fcd x:0 0 0 2024-05-09T00:07:34.404 INFO:tasks.workunit.client.1.smithi135.stdout:2/565: dread d1/d12/d21/d57/f95 [0,4194304] 0 2024-05-09T00:07:34.404 INFO:tasks.workunit.client.1.smithi135.stdout:2/566: rename d1/d12/d20 to d1/d12/d20/d3b/dc3 22 2024-05-09T00:07:34.405 INFO:tasks.workunit.client.1.smithi135.stdout:5/631: symlink db/d24/db0/lc2 0 2024-05-09T00:07:34.406 INFO:tasks.workunit.client.1.smithi135.stdout:0/602: dwrite d3/dd/f4e [0,4194304] 0 2024-05-09T00:07:34.406 INFO:tasks.workunit.client.1.smithi135.stdout:9/492: dwrite d1/d1a/d10/d3c/d43/f83 [0,4194304] 0 2024-05-09T00:07:34.411 INFO:tasks.workunit.client.1.smithi135.stdout:1/587: rmdir da/d14/d20/d2c/d7f 0 2024-05-09T00:07:34.412 INFO:tasks.workunit.client.1.smithi135.stdout:5/632: rename db/d24/f98 to db/d5d/dac/fc3 0 2024-05-09T00:07:34.415 INFO:tasks.workunit.client.1.smithi135.stdout:8/607: dread d4/d7/f74 [0,4194304] 0 2024-05-09T00:07:34.415 INFO:tasks.workunit.client.1.smithi135.stdout:8/608: chown d4/d7/de/d45/dc5 70433 1 2024-05-09T00:07:34.416 INFO:tasks.workunit.client.1.smithi135.stdout:0/603: dread d3/dd/d3f/d3a/f4a [0,4194304] 0 2024-05-09T00:07:34.421 INFO:tasks.workunit.client.1.smithi135.stdout:9/493: rmdir d1/d1a/d10 39 2024-05-09T00:07:34.421 INFO:tasks.workunit.client.1.smithi135.stdout:1/588: dread da/d14/d20/d38/d3a/d40/f68 [0,4194304] 0 2024-05-09T00:07:34.421 INFO:tasks.workunit.client.1.smithi135.stdout:9/494: chown d1/d24/d44/d54/d66/l7c 354499 1 2024-05-09T00:07:34.423 INFO:tasks.workunit.client.1.smithi135.stdout:2/567: symlink d1/lc4 0 2024-05-09T00:07:34.423 INFO:tasks.workunit.client.1.smithi135.stdout:0/604: dread d3/dd/d3f/d3a/f4a [0,4194304] 0 2024-05-09T00:07:34.424 INFO:tasks.workunit.client.1.smithi135.stdout:2/568: read d1/d12/f24 [2052059,114542] 0 2024-05-09T00:07:34.425 INFO:tasks.workunit.client.1.smithi135.stdout:5/633: unlink db/d84/d31/d5e/c8a 0 2024-05-09T00:07:34.425 INFO:tasks.workunit.client.1.smithi135.stdout:5/634: fsync db/f7f 0 2024-05-09T00:07:34.427 INFO:tasks.workunit.client.1.smithi135.stdout:8/609: unlink d4/d7/c18 0 2024-05-09T00:07:34.428 INFO:tasks.workunit.client.1.smithi135.stdout:1/589: dread da/d24/d27/d33/d52/f56 [0,4194304] 0 2024-05-09T00:07:34.429 INFO:tasks.workunit.client.1.smithi135.stdout:9/495: mkdir d1/d1a/d89/d99 0 2024-05-09T00:07:34.430 INFO:tasks.workunit.client.1.smithi135.stdout:4/471: rmdir dc/d7f 0 2024-05-09T00:07:34.430 INFO:tasks.workunit.client.1.smithi135.stdout:4/472: write dc/d26/d4e/f6e [2307267,101457] 0 2024-05-09T00:07:34.430 INFO:tasks.workunit.client.1.smithi135.stdout:4/473: chown dc/d4a/d69/d39/f68 0 1 2024-05-09T00:07:34.433 INFO:tasks.workunit.client.1.smithi135.stdout:2/569: mknod d1/d12/d21/db1/cc5 0 2024-05-09T00:07:34.434 INFO:tasks.workunit.client.1.smithi135.stdout:6/592: sync 2024-05-09T00:07:34.434 INFO:tasks.workunit.client.1.smithi135.stdout:1/590: creat da/d24/d27/d33/d36/fda x:0 0 0 2024-05-09T00:07:34.434 INFO:tasks.workunit.client.1.smithi135.stdout:9/496: symlink d1/d1a/d10/d3c/l9a 0 2024-05-09T00:07:34.434 INFO:tasks.workunit.client.1.smithi135.stdout:5/635: mkdir db/d84/d62/d73/d9c/d9f/dc0/dc4 0 2024-05-09T00:07:34.434 INFO:tasks.workunit.client.1.smithi135.stdout:5/636: dread - db/d5d/dac/f85 zero size 2024-05-09T00:07:34.436 INFO:tasks.workunit.client.1.smithi135.stdout:4/474: creat dc/d4a/fa4 x:0 0 0 2024-05-09T00:07:34.436 INFO:tasks.workunit.client.1.smithi135.stdout:4/475: chown dc/dd/c8d 0 1 2024-05-09T00:07:34.436 INFO:tasks.workunit.client.1.smithi135.stdout:4/476: fsync fa 0 2024-05-09T00:07:34.437 INFO:tasks.workunit.client.1.smithi135.stdout:6/593: mknod d2/da/d1d/d86/cd5 0 2024-05-09T00:07:34.438 INFO:tasks.workunit.client.1.smithi135.stdout:6/594: chown d2/d20/d3f 1953 1 2024-05-09T00:07:34.438 INFO:tasks.workunit.client.1.smithi135.stdout:6/595: read - d2/da/d49/da4/fc7 zero size 2024-05-09T00:07:34.450 INFO:tasks.workunit.client.1.smithi135.stdout:1/591: mknod da/d14/d20/cdb 0 2024-05-09T00:07:34.450 INFO:tasks.workunit.client.1.smithi135.stdout:1/592: fdatasync da/d14/d20/d38/d86/fd1 0 2024-05-09T00:07:34.450 INFO:tasks.workunit.client.1.smithi135.stdout:1/593: stat da/d14/d20/cbb 0 2024-05-09T00:07:34.450 INFO:tasks.workunit.client.1.smithi135.stdout:1/594: write da/d24/d27/d33/d7d/fb8 [260008,31553] 0 2024-05-09T00:07:34.453 INFO:tasks.workunit.client.1.smithi135.stdout:1/595: read da/f63 [2548103,117621] 0 2024-05-09T00:07:34.455 INFO:tasks.workunit.client.1.smithi135.stdout:9/497: symlink d1/d1a/d2c/d2d/l9b 0 2024-05-09T00:07:34.457 INFO:tasks.workunit.client.1.smithi135.stdout:1/596: mknod da/d14/d20/d38/d86/cdc 0 2024-05-09T00:07:34.457 INFO:tasks.workunit.client.1.smithi135.stdout:1/597: write da/d24/d27/d33/d52/d71/d8d/fab [43951,93373] 0 2024-05-09T00:07:34.457 INFO:tasks.workunit.client.1.smithi135.stdout:1/598: fsync da/d24/d27/d33/d52/d71/faa 0 2024-05-09T00:07:34.459 INFO:tasks.workunit.client.1.smithi135.stdout:9/498: creat d1/d1a/d2c/d20/f9c x:0 0 0 2024-05-09T00:07:34.461 INFO:tasks.workunit.client.1.smithi135.stdout:9/499: rename d1/d1a/c46 to d1/d24/d44/c9d 0 2024-05-09T00:07:34.465 INFO:tasks.workunit.client.1.smithi135.stdout:9/500: mknod d1/d1a/d10/c9e 0 2024-05-09T00:07:34.466 INFO:tasks.workunit.client.1.smithi135.stdout:2/570: dwrite d1/f32 [0,4194304] 0 2024-05-09T00:07:34.466 INFO:tasks.workunit.client.1.smithi135.stdout:6/596: dwrite d2/d20/f36 [0,4194304] 0 2024-05-09T00:07:34.466 INFO:tasks.workunit.client.1.smithi135.stdout:9/501: creat d1/d24/d44/d7f/f9f x:0 0 0 2024-05-09T00:07:34.468 INFO:tasks.workunit.client.1.smithi135.stdout:2/571: mkdir d1/d12/d21/d41/d6d/d6e/dc6 0 2024-05-09T00:07:34.470 INFO:tasks.workunit.client.1.smithi135.stdout:6/597: unlink d2/da/d26/d57/d60/f72 0 2024-05-09T00:07:34.470 INFO:tasks.workunit.client.1.smithi135.stdout:9/502: stat d1/d24/l95 0 2024-05-09T00:07:34.470 INFO:tasks.workunit.client.1.smithi135.stdout:2/572: write d1/d12/d27/f62 [1100739,87652] 0 2024-05-09T00:07:34.471 INFO:tasks.workunit.client.1.smithi135.stdout:6/598: creat d2/d20/d37/d4e/d7c/fd6 x:0 0 0 2024-05-09T00:07:34.471 INFO:tasks.workunit.client.1.smithi135.stdout:6/599: write d2/da/d1d/d69/f9c [285094,104535] 0 2024-05-09T00:07:34.472 INFO:tasks.workunit.client.1.smithi135.stdout:9/503: link d1/d1a/d2c/f6d d1/d24/d86/fa0 0 2024-05-09T00:07:34.473 INFO:tasks.workunit.client.1.smithi135.stdout:2/573: mkdir d1/d12/d21/dc7 0 2024-05-09T00:07:34.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/600: mkdir d2/d20/d3f/d4f/d7f/dbd/dd7 0 2024-05-09T00:07:34.474 INFO:tasks.workunit.client.1.smithi135.stdout:9/504: symlink d1/d1a/d89/la1 0 2024-05-09T00:07:34.475 INFO:tasks.workunit.client.1.smithi135.stdout:2/574: mkdir d1/d12/d21/d57/dc8 0 2024-05-09T00:07:34.481 INFO:tasks.workunit.client.1.smithi135.stdout:8/610: dwrite d4/d7/d2a/d67/f75 [0,4194304] 0 2024-05-09T00:07:34.481 INFO:tasks.workunit.client.1.smithi135.stdout:4/477: dwrite dc/d4a/d69/f67 [0,4194304] 0 2024-05-09T00:07:34.487 INFO:tasks.workunit.client.1.smithi135.stdout:8/611: creat d4/d8/da2/da6/fce x:0 0 0 2024-05-09T00:07:34.487 INFO:tasks.workunit.client.1.smithi135.stdout:8/612: fsync d4/d8/f83 0 2024-05-09T00:07:34.487 INFO:tasks.workunit.client.1.smithi135.stdout:8/613: getdents d4/dc6 0 2024-05-09T00:07:34.487 INFO:tasks.workunit.client.1.smithi135.stdout:2/575: dread d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:34.490 INFO:tasks.workunit.client.1.smithi135.stdout:4/478: readlink dc/l16 0 2024-05-09T00:07:34.490 INFO:tasks.workunit.client.1.smithi135.stdout:4/479: dread - dc/d4a/d69/d39/f9b zero size 2024-05-09T00:07:34.490 INFO:tasks.workunit.client.1.smithi135.stdout:4/480: dread - dc/d4a/d69/d39/f9b zero size 2024-05-09T00:07:34.491 INFO:tasks.workunit.client.1.smithi135.stdout:7/662: sync 2024-05-09T00:07:34.491 INFO:tasks.workunit.client.1.smithi135.stdout:3/593: sync 2024-05-09T00:07:34.491 INFO:tasks.workunit.client.1.smithi135.stdout:7/663: getdents db/d1e/d3a/d40/d84 0 2024-05-09T00:07:34.491 INFO:tasks.workunit.client.1.smithi135.stdout:9/505: dread d1/d24/f47 [0,4194304] 0 2024-05-09T00:07:34.492 INFO:tasks.workunit.client.1.smithi135.stdout:8/614: mknod d4/d7/d2a/d9f/ccf 0 2024-05-09T00:07:34.492 INFO:tasks.workunit.client.1.smithi135.stdout:6/601: dwrite d2/da/d1d/fab [0,4194304] 0 2024-05-09T00:07:34.492 INFO:tasks.workunit.client.1.smithi135.stdout:6/602: truncate d2/da/d49/fc6 7856 0 2024-05-09T00:07:34.492 INFO:tasks.workunit.client.1.smithi135.stdout:5/637: dwrite db/d5d/dac/fc3 [0,4194304] 0 2024-05-09T00:07:34.492 INFO:tasks.workunit.client.1.smithi135.stdout:6/603: stat d2/d20/d37/d4e/d7c/fa5 0 2024-05-09T00:07:34.492 INFO:tasks.workunit.client.1.smithi135.stdout:5/638: fsync db/d5d/dac/f85 0 2024-05-09T00:07:34.498 INFO:tasks.workunit.client.1.smithi135.stdout:2/576: dread d1/d12/d21/d57/f6c [0,4194304] 0 2024-05-09T00:07:34.498 INFO:tasks.workunit.client.1.smithi135.stdout:2/577: write d1/d12/d20/d2b/fac [76220,113534] 0 2024-05-09T00:07:34.499 INFO:tasks.workunit.client.1.smithi135.stdout:9/506: write d1/d1a/d2c/f11 [1500523,19566] 0 2024-05-09T00:07:34.499 INFO:tasks.workunit.client.1.smithi135.stdout:6/604: dread d2/d20/d2e/fa0 [0,4194304] 0 2024-05-09T00:07:34.500 INFO:tasks.workunit.client.1.smithi135.stdout:9/507: write d1/d1a/d10/d3c/d5c/f63 [605924,28268] 0 2024-05-09T00:07:34.506 INFO:tasks.workunit.client.1.smithi135.stdout:6/605: read d2/da/d49/f64 [2780890,114756] 0 2024-05-09T00:07:34.506 INFO:tasks.workunit.client.1.smithi135.stdout:4/481: dread dc/d4a/d69/f4c [0,4194304] 0 2024-05-09T00:07:34.506 INFO:tasks.workunit.client.1.smithi135.stdout:6/606: write d2/da/d49/fc6 [897082,102903] 0 2024-05-09T00:07:34.506 INFO:tasks.workunit.client.1.smithi135.stdout:4/482: write dc/d4a/fa4 [768841,37503] 0 2024-05-09T00:07:34.507 INFO:tasks.workunit.client.1.smithi135.stdout:6/607: chown d2/da/d26/d57/d59/d62/da8/lc2 121317965 1 2024-05-09T00:07:34.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/578: dread d1/d12/d20/d2b/f71 [4194304,4194304] 0 2024-05-09T00:07:34.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/579: stat d1/d12/d27 0 2024-05-09T00:07:34.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/580: dread - d1/d12/d20/d3b/d40/fb7 zero size 2024-05-09T00:07:34.512 INFO:tasks.workunit.client.1.smithi135.stdout:2/581: symlink d1/d12/lc9 0 2024-05-09T00:07:34.512 INFO:tasks.workunit.client.1.smithi135.stdout:2/582: write d1/d12/d27/f3c [1798804,106126] 0 2024-05-09T00:07:34.512 INFO:tasks.workunit.client.1.smithi135.stdout:2/583: truncate d1/d12/d20/d2b/d94/fab 70495 0 2024-05-09T00:07:34.514 INFO:tasks.workunit.client.1.smithi135.stdout:4/483: dread dc/d4a/d69/d55/d5f/f21 [0,4194304] 0 2024-05-09T00:07:34.514 INFO:tasks.workunit.client.1.smithi135.stdout:4/484: fdatasync dc/d4a/d69/d55/d5f/f97 0 2024-05-09T00:07:34.514 INFO:tasks.workunit.client.1.smithi135.stdout:2/584: write d1/d22/f31 [882202,62448] 0 2024-05-09T00:07:34.517 INFO:tasks.workunit.client.1.smithi135.stdout:4/485: mkdir dc/d4a/d8c/da5 0 2024-05-09T00:07:34.518 INFO:tasks.workunit.client.1.smithi135.stdout:2/585: dread d1/d12/d21/d57/f95 [0,4194304] 0 2024-05-09T00:07:34.519 INFO:tasks.workunit.client.1.smithi135.stdout:9/508: getdents d1/d24/d44 0 2024-05-09T00:07:34.519 INFO:tasks.workunit.client.1.smithi135.stdout:9/509: dread - d1/d1a/d10/d3c/d5c/f6b zero size 2024-05-09T00:07:34.519 INFO:tasks.workunit.client.1.smithi135.stdout:6/608: dread d2/da/d49/f23 [0,4194304] 0 2024-05-09T00:07:34.520 INFO:tasks.workunit.client.1.smithi135.stdout:2/586: mknod d1/d12/d20/d2b/cca 0 2024-05-09T00:07:34.522 INFO:tasks.workunit.client.1.smithi135.stdout:8/615: dwrite d4/f20 [8388608,4194304] 0 2024-05-09T00:07:34.522 INFO:tasks.workunit.client.1.smithi135.stdout:8/616: chown d4/d7/de/f35 7 1 2024-05-09T00:07:34.525 INFO:tasks.workunit.client.1.smithi135.stdout:3/594: dwrite d8/d6d/d44/f72 [0,4194304] 0 2024-05-09T00:07:34.525 INFO:tasks.workunit.client.1.smithi135.stdout:9/510: mkdir d1/d24/d44/d7f/da2 0 2024-05-09T00:07:34.525 INFO:tasks.workunit.client.1.smithi135.stdout:6/609: write d2/f77 [2402606,112857] 0 2024-05-09T00:07:34.528 INFO:tasks.workunit.client.1.smithi135.stdout:4/486: dread fa [4194304,4194304] 0 2024-05-09T00:07:34.539 INFO:tasks.workunit.client.1.smithi135.stdout:2/587: symlink d1/d12/d27/lcb 0 2024-05-09T00:07:34.539 INFO:tasks.workunit.client.1.smithi135.stdout:2/588: dread - d1/d22/d63/f93 zero size 2024-05-09T00:07:34.541 INFO:tasks.workunit.client.1.smithi135.stdout:8/617: creat d4/d7/d2a/d96/fd0 x:0 0 0 2024-05-09T00:07:34.541 INFO:tasks.workunit.client.1.smithi135.stdout:8/618: dread - d4/d7/d2a/d96/fd0 zero size 2024-05-09T00:07:34.544 INFO:tasks.workunit.client.1.smithi135.stdout:3/595: mkdir d8/d13/d1f/d40/d52/dd3 0 2024-05-09T00:07:34.547 INFO:tasks.workunit.client.1.smithi135.stdout:9/511: rename d1/l21 to d1/d1a/d89/la3 0 2024-05-09T00:07:34.547 INFO:tasks.workunit.client.1.smithi135.stdout:9/512: truncate d1/d1a/f67 1738353 0 2024-05-09T00:07:34.550 INFO:tasks.workunit.client.1.smithi135.stdout:6/610: unlink d2/d1a/d7a/caf 0 2024-05-09T00:07:34.550 INFO:tasks.workunit.client.1.smithi135.stdout:6/611: chown d2/f58 438355 1 2024-05-09T00:07:34.552 INFO:tasks.workunit.client.1.smithi135.stdout:2/589: creat d1/d12/d20/d3b/d40/fcc x:0 0 0 2024-05-09T00:07:34.553 INFO:tasks.workunit.client.1.smithi135.stdout:4/487: dwrite dc/d26/f4f [0,4194304] 0 2024-05-09T00:07:34.554 INFO:tasks.workunit.client.1.smithi135.stdout:3/596: rename d8/d13/d1f/f99 to d8/d6d/d44/d4b/d59/d90/d7b/d80/d84/fd4 0 2024-05-09T00:07:34.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/612: mkdir d2/da/d49/da4/dce/dd8 0 2024-05-09T00:07:34.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/613: chown d2/da/d1d/d69/d89 280 1 2024-05-09T00:07:34.555 INFO:tasks.workunit.client.1.smithi135.stdout:2/590: symlink d1/d12/da3/lcd 0 2024-05-09T00:07:34.558 INFO:tasks.workunit.client.1.smithi135.stdout:3/597: mknod d8/d6d/d44/d4b/da0/daa/cd5 0 2024-05-09T00:07:34.558 INFO:tasks.workunit.client.1.smithi135.stdout:3/598: write d8/d6d/fae [519908,5065] 0 2024-05-09T00:07:34.558 INFO:tasks.workunit.client.1.smithi135.stdout:3/599: stat d8/d13/d1f 0 2024-05-09T00:07:34.561 INFO:tasks.workunit.client.1.smithi135.stdout:3/600: creat d8/d13/d51/fd6 x:0 0 0 2024-05-09T00:07:34.567 INFO:tasks.workunit.client.1.smithi135.stdout:3/601: rename d8/d13/d75/d53/c57 to d8/d13/d75/d53/d6a/cd7 0 2024-05-09T00:07:34.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/591: getdents d1/d12/d20/d2b 0 2024-05-09T00:07:34.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/592: readlink d1/d12/d20/d2b/l53 0 2024-05-09T00:07:34.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/593: write d1/d12/d20/d2b/fac [678887,76045] 0 2024-05-09T00:07:34.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/594: truncate d1/d12/d20/f46 3283754 0 2024-05-09T00:07:34.567 INFO:tasks.workunit.client.1.smithi135.stdout:3/602: link d8/d6d/d44/d4b/da0/daa/d88/lba d8/d13/d1f/ld8 0 2024-05-09T00:07:34.569 INFO:tasks.workunit.client.1.smithi135.stdout:2/595: symlink d1/d12/d21/d41/d6d/d6e/dc6/lce 0 2024-05-09T00:07:34.569 INFO:tasks.workunit.client.1.smithi135.stdout:2/596: fsync d1/d12/d21/d41/d6d/d6e/f75 0 2024-05-09T00:07:34.569 INFO:tasks.workunit.client.1.smithi135.stdout:2/597: write d1/d12/d20/d3b/d40/fb7 [185312,72073] 0 2024-05-09T00:07:34.570 INFO:tasks.workunit.client.1.smithi135.stdout:2/598: creat d1/d12/d21/dc7/fcf x:0 0 0 2024-05-09T00:07:34.570 INFO:tasks.workunit.client.1.smithi135.stdout:2/599: fdatasync d1/d22/d63/f97 0 2024-05-09T00:07:34.570 INFO:tasks.workunit.client.1.smithi135.stdout:2/600: write d1/f1c [932788,106544] 0 2024-05-09T00:07:34.570 INFO:tasks.workunit.client.1.smithi135.stdout:3/603: dread d8/d6d/d44/d4b/da0/daa/d88/f93 [0,4194304] 0 2024-05-09T00:07:34.571 INFO:tasks.workunit.client.1.smithi135.stdout:2/601: creat d1/d12/d21/d57/fd0 x:0 0 0 2024-05-09T00:07:34.571 INFO:tasks.workunit.client.1.smithi135.stdout:2/602: read d1/fd [513698,14676] 0 2024-05-09T00:07:34.572 INFO:tasks.workunit.client.1.smithi135.stdout:3/604: link f3 d8/d6d/d44/d4b/fd9 0 2024-05-09T00:07:34.573 INFO:tasks.workunit.client.1.smithi135.stdout:2/603: creat d1/d12/d21/d41/d6d/d6e/fd1 x:0 0 0 2024-05-09T00:07:34.574 INFO:tasks.workunit.client.1.smithi135.stdout:3/605: creat d8/d13/d1f/fda x:0 0 0 2024-05-09T00:07:34.574 INFO:tasks.workunit.client.1.smithi135.stdout:0/605: sync 2024-05-09T00:07:34.575 INFO:tasks.workunit.client.1.smithi135.stdout:3/606: creat d8/d6d/d44/d4b/fdb x:0 0 0 2024-05-09T00:07:34.575 INFO:tasks.workunit.client.1.smithi135.stdout:3/607: truncate d8/d6d/d44/d4b/d59/d90/d7b/d80/fbb 61811 0 2024-05-09T00:07:34.579 INFO:tasks.workunit.client.1.smithi135.stdout:3/608: mknod d8/d6d/d44/d4b/d59/d90/d7b/d80/d84/cdc 0 2024-05-09T00:07:34.579 INFO:tasks.workunit.client.1.smithi135.stdout:3/609: chown d8/d13/f22 29 1 2024-05-09T00:07:34.581 INFO:tasks.workunit.client.1.smithi135.stdout:3/610: read f3 [1838471,130456] 0 2024-05-09T00:07:34.583 INFO:tasks.workunit.client.1.smithi135.stdout:3/611: mkdir d8/d13/ddd 0 2024-05-09T00:07:34.585 INFO:tasks.workunit.client.1.smithi135.stdout:9/513: dwrite d1/d24/d44/d54/f55 [0,4194304] 0 2024-05-09T00:07:34.587 INFO:tasks.workunit.client.1.smithi135.stdout:0/606: dread d3/f12 [0,4194304] 0 2024-05-09T00:07:34.594 INFO:tasks.workunit.client.1.smithi135.stdout:4/488: dwrite dc/d4a/d69/d55/d6d/f94 [0,4194304] 0 2024-05-09T00:07:34.595 INFO:tasks.workunit.client.1.smithi135.stdout:2/604: dwrite d1/d12/d20/d2b/d56/d72/fae [0,4194304] 0 2024-05-09T00:07:34.596 INFO:tasks.workunit.client.1.smithi135.stdout:8/619: dwrite d4/d7/d33/d39/f3b [0,4194304] 0 2024-05-09T00:07:34.596 INFO:tasks.workunit.client.1.smithi135.stdout:6/614: dwrite d2/d20/d3f/d4f/d7f/fca [0,4194304] 0 2024-05-09T00:07:34.596 INFO:tasks.workunit.client.1.smithi135.stdout:4/489: mknod dc/d4a/d69/d55/d5f/d5a/d9e/ca6 0 2024-05-09T00:07:34.599 INFO:tasks.workunit.client.1.smithi135.stdout:9/514: dread d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:34.599 INFO:tasks.workunit.client.1.smithi135.stdout:9/515: readlink d1/d24/d86/l8b 0 2024-05-09T00:07:34.599 INFO:tasks.workunit.client.1.smithi135.stdout:9/516: write d1/d1a/d10/d3c/d5c/f6b [424415,88811] 0 2024-05-09T00:07:34.599 INFO:tasks.workunit.client.1.smithi135.stdout:8/620: read d4/d7/de/f35 [1066518,114734] 0 2024-05-09T00:07:34.607 INFO:tasks.workunit.client.1.smithi135.stdout:0/607: dwrite d3/dd/d2d/f6a [0,4194304] 0 2024-05-09T00:07:34.607 INFO:tasks.workunit.client.1.smithi135.stdout:0/608: truncate d3/dd/f32 8598875 0 2024-05-09T00:07:34.607 INFO:tasks.workunit.client.1.smithi135.stdout:0/609: write d3/dd/d3f/d29/d54/f87 [262921,78629] 0 2024-05-09T00:07:34.607 INFO:tasks.workunit.client.1.smithi135.stdout:3/612: dwrite d8/d13/d75/d58/f9e [0,4194304] 0 2024-05-09T00:07:34.607 INFO:tasks.workunit.client.1.smithi135.stdout:3/613: fsync d8/d13/d75/d58/f8a 0 2024-05-09T00:07:34.611 INFO:tasks.workunit.client.1.smithi135.stdout:6/615: unlink d2/da/d1d/d86/cd5 0 2024-05-09T00:07:34.612 INFO:tasks.workunit.client.1.smithi135.stdout:4/490: creat dc/d26/fa7 x:0 0 0 2024-05-09T00:07:34.614 INFO:tasks.workunit.client.1.smithi135.stdout:9/517: mkdir d1/da4 0 2024-05-09T00:07:34.614 INFO:tasks.workunit.client.1.smithi135.stdout:9/518: truncate d1/d1a/d2c/f5d 4529544 0 2024-05-09T00:07:34.615 INFO:tasks.workunit.client.1.smithi135.stdout:8/621: mkdir d4/d8/da2/da6/db8/dd1 0 2024-05-09T00:07:34.619 INFO:tasks.workunit.client.1.smithi135.stdout:2/605: dwrite d1/d12/d20/d2b/f55 [0,4194304] 0 2024-05-09T00:07:34.625 INFO:tasks.workunit.client.1.smithi135.stdout:0/610: creat d3/dd/d3f/d43/da3/fa7 x:0 0 0 2024-05-09T00:07:34.625 INFO:tasks.workunit.client.1.smithi135.stdout:0/611: truncate d3/dd/d2d/f6e 887497 0 2024-05-09T00:07:34.627 INFO:tasks.workunit.client.1.smithi135.stdout:4/491: dwrite dc/d26/f4f [0,4194304] 0 2024-05-09T00:07:34.628 INFO:tasks.workunit.client.1.smithi135.stdout:3/614: mknod d8/d6d/d44/d4b/d59/d90/d7b/d80/cde 0 2024-05-09T00:07:34.629 INFO:tasks.workunit.client.1.smithi135.stdout:6/616: rmdir d2/da/d49/da4 39 2024-05-09T00:07:34.633 INFO:tasks.workunit.client.1.smithi135.stdout:9/519: creat d1/d1a/d89/d99/fa5 x:0 0 0 2024-05-09T00:07:34.633 INFO:tasks.workunit.client.1.smithi135.stdout:8/622: mknod d4/d8/da2/da6/db8/dd1/cd2 0 2024-05-09T00:07:34.633 INFO:tasks.workunit.client.1.smithi135.stdout:9/520: fdatasync d1/d1a/d10/d3c/d43/f83 0 2024-05-09T00:07:34.634 INFO:tasks.workunit.client.1.smithi135.stdout:6/617: write d2/da/fb [3623900,44101] 0 2024-05-09T00:07:34.635 INFO:tasks.workunit.client.1.smithi135.stdout:2/606: mknod d1/d12/d20/d2b/d94/cd2 0 2024-05-09T00:07:34.637 INFO:tasks.workunit.client.1.smithi135.stdout:0/612: creat d3/dd/d3f/d29/d7c/fa8 x:0 0 0 2024-05-09T00:07:34.637 INFO:tasks.workunit.client.1.smithi135.stdout:0/613: chown d3/dd/d3f/d29/d7c/fa8 273028986 1 2024-05-09T00:07:34.637 INFO:tasks.workunit.client.1.smithi135.stdout:3/615: stat d8/d6d/d44/d4b/d59/l5a 0 2024-05-09T00:07:34.637 INFO:tasks.workunit.client.1.smithi135.stdout:3/616: chown d8/d13/d51/fd6 0 1 2024-05-09T00:07:34.637 INFO:tasks.workunit.client.1.smithi135.stdout:3/617: fdatasync d8/f70 0 2024-05-09T00:07:34.637 INFO:tasks.workunit.client.1.smithi135.stdout:3/618: write d8/d6d/d44/d4b/da0/daa/d88/f93 [23340,114562] 0 2024-05-09T00:07:34.638 INFO:tasks.workunit.client.1.smithi135.stdout:8/623: symlink d4/d7/d33/ld3 0 2024-05-09T00:07:34.638 INFO:tasks.workunit.client.1.smithi135.stdout:8/624: readlink d4/d8/da2/lb9 0 2024-05-09T00:07:34.640 INFO:tasks.workunit.client.1.smithi135.stdout:9/521: rename d1/d1a/d2c/d2d/l8c to d1/d24/d86/la6 0 2024-05-09T00:07:34.640 INFO:tasks.workunit.client.1.smithi135.stdout:9/522: write d1/d1a/d2c/d20/f98 [126986,77700] 0 2024-05-09T00:07:34.640 INFO:tasks.workunit.client.1.smithi135.stdout:8/625: write d4/d22/f8c [3149755,126575] 0 2024-05-09T00:07:34.640 INFO:tasks.workunit.client.1.smithi135.stdout:6/618: mkdir d2/da/d49/da6/dd9 0 2024-05-09T00:07:34.641 INFO:tasks.workunit.client.1.smithi135.stdout:3/619: read d8/d13/f22 [1868990,64862] 0 2024-05-09T00:07:34.642 INFO:tasks.workunit.client.1.smithi135.stdout:4/492: dwrite dc/dd/f7e [0,4194304] 0 2024-05-09T00:07:34.642 INFO:tasks.workunit.client.1.smithi135.stdout:4/493: dread - dc/d71/f91 zero size 2024-05-09T00:07:34.642 INFO:tasks.workunit.client.1.smithi135.stdout:1/599: sync 2024-05-09T00:07:34.644 INFO:tasks.workunit.client.1.smithi135.stdout:8/626: symlink d4/d7/d4a/d9c/ld4 0 2024-05-09T00:07:34.645 INFO:tasks.workunit.client.1.smithi135.stdout:6/619: rmdir d2/d20/d37/d4e 39 2024-05-09T00:07:34.645 INFO:tasks.workunit.client.1.smithi135.stdout:0/614: dread d3/dd/d3f/f5b [4194304,4194304] 0 2024-05-09T00:07:34.645 INFO:tasks.workunit.client.1.smithi135.stdout:1/600: dread da/f1f [0,4194304] 0 2024-05-09T00:07:34.647 INFO:tasks.workunit.client.1.smithi135.stdout:2/607: dread d1/f33 [0,4194304] 0 2024-05-09T00:07:34.647 INFO:tasks.workunit.client.1.smithi135.stdout:3/620: rename d8/d13/d75/d58/lb0 to d8/d13/ddd/ldf 0 2024-05-09T00:07:34.647 INFO:tasks.workunit.client.1.smithi135.stdout:3/621: truncate d8/d13/d51/fd6 483464 0 2024-05-09T00:07:34.651 INFO:tasks.workunit.client.1.smithi135.stdout:4/494: dread dc/d26/d4e/f6e [0,4194304] 0 2024-05-09T00:07:34.654 INFO:tasks.workunit.client.1.smithi135.stdout:9/523: link d1/d1a/d2c/f5d d1/d1a/d10/fa7 0 2024-05-09T00:07:34.654 INFO:tasks.workunit.client.1.smithi135.stdout:9/524: chown d1/d24/d44/d7f/f81 491 1 2024-05-09T00:07:34.655 INFO:tasks.workunit.client.1.smithi135.stdout:0/615: creat d3/dd/d3f/d43/fa9 x:0 0 0 2024-05-09T00:07:34.656 INFO:tasks.workunit.client.1.smithi135.stdout:0/616: chown d3/dd/c83 206 1 2024-05-09T00:07:34.656 INFO:tasks.workunit.client.1.smithi135.stdout:0/617: chown d3/dd/d3f/d29/d54 32255779 1 2024-05-09T00:07:34.656 INFO:tasks.workunit.client.1.smithi135.stdout:0/618: write d3/dd/f62 [414370,43267] 0 2024-05-09T00:07:34.656 INFO:tasks.workunit.client.1.smithi135.stdout:0/619: truncate d3/dd/d3f/d43/da3/fa7 287914 0 2024-05-09T00:07:34.656 INFO:tasks.workunit.client.1.smithi135.stdout:5/639: sync 2024-05-09T00:07:34.656 INFO:tasks.workunit.client.1.smithi135.stdout:5/640: chown db/d24/d32/d5b/d91 1008 1 2024-05-09T00:07:34.656 INFO:tasks.workunit.client.1.smithi135.stdout:3/622: dread d8/f23 [0,4194304] 0 2024-05-09T00:07:34.657 INFO:tasks.workunit.client.1.smithi135.stdout:8/627: rename d4/d7/f2f to d4/d22/d8b/fd5 0 2024-05-09T00:07:34.658 INFO:tasks.workunit.client.1.smithi135.stdout:7/664: sync 2024-05-09T00:07:34.659 INFO:tasks.workunit.client.1.smithi135.stdout:7/665: stat db/dd/d33/d58/db5 0 2024-05-09T00:07:34.659 INFO:tasks.workunit.client.1.smithi135.stdout:7/666: chown db/fd5 109 1 2024-05-09T00:07:34.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/623: dread d8/d6d/d44/d4b/d59/d90/fc5 [0,4194304] 0 2024-05-09T00:07:34.663 INFO:tasks.workunit.client.1.smithi135.stdout:5/641: truncate db/d3f/f61 1024647 0 2024-05-09T00:07:34.665 INFO:tasks.workunit.client.1.smithi135.stdout:4/495: rename dc/d26/d31/c78 to dc/d4a/d69/d55/d5f/ca8 0 2024-05-09T00:07:34.666 INFO:tasks.workunit.client.1.smithi135.stdout:8/628: mknod d4/d7/d2a/d96/dc2/cd6 0 2024-05-09T00:07:34.667 INFO:tasks.workunit.client.1.smithi135.stdout:2/608: symlink d1/ld3 0 2024-05-09T00:07:34.668 INFO:tasks.workunit.client.1.smithi135.stdout:2/609: write d1/d12/f5a [3831081,25164] 0 2024-05-09T00:07:34.668 INFO:tasks.workunit.client.1.smithi135.stdout:7/667: creat db/d1e/d3a/d40/d4c/d67/fe3 x:0 0 0 2024-05-09T00:07:34.669 INFO:tasks.workunit.client.1.smithi135.stdout:3/624: creat d8/d6d/d44/d4b/d59/d90/d7b/d80/d84/fe0 x:0 0 0 2024-05-09T00:07:34.670 INFO:tasks.workunit.client.1.smithi135.stdout:3/625: read d8/d13/f1e [1043001,44109] 0 2024-05-09T00:07:34.670 INFO:tasks.workunit.client.1.smithi135.stdout:3/626: read - d8/d13/fcc zero size 2024-05-09T00:07:34.671 INFO:tasks.workunit.client.1.smithi135.stdout:9/525: rename d1/d1a/d2c/d2d/f82 to d1/d24/d44/d54/fa8 0 2024-05-09T00:07:34.672 INFO:tasks.workunit.client.1.smithi135.stdout:4/496: unlink dc/d26/d31/d82/l9c 0 2024-05-09T00:07:34.673 INFO:tasks.workunit.client.1.smithi135.stdout:8/629: creat d4/d7/d33/fd7 x:0 0 0 2024-05-09T00:07:34.677 INFO:tasks.workunit.client.1.smithi135.stdout:7/668: creat db/dd/d33/da5/fe4 x:0 0 0 2024-05-09T00:07:34.678 INFO:tasks.workunit.client.1.smithi135.stdout:3/627: mkdir d8/d13/d75/de1 0 2024-05-09T00:07:34.678 INFO:tasks.workunit.client.1.smithi135.stdout:3/628: fsync d8/d6d/d44/d4b/da0/daa/f8e 0 2024-05-09T00:07:34.679 INFO:tasks.workunit.client.1.smithi135.stdout:0/620: rename d3/d64/d8d to d3/dd/d3f/d29/d7c/daa 0 2024-05-09T00:07:34.680 INFO:tasks.workunit.client.1.smithi135.stdout:7/669: dread db/dd/d33/d68/f9c [0,4194304] 0 2024-05-09T00:07:34.680 INFO:tasks.workunit.client.1.smithi135.stdout:9/526: mknod d1/d1a/d10/d3c/d5c/ca9 0 2024-05-09T00:07:34.681 INFO:tasks.workunit.client.1.smithi135.stdout:4/497: creat dc/d26/d31/d82/fa9 x:0 0 0 2024-05-09T00:07:34.681 INFO:tasks.workunit.client.1.smithi135.stdout:4/498: write dc/d4a/fa4 [1000536,43004] 0 2024-05-09T00:07:34.682 INFO:tasks.workunit.client.1.smithi135.stdout:7/670: write db/d1e/f7c [2689137,88761] 0 2024-05-09T00:07:34.682 INFO:tasks.workunit.client.1.smithi135.stdout:8/630: mknod d4/d7/d4a/d9c/cd8 0 2024-05-09T00:07:34.683 INFO:tasks.workunit.client.1.smithi135.stdout:2/610: unlink d1/le 0 2024-05-09T00:07:34.685 INFO:tasks.workunit.client.1.smithi135.stdout:3/629: creat d8/d13/d75/d53/fe2 x:0 0 0 2024-05-09T00:07:34.688 INFO:tasks.workunit.client.1.smithi135.stdout:5/642: rename db/d24/c8e to db/d24/d32/cc5 0 2024-05-09T00:07:34.689 INFO:tasks.workunit.client.1.smithi135.stdout:9/527: truncate d1/f59 2767992 0 2024-05-09T00:07:34.690 INFO:tasks.workunit.client.1.smithi135.stdout:4/499: getdents dc/d71/d86 0 2024-05-09T00:07:34.692 INFO:tasks.workunit.client.1.smithi135.stdout:8/631: creat d4/fd9 x:0 0 0 2024-05-09T00:07:34.694 INFO:tasks.workunit.client.1.smithi135.stdout:3/630: dread d8/d6d/d44/d4b/d69/f4d [0,4194304] 0 2024-05-09T00:07:34.696 INFO:tasks.workunit.client.1.smithi135.stdout:0/621: rename d3/dd/d3f/d3a/l81 to d3/dd/d2d/d4c/d84/d9a/lab 0 2024-05-09T00:07:34.697 INFO:tasks.workunit.client.1.smithi135.stdout:9/528: dread d1/d1a/d2c/f5d [0,4194304] 0 2024-05-09T00:07:34.698 INFO:tasks.workunit.client.1.smithi135.stdout:4/500: mknod dc/d26/caa 0 2024-05-09T00:07:34.698 INFO:tasks.workunit.client.1.smithi135.stdout:8/632: creat d4/d22/fda x:0 0 0 2024-05-09T00:07:34.699 INFO:tasks.workunit.client.1.smithi135.stdout:7/671: dwrite db/d5b/f71 [0,4194304] 0 2024-05-09T00:07:34.700 INFO:tasks.workunit.client.1.smithi135.stdout:3/631: mknod d8/d13/d1f/ce3 0 2024-05-09T00:07:34.702 INFO:tasks.workunit.client.1.smithi135.stdout:8/633: creat d4/fdb x:0 0 0 2024-05-09T00:07:34.706 INFO:tasks.workunit.client.1.smithi135.stdout:7/672: unlink db/d1e/d3a/d40/lb0 0 2024-05-09T00:07:34.706 INFO:tasks.workunit.client.1.smithi135.stdout:7/673: fsync db/f37 0 2024-05-09T00:07:34.708 INFO:tasks.workunit.client.1.smithi135.stdout:3/632: mknod d8/d6d/d44/d4b/da0/daa/dc9/ce4 0 2024-05-09T00:07:34.708 INFO:tasks.workunit.client.1.smithi135.stdout:3/633: chown d8/d13/fcc 303 1 2024-05-09T00:07:34.709 INFO:tasks.workunit.client.1.smithi135.stdout:8/634: creat d4/d7/fdc x:0 0 0 2024-05-09T00:07:34.709 INFO:tasks.workunit.client.1.smithi135.stdout:8/635: stat d4/d7/l5b 0 2024-05-09T00:07:34.709 INFO:tasks.workunit.client.1.smithi135.stdout:8/636: dread - d4/fd9 zero size 2024-05-09T00:07:34.710 INFO:tasks.workunit.client.1.smithi135.stdout:3/634: rmdir d8/d6d/d44/d4b/d59/d90 39 2024-05-09T00:07:34.711 INFO:tasks.workunit.client.1.smithi135.stdout:3/635: truncate d8/d6d/d44/d4b/d69/fca 3690080 0 2024-05-09T00:07:34.713 INFO:tasks.workunit.client.0.smithi026.stdout:4/26: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:8/13: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:4/27: stat d0/l5 0 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:0/61: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:2/3: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:9/52: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:3/46: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:6/37: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:7/26: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:5/1: sync 2024-05-09T00:07:34.714 INFO:tasks.workunit.client.0.smithi026.stdout:1/42: sync 2024-05-09T00:07:34.715 INFO:tasks.workunit.client.1.smithi135.stdout:3/636: link d8/d6d/la5 d8/d6d/d44/d4b/d69/le5 0 2024-05-09T00:07:34.717 INFO:tasks.workunit.client.0.smithi026.stdout:8/14: unlink f0 0 2024-05-09T00:07:34.719 INFO:tasks.workunit.client.0.smithi026.stdout:4/28: creat d0/f7 x:0 0 0 2024-05-09T00:07:34.719 INFO:tasks.workunit.client.0.smithi026.stdout:4/29: readlink d0/l5 0 2024-05-09T00:07:34.719 INFO:tasks.workunit.client.0.smithi026.stdout:4/30: chown d0/f2 364 1 2024-05-09T00:07:34.719 INFO:tasks.workunit.client.0.smithi026.stdout:4/31: truncate d0/f2 1618459 0 2024-05-09T00:07:34.719 INFO:tasks.workunit.client.1.smithi135.stdout:8/637: dread d4/d7/d33/d39/f3b [4194304,4194304] 0 2024-05-09T00:07:34.722 INFO:tasks.workunit.client.0.smithi026.stdout:9/53: rmdir d7 39 2024-05-09T00:07:34.727 INFO:tasks.workunit.client.0.smithi026.stdout:2/4: creat f1 x:0 0 0 2024-05-09T00:07:34.728 INFO:tasks.workunit.client.0.smithi026.stdout:2/5: dread - f1 zero size 2024-05-09T00:07:34.728 INFO:tasks.workunit.client.1.smithi135.stdout:5/643: dwrite db/d5d/dac/fc3 [0,4194304] 0 2024-05-09T00:07:34.728 INFO:tasks.workunit.client.0.smithi026.stdout:1/43: dread d5/f7 [0,4194304] 0 2024-05-09T00:07:34.728 INFO:tasks.workunit.client.0.smithi026.stdout:3/47: truncate f0 117481 0 2024-05-09T00:07:34.729 INFO:tasks.workunit.client.1.smithi135.stdout:0/622: dwrite d3/f23 [0,4194304] 0 2024-05-09T00:07:34.729 INFO:tasks.workunit.client.1.smithi135.stdout:7/674: dwrite db/d21/fb1 [0,4194304] 0 2024-05-09T00:07:34.730 INFO:tasks.workunit.client.0.smithi026.stdout:7/27: rename c1 to d8/c9 0 2024-05-09T00:07:34.730 INFO:tasks.workunit.client.0.smithi026.stdout:7/28: chown d8 1 1 2024-05-09T00:07:34.732 INFO:tasks.workunit.client.0.smithi026.stdout:5/2: symlink l1 0 2024-05-09T00:07:34.732 INFO:tasks.workunit.client.1.smithi135.stdout:3/637: dwrite f0 [0,4194304] 0 2024-05-09T00:07:34.734 INFO:tasks.workunit.client.1.smithi135.stdout:3/638: write d8/d6d/d44/d4b/d59/d90/f94 [923670,129513] 0 2024-05-09T00:07:34.735 INFO:tasks.workunit.client.1.smithi135.stdout:3/639: chown d8/f11 11268 1 2024-05-09T00:07:34.735 INFO:tasks.workunit.client.0.smithi026.stdout:8/15: rename f1 to f2 0 2024-05-09T00:07:34.735 INFO:tasks.workunit.client.0.smithi026.stdout:8/16: readlink - no filename 2024-05-09T00:07:34.735 INFO:tasks.workunit.client.0.smithi026.stdout:8/17: rmdir - no directory 2024-05-09T00:07:34.739 INFO:tasks.workunit.client.1.smithi135.stdout:7/675: truncate f8 3323086 0 2024-05-09T00:07:34.739 INFO:tasks.workunit.client.1.smithi135.stdout:7/676: fdatasync db/d1e/d3a/d40/d4c/fc3 0 2024-05-09T00:07:34.741 INFO:tasks.workunit.client.1.smithi135.stdout:0/623: creat d3/d64/fac x:0 0 0 2024-05-09T00:07:34.742 INFO:tasks.workunit.client.1.smithi135.stdout:0/624: chown d3/dd/d3f/d29/d7c 1499 1 2024-05-09T00:07:34.743 INFO:tasks.workunit.client.1.smithi135.stdout:7/677: dread db/d1e/d3a/f3b [0,4194304] 0 2024-05-09T00:07:34.743 INFO:tasks.workunit.client.1.smithi135.stdout:7/678: chown db/dd/d33/dd3/fda 1022 1 2024-05-09T00:07:34.744 INFO:tasks.workunit.client.0.smithi026.stdout:9/54: write d7/fd [2876830,67932] 0 2024-05-09T00:07:34.745 INFO:tasks.workunit.client.0.smithi026.stdout:2/6: creat f2 x:0 0 0 2024-05-09T00:07:34.748 INFO:tasks.workunit.client.1.smithi135.stdout:5/644: dwrite db/f28 [0,4194304] 0 2024-05-09T00:07:34.748 INFO:tasks.workunit.client.1.smithi135.stdout:5/645: write db/d84/d62/fa1 [172365,109832] 0 2024-05-09T00:07:34.748 INFO:tasks.workunit.client.1.smithi135.stdout:5/646: fsync db/d3f/fb3 0 2024-05-09T00:07:34.748 INFO:tasks.workunit.client.1.smithi135.stdout:0/625: symlink d3/lad 0 2024-05-09T00:07:34.748 INFO:tasks.workunit.client.1.smithi135.stdout:0/626: chown d3/dd/d3f/d29/d7c/daa 19 1 2024-05-09T00:07:34.749 INFO:tasks.workunit.client.0.smithi026.stdout:1/44: creat d5/fc x:0 0 0 2024-05-09T00:07:34.750 INFO:tasks.workunit.client.1.smithi135.stdout:3/640: dwrite d8/d6d/d44/d4b/da0/daa/f8e [0,4194304] 0 2024-05-09T00:07:34.754 INFO:tasks.workunit.client.1.smithi135.stdout:0/627: mkdir d3/dd/d3f/d58/dae 0 2024-05-09T00:07:34.755 INFO:tasks.workunit.client.0.smithi026.stdout:3/48: link f2 d5/fd 0 2024-05-09T00:07:34.759 INFO:tasks.workunit.client.0.smithi026.stdout:7/29: rmdir d8 39 2024-05-09T00:07:34.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/30: dread - f7 zero size 2024-05-09T00:07:34.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/31: write f6 [173240,114964] 0 2024-05-09T00:07:34.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/32: write f5 [4520147,95189] 0 2024-05-09T00:07:34.760 INFO:tasks.workunit.client.0.smithi026.stdout:0/62: write f10 [1594294,70757] 0 2024-05-09T00:07:34.760 INFO:tasks.workunit.client.0.smithi026.stdout:0/63: rmdir - no directory 2024-05-09T00:07:34.761 INFO:tasks.workunit.client.1.smithi135.stdout:5/647: dwrite db/f94 [0,4194304] 0 2024-05-09T00:07:34.761 INFO:tasks.workunit.client.0.smithi026.stdout:7/33: fsync f5 0 2024-05-09T00:07:34.762 INFO:tasks.workunit.client.1.smithi135.stdout:5/648: write db/d24/d32/d5b/f76 [2078950,112937] 0 2024-05-09T00:07:34.766 INFO:tasks.workunit.client.0.smithi026.stdout:5/3: getdents . 0 2024-05-09T00:07:34.766 INFO:tasks.workunit.client.0.smithi026.stdout:5/4: chown l1 661126 1 2024-05-09T00:07:34.766 INFO:tasks.workunit.client.0.smithi026.stdout:5/5: read - no filename 2024-05-09T00:07:34.766 INFO:tasks.workunit.client.0.smithi026.stdout:5/6: truncate - no filename 2024-05-09T00:07:34.766 INFO:tasks.workunit.client.0.smithi026.stdout:5/7: chown l1 100821 1 2024-05-09T00:07:34.766 INFO:tasks.workunit.client.0.smithi026.stdout:5/8: dwrite - no filename 2024-05-09T00:07:34.767 INFO:tasks.workunit.client.0.smithi026.stdout:4/32: mknod d0/c8 0 2024-05-09T00:07:34.768 INFO:tasks.workunit.client.1.smithi135.stdout:3/641: link d8/d6d/c8b d8/d6d/d44/d4b/d59/ce6 0 2024-05-09T00:07:34.770 INFO:tasks.workunit.client.1.smithi135.stdout:3/642: dread d8/d6d/d44/d4b/d59/d90/d7b/fbf [0,4194304] 0 2024-05-09T00:07:34.770 INFO:tasks.workunit.client.1.smithi135.stdout:3/643: truncate d8/d6d/d24/fb7 170686 0 2024-05-09T00:07:34.770 INFO:tasks.workunit.client.1.smithi135.stdout:3/644: dread - d8/d13/d1f/fda zero size 2024-05-09T00:07:34.770 INFO:tasks.workunit.client.1.smithi135.stdout:3/645: dread - d8/d6d/d44/d4b/d59/d90/d7b/d80/f9f zero size 2024-05-09T00:07:34.771 INFO:tasks.workunit.client.1.smithi135.stdout:0/628: creat d3/dd/d3f/d3a/da4/faf x:0 0 0 2024-05-09T00:07:34.771 INFO:tasks.workunit.client.1.smithi135.stdout:0/629: readlink d3/d64/l85 0 2024-05-09T00:07:34.771 INFO:tasks.workunit.client.1.smithi135.stdout:3/646: write d8/d13/f19 [1660038,40249] 0 2024-05-09T00:07:34.771 INFO:tasks.workunit.client.0.smithi026.stdout:2/7: creat f3 x:0 0 0 2024-05-09T00:07:34.772 INFO:tasks.workunit.client.0.smithi026.stdout:2/8: dread - f3 zero size 2024-05-09T00:07:34.773 INFO:tasks.workunit.client.1.smithi135.stdout:5/649: rename db/c1b to db/d84/d62/cc6 0 2024-05-09T00:07:34.773 INFO:tasks.workunit.client.1.smithi135.stdout:6/620: sync 2024-05-09T00:07:34.773 INFO:tasks.workunit.client.1.smithi135.stdout:1/601: sync 2024-05-09T00:07:34.777 INFO:tasks.workunit.client.1.smithi135.stdout:0/630: rmdir d3/dd/d3f/d29/d54 39 2024-05-09T00:07:34.777 INFO:tasks.workunit.client.1.smithi135.stdout:0/631: truncate d3/dd/d3f/d29/f7f 940408 0 2024-05-09T00:07:34.777 INFO:tasks.workunit.client.1.smithi135.stdout:5/650: dread db/d84/d31/d5e/fa6 [0,4194304] 0 2024-05-09T00:07:34.778 INFO:tasks.workunit.client.1.smithi135.stdout:5/651: write db/d84/d62/d73/d9c/d9f/f87 [752432,114136] 0 2024-05-09T00:07:34.779 INFO:tasks.workunit.client.1.smithi135.stdout:3/647: creat d8/d13/d51/d92/fe7 x:0 0 0 2024-05-09T00:07:34.779 INFO:tasks.workunit.client.1.smithi135.stdout:0/632: write d3/dd/f1b [3855520,33010] 0 2024-05-09T00:07:34.780 INFO:tasks.workunit.client.1.smithi135.stdout:0/633: write d3/dd/f98 [2495336,91530] 0 2024-05-09T00:07:34.781 INFO:tasks.workunit.client.0.smithi026.stdout:3/49: truncate d5/fd 2018527 0 2024-05-09T00:07:34.781 INFO:tasks.workunit.client.1.smithi135.stdout:5/652: dread db/d84/faf [0,4194304] 0 2024-05-09T00:07:34.781 INFO:tasks.workunit.client.1.smithi135.stdout:5/653: dread - db/d24/db0/fc1 zero size 2024-05-09T00:07:34.783 INFO:tasks.workunit.client.1.smithi135.stdout:6/621: dread d2/da/d49/f5a [0,4194304] 0 2024-05-09T00:07:34.789 INFO:tasks.workunit.client.1.smithi135.stdout:3/648: dread d8/d6d/d44/d4b/d59/d90/f9c [0,4194304] 0 2024-05-09T00:07:34.789 INFO:tasks.workunit.client.1.smithi135.stdout:3/649: truncate d8/d13/d1f/fa4 454345 0 2024-05-09T00:07:34.789 INFO:tasks.workunit.client.0.smithi026.stdout:2/9: dwrite f2 [0,4194304] 0 2024-05-09T00:07:34.789 INFO:tasks.workunit.client.0.smithi026.stdout:2/10: readlink l0 0 2024-05-09T00:07:34.790 INFO:tasks.workunit.client.1.smithi135.stdout:2/611: sync 2024-05-09T00:07:34.791 INFO:tasks.workunit.client.1.smithi135.stdout:0/634: link d3/dd/d2d/d4c/l66 d3/dd/d3f/d29/d54/lb0 0 2024-05-09T00:07:34.795 INFO:tasks.workunit.client.1.smithi135.stdout:1/602: dwrite da/d24/d27/f6e [0,4194304] 0 2024-05-09T00:07:34.795 INFO:tasks.workunit.client.1.smithi135.stdout:5/654: unlink db/d84/d62/d73/fba 0 2024-05-09T00:07:34.797 INFO:tasks.workunit.client.0.smithi026.stdout:5/9: mkdir d2 0 2024-05-09T00:07:34.799 INFO:tasks.workunit.client.1.smithi135.stdout:6/622: rename d2/d20/ca2 to d2/da/d1d/d69/d89/cda 0 2024-05-09T00:07:34.799 INFO:tasks.workunit.client.1.smithi135.stdout:6/623: chown d2/da/d49/c32 11851790 1 2024-05-09T00:07:34.800 INFO:tasks.workunit.client.1.smithi135.stdout:6/624: truncate d2/da/d49/da4/fc7 738857 0 2024-05-09T00:07:34.802 INFO:tasks.workunit.client.1.smithi135.stdout:5/655: write db/f94 [1486689,109820] 0 2024-05-09T00:07:34.802 INFO:tasks.workunit.client.0.smithi026.stdout:1/45: mkdir d5/dd 0 2024-05-09T00:07:34.803 INFO:tasks.workunit.client.1.smithi135.stdout:5/656: read db/d84/faf [101633,71835] 0 2024-05-09T00:07:34.806 INFO:tasks.workunit.client.1.smithi135.stdout:2/612: rmdir d1/d12/d27 39 2024-05-09T00:07:34.807 INFO:tasks.workunit.client.0.smithi026.stdout:0/64: mknod c15 0 2024-05-09T00:07:34.807 INFO:tasks.workunit.client.0.smithi026.stdout:0/65: read fa [404589,2432] 0 2024-05-09T00:07:34.810 INFO:tasks.workunit.client.0.smithi026.stdout:5/10: creat d2/f3 x:0 0 0 2024-05-09T00:07:34.812 INFO:tasks.workunit.client.0.smithi026.stdout:4/33: link d0/f2 d0/f9 0 2024-05-09T00:07:34.812 INFO:tasks.workunit.client.1.smithi135.stdout:0/635: mknod d3/dd/d3f/d58/cb1 0 2024-05-09T00:07:34.814 INFO:tasks.workunit.client.0.smithi026.stdout:5/11: mknod d2/c4 0 2024-05-09T00:07:34.814 INFO:tasks.workunit.client.0.smithi026.stdout:5/12: dread - d2/f3 zero size 2024-05-09T00:07:34.815 INFO:tasks.workunit.client.1.smithi135.stdout:1/603: mknod da/d24/d27/d33/d52/d71/d8d/cdd 0 2024-05-09T00:07:34.817 INFO:tasks.workunit.client.1.smithi135.stdout:3/650: dwrite d8/d13/f22 [0,4194304] 0 2024-05-09T00:07:34.817 INFO:tasks.workunit.client.1.smithi135.stdout:3/651: readlink d8/d6d/d44/d4b/da0/daa/d88/lba 0 2024-05-09T00:07:34.817 INFO:tasks.workunit.client.1.smithi135.stdout:3/652: fdatasync d8/d13/d1f/d40/d52/fcb 0 2024-05-09T00:07:34.820 INFO:tasks.workunit.client.1.smithi135.stdout:2/613: dread d1/d12/d21/f4a [0,4194304] 0 2024-05-09T00:07:34.820 INFO:tasks.workunit.client.1.smithi135.stdout:2/614: truncate d1/d12/da3/fc2 118895 0 2024-05-09T00:07:34.825 INFO:tasks.workunit.client.0.smithi026.stdout:2/11: dwrite f2 [0,4194304] 0 2024-05-09T00:07:34.827 INFO:tasks.workunit.client.1.smithi135.stdout:1/604: dread da/d14/f1a [0,4194304] 0 2024-05-09T00:07:34.830 INFO:tasks.workunit.client.1.smithi135.stdout:6/625: dwrite d2/da/d1d/fc8 [0,4194304] 0 2024-05-09T00:07:34.831 INFO:tasks.workunit.client.1.smithi135.stdout:6/626: stat d2/da/d1d/d69 0 2024-05-09T00:07:34.831 INFO:tasks.workunit.client.1.smithi135.stdout:6/627: fdatasync d2/d20/d37/d4e/faa 0 2024-05-09T00:07:34.860 INFO:tasks.workunit.client.1.smithi135.stdout:0/636: mknod d3/dd/d3f/d3a/d46/cb2 0 2024-05-09T00:07:34.861 INFO:tasks.workunit.client.0.smithi026.stdout:0/66: mknod c16 0 2024-05-09T00:07:34.862 INFO:tasks.workunit.client.0.smithi026.stdout:5/13: chown l1 7704351 1 2024-05-09T00:07:34.862 INFO:tasks.workunit.client.0.smithi026.stdout:5/14: write d2/f3 [735513,47208] 0 2024-05-09T00:07:34.864 INFO:tasks.workunit.client.0.smithi026.stdout:4/34: link d0/c8 d0/ca 0 2024-05-09T00:07:34.866 INFO:tasks.workunit.client.1.smithi135.stdout:3/653: dwrite d8/d13/d75/f87 [0,4194304] 0 2024-05-09T00:07:34.866 INFO:tasks.workunit.client.1.smithi135.stdout:2/615: dwrite d1/d12/d21/dc7/fcf [0,4194304] 0 2024-05-09T00:07:34.866 INFO:tasks.workunit.client.1.smithi135.stdout:2/616: fsync d1/d12/f8d 0 2024-05-09T00:07:34.866 INFO:tasks.workunit.client.1.smithi135.stdout:6/628: dwrite d2/f77 [0,4194304] 0 2024-05-09T00:07:34.866 INFO:tasks.workunit.client.1.smithi135.stdout:3/654: read d8/d13/f19 [2506186,105442] 0 2024-05-09T00:07:34.867 INFO:tasks.workunit.client.0.smithi026.stdout:5/15: dread d2/f3 [0,4194304] 0 2024-05-09T00:07:34.868 INFO:tasks.workunit.client.0.smithi026.stdout:5/16: dread d2/f3 [0,4194304] 0 2024-05-09T00:07:34.872 INFO:tasks.workunit.client.1.smithi135.stdout:3/655: dread d8/f23 [0,4194304] 0 2024-05-09T00:07:34.890 INFO:tasks.workunit.client.0.smithi026.stdout:2/12: creat f4 x:0 0 0 2024-05-09T00:07:34.891 INFO:tasks.workunit.client.1.smithi135.stdout:1/605: symlink da/dce/lde 0 2024-05-09T00:07:34.897 INFO:tasks.workunit.client.1.smithi135.stdout:0/637: creat d3/dd/d3f/d58/fb3 x:0 0 0 2024-05-09T00:07:34.898 INFO:tasks.workunit.client.0.smithi026.stdout:5/17: creat d2/f5 x:0 0 0 2024-05-09T00:07:34.901 INFO:tasks.workunit.client.0.smithi026.stdout:2/13: rename f3 to f5 0 2024-05-09T00:07:34.909 INFO:tasks.workunit.client.0.smithi026.stdout:0/67: rename c2 to c17 0 2024-05-09T00:07:34.909 INFO:tasks.workunit.client.0.smithi026.stdout:0/68: write f14 [831436,115942] 0 2024-05-09T00:07:34.909 INFO:tasks.workunit.client.1.smithi135.stdout:6/629: dread - d2/da/d26/d57/d60/fbe zero size 2024-05-09T00:07:34.911 INFO:tasks.workunit.client.1.smithi135.stdout:4/501: sync 2024-05-09T00:07:34.911 INFO:tasks.workunit.client.1.smithi135.stdout:8/638: sync 2024-05-09T00:07:34.913 INFO:tasks.workunit.client.1.smithi135.stdout:3/656: mknod d8/d13/d1f/d62/ce8 0 2024-05-09T00:07:34.913 INFO:tasks.workunit.client.1.smithi135.stdout:0/638: dwrite d3/dd/d3f/d29/f2e [0,4194304] 0 2024-05-09T00:07:34.913 INFO:tasks.workunit.client.1.smithi135.stdout:9/529: sync 2024-05-09T00:07:34.916 INFO:tasks.workunit.client.1.smithi135.stdout:1/606: rename da/f4b to da/d14/d20/d38/d3a/d40/d75/fdf 0 2024-05-09T00:07:34.916 INFO:tasks.workunit.client.1.smithi135.stdout:1/607: write da/d24/d27/d33/d36/fda [11144,76347] 0 2024-05-09T00:07:34.916 INFO:tasks.workunit.client.1.smithi135.stdout:2/617: symlink d1/d12/d20/d3b/d4f/ld4 0 2024-05-09T00:07:34.916 INFO:tasks.workunit.client.1.smithi135.stdout:2/618: fdatasync d1/f32 0 2024-05-09T00:07:34.916 INFO:tasks.workunit.client.1.smithi135.stdout:2/619: chown d1/d12/d20/d2b/fa5 35431 1 2024-05-09T00:07:34.916 INFO:tasks.workunit.client.1.smithi135.stdout:2/620: stat d1/d12/d21/d41/d6d/d6e/f9a 0 2024-05-09T00:07:34.917 INFO:tasks.workunit.client.0.smithi026.stdout:0/69: symlink l18 0 2024-05-09T00:07:34.917 INFO:tasks.workunit.client.0.smithi026.stdout:0/70: read f14 [49723,97381] 0 2024-05-09T00:07:34.918 INFO:tasks.workunit.client.0.smithi026.stdout:0/71: read f5 [124332,32001] 0 2024-05-09T00:07:34.918 INFO:tasks.workunit.client.0.smithi026.stdout:0/72: write fa [1704258,36784] 0 2024-05-09T00:07:34.919 INFO:tasks.workunit.client.0.smithi026.stdout:4/35: rmdir d0 39 2024-05-09T00:07:34.920 INFO:tasks.workunit.client.1.smithi135.stdout:6/630: mkdir d2/d20/d3f/d4f/ddb 0 2024-05-09T00:07:34.921 INFO:tasks.workunit.client.1.smithi135.stdout:4/502: creat dc/d4a/d69/d55/fab x:0 0 0 2024-05-09T00:07:34.921 INFO:tasks.workunit.client.0.smithi026.stdout:0/73: chown cc 432430 1 2024-05-09T00:07:34.924 INFO:tasks.workunit.client.0.smithi026.stdout:4/36: creat d0/fb x:0 0 0 2024-05-09T00:07:34.925 INFO:tasks.workunit.client.0.smithi026.stdout:0/74: creat f19 x:0 0 0 2024-05-09T00:07:34.925 INFO:tasks.workunit.client.0.smithi026.stdout:0/75: chown f5 1797 1 2024-05-09T00:07:34.927 INFO:tasks.workunit.client.0.smithi026.stdout:0/76: chown c3 18 1 2024-05-09T00:07:34.927 INFO:tasks.workunit.client.0.smithi026.stdout:0/77: rmdir - no directory 2024-05-09T00:07:34.929 INFO:tasks.workunit.client.1.smithi135.stdout:2/621: creat d1/d12/d21/db1/fd5 x:0 0 0 2024-05-09T00:07:34.930 INFO:tasks.workunit.client.0.smithi026.stdout:0/78: symlink l1a 0 2024-05-09T00:07:34.930 INFO:tasks.workunit.client.0.smithi026.stdout:2/14: dwrite f5 [0,4194304] 0 2024-05-09T00:07:34.930 INFO:tasks.workunit.client.0.smithi026.stdout:2/15: chown f1 9188143 1 2024-05-09T00:07:34.930 INFO:tasks.workunit.client.1.smithi135.stdout:2/622: write d1/d12/d21/f4a [1809478,110265] 0 2024-05-09T00:07:34.931 INFO:tasks.workunit.client.1.smithi135.stdout:2/623: write d1/d12/d20/d2b/d56/f89 [420856,1077] 0 2024-05-09T00:07:34.933 INFO:tasks.workunit.client.1.smithi135.stdout:7/679: sync 2024-05-09T00:07:34.933 INFO:tasks.workunit.client.1.smithi135.stdout:6/631: write d2/d20/d37/d4e/faa [563034,40490] 0 2024-05-09T00:07:34.933 INFO:tasks.workunit.client.1.smithi135.stdout:6/632: chown d2/d20/d37/d4e/cbc 226871 1 2024-05-09T00:07:34.941 INFO:tasks.workunit.client.1.smithi135.stdout:7/680: mknod db/dd/d33/dd3/ce5 0 2024-05-09T00:07:34.941 INFO:tasks.workunit.client.1.smithi135.stdout:7/681: write db/d21/fd9 [50917,84635] 0 2024-05-09T00:07:34.941 INFO:tasks.workunit.client.1.smithi135.stdout:7/682: write db/dd/d33/d58/f8d [14028,17738] 0 2024-05-09T00:07:34.943 INFO:tasks.workunit.client.0.smithi026.stdout:0/79: dread f10 [0,4194304] 0 2024-05-09T00:07:34.946 INFO:tasks.workunit.client.1.smithi135.stdout:6/633: dread d2/da/d1d/d69/d78/f97 [0,4194304] 0 2024-05-09T00:07:34.948 INFO:tasks.workunit.client.0.smithi026.stdout:0/80: write f4 [619456,66915] 0 2024-05-09T00:07:34.954 INFO:tasks.workunit.client.1.smithi135.stdout:3/657: dwrite d8/d13/d1f/d40/fcd [0,4194304] 0 2024-05-09T00:07:34.955 INFO:tasks.workunit.client.1.smithi135.stdout:7/683: dread db/d1e/d3a/f52 [0,4194304] 0 2024-05-09T00:07:34.960 INFO:tasks.workunit.client.0.smithi026.stdout:2/16: dwrite f2 [0,4194304] 0 2024-05-09T00:07:34.960 INFO:tasks.workunit.client.0.smithi026.stdout:2/17: write f1 [751316,9259] 0 2024-05-09T00:07:34.961 INFO:tasks.workunit.client.0.smithi026.stdout:2/18: fdatasync f4 0 2024-05-09T00:07:34.961 INFO:tasks.workunit.client.1.smithi135.stdout:9/530: dwrite d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:34.962 INFO:tasks.workunit.client.1.smithi135.stdout:9/531: write d1/d1a/d2c/f84 [1018625,15351] 0 2024-05-09T00:07:34.962 INFO:tasks.workunit.client.1.smithi135.stdout:9/532: chown d1/d1a/d10/d3c/d5c/f6b 10933845 1 2024-05-09T00:07:34.963 INFO:tasks.workunit.client.1.smithi135.stdout:4/503: dwrite dc/d4a/d69/d55/fa3 [0,4194304] 0 2024-05-09T00:07:34.963 INFO:tasks.workunit.client.1.smithi135.stdout:7/684: truncate db/fd5 3364798 0 2024-05-09T00:07:34.963 INFO:tasks.workunit.client.1.smithi135.stdout:1/608: dwrite da/d14/d5c/f8f [0,4194304] 0 2024-05-09T00:07:34.963 INFO:tasks.workunit.client.1.smithi135.stdout:2/624: dwrite d1/d12/d21/d57/fa2 [0,4194304] 0 2024-05-09T00:07:34.963 INFO:tasks.workunit.client.1.smithi135.stdout:3/658: link d8/d6d/d44/d4b/da0/daa/cd5 d8/d13/d51/ce9 0 2024-05-09T00:07:34.963 INFO:tasks.workunit.client.1.smithi135.stdout:5/657: sync 2024-05-09T00:07:34.964 INFO:tasks.workunit.client.0.smithi026.stdout:2/19: creat f6 x:0 0 0 2024-05-09T00:07:34.964 INFO:tasks.workunit.client.0.smithi026.stdout:5/18: truncate d2/f3 434058 0 2024-05-09T00:07:34.964 INFO:tasks.workunit.client.0.smithi026.stdout:5/19: chown d2/f3 1616 1 2024-05-09T00:07:34.968 INFO:tasks.workunit.client.1.smithi135.stdout:4/504: dread dc/d26/f2a [0,4194304] 0 2024-05-09T00:07:34.970 INFO:tasks.workunit.client.0.smithi026.stdout:2/20: dread f2 [0,4194304] 0 2024-05-09T00:07:34.971 INFO:tasks.workunit.client.0.smithi026.stdout:5/20: unlink d2/f5 0 2024-05-09T00:07:34.971 INFO:tasks.workunit.client.0.smithi026.stdout:2/21: write f6 [149227,125313] 0 2024-05-09T00:07:34.972 INFO:tasks.workunit.client.1.smithi135.stdout:7/685: mkdir db/d1e/de6 0 2024-05-09T00:07:34.974 INFO:tasks.workunit.client.1.smithi135.stdout:9/533: dread d1/d1a/d2c/d2d/f32 [4194304,4194304] 0 2024-05-09T00:07:34.975 INFO:tasks.workunit.client.0.smithi026.stdout:2/22: mknod c7 0 2024-05-09T00:07:34.977 INFO:tasks.workunit.client.0.smithi026.stdout:0/81: dwrite f10 [4194304,4194304] 0 2024-05-09T00:07:34.977 INFO:tasks.workunit.client.1.smithi135.stdout:3/659: rename d8/d13/f1e to d8/d13/d51/d63/d89/fea 0 2024-05-09T00:07:34.977 INFO:tasks.workunit.client.1.smithi135.stdout:6/634: dwrite d2/d1a/d7a/f8a [0,4194304] 0 2024-05-09T00:07:34.978 INFO:tasks.workunit.client.0.smithi026.stdout:2/23: creat f8 x:0 0 0 2024-05-09T00:07:34.980 INFO:tasks.workunit.client.1.smithi135.stdout:5/658: link db/d24/d32/d5b/d91/l54 db/d24/db0/lc7 0 2024-05-09T00:07:34.982 INFO:tasks.workunit.client.1.smithi135.stdout:4/505: mkdir dc/d4a/d69/dac 0 2024-05-09T00:07:34.982 INFO:tasks.workunit.client.1.smithi135.stdout:4/506: chown dc/d26/d31/f5d 0 1 2024-05-09T00:07:34.983 INFO:tasks.workunit.client.1.smithi135.stdout:6/635: dread d2/f17 [0,4194304] 0 2024-05-09T00:07:34.984 INFO:tasks.workunit.client.1.smithi135.stdout:9/534: mknod d1/d1a/d10/d3c/d5c/caa 0 2024-05-09T00:07:34.984 INFO:tasks.workunit.client.1.smithi135.stdout:9/535: dread - d1/d1a/d10/f68 zero size 2024-05-09T00:07:34.985 INFO:tasks.workunit.client.1.smithi135.stdout:7/686: rename db/dd/d33/da5/fe4 to db/d1e/fe7 0 2024-05-09T00:07:34.986 INFO:tasks.workunit.client.1.smithi135.stdout:1/609: write da/d14/f3f [2666754,44795] 0 2024-05-09T00:07:34.987 INFO:tasks.workunit.client.1.smithi135.stdout:3/660: dread d8/d6d/d44/d4b/d69/f4a [0,4194304] 0 2024-05-09T00:07:34.988 INFO:tasks.workunit.client.1.smithi135.stdout:4/507: symlink dc/d71/lad 0 2024-05-09T00:07:34.990 INFO:tasks.workunit.client.0.smithi026.stdout:2/24: dread f5 [0,4194304] 0 2024-05-09T00:07:34.990 INFO:tasks.workunit.client.1.smithi135.stdout:6/636: getdents d2/da/d1d 0 2024-05-09T00:07:34.991 INFO:tasks.workunit.client.1.smithi135.stdout:6/637: stat d2/da/l28 0 2024-05-09T00:07:34.992 INFO:tasks.workunit.client.1.smithi135.stdout:9/536: creat d1/d1a/d10/d3c/d5c/fab x:0 0 0 2024-05-09T00:07:34.995 INFO:tasks.workunit.client.1.smithi135.stdout:5/659: rename db/d84/l7a to db/d24/lc8 0 2024-05-09T00:07:34.998 INFO:tasks.workunit.client.1.smithi135.stdout:7/687: unlink db/d1e/d3a/d40/d4c/d67/ld4 0 2024-05-09T00:07:34.998 INFO:tasks.workunit.client.1.smithi135.stdout:7/688: chown db/d1e/d3a/d40/l5a 4178016 1 2024-05-09T00:07:34.998 INFO:tasks.workunit.client.1.smithi135.stdout:7/689: write db/d1e/d3a/d40/f55 [4471907,96513] 0 2024-05-09T00:07:34.999 INFO:tasks.workunit.client.1.smithi135.stdout:7/690: read db/d1e/d3a/d40/d4c/f4f [5023804,7316] 0 2024-05-09T00:07:34.999 INFO:tasks.workunit.client.1.smithi135.stdout:7/691: chown db/dd/ccf 64125909 1 2024-05-09T00:07:35.000 INFO:tasks.workunit.client.1.smithi135.stdout:1/610: read da/db/f2a [176459,102950] 0 2024-05-09T00:07:35.000 INFO:tasks.workunit.client.1.smithi135.stdout:2/625: dwrite d1/d12/d21/d57/f7b [0,4194304] 0 2024-05-09T00:07:35.004 INFO:tasks.workunit.client.1.smithi135.stdout:3/661: mkdir d8/d6d/d44/d4b/d59/deb 0 2024-05-09T00:07:35.004 INFO:tasks.workunit.client.1.smithi135.stdout:3/662: truncate d8/d6d/d44/d4b/d59/d90/d7b/d80/fbb 579588 0 2024-05-09T00:07:35.008 INFO:tasks.workunit.client.1.smithi135.stdout:4/508: read dc/f2d [48515,5116] 0 2024-05-09T00:07:35.010 INFO:tasks.workunit.client.1.smithi135.stdout:5/660: unlink db/f10 0 2024-05-09T00:07:35.011 INFO:tasks.workunit.client.1.smithi135.stdout:6/638: rename d2/d20/d3f/d4f/d7f/dbd to d2/da/d26/d57/ddc 0 2024-05-09T00:07:35.012 INFO:tasks.workunit.client.1.smithi135.stdout:6/639: read d2/d1a/f1b [2292794,114153] 0 2024-05-09T00:07:35.013 INFO:tasks.workunit.client.0.smithi026.stdout:0/82: dwrite f4 [4194304,4194304] 0 2024-05-09T00:07:35.013 INFO:tasks.workunit.client.0.smithi026.stdout:0/83: fdatasync ff 0 2024-05-09T00:07:35.014 INFO:tasks.workunit.client.1.smithi135.stdout:7/692: getdents db/d21/d98 0 2024-05-09T00:07:35.014 INFO:tasks.workunit.client.1.smithi135.stdout:7/693: chown db/d1e/d3a/c48 267863352 1 2024-05-09T00:07:35.016 INFO:tasks.workunit.client.1.smithi135.stdout:2/626: dwrite d1/d12/d20/d2b/d56/d72/fb2 [0,4194304] 0 2024-05-09T00:07:35.016 INFO:tasks.workunit.client.1.smithi135.stdout:2/627: write d1/d12/d21/f42 [684027,73137] 0 2024-05-09T00:07:35.017 INFO:tasks.workunit.client.1.smithi135.stdout:9/537: dwrite d1/d1a/f51 [0,4194304] 0 2024-05-09T00:07:35.017 INFO:tasks.workunit.client.0.smithi026.stdout:0/84: dread f5 [0,4194304] 0 2024-05-09T00:07:35.019 INFO:tasks.workunit.client.0.smithi026.stdout:0/85: chown c8 12108 1 2024-05-09T00:07:35.021 INFO:tasks.workunit.client.0.smithi026.stdout:0/86: creat f1b x:0 0 0 2024-05-09T00:07:35.021 INFO:tasks.workunit.client.0.smithi026.stdout:0/87: truncate f5 1187546 0 2024-05-09T00:07:35.021 INFO:tasks.workunit.client.0.smithi026.stdout:0/88: chown f10 345436 1 2024-05-09T00:07:35.021 INFO:tasks.workunit.client.0.smithi026.stdout:0/89: chown c8 4 1 2024-05-09T00:07:35.022 INFO:tasks.workunit.client.0.smithi026.stdout:0/90: write f4 [4784524,114066] 0 2024-05-09T00:07:35.022 INFO:tasks.workunit.client.0.smithi026.stdout:0/91: write f5 [664559,69293] 0 2024-05-09T00:07:35.023 INFO:tasks.workunit.client.0.smithi026.stdout:0/92: fdatasync f10 0 2024-05-09T00:07:35.023 INFO:tasks.workunit.client.0.smithi026.stdout:0/93: read f11 [256277,94516] 0 2024-05-09T00:07:35.026 INFO:tasks.workunit.client.1.smithi135.stdout:1/611: mkdir da/d14/d5c/de0 0 2024-05-09T00:07:35.026 INFO:tasks.workunit.client.1.smithi135.stdout:1/612: stat da/d14/d20/d38/d3a/d40/f8a 0 2024-05-09T00:07:35.027 INFO:tasks.workunit.client.1.smithi135.stdout:3/663: creat d8/d13/d75/fec x:0 0 0 2024-05-09T00:07:35.029 INFO:tasks.workunit.client.0.smithi026.stdout:0/94: symlink l1c 0 2024-05-09T00:07:35.029 INFO:tasks.workunit.client.0.smithi026.stdout:0/95: write f14 [1839180,3504] 0 2024-05-09T00:07:35.029 INFO:tasks.workunit.client.0.smithi026.stdout:0/96: read f12 [36791,108423] 0 2024-05-09T00:07:35.030 INFO:tasks.workunit.client.1.smithi135.stdout:4/509: creat dc/d4a/d8c/da5/fae x:0 0 0 2024-05-09T00:07:35.030 INFO:tasks.workunit.client.1.smithi135.stdout:4/510: readlink dc/d4a/d69/l49 0 2024-05-09T00:07:35.030 INFO:tasks.workunit.client.1.smithi135.stdout:4/511: chown dc/d4a/d69/d39/l64 2399063 1 2024-05-09T00:07:35.036 INFO:tasks.workunit.client.0.smithi026.stdout:0/97: dread f5 [0,4194304] 0 2024-05-09T00:07:35.038 INFO:tasks.workunit.client.1.smithi135.stdout:5/661: rename db/c71 to db/d3f/cc9 0 2024-05-09T00:07:35.038 INFO:tasks.workunit.client.1.smithi135.stdout:6/640: symlink d2/da/d1d/d86/ldd 0 2024-05-09T00:07:35.038 INFO:tasks.workunit.client.1.smithi135.stdout:7/694: creat db/d1e/d94/fe8 x:0 0 0 2024-05-09T00:07:35.038 INFO:tasks.workunit.client.1.smithi135.stdout:5/662: truncate db/d5d/dac/f85 915695 0 2024-05-09T00:07:35.049 INFO:tasks.workunit.client.1.smithi135.stdout:7/695: dread db/d21/fd9 [0,4194304] 0 2024-05-09T00:07:35.053 INFO:tasks.workunit.client.0.smithi026.stdout:0/98: dwrite fb [0,4194304] 0 2024-05-09T00:07:35.053 INFO:tasks.workunit.client.1.smithi135.stdout:4/512: dwrite dc/d26/d31/d82/fa9 [0,4194304] 0 2024-05-09T00:07:35.055 INFO:tasks.workunit.client.1.smithi135.stdout:1/613: dwrite da/db/d16/f18 [4194304,4194304] 0 2024-05-09T00:07:35.066 INFO:tasks.workunit.client.1.smithi135.stdout:7/696: dwrite db/d5b/f64 [0,4194304] 0 2024-05-09T00:07:35.096 INFO:tasks.workunit.client.0.smithi026.stdout:5/21: truncate d2/f3 392794 0 2024-05-09T00:07:35.096 INFO:tasks.workunit.client.0.smithi026.stdout:5/22: stat l1 0 2024-05-09T00:07:35.098 INFO:tasks.workunit.client.1.smithi135.stdout:9/538: creat d1/d24/d44/d54/d66/fac x:0 0 0 2024-05-09T00:07:35.099 INFO:tasks.workunit.client.1.smithi135.stdout:3/664: rmdir d8/d6d/d44/d4b/d59/d90 39 2024-05-09T00:07:35.099 INFO:tasks.workunit.client.1.smithi135.stdout:8/639: sync 2024-05-09T00:07:35.099 INFO:tasks.workunit.client.1.smithi135.stdout:0/639: sync 2024-05-09T00:07:35.100 INFO:tasks.workunit.client.1.smithi135.stdout:8/640: chown d4/d8/l4f 1175 1 2024-05-09T00:07:35.104 INFO:tasks.workunit.client.1.smithi135.stdout:5/663: symlink db/d24/d32/lca 0 2024-05-09T00:07:35.107 INFO:tasks.workunit.client.0.smithi026.stdout:0/99: mkdir d1d 0 2024-05-09T00:07:35.110 INFO:tasks.workunit.client.0.smithi026.stdout:0/100: mkdir d1d/d1e 0 2024-05-09T00:07:35.110 INFO:tasks.workunit.client.0.smithi026.stdout:0/101: chown f14 154 1 2024-05-09T00:07:35.112 INFO:tasks.workunit.client.1.smithi135.stdout:4/513: creat dc/d4a/d69/d55/d5f/faf x:0 0 0 2024-05-09T00:07:35.112 INFO:tasks.workunit.client.1.smithi135.stdout:4/514: chown dc/d4a/d69/f4c 160420290 1 2024-05-09T00:07:35.112 INFO:tasks.workunit.client.1.smithi135.stdout:4/515: write dc/d71/f91 [111943,47461] 0 2024-05-09T00:07:35.112 INFO:tasks.workunit.client.1.smithi135.stdout:1/614: getdents da/d14/d20/d38/d3a/db7/dc6/d93 0 2024-05-09T00:07:35.113 INFO:tasks.workunit.client.0.smithi026.stdout:0/102: mknod d1d/c1f 0 2024-05-09T00:07:35.117 INFO:tasks.workunit.client.0.smithi026.stdout:0/103: mkdir d1d/d1e/d20 0 2024-05-09T00:07:35.118 INFO:tasks.workunit.client.1.smithi135.stdout:7/697: truncate db/d1e/fcb 3113966 0 2024-05-09T00:07:35.119 INFO:tasks.workunit.client.1.smithi135.stdout:7/698: chown db/d21/fb3 16044922 1 2024-05-09T00:07:35.119 INFO:tasks.workunit.client.1.smithi135.stdout:7/699: dread - db/dd/fb7 zero size 2024-05-09T00:07:35.120 INFO:tasks.workunit.client.1.smithi135.stdout:7/700: write db/d13/f24 [2136564,34083] 0 2024-05-09T00:07:35.120 INFO:tasks.workunit.client.1.smithi135.stdout:2/628: link d1/l2f d1/d12/d21/d57/dbd/ld6 0 2024-05-09T00:07:35.121 INFO:tasks.workunit.client.1.smithi135.stdout:4/516: dread dc/d4a/d69/d55/d5f/f84 [0,4194304] 0 2024-05-09T00:07:35.121 INFO:tasks.workunit.client.0.smithi026.stdout:0/104: symlink d1d/d1e/l21 0 2024-05-09T00:07:35.121 INFO:tasks.workunit.client.0.smithi026.stdout:0/105: stat ff 0 2024-05-09T00:07:35.122 INFO:tasks.workunit.client.1.smithi135.stdout:9/539: mkdir d1/d1a/d89/dad 0 2024-05-09T00:07:35.123 INFO:tasks.workunit.client.1.smithi135.stdout:8/641: rmdir d4/d7/d2a/d9f 39 2024-05-09T00:07:35.123 INFO:tasks.workunit.client.1.smithi135.stdout:8/642: write d4/d7/de/d45/d76/f99 [329501,105693] 0 2024-05-09T00:07:35.124 INFO:tasks.workunit.client.1.smithi135.stdout:0/640: creat d3/dd/d3f/d58/dae/fb4 x:0 0 0 2024-05-09T00:07:35.125 INFO:tasks.workunit.client.1.smithi135.stdout:6/641: mknod d2/d20/d3f/cde 0 2024-05-09T00:07:35.126 INFO:tasks.workunit.client.1.smithi135.stdout:6/642: dread - d2/d1a/f9f zero size 2024-05-09T00:07:35.129 INFO:tasks.workunit.client.0.smithi026.stdout:5/23: dwrite d2/f3 [0,4194304] 0 2024-05-09T00:07:35.129 INFO:tasks.workunit.client.0.smithi026.stdout:0/106: dread f4 [4194304,4194304] 0 2024-05-09T00:07:35.130 INFO:tasks.workunit.client.0.smithi026.stdout:5/24: write d2/f3 [3045532,32262] 0 2024-05-09T00:07:35.135 INFO:tasks.workunit.client.1.smithi135.stdout:5/664: creat db/d84/d62/d73/d9c/d9f/dc0/dc4/fcb x:0 0 0 2024-05-09T00:07:35.137 INFO:tasks.workunit.client.1.smithi135.stdout:8/643: dwrite d4/f89 [0,4194304] 0 2024-05-09T00:07:35.137 INFO:tasks.workunit.client.1.smithi135.stdout:8/644: chown d4/d7/da4/lad 0 1 2024-05-09T00:07:35.138 INFO:tasks.workunit.client.1.smithi135.stdout:5/665: write db/d84/f43 [862962,74030] 0 2024-05-09T00:07:35.138 INFO:tasks.workunit.client.0.smithi026.stdout:0/107: unlink l18 0 2024-05-09T00:07:35.140 INFO:tasks.workunit.client.1.smithi135.stdout:7/701: creat db/d1e/d3a/d40/d7e/fe9 x:0 0 0 2024-05-09T00:07:35.140 INFO:tasks.workunit.client.0.smithi026.stdout:0/108: link c16 d1d/c22 0 2024-05-09T00:07:35.143 INFO:tasks.workunit.client.1.smithi135.stdout:2/629: creat d1/d12/d21/d57/dbd/fd7 x:0 0 0 2024-05-09T00:07:35.143 INFO:tasks.workunit.client.1.smithi135.stdout:2/630: truncate d1/d12/fb3 4855958 0 2024-05-09T00:07:35.143 INFO:tasks.workunit.client.1.smithi135.stdout:4/517: mknod dc/d4a/d69/d55/d6d/cb0 0 2024-05-09T00:07:35.143 INFO:tasks.workunit.client.1.smithi135.stdout:9/540: creat d1/d1a/d10/d3c/d5c/fae x:0 0 0 2024-05-09T00:07:35.144 INFO:tasks.workunit.client.1.smithi135.stdout:6/643: creat d2/da/d26/d57/d60/fdf x:0 0 0 2024-05-09T00:07:35.144 INFO:tasks.workunit.client.1.smithi135.stdout:6/644: truncate d2/da/d26/d57/d60/fdf 894076 0 2024-05-09T00:07:35.144 INFO:tasks.workunit.client.1.smithi135.stdout:6/645: write d2/d5f/fba [957513,108333] 0 2024-05-09T00:07:35.146 INFO:tasks.workunit.client.1.smithi135.stdout:8/645: getdents d4/d7/d2a/d96/dc2 0 2024-05-09T00:07:35.150 INFO:tasks.workunit.client.1.smithi135.stdout:7/702: dread db/f29 [0,4194304] 0 2024-05-09T00:07:35.151 INFO:tasks.workunit.client.1.smithi135.stdout:0/641: dread d3/dd/d2d/f68 [0,4194304] 0 2024-05-09T00:07:35.151 INFO:tasks.workunit.client.1.smithi135.stdout:4/518: getdents dc/d4a 0 2024-05-09T00:07:35.153 INFO:tasks.workunit.client.1.smithi135.stdout:9/541: truncate d1/d1a/d2c/f11 727942 0 2024-05-09T00:07:35.154 INFO:tasks.workunit.client.1.smithi135.stdout:5/666: dwrite db/d84/f41 [0,4194304] 0 2024-05-09T00:07:35.154 INFO:tasks.workunit.client.1.smithi135.stdout:5/667: dread - db/d84/d62/d73/d9c/d9f/dc0/dc4/fcb zero size 2024-05-09T00:07:35.154 INFO:tasks.workunit.client.1.smithi135.stdout:5/668: stat db/d84/d62/d73/d9c/d9f/f8b 0 2024-05-09T00:07:35.154 INFO:tasks.workunit.client.1.smithi135.stdout:5/669: fsync db/f94 0 2024-05-09T00:07:35.154 INFO:tasks.workunit.client.1.smithi135.stdout:6/646: mknod d2/da/d26/d57/d59/d62/da8/ce0 0 2024-05-09T00:07:35.156 INFO:tasks.workunit.client.1.smithi135.stdout:8/646: unlink d4/fd9 0 2024-05-09T00:07:35.156 INFO:tasks.workunit.client.1.smithi135.stdout:8/647: dread - d4/d8/da2/da6/fce zero size 2024-05-09T00:07:35.156 INFO:tasks.workunit.client.1.smithi135.stdout:8/648: dread - d4/d7/d33/fd7 zero size 2024-05-09T00:07:35.156 INFO:tasks.workunit.client.1.smithi135.stdout:8/649: write d4/d7/d33/f7f [250307,27899] 0 2024-05-09T00:07:35.163 INFO:tasks.workunit.client.1.smithi135.stdout:2/631: rename d1/d12/d20/d3b/d40/fcc to d1/d12/da3/fd8 0 2024-05-09T00:07:35.163 INFO:tasks.workunit.client.1.smithi135.stdout:5/670: readlink db/d24/d32/lbc 0 2024-05-09T00:07:35.164 INFO:tasks.workunit.client.1.smithi135.stdout:9/542: unlink d1/d1a/d2c/d20/c50 0 2024-05-09T00:07:35.164 INFO:tasks.workunit.client.1.smithi135.stdout:2/632: write d1/d22/f26 [1235126,51453] 0 2024-05-09T00:07:35.168 INFO:tasks.workunit.client.1.smithi135.stdout:2/633: write d1/d12/d21/d57/f7b [1848582,41495] 0 2024-05-09T00:07:35.168 INFO:tasks.workunit.client.1.smithi135.stdout:2/634: truncate d1/d12/d21/d57/f95 1326049 0 2024-05-09T00:07:35.170 INFO:tasks.workunit.client.1.smithi135.stdout:0/642: rename d3/dd/d2d/d4c/d84/d9a to d3/dd/d2d/db5 0 2024-05-09T00:07:35.170 INFO:tasks.workunit.client.1.smithi135.stdout:0/643: readlink d3/dd/l86 0 2024-05-09T00:07:35.172 INFO:tasks.workunit.client.0.smithi026.stdout:0/109: getdents d1d 0 2024-05-09T00:07:35.174 INFO:tasks.workunit.client.0.smithi026.stdout:5/25: dwrite d2/f3 [0,4194304] 0 2024-05-09T00:07:35.175 INFO:tasks.workunit.client.1.smithi135.stdout:2/635: mkdir d1/d12/d20/d2b/d7c/dd9 0 2024-05-09T00:07:35.175 INFO:tasks.workunit.client.1.smithi135.stdout:2/636: fdatasync d1/d12/d21/dc7/fcf 0 2024-05-09T00:07:35.175 INFO:tasks.workunit.client.1.smithi135.stdout:2/637: readlink d1/d12/d21/d41/d6d/l9c 0 2024-05-09T00:07:35.175 INFO:tasks.workunit.client.1.smithi135.stdout:2/638: chown d1/d12/d21/f42 13 1 2024-05-09T00:07:35.175 INFO:tasks.workunit.client.1.smithi135.stdout:2/639: fdatasync d1/d12/da3/fc2 0 2024-05-09T00:07:35.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/26: chown l0 140 1 2024-05-09T00:07:35.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/27: chown d2 11 1 2024-05-09T00:07:35.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/28: readlink l0 0 2024-05-09T00:07:35.178 INFO:tasks.workunit.client.1.smithi135.stdout:4/519: dwrite dc/d26/d4e/f6e [0,4194304] 0 2024-05-09T00:07:35.178 INFO:tasks.workunit.client.1.smithi135.stdout:7/703: dwrite db/dd/d33/d58/db5/fd1 [0,4194304] 0 2024-05-09T00:07:35.179 INFO:tasks.workunit.client.0.smithi026.stdout:5/29: link l1 d2/l6 0 2024-05-09T00:07:35.179 INFO:tasks.workunit.client.1.smithi135.stdout:7/704: write db/d1e/d94/fe8 [264906,124880] 0 2024-05-09T00:07:35.181 INFO:tasks.workunit.client.1.smithi135.stdout:6/647: rename d2/d1a/l39 to d2/da/d49/da4/le1 0 2024-05-09T00:07:35.184 INFO:tasks.workunit.client.1.smithi135.stdout:0/644: getdents d3/dd/d3f/d29/d7c 0 2024-05-09T00:07:35.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/645: read - d3/dd/d3f/d58/fb3 zero size 2024-05-09T00:07:35.186 INFO:tasks.workunit.client.1.smithi135.stdout:5/671: mkdir db/d84/d31/dcc 0 2024-05-09T00:07:35.188 INFO:tasks.workunit.client.1.smithi135.stdout:0/646: read d3/dd/d3f/d43/f53 [15655,77094] 0 2024-05-09T00:07:35.189 INFO:tasks.workunit.client.1.smithi135.stdout:0/647: write d3/dd/f4e [1922647,74293] 0 2024-05-09T00:07:35.189 INFO:tasks.workunit.client.1.smithi135.stdout:0/648: chown d3/dd/d2d/db5/lab 12816563 1 2024-05-09T00:07:35.195 INFO:tasks.workunit.client.1.smithi135.stdout:2/640: dwrite d1/d12/d21/d41/d6d/f92 [4194304,4194304] 0 2024-05-09T00:07:35.201 INFO:tasks.workunit.client.1.smithi135.stdout:4/520: symlink dc/dd/lb1 0 2024-05-09T00:07:35.203 INFO:tasks.workunit.client.1.smithi135.stdout:8/650: rename d4/d8/f83 to d4/d7/d2a/d96/fdd 0 2024-05-09T00:07:35.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/649: creat d3/dd/d2d/db5/fb6 x:0 0 0 2024-05-09T00:07:35.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/650: write d3/dd/f4e [5205344,53035] 0 2024-05-09T00:07:35.209 INFO:tasks.workunit.client.1.smithi135.stdout:7/705: dwrite db/dd/d33/d58/fd7 [0,4194304] 0 2024-05-09T00:07:35.209 INFO:tasks.workunit.client.1.smithi135.stdout:4/521: dread dc/d26/d4e/f54 [0,4194304] 0 2024-05-09T00:07:35.209 INFO:tasks.workunit.client.1.smithi135.stdout:7/706: chown db/da8/d78/f87 28 1 2024-05-09T00:07:35.210 INFO:tasks.workunit.client.1.smithi135.stdout:2/641: creat d1/d12/d20/d2b/d56/d86/fda x:0 0 0 2024-05-09T00:07:35.211 INFO:tasks.workunit.client.1.smithi135.stdout:2/642: write d1/d22/f28 [1807116,80511] 0 2024-05-09T00:07:35.211 INFO:tasks.workunit.client.1.smithi135.stdout:2/643: truncate d1/d12/d21/f9f 214994 0 2024-05-09T00:07:35.211 INFO:tasks.workunit.client.1.smithi135.stdout:6/648: dwrite d2/f25 [0,4194304] 0 2024-05-09T00:07:35.211 INFO:tasks.workunit.client.1.smithi135.stdout:6/649: truncate d2/d1a/f9f 3138 0 2024-05-09T00:07:35.211 INFO:tasks.workunit.client.1.smithi135.stdout:6/650: readlink d2/d20/d3f/la9 0 2024-05-09T00:07:35.212 INFO:tasks.workunit.client.0.smithi026.stdout:5/30: truncate d2/f3 71670 0 2024-05-09T00:07:35.212 INFO:tasks.workunit.client.1.smithi135.stdout:5/672: mkdir db/d24/db0/dcd 0 2024-05-09T00:07:35.215 INFO:tasks.workunit.client.0.smithi026.stdout:5/31: rename l1 to d2/l7 0 2024-05-09T00:07:35.215 INFO:tasks.workunit.client.1.smithi135.stdout:0/651: mknod d3/dd/d3f/d29/d7c/daa/cb7 0 2024-05-09T00:07:35.217 INFO:tasks.workunit.client.1.smithi135.stdout:3/665: sync 2024-05-09T00:07:35.218 INFO:tasks.workunit.client.1.smithi135.stdout:4/522: mknod dc/d4a/d69/d55/d5f/cb2 0 2024-05-09T00:07:35.219 INFO:tasks.workunit.client.1.smithi135.stdout:4/523: read dc/d4a/d69/d55/d5f/f97 [157345,53159] 0 2024-05-09T00:07:35.219 INFO:tasks.workunit.client.1.smithi135.stdout:7/707: creat db/d1e/d3a/d40/d4c/d67/fea x:0 0 0 2024-05-09T00:07:35.219 INFO:tasks.workunit.client.1.smithi135.stdout:7/708: fsync db/d21/fc4 0 2024-05-09T00:07:35.220 INFO:tasks.workunit.client.1.smithi135.stdout:2/644: link d1/d12/d21/d41/d6d/d6e/dc6/lce d1/d12/d21/d57/dbd/ldb 0 2024-05-09T00:07:35.221 INFO:tasks.workunit.client.1.smithi135.stdout:6/651: truncate d2/f96 90391 0 2024-05-09T00:07:35.225 INFO:tasks.workunit.client.1.smithi135.stdout:5/673: truncate db/d3f/f5c 2169513 0 2024-05-09T00:07:35.225 INFO:tasks.workunit.client.1.smithi135.stdout:5/674: write db/d84/d62/d73/d9c/d9f/f8b [1664752,98339] 0 2024-05-09T00:07:35.226 INFO:tasks.workunit.client.1.smithi135.stdout:0/652: unlink d3/d64/l67 0 2024-05-09T00:07:35.226 INFO:tasks.workunit.client.1.smithi135.stdout:0/653: read - d3/dd/d3f/d3a/d46/f9d zero size 2024-05-09T00:07:35.227 INFO:tasks.workunit.client.1.smithi135.stdout:3/666: stat d8/d6d/d24/l25 0 2024-05-09T00:07:35.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/524: symlink dc/d26/d31/d96/lb3 0 2024-05-09T00:07:35.229 INFO:tasks.workunit.client.0.smithi026.stdout:5/32: write d2/f3 [663973,85916] 0 2024-05-09T00:07:35.229 INFO:tasks.workunit.client.0.smithi026.stdout:5/33: truncate d2/f3 901925 0 2024-05-09T00:07:35.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/525: read f7 [194901,97122] 0 2024-05-09T00:07:35.231 INFO:tasks.workunit.client.1.smithi135.stdout:7/709: symlink db/d1e/d3a/d40/d4c/leb 0 2024-05-09T00:07:35.233 INFO:tasks.workunit.client.1.smithi135.stdout:2/645: rename d1/d22/l77 to d1/d12/d20/d2b/d7c/dd9/ldc 0 2024-05-09T00:07:35.237 INFO:tasks.workunit.client.1.smithi135.stdout:5/675: link db/d84/d62/d73/d9c/d9f/fb4 db/d24/d32/fce 0 2024-05-09T00:07:35.238 INFO:tasks.workunit.client.1.smithi135.stdout:6/652: truncate d2/f77 2635468 0 2024-05-09T00:07:35.238 INFO:tasks.workunit.client.1.smithi135.stdout:5/676: chown db/d3f/fb3 385 1 2024-05-09T00:07:35.238 INFO:tasks.workunit.client.1.smithi135.stdout:6/653: chown d2/da/d1d/fc8 1286 1 2024-05-09T00:07:35.239 INFO:tasks.workunit.client.1.smithi135.stdout:0/654: rmdir d3/dd/d3f/d3a 39 2024-05-09T00:07:35.239 INFO:tasks.workunit.client.1.smithi135.stdout:0/655: chown d3 87 1 2024-05-09T00:07:35.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/710: symlink db/d1e/d63/lec 0 2024-05-09T00:07:35.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/711: stat db/d5b/f71 0 2024-05-09T00:07:35.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/712: write db/dd/d33/f3d [5617087,80105] 0 2024-05-09T00:07:35.240 INFO:tasks.workunit.client.1.smithi135.stdout:7/713: dread - db/d1e/d3a/d40/d4c/f6b zero size 2024-05-09T00:07:35.243 INFO:tasks.workunit.client.1.smithi135.stdout:5/677: symlink db/d24/db0/dcd/lcf 0 2024-05-09T00:07:35.243 INFO:tasks.workunit.client.1.smithi135.stdout:5/678: stat db/d84/d31/d5e/c7d 0 2024-05-09T00:07:35.245 INFO:tasks.workunit.client.1.smithi135.stdout:6/654: mknod d2/da/d26/d57/d59/ce2 0 2024-05-09T00:07:35.245 INFO:tasks.workunit.client.1.smithi135.stdout:6/655: write d2/da/d49/f67 [4397967,63843] 0 2024-05-09T00:07:35.248 INFO:tasks.workunit.client.1.smithi135.stdout:0/656: link d3/dd/d3f/f75 d3/dd/d3f/d58/dae/fb8 0 2024-05-09T00:07:35.248 INFO:tasks.workunit.client.1.smithi135.stdout:0/657: fsync d3/dd/d3f/d3a/d46/f91 0 2024-05-09T00:07:35.249 INFO:tasks.workunit.client.1.smithi135.stdout:6/656: dread d2/f17 [0,4194304] 0 2024-05-09T00:07:35.249 INFO:tasks.workunit.client.1.smithi135.stdout:0/658: write d3/dd/f26 [7587152,25558] 0 2024-05-09T00:07:35.249 INFO:tasks.workunit.client.1.smithi135.stdout:0/659: chown d3/dd/d3f/d43/c45 19706649 1 2024-05-09T00:07:35.249 INFO:tasks.workunit.client.1.smithi135.stdout:7/714: mkdir db/d1e/d3a/d40/d4c/da3/ded 0 2024-05-09T00:07:35.250 INFO:tasks.workunit.client.1.smithi135.stdout:3/667: dwrite d8/d13/d1f/d40/d52/f54 [0,4194304] 0 2024-05-09T00:07:35.251 INFO:tasks.workunit.client.1.smithi135.stdout:3/668: readlink d8/d13/d51/d63/db9/lc7 0 2024-05-09T00:07:35.251 INFO:tasks.workunit.client.1.smithi135.stdout:3/669: fdatasync d8/d13/d1f/f2e 0 2024-05-09T00:07:35.251 INFO:tasks.workunit.client.1.smithi135.stdout:5/679: fdatasync db/d24/f72 0 2024-05-09T00:07:35.254 INFO:tasks.workunit.client.1.smithi135.stdout:6/657: rename d2/da/d1d/d69/d89/lcf to d2/da/d26/d57/ddc/dd7/le3 0 2024-05-09T00:07:35.255 INFO:tasks.workunit.client.1.smithi135.stdout:9/543: sync 2024-05-09T00:07:35.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/615: sync 2024-05-09T00:07:35.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/616: fsync da/d14/fd3 0 2024-05-09T00:07:35.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/617: chown da/d24/cc3 138710601 1 2024-05-09T00:07:35.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/618: fdatasync da/d14/d20/fc7 0 2024-05-09T00:07:35.255 INFO:tasks.workunit.client.1.smithi135.stdout:5/680: dread db/d24/d32/d5b/f6a [0,4194304] 0 2024-05-09T00:07:35.256 INFO:tasks.workunit.client.1.smithi135.stdout:0/660: creat d3/dd/d3f/d58/dae/fb9 x:0 0 0 2024-05-09T00:07:35.256 INFO:tasks.workunit.client.1.smithi135.stdout:0/661: write d3/dd/d3f/d29/f2e [4452620,104152] 0 2024-05-09T00:07:35.257 INFO:tasks.workunit.client.1.smithi135.stdout:0/662: fdatasync d3/f23 0 2024-05-09T00:07:35.257 INFO:tasks.workunit.client.1.smithi135.stdout:0/663: chown d3/dd/d3f/d58/dae 908487300 1 2024-05-09T00:07:35.258 INFO:tasks.workunit.client.1.smithi135.stdout:7/715: link db/d21/cdd db/d1e/d63/cee 0 2024-05-09T00:07:35.258 INFO:tasks.workunit.client.1.smithi135.stdout:1/619: write da/db/d16/f18 [5671720,62010] 0 2024-05-09T00:07:35.258 INFO:tasks.workunit.client.1.smithi135.stdout:1/620: chown da/db/d16/f3e 1799635931 1 2024-05-09T00:07:35.258 INFO:tasks.workunit.client.1.smithi135.stdout:1/621: write da/d73/fd5 [731642,63645] 0 2024-05-09T00:07:35.259 INFO:tasks.workunit.client.1.smithi135.stdout:7/716: write db/dd/d33/da5/fc6 [2140219,103829] 0 2024-05-09T00:07:35.261 INFO:tasks.workunit.client.1.smithi135.stdout:3/670: mknod d8/ced 0 2024-05-09T00:07:35.263 INFO:tasks.workunit.client.0.smithi026.stdout:5/34: dwrite d2/f3 [0,4194304] 0 2024-05-09T00:07:35.264 INFO:tasks.workunit.client.1.smithi135.stdout:6/658: creat d2/da/d26/d57/d59/d62/fe4 x:0 0 0 2024-05-09T00:07:35.264 INFO:tasks.workunit.client.1.smithi135.stdout:3/671: dread d8/d6d/d44/d4b/da0/daa/f8f [0,4194304] 0 2024-05-09T00:07:35.265 INFO:tasks.workunit.client.1.smithi135.stdout:5/681: mknod db/d84/d62/cd0 0 2024-05-09T00:07:35.265 INFO:tasks.workunit.client.1.smithi135.stdout:5/682: truncate db/d84/faf 795263 0 2024-05-09T00:07:35.265 INFO:tasks.workunit.client.1.smithi135.stdout:5/683: chown db/d3f/cc9 15872039 1 2024-05-09T00:07:35.266 INFO:tasks.workunit.client.1.smithi135.stdout:5/684: read db/d5d/dac/fc3 [2926494,65471] 0 2024-05-09T00:07:35.266 INFO:tasks.workunit.client.1.smithi135.stdout:3/672: dread d8/d6d/d44/d4b/da0/daa/d88/f93 [0,4194304] 0 2024-05-09T00:07:35.275 INFO:tasks.workunit.client.1.smithi135.stdout:1/622: dwrite da/d24/d27/faf [0,4194304] 0 2024-05-09T00:07:35.314 INFO:tasks.workunit.client.1.smithi135.stdout:0/664: truncate d3/dd/d3f/f76 4545495 0 2024-05-09T00:07:35.358 INFO:tasks.workunit.client.0.smithi026.stdout:5/35: mkdir d2/d8 0 2024-05-09T00:07:35.359 INFO:tasks.workunit.client.1.smithi135.stdout:7/717: mkdir db/d1e/d3a/d40/d4c/d67/def 0 2024-05-09T00:07:35.361 INFO:tasks.workunit.client.1.smithi135.stdout:6/659: mknod d2/da/d26/d57/ddc/ce5 0 2024-05-09T00:07:35.361 INFO:tasks.workunit.client.1.smithi135.stdout:6/660: chown d2/l13 61506 1 2024-05-09T00:07:35.362 INFO:tasks.workunit.client.1.smithi135.stdout:7/718: dread db/d1e/d3a/f3b [0,4194304] 0 2024-05-09T00:07:35.367 INFO:tasks.workunit.client.1.smithi135.stdout:7/719: write db/fd2 [333354,105660] 0 2024-05-09T00:07:35.367 INFO:tasks.workunit.client.1.smithi135.stdout:7/720: fdatasync db/dd/d33/da5/fac 0 2024-05-09T00:07:35.367 INFO:tasks.workunit.client.1.smithi135.stdout:7/721: stat db/fd5 0 2024-05-09T00:07:35.367 INFO:tasks.workunit.client.1.smithi135.stdout:5/685: mknod db/d3f/cd1 0 2024-05-09T00:07:35.367 INFO:tasks.workunit.client.1.smithi135.stdout:5/686: stat db/fb9 0 2024-05-09T00:07:35.368 INFO:tasks.workunit.client.1.smithi135.stdout:7/722: read db/dd/d33/d58/fd7 [3275879,55347] 0 2024-05-09T00:07:35.368 INFO:tasks.workunit.client.1.smithi135.stdout:7/723: dread - db/dd/fb7 zero size 2024-05-09T00:07:35.368 INFO:tasks.workunit.client.1.smithi135.stdout:3/673: stat l7 0 2024-05-09T00:07:35.368 INFO:tasks.workunit.client.1.smithi135.stdout:3/674: truncate d8/d6d/d24/fb7 462663 0 2024-05-09T00:07:35.368 INFO:tasks.workunit.client.1.smithi135.stdout:3/675: chown d8/d13/d1f/d40/c3a 1 1 2024-05-09T00:07:35.369 INFO:tasks.workunit.client.1.smithi135.stdout:7/724: dread db/d13/f73 [0,4194304] 0 2024-05-09T00:07:35.369 INFO:tasks.workunit.client.1.smithi135.stdout:7/725: read db/da8/f86 [1563133,122515] 0 2024-05-09T00:07:35.374 INFO:tasks.workunit.client.1.smithi135.stdout:1/623: mknod da/db/d16/ce1 0 2024-05-09T00:07:35.376 INFO:tasks.workunit.client.1.smithi135.stdout:0/665: rename d3/dd/d2d/d4c/c73 to d3/dd/d3f/d29/d7c/cba 0 2024-05-09T00:07:35.386 INFO:tasks.workunit.client.1.smithi135.stdout:1/624: link da/d14/d5c/d83/fcb da/d73/fe2 0 2024-05-09T00:07:35.451 INFO:tasks.workunit.client.0.smithi026.stdout:8/18: sync 2024-05-09T00:07:35.452 INFO:tasks.workunit.client.0.smithi026.stdout:6/38: sync 2024-05-09T00:07:35.452 INFO:tasks.workunit.client.0.smithi026.stdout:6/39: read - fa zero size 2024-05-09T00:07:35.452 INFO:tasks.workunit.client.0.smithi026.stdout:8/19: rename f2 to f3 0 2024-05-09T00:07:35.453 INFO:tasks.workunit.client.0.smithi026.stdout:6/40: dread f9 [0,4194304] 0 2024-05-09T00:07:35.454 INFO:tasks.workunit.client.0.smithi026.stdout:8/20: symlink l4 0 2024-05-09T00:07:35.454 INFO:tasks.workunit.client.0.smithi026.stdout:8/21: write f3 [150453,4795] 0 2024-05-09T00:07:35.454 INFO:tasks.workunit.client.0.smithi026.stdout:8/22: write f3 [110520,23094] 0 2024-05-09T00:07:35.454 INFO:tasks.workunit.client.0.smithi026.stdout:8/23: chown f3 0 1 2024-05-09T00:07:35.465 INFO:tasks.workunit.client.0.smithi026.stdout:8/24: symlink l5 0 2024-05-09T00:07:35.465 INFO:tasks.workunit.client.0.smithi026.stdout:8/25: chown f3 2 1 2024-05-09T00:07:35.465 INFO:tasks.workunit.client.0.smithi026.stdout:8/26: truncate f3 500467 0 2024-05-09T00:07:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:7/34: sync 2024-05-09T00:07:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:2/25: sync 2024-05-09T00:07:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:4/37: sync 2024-05-09T00:07:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:1/46: sync 2024-05-09T00:07:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:0/110: sync 2024-05-09T00:07:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:3/50: sync 2024-05-09T00:07:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:9/55: sync 2024-05-09T00:07:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:0/111: write f14 [1895331,22749] 0 2024-05-09T00:07:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:1/47: creat d5/dd/fe x:0 0 0 2024-05-09T00:07:35.487 INFO:tasks.workunit.client.0.smithi026.stdout:2/26: creat f9 x:0 0 0 2024-05-09T00:07:35.487 INFO:tasks.workunit.client.0.smithi026.stdout:2/27: fsync f5 0 2024-05-09T00:07:35.488 INFO:tasks.workunit.client.0.smithi026.stdout:7/35: creat d8/fa x:0 0 0 2024-05-09T00:07:35.489 INFO:tasks.workunit.client.0.smithi026.stdout:3/51: symlink d5/le 0 2024-05-09T00:07:35.491 INFO:tasks.workunit.client.0.smithi026.stdout:0/112: rmdir d1d 39 2024-05-09T00:07:35.492 INFO:tasks.workunit.client.0.smithi026.stdout:9/56: mknod d7/c12 0 2024-05-09T00:07:35.496 INFO:tasks.workunit.client.0.smithi026.stdout:0/113: creat d1d/d1e/f23 x:0 0 0 2024-05-09T00:07:35.496 INFO:tasks.workunit.client.0.smithi026.stdout:0/114: chown d1d/d1e/f23 11772532 1 2024-05-09T00:07:35.496 INFO:tasks.workunit.client.0.smithi026.stdout:0/115: truncate f1b 162351 0 2024-05-09T00:07:35.498 INFO:tasks.workunit.client.0.smithi026.stdout:1/48: dread d5/f7 [0,4194304] 0 2024-05-09T00:07:35.498 INFO:tasks.workunit.client.0.smithi026.stdout:0/116: mknod d1d/c24 0 2024-05-09T00:07:35.502 INFO:tasks.workunit.client.0.smithi026.stdout:9/57: link d7/la d7/l13 0 2024-05-09T00:07:35.505 INFO:tasks.workunit.client.0.smithi026.stdout:9/58: truncate d7/f8 4580694 0 2024-05-09T00:07:35.506 INFO:tasks.workunit.client.1.smithi135.stdout:8/651: sync 2024-05-09T00:07:35.508 INFO:tasks.workunit.client.0.smithi026.stdout:0/117: dread f4 [0,4194304] 0 2024-05-09T00:07:35.508 INFO:tasks.workunit.client.1.smithi135.stdout:4/526: sync 2024-05-09T00:07:35.510 INFO:tasks.workunit.client.0.smithi026.stdout:0/118: write f5 [515473,127758] 0 2024-05-09T00:07:35.511 INFO:tasks.workunit.client.1.smithi135.stdout:9/544: sync 2024-05-09T00:07:35.511 INFO:tasks.workunit.client.1.smithi135.stdout:2/646: sync 2024-05-09T00:07:35.511 INFO:tasks.workunit.client.1.smithi135.stdout:2/647: stat d1/f1c 0 2024-05-09T00:07:35.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/119: chown ce 26793814 1 2024-05-09T00:07:35.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/120: readlink l1c 0 2024-05-09T00:07:35.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/121: truncate f1b 701830 0 2024-05-09T00:07:35.518 INFO:tasks.workunit.client.0.smithi026.stdout:4/38: dread d0/f6 [0,4194304] 0 2024-05-09T00:07:35.519 INFO:tasks.workunit.client.1.smithi135.stdout:2/648: mkdir d1/d12/d20/d2b/d56/ddd 0 2024-05-09T00:07:35.520 INFO:tasks.workunit.client.0.smithi026.stdout:4/39: unlink d0/l4 0 2024-05-09T00:07:35.525 INFO:tasks.workunit.client.1.smithi135.stdout:2/649: rmdir d1/d12/d21/d57/dc8 0 2024-05-09T00:07:35.525 INFO:tasks.workunit.client.1.smithi135.stdout:2/650: stat d1/d12/da3/lcd 0 2024-05-09T00:07:35.525 INFO:tasks.workunit.client.1.smithi135.stdout:2/651: readlink d1/d12/d20/d2b/d7c/dd9/ldc 0 2024-05-09T00:07:35.527 INFO:tasks.workunit.client.1.smithi135.stdout:2/652: mknod d1/d12/d21/d57/cde 0 2024-05-09T00:07:35.538 INFO:tasks.workunit.client.1.smithi135.stdout:6/661: creat d2/d20/fe6 x:0 0 0 2024-05-09T00:07:35.539 INFO:tasks.workunit.client.1.smithi135.stdout:6/662: truncate d2/da/d26/d57/d60/fdf 1100228 0 2024-05-09T00:07:35.539 INFO:tasks.workunit.client.0.smithi026.stdout:2/28: dwrite f4 [0,4194304] 0 2024-05-09T00:07:35.539 INFO:tasks.workunit.client.1.smithi135.stdout:6/663: write d2/da/d26/d57/d60/f6f [28478,32658] 0 2024-05-09T00:07:35.541 INFO:tasks.workunit.client.0.smithi026.stdout:2/29: write f5 [2279944,122197] 0 2024-05-09T00:07:35.543 INFO:tasks.workunit.client.0.smithi026.stdout:2/30: rename f1 to fa 0 2024-05-09T00:07:35.546 INFO:tasks.workunit.client.1.smithi135.stdout:2/653: creat d1/fdf x:0 0 0 2024-05-09T00:07:35.546 INFO:tasks.workunit.client.1.smithi135.stdout:2/654: readlink d1/d12/d21/d41/d6d/lba 0 2024-05-09T00:07:35.547 INFO:tasks.workunit.client.1.smithi135.stdout:2/655: creat d1/d12/d27/fe0 x:0 0 0 2024-05-09T00:07:35.547 INFO:tasks.workunit.client.1.smithi135.stdout:2/656: write d1/d12/da3/fd8 [478912,348] 0 2024-05-09T00:07:35.548 INFO:tasks.workunit.client.0.smithi026.stdout:8/27: getdents . 0 2024-05-09T00:07:35.549 INFO:tasks.workunit.client.1.smithi135.stdout:2/657: mknod d1/d12/d20/d2b/d56/d72/ce1 0 2024-05-09T00:07:35.549 INFO:tasks.workunit.client.0.smithi026.stdout:8/28: mknod c6 0 2024-05-09T00:07:35.551 INFO:tasks.workunit.client.1.smithi135.stdout:2/658: creat d1/d12/d20/d2b/fe2 x:0 0 0 2024-05-09T00:07:35.551 INFO:tasks.workunit.client.1.smithi135.stdout:2/659: write d1/d12/d20/d2b/d56/f69 [477480,38804] 0 2024-05-09T00:07:35.551 INFO:tasks.workunit.client.0.smithi026.stdout:8/29: stat f3 0 2024-05-09T00:07:35.552 INFO:tasks.workunit.client.0.smithi026.stdout:8/30: read f3 [415767,69336] 0 2024-05-09T00:07:35.553 INFO:tasks.workunit.client.1.smithi135.stdout:2/660: mknod d1/d12/d21/d41/d6d/ce3 0 2024-05-09T00:07:35.553 INFO:tasks.workunit.client.1.smithi135.stdout:2/661: write d1/d12/d20/d3b/d4f/f6a [1112422,40073] 0 2024-05-09T00:07:35.554 INFO:tasks.workunit.client.0.smithi026.stdout:8/31: creat f7 x:0 0 0 2024-05-09T00:07:35.554 INFO:tasks.workunit.client.0.smithi026.stdout:8/32: dread - f7 zero size 2024-05-09T00:07:35.555 INFO:tasks.workunit.client.1.smithi135.stdout:2/662: symlink d1/d12/le4 0 2024-05-09T00:07:35.556 INFO:tasks.workunit.client.1.smithi135.stdout:1/625: link da/db/ca5 da/d14/d20/ce3 0 2024-05-09T00:07:35.556 INFO:tasks.workunit.client.1.smithi135.stdout:1/626: fsync da/db/f95 0 2024-05-09T00:07:35.557 INFO:tasks.workunit.client.1.smithi135.stdout:2/663: symlink d1/d12/d21/dc7/le5 0 2024-05-09T00:07:35.558 INFO:tasks.workunit.client.0.smithi026.stdout:8/33: symlink l8 0 2024-05-09T00:07:35.560 INFO:tasks.workunit.client.1.smithi135.stdout:1/627: link da/d24/cc3 da/d24/d27/ce4 0 2024-05-09T00:07:35.562 INFO:tasks.workunit.client.1.smithi135.stdout:4/527: dwrite dc/d4a/d69/d55/d5f/f21 [0,4194304] 0 2024-05-09T00:07:35.562 INFO:tasks.workunit.client.0.smithi026.stdout:1/49: dwrite d5/dd/fe [0,4194304] 0 2024-05-09T00:07:35.563 INFO:tasks.workunit.client.0.smithi026.stdout:1/50: dread - d5/fc zero size 2024-05-09T00:07:35.564 INFO:tasks.workunit.client.1.smithi135.stdout:3/676: creat d8/d13/d1f/d40/fee x:0 0 0 2024-05-09T00:07:35.564 INFO:tasks.workunit.client.1.smithi135.stdout:3/677: chown d8/d6d/la5 2735617 1 2024-05-09T00:07:35.564 INFO:tasks.workunit.client.1.smithi135.stdout:3/678: fsync d8/d6d/d44/d4b/d59/d90/f9c 0 2024-05-09T00:07:35.566 INFO:tasks.workunit.client.1.smithi135.stdout:8/652: dwrite d4/d7/d33/fd7 [0,4194304] 0 2024-05-09T00:07:35.567 INFO:tasks.workunit.client.0.smithi026.stdout:9/59: dwrite d7/fd [4194304,4194304] 0 2024-05-09T00:07:35.567 INFO:tasks.workunit.client.0.smithi026.stdout:0/122: dwrite f19 [0,4194304] 0 2024-05-09T00:07:35.567 INFO:tasks.workunit.client.0.smithi026.stdout:0/123: truncate f10 8880013 0 2024-05-09T00:07:35.567 INFO:tasks.workunit.client.0.smithi026.stdout:0/124: stat d1d/c24 0 2024-05-09T00:07:35.568 INFO:tasks.workunit.client.1.smithi135.stdout:7/726: unlink db/d1e/d3a/d40/l5a 0 2024-05-09T00:07:35.569 INFO:tasks.workunit.client.0.smithi026.stdout:4/40: dwrite d0/f2 [0,4194304] 0 2024-05-09T00:07:35.570 INFO:tasks.workunit.client.1.smithi135.stdout:3/679: rename d8/d6d/d44/d4b/da0/daa/cd5 to d8/d6d/d44/d4b/da0/daa/cef 0 2024-05-09T00:07:35.574 INFO:tasks.workunit.client.1.smithi135.stdout:8/653: write d4/d7/d33/fd7 [2093973,122252] 0 2024-05-09T00:07:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:3/680: mknod d8/d6d/d44/cf0 0 2024-05-09T00:07:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:3/681: write d8/d6d/d44/d4b/fd9 [4796603,105580] 0 2024-05-09T00:07:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:3/682: chown d8/d13/d75/d53/d6a/fd0 12 1 2024-05-09T00:07:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:3/683: truncate d8/d6d/d24/fb7 895993 0 2024-05-09T00:07:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:8/654: mkdir d4/d8/da2/da6/dde 0 2024-05-09T00:07:35.580 INFO:tasks.workunit.client.1.smithi135.stdout:8/655: fsync d4/d22/f8c 0 2024-05-09T00:07:35.580 INFO:tasks.workunit.client.1.smithi135.stdout:8/656: fdatasync d4/d7/d2a/d96/f9e 0 2024-05-09T00:07:35.580 INFO:tasks.workunit.client.1.smithi135.stdout:8/657: write d4/d7/d33/d39/f84 [665652,107969] 0 2024-05-09T00:07:35.580 INFO:tasks.workunit.client.0.smithi026.stdout:0/125: unlink c15 0 2024-05-09T00:07:35.581 INFO:tasks.workunit.client.0.smithi026.stdout:0/126: chown l1c 1888580754 1 2024-05-09T00:07:35.584 INFO:tasks.workunit.client.1.smithi135.stdout:8/658: rmdir d4/d22/d8b 39 2024-05-09T00:07:35.585 INFO:tasks.workunit.client.1.smithi135.stdout:8/659: write d4/f94 [650276,101240] 0 2024-05-09T00:07:35.586 INFO:tasks.workunit.client.0.smithi026.stdout:4/41: creat d0/fc x:0 0 0 2024-05-09T00:07:35.587 INFO:tasks.workunit.client.0.smithi026.stdout:4/42: chown d0/fb 453236 1 2024-05-09T00:07:35.587 INFO:tasks.workunit.client.0.smithi026.stdout:9/60: mknod d7/c14 0 2024-05-09T00:07:35.589 INFO:tasks.workunit.client.1.smithi135.stdout:8/660: creat d4/d22/fdf x:0 0 0 2024-05-09T00:07:35.590 INFO:tasks.workunit.client.0.smithi026.stdout:4/43: mknod d0/cd 0 2024-05-09T00:07:35.590 INFO:tasks.workunit.client.0.smithi026.stdout:4/44: chown d0/fb 481 1 2024-05-09T00:07:35.591 INFO:tasks.workunit.client.0.smithi026.stdout:9/61: symlink d7/l15 0 2024-05-09T00:07:35.592 INFO:tasks.workunit.client.1.smithi135.stdout:8/661: symlink d4/d7/d4a/le0 0 2024-05-09T00:07:35.595 INFO:tasks.workunit.client.1.smithi135.stdout:5/687: rename db/l1e to db/d84/ld2 0 2024-05-09T00:07:35.597 INFO:tasks.workunit.client.1.smithi135.stdout:8/662: mkdir d4/d7/d2a/d9f/de1 0 2024-05-09T00:07:35.599 INFO:tasks.workunit.client.1.smithi135.stdout:5/688: creat db/d24/d32/d5b/d91/fd3 x:0 0 0 2024-05-09T00:07:35.601 INFO:tasks.workunit.client.0.smithi026.stdout:9/62: link d7/fe d7/f16 0 2024-05-09T00:07:35.605 INFO:tasks.workunit.client.1.smithi135.stdout:8/663: rename d4/d7/d2a/d96 to d4/d7/de/d45/d76/de2 0 2024-05-09T00:07:35.605 INFO:tasks.workunit.client.1.smithi135.stdout:8/664: fdatasync d4/d7/de/d45/fac 0 2024-05-09T00:07:35.607 INFO:tasks.workunit.client.1.smithi135.stdout:2/664: dwrite d1/d12/d21/d41/d6d/db4/fbe [0,4194304] 0 2024-05-09T00:07:35.608 INFO:tasks.workunit.client.0.smithi026.stdout:8/34: dwrite f7 [0,4194304] 0 2024-05-09T00:07:35.609 INFO:tasks.workunit.client.1.smithi135.stdout:4/528: dread dc/dd/f14 [0,4194304] 0 2024-05-09T00:07:35.610 INFO:tasks.workunit.client.1.smithi135.stdout:7/727: dwrite db/d1e/d3a/f3b [0,4194304] 0 2024-05-09T00:07:35.610 INFO:tasks.workunit.client.0.smithi026.stdout:9/63: unlink d7/fe 0 2024-05-09T00:07:35.611 INFO:tasks.workunit.client.0.smithi026.stdout:0/127: dread f5 [0,4194304] 0 2024-05-09T00:07:35.612 INFO:tasks.workunit.client.1.smithi135.stdout:8/665: creat d4/d7/d2a/d9f/fe3 x:0 0 0 2024-05-09T00:07:35.615 INFO:tasks.workunit.client.1.smithi135.stdout:5/689: write db/d24/f34 [1397880,3277] 0 2024-05-09T00:07:35.615 INFO:tasks.workunit.client.1.smithi135.stdout:5/690: chown db/d24/d32/lca 72595 1 2024-05-09T00:07:35.615 INFO:tasks.workunit.client.1.smithi135.stdout:5/691: dread - db/d84/d31/fbb zero size 2024-05-09T00:07:35.616 INFO:tasks.workunit.client.0.smithi026.stdout:0/128: write f19 [1105382,22280] 0 2024-05-09T00:07:35.616 INFO:tasks.workunit.client.1.smithi135.stdout:8/666: write d4/d7/d2a/d67/fb3 [2678794,43773] 0 2024-05-09T00:07:35.616 INFO:tasks.workunit.client.1.smithi135.stdout:8/667: dread - d4/d7/de/d45/d76/de2/fd0 zero size 2024-05-09T00:07:35.617 INFO:tasks.workunit.client.1.smithi135.stdout:8/668: chown d4/d7/d4a/d9c/ca0 393982 1 2024-05-09T00:07:35.617 INFO:tasks.workunit.client.1.smithi135.stdout:2/665: chown d1/l14 6 1 2024-05-09T00:07:35.617 INFO:tasks.workunit.client.1.smithi135.stdout:1/628: dwrite da/d14/d20/d38/d3a/d40/fc5 [0,4194304] 0 2024-05-09T00:07:35.617 INFO:tasks.workunit.client.1.smithi135.stdout:1/629: stat da/d24/d27/d33/f98 0 2024-05-09T00:07:35.617 INFO:tasks.workunit.client.1.smithi135.stdout:1/630: write da/d24/d27/d33/d7d/fc0 [920719,93847] 0 2024-05-09T00:07:35.620 INFO:tasks.workunit.client.0.smithi026.stdout:1/51: dwrite f4 [8388608,4194304] 0 2024-05-09T00:07:35.620 INFO:tasks.workunit.client.1.smithi135.stdout:3/684: dwrite d8/d13/d1f/d40/fcd [0,4194304] 0 2024-05-09T00:07:35.623 INFO:tasks.workunit.client.0.smithi026.stdout:0/129: mkdir d1d/d25 0 2024-05-09T00:07:35.623 INFO:tasks.workunit.client.0.smithi026.stdout:0/130: getdents d1d/d25 0 2024-05-09T00:07:35.625 INFO:tasks.workunit.client.1.smithi135.stdout:4/529: rename dc/d4a/d69/d39/l35 to dc/d71/d86/lb4 0 2024-05-09T00:07:35.625 INFO:tasks.workunit.client.1.smithi135.stdout:4/530: readlink dc/dd/l30 0 2024-05-09T00:07:35.628 INFO:tasks.workunit.client.1.smithi135.stdout:5/692: dread db/d84/f3c [0,4194304] 0 2024-05-09T00:07:35.629 INFO:tasks.workunit.client.0.smithi026.stdout:1/52: rename d5/fc to d5/dd/ff 0 2024-05-09T00:07:35.629 INFO:tasks.workunit.client.0.smithi026.stdout:1/53: truncate d5/dd/ff 463404 0 2024-05-09T00:07:35.629 INFO:tasks.workunit.client.0.smithi026.stdout:1/54: readlink d5/l6 0 2024-05-09T00:07:35.630 INFO:tasks.workunit.client.1.smithi135.stdout:5/693: write db/f12 [3350317,31033] 0 2024-05-09T00:07:35.630 INFO:tasks.workunit.client.1.smithi135.stdout:5/694: write db/d84/d62/d73/d9c/d9f/dc0/dc4/fcb [736920,24766] 0 2024-05-09T00:07:35.632 INFO:tasks.workunit.client.0.smithi026.stdout:9/64: mknod d7/c17 0 2024-05-09T00:07:35.632 INFO:tasks.workunit.client.0.smithi026.stdout:2/31: dwrite f9 [0,4194304] 0 2024-05-09T00:07:35.632 INFO:tasks.workunit.client.0.smithi026.stdout:2/32: fsync fa 0 2024-05-09T00:07:35.633 INFO:tasks.workunit.client.0.smithi026.stdout:8/35: link f7 f9 0 2024-05-09T00:07:35.638 INFO:tasks.workunit.client.1.smithi135.stdout:8/669: creat d4/d7/de/d45/d76/de2/fe4 x:0 0 0 2024-05-09T00:07:35.638 INFO:tasks.workunit.client.1.smithi135.stdout:4/531: dread dc/d26/d31/f6f [0,4194304] 0 2024-05-09T00:07:35.642 INFO:tasks.workunit.client.0.smithi026.stdout:9/65: dread d7/f16 [0,4194304] 0 2024-05-09T00:07:35.642 INFO:tasks.workunit.client.0.smithi026.stdout:2/33: getdents . 0 2024-05-09T00:07:35.644 INFO:tasks.workunit.client.1.smithi135.stdout:7/728: dwrite db/d1e/d3a/d40/d4c/f53 [0,4194304] 0 2024-05-09T00:07:35.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:33.904809+0000 mgr.smithi135.kkrhgf (mgr.24419) 46 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 839 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 94 MiB/s wr, 157 op/s 2024-05-09T00:07:35.645 INFO:tasks.workunit.client.0.smithi026.stdout:8/36: chown l5 17825623 1 2024-05-09T00:07:35.646 INFO:tasks.workunit.client.0.smithi026.stdout:8/37: dread f3 [0,4194304] 0 2024-05-09T00:07:35.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:33.904809+0000 mgr.smithi135.kkrhgf (mgr.24419) 46 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 839 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 94 MiB/s wr, 157 op/s 2024-05-09T00:07:35.648 INFO:tasks.workunit.client.0.smithi026.stdout:0/131: dwrite fa [0,4194304] 0 2024-05-09T00:07:35.648 INFO:tasks.workunit.client.0.smithi026.stdout:0/132: stat f5 0 2024-05-09T00:07:35.648 INFO:tasks.workunit.client.0.smithi026.stdout:9/66: rmdir d7 39 2024-05-09T00:07:35.649 INFO:tasks.workunit.client.1.smithi135.stdout:1/631: dwrite da/d24/d27/d33/d52/f80 [0,4194304] 0 2024-05-09T00:07:35.650 INFO:tasks.workunit.client.0.smithi026.stdout:8/38: creat fa x:0 0 0 2024-05-09T00:07:35.655 INFO:tasks.workunit.client.0.smithi026.stdout:4/45: getdents d0 0 2024-05-09T00:07:35.660 INFO:tasks.workunit.client.0.smithi026.stdout:0/133: creat d1d/d1e/f26 x:0 0 0 2024-05-09T00:07:35.660 INFO:tasks.workunit.client.0.smithi026.stdout:0/134: chown l13 558293028 1 2024-05-09T00:07:35.660 INFO:tasks.workunit.client.0.smithi026.stdout:0/135: fsync f1b 0 2024-05-09T00:07:35.661 INFO:tasks.workunit.client.1.smithi135.stdout:1/632: dread da/d14/d5c/f6b [0,4194304] 0 2024-05-09T00:07:35.661 INFO:tasks.workunit.client.1.smithi135.stdout:1/633: chown da/d14/d20/d38/d86/cdc 67551 1 2024-05-09T00:07:35.661 INFO:tasks.workunit.client.1.smithi135.stdout:1/634: chown da/d73/cb5 198475 1 2024-05-09T00:07:35.661 INFO:tasks.workunit.client.1.smithi135.stdout:1/635: chown da/d14/d20/d38/d3a/d40/lc9 447351822 1 2024-05-09T00:07:35.661 INFO:tasks.workunit.client.1.smithi135.stdout:0/666: sync 2024-05-09T00:07:35.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/685: read d8/d13/d51/fd6 [310654,130167] 0 2024-05-09T00:07:35.662 INFO:tasks.workunit.client.1.smithi135.stdout:3/686: write d8/d6d/d44/d4b/d69/fca [668347,61477] 0 2024-05-09T00:07:35.663 INFO:tasks.workunit.client.1.smithi135.stdout:7/729: dwrite db/d21/dd0/fd8 [0,4194304] 0 2024-05-09T00:07:35.663 INFO:tasks.workunit.client.1.smithi135.stdout:7/730: dread - db/da8/fbb zero size 2024-05-09T00:07:35.664 INFO:tasks.workunit.client.1.smithi135.stdout:5/695: rename db/d84/d31/f89 to db/d24/d32/fd4 0 2024-05-09T00:07:35.665 INFO:tasks.workunit.client.0.smithi026.stdout:9/67: stat d7/cf 0 2024-05-09T00:07:35.665 INFO:tasks.workunit.client.0.smithi026.stdout:9/68: chown c5 0 1 2024-05-09T00:07:35.667 INFO:tasks.workunit.client.1.smithi135.stdout:8/670: mknod d4/d8/ce5 0 2024-05-09T00:07:35.669 INFO:tasks.workunit.client.0.smithi026.stdout:2/34: dwrite f4 [0,4194304] 0 2024-05-09T00:07:35.670 INFO:tasks.workunit.client.0.smithi026.stdout:2/35: stat f4 0 2024-05-09T00:07:35.670 INFO:tasks.workunit.client.1.smithi135.stdout:4/532: creat dc/fb5 x:0 0 0 2024-05-09T00:07:35.670 INFO:tasks.workunit.client.1.smithi135.stdout:4/533: readlink dc/d4a/d69/d55/d6d/l8f 0 2024-05-09T00:07:35.670 INFO:tasks.workunit.client.1.smithi135.stdout:4/534: truncate dc/d4a/d69/d55/d5f/f97 4797053 0 2024-05-09T00:07:35.671 INFO:tasks.workunit.client.1.smithi135.stdout:8/671: write d4/d7/de/d45/f7a [2421003,4847] 0 2024-05-09T00:07:35.671 INFO:tasks.workunit.client.1.smithi135.stdout:8/672: chown d4/d7/de/d45/l86 7 1 2024-05-09T00:07:35.671 INFO:tasks.workunit.client.1.smithi135.stdout:8/673: chown d4/d7/d4a/d9c/ld4 10513 1 2024-05-09T00:07:35.671 INFO:tasks.workunit.client.0.smithi026.stdout:4/46: creat d0/fe x:0 0 0 2024-05-09T00:07:35.672 INFO:tasks.workunit.client.1.smithi135.stdout:2/666: dread d1/d12/d20/d2b/d7c/db5/f7a [0,4194304] 0 2024-05-09T00:07:35.677 INFO:tasks.workunit.client.0.smithi026.stdout:0/136: rename cc to d1d/d1e/d20/c27 0 2024-05-09T00:07:35.680 INFO:tasks.workunit.client.0.smithi026.stdout:8/39: truncate f7 594198 0 2024-05-09T00:07:35.685 INFO:tasks.workunit.client.0.smithi026.stdout:0/137: creat d1d/d1e/d20/f28 x:0 0 0 2024-05-09T00:07:35.686 INFO:tasks.workunit.client.1.smithi135.stdout:1/636: creat da/d14/d20/d38/d3a/db7/fe5 x:0 0 0 2024-05-09T00:07:35.688 INFO:tasks.workunit.client.1.smithi135.stdout:0/667: unlink d3/dd/d3f/d29/l37 0 2024-05-09T00:07:35.689 INFO:tasks.workunit.client.0.smithi026.stdout:4/47: symlink d0/lf 0 2024-05-09T00:07:35.689 INFO:tasks.workunit.client.0.smithi026.stdout:4/48: stat d0/lf 0 2024-05-09T00:07:35.690 INFO:tasks.workunit.client.0.smithi026.stdout:9/69: dwrite f3 [0,4194304] 0 2024-05-09T00:07:35.691 INFO:tasks.workunit.client.1.smithi135.stdout:3/687: link d8/d6d/d44/d4b/d59/d90/d7b/fc0 d8/d6d/d44/d4b/da0/ff1 0 2024-05-09T00:07:35.691 INFO:tasks.workunit.client.0.smithi026.stdout:0/138: truncate f14 1555711 0 2024-05-09T00:07:35.691 INFO:tasks.workunit.client.0.smithi026.stdout:0/139: chown ce 15643270 1 2024-05-09T00:07:35.692 INFO:tasks.workunit.client.0.smithi026.stdout:8/40: getdents . 0 2024-05-09T00:07:35.694 INFO:tasks.workunit.client.0.smithi026.stdout:4/49: readlink d0/l5 0 2024-05-09T00:07:35.695 INFO:tasks.workunit.client.0.smithi026.stdout:2/36: dwrite f9 [0,4194304] 0 2024-05-09T00:07:35.695 INFO:tasks.workunit.client.0.smithi026.stdout:2/37: chown f9 204 1 2024-05-09T00:07:35.696 INFO:tasks.workunit.client.0.smithi026.stdout:9/70: truncate f2 1916166 0 2024-05-09T00:07:35.698 INFO:tasks.workunit.client.1.smithi135.stdout:9/545: sync 2024-05-09T00:07:35.698 INFO:tasks.workunit.client.1.smithi135.stdout:9/546: stat d1/d1a/d2c/d2d/l4a 0 2024-05-09T00:07:35.700 INFO:tasks.workunit.client.0.smithi026.stdout:4/50: write d0/f9 [4107967,121127] 0 2024-05-09T00:07:35.700 INFO:tasks.workunit.client.0.smithi026.stdout:4/51: truncate d0/fe 300008 0 2024-05-09T00:07:35.701 INFO:tasks.workunit.client.1.smithi135.stdout:7/731: creat db/d5b/ff0 x:0 0 0 2024-05-09T00:07:35.701 INFO:tasks.workunit.client.1.smithi135.stdout:7/732: fdatasync db/dd/d33/d58/db5/fdf 0 2024-05-09T00:07:35.701 INFO:tasks.workunit.client.1.smithi135.stdout:7/733: readlink db/d1e/d3a/d40/d4c/d67/l76 0 2024-05-09T00:07:35.701 INFO:tasks.workunit.client.1.smithi135.stdout:7/734: fdatasync db/dd/d33/f82 0 2024-05-09T00:07:35.716 INFO:tasks.workunit.client.0.smithi026.stdout:0/140: dwrite ff [0,4194304] 0 2024-05-09T00:07:35.716 INFO:tasks.workunit.client.0.smithi026.stdout:0/141: read - d1d/d1e/f26 zero size 2024-05-09T00:07:35.716 INFO:tasks.workunit.client.0.smithi026.stdout:0/142: write d1d/d1e/d20/f28 [229399,28243] 0 2024-05-09T00:07:35.728 INFO:tasks.workunit.client.1.smithi135.stdout:7/735: dwrite db/dd/f2d [0,4194304] 0 2024-05-09T00:07:35.728 INFO:tasks.workunit.client.1.smithi135.stdout:7/736: chown db/dd/l49 772 1 2024-05-09T00:07:35.747 INFO:tasks.workunit.client.1.smithi135.stdout:7/737: dwrite db/d5b/f64 [0,4194304] 0 2024-05-09T00:07:35.755 INFO:tasks.workunit.client.1.smithi135.stdout:7/738: dread db/da8/f80 [0,4194304] 0 2024-05-09T00:07:35.765 INFO:tasks.workunit.client.1.smithi135.stdout:5/696: symlink db/d84/d62/d73/d9c/d9f/dc0/ld5 0 2024-05-09T00:07:35.768 INFO:tasks.workunit.client.1.smithi135.stdout:8/674: mknod d4/d7/de/d45/d76/ce6 0 2024-05-09T00:07:35.768 INFO:tasks.workunit.client.1.smithi135.stdout:8/675: chown d4/d7/d2a/d67/cbb 139 1 2024-05-09T00:07:35.855 INFO:tasks.workunit.client.1.smithi135.stdout:2/667: rename d1/d12/d20/d2b/d7c/dd9 to d1/d12/d21/de6 0 2024-05-09T00:07:35.855 INFO:tasks.workunit.client.1.smithi135.stdout:2/668: fsync d1/d12/d20/d2b/d56/d86/f88 0 2024-05-09T00:07:35.857 INFO:tasks.workunit.client.1.smithi135.stdout:1/637: creat da/d14/d5c/fe6 x:0 0 0 2024-05-09T00:07:35.857 INFO:tasks.workunit.client.1.smithi135.stdout:1/638: write da/d14/d20/d38/d3a/d40/d75/fc2 [746044,114210] 0 2024-05-09T00:07:35.857 INFO:tasks.workunit.client.1.smithi135.stdout:1/639: read da/d24/d27/d33/d52/d71/d8d/f9d [181245,95641] 0 2024-05-09T00:07:35.859 INFO:tasks.workunit.client.1.smithi135.stdout:0/668: rmdir d3/dd/d3f/d58/dae 39 2024-05-09T00:07:35.860 INFO:tasks.workunit.client.1.smithi135.stdout:6/664: sync 2024-05-09T00:07:35.863 INFO:tasks.workunit.client.1.smithi135.stdout:3/688: creat d8/d13/d51/d63/d89/ff2 x:0 0 0 2024-05-09T00:07:35.866 INFO:tasks.workunit.client.1.smithi135.stdout:9/547: mkdir d1/d24/d44/daf 0 2024-05-09T00:07:35.866 INFO:tasks.workunit.client.1.smithi135.stdout:9/548: write d1/d1a/f42 [4632774,95850] 0 2024-05-09T00:07:35.871 INFO:tasks.workunit.client.1.smithi135.stdout:3/689: dread d8/f26 [0,4194304] 0 2024-05-09T00:07:35.872 INFO:tasks.workunit.client.0.smithi026.stdout:2/38: link f9 fb 0 2024-05-09T00:07:35.873 INFO:tasks.workunit.client.0.smithi026.stdout:8/41: dwrite f7 [0,4194304] 0 2024-05-09T00:07:35.873 INFO:tasks.workunit.client.1.smithi135.stdout:7/739: creat db/ff1 x:0 0 0 2024-05-09T00:07:35.874 INFO:tasks.workunit.client.0.smithi026.stdout:8/42: dread f3 [0,4194304] 0 2024-05-09T00:07:35.876 INFO:tasks.workunit.client.1.smithi135.stdout:5/697: mknod db/d3f/cd6 0 2024-05-09T00:07:35.876 INFO:tasks.workunit.client.1.smithi135.stdout:5/698: truncate db/d84/d62/d73/d9c/d9f/d92/fa0 461490 0 2024-05-09T00:07:35.878 INFO:tasks.workunit.client.1.smithi135.stdout:4/535: mkdir dc/d26/d31/db6 0 2024-05-09T00:07:35.878 INFO:tasks.workunit.client.1.smithi135.stdout:4/536: read - dc/d26/d31/f9a zero size 2024-05-09T00:07:35.880 INFO:tasks.workunit.client.1.smithi135.stdout:6/665: dwrite d2/da/d26/d57/f6c [4194304,4194304] 0 2024-05-09T00:07:35.880 INFO:tasks.workunit.client.1.smithi135.stdout:8/676: mknod d4/d7/d4a/d9c/ce7 0 2024-05-09T00:07:35.881 INFO:tasks.workunit.client.1.smithi135.stdout:8/677: read d4/d7/d33/d39/f84 [225401,109832] 0 2024-05-09T00:07:35.881 INFO:tasks.workunit.client.0.smithi026.stdout:4/52: write d0/f7 [311357,102744] 0 2024-05-09T00:07:35.883 INFO:tasks.workunit.client.1.smithi135.stdout:2/669: rename d1/d12/lc9 to d1/d12/le7 0 2024-05-09T00:07:35.885 INFO:tasks.workunit.client.1.smithi135.stdout:1/640: rmdir da/d24/d27/d33/d52/d71/d8d 39 2024-05-09T00:07:35.887 INFO:tasks.workunit.client.1.smithi135.stdout:0/669: mknod d3/dd/d3f/d58/dae/cbb 0 2024-05-09T00:07:35.891 INFO:tasks.workunit.client.1.smithi135.stdout:9/549: mknod d1/d24/d44/d54/d66/d6e/cb0 0 2024-05-09T00:07:35.891 INFO:tasks.workunit.client.1.smithi135.stdout:9/550: truncate d1/d1a/d2c/d20/f98 1166641 0 2024-05-09T00:07:35.893 INFO:tasks.workunit.client.1.smithi135.stdout:3/690: symlink d8/lf3 0 2024-05-09T00:07:35.894 INFO:tasks.workunit.client.0.smithi026.stdout:2/39: creat fc x:0 0 0 2024-05-09T00:07:35.894 INFO:tasks.workunit.client.1.smithi135.stdout:4/537: dwrite dc/d26/d31/d82/f89 [0,4194304] 0 2024-05-09T00:07:35.895 INFO:tasks.workunit.client.1.smithi135.stdout:7/740: mknod db/dd/dca/cf2 0 2024-05-09T00:07:35.895 INFO:tasks.workunit.client.1.smithi135.stdout:3/691: dread d8/d13/d75/d58/f8a [0,4194304] 0 2024-05-09T00:07:35.895 INFO:tasks.workunit.client.0.smithi026.stdout:8/43: mkdir db 0 2024-05-09T00:07:35.896 INFO:tasks.workunit.client.0.smithi026.stdout:8/44: write fa [55093,61767] 0 2024-05-09T00:07:35.897 INFO:tasks.workunit.client.0.smithi026.stdout:8/45: dread f3 [0,4194304] 0 2024-05-09T00:07:35.897 INFO:tasks.workunit.client.1.smithi135.stdout:5/699: mknod db/d24/db0/cd7 0 2024-05-09T00:07:35.899 INFO:tasks.workunit.client.1.smithi135.stdout:5/700: write db/f7f [2403844,95158] 0 2024-05-09T00:07:35.899 INFO:tasks.workunit.client.1.smithi135.stdout:5/701: truncate db/d3f/f5c 2963987 0 2024-05-09T00:07:35.901 INFO:tasks.workunit.client.0.smithi026.stdout:9/71: truncate d7/f16 2085199 0 2024-05-09T00:07:35.904 INFO:tasks.workunit.client.1.smithi135.stdout:6/666: rename d2/d20/f36 to d2/da/d26/d57/d59/fe7 0 2024-05-09T00:07:35.907 INFO:tasks.workunit.client.1.smithi135.stdout:8/678: getdents d4/d8/da2/dab 0 2024-05-09T00:07:35.907 INFO:tasks.workunit.client.1.smithi135.stdout:8/679: chown d4/d7/de/c12 289956162 1 2024-05-09T00:07:35.909 INFO:tasks.workunit.client.0.smithi026.stdout:2/40: link f8 fd 0 2024-05-09T00:07:35.910 INFO:tasks.workunit.client.0.smithi026.stdout:2/41: chown c7 12141641 1 2024-05-09T00:07:35.910 INFO:tasks.workunit.client.0.smithi026.stdout:2/42: write fd [919120,44918] 0 2024-05-09T00:07:35.911 INFO:tasks.workunit.client.1.smithi135.stdout:8/680: write d4/d7/de/d45/d76/f97 [2451239,90578] 0 2024-05-09T00:07:35.911 INFO:tasks.workunit.client.1.smithi135.stdout:8/681: write d4/d7/de/d45/dc5/fcd [945017,82643] 0 2024-05-09T00:07:35.911 INFO:tasks.workunit.client.1.smithi135.stdout:2/670: chown d1/d12/d20/d3b/c66 515882543 1 2024-05-09T00:07:35.911 INFO:tasks.workunit.client.1.smithi135.stdout:2/671: stat d1/f32 0 2024-05-09T00:07:35.912 INFO:tasks.workunit.client.0.smithi026.stdout:8/46: rmdir db 0 2024-05-09T00:07:35.914 INFO:tasks.workunit.client.1.smithi135.stdout:1/641: symlink da/d73/le7 0 2024-05-09T00:07:35.915 INFO:tasks.workunit.client.0.smithi026.stdout:8/47: write f7 [1877599,40617] 0 2024-05-09T00:07:35.917 INFO:tasks.workunit.client.1.smithi135.stdout:0/670: symlink d3/dd/d3f/d58/lbc 0 2024-05-09T00:07:35.917 INFO:tasks.workunit.client.1.smithi135.stdout:0/671: write d3/dd/d3f/f72 [5290099,15344] 0 2024-05-09T00:07:35.918 INFO:tasks.workunit.client.1.smithi135.stdout:7/741: dwrite db/ff1 [0,4194304] 0 2024-05-09T00:07:35.919 INFO:tasks.workunit.client.1.smithi135.stdout:9/551: truncate d1/d1a/d10/d3c/d5c/f63 123245 0 2024-05-09T00:07:35.919 INFO:tasks.workunit.client.0.smithi026.stdout:4/53: mknod d0/c10 0 2024-05-09T00:07:35.919 INFO:tasks.workunit.client.0.smithi026.stdout:4/54: stat d0 0 2024-05-09T00:07:35.922 INFO:tasks.workunit.client.0.smithi026.stdout:8/48: creat fc x:0 0 0 2024-05-09T00:07:35.922 INFO:tasks.workunit.client.0.smithi026.stdout:8/49: chown fc 4 1 2024-05-09T00:07:35.922 INFO:tasks.workunit.client.0.smithi026.stdout:8/50: stat f9 0 2024-05-09T00:07:35.922 INFO:tasks.workunit.client.0.smithi026.stdout:8/51: write fc [608265,74386] 0 2024-05-09T00:07:35.923 INFO:tasks.workunit.client.0.smithi026.stdout:4/55: stat d0/c8 0 2024-05-09T00:07:35.924 INFO:tasks.workunit.client.1.smithi135.stdout:4/538: dwrite dc/d4a/d69/f67 [0,4194304] 0 2024-05-09T00:07:35.924 INFO:tasks.workunit.client.1.smithi135.stdout:4/539: stat dc/d4a/d69/dac 0 2024-05-09T00:07:35.925 INFO:tasks.workunit.client.0.smithi026.stdout:8/52: creat fd x:0 0 0 2024-05-09T00:07:35.925 INFO:tasks.workunit.client.1.smithi135.stdout:5/702: symlink db/d96/ld8 0 2024-05-09T00:07:35.926 INFO:tasks.workunit.client.1.smithi135.stdout:5/703: fdatasync db/d84/d62/d73/d9c/d9f/f87 0 2024-05-09T00:07:35.926 INFO:tasks.workunit.client.0.smithi026.stdout:4/56: rename d0 to d0/d11 22 2024-05-09T00:07:35.928 INFO:tasks.workunit.client.0.smithi026.stdout:4/57: write d0/f9 [584448,85368] 0 2024-05-09T00:07:35.929 INFO:tasks.workunit.client.1.smithi135.stdout:4/540: write dc/dd/f7e [667979,102710] 0 2024-05-09T00:07:35.929 INFO:tasks.workunit.client.1.smithi135.stdout:4/541: chown dc/d71/d86/c95 65954 1 2024-05-09T00:07:35.929 INFO:tasks.workunit.client.1.smithi135.stdout:3/692: dwrite d8/d6d/d44/d4b/d59/fbe [0,4194304] 0 2024-05-09T00:07:35.929 INFO:tasks.workunit.client.1.smithi135.stdout:3/693: write d8/d6d/fa1 [4554746,27978] 0 2024-05-09T00:07:35.929 INFO:tasks.workunit.client.1.smithi135.stdout:6/667: mknod d2/d20/d3f/d4f/d7f/ce8 0 2024-05-09T00:07:35.929 INFO:tasks.workunit.client.0.smithi026.stdout:2/43: dwrite fa [0,4194304] 0 2024-05-09T00:07:35.929 INFO:tasks.workunit.client.0.smithi026.stdout:2/44: fsync fc 0 2024-05-09T00:07:35.931 INFO:tasks.workunit.client.0.smithi026.stdout:8/53: dread fc [0,4194304] 0 2024-05-09T00:07:35.931 INFO:tasks.workunit.client.1.smithi135.stdout:8/682: link d4/d7/d4a/le0 d4/dc6/le8 0 2024-05-09T00:07:35.932 INFO:tasks.workunit.client.1.smithi135.stdout:8/683: chown d4/d7/d33/c93 120013480 1 2024-05-09T00:07:35.932 INFO:tasks.workunit.client.1.smithi135.stdout:8/684: chown d4/d7/d2a/d56/f7c 16034 1 2024-05-09T00:07:35.933 INFO:tasks.workunit.client.0.smithi026.stdout:4/58: fsync d0/fc 0 2024-05-09T00:07:35.933 INFO:tasks.workunit.client.0.smithi026.stdout:9/72: read f2 [849895,10344] 0 2024-05-09T00:07:35.933 INFO:tasks.workunit.client.0.smithi026.stdout:9/73: fdatasync d7/fd 0 2024-05-09T00:07:35.937 INFO:tasks.workunit.client.1.smithi135.stdout:1/642: mkdir da/d14/d20/d38/d3a/db7/dc6/d93/de8 0 2024-05-09T00:07:35.940 INFO:tasks.workunit.client.1.smithi135.stdout:0/672: creat d3/dd/d2d/d4c/d84/fbd x:0 0 0 2024-05-09T00:07:35.940 INFO:tasks.workunit.client.1.smithi135.stdout:0/673: write d3/dd/d3f/d3a/da4/faf [743167,109778] 0 2024-05-09T00:07:35.943 INFO:tasks.workunit.client.0.smithi026.stdout:5/36: sync 2024-05-09T00:07:35.943 INFO:tasks.workunit.client.0.smithi026.stdout:6/41: sync 2024-05-09T00:07:35.945 INFO:tasks.workunit.client.1.smithi135.stdout:7/742: symlink db/d1e/d3a/d40/d4c/d67/dc8/lf3 0 2024-05-09T00:07:35.947 INFO:tasks.workunit.client.1.smithi135.stdout:9/552: symlink d1/d24/d44/d54/d66/lb1 0 2024-05-09T00:07:35.947 INFO:tasks.workunit.client.1.smithi135.stdout:0/674: dread d3/dd/f98 [0,4194304] 0 2024-05-09T00:07:35.948 INFO:tasks.workunit.client.0.smithi026.stdout:2/45: symlink le 0 2024-05-09T00:07:35.950 INFO:tasks.workunit.client.1.smithi135.stdout:5/704: symlink db/d24/d32/d5b/ld9 0 2024-05-09T00:07:35.950 INFO:tasks.workunit.client.0.smithi026.stdout:8/54: mkdir de 0 2024-05-09T00:07:35.952 INFO:tasks.workunit.client.0.smithi026.stdout:4/59: getdents d0 0 2024-05-09T00:07:35.953 INFO:tasks.workunit.client.1.smithi135.stdout:6/668: dwrite d2/f76 [0,4194304] 0 2024-05-09T00:07:35.954 INFO:tasks.workunit.client.0.smithi026.stdout:9/74: fsync d7/f9 0 2024-05-09T00:07:35.954 INFO:tasks.workunit.client.0.smithi026.stdout:9/75: readlink d7/l15 0 2024-05-09T00:07:35.956 INFO:tasks.workunit.client.0.smithi026.stdout:5/37: link d2/c4 d2/d8/c9 0 2024-05-09T00:07:35.957 INFO:tasks.workunit.client.0.smithi026.stdout:5/38: write d2/f3 [1032516,40372] 0 2024-05-09T00:07:35.958 INFO:tasks.workunit.client.1.smithi135.stdout:2/672: dwrite d1/d12/d20/d3b/f7e [0,4194304] 0 2024-05-09T00:07:35.959 INFO:tasks.workunit.client.1.smithi135.stdout:3/694: mkdir d8/d13/d51/d63/db9/df4 0 2024-05-09T00:07:35.960 INFO:tasks.workunit.client.0.smithi026.stdout:9/76: rmdir d7 39 2024-05-09T00:07:35.963 INFO:tasks.workunit.client.1.smithi135.stdout:8/685: creat d4/d7/d4a/d9c/fe9 x:0 0 0 2024-05-09T00:07:35.963 INFO:tasks.workunit.client.1.smithi135.stdout:8/686: stat d4/d7/d33/fd7 0 2024-05-09T00:07:35.963 INFO:tasks.workunit.client.1.smithi135.stdout:8/687: chown d4/d7/de/d45/l6a 8 1 2024-05-09T00:07:35.966 INFO:tasks.workunit.client.0.smithi026.stdout:5/39: getdents d2 0 2024-05-09T00:07:35.966 INFO:tasks.workunit.client.1.smithi135.stdout:1/643: mkdir da/d14/d20/d38/d3a/db7/de9 0 2024-05-09T00:07:35.970 INFO:tasks.workunit.client.1.smithi135.stdout:7/743: creat db/d1e/d3a/d40/ff4 x:0 0 0 2024-05-09T00:07:35.970 INFO:tasks.workunit.client.1.smithi135.stdout:7/744: write db/dd/d33/f9e [917320,56222] 0 2024-05-09T00:07:35.970 INFO:tasks.workunit.client.1.smithi135.stdout:7/745: read db/d13/fae [67389,44632] 0 2024-05-09T00:07:35.970 INFO:tasks.workunit.client.1.smithi135.stdout:7/746: dread - db/d5b/ff0 zero size 2024-05-09T00:07:35.972 INFO:tasks.workunit.client.0.smithi026.stdout:8/55: rename fc to de/ff 0 2024-05-09T00:07:35.973 INFO:tasks.workunit.client.1.smithi135.stdout:9/553: getdents d1/d1a/d10 0 2024-05-09T00:07:35.973 INFO:tasks.workunit.client.1.smithi135.stdout:9/554: readlink d1/d1a/d2c/l8f 0 2024-05-09T00:07:35.977 INFO:tasks.workunit.client.0.smithi026.stdout:8/56: write f9 [2723887,32158] 0 2024-05-09T00:07:35.978 INFO:tasks.workunit.client.1.smithi135.stdout:5/705: creat db/d96/fda x:0 0 0 2024-05-09T00:07:35.978 INFO:tasks.workunit.client.1.smithi135.stdout:5/706: chown db/d24/db0/fc1 83 1 2024-05-09T00:07:35.978 INFO:tasks.workunit.client.1.smithi135.stdout:5/707: dread - db/fb9 zero size 2024-05-09T00:07:35.978 INFO:tasks.workunit.client.1.smithi135.stdout:2/673: dwrite d1/d22/f43 [0,4194304] 0 2024-05-09T00:07:35.979 INFO:tasks.workunit.client.0.smithi026.stdout:9/77: symlink d7/l18 0 2024-05-09T00:07:35.981 INFO:tasks.workunit.client.1.smithi135.stdout:0/675: dwrite d3/dd/d2d/d4c/f60 [0,4194304] 0 2024-05-09T00:07:35.982 INFO:tasks.workunit.client.0.smithi026.stdout:9/78: write d7/f16 [95901,117501] 0 2024-05-09T00:07:35.983 INFO:tasks.workunit.client.0.smithi026.stdout:4/60: dwrite d0/fe [0,4194304] 0 2024-05-09T00:07:35.983 INFO:tasks.workunit.client.0.smithi026.stdout:4/61: write d0/fb [662670,61261] 0 2024-05-09T00:07:35.983 INFO:tasks.workunit.client.0.smithi026.stdout:6/42: dwrite f4 [0,4194304] 0 2024-05-09T00:07:35.984 INFO:tasks.workunit.client.1.smithi135.stdout:4/542: truncate dc/f42 669667 0 2024-05-09T00:07:35.984 INFO:tasks.workunit.client.0.smithi026.stdout:3/52: sync 2024-05-09T00:07:35.984 INFO:tasks.workunit.client.0.smithi026.stdout:7/36: sync 2024-05-09T00:07:35.984 INFO:tasks.workunit.client.0.smithi026.stdout:7/37: fdatasync f5 0 2024-05-09T00:07:35.985 INFO:tasks.workunit.client.1.smithi135.stdout:6/669: rmdir d2/d5f 39 2024-05-09T00:07:35.993 INFO:tasks.workunit.client.0.smithi026.stdout:0/143: sync 2024-05-09T00:07:35.994 INFO:tasks.workunit.client.0.smithi026.stdout:1/55: sync 2024-05-09T00:07:35.994 INFO:tasks.workunit.client.0.smithi026.stdout:1/56: getdents d5/db 0 2024-05-09T00:07:35.994 INFO:tasks.workunit.client.1.smithi135.stdout:3/695: rename d8/d13/d75/d9b to d8/d6d/d44/d4b/da0/daa/d88/df5 0 2024-05-09T00:07:35.996 INFO:tasks.workunit.client.1.smithi135.stdout:7/747: symlink db/d1e/d3a/d40/d7e/lf5 0 2024-05-09T00:07:36.000 INFO:tasks.workunit.client.1.smithi135.stdout:5/708: getdents db/d84 0 2024-05-09T00:07:36.001 INFO:tasks.workunit.client.1.smithi135.stdout:5/709: truncate db/d5d/fa3 779239 0 2024-05-09T00:07:36.001 INFO:tasks.workunit.client.1.smithi135.stdout:5/710: fdatasync db/d5d/dac/fa4 0 2024-05-09T00:07:36.006 INFO:tasks.workunit.client.0.smithi026.stdout:7/38: creat d8/fb x:0 0 0 2024-05-09T00:07:36.008 INFO:tasks.workunit.client.1.smithi135.stdout:7/748: dread db/d1e/d3a/d40/d4c/f53 [0,4194304] 0 2024-05-09T00:07:36.013 INFO:tasks.workunit.client.0.smithi026.stdout:0/144: creat d1d/f29 x:0 0 0 2024-05-09T00:07:36.017 INFO:tasks.workunit.client.0.smithi026.stdout:8/57: truncate f9 2747895 0 2024-05-09T00:07:36.020 INFO:tasks.workunit.client.0.smithi026.stdout:4/62: mkdir d0/d12 0 2024-05-09T00:07:36.021 INFO:tasks.workunit.client.1.smithi135.stdout:0/676: mknod d3/dd/d3f/d43/da3/cbe 0 2024-05-09T00:07:36.021 INFO:tasks.workunit.client.1.smithi135.stdout:0/677: truncate d3/dd/d3f/d29/d7c/fa8 926363 0 2024-05-09T00:07:36.023 INFO:tasks.workunit.client.0.smithi026.stdout:7/39: truncate f5 776932 0 2024-05-09T00:07:36.023 INFO:tasks.workunit.client.0.smithi026.stdout:7/40: fdatasync f5 0 2024-05-09T00:07:36.023 INFO:tasks.workunit.client.0.smithi026.stdout:0/145: readlink l9 0 2024-05-09T00:07:36.025 INFO:tasks.workunit.client.0.smithi026.stdout:1/57: dread f3 [0,4194304] 0 2024-05-09T00:07:36.025 INFO:tasks.workunit.client.0.smithi026.stdout:4/63: unlink d0/f7 0 2024-05-09T00:07:36.025 INFO:tasks.workunit.client.0.smithi026.stdout:4/64: stat d0/fe 0 2024-05-09T00:07:36.025 INFO:tasks.workunit.client.1.smithi135.stdout:2/674: dwrite d1/fdf [0,4194304] 0 2024-05-09T00:07:36.026 INFO:tasks.workunit.client.0.smithi026.stdout:5/40: dwrite d2/f3 [4194304,4194304] 0 2024-05-09T00:07:36.027 INFO:tasks.workunit.client.1.smithi135.stdout:3/696: dwrite d8/d6d/d44/d4b/d59/d90/f9c [0,4194304] 0 2024-05-09T00:07:36.027 INFO:tasks.workunit.client.1.smithi135.stdout:3/697: readlink d8/d13/d1f/ld8 0 2024-05-09T00:07:36.027 INFO:tasks.workunit.client.1.smithi135.stdout:3/698: stat d8/d6d/d44/d4b/fdb 0 2024-05-09T00:07:36.028 INFO:tasks.workunit.client.1.smithi135.stdout:6/670: dwrite d2/d20/d3f/f44 [0,4194304] 0 2024-05-09T00:07:36.028 INFO:tasks.workunit.client.1.smithi135.stdout:6/671: dread - d2/da/d26/d57/d59/d62/fbb zero size 2024-05-09T00:07:36.028 INFO:tasks.workunit.client.0.smithi026.stdout:6/43: dwrite f9 [0,4194304] 0 2024-05-09T00:07:36.028 INFO:tasks.workunit.client.0.smithi026.stdout:0/146: mknod d1d/d1e/d20/c2a 0 2024-05-09T00:07:36.029 INFO:tasks.workunit.client.0.smithi026.stdout:0/147: readlink l1a 0 2024-05-09T00:07:36.029 INFO:tasks.workunit.client.0.smithi026.stdout:1/58: write f4 [8627054,53412] 0 2024-05-09T00:07:36.033 INFO:tasks.workunit.client.0.smithi026.stdout:5/41: symlink d2/la 0 2024-05-09T00:07:36.036 INFO:tasks.workunit.client.0.smithi026.stdout:3/53: write d5/fd [402690,61627] 0 2024-05-09T00:07:36.039 INFO:tasks.workunit.client.0.smithi026.stdout:7/41: getdents d8 0 2024-05-09T00:07:36.039 INFO:tasks.workunit.client.0.smithi026.stdout:7/42: write d8/fb [505452,20793] 0 2024-05-09T00:07:36.041 INFO:tasks.workunit.client.0.smithi026.stdout:6/44: symlink lb 0 2024-05-09T00:07:36.044 INFO:tasks.workunit.client.0.smithi026.stdout:9/79: truncate d7/f16 1774258 0 2024-05-09T00:07:36.045 INFO:tasks.workunit.client.0.smithi026.stdout:0/148: creat d1d/d25/f2b x:0 0 0 2024-05-09T00:07:36.046 INFO:tasks.workunit.client.0.smithi026.stdout:9/80: write d7/fd [1557055,28035] 0 2024-05-09T00:07:36.048 INFO:tasks.workunit.client.1.smithi135.stdout:4/543: unlink dc/d4a/d69/c92 0 2024-05-09T00:07:36.048 INFO:tasks.workunit.client.1.smithi135.stdout:4/544: truncate dc/d71/f91 674691 0 2024-05-09T00:07:36.051 INFO:tasks.workunit.client.0.smithi026.stdout:3/54: creat d5/d9/ff x:0 0 0 2024-05-09T00:07:36.051 INFO:tasks.workunit.client.0.smithi026.stdout:3/55: chown d5/d9/ff 174 1 2024-05-09T00:07:36.054 INFO:tasks.workunit.client.0.smithi026.stdout:5/42: dwrite d2/f3 [0,4194304] 0 2024-05-09T00:07:36.054 INFO:tasks.workunit.client.0.smithi026.stdout:5/43: chown d2/c4 9778506 1 2024-05-09T00:07:36.054 INFO:tasks.workunit.client.1.smithi135.stdout:8/688: rename d4/fdb to d4/d7/d33/fea 0 2024-05-09T00:07:36.054 INFO:tasks.workunit.client.1.smithi135.stdout:8/689: chown d4/d7/de/f35 228690245 1 2024-05-09T00:07:36.055 INFO:tasks.workunit.client.0.smithi026.stdout:7/43: creat d8/fc x:0 0 0 2024-05-09T00:07:36.056 INFO:tasks.workunit.client.1.smithi135.stdout:7/749: link db/dd/d33/f9d db/d1e/d3a/d40/d4c/da3/ded/ff6 0 2024-05-09T00:07:36.057 INFO:tasks.workunit.client.1.smithi135.stdout:7/750: write db/d1e/d3a/d40/d4c/fa6 [763247,44723] 0 2024-05-09T00:07:36.058 INFO:tasks.workunit.client.0.smithi026.stdout:6/45: rename l2 to lc 0 2024-05-09T00:07:36.058 INFO:tasks.workunit.client.0.smithi026.stdout:6/46: fdatasync fa 0 2024-05-09T00:07:36.058 INFO:tasks.workunit.client.0.smithi026.stdout:6/47: rmdir - no directory 2024-05-09T00:07:36.058 INFO:tasks.workunit.client.0.smithi026.stdout:6/48: dread - fa zero size 2024-05-09T00:07:36.059 INFO:tasks.workunit.client.1.smithi135.stdout:0/678: truncate d3/dd/d3f/f33 31051 0 2024-05-09T00:07:36.060 INFO:tasks.workunit.client.0.smithi026.stdout:0/149: symlink d1d/d25/l2c 0 2024-05-09T00:07:36.061 INFO:tasks.workunit.client.0.smithi026.stdout:4/65: dwrite d0/fe [0,4194304] 0 2024-05-09T00:07:36.065 INFO:tasks.workunit.client.0.smithi026.stdout:1/59: unlink d5/c8 0 2024-05-09T00:07:36.067 INFO:tasks.workunit.client.0.smithi026.stdout:3/56: rename d5/fb to d5/d9/f10 0 2024-05-09T00:07:36.069 INFO:tasks.workunit.client.1.smithi135.stdout:2/675: mknod d1/d12/d20/ce8 0 2024-05-09T00:07:36.069 INFO:tasks.workunit.client.1.smithi135.stdout:2/676: write d1/fd [1029399,50080] 0 2024-05-09T00:07:36.070 INFO:tasks.workunit.client.0.smithi026.stdout:5/44: creat d2/d8/fb x:0 0 0 2024-05-09T00:07:36.073 INFO:tasks.workunit.client.0.smithi026.stdout:8/58: dwrite f9 [0,4194304] 0 2024-05-09T00:07:36.073 INFO:tasks.workunit.client.0.smithi026.stdout:8/59: fdatasync fa 0 2024-05-09T00:07:36.076 INFO:tasks.workunit.client.0.smithi026.stdout:9/81: dwrite d7/fd [8388608,4194304] 0 2024-05-09T00:07:36.077 INFO:tasks.workunit.client.1.smithi135.stdout:3/699: rmdir d8/d13/d51/d63/db9/df4 0 2024-05-09T00:07:36.077 INFO:tasks.workunit.client.1.smithi135.stdout:3/700: dread - d8/d13/d51/d63/d89/ff2 zero size 2024-05-09T00:07:36.078 INFO:tasks.workunit.client.0.smithi026.stdout:0/150: mkdir d1d/d1e/d2d 0 2024-05-09T00:07:36.078 INFO:tasks.workunit.client.0.smithi026.stdout:0/151: dread - d1d/d25/f2b zero size 2024-05-09T00:07:36.079 INFO:tasks.workunit.client.1.smithi135.stdout:6/672: mknod d2/da/d1d/d69/d89/ce9 0 2024-05-09T00:07:36.081 INFO:tasks.workunit.client.0.smithi026.stdout:3/57: creat d5/d9/dc/f11 x:0 0 0 2024-05-09T00:07:36.082 INFO:tasks.workunit.client.1.smithi135.stdout:6/673: dread d2/d20/d2e/fa0 [0,4194304] 0 2024-05-09T00:07:36.083 INFO:tasks.workunit.client.0.smithi026.stdout:8/60: dread f9 [0,4194304] 0 2024-05-09T00:07:36.084 INFO:tasks.workunit.client.0.smithi026.stdout:4/66: dwrite d0/fc [0,4194304] 0 2024-05-09T00:07:36.086 INFO:tasks.workunit.client.0.smithi026.stdout:5/45: unlink d2/d8/fb 0 2024-05-09T00:07:36.086 INFO:tasks.workunit.client.0.smithi026.stdout:5/46: fsync d2/f3 0 2024-05-09T00:07:36.086 INFO:tasks.workunit.client.0.smithi026.stdout:5/47: truncate d2/f3 8767791 0 2024-05-09T00:07:36.089 INFO:tasks.workunit.client.0.smithi026.stdout:7/44: mknod d8/cd 0 2024-05-09T00:07:36.090 INFO:tasks.workunit.client.1.smithi135.stdout:4/545: creat dc/d26/d93/d9d/fb7 x:0 0 0 2024-05-09T00:07:36.093 INFO:tasks.workunit.client.0.smithi026.stdout:9/82: truncate f2 2402499 0 2024-05-09T00:07:36.097 INFO:tasks.workunit.client.1.smithi135.stdout:9/555: rename d1/d1a/d10/d3c/d43/f94 to d1/d1a/d2c/d20/fb2 0 2024-05-09T00:07:36.100 INFO:tasks.workunit.client.0.smithi026.stdout:6/49: getdents . 0 2024-05-09T00:07:36.102 INFO:tasks.workunit.client.0.smithi026.stdout:8/61: symlink de/l10 0 2024-05-09T00:07:36.104 INFO:tasks.workunit.client.1.smithi135.stdout:8/690: mknod d4/d7/de/d45/dc5/ceb 0 2024-05-09T00:07:36.105 INFO:tasks.workunit.client.1.smithi135.stdout:8/691: read d4/d7/d33/f55 [7404474,9669] 0 2024-05-09T00:07:36.106 INFO:tasks.workunit.client.0.smithi026.stdout:1/60: dwrite f3 [8388608,4194304] 0 2024-05-09T00:07:36.107 INFO:tasks.workunit.client.0.smithi026.stdout:1/61: fdatasync f3 0 2024-05-09T00:07:36.108 INFO:tasks.workunit.client.0.smithi026.stdout:0/152: dwrite d1d/f29 [0,4194304] 0 2024-05-09T00:07:36.110 INFO:tasks.workunit.client.0.smithi026.stdout:4/67: creat d0/d12/f13 x:0 0 0 2024-05-09T00:07:36.110 INFO:tasks.workunit.client.0.smithi026.stdout:5/48: dwrite d2/f3 [8388608,4194304] 0 2024-05-09T00:07:36.112 INFO:tasks.workunit.client.1.smithi135.stdout:0/679: link d3/d64/l85 d3/dd/d3f/lbf 0 2024-05-09T00:07:36.115 INFO:tasks.workunit.client.0.smithi026.stdout:7/45: dread - d8/fa zero size 2024-05-09T00:07:36.119 INFO:tasks.workunit.client.1.smithi135.stdout:2/677: unlink d1/d12/d21/d57/f7b 0 2024-05-09T00:07:36.120 INFO:tasks.workunit.client.0.smithi026.stdout:9/83: getdents d7 0 2024-05-09T00:07:36.127 INFO:tasks.workunit.client.0.smithi026.stdout:6/50: link c8 cd 0 2024-05-09T00:07:36.127 INFO:tasks.workunit.client.0.smithi026.stdout:6/51: rmdir - no directory 2024-05-09T00:07:36.132 INFO:tasks.workunit.client.0.smithi026.stdout:8/62: creat de/f11 x:0 0 0 2024-05-09T00:07:36.139 INFO:tasks.workunit.client.1.smithi135.stdout:5/711: rename db/d84/d62/d73/d9c/d9f/f8b to db/fdb 0 2024-05-09T00:07:36.142 INFO:tasks.workunit.client.1.smithi135.stdout:9/556: mkdir d1/d1a/d10/db3 0 2024-05-09T00:07:36.144 INFO:tasks.workunit.client.0.smithi026.stdout:3/58: dwrite d5/fd [0,4194304] 0 2024-05-09T00:07:36.144 INFO:tasks.workunit.client.1.smithi135.stdout:8/692: mkdir d4/d7/d2a/d56/dec 0 2024-05-09T00:07:36.144 INFO:tasks.workunit.client.1.smithi135.stdout:8/693: stat d4/d7/d2a/d56/dec 0 2024-05-09T00:07:36.145 INFO:tasks.workunit.client.0.smithi026.stdout:1/62: dwrite f4 [4194304,4194304] 0 2024-05-09T00:07:36.145 INFO:tasks.workunit.client.0.smithi026.stdout:1/63: readlink d5/l6 0 2024-05-09T00:07:36.146 INFO:tasks.workunit.client.1.smithi135.stdout:4/546: mkdir dc/d26/d31/db8 0 2024-05-09T00:07:36.149 INFO:tasks.workunit.client.1.smithi135.stdout:0/680: dwrite d3/dd/d3f/d58/f63 [0,4194304] 0 2024-05-09T00:07:36.149 INFO:tasks.workunit.client.1.smithi135.stdout:0/681: dread - d3/dd/d3f/d43/da3/fa6 zero size 2024-05-09T00:07:36.149 INFO:tasks.workunit.client.1.smithi135.stdout:1/644: sync 2024-05-09T00:07:36.150 INFO:tasks.workunit.client.0.smithi026.stdout:5/49: dwrite d2/f3 [4194304,4194304] 0 2024-05-09T00:07:36.150 INFO:tasks.workunit.client.0.smithi026.stdout:5/50: chown d2/l6 36 1 2024-05-09T00:07:36.150 INFO:tasks.workunit.client.0.smithi026.stdout:8/63: dwrite f9 [0,4194304] 0 2024-05-09T00:07:36.151 INFO:tasks.workunit.client.1.smithi135.stdout:3/701: rename d8/d13/d1f/d40/d52/l9a to d8/d13/d1f/d40/lf6 0 2024-05-09T00:07:36.151 INFO:tasks.workunit.client.1.smithi135.stdout:3/702: chown d8/d13/f46 0 1 2024-05-09T00:07:36.151 INFO:tasks.workunit.client.0.smithi026.stdout:7/46: unlink l2 0 2024-05-09T00:07:36.151 INFO:tasks.workunit.client.0.smithi026.stdout:8/64: dread f3 [0,4194304] 0 2024-05-09T00:07:36.153 INFO:tasks.workunit.client.1.smithi135.stdout:4/547: chown dc/d4a/d69/d55/fa3 1295019 1 2024-05-09T00:07:36.157 INFO:tasks.workunit.client.0.smithi026.stdout:9/84: creat d7/f19 x:0 0 0 2024-05-09T00:07:36.157 INFO:tasks.workunit.client.0.smithi026.stdout:1/64: write f3 [7579143,8516] 0 2024-05-09T00:07:36.160 INFO:tasks.workunit.client.1.smithi135.stdout:1/645: truncate da/d14/d20/d38/f46 1798808 0 2024-05-09T00:07:36.162 INFO:tasks.workunit.client.1.smithi135.stdout:1/646: read da/d14/f3f [3267812,20376] 0 2024-05-09T00:07:36.162 INFO:tasks.workunit.client.1.smithi135.stdout:1/647: write da/d14/d20/d38/f58 [361114,38095] 0 2024-05-09T00:07:36.164 INFO:tasks.workunit.client.1.smithi135.stdout:5/712: dread db/f7f [0,4194304] 0 2024-05-09T00:07:36.165 INFO:tasks.workunit.client.0.smithi026.stdout:6/52: read f4 [1434651,80043] 0 2024-05-09T00:07:36.172 INFO:tasks.workunit.client.1.smithi135.stdout:2/678: rename d1/d12/d20/d3b/c70 to d1/d12/d21/d41/d6d/db4/ce9 0 2024-05-09T00:07:36.174 INFO:tasks.workunit.client.0.smithi026.stdout:4/68: dwrite d0/fc [4194304,4194304] 0 2024-05-09T00:07:36.174 INFO:tasks.workunit.client.1.smithi135.stdout:9/557: dread d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:36.178 INFO:tasks.workunit.client.1.smithi135.stdout:4/548: creat dc/d26/d31/d82/fb9 x:0 0 0 2024-05-09T00:07:36.178 INFO:tasks.workunit.client.1.smithi135.stdout:4/549: dread - dc/d4a/d69/d39/f9b zero size 2024-05-09T00:07:36.180 INFO:tasks.workunit.client.1.smithi135.stdout:3/703: dwrite d8/d13/d51/d63/d89/ff2 [0,4194304] 0 2024-05-09T00:07:36.180 INFO:tasks.workunit.client.0.smithi026.stdout:3/59: dwrite d5/d9/dc/f11 [0,4194304] 0 2024-05-09T00:07:36.186 INFO:tasks.workunit.client.1.smithi135.stdout:5/713: rename db/d96 to db/d5d/dac/ddc 0 2024-05-09T00:07:36.186 INFO:tasks.workunit.client.1.smithi135.stdout:0/682: dwrite d3/dd/f32 [0,4194304] 0 2024-05-09T00:07:36.186 INFO:tasks.workunit.client.1.smithi135.stdout:0/683: stat d3/f12 0 2024-05-09T00:07:36.187 INFO:tasks.workunit.client.0.smithi026.stdout:5/51: getdents d2 0 2024-05-09T00:07:36.187 INFO:tasks.workunit.client.0.smithi026.stdout:5/52: chown d2/l6 79611 1 2024-05-09T00:07:36.188 INFO:tasks.workunit.client.1.smithi135.stdout:9/558: symlink d1/d24/d44/lb4 0 2024-05-09T00:07:36.191 INFO:tasks.workunit.client.0.smithi026.stdout:8/65: unlink c6 0 2024-05-09T00:07:36.195 INFO:tasks.workunit.client.0.smithi026.stdout:1/65: creat d5/f10 x:0 0 0 2024-05-09T00:07:36.197 INFO:tasks.workunit.client.0.smithi026.stdout:6/53: write f1 [4830836,96608] 0 2024-05-09T00:07:36.198 INFO:tasks.workunit.client.1.smithi135.stdout:3/704: rmdir d8 39 2024-05-09T00:07:36.198 INFO:tasks.workunit.client.1.smithi135.stdout:1/648: dwrite f9 [0,4194304] 0 2024-05-09T00:07:36.198 INFO:tasks.workunit.client.1.smithi135.stdout:1/649: readlink da/db/d16/l5a 0 2024-05-09T00:07:36.198 INFO:tasks.workunit.client.1.smithi135.stdout:5/714: truncate db/d24/d32/d5b/d91/fa2 2822827 0 2024-05-09T00:07:36.200 INFO:tasks.workunit.client.0.smithi026.stdout:5/53: dread d2/f3 [4194304,4194304] 0 2024-05-09T00:07:36.200 INFO:tasks.workunit.client.0.smithi026.stdout:5/54: write d2/f3 [7989616,105354] 0 2024-05-09T00:07:36.201 INFO:tasks.workunit.client.0.smithi026.stdout:4/69: rename d0/ca to d0/d12/c14 0 2024-05-09T00:07:36.204 INFO:tasks.workunit.client.1.smithi135.stdout:0/684: rename d3/dd/d3f/d29/f7f to d3/dd/fc0 0 2024-05-09T00:07:36.206 INFO:tasks.workunit.client.1.smithi135.stdout:2/679: creat d1/d12/d20/fea x:0 0 0 2024-05-09T00:07:36.208 INFO:tasks.workunit.client.1.smithi135.stdout:2/680: dread d1/d12/d20/d3b/d40/f5e [0,4194304] 0 2024-05-09T00:07:36.208 INFO:tasks.workunit.client.1.smithi135.stdout:9/559: mknod d1/d1a/d10/d3c/d43/cb5 0 2024-05-09T00:07:36.208 INFO:tasks.workunit.client.1.smithi135.stdout:9/560: readlink d1/d1a/d89/la1 0 2024-05-09T00:07:36.209 INFO:tasks.workunit.client.1.smithi135.stdout:9/561: write d1/d1a/f29 [3409574,56682] 0 2024-05-09T00:07:36.209 INFO:tasks.workunit.client.1.smithi135.stdout:9/562: read - d1/d24/d44/d54/d66/fac zero size 2024-05-09T00:07:36.209 INFO:tasks.workunit.client.1.smithi135.stdout:9/563: stat d1/d1a/d10/f6a 0 2024-05-09T00:07:36.209 INFO:tasks.workunit.client.1.smithi135.stdout:9/564: chown d1/d1a/l5b 1471 1 2024-05-09T00:07:36.212 INFO:tasks.workunit.client.0.smithi026.stdout:7/47: symlink d8/le 0 2024-05-09T00:07:36.214 INFO:tasks.workunit.client.1.smithi135.stdout:4/550: mkdir dc/d71/dba 0 2024-05-09T00:07:36.214 INFO:tasks.workunit.client.1.smithi135.stdout:4/551: write dc/d4a/d69/d39/f9b [544656,22298] 0 2024-05-09T00:07:36.214 INFO:tasks.workunit.client.0.smithi026.stdout:8/66: creat de/f12 x:0 0 0 2024-05-09T00:07:36.215 INFO:tasks.workunit.client.0.smithi026.stdout:8/67: write de/ff [1002391,67573] 0 2024-05-09T00:07:36.215 INFO:tasks.workunit.client.0.smithi026.stdout:8/68: chown l4 3002 1 2024-05-09T00:07:36.217 INFO:tasks.workunit.client.1.smithi135.stdout:3/705: creat d8/d6d/ff7 x:0 0 0 2024-05-09T00:07:36.217 INFO:tasks.workunit.client.1.smithi135.stdout:3/706: getdents d8/d6d/d44/d4b/dc2 0 2024-05-09T00:07:36.218 INFO:tasks.workunit.client.0.smithi026.stdout:9/85: truncate d7/f8 4048234 0 2024-05-09T00:07:36.221 INFO:tasks.workunit.client.1.smithi135.stdout:1/650: creat da/d14/d20/d38/d3a/db7/dc6/d93/de8/fea x:0 0 0 2024-05-09T00:07:36.221 INFO:tasks.workunit.client.1.smithi135.stdout:1/651: fdatasync da/d73/f81 0 2024-05-09T00:07:36.222 INFO:tasks.workunit.client.0.smithi026.stdout:6/54: chown l3 2 1 2024-05-09T00:07:36.223 INFO:tasks.workunit.client.1.smithi135.stdout:5/715: symlink db/d84/ldd 0 2024-05-09T00:07:36.223 INFO:tasks.workunit.client.1.smithi135.stdout:5/716: fdatasync db/d24/d32/f47 0 2024-05-09T00:07:36.223 INFO:tasks.workunit.client.0.smithi026.stdout:3/60: write d5/fd [5045133,68492] 0 2024-05-09T00:07:36.224 INFO:tasks.workunit.client.1.smithi135.stdout:1/652: read da/f1f [733598,101592] 0 2024-05-09T00:07:36.224 INFO:tasks.workunit.client.0.smithi026.stdout:4/70: dwrite d0/f6 [0,4194304] 0 2024-05-09T00:07:36.225 INFO:tasks.workunit.client.1.smithi135.stdout:1/653: read da/f1f [1707316,4820] 0 2024-05-09T00:07:36.229 INFO:tasks.workunit.client.0.smithi026.stdout:7/48: dwrite d8/fa [0,4194304] 0 2024-05-09T00:07:36.236 INFO:tasks.workunit.client.0.smithi026.stdout:5/55: creat d2/fc x:0 0 0 2024-05-09T00:07:36.239 INFO:tasks.workunit.client.1.smithi135.stdout:2/681: creat d1/d12/d20/feb x:0 0 0 2024-05-09T00:07:36.243 INFO:tasks.workunit.client.0.smithi026.stdout:1/66: dread d5/dd/ff [0,4194304] 0 2024-05-09T00:07:36.244 INFO:tasks.workunit.client.1.smithi135.stdout:9/565: truncate d1/d1a/d2c/f6d 2988154 0 2024-05-09T00:07:36.246 INFO:tasks.workunit.client.1.smithi135.stdout:9/566: write d1/f2 [3901979,64075] 0 2024-05-09T00:07:36.246 INFO:tasks.workunit.client.1.smithi135.stdout:9/567: truncate d1/d24/d44/d7f/f81 333367 0 2024-05-09T00:07:36.248 INFO:tasks.workunit.client.1.smithi135.stdout:6/674: sync 2024-05-09T00:07:36.248 INFO:tasks.workunit.client.1.smithi135.stdout:6/675: fsync d2/da/d1d/d69/d78/f84 0 2024-05-09T00:07:36.249 INFO:tasks.workunit.client.1.smithi135.stdout:6/676: write d2/d20/d3f/f44 [4503013,118132] 0 2024-05-09T00:07:36.249 INFO:tasks.workunit.client.1.smithi135.stdout:1/654: dwrite da/d73/f78 [4194304,4194304] 0 2024-05-09T00:07:36.249 INFO:tasks.workunit.client.1.smithi135.stdout:1/655: chown da/d14/d20/d38/d3a/db7/de9 41 1 2024-05-09T00:07:36.249 INFO:tasks.workunit.client.0.smithi026.stdout:3/61: dwrite d5/d9/f10 [0,4194304] 0 2024-05-09T00:07:36.250 INFO:tasks.workunit.client.1.smithi135.stdout:3/707: creat d8/d13/ddd/ff8 x:0 0 0 2024-05-09T00:07:36.250 INFO:tasks.workunit.client.1.smithi135.stdout:3/708: fsync d8/d6d/d44/d4b/d69/f4d 0 2024-05-09T00:07:36.250 INFO:tasks.workunit.client.1.smithi135.stdout:3/709: fdatasync d8/f11 0 2024-05-09T00:07:36.250 INFO:tasks.workunit.client.0.smithi026.stdout:6/55: chown lb 1062 1 2024-05-09T00:07:36.251 INFO:tasks.workunit.client.1.smithi135.stdout:7/751: sync 2024-05-09T00:07:36.251 INFO:tasks.workunit.client.1.smithi135.stdout:7/752: read db/d1e/d3a/f3b [3306239,5725] 0 2024-05-09T00:07:36.251 INFO:tasks.workunit.client.1.smithi135.stdout:7/753: write db/d1e/d3a/d40/d7e/fe9 [350968,53234] 0 2024-05-09T00:07:36.251 INFO:tasks.workunit.client.1.smithi135.stdout:5/717: rmdir db/d3f 39 2024-05-09T00:07:36.251 INFO:tasks.workunit.client.1.smithi135.stdout:5/718: fdatasync db/d5d/dac/f82 0 2024-05-09T00:07:36.253 INFO:tasks.workunit.client.1.smithi135.stdout:2/682: chown d1/d12/d21/l8e 666 1 2024-05-09T00:07:36.253 INFO:tasks.workunit.client.1.smithi135.stdout:2/683: fsync d1/d12/d20/d2b/d56/d86/f88 0 2024-05-09T00:07:36.253 INFO:tasks.workunit.client.1.smithi135.stdout:2/684: fsync d1/d12/d21/d41/d6d/d6e/f9a 0 2024-05-09T00:07:36.254 INFO:tasks.workunit.client.1.smithi135.stdout:8/694: sync 2024-05-09T00:07:36.255 INFO:tasks.workunit.client.1.smithi135.stdout:4/552: symlink dc/dd/lbb 0 2024-05-09T00:07:36.259 INFO:tasks.workunit.client.1.smithi135.stdout:4/553: write dc/d4a/d69/d39/f48 [2218004,41264] 0 2024-05-09T00:07:36.261 INFO:tasks.workunit.client.1.smithi135.stdout:1/656: creat da/db/feb x:0 0 0 2024-05-09T00:07:36.262 INFO:tasks.workunit.client.0.smithi026.stdout:6/56: dread f4 [0,4194304] 0 2024-05-09T00:07:36.263 INFO:tasks.workunit.client.0.smithi026.stdout:4/71: unlink d0/f6 0 2024-05-09T00:07:36.267 INFO:tasks.workunit.client.1.smithi135.stdout:1/657: dread da/d24/d27/d33/d7d/fb8 [0,4194304] 0 2024-05-09T00:07:36.267 INFO:tasks.workunit.client.1.smithi135.stdout:7/754: creat db/d1e/d3a/d40/d4c/da3/ded/ff7 x:0 0 0 2024-05-09T00:07:36.268 INFO:tasks.workunit.client.0.smithi026.stdout:7/49: creat d8/ff x:0 0 0 2024-05-09T00:07:36.269 INFO:tasks.workunit.client.1.smithi135.stdout:5/719: creat db/fde x:0 0 0 2024-05-09T00:07:36.270 INFO:tasks.workunit.client.0.smithi026.stdout:5/56: mknod d2/cd 0 2024-05-09T00:07:36.270 INFO:tasks.workunit.client.0.smithi026.stdout:5/57: fsync d2/fc 0 2024-05-09T00:07:36.271 INFO:tasks.workunit.client.1.smithi135.stdout:2/685: symlink d1/d12/d20/d2b/d56/lec 0 2024-05-09T00:07:36.271 INFO:tasks.workunit.client.0.smithi026.stdout:1/67: mknod d5/db/c11 0 2024-05-09T00:07:36.272 INFO:tasks.workunit.client.0.smithi026.stdout:1/68: chown d5/dd/ff 106445 1 2024-05-09T00:07:36.273 INFO:tasks.workunit.client.1.smithi135.stdout:6/677: dwrite d2/da/d26/d57/f6c [4194304,4194304] 0 2024-05-09T00:07:36.274 INFO:tasks.workunit.client.1.smithi135.stdout:8/695: rename d4/d7/de/d45/d76/f99 to d4/d7/da4/fed 0 2024-05-09T00:07:36.275 INFO:tasks.workunit.client.0.smithi026.stdout:3/62: rename d5/f7 to d5/f12 0 2024-05-09T00:07:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:6/57: read - fa zero size 2024-05-09T00:07:36.278 INFO:tasks.workunit.client.0.smithi026.stdout:4/72: truncate d0/f9 3699913 0 2024-05-09T00:07:36.278 INFO:tasks.workunit.client.1.smithi135.stdout:6/678: write d2/da/d26/d57/f6c [3719383,56198] 0 2024-05-09T00:07:36.279 INFO:tasks.workunit.client.0.smithi026.stdout:7/50: creat d8/f10 x:0 0 0 2024-05-09T00:07:36.279 INFO:tasks.workunit.client.0.smithi026.stdout:7/51: write d8/f10 [960369,116791] 0 2024-05-09T00:07:36.281 INFO:tasks.workunit.client.0.smithi026.stdout:5/58: rename d2/cd to d2/ce 0 2024-05-09T00:07:36.281 INFO:tasks.workunit.client.0.smithi026.stdout:9/86: dwrite d7/fd [12582912,4194304] 0 2024-05-09T00:07:36.282 INFO:tasks.workunit.client.1.smithi135.stdout:4/554: creat dc/dd/fbc x:0 0 0 2024-05-09T00:07:36.282 INFO:tasks.workunit.client.0.smithi026.stdout:1/69: creat d5/db/f12 x:0 0 0 2024-05-09T00:07:36.283 INFO:tasks.workunit.client.1.smithi135.stdout:1/658: getdents da/d14/d20/d38/d3a/d40/d96 0 2024-05-09T00:07:36.284 INFO:tasks.workunit.client.1.smithi135.stdout:2/686: getdents d1/d22 0 2024-05-09T00:07:36.284 INFO:tasks.workunit.client.1.smithi135.stdout:3/710: dwrite d8/d13/d51/d63/d89/fea [8388608,4194304] 0 2024-05-09T00:07:36.285 INFO:tasks.workunit.client.1.smithi135.stdout:5/720: dwrite db/d3f/f5f [0,4194304] 0 2024-05-09T00:07:36.285 INFO:tasks.workunit.client.1.smithi135.stdout:5/721: fsync db/d3f/f5c 0 2024-05-09T00:07:36.285 INFO:tasks.workunit.client.1.smithi135.stdout:5/722: write db/d5d/dac/ddc/f9a [743328,106591] 0 2024-05-09T00:07:36.286 INFO:tasks.workunit.client.0.smithi026.stdout:3/63: mkdir d5/d9/d13 0 2024-05-09T00:07:36.287 INFO:tasks.workunit.client.1.smithi135.stdout:7/755: rename db/d1e/d3a/c3e to db/dd/d33/d68/cf8 0 2024-05-09T00:07:36.288 INFO:tasks.workunit.client.0.smithi026.stdout:6/58: read f9 [3253654,56577] 0 2024-05-09T00:07:36.289 INFO:tasks.workunit.client.1.smithi135.stdout:8/696: mkdir d4/d7/d4a/dee 0 2024-05-09T00:07:36.291 INFO:tasks.workunit.client.1.smithi135.stdout:6/679: unlink d2/d20/d2e/cb2 0 2024-05-09T00:07:36.293 INFO:tasks.workunit.client.1.smithi135.stdout:4/555: rmdir dc/d4a/d69/d55 39 2024-05-09T00:07:36.294 INFO:tasks.workunit.client.1.smithi135.stdout:4/556: dread - dc/d4a/d69/d55/fab zero size 2024-05-09T00:07:36.294 INFO:tasks.workunit.client.0.smithi026.stdout:5/59: mkdir d2/d8/df 0 2024-05-09T00:07:36.295 INFO:tasks.workunit.client.0.smithi026.stdout:5/60: write d2/f3 [51104,41094] 0 2024-05-09T00:07:36.296 INFO:tasks.workunit.client.1.smithi135.stdout:1/659: mknod da/d14/d20/d38/d3a/d40/d96/cec 0 2024-05-09T00:07:36.297 INFO:tasks.workunit.client.1.smithi135.stdout:1/660: write da/d24/d27/d33/fb0 [1855709,14965] 0 2024-05-09T00:07:36.298 INFO:tasks.workunit.client.1.smithi135.stdout:2/687: write d1/d12/f48 [3042180,129045] 0 2024-05-09T00:07:36.298 INFO:tasks.workunit.client.0.smithi026.stdout:3/64: symlink d5/d9/d13/l14 0 2024-05-09T00:07:36.299 INFO:tasks.workunit.client.1.smithi135.stdout:3/711: creat d8/d13/d75/d58/ff9 x:0 0 0 2024-05-09T00:07:36.299 INFO:tasks.workunit.client.1.smithi135.stdout:3/712: readlink d8/d13/d1f/l83 0 2024-05-09T00:07:36.300 INFO:tasks.workunit.client.0.smithi026.stdout:3/65: write d5/fd [1664785,65190] 0 2024-05-09T00:07:36.302 INFO:tasks.workunit.client.1.smithi135.stdout:5/723: mkdir db/d84/d31/d5e/ddf 0 2024-05-09T00:07:36.304 INFO:tasks.workunit.client.0.smithi026.stdout:7/52: symlink d8/l11 0 2024-05-09T00:07:36.307 INFO:tasks.workunit.client.1.smithi135.stdout:2/688: dread d1/d12/d20/d3b/f7e [0,4194304] 0 2024-05-09T00:07:36.307 INFO:tasks.workunit.client.1.smithi135.stdout:7/756: rename db/dd/d33/dd3/ce5 to db/d21/d98/cf9 0 2024-05-09T00:07:36.307 INFO:tasks.workunit.client.1.smithi135.stdout:7/757: truncate db/da8/f86 3224341 0 2024-05-09T00:07:36.309 INFO:tasks.workunit.client.0.smithi026.stdout:5/61: creat d2/d8/f10 x:0 0 0 2024-05-09T00:07:36.312 INFO:tasks.workunit.client.0.smithi026.stdout:1/70: symlink d5/l13 0 2024-05-09T00:07:36.313 INFO:tasks.workunit.client.1.smithi135.stdout:2/689: write d1/d12/d20/d2b/d56/d72/fae [584659,27219] 0 2024-05-09T00:07:36.314 INFO:tasks.workunit.client.1.smithi135.stdout:2/690: write d1/d12/d20/d3b/d4f/f64 [396125,6025] 0 2024-05-09T00:07:36.315 INFO:tasks.workunit.client.0.smithi026.stdout:3/66: symlink d5/l15 0 2024-05-09T00:07:36.316 INFO:tasks.workunit.client.1.smithi135.stdout:3/713: dwrite d8/d6d/d44/d4b/d59/d90/f94 [0,4194304] 0 2024-05-09T00:07:36.317 INFO:tasks.workunit.client.0.smithi026.stdout:6/59: dwrite f6 [0,4194304] 0 2024-05-09T00:07:36.318 INFO:tasks.workunit.client.1.smithi135.stdout:6/680: creat d2/d20/d3f/fea x:0 0 0 2024-05-09T00:07:36.319 INFO:tasks.workunit.client.1.smithi135.stdout:6/681: write d2/d1a/f1b [2566002,89996] 0 2024-05-09T00:07:36.319 INFO:tasks.workunit.client.0.smithi026.stdout:9/87: rename d7/cf to d7/c1a 0 2024-05-09T00:07:36.321 INFO:tasks.workunit.client.1.smithi135.stdout:4/557: mkdir dc/d4a/d69/d55/d5f/d5a/dbd 0 2024-05-09T00:07:36.321 INFO:tasks.workunit.client.0.smithi026.stdout:5/62: mknod d2/c11 0 2024-05-09T00:07:36.322 INFO:tasks.workunit.client.0.smithi026.stdout:4/73: write d0/f2 [397234,43877] 0 2024-05-09T00:07:36.323 INFO:tasks.workunit.client.1.smithi135.stdout:1/661: symlink da/d14/d20/d38/d86/led 0 2024-05-09T00:07:36.323 INFO:tasks.workunit.client.1.smithi135.stdout:1/662: truncate da/d24/d27/d33/d52/d71/d8d/f9d 1932241 0 2024-05-09T00:07:36.323 INFO:tasks.workunit.client.1.smithi135.stdout:1/663: chown da/d24/d27/d33/d52/d71 1940094 1 2024-05-09T00:07:36.324 INFO:tasks.workunit.client.0.smithi026.stdout:1/71: truncate d5/dd/fe 1483663 0 2024-05-09T00:07:36.324 INFO:tasks.workunit.client.0.smithi026.stdout:1/72: write d5/db/f12 [897592,47536] 0 2024-05-09T00:07:36.326 INFO:tasks.workunit.client.0.smithi026.stdout:3/67: unlink c4 0 2024-05-09T00:07:36.326 INFO:tasks.workunit.client.0.smithi026.stdout:3/68: fsync d5/f12 0 2024-05-09T00:07:36.328 INFO:tasks.workunit.client.1.smithi135.stdout:5/724: creat db/d5d/dac/fe0 x:0 0 0 2024-05-09T00:07:36.329 INFO:tasks.workunit.client.0.smithi026.stdout:7/53: mkdir d8/d12 0 2024-05-09T00:07:36.335 INFO:tasks.workunit.client.1.smithi135.stdout:7/758: mknod db/d1e/de6/cfa 0 2024-05-09T00:07:36.336 INFO:tasks.workunit.client.1.smithi135.stdout:2/691: chown d1/d12/d27/f3c 1619930389 1 2024-05-09T00:07:36.336 INFO:tasks.workunit.client.1.smithi135.stdout:2/692: chown d1/d12/d21/f38 1 1 2024-05-09T00:07:36.337 INFO:tasks.workunit.client.1.smithi135.stdout:3/714: creat d8/d6d/d44/d4b/d59/deb/ffa x:0 0 0 2024-05-09T00:07:36.338 INFO:tasks.workunit.client.1.smithi135.stdout:3/715: chown d8/d13/d51/d92 234 1 2024-05-09T00:07:36.338 INFO:tasks.workunit.client.1.smithi135.stdout:3/716: fsync d8/d13/f1b 0 2024-05-09T00:07:36.340 INFO:tasks.workunit.client.1.smithi135.stdout:6/682: mknod d2/d20/ceb 0 2024-05-09T00:07:36.342 INFO:tasks.workunit.client.1.smithi135.stdout:4/558: dwrite dc/d26/d31/f9a [0,4194304] 0 2024-05-09T00:07:36.342 INFO:tasks.workunit.client.0.smithi026.stdout:9/88: write d7/f9 [989648,6478] 0 2024-05-09T00:07:36.346 INFO:tasks.workunit.client.1.smithi135.stdout:7/759: rename db/d13/f24 to db/d1e/ffb 0 2024-05-09T00:07:36.346 INFO:tasks.workunit.client.1.smithi135.stdout:7/760: chown db/d1e/d3a/d40/d4c/d67/l76 27280 1 2024-05-09T00:07:36.347 INFO:tasks.workunit.client.0.smithi026.stdout:5/63: creat d2/d8/df/f12 x:0 0 0 2024-05-09T00:07:36.347 INFO:tasks.workunit.client.0.smithi026.stdout:5/64: chown d2/ce 444 1 2024-05-09T00:07:36.350 INFO:tasks.workunit.client.1.smithi135.stdout:3/717: mknod d8/d13/d51/d63/cfb 0 2024-05-09T00:07:36.350 INFO:tasks.workunit.client.1.smithi135.stdout:3/718: chown d8/d6d/d44/l68 8106176 1 2024-05-09T00:07:36.351 INFO:tasks.workunit.client.1.smithi135.stdout:6/683: symlink d2/d20/d37/lec 0 2024-05-09T00:07:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:3/69: creat d5/d9/f16 x:0 0 0 2024-05-09T00:07:36.353 INFO:tasks.workunit.client.1.smithi135.stdout:0/685: sync 2024-05-09T00:07:36.353 INFO:tasks.workunit.client.1.smithi135.stdout:0/686: chown d3/dd/d3f/f5b 0 1 2024-05-09T00:07:36.353 INFO:tasks.workunit.client.1.smithi135.stdout:0/687: fdatasync d3/dd/d3f/f5b 0 2024-05-09T00:07:36.353 INFO:tasks.workunit.client.1.smithi135.stdout:0/688: dread - d3/dd/d3f/d43/da3/fa6 zero size 2024-05-09T00:07:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:4/74: dwrite d0/d12/f13 [0,4194304] 0 2024-05-09T00:07:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:6/60: mknod ce 0 2024-05-09T00:07:36.357 INFO:tasks.workunit.client.1.smithi135.stdout:5/725: dwrite db/d5d/fa3 [0,4194304] 0 2024-05-09T00:07:36.357 INFO:tasks.workunit.client.1.smithi135.stdout:7/761: dread f8 [0,4194304] 0 2024-05-09T00:07:36.357 INFO:tasks.workunit.client.1.smithi135.stdout:1/664: dwrite da/d24/d27/f28 [0,4194304] 0 2024-05-09T00:07:36.357 INFO:tasks.workunit.client.1.smithi135.stdout:1/665: fsync da/d14/d5c/d83/f92 0 2024-05-09T00:07:36.359 INFO:tasks.workunit.client.1.smithi135.stdout:4/559: link dc/d4a/d69/d55/d6d/l8f dc/d4a/d69/d55/d5f/d5a/dbd/lbe 0 2024-05-09T00:07:36.359 INFO:tasks.workunit.client.1.smithi135.stdout:4/560: write dc/d4a/d69/d55/fab [466378,129312] 0 2024-05-09T00:07:36.360 INFO:tasks.workunit.client.0.smithi026.stdout:3/70: dread d5/f12 [0,4194304] 0 2024-05-09T00:07:36.360 INFO:tasks.workunit.client.0.smithi026.stdout:1/73: write d5/dd/fe [2189577,98300] 0 2024-05-09T00:07:36.360 INFO:tasks.workunit.client.0.smithi026.stdout:1/74: readlink d5/l6 0 2024-05-09T00:07:36.361 INFO:tasks.workunit.client.1.smithi135.stdout:2/693: getdents d1/d12/da3 0 2024-05-09T00:07:36.362 INFO:tasks.workunit.client.0.smithi026.stdout:3/71: write d5/fd [1290142,67154] 0 2024-05-09T00:07:36.363 INFO:tasks.workunit.client.1.smithi135.stdout:3/719: symlink d8/d13/d51/d63/d89/lfc 0 2024-05-09T00:07:36.364 INFO:tasks.workunit.client.0.smithi026.stdout:5/65: mknod d2/d8/c13 0 2024-05-09T00:07:36.365 INFO:tasks.workunit.client.1.smithi135.stdout:6/684: creat d2/da/d1d/d69/d89/fed x:0 0 0 2024-05-09T00:07:36.365 INFO:tasks.workunit.client.1.smithi135.stdout:6/685: fdatasync d2/da/d26/fc0 0 2024-05-09T00:07:36.366 INFO:tasks.workunit.client.1.smithi135.stdout:0/689: mkdir d3/dd/d3f/d3a/da4/dc1 0 2024-05-09T00:07:36.369 INFO:tasks.workunit.client.0.smithi026.stdout:7/54: mknod d8/c13 0 2024-05-09T00:07:36.369 INFO:tasks.workunit.client.0.smithi026.stdout:7/55: write d8/fa [4171968,85389] 0 2024-05-09T00:07:36.370 INFO:tasks.workunit.client.0.smithi026.stdout:7/56: fsync f5 0 2024-05-09T00:07:36.370 INFO:tasks.workunit.client.0.smithi026.stdout:7/57: truncate f5 1727737 0 2024-05-09T00:07:36.372 INFO:tasks.workunit.client.1.smithi135.stdout:7/762: rmdir db/d1e/d3a/d40/d7e 39 2024-05-09T00:07:36.374 INFO:tasks.workunit.client.1.smithi135.stdout:7/763: dread db/dd/d33/f9e [0,4194304] 0 2024-05-09T00:07:36.374 INFO:tasks.workunit.client.1.smithi135.stdout:7/764: dread - db/dd/fb7 zero size 2024-05-09T00:07:36.375 INFO:tasks.workunit.client.1.smithi135.stdout:5/726: mkdir db/d3f/de1 0 2024-05-09T00:07:36.378 INFO:tasks.workunit.client.0.smithi026.stdout:4/75: link d0/f9 d0/d12/f15 0 2024-05-09T00:07:36.380 INFO:tasks.workunit.client.0.smithi026.stdout:6/61: truncate f4 1128235 0 2024-05-09T00:07:36.395 INFO:tasks.workunit.client.1.smithi135.stdout:1/666: rmdir da/dce 39 2024-05-09T00:07:36.396 INFO:tasks.workunit.client.0.smithi026.stdout:1/75: mknod d5/dd/c14 0 2024-05-09T00:07:36.396 INFO:tasks.workunit.client.0.smithi026.stdout:1/76: fsync d5/dd/ff 0 2024-05-09T00:07:36.397 INFO:tasks.workunit.client.1.smithi135.stdout:4/561: rename dc/d4a/l74 to dc/d4a/d69/d55/d5f/lbf 0 2024-05-09T00:07:36.398 INFO:tasks.workunit.client.0.smithi026.stdout:3/72: truncate d5/f12 2841267 0 2024-05-09T00:07:36.398 INFO:tasks.workunit.client.0.smithi026.stdout:3/73: truncate d5/d9/f16 327428 0 2024-05-09T00:07:36.399 INFO:tasks.workunit.client.1.smithi135.stdout:2/694: link d1/d22/d63/f97 d1/d22/d63/fed 0 2024-05-09T00:07:36.401 INFO:tasks.workunit.client.1.smithi135.stdout:3/720: truncate d8/d13/d1f/d40/d52/f54 7950962 0 2024-05-09T00:07:36.402 INFO:tasks.workunit.client.1.smithi135.stdout:6/686: creat d2/da/d26/d57/ddc/fee x:0 0 0 2024-05-09T00:07:36.402 INFO:tasks.workunit.client.1.smithi135.stdout:6/687: chown d2/d20/d37/ld1 463047 1 2024-05-09T00:07:36.402 INFO:tasks.workunit.client.1.smithi135.stdout:6/688: fdatasync d2/da/d1d/d69/d78/fc9 0 2024-05-09T00:07:36.403 INFO:tasks.workunit.client.0.smithi026.stdout:4/76: getdents d0 0 2024-05-09T00:07:36.405 INFO:tasks.workunit.client.1.smithi135.stdout:0/690: unlink d3/f12 0 2024-05-09T00:07:36.405 INFO:tasks.workunit.client.1.smithi135.stdout:0/691: chown d3/dd/d3f/d58/dae/fb8 3 1 2024-05-09T00:07:36.405 INFO:tasks.workunit.client.1.smithi135.stdout:0/692: chown d3/dd/f7b 386 1 2024-05-09T00:07:36.405 INFO:tasks.workunit.client.1.smithi135.stdout:0/693: chown d3/c20 27 1 2024-05-09T00:07:36.405 INFO:tasks.workunit.client.1.smithi135.stdout:0/694: dread - d3/dd/d3f/d29/d7c/fa5 zero size 2024-05-09T00:07:36.405 INFO:tasks.workunit.client.1.smithi135.stdout:7/765: dwrite db/d1e/d3a/d40/d4c/f4f [4194304,4194304] 0 2024-05-09T00:07:36.406 INFO:tasks.workunit.client.1.smithi135.stdout:1/667: symlink da/db/d16/lee 0 2024-05-09T00:07:36.407 INFO:tasks.workunit.client.0.smithi026.stdout:7/58: dwrite d8/f10 [0,4194304] 0 2024-05-09T00:07:36.407 INFO:tasks.workunit.client.0.smithi026.stdout:7/59: chown d8/cd 5241 1 2024-05-09T00:07:36.407 INFO:tasks.workunit.client.0.smithi026.stdout:3/74: mknod d5/c17 0 2024-05-09T00:07:36.407 INFO:tasks.workunit.client.1.smithi135.stdout:4/562: rmdir dc/d26/d4e 39 2024-05-09T00:07:36.410 INFO:tasks.workunit.client.0.smithi026.stdout:5/66: truncate d2/f3 6045806 0 2024-05-09T00:07:36.410 INFO:tasks.workunit.client.1.smithi135.stdout:3/721: link d8/d13/d51/d92/fb1 d8/d6d/d44/d4b/ffd 0 2024-05-09T00:07:36.414 INFO:tasks.workunit.client.1.smithi135.stdout:6/689: mknod d2/da/d26/d57/d59/d62/da8/cef 0 2024-05-09T00:07:36.414 INFO:tasks.workunit.client.0.smithi026.stdout:6/62: symlink lf 0 2024-05-09T00:07:36.415 INFO:tasks.workunit.client.0.smithi026.stdout:7/60: dread d8/f10 [0,4194304] 0 2024-05-09T00:07:36.416 INFO:tasks.workunit.client.1.smithi135.stdout:7/766: dread db/d1e/d3a/d40/d4c/fc3 [0,4194304] 0 2024-05-09T00:07:36.416 INFO:tasks.workunit.client.1.smithi135.stdout:0/695: rename d3/l17 to d3/dd/d3f/d58/dae/lc2 0 2024-05-09T00:07:36.418 INFO:tasks.workunit.client.1.smithi135.stdout:5/727: dwrite db/d84/d62/d73/f83 [0,4194304] 0 2024-05-09T00:07:36.418 INFO:tasks.workunit.client.1.smithi135.stdout:5/728: fsync db/d84/f43 0 2024-05-09T00:07:36.418 INFO:tasks.workunit.client.1.smithi135.stdout:5/729: truncate db/d84/d31/fbb 898767 0 2024-05-09T00:07:36.419 INFO:tasks.workunit.client.1.smithi135.stdout:1/668: creat da/d14/d20/d38/d3a/d40/d96/fef x:0 0 0 2024-05-09T00:07:36.420 INFO:tasks.workunit.client.1.smithi135.stdout:2/695: dwrite d1/d22/f26 [0,4194304] 0 2024-05-09T00:07:36.421 INFO:tasks.workunit.client.1.smithi135.stdout:4/563: chown dc/c2e 310 1 2024-05-09T00:07:36.423 INFO:tasks.workunit.client.1.smithi135.stdout:7/767: mkdir db/d1e/d3a/dfc 0 2024-05-09T00:07:36.427 INFO:tasks.workunit.client.1.smithi135.stdout:6/690: rename d2/d20/d2e/d3d to d2/da/df0 0 2024-05-09T00:07:36.429 INFO:tasks.workunit.client.1.smithi135.stdout:0/696: creat d3/dd/fc3 x:0 0 0 2024-05-09T00:07:36.430 INFO:tasks.workunit.client.0.smithi026.stdout:4/77: rename d0/c8 to d0/c16 0 2024-05-09T00:07:36.433 INFO:tasks.workunit.client.0.smithi026.stdout:9/89: truncate d7/fd 9683608 0 2024-05-09T00:07:36.433 INFO:tasks.workunit.client.0.smithi026.stdout:9/90: chown f3 1910875636 1 2024-05-09T00:07:36.433 INFO:tasks.workunit.client.0.smithi026.stdout:7/61: symlink d8/d12/l14 0 2024-05-09T00:07:36.434 INFO:tasks.workunit.client.0.smithi026.stdout:7/62: dread - d8/ff zero size 2024-05-09T00:07:36.435 INFO:tasks.workunit.client.1.smithi135.stdout:5/730: creat db/d84/d62/d73/d9c/fe2 x:0 0 0 2024-05-09T00:07:36.435 INFO:tasks.workunit.client.1.smithi135.stdout:5/731: chown db/d84/d62/c6f 60 1 2024-05-09T00:07:36.435 INFO:tasks.workunit.client.1.smithi135.stdout:5/732: chown db/fde 7 1 2024-05-09T00:07:36.435 INFO:tasks.workunit.client.1.smithi135.stdout:5/733: write db/d84/d31/f90 [130204,40655] 0 2024-05-09T00:07:36.436 INFO:tasks.workunit.client.0.smithi026.stdout:4/78: truncate d0/fe 1818075 0 2024-05-09T00:07:36.438 INFO:tasks.workunit.client.0.smithi026.stdout:6/63: truncate f4 1197548 0 2024-05-09T00:07:36.438 INFO:tasks.workunit.client.1.smithi135.stdout:8/697: sync 2024-05-09T00:07:36.438 INFO:tasks.workunit.client.1.smithi135.stdout:9/568: sync 2024-05-09T00:07:36.438 INFO:tasks.workunit.client.1.smithi135.stdout:9/569: write d1/d1a/d89/d99/fa5 [1043778,100917] 0 2024-05-09T00:07:36.439 INFO:tasks.workunit.client.0.smithi026.stdout:9/91: creat d7/f1b x:0 0 0 2024-05-09T00:07:36.442 INFO:tasks.workunit.client.1.smithi135.stdout:6/691: dread d2/f76 [0,4194304] 0 2024-05-09T00:07:36.442 INFO:tasks.workunit.client.1.smithi135.stdout:2/696: rmdir d1/d12/d21 39 2024-05-09T00:07:36.442 INFO:tasks.workunit.client.1.smithi135.stdout:2/697: fsync d1/d22/d63/f93 0 2024-05-09T00:07:36.446 INFO:tasks.workunit.client.1.smithi135.stdout:4/564: dwrite dc/d4a/d69/d55/d5f/f20 [0,4194304] 0 2024-05-09T00:07:36.450 INFO:tasks.workunit.client.1.smithi135.stdout:7/768: unlink db/cd6 0 2024-05-09T00:07:36.451 INFO:tasks.workunit.client.0.smithi026.stdout:7/63: mkdir d8/d15 0 2024-05-09T00:07:36.451 INFO:tasks.workunit.client.0.smithi026.stdout:1/77: dwrite d5/dd/fe [0,4194304] 0 2024-05-09T00:07:36.451 INFO:tasks.workunit.client.1.smithi135.stdout:8/698: dread d4/f20 [4194304,4194304] 0 2024-05-09T00:07:36.451 INFO:tasks.workunit.client.1.smithi135.stdout:8/699: dread - d4/d7/fca zero size 2024-05-09T00:07:36.452 INFO:tasks.workunit.client.0.smithi026.stdout:9/92: symlink d7/l1c 0 2024-05-09T00:07:36.453 INFO:tasks.workunit.client.0.smithi026.stdout:5/67: write d2/f3 [6762716,88824] 0 2024-05-09T00:07:36.453 INFO:tasks.workunit.client.0.smithi026.stdout:5/68: dread - d2/fc zero size 2024-05-09T00:07:36.456 INFO:tasks.workunit.client.1.smithi135.stdout:8/700: write d4/d8/f1e [3819921,127954] 0 2024-05-09T00:07:36.457 INFO:tasks.workunit.client.1.smithi135.stdout:0/697: creat d3/dd/d3f/d43/da3/fc4 x:0 0 0 2024-05-09T00:07:36.457 INFO:tasks.workunit.client.1.smithi135.stdout:0/698: fsync d3/dd/d3f/f7e 0 2024-05-09T00:07:36.459 INFO:tasks.workunit.client.1.smithi135.stdout:1/669: symlink da/db/lf0 0 2024-05-09T00:07:36.461 INFO:tasks.workunit.client.0.smithi026.stdout:1/78: creat d5/db/f15 x:0 0 0 2024-05-09T00:07:36.462 INFO:tasks.workunit.client.1.smithi135.stdout:6/692: symlink d2/d20/lf1 0 2024-05-09T00:07:36.462 INFO:tasks.workunit.client.0.smithi026.stdout:9/93: readlink d7/l15 0 2024-05-09T00:07:36.464 INFO:tasks.workunit.client.1.smithi135.stdout:2/698: unlink d1/d22/f26 0 2024-05-09T00:07:36.466 INFO:tasks.workunit.client.1.smithi135.stdout:8/701: dread d4/d7/f52 [0,4194304] 0 2024-05-09T00:07:36.466 INFO:tasks.workunit.client.1.smithi135.stdout:8/702: write d4/d7/d2a/faf [181862,99589] 0 2024-05-09T00:07:36.466 INFO:tasks.workunit.client.1.smithi135.stdout:8/703: chown d4/d22/f27 1293708 1 2024-05-09T00:07:36.466 INFO:tasks.workunit.client.0.smithi026.stdout:5/69: mknod d2/c14 0 2024-05-09T00:07:36.467 INFO:tasks.workunit.client.1.smithi135.stdout:8/704: write d4/d8/da2/da6/db8/fcb [950816,34836] 0 2024-05-09T00:07:36.469 INFO:tasks.workunit.client.1.smithi135.stdout:7/769: creat db/dd/d33/d68/ffd x:0 0 0 2024-05-09T00:07:36.470 INFO:tasks.workunit.client.1.smithi135.stdout:1/670: dread f9 [0,4194304] 0 2024-05-09T00:07:36.470 INFO:tasks.workunit.client.1.smithi135.stdout:1/671: readlink da/d14/d20/d38/d3a/d40/d75/lb9 0 2024-05-09T00:07:36.472 INFO:tasks.workunit.client.1.smithi135.stdout:9/570: dwrite d1/d1a/d10/f6a [0,4194304] 0 2024-05-09T00:07:36.472 INFO:tasks.workunit.client.1.smithi135.stdout:9/571: truncate d1/d1a/d10/f68 1025407 0 2024-05-09T00:07:36.473 INFO:tasks.workunit.client.1.smithi135.stdout:0/699: rename d3/f23 to d3/dd/d2d/d4c/fc5 0 2024-05-09T00:07:36.473 INFO:tasks.workunit.client.1.smithi135.stdout:5/734: dwrite db/d24/f34 [0,4194304] 0 2024-05-09T00:07:36.473 INFO:tasks.workunit.client.0.smithi026.stdout:6/64: dwrite f9 [0,4194304] 0 2024-05-09T00:07:36.473 INFO:tasks.workunit.client.0.smithi026.stdout:5/70: link l0 d2/l15 0 2024-05-09T00:07:36.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/693: getdents d2/da/d26/d57/ddc/dd7 0 2024-05-09T00:07:36.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/694: dread - d2/d20/d37/d4e/d7c/fd6 zero size 2024-05-09T00:07:36.475 INFO:tasks.workunit.client.1.smithi135.stdout:6/695: dread - d2/da/d26/d57/d59/d62/fe4 zero size 2024-05-09T00:07:36.475 INFO:tasks.workunit.client.0.smithi026.stdout:4/79: getdents d0 0 2024-05-09T00:07:36.476 INFO:tasks.workunit.client.0.smithi026.stdout:1/79: mkdir d5/d16 0 2024-05-09T00:07:36.477 INFO:tasks.workunit.client.1.smithi135.stdout:9/572: write d1/d1a/d2c/f28 [3940408,96968] 0 2024-05-09T00:07:36.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/699: rmdir d1/d12/d27 39 2024-05-09T00:07:36.478 INFO:tasks.workunit.client.1.smithi135.stdout:2/700: chown d1/f47 7 1 2024-05-09T00:07:36.481 INFO:tasks.workunit.client.1.smithi135.stdout:4/565: mknod dc/d26/d31/cc0 0 2024-05-09T00:07:36.481 INFO:tasks.workunit.client.0.smithi026.stdout:5/71: symlink d2/l16 0 2024-05-09T00:07:36.481 INFO:tasks.workunit.client.0.smithi026.stdout:5/72: truncate d2/d8/f10 285221 0 2024-05-09T00:07:36.483 INFO:tasks.workunit.client.1.smithi135.stdout:7/770: mknod db/d1e/d3a/d40/d7e/cfe 0 2024-05-09T00:07:36.483 INFO:tasks.workunit.client.1.smithi135.stdout:4/566: dread dc/d4a/d69/d39/f9b [0,4194304] 0 2024-05-09T00:07:36.483 INFO:tasks.workunit.client.1.smithi135.stdout:7/771: fsync db/d1e/d3a/f52 0 2024-05-09T00:07:36.483 INFO:tasks.workunit.client.1.smithi135.stdout:7/772: dread - db/d1e/fe7 zero size 2024-05-09T00:07:36.483 INFO:tasks.workunit.client.0.smithi026.stdout:4/80: truncate d0/d12/f13 82369 0 2024-05-09T00:07:36.485 INFO:tasks.workunit.client.1.smithi135.stdout:1/672: getdents da/d24 0 2024-05-09T00:07:36.486 INFO:tasks.workunit.client.0.smithi026.stdout:1/80: mkdir d5/dd/d17 0 2024-05-09T00:07:36.488 INFO:tasks.workunit.client.0.smithi026.stdout:6/65: unlink l7 0 2024-05-09T00:07:36.493 INFO:tasks.workunit.client.0.smithi026.stdout:1/81: link d5/f10 d5/d16/f18 0 2024-05-09T00:07:36.493 INFO:tasks.workunit.client.0.smithi026.stdout:1/82: write d5/f10 [872965,118653] 0 2024-05-09T00:07:36.494 INFO:tasks.workunit.client.0.smithi026.stdout:7/64: getdents d8 0 2024-05-09T00:07:36.496 INFO:tasks.workunit.client.0.smithi026.stdout:9/94: dread d7/fd [4194304,4194304] 0 2024-05-09T00:07:36.496 INFO:tasks.workunit.client.0.smithi026.stdout:4/81: rename d0/d12/c14 to d0/c17 0 2024-05-09T00:07:36.498 INFO:tasks.workunit.client.1.smithi135.stdout:0/700: creat d3/dd/d2d/d4c/fc6 x:0 0 0 2024-05-09T00:07:36.499 INFO:tasks.workunit.client.0.smithi026.stdout:1/83: creat d5/d16/f19 x:0 0 0 2024-05-09T00:07:36.500 INFO:tasks.workunit.client.1.smithi135.stdout:5/735: dwrite db/d24/d32/d5b/d91/fd3 [0,4194304] 0 2024-05-09T00:07:36.501 INFO:tasks.workunit.client.1.smithi135.stdout:5/736: fdatasync db/f12 0 2024-05-09T00:07:36.501 INFO:tasks.workunit.client.0.smithi026.stdout:7/65: symlink d8/d12/l16 0 2024-05-09T00:07:36.502 INFO:tasks.workunit.client.0.smithi026.stdout:9/95: creat d7/f1d x:0 0 0 2024-05-09T00:07:36.503 INFO:tasks.workunit.client.1.smithi135.stdout:6/696: symlink d2/da/d26/d57/d59/lf2 0 2024-05-09T00:07:36.506 INFO:tasks.workunit.client.1.smithi135.stdout:9/573: creat d1/d1a/d10/d3c/d43/fb6 x:0 0 0 2024-05-09T00:07:36.506 INFO:tasks.workunit.client.1.smithi135.stdout:9/574: fdatasync d1/d1a/d2c/f53 0 2024-05-09T00:07:36.506 INFO:tasks.workunit.client.1.smithi135.stdout:9/575: readlink d1/d1a/d2c/d2d/l8a 0 2024-05-09T00:07:36.506 INFO:tasks.workunit.client.0.smithi026.stdout:1/84: symlink d5/dd/l1a 0 2024-05-09T00:07:36.507 INFO:tasks.workunit.client.1.smithi135.stdout:9/576: dread d1/d1a/d10/d3c/d5c/f63 [0,4194304] 0 2024-05-09T00:07:36.508 INFO:tasks.workunit.client.0.smithi026.stdout:7/66: symlink d8/d15/l17 0 2024-05-09T00:07:36.508 INFO:tasks.workunit.client.0.smithi026.stdout:7/67: write f5 [2409263,86453] 0 2024-05-09T00:07:36.508 INFO:tasks.workunit.client.0.smithi026.stdout:7/68: chown d8/d12/l14 31038910 1 2024-05-09T00:07:36.508 INFO:tasks.workunit.client.0.smithi026.stdout:7/69: chown d8/c13 4607 1 2024-05-09T00:07:36.508 INFO:tasks.workunit.client.0.smithi026.stdout:7/70: fsync f7 0 2024-05-09T00:07:36.510 INFO:tasks.workunit.client.0.smithi026.stdout:6/66: dwrite fa [0,4194304] 0 2024-05-09T00:07:36.510 INFO:tasks.workunit.client.0.smithi026.stdout:6/67: rmdir - no directory 2024-05-09T00:07:36.511 INFO:tasks.workunit.client.0.smithi026.stdout:4/82: rename d0/c16 to d0/c18 0 2024-05-09T00:07:36.516 INFO:tasks.workunit.client.0.smithi026.stdout:2/46: sync 2024-05-09T00:07:36.516 INFO:tasks.workunit.client.0.smithi026.stdout:8/69: sync 2024-05-09T00:07:36.516 INFO:tasks.workunit.client.0.smithi026.stdout:8/70: truncate f7 5034345 0 2024-05-09T00:07:36.518 INFO:tasks.workunit.client.1.smithi135.stdout:7/773: creat db/dd/d33/d58/dc7/fff x:0 0 0 2024-05-09T00:07:36.518 INFO:tasks.workunit.client.1.smithi135.stdout:7/774: dread - db/da8/f75 zero size 2024-05-09T00:07:36.521 INFO:tasks.workunit.client.0.smithi026.stdout:7/71: dwrite d8/fa [4194304,4194304] 0 2024-05-09T00:07:36.521 INFO:tasks.workunit.client.0.smithi026.stdout:7/72: fsync f7 0 2024-05-09T00:07:36.521 INFO:tasks.workunit.client.0.smithi026.stdout:7/73: chown d8/d15/l17 13957371 1 2024-05-09T00:07:36.521 INFO:tasks.workunit.client.0.smithi026.stdout:7/74: truncate f7 709560 0 2024-05-09T00:07:36.523 INFO:tasks.workunit.client.0.smithi026.stdout:6/68: unlink l3 0 2024-05-09T00:07:36.523 INFO:tasks.workunit.client.0.smithi026.stdout:0/153: sync 2024-05-09T00:07:36.523 INFO:tasks.workunit.client.1.smithi135.stdout:1/673: creat da/ff1 x:0 0 0 2024-05-09T00:07:36.524 INFO:tasks.workunit.client.1.smithi135.stdout:0/701: creat d3/dd/d2d/d4c/d84/fc7 x:0 0 0 2024-05-09T00:07:36.527 INFO:tasks.workunit.client.0.smithi026.stdout:9/96: rename d7/cb to d7/c1e 0 2024-05-09T00:07:36.529 INFO:tasks.workunit.client.0.smithi026.stdout:2/47: mknod cf 0 2024-05-09T00:07:36.529 INFO:tasks.workunit.client.0.smithi026.stdout:2/48: dread - fc zero size 2024-05-09T00:07:36.532 INFO:tasks.workunit.client.0.smithi026.stdout:8/71: link de/f11 de/f13 0 2024-05-09T00:07:36.532 INFO:tasks.workunit.client.0.smithi026.stdout:8/72: dread - de/f11 zero size 2024-05-09T00:07:36.533 INFO:tasks.workunit.client.1.smithi135.stdout:6/697: symlink d2/da/d26/d57/ddc/lf3 0 2024-05-09T00:07:36.533 INFO:tasks.workunit.client.1.smithi135.stdout:6/698: truncate d2/da/d26/d57/d60/fbe 866308 0 2024-05-09T00:07:36.534 INFO:tasks.workunit.client.1.smithi135.stdout:9/577: symlink d1/d24/lb7 0 2024-05-09T00:07:36.537 INFO:tasks.workunit.client.0.smithi026.stdout:2/49: write fb [2781328,53970] 0 2024-05-09T00:07:36.537 INFO:tasks.workunit.client.0.smithi026.stdout:2/50: chown l0 53412 1 2024-05-09T00:07:36.538 INFO:tasks.workunit.client.1.smithi135.stdout:2/701: truncate d1/d12/f5a 3429702 0 2024-05-09T00:07:36.538 INFO:tasks.workunit.client.1.smithi135.stdout:2/702: write d1/d12/d21/f9f [618473,10400] 0 2024-05-09T00:07:36.540 INFO:tasks.workunit.client.0.smithi026.stdout:7/75: unlink d8/c9 0 2024-05-09T00:07:36.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/567: mknod dc/d26/d31/cc1 0 2024-05-09T00:07:36.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/568: fdatasync dc/dd/f7e 0 2024-05-09T00:07:36.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/569: truncate dc/d26/d4e/fa2 375908 0 2024-05-09T00:07:36.543 INFO:tasks.workunit.client.0.smithi026.stdout:9/97: creat d7/f1f x:0 0 0 2024-05-09T00:07:36.543 INFO:tasks.workunit.client.1.smithi135.stdout:7/775: creat db/f100 x:0 0 0 2024-05-09T00:07:36.543 INFO:tasks.workunit.client.1.smithi135.stdout:7/776: stat db/d13/l18 0 2024-05-09T00:07:36.544 INFO:tasks.workunit.client.0.smithi026.stdout:0/154: write f10 [6277785,18521] 0 2024-05-09T00:07:36.545 INFO:tasks.workunit.client.1.smithi135.stdout:1/674: mkdir da/db/d16/df2 0 2024-05-09T00:07:36.545 INFO:tasks.workunit.client.1.smithi135.stdout:1/675: stat da/db/lf0 0 2024-05-09T00:07:36.547 INFO:tasks.workunit.client.0.smithi026.stdout:2/51: rename fa to f10 0 2024-05-09T00:07:36.550 INFO:tasks.workunit.client.1.smithi135.stdout:0/702: symlink d3/dd/d3f/d3a/da4/dc1/lc8 0 2024-05-09T00:07:36.551 INFO:tasks.workunit.client.1.smithi135.stdout:0/703: dread - d3/d64/fac zero size 2024-05-09T00:07:36.551 INFO:tasks.workunit.client.0.smithi026.stdout:7/76: creat d8/d15/f18 x:0 0 0 2024-05-09T00:07:36.551 INFO:tasks.workunit.client.0.smithi026.stdout:7/77: readlink d8/d15/l17 0 2024-05-09T00:07:36.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/699: unlink d2/f58 0 2024-05-09T00:07:36.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/700: write d2/da/d26/d57/d60/fbe [1521445,74378] 0 2024-05-09T00:07:36.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/701: stat d2/d20/d3f/fea 0 2024-05-09T00:07:36.556 INFO:tasks.workunit.client.1.smithi135.stdout:9/578: symlink d1/d24/d44/daf/lb8 0 2024-05-09T00:07:36.557 INFO:tasks.workunit.client.0.smithi026.stdout:0/155: rmdir d1d/d1e/d20 39 2024-05-09T00:07:36.558 INFO:tasks.workunit.client.0.smithi026.stdout:0/156: readlink l1a 0 2024-05-09T00:07:36.560 INFO:tasks.workunit.client.0.smithi026.stdout:2/52: creat f11 x:0 0 0 2024-05-09T00:07:36.561 INFO:tasks.workunit.client.1.smithi135.stdout:2/703: symlink d1/d12/d21/lee 0 2024-05-09T00:07:36.564 INFO:tasks.workunit.client.0.smithi026.stdout:7/78: link d8/d15/l17 d8/l19 0 2024-05-09T00:07:36.564 INFO:tasks.workunit.client.0.smithi026.stdout:2/53: dread f2 [0,4194304] 0 2024-05-09T00:07:36.565 INFO:tasks.workunit.client.1.smithi135.stdout:4/570: readlink dc/l81 0 2024-05-09T00:07:36.565 INFO:tasks.workunit.client.1.smithi135.stdout:5/737: dwrite db/d84/d62/fa1 [0,4194304] 0 2024-05-09T00:07:36.568 INFO:tasks.workunit.client.1.smithi135.stdout:1/676: link da/d14/d20/d38/d3a/d40/d96/cec da/d24/d27/d33/d52/d71/cf3 0 2024-05-09T00:07:36.568 INFO:tasks.workunit.client.1.smithi135.stdout:7/777: dwrite db/d1e/d3a/d40/d4c/da3/fcd [0,4194304] 0 2024-05-09T00:07:36.568 INFO:tasks.workunit.client.0.smithi026.stdout:4/83: dwrite d0/f9 [0,4194304] 0 2024-05-09T00:07:36.568 INFO:tasks.workunit.client.0.smithi026.stdout:8/73: dwrite de/f13 [0,4194304] 0 2024-05-09T00:07:36.569 INFO:tasks.workunit.client.0.smithi026.stdout:5/73: dwrite d2/f3 [0,4194304] 0 2024-05-09T00:07:36.569 INFO:tasks.workunit.client.0.smithi026.stdout:5/74: dread - d2/d8/df/f12 zero size 2024-05-09T00:07:36.570 INFO:tasks.workunit.client.0.smithi026.stdout:2/54: symlink l12 0 2024-05-09T00:07:36.570 INFO:tasks.workunit.client.0.smithi026.stdout:8/74: write f7 [3796759,62147] 0 2024-05-09T00:07:36.571 INFO:tasks.workunit.client.0.smithi026.stdout:6/69: dwrite f6 [0,4194304] 0 2024-05-09T00:07:36.571 INFO:tasks.workunit.client.1.smithi135.stdout:0/704: truncate d3/dd/d3f/f27 805031 0 2024-05-09T00:07:36.572 INFO:tasks.workunit.client.0.smithi026.stdout:9/98: rename d7/c14 to d7/c20 0 2024-05-09T00:07:36.580 INFO:tasks.workunit.client.1.smithi135.stdout:4/571: dread dc/d4a/d69/d55/d5f/f21 [0,4194304] 0 2024-05-09T00:07:36.580 INFO:tasks.workunit.client.1.smithi135.stdout:9/579: symlink d1/d1a/d2c/lb9 0 2024-05-09T00:07:36.580 INFO:tasks.workunit.client.1.smithi135.stdout:6/702: link d2/d20/d37/ld1 d2/da/d26/d57/lf4 0 2024-05-09T00:07:36.580 INFO:tasks.workunit.client.1.smithi135.stdout:9/580: fdatasync d1/d1a/d10/d3c/d5c/f63 0 2024-05-09T00:07:36.586 INFO:tasks.workunit.client.1.smithi135.stdout:5/738: unlink db/f2e 0 2024-05-09T00:07:36.593 INFO:tasks.workunit.client.1.smithi135.stdout:1/677: symlink da/d24/dd0/lf4 0 2024-05-09T00:07:36.594 INFO:tasks.workunit.client.1.smithi135.stdout:7/778: mkdir db/d5b/d101 0 2024-05-09T00:07:36.595 INFO:tasks.workunit.client.0.smithi026.stdout:7/79: dwrite d8/fa [0,4194304] 0 2024-05-09T00:07:36.596 INFO:tasks.workunit.client.0.smithi026.stdout:5/75: rmdir d2 39 2024-05-09T00:07:36.598 INFO:tasks.workunit.client.0.smithi026.stdout:0/157: dwrite d1d/d1e/d20/f28 [0,4194304] 0 2024-05-09T00:07:36.598 INFO:tasks.workunit.client.0.smithi026.stdout:0/158: write d1d/d1e/f23 [559433,35336] 0 2024-05-09T00:07:36.598 INFO:tasks.workunit.client.0.smithi026.stdout:2/55: mknod c13 0 2024-05-09T00:07:36.598 INFO:tasks.workunit.client.0.smithi026.stdout:4/84: dwrite d0/f9 [0,4194304] 0 2024-05-09T00:07:36.599 INFO:tasks.workunit.client.1.smithi135.stdout:0/705: mkdir d3/dd/dc9 0 2024-05-09T00:07:36.599 INFO:tasks.workunit.client.1.smithi135.stdout:0/706: write d3/dd/d3f/f7e [323267,79277] 0 2024-05-09T00:07:36.601 INFO:tasks.workunit.client.0.smithi026.stdout:8/75: creat de/f14 x:0 0 0 2024-05-09T00:07:36.603 INFO:tasks.workunit.client.1.smithi135.stdout:9/581: link d1/d1a/d10/f90 d1/fba 0 2024-05-09T00:07:36.604 INFO:tasks.workunit.client.0.smithi026.stdout:6/70: creat f10 x:0 0 0 2024-05-09T00:07:36.607 INFO:tasks.workunit.client.1.smithi135.stdout:4/572: creat dc/d4a/d69/d39/fc2 x:0 0 0 2024-05-09T00:07:36.607 INFO:tasks.workunit.client.1.smithi135.stdout:5/739: mkdir db/d5d/dac/ddc/dbf/de3 0 2024-05-09T00:07:36.609 INFO:tasks.workunit.client.1.smithi135.stdout:6/703: dread d2/da/d26/d57/f6c [0,4194304] 0 2024-05-09T00:07:36.610 INFO:tasks.workunit.client.1.smithi135.stdout:6/704: stat d2/d20/d37/d4e/d7c/c8c 0 2024-05-09T00:07:36.610 INFO:tasks.workunit.client.1.smithi135.stdout:6/705: stat d2/l13 0 2024-05-09T00:07:36.610 INFO:tasks.workunit.client.1.smithi135.stdout:6/706: chown d2/da/d26/d57 6004843 1 2024-05-09T00:07:36.610 INFO:tasks.workunit.client.1.smithi135.stdout:9/582: dread d1/d1a/d2c/d20/f98 [0,4194304] 0 2024-05-09T00:07:36.611 INFO:tasks.workunit.client.0.smithi026.stdout:7/80: mknod d8/d15/c1a 0 2024-05-09T00:07:36.611 INFO:tasks.workunit.client.0.smithi026.stdout:7/81: write d8/ff [152002,64048] 0 2024-05-09T00:07:36.611 INFO:tasks.workunit.client.0.smithi026.stdout:7/82: fsync d8/f10 0 2024-05-09T00:07:36.612 INFO:tasks.workunit.client.1.smithi135.stdout:7/779: creat db/d5b/d101/f102 x:0 0 0 2024-05-09T00:07:36.612 INFO:tasks.workunit.client.1.smithi135.stdout:7/780: chown db/d21/cab 674 1 2024-05-09T00:07:36.612 INFO:tasks.workunit.client.1.smithi135.stdout:7/781: chown db/d1e/d3a/d40/d4c/da3/ded/ff7 1 1 2024-05-09T00:07:36.612 INFO:tasks.workunit.client.1.smithi135.stdout:7/782: chown db/d1e/d3a/d40/f6a 232243046 1 2024-05-09T00:07:36.612 INFO:tasks.workunit.client.1.smithi135.stdout:7/783: fsync db/d1e/d63/f7b 0 2024-05-09T00:07:36.614 INFO:tasks.workunit.client.1.smithi135.stdout:7/784: dread db/d1e/d3a/d40/f6a [0,4194304] 0 2024-05-09T00:07:36.614 INFO:tasks.workunit.client.1.smithi135.stdout:7/785: chown db/d1e/d3a/d40/d4c/da3/fcd 1172 1 2024-05-09T00:07:36.615 INFO:tasks.workunit.client.1.smithi135.stdout:7/786: dread - db/dd/d33/f82 zero size 2024-05-09T00:07:36.615 INFO:tasks.workunit.client.1.smithi135.stdout:7/787: readlink db/la2 0 2024-05-09T00:07:36.616 INFO:tasks.workunit.client.0.smithi026.stdout:5/76: creat d2/d8/df/f17 x:0 0 0 2024-05-09T00:07:36.622 INFO:tasks.workunit.client.1.smithi135.stdout:0/707: mknod d3/dd/d2d/db5/cca 0 2024-05-09T00:07:36.625 INFO:tasks.workunit.client.1.smithi135.stdout:4/573: rename dc/dd/f3d to dc/d26/d4e/fc3 0 2024-05-09T00:07:36.626 INFO:tasks.workunit.client.1.smithi135.stdout:9/583: dwrite d1/d24/d44/d54/d66/fac [0,4194304] 0 2024-05-09T00:07:36.626 INFO:tasks.workunit.client.1.smithi135.stdout:9/584: write d1/d24/d86/f96 [585583,41022] 0 2024-05-09T00:07:36.627 INFO:tasks.workunit.client.0.smithi026.stdout:0/159: link l13 d1d/d1e/d20/l2e 0 2024-05-09T00:07:36.629 INFO:tasks.workunit.client.1.smithi135.stdout:5/740: creat db/d5d/fe4 x:0 0 0 2024-05-09T00:07:36.630 INFO:tasks.workunit.client.0.smithi026.stdout:7/83: dwrite d8/fa [0,4194304] 0 2024-05-09T00:07:36.630 INFO:tasks.workunit.client.0.smithi026.stdout:7/84: fsync d8/f10 0 2024-05-09T00:07:36.631 INFO:tasks.workunit.client.0.smithi026.stdout:2/56: mkdir d14 0 2024-05-09T00:07:36.631 INFO:tasks.workunit.client.0.smithi026.stdout:2/57: write fd [1259977,110577] 0 2024-05-09T00:07:36.634 INFO:tasks.workunit.client.1.smithi135.stdout:1/678: mkdir da/d24/d27/d33/d52/df5 0 2024-05-09T00:07:36.634 INFO:tasks.workunit.client.1.smithi135.stdout:1/679: dread da/d73/f81 [0,4194304] 0 2024-05-09T00:07:36.635 INFO:tasks.workunit.client.1.smithi135.stdout:1/680: readlink da/d14/d20/d38/l45 0 2024-05-09T00:07:36.635 INFO:tasks.workunit.client.1.smithi135.stdout:6/707: creat d2/da/d26/d57/ddc/ff5 x:0 0 0 2024-05-09T00:07:36.637 INFO:tasks.workunit.client.0.smithi026.stdout:8/76: creat de/f15 x:0 0 0 2024-05-09T00:07:36.638 INFO:tasks.workunit.client.1.smithi135.stdout:8/705: sync 2024-05-09T00:07:36.638 INFO:tasks.workunit.client.1.smithi135.stdout:3/722: sync 2024-05-09T00:07:36.640 INFO:tasks.workunit.client.0.smithi026.stdout:6/71: creat f11 x:0 0 0 2024-05-09T00:07:36.642 INFO:tasks.workunit.client.1.smithi135.stdout:7/788: mknod db/dd/d33/d68/dde/c103 0 2024-05-09T00:07:36.644 INFO:tasks.workunit.client.1.smithi135.stdout:0/708: dwrite d3/dd/d2d/d4c/fc6 [0,4194304] 0 2024-05-09T00:07:36.644 INFO:tasks.workunit.client.1.smithi135.stdout:0/709: chown d3/d9e/f8f 41865131 1 2024-05-09T00:07:36.644 INFO:tasks.workunit.client.0.smithi026.stdout:9/99: rename c5 to d7/c21 0 2024-05-09T00:07:36.646 INFO:tasks.workunit.client.0.smithi026.stdout:5/77: rmdir d2/d8 39 2024-05-09T00:07:36.648 INFO:tasks.workunit.client.1.smithi135.stdout:0/710: write d3/dd/d3f/d29/f77 [6331752,74815] 0 2024-05-09T00:07:36.648 INFO:tasks.workunit.client.1.smithi135.stdout:0/711: truncate d3/dd/d3f/d3a/d46/f38 5068838 0 2024-05-09T00:07:36.649 INFO:tasks.workunit.client.0.smithi026.stdout:0/160: stat d1d/c22 0 2024-05-09T00:07:36.651 INFO:tasks.workunit.client.1.smithi135.stdout:4/574: creat dc/d26/d31/fc4 x:0 0 0 2024-05-09T00:07:36.653 INFO:tasks.workunit.client.0.smithi026.stdout:7/85: mkdir d8/d1b 0 2024-05-09T00:07:36.653 INFO:tasks.workunit.client.0.smithi026.stdout:7/86: fdatasync f6 0 2024-05-09T00:07:36.653 INFO:tasks.workunit.client.0.smithi026.stdout:7/87: fsync d8/fa 0 2024-05-09T00:07:36.653 INFO:tasks.workunit.client.0.smithi026.stdout:7/88: getdents d8/d1b 0 2024-05-09T00:07:36.654 INFO:tasks.workunit.client.0.smithi026.stdout:7/89: fdatasync d8/fc 0 2024-05-09T00:07:36.654 INFO:tasks.workunit.client.0.smithi026.stdout:7/90: write d8/ff [193921,130042] 0 2024-05-09T00:07:36.656 INFO:tasks.workunit.client.0.smithi026.stdout:2/58: mkdir d14/d15 0 2024-05-09T00:07:36.657 INFO:tasks.workunit.client.1.smithi135.stdout:5/741: mknod db/d84/d31/d5e/ddf/ce5 0 2024-05-09T00:07:36.658 INFO:tasks.workunit.client.0.smithi026.stdout:0/161: dread f10 [0,4194304] 0 2024-05-09T00:07:36.659 INFO:tasks.workunit.client.0.smithi026.stdout:4/85: mkdir d0/d19 0 2024-05-09T00:07:36.662 INFO:tasks.workunit.client.1.smithi135.stdout:8/706: link d4/d7/d2a/d56/f61 d4/d7/d4a/fef 0 2024-05-09T00:07:36.662 INFO:tasks.workunit.client.1.smithi135.stdout:8/707: fdatasync d4/d22/f8c 0 2024-05-09T00:07:36.662 INFO:tasks.workunit.client.1.smithi135.stdout:8/708: chown d4/d7/d2a/d9f 1963520 1 2024-05-09T00:07:36.662 INFO:tasks.workunit.client.1.smithi135.stdout:1/681: dwrite da/d14/d20/d38/d3a/d40/fc5 [0,4194304] 0 2024-05-09T00:07:36.663 INFO:tasks.workunit.client.1.smithi135.stdout:6/708: dwrite d2/d20/d2e/f8d [0,4194304] 0 2024-05-09T00:07:36.663 INFO:tasks.workunit.client.1.smithi135.stdout:6/709: dread - d2/d20/d37/d4e/f6a zero size 2024-05-09T00:07:36.663 INFO:tasks.workunit.client.0.smithi026.stdout:6/72: creat f12 x:0 0 0 2024-05-09T00:07:36.663 INFO:tasks.workunit.client.0.smithi026.stdout:6/73: dread - f11 zero size 2024-05-09T00:07:36.664 INFO:tasks.workunit.client.1.smithi135.stdout:9/585: dwrite d1/d1a/d10/d3c/f4b [4194304,4194304] 0 2024-05-09T00:07:36.664 INFO:tasks.workunit.client.0.smithi026.stdout:8/77: dwrite de/ff [0,4194304] 0 2024-05-09T00:07:36.665 INFO:tasks.workunit.client.1.smithi135.stdout:9/586: dread d1/d24/d44/d54/fa8 [0,4194304] 0 2024-05-09T00:07:36.666 INFO:tasks.workunit.client.1.smithi135.stdout:3/723: mkdir d8/d6d/d44/d4b/da0/daa/dc9/dfe 0 2024-05-09T00:07:36.666 INFO:tasks.workunit.client.1.smithi135.stdout:3/724: dread - d8/d6d/d44/d4b/d59/d90/d7b/d80/d84/f8d zero size 2024-05-09T00:07:36.667 INFO:tasks.workunit.client.0.smithi026.stdout:9/100: truncate d7/fd 5230552 0 2024-05-09T00:07:36.670 INFO:tasks.workunit.client.0.smithi026.stdout:5/78: creat d2/d8/df/f18 x:0 0 0 2024-05-09T00:07:36.671 INFO:tasks.workunit.client.0.smithi026.stdout:2/59: dwrite f9 [0,4194304] 0 2024-05-09T00:07:36.673 INFO:tasks.workunit.client.1.smithi135.stdout:7/789: rename db/dd/d33/d68/l74 to db/d21/l104 0 2024-05-09T00:07:36.676 INFO:tasks.workunit.client.0.smithi026.stdout:7/91: creat d8/d15/f1c x:0 0 0 2024-05-09T00:07:36.676 INFO:tasks.workunit.client.0.smithi026.stdout:7/92: dread - d8/fc zero size 2024-05-09T00:07:36.678 INFO:tasks.workunit.client.0.smithi026.stdout:0/162: symlink d1d/d25/l2f 0 2024-05-09T00:07:36.678 INFO:tasks.workunit.client.0.smithi026.stdout:0/163: read - d1d/d1e/f26 zero size 2024-05-09T00:07:36.679 INFO:tasks.workunit.client.0.smithi026.stdout:0/164: write ff [397985,36930] 0 2024-05-09T00:07:36.679 INFO:tasks.workunit.client.0.smithi026.stdout:0/165: truncate f11 4941906 0 2024-05-09T00:07:36.680 INFO:tasks.workunit.client.0.smithi026.stdout:4/86: mknod d0/d19/c1a 0 2024-05-09T00:07:36.680 INFO:tasks.workunit.client.0.smithi026.stdout:4/87: fdatasync d0/f9 0 2024-05-09T00:07:36.681 INFO:tasks.workunit.client.1.smithi135.stdout:0/712: symlink d3/dd/lcb 0 2024-05-09T00:07:36.682 INFO:tasks.workunit.client.1.smithi135.stdout:0/713: readlink d3/dd/d3f/lbf 0 2024-05-09T00:07:36.683 INFO:tasks.workunit.client.1.smithi135.stdout:4/575: creat dc/d4a/d69/d39/fc5 x:0 0 0 2024-05-09T00:07:36.683 INFO:tasks.workunit.client.1.smithi135.stdout:4/576: chown dc/d4a/d69/d55/d5f/f53 386 1 2024-05-09T00:07:36.685 INFO:tasks.workunit.client.1.smithi135.stdout:8/709: truncate d4/d22/f27 208704 0 2024-05-09T00:07:36.688 INFO:tasks.workunit.client.1.smithi135.stdout:2/704: sync 2024-05-09T00:07:36.689 INFO:tasks.workunit.client.0.smithi026.stdout:5/79: dwrite d2/d8/df/f17 [0,4194304] 0 2024-05-09T00:07:36.690 INFO:tasks.workunit.client.0.smithi026.stdout:5/80: readlink d2/l16 0 2024-05-09T00:07:36.690 INFO:tasks.workunit.client.0.smithi026.stdout:5/81: write d2/d8/df/f18 [935928,87616] 0 2024-05-09T00:07:36.691 INFO:tasks.workunit.client.1.smithi135.stdout:1/682: creat da/d14/d20/d38/d3a/ff6 x:0 0 0 2024-05-09T00:07:36.691 INFO:tasks.workunit.client.0.smithi026.stdout:8/78: creat de/f16 x:0 0 0 2024-05-09T00:07:36.691 INFO:tasks.workunit.client.0.smithi026.stdout:8/79: write f7 [4697487,82607] 0 2024-05-09T00:07:36.694 INFO:tasks.workunit.client.0.smithi026.stdout:2/60: mknod d14/d15/c16 0 2024-05-09T00:07:36.695 INFO:tasks.workunit.client.1.smithi135.stdout:6/710: getdents d2/da/d49/da6 0 2024-05-09T00:07:36.696 INFO:tasks.workunit.client.0.smithi026.stdout:7/93: mknod d8/d1b/c1d 0 2024-05-09T00:07:36.696 INFO:tasks.workunit.client.0.smithi026.stdout:7/94: read f6 [68642,29288] 0 2024-05-09T00:07:36.696 INFO:tasks.workunit.client.0.smithi026.stdout:7/95: chown d8/f10 3280186 1 2024-05-09T00:07:36.699 INFO:tasks.workunit.client.0.smithi026.stdout:0/166: symlink d1d/d1e/d2d/l30 0 2024-05-09T00:07:36.699 INFO:tasks.workunit.client.1.smithi135.stdout:2/705: dread d1/d22/d63/fed [0,4194304] 0 2024-05-09T00:07:36.700 INFO:tasks.workunit.client.0.smithi026.stdout:4/88: dwrite d0/f9 [0,4194304] 0 2024-05-09T00:07:36.700 INFO:tasks.workunit.client.0.smithi026.stdout:0/167: write f4 [5558580,106286] 0 2024-05-09T00:07:36.702 INFO:tasks.workunit.client.0.smithi026.stdout:6/74: symlink l13 0 2024-05-09T00:07:36.705 INFO:tasks.workunit.client.0.smithi026.stdout:0/168: dread f14 [0,4194304] 0 2024-05-09T00:07:36.708 INFO:tasks.workunit.client.1.smithi135.stdout:9/587: truncate d1/d24/d44/d54/f69 1704096 0 2024-05-09T00:07:36.710 INFO:tasks.workunit.client.0.smithi026.stdout:5/82: link d2/d8/c13 d2/d8/df/c19 0 2024-05-09T00:07:36.712 INFO:tasks.workunit.client.1.smithi135.stdout:3/725: link d8/c5b d8/d6d/d44/d4b/d69/cff 0 2024-05-09T00:07:36.713 INFO:tasks.workunit.client.0.smithi026.stdout:8/80: unlink de/l10 0 2024-05-09T00:07:36.715 INFO:tasks.workunit.client.1.smithi135.stdout:7/790: creat db/d1e/d3a/d40/d4c/d67/f105 x:0 0 0 2024-05-09T00:07:36.717 INFO:tasks.workunit.client.0.smithi026.stdout:9/101: rename c4 to d7/c22 0 2024-05-09T00:07:36.719 INFO:tasks.workunit.client.1.smithi135.stdout:0/714: rmdir d3/dd/d3f/d29/d7c/daa 39 2024-05-09T00:07:36.719 INFO:tasks.workunit.client.1.smithi135.stdout:0/715: fdatasync d3/dd/f2f 0 2024-05-09T00:07:36.719 INFO:tasks.workunit.client.1.smithi135.stdout:3/726: dread d8/d13/d1f/f6b [0,4194304] 0 2024-05-09T00:07:36.720 INFO:tasks.workunit.client.0.smithi026.stdout:2/61: mkdir d14/d15/d17 0 2024-05-09T00:07:36.720 INFO:tasks.workunit.client.0.smithi026.stdout:2/62: readlink l0 0 2024-05-09T00:07:36.724 INFO:tasks.workunit.client.1.smithi135.stdout:4/577: unlink f7 0 2024-05-09T00:07:36.728 INFO:tasks.workunit.client.1.smithi135.stdout:8/710: symlink d4/d8/lf0 0 2024-05-09T00:07:36.728 INFO:tasks.workunit.client.1.smithi135.stdout:8/711: readlink d4/d7/de/l9a 0 2024-05-09T00:07:36.728 INFO:tasks.workunit.client.1.smithi135.stdout:8/712: write d4/f2b [10248331,28412] 0 2024-05-09T00:07:36.728 INFO:tasks.workunit.client.0.smithi026.stdout:7/96: rmdir d8/d15 39 2024-05-09T00:07:36.729 INFO:tasks.workunit.client.0.smithi026.stdout:7/97: dread f6 [0,4194304] 0 2024-05-09T00:07:36.731 INFO:tasks.workunit.client.1.smithi135.stdout:1/683: getdents da/d14/d20/d38/d3a/db7 0 2024-05-09T00:07:36.732 INFO:tasks.workunit.client.1.smithi135.stdout:6/711: chown d2/da/d26/d57/ddc/dd7 931 1 2024-05-09T00:07:36.734 INFO:tasks.workunit.client.1.smithi135.stdout:2/706: mkdir d1/d12/d21/d57/dbd/def 0 2024-05-09T00:07:36.734 INFO:tasks.workunit.client.1.smithi135.stdout:2/707: readlink d1/d12/d21/d41/d6d/l85 0 2024-05-09T00:07:36.735 INFO:tasks.workunit.client.1.smithi135.stdout:2/708: write d1/d12/d20/f80 [798625,88067] 0 2024-05-09T00:07:36.737 INFO:tasks.workunit.client.1.smithi135.stdout:7/791: rename db/d1e/d3a/d40/f55 to db/d1e/d3a/f106 0 2024-05-09T00:07:36.737 INFO:tasks.workunit.client.1.smithi135.stdout:7/792: stat db/da8/f80 0 2024-05-09T00:07:36.738 INFO:tasks.workunit.client.1.smithi135.stdout:0/716: creat d3/dd/d2d/d4c/fcc x:0 0 0 2024-05-09T00:07:36.739 INFO:tasks.workunit.client.1.smithi135.stdout:0/717: write d3/dd/d3f/d58/f5c [527540,126878] 0 2024-05-09T00:07:36.740 INFO:tasks.workunit.client.0.smithi026.stdout:8/81: mkdir de/d17 0 2024-05-09T00:07:36.740 INFO:tasks.workunit.client.1.smithi135.stdout:3/727: mknod d8/d13/d1f/d40/d52/c100 0 2024-05-09T00:07:36.742 INFO:tasks.workunit.client.0.smithi026.stdout:5/83: rename l0 to d2/d8/df/l1a 0 2024-05-09T00:07:36.743 INFO:tasks.workunit.client.1.smithi135.stdout:8/713: truncate d4/d7/d4a/fef 3178329 0 2024-05-09T00:07:36.743 INFO:tasks.workunit.client.0.smithi026.stdout:0/169: dwrite f12 [0,4194304] 0 2024-05-09T00:07:36.745 INFO:tasks.workunit.client.1.smithi135.stdout:6/712: symlink d2/d20/d3f/d4f/lf6 0 2024-05-09T00:07:36.746 INFO:tasks.workunit.client.1.smithi135.stdout:6/713: write d2/d1a/f24 [1632320,34491] 0 2024-05-09T00:07:36.746 INFO:tasks.workunit.client.0.smithi026.stdout:2/63: creat d14/f18 x:0 0 0 2024-05-09T00:07:36.747 INFO:tasks.workunit.client.1.smithi135.stdout:2/709: creat d1/d12/d20/d2b/ff0 x:0 0 0 2024-05-09T00:07:36.748 INFO:tasks.workunit.client.0.smithi026.stdout:6/75: rename cd to c14 0 2024-05-09T00:07:36.748 INFO:tasks.workunit.client.0.smithi026.stdout:6/76: rmdir - no directory 2024-05-09T00:07:36.748 INFO:tasks.workunit.client.1.smithi135.stdout:8/714: write d4/f20 [10607526,95741] 0 2024-05-09T00:07:36.751 INFO:tasks.workunit.client.0.smithi026.stdout:7/98: mkdir d8/d12/d1e 0 2024-05-09T00:07:36.752 INFO:tasks.workunit.client.0.smithi026.stdout:7/99: write d8/f10 [3853130,3546] 0 2024-05-09T00:07:36.752 INFO:tasks.workunit.client.1.smithi135.stdout:4/578: rename dc/d4a/d69/d55/d5f/d5a/d9e/ca6 to dc/d4a/d69/d55/d5f/cc6 0 2024-05-09T00:07:36.752 INFO:tasks.workunit.client.1.smithi135.stdout:4/579: chown dc/d26/d31/d82/fa9 70489697 1 2024-05-09T00:07:36.752 INFO:tasks.workunit.client.1.smithi135.stdout:4/580: fdatasync dc/d4a/f50 0 2024-05-09T00:07:36.753 INFO:tasks.workunit.client.0.smithi026.stdout:8/82: symlink de/d17/l18 0 2024-05-09T00:07:36.754 INFO:tasks.workunit.client.0.smithi026.stdout:8/83: write f3 [339449,129662] 0 2024-05-09T00:07:36.754 INFO:tasks.workunit.client.0.smithi026.stdout:8/84: chown de/f15 6483264 1 2024-05-09T00:07:36.754 INFO:tasks.workunit.client.1.smithi135.stdout:7/793: creat db/dd/d33/d58/dc7/f107 x:0 0 0 2024-05-09T00:07:36.755 INFO:tasks.workunit.client.0.smithi026.stdout:5/84: mknod d2/d8/df/c1b 0 2024-05-09T00:07:36.755 INFO:tasks.workunit.client.0.smithi026.stdout:5/85: write d2/d8/f10 [168021,108608] 0 2024-05-09T00:07:36.756 INFO:tasks.workunit.client.1.smithi135.stdout:0/718: mkdir d3/dd/d3f/d3a/da4/dcd 0 2024-05-09T00:07:36.759 INFO:tasks.workunit.client.1.smithi135.stdout:3/728: getdents d8/d13/d1f/d40 0 2024-05-09T00:07:36.765 INFO:tasks.workunit.client.1.smithi135.stdout:6/714: creat d2/da/d1d/d69/ff7 x:0 0 0 2024-05-09T00:07:36.766 INFO:tasks.workunit.client.1.smithi135.stdout:3/729: dread d8/d6d/fa1 [0,4194304] 0 2024-05-09T00:07:36.768 INFO:tasks.workunit.client.1.smithi135.stdout:2/710: link d1/d12/d20/d3b/d40/c4b d1/d12/d21/d41/d6d/d6e/cf1 0 2024-05-09T00:07:36.771 INFO:tasks.workunit.client.1.smithi135.stdout:6/715: dread d2/da/d1d/d69/d78/f97 [0,4194304] 0 2024-05-09T00:07:36.772 INFO:tasks.workunit.client.1.smithi135.stdout:8/715: getdents d4/d7/d2a/d67 0 2024-05-09T00:07:36.773 INFO:tasks.workunit.client.1.smithi135.stdout:5/742: sync 2024-05-09T00:07:36.773 INFO:tasks.workunit.client.1.smithi135.stdout:5/743: write db/d24/f72 [938918,21738] 0 2024-05-09T00:07:36.774 INFO:tasks.workunit.client.0.smithi026.stdout:0/170: link d1d/d1e/l21 d1d/d1e/d20/l31 0 2024-05-09T00:07:36.774 INFO:tasks.workunit.client.0.smithi026.stdout:0/171: read f10 [6791503,29287] 0 2024-05-09T00:07:36.775 INFO:tasks.workunit.client.0.smithi026.stdout:9/102: mkdir d7/d23 0 2024-05-09T00:07:36.778 INFO:tasks.workunit.client.0.smithi026.stdout:2/64: symlink d14/d15/l19 0 2024-05-09T00:07:36.783 INFO:tasks.workunit.client.1.smithi135.stdout:4/581: link dc/dd/f22 dc/d26/d31/db6/fc7 0 2024-05-09T00:07:36.787 INFO:tasks.workunit.client.1.smithi135.stdout:7/794: unlink db/d1e/d3a/d40/d4c/d67/fbd 0 2024-05-09T00:07:36.788 INFO:tasks.workunit.client.1.smithi135.stdout:3/730: dwrite d8/d13/f2d [0,4194304] 0 2024-05-09T00:07:36.788 INFO:tasks.workunit.client.0.smithi026.stdout:7/100: link d8/fa d8/f1f 0 2024-05-09T00:07:36.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/719: truncate d3/dd/d2d/f49 2948762 0 2024-05-09T00:07:36.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/720: fdatasync d3/f79 0 2024-05-09T00:07:36.790 INFO:tasks.workunit.client.0.smithi026.stdout:8/85: symlink de/l19 0 2024-05-09T00:07:36.790 INFO:tasks.workunit.client.0.smithi026.stdout:8/86: chown de/d17 877282284 1 2024-05-09T00:07:36.792 INFO:tasks.workunit.client.1.smithi135.stdout:2/711: symlink d1/d12/d20/d2b/lf2 0 2024-05-09T00:07:36.793 INFO:tasks.workunit.client.1.smithi135.stdout:8/716: dwrite d4/d7/d33/fea [0,4194304] 0 2024-05-09T00:07:36.795 INFO:tasks.workunit.client.0.smithi026.stdout:5/86: mknod d2/d8/c1c 0 2024-05-09T00:07:36.797 INFO:tasks.workunit.client.0.smithi026.stdout:0/172: truncate f10 3183114 0 2024-05-09T00:07:36.797 INFO:tasks.workunit.client.0.smithi026.stdout:0/173: fdatasync d1d/d25/f2b 0 2024-05-09T00:07:36.798 INFO:tasks.workunit.client.1.smithi135.stdout:6/716: write d2/da/d26/d57/d60/fbe [316438,117233] 0 2024-05-09T00:07:36.799 INFO:tasks.workunit.client.1.smithi135.stdout:5/744: truncate db/f12 2641901 0 2024-05-09T00:07:36.800 INFO:tasks.workunit.client.0.smithi026.stdout:2/65: rmdir d14/d15 39 2024-05-09T00:07:36.801 INFO:tasks.workunit.client.0.smithi026.stdout:2/66: fdatasync fb 0 2024-05-09T00:07:36.801 INFO:tasks.workunit.client.0.smithi026.stdout:9/103: dwrite d7/f19 [0,4194304] 0 2024-05-09T00:07:36.801 INFO:tasks.workunit.client.0.smithi026.stdout:9/104: fdatasync d7/f9 0 2024-05-09T00:07:36.801 INFO:tasks.workunit.client.0.smithi026.stdout:0/174: write f11 [1297170,6015] 0 2024-05-09T00:07:36.804 INFO:tasks.workunit.client.0.smithi026.stdout:6/77: mkdir d15 0 2024-05-09T00:07:36.804 INFO:tasks.workunit.client.0.smithi026.stdout:2/67: dread f8 [0,4194304] 0 2024-05-09T00:07:36.805 INFO:tasks.workunit.client.1.smithi135.stdout:4/582: rmdir dc/d71 39 2024-05-09T00:07:36.806 INFO:tasks.workunit.client.0.smithi026.stdout:7/101: symlink d8/d12/d1e/l20 0 2024-05-09T00:07:36.806 INFO:tasks.workunit.client.0.smithi026.stdout:7/102: chown d8/d1b 0 1 2024-05-09T00:07:36.810 INFO:tasks.workunit.client.0.smithi026.stdout:5/87: dread d2/d8/f10 [0,4194304] 0 2024-05-09T00:07:36.811 INFO:tasks.workunit.client.0.smithi026.stdout:8/87: creat de/d17/f1a x:0 0 0 2024-05-09T00:07:36.811 INFO:tasks.workunit.client.1.smithi135.stdout:3/731: dwrite d8/d13/d1f/f6b [4194304,4194304] 0 2024-05-09T00:07:36.811 INFO:tasks.workunit.client.1.smithi135.stdout:7/795: dwrite db/d1e/fc5 [0,4194304] 0 2024-05-09T00:07:36.811 INFO:tasks.workunit.client.1.smithi135.stdout:7/796: truncate db/d1e/ffb 4801741 0 2024-05-09T00:07:36.811 INFO:tasks.workunit.client.1.smithi135.stdout:7/797: write db/d1e/d3a/d40/d4c/da3/ded/ff6 [104849,125104] 0 2024-05-09T00:07:36.811 INFO:tasks.workunit.client.1.smithi135.stdout:7/798: fsync db/da8/d78/f87 0 2024-05-09T00:07:36.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/721: creat d3/dd/d3f/d29/d7c/daa/fce x:0 0 0 2024-05-09T00:07:36.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/722: dread - d3/dd/d3f/d43/fa9 zero size 2024-05-09T00:07:36.817 INFO:tasks.workunit.client.0.smithi026.stdout:3/75: sync 2024-05-09T00:07:36.817 INFO:tasks.workunit.client.0.smithi026.stdout:1/85: sync 2024-05-09T00:07:36.817 INFO:tasks.workunit.client.0.smithi026.stdout:3/76: chown d5/d9/f10 0 1 2024-05-09T00:07:36.817 INFO:tasks.workunit.client.0.smithi026.stdout:1/86: fdatasync d5/d16/f19 0 2024-05-09T00:07:36.820 INFO:tasks.workunit.client.0.smithi026.stdout:9/105: creat d7/f24 x:0 0 0 2024-05-09T00:07:36.820 INFO:tasks.workunit.client.0.smithi026.stdout:9/106: chown d7/f8 28 1 2024-05-09T00:07:36.822 INFO:tasks.workunit.client.1.smithi135.stdout:8/717: mknod d4/d7/de/d45/d76/cf1 0 2024-05-09T00:07:36.824 INFO:tasks.workunit.client.0.smithi026.stdout:0/175: creat d1d/d1e/f32 x:0 0 0 2024-05-09T00:07:36.826 INFO:tasks.workunit.client.1.smithi135.stdout:6/717: symlink d2/da/d1d/d69/d78/lf8 0 2024-05-09T00:07:36.826 INFO:tasks.workunit.client.1.smithi135.stdout:6/718: write d2/da/d26/d57/d60/fbe [1104147,47415] 0 2024-05-09T00:07:36.826 INFO:tasks.workunit.client.1.smithi135.stdout:6/719: write d2/da/d1d/d69/f87 [5139075,51620] 0 2024-05-09T00:07:36.826 INFO:tasks.workunit.client.1.smithi135.stdout:5/745: creat db/d5d/fe6 x:0 0 0 2024-05-09T00:07:36.827 INFO:tasks.workunit.client.0.smithi026.stdout:6/78: symlink d15/l16 0 2024-05-09T00:07:36.827 INFO:tasks.workunit.client.0.smithi026.stdout:2/68: symlink d14/d15/d17/l1a 0 2024-05-09T00:07:36.828 INFO:tasks.workunit.client.0.smithi026.stdout:2/69: write fb [850503,119959] 0 2024-05-09T00:07:36.831 INFO:tasks.workunit.client.0.smithi026.stdout:7/103: symlink d8/d12/l21 0 2024-05-09T00:07:36.831 INFO:tasks.workunit.client.0.smithi026.stdout:7/104: truncate d8/fb 1483560 0 2024-05-09T00:07:36.832 INFO:tasks.workunit.client.1.smithi135.stdout:9/588: sync 2024-05-09T00:07:36.832 INFO:tasks.workunit.client.1.smithi135.stdout:4/583: dwrite dc/d26/d31/f3c [0,4194304] 0 2024-05-09T00:07:36.834 INFO:tasks.workunit.client.0.smithi026.stdout:5/88: truncate d2/f3 3878409 0 2024-05-09T00:07:36.837 INFO:tasks.workunit.client.0.smithi026.stdout:8/88: symlink de/d17/l1b 0 2024-05-09T00:07:36.837 INFO:tasks.workunit.client.0.smithi026.stdout:8/89: dread - de/f16 zero size 2024-05-09T00:07:36.837 INFO:tasks.workunit.client.0.smithi026.stdout:8/90: write fa [615318,45636] 0 2024-05-09T00:07:36.837 INFO:tasks.workunit.client.0.smithi026.stdout:8/91: chown de/l19 113 1 2024-05-09T00:07:36.837 INFO:tasks.workunit.client.1.smithi135.stdout:7/799: dwrite db/d13/f57 [0,4194304] 0 2024-05-09T00:07:36.837 INFO:tasks.workunit.client.1.smithi135.stdout:9/589: write d1/d24/f35 [2458688,83111] 0 2024-05-09T00:07:36.837 INFO:tasks.workunit.client.1.smithi135.stdout:9/590: fdatasync d1/d1a/d10/fa7 0 2024-05-09T00:07:36.838 INFO:tasks.workunit.client.0.smithi026.stdout:1/87: dwrite d5/db/f15 [0,4194304] 0 2024-05-09T00:07:36.838 INFO:tasks.workunit.client.0.smithi026.stdout:1/88: truncate d5/f10 1482272 0 2024-05-09T00:07:36.838 INFO:tasks.workunit.client.1.smithi135.stdout:9/591: write d1/d1a/f42 [2329430,111120] 0 2024-05-09T00:07:36.840 INFO:tasks.workunit.client.1.smithi135.stdout:3/732: rename d8/d6d/d44/d4b/d69/f4a to d8/d6d/d44/d4b/da0/daa/dc9/f101 0 2024-05-09T00:07:36.840 INFO:tasks.workunit.client.1.smithi135.stdout:3/733: dread - d8/d13/d1f/fda zero size 2024-05-09T00:07:36.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/77: rename d5/d9/f10 to d5/d9/dc/f18 0 2024-05-09T00:07:36.843 INFO:tasks.workunit.client.1.smithi135.stdout:1/684: sync 2024-05-09T00:07:36.843 INFO:tasks.workunit.client.1.smithi135.stdout:1/685: fsync da/d14/d20/d2c/f99 0 2024-05-09T00:07:36.844 INFO:tasks.workunit.client.0.smithi026.stdout:9/107: stat c0 0 2024-05-09T00:07:36.846 INFO:tasks.workunit.client.1.smithi135.stdout:0/723: rmdir d3/dd/d3f/d29/d54 39 2024-05-09T00:07:36.846 INFO:tasks.workunit.client.1.smithi135.stdout:0/724: chown d3/dd/d2d/f49 2154 1 2024-05-09T00:07:36.847 INFO:tasks.workunit.client.0.smithi026.stdout:7/105: mkdir d8/d12/d22 0 2024-05-09T00:07:36.847 INFO:tasks.workunit.client.0.smithi026.stdout:0/176: write f10 [3512886,100562] 0 2024-05-09T00:07:36.850 INFO:tasks.workunit.client.0.smithi026.stdout:0/177: write d1d/d1e/d20/f28 [2414693,45268] 0 2024-05-09T00:07:36.850 INFO:tasks.workunit.client.0.smithi026.stdout:7/106: dread d8/ff [0,4194304] 0 2024-05-09T00:07:36.850 INFO:tasks.workunit.client.0.smithi026.stdout:0/178: chown f11 1 1 2024-05-09T00:07:36.851 INFO:tasks.workunit.client.1.smithi135.stdout:8/718: symlink d4/d7/d4a/d9c/lf2 0 2024-05-09T00:07:36.852 INFO:tasks.workunit.client.0.smithi026.stdout:5/89: getdents d2/d8/df 0 2024-05-09T00:07:36.855 INFO:tasks.workunit.client.0.smithi026.stdout:5/90: read d2/d8/df/f17 [2617614,119498] 0 2024-05-09T00:07:36.855 INFO:tasks.workunit.client.1.smithi135.stdout:5/746: mknod db/d24/d32/d5b/d91/ce7 0 2024-05-09T00:07:36.857 INFO:tasks.workunit.client.1.smithi135.stdout:5/747: write db/d3f/f57 [2021418,4199] 0 2024-05-09T00:07:36.858 INFO:tasks.workunit.client.0.smithi026.stdout:8/92: creat de/d17/f1c x:0 0 0 2024-05-09T00:07:36.862 INFO:tasks.workunit.client.1.smithi135.stdout:5/748: write db/d84/f49 [2198930,127373] 0 2024-05-09T00:07:36.864 INFO:tasks.workunit.client.0.smithi026.stdout:0/179: dread fb [0,4194304] 0 2024-05-09T00:07:36.868 INFO:tasks.workunit.client.1.smithi135.stdout:1/686: dwrite da/d14/d5c/fe6 [0,4194304] 0 2024-05-09T00:07:36.868 INFO:tasks.workunit.client.0.smithi026.stdout:1/89: dwrite d5/f7 [0,4194304] 0 2024-05-09T00:07:36.870 INFO:tasks.workunit.client.0.smithi026.stdout:6/79: rename l13 to d15/l17 0 2024-05-09T00:07:36.873 INFO:tasks.workunit.client.0.smithi026.stdout:3/78: symlink d5/d9/dc/l19 0 2024-05-09T00:07:36.874 INFO:tasks.workunit.client.0.smithi026.stdout:7/107: link d8/cd d8/d12/c23 0 2024-05-09T00:07:36.875 INFO:tasks.workunit.client.0.smithi026.stdout:7/108: chown d8/c13 141577 1 2024-05-09T00:07:36.876 INFO:tasks.workunit.client.1.smithi135.stdout:9/592: symlink d1/d24/d86/lbb 0 2024-05-09T00:07:36.878 INFO:tasks.workunit.client.0.smithi026.stdout:5/91: mknod d2/c1d 0 2024-05-09T00:07:36.879 INFO:tasks.workunit.client.0.smithi026.stdout:6/80: dread f4 [0,4194304] 0 2024-05-09T00:07:36.880 INFO:tasks.workunit.client.0.smithi026.stdout:8/93: mkdir de/d17/d1d 0 2024-05-09T00:07:36.881 INFO:tasks.workunit.client.0.smithi026.stdout:8/94: write f7 [2238066,21725] 0 2024-05-09T00:07:36.881 INFO:tasks.workunit.client.1.smithi135.stdout:5/749: dwrite db/d24/d32/d5b/d91/fd3 [0,4194304] 0 2024-05-09T00:07:36.883 INFO:tasks.workunit.client.1.smithi135.stdout:6/720: rename d2/da/df0/l4d to d2/da/d49/da4/dce/dd8/lf9 0 2024-05-09T00:07:36.886 INFO:tasks.workunit.client.1.smithi135.stdout:0/725: symlink d3/dd/d3f/d58/dae/lcf 0 2024-05-09T00:07:36.886 INFO:tasks.workunit.client.1.smithi135.stdout:0/726: chown d3/dd/d3f/d58/dae/fb8 3 1 2024-05-09T00:07:36.887 INFO:tasks.workunit.client.0.smithi026.stdout:5/92: dread d2/f3 [0,4194304] 0 2024-05-09T00:07:36.888 INFO:tasks.workunit.client.0.smithi026.stdout:1/90: truncate f3 7127464 0 2024-05-09T00:07:36.889 INFO:tasks.workunit.client.1.smithi135.stdout:8/719: mknod d4/d7/de/d45/cf3 0 2024-05-09T00:07:36.891 INFO:tasks.workunit.client.0.smithi026.stdout:9/108: rename d7/f24 to d7/d23/f25 0 2024-05-09T00:07:36.894 INFO:tasks.workunit.client.0.smithi026.stdout:7/109: dwrite f6 [0,4194304] 0 2024-05-09T00:07:36.894 INFO:tasks.workunit.client.0.smithi026.stdout:7/110: fsync d8/fc 0 2024-05-09T00:07:36.896 INFO:tasks.workunit.client.1.smithi135.stdout:1/687: creat da/d14/d5c/d83/ff7 x:0 0 0 2024-05-09T00:07:36.897 INFO:tasks.workunit.client.0.smithi026.stdout:8/95: link de/f14 de/f1e 0 2024-05-09T00:07:36.898 INFO:tasks.workunit.client.0.smithi026.stdout:7/111: write f5 [681799,5691] 0 2024-05-09T00:07:36.898 INFO:tasks.workunit.client.0.smithi026.stdout:7/112: stat f6 0 2024-05-09T00:07:36.898 INFO:tasks.workunit.client.1.smithi135.stdout:9/593: truncate d1/d24/f47 1633510 0 2024-05-09T00:07:36.900 INFO:tasks.workunit.client.0.smithi026.stdout:5/93: stat d2/ce 0 2024-05-09T00:07:36.903 INFO:tasks.workunit.client.0.smithi026.stdout:0/180: truncate f11 976127 0 2024-05-09T00:07:36.905 INFO:tasks.workunit.client.0.smithi026.stdout:1/91: creat d5/d16/f1b x:0 0 0 2024-05-09T00:07:36.906 INFO:tasks.workunit.client.0.smithi026.stdout:5/94: dread d2/f3 [0,4194304] 0 2024-05-09T00:07:36.906 INFO:tasks.workunit.client.1.smithi135.stdout:1/688: dread da/db/d16/f6c [0,4194304] 0 2024-05-09T00:07:36.906 INFO:tasks.workunit.client.1.smithi135.stdout:5/750: symlink db/d24/db0/dcd/le8 0 2024-05-09T00:07:36.909 INFO:tasks.workunit.client.0.smithi026.stdout:6/81: unlink d15/l17 0 2024-05-09T00:07:36.911 INFO:tasks.workunit.client.1.smithi135.stdout:6/721: creat d2/da/df0/ffa x:0 0 0 2024-05-09T00:07:36.912 INFO:tasks.workunit.client.1.smithi135.stdout:2/712: sync 2024-05-09T00:07:36.914 INFO:tasks.workunit.client.1.smithi135.stdout:3/734: rename d8/d13/d51 to d8/d102 0 2024-05-09T00:07:36.916 INFO:tasks.workunit.client.1.smithi135.stdout:0/727: mkdir d3/d9e/dd0 0 2024-05-09T00:07:36.918 INFO:tasks.workunit.client.0.smithi026.stdout:8/96: dwrite f3 [0,4194304] 0 2024-05-09T00:07:36.918 INFO:tasks.workunit.client.0.smithi026.stdout:8/97: fdatasync de/f13 0 2024-05-09T00:07:36.918 INFO:tasks.workunit.client.0.smithi026.stdout:6/82: dread fa [0,4194304] 0 2024-05-09T00:07:36.919 INFO:tasks.workunit.client.1.smithi135.stdout:9/594: creat d1/d24/d44/d54/d66/d6e/fbc x:0 0 0 2024-05-09T00:07:36.920 INFO:tasks.workunit.client.0.smithi026.stdout:0/181: mkdir d1d/d33 0 2024-05-09T00:07:36.922 INFO:tasks.workunit.client.0.smithi026.stdout:1/92: creat d5/f1c x:0 0 0 2024-05-09T00:07:36.925 INFO:tasks.workunit.client.1.smithi135.stdout:5/751: rename db/d5d/dac/f85 to db/d84/d62/d73/dbe/fe9 0 2024-05-09T00:07:36.926 INFO:tasks.workunit.client.0.smithi026.stdout:5/95: rename d2/l15 to d2/d8/df/l1e 0 2024-05-09T00:07:36.926 INFO:tasks.workunit.client.0.smithi026.stdout:5/96: readlink d2/l16 0 2024-05-09T00:07:36.927 INFO:tasks.workunit.client.0.smithi026.stdout:5/97: chown d2/d8/c13 0 1 2024-05-09T00:07:36.929 INFO:tasks.workunit.client.1.smithi135.stdout:3/735: creat d8/f103 x:0 0 0 2024-05-09T00:07:36.929 INFO:tasks.workunit.client.1.smithi135.stdout:3/736: chown d8/d6d/la5 1916 1 2024-05-09T00:07:36.930 INFO:tasks.workunit.client.0.smithi026.stdout:9/109: mkdir d7/d26 0 2024-05-09T00:07:36.930 INFO:tasks.workunit.client.0.smithi026.stdout:9/110: dread - d7/f1b zero size 2024-05-09T00:07:36.930 INFO:tasks.workunit.client.0.smithi026.stdout:9/111: readlink d7/l1c 0 2024-05-09T00:07:36.931 INFO:tasks.workunit.client.1.smithi135.stdout:0/728: mknod d3/dd/d3f/cd1 0 2024-05-09T00:07:36.931 INFO:tasks.workunit.client.1.smithi135.stdout:2/713: dread d1/d12/d20/f51 [0,4194304] 0 2024-05-09T00:07:36.934 INFO:tasks.workunit.client.1.smithi135.stdout:9/595: creat d1/d24/d44/fbd x:0 0 0 2024-05-09T00:07:36.937 INFO:tasks.workunit.client.0.smithi026.stdout:7/113: dwrite f5 [0,4194304] 0 2024-05-09T00:07:36.937 INFO:tasks.workunit.client.0.smithi026.stdout:7/114: dread - d8/fc zero size 2024-05-09T00:07:36.940 INFO:tasks.workunit.client.0.smithi026.stdout:8/98: rmdir de/d17/d1d 0 2024-05-09T00:07:36.940 INFO:tasks.workunit.client.0.smithi026.stdout:8/99: write de/d17/f1a [580620,67887] 0 2024-05-09T00:07:36.940 INFO:tasks.workunit.client.0.smithi026.stdout:8/100: chown l8 6666 1 2024-05-09T00:07:36.941 INFO:tasks.workunit.client.1.smithi135.stdout:5/752: getdents db/d84/d62/d73/d9c 0 2024-05-09T00:07:36.941 INFO:tasks.workunit.client.1.smithi135.stdout:5/753: fsync db/d5d/dac/ddc/fda 0 2024-05-09T00:07:36.943 INFO:tasks.workunit.client.0.smithi026.stdout:6/83: creat d15/f18 x:0 0 0 2024-05-09T00:07:36.944 INFO:tasks.workunit.client.1.smithi135.stdout:5/754: write db/d3f/f57 [2259481,64519] 0 2024-05-09T00:07:36.945 INFO:tasks.workunit.client.0.smithi026.stdout:6/84: write f4 [310097,56632] 0 2024-05-09T00:07:36.945 INFO:tasks.workunit.client.1.smithi135.stdout:3/737: creat d8/d6d/d44/d4b/da0/f104 x:0 0 0 2024-05-09T00:07:36.947 INFO:tasks.workunit.client.0.smithi026.stdout:0/182: symlink d1d/d25/l34 0 2024-05-09T00:07:36.948 INFO:tasks.workunit.client.0.smithi026.stdout:6/85: write fa [112417,128581] 0 2024-05-09T00:07:36.948 INFO:tasks.workunit.client.1.smithi135.stdout:0/729: link d3/dd/d3f/d58/lbc d3/dd/d3f/d43/ld2 0 2024-05-09T00:07:36.949 INFO:tasks.workunit.client.1.smithi135.stdout:3/738: dread d8/d6d/fa1 [0,4194304] 0 2024-05-09T00:07:36.949 INFO:tasks.workunit.client.1.smithi135.stdout:6/722: dwrite d2/da/d26/d57/f6c [4194304,4194304] 0 2024-05-09T00:07:36.949 INFO:tasks.workunit.client.0.smithi026.stdout:1/93: mkdir d5/db/d1d 0 2024-05-09T00:07:36.950 INFO:tasks.workunit.client.0.smithi026.stdout:3/79: dwrite f0 [0,4194304] 0 2024-05-09T00:07:36.950 INFO:tasks.workunit.client.0.smithi026.stdout:3/80: fsync d5/d9/dc/f18 0 2024-05-09T00:07:36.952 INFO:tasks.workunit.client.1.smithi135.stdout:2/714: rename d1/d22/f28 to d1/d12/d27/ff3 0 2024-05-09T00:07:36.953 INFO:tasks.workunit.client.1.smithi135.stdout:7/800: sync 2024-05-09T00:07:36.953 INFO:tasks.workunit.client.1.smithi135.stdout:4/584: sync 2024-05-09T00:07:36.953 INFO:tasks.workunit.client.1.smithi135.stdout:7/801: stat db/dd/d33/d58 0 2024-05-09T00:07:36.953 INFO:tasks.workunit.client.1.smithi135.stdout:4/585: stat dc/d4a/d69/d55/d5f/f20 0 2024-05-09T00:07:36.953 INFO:tasks.workunit.client.1.smithi135.stdout:4/586: getdents dc/d26/d31/db8 0 2024-05-09T00:07:36.953 INFO:tasks.workunit.client.0.smithi026.stdout:5/98: creat d2/d8/df/f1f x:0 0 0 2024-05-09T00:07:36.953 INFO:tasks.workunit.client.0.smithi026.stdout:5/99: write d2/d8/df/f1f [126007,101980] 0 2024-05-09T00:07:36.955 INFO:tasks.workunit.client.1.smithi135.stdout:9/596: symlink d1/d1a/d89/d99/lbe 0 2024-05-09T00:07:36.956 INFO:tasks.workunit.client.0.smithi026.stdout:0/183: dread fa [0,4194304] 0 2024-05-09T00:07:36.957 INFO:tasks.workunit.client.0.smithi026.stdout:9/112: write d7/f16 [1469745,98625] 0 2024-05-09T00:07:36.962 INFO:tasks.workunit.client.1.smithi135.stdout:5/755: creat db/d24/d32/d5b/fea x:0 0 0 2024-05-09T00:07:36.962 INFO:tasks.workunit.client.1.smithi135.stdout:5/756: write db/d84/faf [1157293,73480] 0 2024-05-09T00:07:36.962 INFO:tasks.workunit.client.1.smithi135.stdout:5/757: stat db/f7f 0 2024-05-09T00:07:36.965 INFO:tasks.workunit.client.0.smithi026.stdout:7/115: rename d8/d12/l14 to d8/d12/l24 0 2024-05-09T00:07:36.967 INFO:tasks.workunit.client.1.smithi135.stdout:6/723: creat d2/da/d1d/d69/d89/ffb x:0 0 0 2024-05-09T00:07:36.970 INFO:tasks.workunit.client.1.smithi135.stdout:3/739: dwrite d8/d13/d75/fac [0,4194304] 0 2024-05-09T00:07:36.972 INFO:tasks.workunit.client.1.smithi135.stdout:7/802: mknod db/d5b/d101/c108 0 2024-05-09T00:07:36.973 INFO:tasks.workunit.client.1.smithi135.stdout:7/803: write db/da8/f86 [2429493,126358] 0 2024-05-09T00:07:36.973 INFO:tasks.workunit.client.1.smithi135.stdout:7/804: fdatasync db/dd/d33/da5/fc6 0 2024-05-09T00:07:36.974 INFO:tasks.workunit.client.1.smithi135.stdout:9/597: mknod d1/d1a/d89/d99/cbf 0 2024-05-09T00:07:36.979 INFO:tasks.workunit.client.1.smithi135.stdout:6/724: mkdir d2/da/d1d/d69/dfc 0 2024-05-09T00:07:36.980 INFO:tasks.workunit.client.1.smithi135.stdout:4/587: dwrite dc/d26/d4e/f6e [0,4194304] 0 2024-05-09T00:07:36.981 INFO:tasks.workunit.client.1.smithi135.stdout:3/740: creat d8/d102/d63/f105 x:0 0 0 2024-05-09T00:07:36.985 INFO:tasks.workunit.client.1.smithi135.stdout:7/805: mkdir db/d1e/d109 0 2024-05-09T00:07:36.985 INFO:tasks.workunit.client.1.smithi135.stdout:7/806: truncate db/d1e/d3a/d40/d7e/fe0 760056 0 2024-05-09T00:07:36.985 INFO:tasks.workunit.client.1.smithi135.stdout:7/807: truncate db/d1e/d3a/d40/d4c/d67/fa0 1527249 0 2024-05-09T00:07:36.985 INFO:tasks.workunit.client.1.smithi135.stdout:2/715: dwrite d1/d12/da3/fd8 [0,4194304] 0 2024-05-09T00:07:36.985 INFO:tasks.workunit.client.1.smithi135.stdout:2/716: chown d1/d12/da3 391406241 1 2024-05-09T00:07:36.991 INFO:tasks.workunit.client.1.smithi135.stdout:4/588: rename dc/d26/d4e/fc3 to dc/d26/d93/fc8 0 2024-05-09T00:07:36.992 INFO:tasks.workunit.client.0.smithi026.stdout:1/94: creat d5/db/f1e x:0 0 0 2024-05-09T00:07:36.993 INFO:tasks.workunit.client.1.smithi135.stdout:9/598: dwrite d1/d1a/d10/d3c/d5c/fae [0,4194304] 0 2024-05-09T00:07:36.995 INFO:tasks.workunit.client.1.smithi135.stdout:5/758: dwrite db/d84/d31/d5e/f55 [0,4194304] 0 2024-05-09T00:07:36.995 INFO:tasks.workunit.client.1.smithi135.stdout:3/741: unlink d8/d13/d1f/fa4 0 2024-05-09T00:07:37.001 INFO:tasks.workunit.client.0.smithi026.stdout:3/81: unlink l1 0 2024-05-09T00:07:37.003 INFO:tasks.workunit.client.1.smithi135.stdout:2/717: creat d1/d12/d21/d57/ff4 x:0 0 0 2024-05-09T00:07:37.005 INFO:tasks.workunit.client.0.smithi026.stdout:5/100: mknod d2/d8/df/c20 0 2024-05-09T00:07:37.005 INFO:tasks.workunit.client.0.smithi026.stdout:5/101: fdatasync d2/d8/df/f17 0 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/599: dread d1/d1a/d10/d3c/d5c/fae [0,4194304] 0 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/600: dread - d1/d1a/d10/d3c/d5c/fab zero size 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/601: chown d1/d1a/d10/d3c 25 1 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/602: chown d1/d24/d44/daf 556749 1 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/603: write d1/d1a/d2c/d20/f98 [1325009,49001] 0 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/604: write d1/d24/d44/fbd [261049,125491] 0 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/605: readlink d1/d1a/d89/la3 0 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.1.smithi135.stdout:6/725: symlink d2/da/d26/d57/d59/lfd 0 2024-05-09T00:07:37.007 INFO:tasks.workunit.client.0.smithi026.stdout:9/113: readlink d7/la 0 2024-05-09T00:07:37.010 INFO:tasks.workunit.client.0.smithi026.stdout:1/95: dwrite d5/d16/f1b [0,4194304] 0 2024-05-09T00:07:37.011 INFO:tasks.workunit.client.0.smithi026.stdout:7/116: creat d8/d12/f25 x:0 0 0 2024-05-09T00:07:37.011 INFO:tasks.workunit.client.0.smithi026.stdout:7/117: write d8/d15/f1c [956953,18240] 0 2024-05-09T00:07:37.011 INFO:tasks.workunit.client.0.smithi026.stdout:7/118: read d8/f1f [4101313,32817] 0 2024-05-09T00:07:37.012 INFO:tasks.workunit.client.1.smithi135.stdout:4/589: mkdir dc/d4a/d69/d55/dc9 0 2024-05-09T00:07:37.012 INFO:tasks.workunit.client.1.smithi135.stdout:4/590: dread - dc/d4a/d69/d55/d5f/faf zero size 2024-05-09T00:07:37.012 INFO:tasks.workunit.client.1.smithi135.stdout:4/591: write dc/dd/f14 [1356316,117968] 0 2024-05-09T00:07:37.012 INFO:tasks.workunit.client.1.smithi135.stdout:4/592: dread - dc/d4a/d69/f7b zero size 2024-05-09T00:07:37.013 INFO:tasks.workunit.client.0.smithi026.stdout:6/86: rename lc to d15/l19 0 2024-05-09T00:07:37.013 INFO:tasks.workunit.client.1.smithi135.stdout:5/759: dwrite db/d84/d62/d73/f83 [4194304,4194304] 0 2024-05-09T00:07:37.014 INFO:tasks.workunit.client.1.smithi135.stdout:5/760: truncate db/d24/d32/fce 740271 0 2024-05-09T00:07:37.019 INFO:tasks.workunit.client.0.smithi026.stdout:3/82: mkdir d5/d9/d1a 0 2024-05-09T00:07:37.019 INFO:tasks.workunit.client.0.smithi026.stdout:3/83: chown d5/d9/dc/l19 19052 1 2024-05-09T00:07:37.019 INFO:tasks.workunit.client.0.smithi026.stdout:3/84: chown d5/le 941830 1 2024-05-09T00:07:37.019 INFO:tasks.workunit.client.0.smithi026.stdout:3/85: dread - d5/d9/ff zero size 2024-05-09T00:07:37.020 INFO:tasks.workunit.client.0.smithi026.stdout:5/102: mknod d2/d8/df/c21 0 2024-05-09T00:07:37.022 INFO:tasks.workunit.client.1.smithi135.stdout:7/808: rename db/d1e to db/dd/d33/d68/d10a 0 2024-05-09T00:07:37.024 INFO:tasks.workunit.client.0.smithi026.stdout:9/114: creat d7/d26/f27 x:0 0 0 2024-05-09T00:07:37.025 INFO:tasks.workunit.client.0.smithi026.stdout:9/115: fsync d7/f1d 0 2024-05-09T00:07:37.025 INFO:tasks.workunit.client.1.smithi135.stdout:3/742: rmdir d8/d6d/d44/d4b/da0/daa/d88 39 2024-05-09T00:07:37.029 INFO:tasks.workunit.client.1.smithi135.stdout:2/718: creat d1/d22/ff5 x:0 0 0 2024-05-09T00:07:37.031 INFO:tasks.workunit.client.1.smithi135.stdout:9/606: mknod d1/d1a/d89/cc0 0 2024-05-09T00:07:37.033 INFO:tasks.workunit.client.0.smithi026.stdout:1/96: mkdir d5/dd/d1f 0 2024-05-09T00:07:37.034 INFO:tasks.workunit.client.0.smithi026.stdout:5/103: dwrite d2/d8/df/f18 [0,4194304] 0 2024-05-09T00:07:37.035 INFO:tasks.workunit.client.1.smithi135.stdout:6/726: symlink d2/da/d49/da6/dd9/lfe 0 2024-05-09T00:07:37.036 INFO:tasks.workunit.client.0.smithi026.stdout:5/104: dread d2/d8/f10 [0,4194304] 0 2024-05-09T00:07:37.036 INFO:tasks.workunit.client.0.smithi026.stdout:5/105: fdatasync d2/d8/df/f1f 0 2024-05-09T00:07:37.036 INFO:tasks.workunit.client.0.smithi026.stdout:5/106: chown d2/l7 2200604 1 2024-05-09T00:07:37.037 INFO:tasks.workunit.client.1.smithi135.stdout:9/607: write d1/d24/d44/d54/f55 [2591964,11178] 0 2024-05-09T00:07:37.037 INFO:tasks.workunit.client.1.smithi135.stdout:9/608: stat d1/d1a/f29 0 2024-05-09T00:07:37.037 INFO:tasks.workunit.client.1.smithi135.stdout:9/609: fsync d1/d1a/d10/d3c/f4b 0 2024-05-09T00:07:37.037 INFO:tasks.workunit.client.1.smithi135.stdout:4/593: truncate dc/d26/d31/d82/f89 1620764 0 2024-05-09T00:07:37.039 INFO:tasks.workunit.client.0.smithi026.stdout:0/184: rename d1d/d1e/d20/c2a to d1d/d33/c35 0 2024-05-09T00:07:37.039 INFO:tasks.workunit.client.1.smithi135.stdout:4/594: fdatasync dc/dd/f14 0 2024-05-09T00:07:37.042 INFO:tasks.workunit.client.0.smithi026.stdout:6/87: mknod d15/c1a 0 2024-05-09T00:07:37.043 INFO:tasks.workunit.client.0.smithi026.stdout:7/119: fsync d8/d12/f25 0 2024-05-09T00:07:37.043 INFO:tasks.workunit.client.0.smithi026.stdout:7/120: truncate d8/d12/f25 385272 0 2024-05-09T00:07:37.045 INFO:tasks.workunit.client.0.smithi026.stdout:3/86: creat d5/d9/dc/f1b x:0 0 0 2024-05-09T00:07:37.046 INFO:tasks.workunit.client.1.smithi135.stdout:6/727: dread d2/d20/d37/d4e/d9d/fb8 [0,4194304] 0 2024-05-09T00:07:37.048 INFO:tasks.workunit.client.1.smithi135.stdout:6/728: write d2/da/d26/d57/d59/fe7 [663864,44503] 0 2024-05-09T00:07:37.048 INFO:tasks.workunit.client.1.smithi135.stdout:6/729: chown f1 1771608847 1 2024-05-09T00:07:37.050 INFO:tasks.workunit.client.0.smithi026.stdout:1/97: dwrite f4 [4194304,4194304] 0 2024-05-09T00:07:37.051 INFO:tasks.workunit.client.1.smithi135.stdout:5/761: mkdir db/d5d/deb 0 2024-05-09T00:07:37.051 INFO:tasks.workunit.client.1.smithi135.stdout:5/762: dread - db/d3f/fb3 zero size 2024-05-09T00:07:37.055 INFO:tasks.workunit.client.1.smithi135.stdout:7/809: rename db/d21/d98/cbc to db/da8/c10b 0 2024-05-09T00:07:37.058 INFO:tasks.workunit.client.0.smithi026.stdout:5/107: rename d2/d8/df/c1b to d2/c22 0 2024-05-09T00:07:37.058 INFO:tasks.workunit.client.0.smithi026.stdout:5/108: write d2/fc [25578,41343] 0 2024-05-09T00:07:37.058 INFO:tasks.workunit.client.0.smithi026.stdout:5/109: write d2/fc [764230,58860] 0 2024-05-09T00:07:37.060 INFO:tasks.workunit.client.1.smithi135.stdout:3/743: mkdir d8/d6d/d24/d106 0 2024-05-09T00:07:37.063 INFO:tasks.workunit.client.0.smithi026.stdout:7/121: dwrite d8/d12/f25 [0,4194304] 0 2024-05-09T00:07:37.064 INFO:tasks.workunit.client.1.smithi135.stdout:2/719: mknod d1/d12/d20/d3b/d4f/cf6 0 2024-05-09T00:07:37.065 INFO:tasks.workunit.client.1.smithi135.stdout:8/720: sync 2024-05-09T00:07:37.065 INFO:tasks.workunit.client.1.smithi135.stdout:1/689: sync 2024-05-09T00:07:37.066 INFO:tasks.workunit.client.0.smithi026.stdout:9/116: rmdir d7/d26 39 2024-05-09T00:07:37.069 INFO:tasks.workunit.client.1.smithi135.stdout:9/610: symlink d1/d1a/d10/d3c/d5c/lc1 0 2024-05-09T00:07:37.069 INFO:tasks.workunit.client.0.smithi026.stdout:1/98: dwrite d5/f7 [4194304,4194304] 0 2024-05-09T00:07:37.069 INFO:tasks.workunit.client.0.smithi026.stdout:1/99: readlink d5/dd/l1a 0 2024-05-09T00:07:37.070 INFO:tasks.workunit.client.1.smithi135.stdout:4/595: symlink dc/d26/d93/lca 0 2024-05-09T00:07:37.072 INFO:tasks.workunit.client.1.smithi135.stdout:6/730: truncate d2/d1a/d7a/f8a 3587651 0 2024-05-09T00:07:37.072 INFO:tasks.workunit.client.1.smithi135.stdout:6/731: chown d2/d20/d37/d4e/d7c 52 1 2024-05-09T00:07:37.074 INFO:tasks.workunit.client.0.smithi026.stdout:0/185: rename f12 to d1d/d33/f36 0 2024-05-09T00:07:37.074 INFO:tasks.workunit.client.0.smithi026.stdout:0/186: write fa [1939794,8755] 0 2024-05-09T00:07:37.076 INFO:tasks.workunit.client.1.smithi135.stdout:5/763: symlink db/d84/d62/d73/d9c/d9f/dc0/lec 0 2024-05-09T00:07:37.076 INFO:tasks.workunit.client.1.smithi135.stdout:5/764: chown l7 7475 1 2024-05-09T00:07:37.078 INFO:tasks.workunit.client.1.smithi135.stdout:7/810: truncate db/dd/d33/f9e 651274 0 2024-05-09T00:07:37.078 INFO:tasks.workunit.client.1.smithi135.stdout:7/811: write db/dd/d33/d68/d10a/d3a/d40/d4c/f8e [448131,82251] 0 2024-05-09T00:07:37.081 INFO:tasks.workunit.client.1.smithi135.stdout:3/744: getdents d8/d13/d75/d58 0 2024-05-09T00:07:37.081 INFO:tasks.workunit.client.1.smithi135.stdout:3/745: getdents d8/d6d/d24/d106 0 2024-05-09T00:07:37.081 INFO:tasks.workunit.client.1.smithi135.stdout:3/746: fsync d8/d13/d75/d58/f8a 0 2024-05-09T00:07:37.081 INFO:tasks.workunit.client.1.smithi135.stdout:3/747: write d8/d13/d75/fec [707142,42112] 0 2024-05-09T00:07:37.081 INFO:tasks.workunit.client.1.smithi135.stdout:3/748: fdatasync d8/d102/d63/d89/ff2 0 2024-05-09T00:07:37.082 INFO:tasks.workunit.client.1.smithi135.stdout:5/765: dread db/d84/f43 [0,4194304] 0 2024-05-09T00:07:37.083 INFO:tasks.workunit.client.1.smithi135.stdout:1/690: creat da/d14/d5c/d83/ff8 x:0 0 0 2024-05-09T00:07:37.083 INFO:tasks.workunit.client.1.smithi135.stdout:1/691: chown da/f62 12 1 2024-05-09T00:07:37.086 INFO:tasks.workunit.client.0.smithi026.stdout:7/122: rename d8/l19 to d8/l26 0 2024-05-09T00:07:37.086 INFO:tasks.workunit.client.0.smithi026.stdout:7/123: write f7 [551440,47976] 0 2024-05-09T00:07:37.087 INFO:tasks.workunit.client.1.smithi135.stdout:8/721: creat d4/d7/ff4 x:0 0 0 2024-05-09T00:07:37.087 INFO:tasks.workunit.client.1.smithi135.stdout:7/812: dread db/d21/dd0/fd8 [0,4194304] 0 2024-05-09T00:07:37.088 INFO:tasks.workunit.client.0.smithi026.stdout:3/87: creat d5/d9/d1a/f1c x:0 0 0 2024-05-09T00:07:37.088 INFO:tasks.workunit.client.0.smithi026.stdout:3/88: write d5/d9/dc/f1b [635054,94729] 0 2024-05-09T00:07:37.089 INFO:tasks.workunit.client.0.smithi026.stdout:3/89: write f0 [1683475,121849] 0 2024-05-09T00:07:37.089 INFO:tasks.workunit.client.1.smithi135.stdout:4/596: symlink dc/d4a/d69/d55/d5f/d5a/d9e/lcb 0 2024-05-09T00:07:37.090 INFO:tasks.workunit.client.0.smithi026.stdout:9/117: creat d7/f28 x:0 0 0 2024-05-09T00:07:37.091 INFO:tasks.workunit.client.1.smithi135.stdout:0/730: sync 2024-05-09T00:07:37.091 INFO:tasks.workunit.client.1.smithi135.stdout:6/732: rmdir d2/d1a 39 2024-05-09T00:07:37.091 INFO:tasks.workunit.client.1.smithi135.stdout:2/720: dwrite d1/d22/d63/f93 [0,4194304] 0 2024-05-09T00:07:37.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/721: read d1/d12/d20/d3b/d40/f5e [216695,118310] 0 2024-05-09T00:07:37.094 INFO:tasks.workunit.client.1.smithi135.stdout:3/749: creat d8/d6d/d44/d4b/da0/f107 x:0 0 0 2024-05-09T00:07:37.095 INFO:tasks.workunit.client.0.smithi026.stdout:1/100: getdents d5 0 2024-05-09T00:07:37.098 INFO:tasks.workunit.client.1.smithi135.stdout:9/611: dwrite d1/d1a/d10/d3c/f4b [0,4194304] 0 2024-05-09T00:07:37.098 INFO:tasks.workunit.client.1.smithi135.stdout:9/612: stat d1/d24/d44/d54/c76 0 2024-05-09T00:07:37.098 INFO:tasks.workunit.client.1.smithi135.stdout:9/613: chown d1/d24/d86/f96 0 1 2024-05-09T00:07:37.099 INFO:tasks.workunit.client.1.smithi135.stdout:1/692: creat da/d24/ff9 x:0 0 0 2024-05-09T00:07:37.099 INFO:tasks.workunit.client.0.smithi026.stdout:0/187: symlink d1d/d25/l37 0 2024-05-09T00:07:37.100 INFO:tasks.workunit.client.0.smithi026.stdout:0/188: write f10 [2726275,126275] 0 2024-05-09T00:07:37.101 INFO:tasks.workunit.client.1.smithi135.stdout:8/722: creat d4/dc6/ff5 x:0 0 0 2024-05-09T00:07:37.101 INFO:tasks.workunit.client.1.smithi135.stdout:8/723: readlink d4/l5f 0 2024-05-09T00:07:37.101 INFO:tasks.workunit.client.1.smithi135.stdout:8/724: fdatasync d4/d7/d2a/fb5 0 2024-05-09T00:07:37.102 INFO:tasks.workunit.client.1.smithi135.stdout:7/813: creat db/dd/d33/d68/d10a/d3a/d40/d4c/f10c x:0 0 0 2024-05-09T00:07:37.103 INFO:tasks.workunit.client.0.smithi026.stdout:3/90: symlink d5/d9/d13/l1d 0 2024-05-09T00:07:37.105 INFO:tasks.workunit.client.1.smithi135.stdout:4/597: symlink dc/d26/d31/db8/lcc 0 2024-05-09T00:07:37.105 INFO:tasks.workunit.client.1.smithi135.stdout:4/598: truncate dc/d4a/d69/f70 681196 0 2024-05-09T00:07:37.105 INFO:tasks.workunit.client.1.smithi135.stdout:4/599: chown dc/d4a/d69/d55/d5f/f83 47 1 2024-05-09T00:07:37.105 INFO:tasks.workunit.client.1.smithi135.stdout:4/600: stat dc/d4a/d69/f7b 0 2024-05-09T00:07:37.106 INFO:tasks.workunit.client.0.smithi026.stdout:9/118: mkdir d7/d23/d29 0 2024-05-09T00:07:37.108 INFO:tasks.workunit.client.1.smithi135.stdout:6/733: mknod d2/da/cff 0 2024-05-09T00:07:37.108 INFO:tasks.workunit.client.1.smithi135.stdout:6/734: fdatasync d2/d1a/f1b 0 2024-05-09T00:07:37.109 INFO:tasks.workunit.client.0.smithi026.stdout:7/124: dread f6 [0,4194304] 0 2024-05-09T00:07:37.109 INFO:tasks.workunit.client.0.smithi026.stdout:7/125: getdents d8/d12/d22 0 2024-05-09T00:07:37.111 INFO:tasks.workunit.client.0.smithi026.stdout:0/189: rename fb to d1d/d33/f38 0 2024-05-09T00:07:37.114 INFO:tasks.workunit.client.1.smithi135.stdout:0/731: dwrite d3/dd/d2d/f96 [0,4194304] 0 2024-05-09T00:07:37.115 INFO:tasks.workunit.client.0.smithi026.stdout:7/126: symlink d8/d1b/l27 0 2024-05-09T00:07:37.117 INFO:tasks.workunit.client.0.smithi026.stdout:0/190: creat d1d/d1e/d20/f39 x:0 0 0 2024-05-09T00:07:37.118 INFO:tasks.workunit.client.1.smithi135.stdout:3/750: mkdir d8/d6d/d108 0 2024-05-09T00:07:37.120 INFO:tasks.workunit.client.0.smithi026.stdout:9/119: mknod d7/c2a 0 2024-05-09T00:07:37.121 INFO:tasks.workunit.client.0.smithi026.stdout:9/120: fsync f2 0 2024-05-09T00:07:37.122 INFO:tasks.workunit.client.1.smithi135.stdout:2/722: dwrite d1/d12/d20/d2b/d7c/db5/f82 [0,4194304] 0 2024-05-09T00:07:37.122 INFO:tasks.workunit.client.0.smithi026.stdout:7/127: truncate d8/f10 2326436 0 2024-05-09T00:07:37.123 INFO:tasks.workunit.client.0.smithi026.stdout:1/101: dwrite d5/d16/f18 [0,4194304] 0 2024-05-09T00:07:37.124 INFO:tasks.workunit.client.0.smithi026.stdout:0/191: truncate f4 8132829 0 2024-05-09T00:07:37.128 INFO:tasks.workunit.client.0.smithi026.stdout:3/91: rename d5/d9/d1a to d5/d1e 0 2024-05-09T00:07:37.128 INFO:tasks.workunit.client.0.smithi026.stdout:3/92: readlink d5/d9/dc/l19 0 2024-05-09T00:07:37.130 INFO:tasks.workunit.client.0.smithi026.stdout:1/102: dread d5/dd/fe [0,4194304] 0 2024-05-09T00:07:37.132 INFO:tasks.workunit.client.0.smithi026.stdout:9/121: creat d7/f2b x:0 0 0 2024-05-09T00:07:37.132 INFO:tasks.workunit.client.0.smithi026.stdout:9/122: fsync d7/d26/f27 0 2024-05-09T00:07:37.134 INFO:tasks.workunit.client.0.smithi026.stdout:7/128: dread d8/d12/f25 [0,4194304] 0 2024-05-09T00:07:37.135 INFO:tasks.workunit.client.1.smithi135.stdout:1/693: mkdir da/d24/d27/d33/d36/dfa 0 2024-05-09T00:07:37.138 INFO:tasks.workunit.client.1.smithi135.stdout:7/814: mkdir db/dd/d33/d58/d10d 0 2024-05-09T00:07:37.138 INFO:tasks.workunit.client.1.smithi135.stdout:7/815: chown db/l92 10963 1 2024-05-09T00:07:37.138 INFO:tasks.workunit.client.1.smithi135.stdout:7/816: chown db/dd/d33/d68/d10a/d3a/d40/d7e 979594025 1 2024-05-09T00:07:37.138 INFO:tasks.workunit.client.1.smithi135.stdout:7/817: fsync db/dd/d33/d68/d10a/d3a/d40/d84/f85 0 2024-05-09T00:07:37.138 INFO:tasks.workunit.client.1.smithi135.stdout:7/818: chown db/dd/d33/d68/d10a 414 1 2024-05-09T00:07:37.138 INFO:tasks.workunit.client.1.smithi135.stdout:7/819: chown db/l92 17 1 2024-05-09T00:07:37.138 INFO:tasks.workunit.client.0.smithi026.stdout:0/192: creat d1d/d33/f3a x:0 0 0 2024-05-09T00:07:37.139 INFO:tasks.workunit.client.1.smithi135.stdout:4/601: creat dc/d26/d31/d82/fcd x:0 0 0 2024-05-09T00:07:37.141 INFO:tasks.workunit.client.0.smithi026.stdout:3/93: getdents d5/d9/d13 0 2024-05-09T00:07:37.143 INFO:tasks.workunit.client.0.smithi026.stdout:1/103: unlink d5/c9 0 2024-05-09T00:07:37.146 INFO:tasks.workunit.client.0.smithi026.stdout:7/129: mknod d8/d12/c28 0 2024-05-09T00:07:37.148 INFO:tasks.workunit.client.1.smithi135.stdout:0/732: mkdir d3/dd/d3f/d58/dae/dd3 0 2024-05-09T00:07:37.151 INFO:tasks.workunit.client.1.smithi135.stdout:3/751: unlink d8/d13/d75/l6e 0 2024-05-09T00:07:37.151 INFO:tasks.workunit.client.1.smithi135.stdout:3/752: chown d8/d6d/d44/d4b/da0/daa 3 1 2024-05-09T00:07:37.152 INFO:tasks.workunit.client.0.smithi026.stdout:0/193: fsync f4 0 2024-05-09T00:07:37.154 INFO:tasks.workunit.client.0.smithi026.stdout:1/104: mknod d5/db/d1d/c20 0 2024-05-09T00:07:37.157 INFO:tasks.workunit.client.0.smithi026.stdout:3/94: dread d5/f12 [0,4194304] 0 2024-05-09T00:07:37.158 INFO:tasks.workunit.client.1.smithi135.stdout:2/723: fdatasync d1/d12/f24 0 2024-05-09T00:07:37.158 INFO:tasks.workunit.client.0.smithi026.stdout:1/105: chown f2 2573501 1 2024-05-09T00:07:37.161 INFO:tasks.workunit.client.0.smithi026.stdout:3/95: creat d5/f1f x:0 0 0 2024-05-09T00:07:37.163 INFO:tasks.workunit.client.1.smithi135.stdout:9/614: mknod d1/d1a/d2c/d2d/cc2 0 2024-05-09T00:07:37.166 INFO:tasks.workunit.client.1.smithi135.stdout:1/694: creat da/d14/d20/d38/d86/ffb x:0 0 0 2024-05-09T00:07:37.167 INFO:tasks.workunit.client.1.smithi135.stdout:4/602: mkdir dc/d71/d90/dce 0 2024-05-09T00:07:37.167 INFO:tasks.workunit.client.1.smithi135.stdout:4/603: dread - dc/d26/d93/d9d/fb7 zero size 2024-05-09T00:07:37.172 INFO:tasks.workunit.client.1.smithi135.stdout:6/735: rename d2/da/d26/d57/ddc/dd7/le3 to d2/d20/d3f/l100 0 2024-05-09T00:07:37.173 INFO:tasks.workunit.client.1.smithi135.stdout:2/724: symlink d1/d12/d20/d2b/d56/d72/lf7 0 2024-05-09T00:07:37.176 INFO:tasks.workunit.client.1.smithi135.stdout:3/753: symlink d8/d6d/d24/d106/l109 0 2024-05-09T00:07:37.176 INFO:tasks.workunit.client.1.smithi135.stdout:3/754: write d8/d102/fd6 [744997,91126] 0 2024-05-09T00:07:37.176 INFO:tasks.workunit.client.1.smithi135.stdout:3/755: chown d8/d13/f19 258773949 1 2024-05-09T00:07:37.176 INFO:tasks.workunit.client.1.smithi135.stdout:3/756: fdatasync d8/f42 0 2024-05-09T00:07:37.177 INFO:tasks.workunit.client.1.smithi135.stdout:4/604: creat dc/d71/d86/fcf x:0 0 0 2024-05-09T00:07:37.177 INFO:tasks.workunit.client.1.smithi135.stdout:4/605: write dc/d4a/d69/d55/d5f/f53 [572959,51913] 0 2024-05-09T00:07:37.177 INFO:tasks.workunit.client.1.smithi135.stdout:4/606: stat dc/d26/d31/db6 0 2024-05-09T00:07:37.178 INFO:tasks.workunit.client.1.smithi135.stdout:6/736: unlink d2/f25 0 2024-05-09T00:07:37.181 INFO:tasks.workunit.client.1.smithi135.stdout:1/695: mkdir da/d24/d27/d33/d52/dfc 0 2024-05-09T00:07:37.183 INFO:tasks.workunit.client.1.smithi135.stdout:6/737: unlink d2/d20/d37/lec 0 2024-05-09T00:07:37.184 INFO:tasks.workunit.client.1.smithi135.stdout:7/820: dwrite db/dd/d33/d68/d10a/d3a/d40/d4c/d67/f105 [0,4194304] 0 2024-05-09T00:07:37.185 INFO:tasks.workunit.client.1.smithi135.stdout:2/725: rename d1/l10 to d1/d12/da3/lf8 0 2024-05-09T00:07:37.186 INFO:tasks.workunit.client.0.smithi026.stdout:7/130: dwrite d8/fc [0,4194304] 0 2024-05-09T00:07:37.187 INFO:tasks.workunit.client.1.smithi135.stdout:1/696: mkdir da/d14/d20/d38/d3a/db7/de9/dfd 0 2024-05-09T00:07:37.187 INFO:tasks.workunit.client.1.smithi135.stdout:1/697: chown da/d14/d20/d38/d3a/d40/d75/cbc 92804 1 2024-05-09T00:07:37.187 INFO:tasks.workunit.client.1.smithi135.stdout:1/698: write da/d14/d20/d38/f58 [420649,66760] 0 2024-05-09T00:07:37.188 INFO:tasks.workunit.client.1.smithi135.stdout:1/699: write da/d14/d5c/f91 [197823,47878] 0 2024-05-09T00:07:37.189 INFO:tasks.workunit.client.1.smithi135.stdout:1/700: write da/d24/d27/d33/f98 [9720,88660] 0 2024-05-09T00:07:37.190 INFO:tasks.workunit.client.1.smithi135.stdout:6/738: link d2/da/d49/da6/dd9/lfe d2/da/d1d/d69/dfc/l101 0 2024-05-09T00:07:37.190 INFO:tasks.workunit.client.0.smithi026.stdout:7/131: dread d8/fb [0,4194304] 0 2024-05-09T00:07:37.192 INFO:tasks.workunit.client.1.smithi135.stdout:7/821: mkdir db/dd/d33/d10e 0 2024-05-09T00:07:37.192 INFO:tasks.workunit.client.1.smithi135.stdout:7/822: truncate db/dd/d33/d68/f9c 1356235 0 2024-05-09T00:07:37.192 INFO:tasks.workunit.client.1.smithi135.stdout:7/823: fsync db/dd/d33/d58/f8d 0 2024-05-09T00:07:37.193 INFO:tasks.workunit.client.0.smithi026.stdout:7/132: rename d8/d15 to d8/d12/d22/d29 0 2024-05-09T00:07:37.196 INFO:tasks.workunit.client.1.smithi135.stdout:3/757: rename d8/d102/d63/d89/lfc to d8/d6d/d44/d4b/da0/daa/d88/l10a 0 2024-05-09T00:07:37.196 INFO:tasks.workunit.client.1.smithi135.stdout:2/726: truncate d1/d22/d63/fed 4136485 0 2024-05-09T00:07:37.198 INFO:tasks.workunit.client.0.smithi026.stdout:7/133: mknod d8/d12/c2a 0 2024-05-09T00:07:37.198 INFO:tasks.workunit.client.0.smithi026.stdout:7/134: write d8/d12/d22/d29/f18 [158523,127090] 0 2024-05-09T00:07:37.200 INFO:tasks.workunit.client.1.smithi135.stdout:1/701: creat da/d24/d27/d33/d7d/ffe x:0 0 0 2024-05-09T00:07:37.200 INFO:tasks.workunit.client.1.smithi135.stdout:3/758: mknod d8/d6d/d44/d4b/d59/d90/d7b/d80/c10b 0 2024-05-09T00:07:37.201 INFO:tasks.workunit.client.1.smithi135.stdout:2/727: symlink d1/d12/d21/d41/d6d/d6e/lf9 0 2024-05-09T00:07:37.201 INFO:tasks.workunit.client.1.smithi135.stdout:2/728: readlink d1/l2f 0 2024-05-09T00:07:37.202 INFO:tasks.workunit.client.1.smithi135.stdout:1/702: rename da/d14/d20/d38/d86/lcf to da/d24/d27/d33/d36/dfa/lff 0 2024-05-09T00:07:37.207 INFO:tasks.workunit.client.1.smithi135.stdout:3/759: unlink d8/d6d/d44/d4b/d59/d90/d7b/d80/cde 0 2024-05-09T00:07:37.209 INFO:tasks.workunit.client.1.smithi135.stdout:1/703: rename da/d24/d27/d33/d48/l4a to da/d14/d20/d2c/l100 0 2024-05-09T00:07:37.210 INFO:tasks.workunit.client.1.smithi135.stdout:3/760: mkdir d8/d13/d1f/d62/d10c 0 2024-05-09T00:07:37.210 INFO:tasks.workunit.client.1.smithi135.stdout:3/761: read - d8/d6d/d44/d4b/d59/deb/ffa zero size 2024-05-09T00:07:37.212 INFO:tasks.workunit.client.1.smithi135.stdout:1/704: unlink da/d24/d27/d33/d52/d71/d8d/f9d 0 2024-05-09T00:07:37.212 INFO:tasks.workunit.client.1.smithi135.stdout:1/705: write da/d14/d20/fb2 [251505,8053] 0 2024-05-09T00:07:37.236 INFO:tasks.workunit.client.0.smithi026.stdout:0/194: dwrite d1d/f29 [0,4194304] 0 2024-05-09T00:07:37.238 INFO:tasks.workunit.client.0.smithi026.stdout:0/195: creat d1d/d1e/d2d/f3b x:0 0 0 2024-05-09T00:07:37.248 INFO:tasks.workunit.client.0.smithi026.stdout:1/106: dwrite d5/f7 [4194304,4194304] 0 2024-05-09T00:07:37.248 INFO:tasks.workunit.client.0.smithi026.stdout:1/107: fsync d5/d16/f18 0 2024-05-09T00:07:37.249 INFO:tasks.workunit.client.0.smithi026.stdout:1/108: write d5/d16/f19 [485831,98934] 0 2024-05-09T00:07:37.249 INFO:tasks.workunit.client.0.smithi026.stdout:1/109: chown d5/dd/d17 1562 1 2024-05-09T00:07:37.249 INFO:tasks.workunit.client.0.smithi026.stdout:1/110: truncate d5/dd/ff 1060910 0 2024-05-09T00:07:37.249 INFO:tasks.workunit.client.0.smithi026.stdout:1/111: stat d5/d16/f18 0 2024-05-09T00:07:37.249 INFO:tasks.workunit.client.0.smithi026.stdout:3/96: dwrite d5/f1f [0,4194304] 0 2024-05-09T00:07:37.249 INFO:tasks.workunit.client.0.smithi026.stdout:9/123: dwrite f2 [0,4194304] 0 2024-05-09T00:07:37.250 INFO:tasks.workunit.client.1.smithi135.stdout:9/615: dwrite d1/d1a/d2c/d2d/f3b [4194304,4194304] 0 2024-05-09T00:07:37.250 INFO:tasks.workunit.client.1.smithi135.stdout:9/616: dread - d1/d24/d44/d54/d66/d6e/fbc zero size 2024-05-09T00:07:37.250 INFO:tasks.workunit.client.1.smithi135.stdout:4/607: dwrite dc/d4a/fa4 [0,4194304] 0 2024-05-09T00:07:37.250 INFO:tasks.workunit.client.1.smithi135.stdout:1/706: dwrite da/d14/d20/f97 [0,4194304] 0 2024-05-09T00:07:37.250 INFO:tasks.workunit.client.1.smithi135.stdout:2/729: dwrite d1/d12/d20/feb [0,4194304] 0 2024-05-09T00:07:37.251 INFO:tasks.workunit.client.1.smithi135.stdout:6/739: dwrite d2/d20/d2e/fbf [0,4194304] 0 2024-05-09T00:07:37.252 INFO:tasks.workunit.client.0.smithi026.stdout:1/112: link d5/f7 d5/dd/d1f/f21 0 2024-05-09T00:07:37.252 INFO:tasks.workunit.client.1.smithi135.stdout:4/608: dread dc/d4a/d69/d39/f9b [0,4194304] 0 2024-05-09T00:07:37.252 INFO:tasks.workunit.client.1.smithi135.stdout:4/609: readlink dc/d26/d31/d82/l98 0 2024-05-09T00:07:37.253 INFO:tasks.workunit.client.1.smithi135.stdout:4/610: write dc/d71/d86/fcf [288994,46691] 0 2024-05-09T00:07:37.253 INFO:tasks.workunit.client.1.smithi135.stdout:4/611: truncate dc/d26/d31/d82/fb9 632128 0 2024-05-09T00:07:37.253 INFO:tasks.workunit.client.1.smithi135.stdout:9/617: creat d1/d1a/d10/d3c/d43/fc3 x:0 0 0 2024-05-09T00:07:37.261 INFO:tasks.workunit.client.0.smithi026.stdout:3/97: readlink d5/l15 0 2024-05-09T00:07:37.264 INFO:tasks.workunit.client.0.smithi026.stdout:3/98: read f2 [1570316,109096] 0 2024-05-09T00:07:37.266 INFO:tasks.workunit.client.0.smithi026.stdout:3/99: write f0 [1311842,10898] 0 2024-05-09T00:07:37.268 INFO:tasks.workunit.client.1.smithi135.stdout:1/707: dwrite da/f41 [0,4194304] 0 2024-05-09T00:07:37.268 INFO:tasks.workunit.client.0.smithi026.stdout:0/196: dwrite fa [0,4194304] 0 2024-05-09T00:07:37.268 INFO:tasks.workunit.client.0.smithi026.stdout:3/100: write d5/d9/dc/f18 [1359879,128521] 0 2024-05-09T00:07:37.268 INFO:tasks.workunit.client.0.smithi026.stdout:3/101: truncate d5/d9/ff 878162 0 2024-05-09T00:07:37.269 INFO:tasks.workunit.client.1.smithi135.stdout:1/708: read da/d24/d27/d33/d52/f80 [3698143,15588] 0 2024-05-09T00:07:37.272 INFO:tasks.workunit.client.0.smithi026.stdout:7/135: rmdir d8/d12/d22/d29 39 2024-05-09T00:07:37.275 INFO:tasks.workunit.client.1.smithi135.stdout:3/762: rmdir d8/d102/d63 39 2024-05-09T00:07:37.283 INFO:tasks.workunit.client.1.smithi135.stdout:6/740: unlink d2/da/d49/f64 0 2024-05-09T00:07:37.286 INFO:tasks.workunit.client.0.smithi026.stdout:9/124: mknod d7/d23/c2c 0 2024-05-09T00:07:37.286 INFO:tasks.workunit.client.0.smithi026.stdout:9/125: write d7/f19 [5199646,99204] 0 2024-05-09T00:07:37.293 INFO:tasks.workunit.client.0.smithi026.stdout:1/113: symlink d5/dd/d1f/l22 0 2024-05-09T00:07:37.295 INFO:tasks.workunit.client.0.smithi026.stdout:3/102: readlink d5/l6 0 2024-05-09T00:07:37.295 INFO:tasks.workunit.client.0.smithi026.stdout:3/103: chown d5/l15 315989630 1 2024-05-09T00:07:37.296 INFO:tasks.workunit.client.1.smithi135.stdout:1/709: dwrite da/d14/d20/d38/d3a/db7/dc6/d93/de8/fea [0,4194304] 0 2024-05-09T00:07:37.296 INFO:tasks.workunit.client.1.smithi135.stdout:1/710: write da/d24/d27/f9b [140746,35282] 0 2024-05-09T00:07:37.296 INFO:tasks.workunit.client.1.smithi135.stdout:1/711: write da/d14/d20/f7c [342916,9143] 0 2024-05-09T00:07:37.297 INFO:tasks.workunit.client.1.smithi135.stdout:4/612: mknod dc/d4a/d69/d55/cd0 0 2024-05-09T00:07:37.298 INFO:tasks.workunit.client.1.smithi135.stdout:9/618: creat d1/d1a/d89/d99/fc4 x:0 0 0 2024-05-09T00:07:37.298 INFO:tasks.workunit.client.1.smithi135.stdout:9/619: fdatasync d1/d1a/d2c/f84 0 2024-05-09T00:07:37.298 INFO:tasks.workunit.client.1.smithi135.stdout:9/620: stat d1/d1a/d10/c7b 0 2024-05-09T00:07:37.302 INFO:tasks.workunit.client.0.smithi026.stdout:9/126: symlink d7/d26/l2d 0 2024-05-09T00:07:37.305 INFO:tasks.workunit.client.1.smithi135.stdout:6/741: mknod d2/d20/d37/d4e/c102 0 2024-05-09T00:07:37.305 INFO:tasks.workunit.client.1.smithi135.stdout:6/742: write d2/d20/d37/d4e/d7c/fd6 [770737,5284] 0 2024-05-09T00:07:37.305 INFO:tasks.workunit.client.1.smithi135.stdout:6/743: chown d2/d1a/l7e 1821 1 2024-05-09T00:07:37.306 INFO:tasks.workunit.client.1.smithi135.stdout:1/712: mkdir da/d24/dd0/d101 0 2024-05-09T00:07:37.306 INFO:tasks.workunit.client.0.smithi026.stdout:1/114: dread d5/d16/f18 [0,4194304] 0 2024-05-09T00:07:37.307 INFO:tasks.workunit.client.0.smithi026.stdout:7/136: dwrite d8/fa [4194304,4194304] 0 2024-05-09T00:07:37.307 INFO:tasks.workunit.client.1.smithi135.stdout:9/621: mknod d1/d24/cc5 0 2024-05-09T00:07:37.307 INFO:tasks.workunit.client.0.smithi026.stdout:7/137: read f7 [614586,106381] 0 2024-05-09T00:07:37.307 INFO:tasks.workunit.client.0.smithi026.stdout:7/138: stat d8/le 0 2024-05-09T00:07:37.308 INFO:tasks.workunit.client.1.smithi135.stdout:6/744: truncate d2/da/d26/d57/d59/fe7 3093816 0 2024-05-09T00:07:37.311 INFO:tasks.workunit.client.1.smithi135.stdout:9/622: creat d1/fc6 x:0 0 0 2024-05-09T00:07:37.311 INFO:tasks.workunit.client.1.smithi135.stdout:6/745: mkdir d2/d20/d3f/d4f/d103 0 2024-05-09T00:07:37.312 INFO:tasks.workunit.client.1.smithi135.stdout:6/746: truncate d2/da/d49/da4/fc7 1649465 0 2024-05-09T00:07:37.313 INFO:tasks.workunit.client.1.smithi135.stdout:1/713: mknod da/d14/d20/c102 0 2024-05-09T00:07:37.313 INFO:tasks.workunit.client.1.smithi135.stdout:1/714: readlink da/db/lf0 0 2024-05-09T00:07:37.313 INFO:tasks.workunit.client.1.smithi135.stdout:1/715: getdents da/d24/d27/d33/d52/df5 0 2024-05-09T00:07:37.314 INFO:tasks.workunit.client.1.smithi135.stdout:9/623: mknod d1/d1a/d89/d99/cc7 0 2024-05-09T00:07:37.314 INFO:tasks.workunit.client.1.smithi135.stdout:9/624: write d1/d1a/f51 [4830565,32940] 0 2024-05-09T00:07:37.316 INFO:tasks.workunit.client.0.smithi026.stdout:1/115: write f3 [5558395,126692] 0 2024-05-09T00:07:37.317 INFO:tasks.workunit.client.1.smithi135.stdout:1/716: dread da/d24/d27/d33/f98 [0,4194304] 0 2024-05-09T00:07:37.317 INFO:tasks.workunit.client.0.smithi026.stdout:1/116: mknod d5/c23 0 2024-05-09T00:07:37.325 INFO:tasks.workunit.client.0.smithi026.stdout:9/127: write d7/f19 [5243266,74633] 0 2024-05-09T00:07:37.325 INFO:tasks.workunit.client.0.smithi026.stdout:9/128: chown c1 37499471 1 2024-05-09T00:07:37.332 INFO:tasks.workunit.client.1.smithi135.stdout:4/613: dwrite dc/d4a/d69/d39/f68 [0,4194304] 0 2024-05-09T00:07:37.332 INFO:tasks.workunit.client.1.smithi135.stdout:4/614: write dc/d4a/d69/d55/d5f/faf [200292,19359] 0 2024-05-09T00:07:37.333 INFO:tasks.workunit.client.1.smithi135.stdout:3/763: dwrite d8/d6d/d44/d4b/d59/d90/f94 [4194304,4194304] 0 2024-05-09T00:07:37.333 INFO:tasks.workunit.client.1.smithi135.stdout:3/764: stat d8/d102 0 2024-05-09T00:07:37.334 INFO:tasks.workunit.client.0.smithi026.stdout:7/139: dwrite d8/d12/d22/d29/f18 [0,4194304] 0 2024-05-09T00:07:37.334 INFO:tasks.workunit.client.0.smithi026.stdout:2/70: sync 2024-05-09T00:07:37.334 INFO:tasks.workunit.client.0.smithi026.stdout:4/89: sync 2024-05-09T00:07:37.335 INFO:tasks.workunit.client.1.smithi135.stdout:4/615: read dc/d4a/d69/f51 [2946498,87207] 0 2024-05-09T00:07:37.338 INFO:tasks.workunit.client.1.smithi135.stdout:0/733: sync 2024-05-09T00:07:37.339 INFO:tasks.workunit.client.1.smithi135.stdout:5/766: sync 2024-05-09T00:07:37.339 INFO:tasks.workunit.client.1.smithi135.stdout:8/725: sync 2024-05-09T00:07:37.339 INFO:tasks.workunit.client.1.smithi135.stdout:8/726: chown d4/d7/d33/d39/c91 601724 1 2024-05-09T00:07:37.339 INFO:tasks.workunit.client.0.smithi026.stdout:1/117: dread d5/f10 [0,4194304] 0 2024-05-09T00:07:37.341 INFO:tasks.workunit.client.0.smithi026.stdout:2/71: creat d14/d15/f1b x:0 0 0 2024-05-09T00:07:37.342 INFO:tasks.workunit.client.0.smithi026.stdout:2/72: chown fc 36486 1 2024-05-09T00:07:37.342 INFO:tasks.workunit.client.0.smithi026.stdout:2/73: chown fb 29 1 2024-05-09T00:07:37.342 INFO:tasks.workunit.client.0.smithi026.stdout:2/74: fdatasync f6 0 2024-05-09T00:07:37.343 INFO:tasks.workunit.client.1.smithi135.stdout:9/625: dwrite d1/d1a/d2c/d20/f9c [0,4194304] 0 2024-05-09T00:07:37.344 INFO:tasks.workunit.client.0.smithi026.stdout:4/90: mkdir d0/d12/d1b 0 2024-05-09T00:07:37.345 INFO:tasks.workunit.client.0.smithi026.stdout:7/140: dread d8/fc [0,4194304] 0 2024-05-09T00:07:37.346 INFO:tasks.workunit.client.0.smithi026.stdout:1/118: rename d5/db/f15 to d5/d16/f24 0 2024-05-09T00:07:37.346 INFO:tasks.workunit.client.0.smithi026.stdout:1/119: truncate d5/db/f1e 464057 0 2024-05-09T00:07:37.348 INFO:tasks.workunit.client.0.smithi026.stdout:2/75: link f5 d14/d15/d17/f1c 0 2024-05-09T00:07:37.348 INFO:tasks.workunit.client.0.smithi026.stdout:2/76: write f6 [394693,99457] 0 2024-05-09T00:07:37.349 INFO:tasks.workunit.client.1.smithi135.stdout:3/765: mknod d8/d6d/d108/c10d 0 2024-05-09T00:07:37.351 INFO:tasks.workunit.client.0.smithi026.stdout:4/91: unlink d0/d19/c1a 0 2024-05-09T00:07:37.351 INFO:tasks.workunit.client.0.smithi026.stdout:4/92: getdents d0/d12/d1b 0 2024-05-09T00:07:37.352 INFO:tasks.workunit.client.1.smithi135.stdout:4/616: mkdir dc/d26/d31/db8/dd1 0 2024-05-09T00:07:37.352 INFO:tasks.workunit.client.1.smithi135.stdout:4/617: chown dc/d4a/c6a 0 1 2024-05-09T00:07:37.353 INFO:tasks.workunit.client.0.smithi026.stdout:7/141: symlink d8/d12/d22/d29/l2b 0 2024-05-09T00:07:37.353 INFO:tasks.workunit.client.0.smithi026.stdout:7/142: chown d8/cd 1631309707 1 2024-05-09T00:07:37.354 INFO:tasks.workunit.client.1.smithi135.stdout:1/717: dwrite da/d14/f1a [4194304,4194304] 0 2024-05-09T00:07:37.356 INFO:tasks.workunit.client.0.smithi026.stdout:9/129: dwrite d7/f16 [0,4194304] 0 2024-05-09T00:07:37.356 INFO:tasks.workunit.client.0.smithi026.stdout:2/77: dread f5 [0,4194304] 0 2024-05-09T00:07:37.357 INFO:tasks.workunit.client.0.smithi026.stdout:4/93: link d0/c10 d0/d12/d1b/c1c 0 2024-05-09T00:07:37.360 INFO:tasks.workunit.client.0.smithi026.stdout:7/143: rename d8/d12/c28 to d8/d12/d1e/c2c 0 2024-05-09T00:07:37.361 INFO:tasks.workunit.client.0.smithi026.stdout:1/120: dread d5/d16/f1b [0,4194304] 0 2024-05-09T00:07:37.361 INFO:tasks.workunit.client.1.smithi135.stdout:5/767: chown db/d24/c26 2233 1 2024-05-09T00:07:37.361 INFO:tasks.workunit.client.0.smithi026.stdout:1/121: write f2 [7480605,73412] 0 2024-05-09T00:07:37.364 INFO:tasks.workunit.client.1.smithi135.stdout:0/734: rename d3/dd/d3f/d43/f93 to d3/dd/d3f/d29/fd4 0 2024-05-09T00:07:37.365 INFO:tasks.workunit.client.0.smithi026.stdout:2/78: getdents d14 0 2024-05-09T00:07:37.366 INFO:tasks.workunit.client.1.smithi135.stdout:8/727: creat d4/d7/d4a/ff6 x:0 0 0 2024-05-09T00:07:37.367 INFO:tasks.workunit.client.0.smithi026.stdout:9/130: mkdir d7/d23/d29/d2e 0 2024-05-09T00:07:37.368 INFO:tasks.workunit.client.0.smithi026.stdout:4/94: stat d0/c10 0 2024-05-09T00:07:37.368 INFO:tasks.workunit.client.0.smithi026.stdout:8/101: sync 2024-05-09T00:07:37.370 INFO:tasks.workunit.client.0.smithi026.stdout:7/144: getdents d8 0 2024-05-09T00:07:37.371 INFO:tasks.workunit.client.0.smithi026.stdout:4/95: write d0/f2 [3282339,68136] 0 2024-05-09T00:07:37.374 INFO:tasks.workunit.client.1.smithi135.stdout:3/766: creat d8/d6d/d44/d4b/da0/daa/dc9/f10e x:0 0 0 2024-05-09T00:07:37.374 INFO:tasks.workunit.client.1.smithi135.stdout:3/767: write d8/d6d/d44/d4b/d59/d90/d7b/d80/fbb [579350,8157] 0 2024-05-09T00:07:37.377 INFO:tasks.workunit.client.1.smithi135.stdout:1/718: mknod da/d14/c103 0 2024-05-09T00:07:37.377 INFO:tasks.workunit.client.1.smithi135.stdout:1/719: fsync da/d24/d27/f28 0 2024-05-09T00:07:37.377 INFO:tasks.workunit.client.1.smithi135.stdout:1/720: fsync da/d24/d27/d33/d52/d71/f87 0 2024-05-09T00:07:37.378 INFO:tasks.workunit.client.0.smithi026.stdout:2/79: creat d14/f1d x:0 0 0 2024-05-09T00:07:37.378 INFO:tasks.workunit.client.0.smithi026.stdout:2/80: chown l12 56210 1 2024-05-09T00:07:37.380 INFO:tasks.workunit.client.0.smithi026.stdout:9/131: rmdir d7/d23/d29 39 2024-05-09T00:07:37.381 INFO:tasks.workunit.client.1.smithi135.stdout:5/768: creat db/d84/d62/fed x:0 0 0 2024-05-09T00:07:37.381 INFO:tasks.workunit.client.1.smithi135.stdout:5/769: write db/d84/d62/d73/d9c/fe2 [45748,45856] 0 2024-05-09T00:07:37.381 INFO:tasks.workunit.client.1.smithi135.stdout:5/770: write db/d84/d62/d73/d9c/d9f/d92/fa0 [92974,72633] 0 2024-05-09T00:07:37.381 INFO:tasks.workunit.client.1.smithi135.stdout:5/771: stat db/d84/d62/d73/f83 0 2024-05-09T00:07:37.381 INFO:tasks.workunit.client.1.smithi135.stdout:5/772: fsync db/d24/d32/fd4 0 2024-05-09T00:07:37.382 INFO:tasks.workunit.client.0.smithi026.stdout:8/102: symlink de/d17/l1f 0 2024-05-09T00:07:37.383 INFO:tasks.workunit.client.1.smithi135.stdout:9/626: mkdir d1/d1a/d2c/d2d/dc8 0 2024-05-09T00:07:37.384 INFO:tasks.workunit.client.0.smithi026.stdout:4/96: creat d0/d12/f1d x:0 0 0 2024-05-09T00:07:37.384 INFO:tasks.workunit.client.0.smithi026.stdout:9/132: write d7/f19 [398234,81998] 0 2024-05-09T00:07:37.384 INFO:tasks.workunit.client.0.smithi026.stdout:9/133: truncate d7/f1f 755191 0 2024-05-09T00:07:37.384 INFO:tasks.workunit.client.0.smithi026.stdout:9/134: dread - d7/d23/f25 zero size 2024-05-09T00:07:37.385 INFO:tasks.workunit.client.1.smithi135.stdout:3/768: mknod d8/d6d/d44/d4b/d59/d90/c10f 0 2024-05-09T00:07:37.388 INFO:tasks.workunit.client.0.smithi026.stdout:4/97: write d0/f9 [442218,19466] 0 2024-05-09T00:07:37.388 INFO:tasks.workunit.client.1.smithi135.stdout:1/721: mkdir da/d24/d27/d33/d52/d71/d8d/d104 0 2024-05-09T00:07:37.388 INFO:tasks.workunit.client.1.smithi135.stdout:1/722: truncate da/d14/d5c/d83/ff7 75654 0 2024-05-09T00:07:37.390 INFO:tasks.workunit.client.1.smithi135.stdout:7/824: sync 2024-05-09T00:07:37.390 INFO:tasks.workunit.client.1.smithi135.stdout:7/825: chown db/dd/d33/d68/d10a/d3a/d40/d4c/da3/laa 2 1 2024-05-09T00:07:37.390 INFO:tasks.workunit.client.1.smithi135.stdout:7/826: chown db/dd/d33/d68/d10a/d3a/d40/d7e 0 1 2024-05-09T00:07:37.390 INFO:tasks.workunit.client.1.smithi135.stdout:7/827: stat db/fd2 0 2024-05-09T00:07:37.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/828: getdents db/dd/d33/d68/d10a/d3a/d40/d84 0 2024-05-09T00:07:37.391 INFO:tasks.workunit.client.1.smithi135.stdout:8/728: dwrite d4/d7/da4/fc4 [0,4194304] 0 2024-05-09T00:07:37.392 INFO:tasks.workunit.client.0.smithi026.stdout:7/145: dwrite d8/fc [0,4194304] 0 2024-05-09T00:07:37.392 INFO:tasks.workunit.client.0.smithi026.stdout:7/146: chown d8/d12/d22/d29/l17 18710897 1 2024-05-09T00:07:37.392 INFO:tasks.workunit.client.1.smithi135.stdout:5/773: link db/d24/d32/d5b/ld9 db/d84/d62/d73/d9c/lee 0 2024-05-09T00:07:37.392 INFO:tasks.workunit.client.1.smithi135.stdout:1/723: write da/d73/fe2 [1036098,56324] 0 2024-05-09T00:07:37.393 INFO:tasks.workunit.client.0.smithi026.stdout:9/135: mkdir d7/d23/d2f 0 2024-05-09T00:07:37.394 INFO:tasks.workunit.client.1.smithi135.stdout:9/627: creat d1/fc9 x:0 0 0 2024-05-09T00:07:37.396 INFO:tasks.workunit.client.0.smithi026.stdout:2/81: mknod d14/c1e 0 2024-05-09T00:07:37.396 INFO:tasks.workunit.client.1.smithi135.stdout:9/628: write d1/d1a/d2c/f5d [2030451,83281] 0 2024-05-09T00:07:37.396 INFO:tasks.workunit.client.1.smithi135.stdout:9/629: fdatasync d1/d1a/d2c/d20/f92 0 2024-05-09T00:07:37.396 INFO:tasks.workunit.client.1.smithi135.stdout:9/630: dread - d1/d24/d44/d54/d66/d6e/fbc zero size 2024-05-09T00:07:37.397 INFO:tasks.workunit.client.1.smithi135.stdout:3/769: creat d8/d13/d1f/d40/f110 x:0 0 0 2024-05-09T00:07:37.399 INFO:tasks.workunit.client.1.smithi135.stdout:7/829: mkdir db/dd/d33/d68/d10a/d3a/d40/d4c/d67/d10f 0 2024-05-09T00:07:37.401 INFO:tasks.workunit.client.0.smithi026.stdout:7/147: truncate f6 2534373 0 2024-05-09T00:07:37.402 INFO:tasks.workunit.client.1.smithi135.stdout:2/730: sync 2024-05-09T00:07:37.402 INFO:tasks.workunit.client.0.smithi026.stdout:7/148: write d8/fc [2006300,54626] 0 2024-05-09T00:07:37.402 INFO:tasks.workunit.client.0.smithi026.stdout:7/149: chown d8/c13 54838469 1 2024-05-09T00:07:37.402 INFO:tasks.workunit.client.0.smithi026.stdout:7/150: fdatasync d8/f10 0 2024-05-09T00:07:37.403 INFO:tasks.workunit.client.0.smithi026.stdout:9/136: creat d7/d23/d29/f30 x:0 0 0 2024-05-09T00:07:37.403 INFO:tasks.workunit.client.0.smithi026.stdout:9/137: write d7/f28 [389553,58974] 0 2024-05-09T00:07:37.405 INFO:tasks.workunit.client.1.smithi135.stdout:6/747: sync 2024-05-09T00:07:37.406 INFO:tasks.workunit.client.0.smithi026.stdout:9/138: mkdir d7/d23/d29/d31 0 2024-05-09T00:07:37.406 INFO:tasks.workunit.client.0.smithi026.stdout:9/139: write d7/f1f [1763312,18468] 0 2024-05-09T00:07:37.407 INFO:tasks.workunit.client.0.smithi026.stdout:8/103: rmdir de 39 2024-05-09T00:07:37.407 INFO:tasks.workunit.client.0.smithi026.stdout:8/104: write de/f14 [155882,64378] 0 2024-05-09T00:07:37.407 INFO:tasks.workunit.client.0.smithi026.stdout:8/105: dread - de/d17/f1c zero size 2024-05-09T00:07:37.409 INFO:tasks.workunit.client.0.smithi026.stdout:2/82: mkdir d14/d15/d1f 0 2024-05-09T00:07:37.409 INFO:tasks.workunit.client.0.smithi026.stdout:8/106: dread de/d17/f1a [0,4194304] 0 2024-05-09T00:07:37.409 INFO:tasks.workunit.client.0.smithi026.stdout:8/107: write de/f15 [902954,109771] 0 2024-05-09T00:07:37.411 INFO:tasks.workunit.client.0.smithi026.stdout:4/98: rmdir d0/d12 39 2024-05-09T00:07:37.412 INFO:tasks.workunit.client.1.smithi135.stdout:5/774: creat db/d84/d62/fef x:0 0 0 2024-05-09T00:07:37.412 INFO:tasks.workunit.client.1.smithi135.stdout:1/724: truncate da/d73/f78 4104370 0 2024-05-09T00:07:37.416 INFO:tasks.workunit.client.1.smithi135.stdout:9/631: mkdir d1/d24/d44/d7f/da2/dca 0 2024-05-09T00:07:37.417 INFO:tasks.workunit.client.0.smithi026.stdout:8/108: creat de/f20 x:0 0 0 2024-05-09T00:07:37.420 INFO:tasks.workunit.client.1.smithi135.stdout:3/770: creat d8/d6d/d44/d4b/dc2/f111 x:0 0 0 2024-05-09T00:07:37.421 INFO:tasks.workunit.client.0.smithi026.stdout:4/99: link d0/fe d0/d19/f1e 0 2024-05-09T00:07:37.423 INFO:tasks.workunit.client.1.smithi135.stdout:7/830: mknod db/dd/d33/d68/d10a/d3a/d40/d4c/d67/d10f/c110 0 2024-05-09T00:07:37.424 INFO:tasks.workunit.client.1.smithi135.stdout:2/731: dwrite d1/d12/d20/f68 [4194304,4194304] 0 2024-05-09T00:07:37.425 INFO:tasks.workunit.client.0.smithi026.stdout:8/109: mkdir de/d17/d21 0 2024-05-09T00:07:37.426 INFO:tasks.workunit.client.1.smithi135.stdout:5/775: mkdir db/d84/d62/d73/d9c/d9f/dc0/df0 0 2024-05-09T00:07:37.426 INFO:tasks.workunit.client.0.smithi026.stdout:7/151: dwrite d8/ff [0,4194304] 0 2024-05-09T00:07:37.426 INFO:tasks.workunit.client.0.smithi026.stdout:7/152: readlink d8/d12/d1e/l20 0 2024-05-09T00:07:37.427 INFO:tasks.workunit.client.0.smithi026.stdout:4/100: creat d0/f1f x:0 0 0 2024-05-09T00:07:37.428 INFO:tasks.workunit.client.1.smithi135.stdout:9/632: getdents d1/d1a/d2c/d2d 0 2024-05-09T00:07:37.428 INFO:tasks.workunit.client.1.smithi135.stdout:9/633: chown d1/d24/d44/d54/l6f 0 1 2024-05-09T00:07:37.429 INFO:tasks.workunit.client.1.smithi135.stdout:9/634: read d1/d1a/d10/d3c/d5c/fae [389553,50105] 0 2024-05-09T00:07:37.429 INFO:tasks.workunit.client.0.smithi026.stdout:8/110: creat de/d17/d21/f22 x:0 0 0 2024-05-09T00:07:37.429 INFO:tasks.workunit.client.0.smithi026.stdout:8/111: stat f7 0 2024-05-09T00:07:37.429 INFO:tasks.workunit.client.1.smithi135.stdout:3/771: mknod d8/d102/d63/db9/c112 0 2024-05-09T00:07:37.431 INFO:tasks.workunit.client.1.smithi135.stdout:7/831: mkdir db/dd/d33/d111 0 2024-05-09T00:07:37.433 INFO:tasks.workunit.client.1.smithi135.stdout:6/748: dwrite d2/d20/d2e/f8d [0,4194304] 0 2024-05-09T00:07:37.435 INFO:tasks.workunit.client.0.smithi026.stdout:7/153: link d8/ff d8/d1b/f2d 0 2024-05-09T00:07:37.437 INFO:tasks.workunit.client.1.smithi135.stdout:2/732: chown d1/d12/le7 578642 1 2024-05-09T00:07:37.437 INFO:tasks.workunit.client.1.smithi135.stdout:5/776: mknod db/d24/db0/dcd/cf1 0 2024-05-09T00:07:37.437 INFO:tasks.workunit.client.1.smithi135.stdout:5/777: chown db/d5d/deb 16 1 2024-05-09T00:07:37.437 INFO:tasks.workunit.client.0.smithi026.stdout:4/101: mknod d0/d12/c20 0 2024-05-09T00:07:37.440 INFO:tasks.workunit.client.1.smithi135.stdout:9/635: truncate d1/d1a/d2c/f6d 532677 0 2024-05-09T00:07:37.440 INFO:tasks.workunit.client.0.smithi026.stdout:8/112: rename fd to de/f23 0 2024-05-09T00:07:37.442 INFO:tasks.workunit.client.1.smithi135.stdout:3/772: truncate f0 2108390 0 2024-05-09T00:07:37.442 INFO:tasks.workunit.client.1.smithi135.stdout:3/773: chown d8/d6d/d44/d4b/da0/daa/dc9/f101 0 1 2024-05-09T00:07:37.443 INFO:tasks.workunit.client.0.smithi026.stdout:7/154: rmdir d8/d1b 39 2024-05-09T00:07:37.445 INFO:tasks.workunit.client.1.smithi135.stdout:7/832: creat db/dd/d33/d68/d10a/d3a/d40/d7e/f112 x:0 0 0 2024-05-09T00:07:37.447 INFO:tasks.workunit.client.0.smithi026.stdout:4/102: creat d0/f21 x:0 0 0 2024-05-09T00:07:37.450 INFO:tasks.workunit.client.1.smithi135.stdout:2/733: symlink d1/d12/d20/d2b/lfa 0 2024-05-09T00:07:37.451 INFO:tasks.workunit.client.0.smithi026.stdout:7/155: mkdir d8/d2e 0 2024-05-09T00:07:37.452 INFO:tasks.workunit.client.0.smithi026.stdout:7/156: fdatasync f5 0 2024-05-09T00:07:37.452 INFO:tasks.workunit.client.1.smithi135.stdout:5/778: link db/d84/d31/fbb db/d5d/dac/ddc/dbf/ff2 0 2024-05-09T00:07:37.453 INFO:tasks.workunit.client.0.smithi026.stdout:8/113: dread f3 [0,4194304] 0 2024-05-09T00:07:37.454 INFO:tasks.workunit.client.0.smithi026.stdout:7/157: write d8/fb [1265689,119787] 0 2024-05-09T00:07:37.454 INFO:tasks.workunit.client.0.smithi026.stdout:7/158: truncate f7 1681342 0 2024-05-09T00:07:37.454 INFO:tasks.workunit.client.0.smithi026.stdout:7/159: fsync f7 0 2024-05-09T00:07:37.454 INFO:tasks.workunit.client.0.smithi026.stdout:7/160: truncate d8/fa 8775630 0 2024-05-09T00:07:37.454 INFO:tasks.workunit.client.1.smithi135.stdout:9/636: rmdir d1/d24/d86 39 2024-05-09T00:07:37.455 INFO:tasks.workunit.client.1.smithi135.stdout:7/833: symlink db/dd/dca/l113 0 2024-05-09T00:07:37.457 INFO:tasks.workunit.client.1.smithi135.stdout:5/779: unlink db/d5d/dac/fc3 0 2024-05-09T00:07:37.459 INFO:tasks.workunit.client.1.smithi135.stdout:9/637: symlink d1/d1a/d10/db3/lcb 0 2024-05-09T00:07:37.460 INFO:tasks.workunit.client.1.smithi135.stdout:5/780: mknod db/d3f/de1/cf3 0 2024-05-09T00:07:37.467 INFO:tasks.workunit.client.1.smithi135.stdout:2/734: dread d1/fdf [0,4194304] 0 2024-05-09T00:07:37.470 INFO:tasks.workunit.client.0.smithi026.stdout:2/83: dwrite d14/f18 [0,4194304] 0 2024-05-09T00:07:37.472 INFO:tasks.workunit.client.1.smithi135.stdout:2/735: rename d1/d12/cc0 to d1/d12/d21/d57/dbd/cfb 0 2024-05-09T00:07:37.472 INFO:tasks.workunit.client.1.smithi135.stdout:2/736: dread - d1/d12/d21/d57/ff4 zero size 2024-05-09T00:07:37.473 INFO:tasks.workunit.client.1.smithi135.stdout:9/638: rmdir d1/d24/d44/d7f 39 2024-05-09T00:07:37.473 INFO:tasks.workunit.client.1.smithi135.stdout:9/639: fsync d1/d1a/d10/f90 0 2024-05-09T00:07:37.479 INFO:tasks.workunit.client.0.smithi026.stdout:8/114: getdents de/d17 0 2024-05-09T00:07:37.480 INFO:tasks.workunit.client.0.smithi026.stdout:9/140: dwrite d7/f1f [0,4194304] 0 2024-05-09T00:07:37.480 INFO:tasks.workunit.client.0.smithi026.stdout:2/84: dread f10 [0,4194304] 0 2024-05-09T00:07:37.482 INFO:tasks.workunit.client.0.smithi026.stdout:2/85: write fd [376065,101149] 0 2024-05-09T00:07:37.482 INFO:tasks.workunit.client.0.smithi026.stdout:2/86: write f11 [342587,80328] 0 2024-05-09T00:07:37.482 INFO:tasks.workunit.client.0.smithi026.stdout:2/87: chown d14/c1e 1 1 2024-05-09T00:07:37.482 INFO:tasks.workunit.client.0.smithi026.stdout:2/88: fdatasync d14/f1d 0 2024-05-09T00:07:37.482 INFO:tasks.workunit.client.0.smithi026.stdout:2/89: chown f5 1032 1 2024-05-09T00:07:37.484 INFO:tasks.workunit.client.0.smithi026.stdout:9/141: rename d7/f8 to d7/d23/d29/d31/f32 0 2024-05-09T00:07:37.486 INFO:tasks.workunit.client.1.smithi135.stdout:1/725: dwrite da/d73/fe2 [0,4194304] 0 2024-05-09T00:07:37.486 INFO:tasks.workunit.client.1.smithi135.stdout:6/749: dwrite d2/d20/d2e/f8d [4194304,4194304] 0 2024-05-09T00:07:37.486 INFO:tasks.workunit.client.1.smithi135.stdout:6/750: read d2/f96 [77694,54289] 0 2024-05-09T00:07:37.489 INFO:tasks.workunit.client.0.smithi026.stdout:2/90: mkdir d14/d15/d20 0 2024-05-09T00:07:37.490 INFO:tasks.workunit.client.0.smithi026.stdout:2/91: stat f5 0 2024-05-09T00:07:37.491 INFO:tasks.workunit.client.1.smithi135.stdout:9/640: dread d1/d1a/f29 [0,4194304] 0 2024-05-09T00:07:37.491 INFO:tasks.workunit.client.0.smithi026.stdout:9/142: creat d7/d23/f33 x:0 0 0 2024-05-09T00:07:37.495 INFO:tasks.workunit.client.0.smithi026.stdout:2/92: link c7 d14/d15/d17/c21 0 2024-05-09T00:07:37.496 INFO:tasks.workunit.client.1.smithi135.stdout:5/781: dwrite db/d24/d32/f44 [0,4194304] 0 2024-05-09T00:07:37.497 INFO:tasks.workunit.client.0.smithi026.stdout:9/143: creat d7/d23/d29/d31/f34 x:0 0 0 2024-05-09T00:07:37.497 INFO:tasks.workunit.client.0.smithi026.stdout:9/144: dread - d7/f1d zero size 2024-05-09T00:07:37.497 INFO:tasks.workunit.client.0.smithi026.stdout:9/145: dread - d7/d23/f25 zero size 2024-05-09T00:07:37.500 INFO:tasks.workunit.client.1.smithi135.stdout:3/774: dwrite d8/d6d/d44/d4b/d59/fbe [0,4194304] 0 2024-05-09T00:07:37.500 INFO:tasks.workunit.client.1.smithi135.stdout:3/775: chown d8/d13/d1f/d62/d10c 52228344 1 2024-05-09T00:07:37.500 INFO:tasks.workunit.client.1.smithi135.stdout:3/776: write d8/d6d/d44/d4b/d59/d90/d7b/d80/fc4 [454031,98968] 0 2024-05-09T00:07:37.503 INFO:tasks.workunit.client.1.smithi135.stdout:7/834: dwrite db/da8/faf [0,4194304] 0 2024-05-09T00:07:37.503 INFO:tasks.workunit.client.1.smithi135.stdout:7/835: read - db/dd/d33/d68/d10a/d3a/d40/d7e/fb9 zero size 2024-05-09T00:07:37.507 INFO:tasks.workunit.client.0.smithi026.stdout:9/146: link d7/f28 d7/d23/d2f/f35 0 2024-05-09T00:07:37.515 INFO:tasks.workunit.client.1.smithi135.stdout:3/777: dread d8/f14 [0,4194304] 0 2024-05-09T00:07:37.516 INFO:tasks.workunit.client.1.smithi135.stdout:7/836: mknod db/dd/d33/d68/d10a/d63/c114 0 2024-05-09T00:07:37.516 INFO:tasks.workunit.client.1.smithi135.stdout:7/837: stat db/c10 0 2024-05-09T00:07:37.516 INFO:tasks.workunit.client.0.smithi026.stdout:7/161: truncate d8/f1f 5421795 0 2024-05-09T00:07:37.518 INFO:tasks.workunit.client.1.smithi135.stdout:3/778: creat d8/d13/ddd/f113 x:0 0 0 2024-05-09T00:07:37.518 INFO:tasks.workunit.client.1.smithi135.stdout:3/779: chown d8/d102/d92/fb1 4517 1 2024-05-09T00:07:37.519 INFO:tasks.workunit.client.0.smithi026.stdout:2/93: mkdir d14/d22 0 2024-05-09T00:07:37.520 INFO:tasks.workunit.client.0.smithi026.stdout:2/94: write f8 [91314,98475] 0 2024-05-09T00:07:37.521 INFO:tasks.workunit.client.1.smithi135.stdout:2/737: dwrite d1/d12/d21/d57/dbd/fd7 [0,4194304] 0 2024-05-09T00:07:37.521 INFO:tasks.workunit.client.1.smithi135.stdout:2/738: chown d1/d12/d21/f3f 0 1 2024-05-09T00:07:37.521 INFO:tasks.workunit.client.1.smithi135.stdout:3/780: creat d8/d6d/d44/d4b/da0/daa/dc9/f114 x:0 0 0 2024-05-09T00:07:37.521 INFO:tasks.workunit.client.1.smithi135.stdout:3/781: write d8/fb4 [988190,91155] 0 2024-05-09T00:07:37.521 INFO:tasks.workunit.client.1.smithi135.stdout:3/782: chown d8/d6d/d44/d4b/fdb 30 1 2024-05-09T00:07:37.523 INFO:tasks.workunit.client.1.smithi135.stdout:3/783: dread d8/d6d/d44/d4b/d59/d90/d7b/fbf [0,4194304] 0 2024-05-09T00:07:37.523 INFO:tasks.workunit.client.1.smithi135.stdout:3/784: truncate d8/d13/d1f/f30 8841551 0 2024-05-09T00:07:37.523 INFO:tasks.workunit.client.1.smithi135.stdout:3/785: fsync d8/d6d/d44/d4b/d59/d90/d7b/d80/fbb 0 2024-05-09T00:07:37.523 INFO:tasks.workunit.client.1.smithi135.stdout:1/726: dwrite da/d14/d20/d38/d3a/db7/fe5 [0,4194304] 0 2024-05-09T00:07:37.523 INFO:tasks.workunit.client.0.smithi026.stdout:9/147: creat d7/d23/f36 x:0 0 0 2024-05-09T00:07:37.526 INFO:tasks.workunit.client.0.smithi026.stdout:7/162: rename d8/fb to d8/d12/d22/d29/f2f 0 2024-05-09T00:07:37.527 INFO:tasks.workunit.client.0.smithi026.stdout:8/115: dwrite de/ff [0,4194304] 0 2024-05-09T00:07:37.527 INFO:tasks.workunit.client.0.smithi026.stdout:8/116: dread - de/f16 zero size 2024-05-09T00:07:37.527 INFO:tasks.workunit.client.0.smithi026.stdout:8/117: stat de/f11 0 2024-05-09T00:07:37.529 INFO:tasks.workunit.client.1.smithi135.stdout:6/751: dwrite f1 [0,4194304] 0 2024-05-09T00:07:37.529 INFO:tasks.workunit.client.1.smithi135.stdout:4/618: sync 2024-05-09T00:07:37.529 INFO:tasks.workunit.client.1.smithi135.stdout:4/619: write dc/d26/d31/d82/f89 [1753870,67984] 0 2024-05-09T00:07:37.530 INFO:tasks.workunit.client.1.smithi135.stdout:5/782: dwrite db/d84/d62/d73/dbe/fe9 [0,4194304] 0 2024-05-09T00:07:37.530 INFO:tasks.workunit.client.0.smithi026.stdout:9/148: rename d7/f2b to d7/d23/f37 0 2024-05-09T00:07:37.530 INFO:tasks.workunit.client.0.smithi026.stdout:9/149: write d7/d23/f36 [737761,81811] 0 2024-05-09T00:07:37.531 INFO:tasks.workunit.client.1.smithi135.stdout:2/739: getdents d1/d12/d20/d2b/d7c/db5 0 2024-05-09T00:07:37.533 INFO:tasks.workunit.client.1.smithi135.stdout:3/786: dread d8/d6d/d44/d4b/d59/d90/fc5 [0,4194304] 0 2024-05-09T00:07:37.533 INFO:tasks.workunit.client.1.smithi135.stdout:3/787: dread - d8/d13/d1f/d40/f110 zero size 2024-05-09T00:07:37.533 INFO:tasks.workunit.client.1.smithi135.stdout:3/788: stat d8/d13/d1f/d62/c98 0 2024-05-09T00:07:37.533 INFO:tasks.workunit.client.1.smithi135.stdout:3/789: read - d8/d102/d92/fe7 zero size 2024-05-09T00:07:37.535 INFO:tasks.workunit.client.0.smithi026.stdout:8/118: mkdir de/d17/d21/d24 0 2024-05-09T00:07:37.536 INFO:tasks.workunit.client.1.smithi135.stdout:1/727: truncate da/d24/d27/d33/f39 4117997 0 2024-05-09T00:07:37.537 INFO:tasks.workunit.client.0.smithi026.stdout:9/150: symlink d7/d26/l38 0 2024-05-09T00:07:37.538 INFO:tasks.workunit.client.1.smithi135.stdout:6/752: symlink d2/d20/d37/d4e/l104 0 2024-05-09T00:07:37.540 INFO:tasks.workunit.client.1.smithi135.stdout:4/620: mkdir dc/d26/d93/d9d/dd2 0 2024-05-09T00:07:37.540 INFO:tasks.workunit.client.1.smithi135.stdout:4/621: chown dc/d71 221472 1 2024-05-09T00:07:37.541 INFO:tasks.workunit.client.0.smithi026.stdout:2/95: dwrite f9 [0,4194304] 0 2024-05-09T00:07:37.542 INFO:tasks.workunit.client.0.smithi026.stdout:9/151: truncate d7/d23/d29/d31/f32 3873484 0 2024-05-09T00:07:37.544 INFO:tasks.workunit.client.0.smithi026.stdout:2/96: creat d14/d15/d20/f23 x:0 0 0 2024-05-09T00:07:37.547 INFO:tasks.workunit.client.1.smithi135.stdout:2/740: mknod d1/d12/d21/d41/d6d/db4/cfc 0 2024-05-09T00:07:37.547 INFO:tasks.workunit.client.1.smithi135.stdout:2/741: chown d1/d12/d20/d3b/d40/f5e 961136273 1 2024-05-09T00:07:37.548 INFO:tasks.workunit.client.0.smithi026.stdout:9/152: unlink d7/d23/c2c 0 2024-05-09T00:07:37.548 INFO:tasks.workunit.client.0.smithi026.stdout:9/153: truncate d7/d23/f25 514737 0 2024-05-09T00:07:37.549 INFO:tasks.workunit.client.1.smithi135.stdout:1/728: truncate da/f13 5375617 0 2024-05-09T00:07:37.550 INFO:tasks.workunit.client.0.smithi026.stdout:2/97: mknod d14/d15/d20/c24 0 2024-05-09T00:07:37.551 INFO:tasks.workunit.client.1.smithi135.stdout:4/622: unlink dc/d4a/d69/f5c 0 2024-05-09T00:07:37.551 INFO:tasks.workunit.client.1.smithi135.stdout:1/729: write da/f62 [2105810,5240] 0 2024-05-09T00:07:37.552 INFO:tasks.workunit.client.1.smithi135.stdout:1/730: chown da/d24/d27/d33/cd4 1696698 1 2024-05-09T00:07:37.552 INFO:tasks.workunit.client.0.smithi026.stdout:9/154: creat d7/d23/f39 x:0 0 0 2024-05-09T00:07:37.552 INFO:tasks.workunit.client.1.smithi135.stdout:6/753: dwrite d2/da/d1d/d69/d89/fed [0,4194304] 0 2024-05-09T00:07:37.554 INFO:tasks.workunit.client.1.smithi135.stdout:5/783: rename db/d3f/la8 to db/d84/d31/lf4 0 2024-05-09T00:07:37.554 INFO:tasks.workunit.client.1.smithi135.stdout:5/784: chown db/d84/d31/lf4 451863598 1 2024-05-09T00:07:37.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/754: dread d2/da/d1d/d69/f9c [0,4194304] 0 2024-05-09T00:07:37.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/755: chown d2/da/d26/l34 26653223 1 2024-05-09T00:07:37.554 INFO:tasks.workunit.client.1.smithi135.stdout:0/735: sync 2024-05-09T00:07:37.555 INFO:tasks.workunit.client.0.smithi026.stdout:2/98: creat d14/d15/f25 x:0 0 0 2024-05-09T00:07:37.555 INFO:tasks.workunit.client.0.smithi026.stdout:2/99: chown d14/d15/d17/l1a 1131 1 2024-05-09T00:07:37.555 INFO:tasks.workunit.client.1.smithi135.stdout:7/838: truncate db/da8/faf 4080219 0 2024-05-09T00:07:37.555 INFO:tasks.workunit.client.1.smithi135.stdout:7/839: truncate db/dd/d33/f82 560895 0 2024-05-09T00:07:37.557 INFO:tasks.workunit.client.0.smithi026.stdout:9/155: mkdir d7/d23/d2f/d3a 0 2024-05-09T00:07:37.558 INFO:tasks.workunit.client.1.smithi135.stdout:0/736: write d3/dd/d2d/f96 [2046273,49439] 0 2024-05-09T00:07:37.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/623: rmdir dc/d71/d90 39 2024-05-09T00:07:37.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/624: truncate dc/d4a/d69/d55/fab 1109653 0 2024-05-09T00:07:37.559 INFO:tasks.workunit.client.1.smithi135.stdout:4/625: stat dc/d4a/d69/d39/c8a 0 2024-05-09T00:07:37.559 INFO:tasks.workunit.client.0.smithi026.stdout:5/110: sync 2024-05-09T00:07:37.559 INFO:tasks.workunit.client.0.smithi026.stdout:6/88: sync 2024-05-09T00:07:37.560 INFO:tasks.workunit.client.0.smithi026.stdout:2/100: creat d14/d15/f26 x:0 0 0 2024-05-09T00:07:37.562 INFO:tasks.workunit.client.0.smithi026.stdout:6/89: write f9 [1140343,41387] 0 2024-05-09T00:07:37.563 INFO:tasks.workunit.client.1.smithi135.stdout:1/731: dread da/d14/f3f [0,4194304] 0 2024-05-09T00:07:37.565 INFO:tasks.workunit.client.0.smithi026.stdout:5/111: symlink d2/d8/df/l23 0 2024-05-09T00:07:37.565 INFO:tasks.workunit.client.0.smithi026.stdout:5/112: readlink d2/l7 0 2024-05-09T00:07:37.566 INFO:tasks.workunit.client.0.smithi026.stdout:5/113: read d2/fc [615930,119245] 0 2024-05-09T00:07:37.569 INFO:tasks.workunit.client.0.smithi026.stdout:2/101: rename c13 to d14/d15/d1f/c27 0 2024-05-09T00:07:37.571 INFO:tasks.workunit.client.0.smithi026.stdout:9/156: mknod d7/c3b 0 2024-05-09T00:07:37.573 INFO:tasks.workunit.client.0.smithi026.stdout:6/90: mknod d15/c1b 0 2024-05-09T00:07:37.575 INFO:tasks.workunit.client.0.smithi026.stdout:5/114: mkdir d2/d8/df/d24 0 2024-05-09T00:07:37.576 INFO:tasks.workunit.client.0.smithi026.stdout:5/115: chown d2/l16 484253 1 2024-05-09T00:07:37.577 INFO:tasks.workunit.client.0.smithi026.stdout:8/119: rmdir de/d17/d21 39 2024-05-09T00:07:37.582 INFO:tasks.workunit.client.0.smithi026.stdout:2/102: dread d14/f18 [0,4194304] 0 2024-05-09T00:07:37.583 INFO:tasks.workunit.client.1.smithi135.stdout:3/790: rename d8/d6d/d44/d4b/d59/d90/f97 to d8/d6d/d44/d4b/da0/daa/d88/f115 0 2024-05-09T00:07:37.583 INFO:tasks.workunit.client.1.smithi135.stdout:3/791: readlink d8/d13/d1f/l83 0 2024-05-09T00:07:37.583 INFO:tasks.workunit.client.1.smithi135.stdout:3/792: readlink d8/d6d/d44/d4b/d59/d90/lcf 0 2024-05-09T00:07:37.583 INFO:tasks.workunit.client.1.smithi135.stdout:4/626: dwrite dc/dd/f80 [0,4194304] 0 2024-05-09T00:07:37.583 INFO:tasks.workunit.client.1.smithi135.stdout:4/627: truncate dc/d4a/d69/d55/d5f/f20 4622075 0 2024-05-09T00:07:37.584 INFO:tasks.workunit.client.1.smithi135.stdout:5/785: dwrite db/d84/d62/d73/d9c/fe2 [0,4194304] 0 2024-05-09T00:07:37.584 INFO:tasks.workunit.client.0.smithi026.stdout:9/157: creat d7/d23/d29/d31/f3c x:0 0 0 2024-05-09T00:07:37.586 INFO:tasks.workunit.client.1.smithi135.stdout:6/756: unlink d2/da/d26/d57/d59/d62/l7d 0 2024-05-09T00:07:37.587 INFO:tasks.workunit.client.0.smithi026.stdout:6/91: creat d15/f1c x:0 0 0 2024-05-09T00:07:37.590 INFO:tasks.workunit.client.0.smithi026.stdout:8/120: creat de/f25 x:0 0 0 2024-05-09T00:07:37.591 INFO:tasks.workunit.client.0.smithi026.stdout:8/121: write de/f15 [531467,83349] 0 2024-05-09T00:07:37.591 INFO:tasks.workunit.client.0.smithi026.stdout:8/122: dread - de/d17/d21/f22 zero size 2024-05-09T00:07:37.591 INFO:tasks.workunit.client.0.smithi026.stdout:8/123: write de/f23 [480734,20652] 0 2024-05-09T00:07:37.593 INFO:tasks.workunit.client.1.smithi135.stdout:0/737: rename d3/dd/f26 to d3/dd/fd5 0 2024-05-09T00:07:37.594 INFO:tasks.workunit.client.1.smithi135.stdout:0/738: write d3/dd/d3f/d3a/da4/faf [988539,56304] 0 2024-05-09T00:07:37.598 INFO:tasks.workunit.client.0.smithi026.stdout:2/103: rename f10 to d14/d15/d1f/f28 0 2024-05-09T00:07:37.600 INFO:tasks.workunit.client.0.smithi026.stdout:9/158: creat d7/d23/d29/d31/f3d x:0 0 0 2024-05-09T00:07:37.600 INFO:tasks.workunit.client.0.smithi026.stdout:9/159: write d7/f9 [54364,33218] 0 2024-05-09T00:07:37.601 INFO:tasks.workunit.client.0.smithi026.stdout:9/160: write d7/d23/d29/d31/f3d [665923,89677] 0 2024-05-09T00:07:37.601 INFO:tasks.workunit.client.0.smithi026.stdout:9/161: truncate d7/d23/d29/d31/f3d 1432700 0 2024-05-09T00:07:37.602 INFO:tasks.workunit.client.1.smithi135.stdout:2/742: rename d1/d12/d21/d57/dbd/def to d1/d12/d20/d2b/d7c/db5/dfd 0 2024-05-09T00:07:37.604 INFO:tasks.workunit.client.0.smithi026.stdout:6/92: rename f6 to d15/f1d 0 2024-05-09T00:07:37.605 INFO:tasks.workunit.client.0.smithi026.stdout:5/116: dwrite d2/d8/df/f12 [0,4194304] 0 2024-05-09T00:07:37.605 INFO:tasks.workunit.client.1.smithi135.stdout:3/793: mkdir d8/d13/d75/d53/d6a/d116 0 2024-05-09T00:07:37.606 INFO:tasks.workunit.client.0.smithi026.stdout:2/104: symlink d14/d15/d1f/l29 0 2024-05-09T00:07:37.610 INFO:tasks.workunit.client.1.smithi135.stdout:8/729: sync 2024-05-09T00:07:37.611 INFO:tasks.workunit.client.1.smithi135.stdout:4/628: dwrite dc/d26/d31/d82/fb9 [0,4194304] 0 2024-05-09T00:07:37.611 INFO:tasks.workunit.client.1.smithi135.stdout:4/629: fdatasync dc/d4a/d69/f7b 0 2024-05-09T00:07:37.612 INFO:tasks.workunit.client.1.smithi135.stdout:4/630: write dc/d4a/d69/d55/d5f/faf [488170,96650] 0 2024-05-09T00:07:37.612 INFO:tasks.workunit.client.1.smithi135.stdout:4/631: fdatasync dc/dd/f11 0 2024-05-09T00:07:37.612 INFO:tasks.workunit.client.0.smithi026.stdout:9/162: truncate f2 1564993 0 2024-05-09T00:07:37.613 INFO:tasks.workunit.client.1.smithi135.stdout:1/732: dwrite da/f62 [0,4194304] 0 2024-05-09T00:07:37.614 INFO:tasks.workunit.client.0.smithi026.stdout:8/124: dwrite de/ff [0,4194304] 0 2024-05-09T00:07:37.614 INFO:tasks.workunit.client.0.smithi026.stdout:8/125: write de/d17/d21/f22 [658480,19746] 0 2024-05-09T00:07:37.615 INFO:tasks.workunit.client.0.smithi026.stdout:6/93: mkdir d15/d1e 0 2024-05-09T00:07:37.617 INFO:tasks.workunit.client.1.smithi135.stdout:5/786: creat db/d84/d62/d73/dbe/ff5 x:0 0 0 2024-05-09T00:07:37.618 INFO:tasks.workunit.client.1.smithi135.stdout:5/787: dread - db/d84/fb2 zero size 2024-05-09T00:07:37.619 INFO:tasks.workunit.client.1.smithi135.stdout:6/757: creat d2/f105 x:0 0 0 2024-05-09T00:07:37.621 INFO:tasks.workunit.client.1.smithi135.stdout:6/758: dread d2/d20/d37/d4e/faa [0,4194304] 0 2024-05-09T00:07:37.622 INFO:tasks.workunit.client.0.smithi026.stdout:5/117: dwrite d2/d8/f10 [0,4194304] 0 2024-05-09T00:07:37.637 INFO:tasks.workunit.client.1.smithi135.stdout:6/759: dwrite d2/da/d26/f55 [0,4194304] 0 2024-05-09T00:07:37.638 INFO:tasks.workunit.client.1.smithi135.stdout:6/760: write d2/d20/d3f/fea [584222,96301] 0 2024-05-09T00:07:37.638 INFO:tasks.workunit.client.0.smithi026.stdout:5/118: dwrite d2/d8/df/f12 [0,4194304] 0 2024-05-09T00:07:37.638 INFO:tasks.workunit.client.0.smithi026.stdout:5/119: readlink d2/d8/df/l1a 0 2024-05-09T00:07:37.638 INFO:tasks.workunit.client.0.smithi026.stdout:5/120: chown d2/fc 575 1 2024-05-09T00:07:37.638 INFO:tasks.workunit.client.0.smithi026.stdout:5/121: read d2/d8/f10 [1633308,59682] 0 2024-05-09T00:07:37.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:35.905608+0000 mgr.smithi135.kkrhgf (mgr.24419) 47 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 97 MiB/s rd, 205 MiB/s wr, 312 op/s 2024-05-09T00:07:37.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:35.905608+0000 mgr.smithi135.kkrhgf (mgr.24419) 47 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 97 MiB/s rd, 205 MiB/s wr, 312 op/s 2024-05-09T00:07:37.674 INFO:tasks.workunit.client.0.smithi026.stdout:2/105: creat d14/d15/d20/f2a x:0 0 0 2024-05-09T00:07:37.676 INFO:tasks.workunit.client.1.smithi135.stdout:0/739: mknod d3/dd/d3f/d43/da3/cd6 0 2024-05-09T00:07:37.677 INFO:tasks.workunit.client.1.smithi135.stdout:9/641: sync 2024-05-09T00:07:37.684 INFO:tasks.workunit.client.1.smithi135.stdout:7/840: rename db/dd/d33/d68/d10a/d63/c114 to db/d21/d98/c115 0 2024-05-09T00:07:37.685 INFO:tasks.workunit.client.1.smithi135.stdout:2/743: link d1/d12/d21/d41/d6d/ce3 d1/d12/d21/d41/d6d/cfe 0 2024-05-09T00:07:37.687 INFO:tasks.workunit.client.1.smithi135.stdout:3/794: creat d8/d6d/d24/d106/f117 x:0 0 0 2024-05-09T00:07:37.689 INFO:tasks.workunit.client.1.smithi135.stdout:7/841: dread db/dd/d33/d68/d10a/f7c [0,4194304] 0 2024-05-09T00:07:37.694 INFO:tasks.workunit.client.0.smithi026.stdout:8/126: getdents de 0 2024-05-09T00:07:37.695 INFO:tasks.workunit.client.0.smithi026.stdout:2/106: dwrite f11 [0,4194304] 0 2024-05-09T00:07:37.696 INFO:tasks.workunit.client.0.smithi026.stdout:2/107: chown d14/d15/d1f/f28 21489155 1 2024-05-09T00:07:37.697 INFO:tasks.workunit.client.1.smithi135.stdout:4/632: unlink dc/d26/d31/cc0 0 2024-05-09T00:07:37.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/94: creat d15/f1f x:0 0 0 2024-05-09T00:07:37.699 INFO:tasks.workunit.client.1.smithi135.stdout:1/733: link da/f10 da/d14/d20/d38/d3a/db7/de9/f105 0 2024-05-09T00:07:37.700 INFO:tasks.workunit.client.1.smithi135.stdout:1/734: chown da/cf 5897 1 2024-05-09T00:07:37.701 INFO:tasks.workunit.client.1.smithi135.stdout:5/788: creat db/d84/d62/d73/d9c/ff6 x:0 0 0 2024-05-09T00:07:37.703 INFO:tasks.workunit.client.1.smithi135.stdout:6/761: mknod d2/da/d26/d57/ddc/c106 0 2024-05-09T00:07:37.705 INFO:tasks.workunit.client.1.smithi135.stdout:0/740: creat d3/dd/d3f/d43/da3/fd7 x:0 0 0 2024-05-09T00:07:37.705 INFO:tasks.workunit.client.0.smithi026.stdout:5/122: rmdir d2/d8 39 2024-05-09T00:07:37.706 INFO:tasks.workunit.client.1.smithi135.stdout:9/642: creat d1/d24/d44/d54/d66/d6e/fcc x:0 0 0 2024-05-09T00:07:37.706 INFO:tasks.workunit.client.1.smithi135.stdout:9/643: chown d1/d1a/d89/dad 437 1 2024-05-09T00:07:37.709 INFO:tasks.workunit.client.1.smithi135.stdout:8/730: rename d4/d22/l64 to d4/d7/d2a/d56/dec/lf7 0 2024-05-09T00:07:37.710 INFO:tasks.workunit.client.1.smithi135.stdout:6/762: dread d2/da/d1d/fab [0,4194304] 0 2024-05-09T00:07:37.710 INFO:tasks.workunit.client.1.smithi135.stdout:8/731: read d4/d7/da4/fc4 [18235,97227] 0 2024-05-09T00:07:37.711 INFO:tasks.workunit.client.1.smithi135.stdout:2/744: truncate d1/d12/d20/d2b/f37 1622761 0 2024-05-09T00:07:37.712 INFO:tasks.workunit.client.1.smithi135.stdout:6/763: dread d2/da/d1d/f5e [0,4194304] 0 2024-05-09T00:07:37.712 INFO:tasks.workunit.client.0.smithi026.stdout:8/127: creat de/d17/d21/d24/f26 x:0 0 0 2024-05-09T00:07:37.713 INFO:tasks.workunit.client.1.smithi135.stdout:3/795: mknod d8/d13/d1f/d62/c118 0 2024-05-09T00:07:37.713 INFO:tasks.workunit.client.1.smithi135.stdout:3/796: fsync d8/d13/d1f/d40/d52/f7d 0 2024-05-09T00:07:37.714 INFO:tasks.workunit.client.1.smithi135.stdout:7/842: creat db/d5b/f116 x:0 0 0 2024-05-09T00:07:37.716 INFO:tasks.workunit.client.1.smithi135.stdout:4/633: symlink dc/d26/d31/db8/dd1/ld3 0 2024-05-09T00:07:37.716 INFO:tasks.workunit.client.1.smithi135.stdout:4/634: readlink dc/d4a/d69/d55/d5f/d5a/l5e 0 2024-05-09T00:07:37.717 INFO:tasks.workunit.client.0.smithi026.stdout:2/108: unlink c7 0 2024-05-09T00:07:37.718 INFO:tasks.workunit.client.0.smithi026.stdout:6/95: mkdir d15/d1e/d20 0 2024-05-09T00:07:37.719 INFO:tasks.workunit.client.1.smithi135.stdout:1/735: rmdir da/d24/d27 39 2024-05-09T00:07:37.719 INFO:tasks.workunit.client.1.smithi135.stdout:1/736: truncate da/d14/d20/d38/d3a/d40/f8a 1982257 0 2024-05-09T00:07:37.719 INFO:tasks.workunit.client.0.smithi026.stdout:7/163: truncate d8/fa 3892165 0 2024-05-09T00:07:37.721 INFO:tasks.workunit.client.1.smithi135.stdout:5/789: mkdir db/d24/db0/dcd/df7 0 2024-05-09T00:07:37.721 INFO:tasks.workunit.client.0.smithi026.stdout:5/123: creat d2/d8/df/f25 x:0 0 0 2024-05-09T00:07:37.723 INFO:tasks.workunit.client.1.smithi135.stdout:9/644: link d1/d24/d86/f96 d1/fcd 0 2024-05-09T00:07:37.724 INFO:tasks.workunit.client.0.smithi026.stdout:8/128: mkdir de/d17/d27 0 2024-05-09T00:07:37.726 INFO:tasks.workunit.client.0.smithi026.stdout:2/109: rename d14/d15/d17/c21 to d14/d15/d1f/c2b 0 2024-05-09T00:07:37.729 INFO:tasks.workunit.client.1.smithi135.stdout:0/741: rename d3/dd/d3f/d58/dae/cbb to d3/dd/d3f/d3a/da4/dc1/cd8 0 2024-05-09T00:07:37.729 INFO:tasks.workunit.client.0.smithi026.stdout:7/164: mknod d8/d12/d1e/c30 0 2024-05-09T00:07:37.729 INFO:tasks.workunit.client.0.smithi026.stdout:7/165: stat d8/d12/c2a 0 2024-05-09T00:07:37.730 INFO:tasks.workunit.client.1.smithi135.stdout:8/732: mknod d4/d8/da2/dab/cf8 0 2024-05-09T00:07:37.730 INFO:tasks.workunit.client.1.smithi135.stdout:8/733: truncate d4/d7/de/f7d 725152 0 2024-05-09T00:07:37.731 INFO:tasks.workunit.client.0.smithi026.stdout:5/124: mkdir d2/d8/d26 0 2024-05-09T00:07:37.735 INFO:tasks.workunit.client.0.smithi026.stdout:6/96: rename f9 to d15/d1e/d20/f21 0 2024-05-09T00:07:37.736 INFO:tasks.workunit.client.1.smithi135.stdout:2/745: creat d1/d12/d20/d2b/d56/fff x:0 0 0 2024-05-09T00:07:37.736 INFO:tasks.workunit.client.1.smithi135.stdout:2/746: getdents d1/d12/d20/d2b/d7c/db5/dfd 0 2024-05-09T00:07:37.737 INFO:tasks.workunit.client.0.smithi026.stdout:2/110: symlink d14/d15/d17/l2c 0 2024-05-09T00:07:37.738 INFO:tasks.workunit.client.1.smithi135.stdout:2/747: read d1/d12/f24 [34216,57373] 0 2024-05-09T00:07:37.738 INFO:tasks.workunit.client.1.smithi135.stdout:2/748: chown d1/d12/d20/d2b/d56/d86 2143763 1 2024-05-09T00:07:37.738 INFO:tasks.workunit.client.1.smithi135.stdout:3/797: creat d8/d13/d75/f119 x:0 0 0 2024-05-09T00:07:37.740 INFO:tasks.workunit.client.0.smithi026.stdout:7/166: creat d8/d12/d22/f31 x:0 0 0 2024-05-09T00:07:37.745 INFO:tasks.workunit.client.1.smithi135.stdout:7/843: unlink db/dd/d33/d68/d10a/d3a/d40/d7e/fe0 0 2024-05-09T00:07:37.746 INFO:tasks.workunit.client.1.smithi135.stdout:8/734: dread d4/d7/d33/fea [0,4194304] 0 2024-05-09T00:07:37.748 INFO:tasks.workunit.client.1.smithi135.stdout:4/635: symlink dc/dd/ld4 0 2024-05-09T00:07:37.750 INFO:tasks.workunit.client.0.smithi026.stdout:5/125: rename d2/d8/df/f25 to d2/d8/d26/f27 0 2024-05-09T00:07:37.755 INFO:tasks.workunit.client.0.smithi026.stdout:7/167: creat d8/d12/d1e/f32 x:0 0 0 2024-05-09T00:07:37.755 INFO:tasks.workunit.client.0.smithi026.stdout:7/168: chown d8/d12/c23 977 1 2024-05-09T00:07:37.755 INFO:tasks.workunit.client.0.smithi026.stdout:7/169: truncate d8/d12/d1e/f32 392093 0 2024-05-09T00:07:37.756 INFO:tasks.workunit.client.1.smithi135.stdout:9/645: dwrite d1/d1a/d10/d3c/d5c/fab [0,4194304] 0 2024-05-09T00:07:37.756 INFO:tasks.workunit.client.1.smithi135.stdout:1/737: symlink da/d24/dd0/l106 0 2024-05-09T00:07:37.757 INFO:tasks.workunit.client.1.smithi135.stdout:5/790: link db/d84/d62/d73/d9c/lee db/d5d/deb/lf8 0 2024-05-09T00:07:37.759 INFO:tasks.workunit.client.0.smithi026.stdout:8/129: dwrite de/f16 [0,4194304] 0 2024-05-09T00:07:37.759 INFO:tasks.workunit.client.1.smithi135.stdout:0/742: truncate d3/dd/d2d/f96 273983 0 2024-05-09T00:07:37.759 INFO:tasks.workunit.client.1.smithi135.stdout:0/743: write d3/dd/d2d/f6e [1521385,27206] 0 2024-05-09T00:07:37.760 INFO:tasks.workunit.client.0.smithi026.stdout:6/97: dwrite d15/f18 [0,4194304] 0 2024-05-09T00:07:37.762 INFO:tasks.workunit.client.1.smithi135.stdout:0/744: write d3/dd/f1b [436871,77901] 0 2024-05-09T00:07:37.762 INFO:tasks.workunit.client.0.smithi026.stdout:5/126: mkdir d2/d8/df/d28 0 2024-05-09T00:07:37.764 INFO:tasks.workunit.client.1.smithi135.stdout:6/764: dread d2/da/d49/da4/fc7 [0,4194304] 0 2024-05-09T00:07:37.764 INFO:tasks.workunit.client.1.smithi135.stdout:6/765: dread - d2/da/d26/d57/ddc/ff5 zero size 2024-05-09T00:07:37.767 INFO:tasks.workunit.client.1.smithi135.stdout:2/749: getdents d1/d12/d20/d2b/d7c 0 2024-05-09T00:07:37.769 INFO:tasks.workunit.client.1.smithi135.stdout:4/636: getdents dc/d4a/d69/d55/d5f 0 2024-05-09T00:07:37.770 INFO:tasks.workunit.client.0.smithi026.stdout:8/130: mkdir de/d17/d21/d24/d28 0 2024-05-09T00:07:37.771 INFO:tasks.workunit.client.0.smithi026.stdout:8/131: write f3 [3850323,101955] 0 2024-05-09T00:07:37.771 INFO:tasks.workunit.client.0.smithi026.stdout:8/132: write de/d17/d21/f22 [885921,120472] 0 2024-05-09T00:07:37.772 INFO:tasks.workunit.client.0.smithi026.stdout:8/133: truncate de/d17/d21/d24/f26 397491 0 2024-05-09T00:07:37.777 INFO:tasks.workunit.client.1.smithi135.stdout:5/791: symlink db/d84/d31/d5e/ddf/lf9 0 2024-05-09T00:07:37.777 INFO:tasks.workunit.client.1.smithi135.stdout:5/792: chown db/d84/d31/d5e/ddf 428 1 2024-05-09T00:07:37.777 INFO:tasks.workunit.client.1.smithi135.stdout:5/793: truncate db/d5d/f6d 817328 0 2024-05-09T00:07:37.778 INFO:tasks.workunit.client.1.smithi135.stdout:5/794: write db/d24/d32/f44 [1430072,106051] 0 2024-05-09T00:07:37.779 INFO:tasks.workunit.client.1.smithi135.stdout:6/766: getdents d2/da/d49/da4 0 2024-05-09T00:07:37.781 INFO:tasks.workunit.client.1.smithi135.stdout:2/750: creat d1/d12/d21/d41/d6d/db4/f100 x:0 0 0 2024-05-09T00:07:37.781 INFO:tasks.workunit.client.1.smithi135.stdout:2/751: write d1/d12/d21/d41/d6d/d6e/fbf [434748,98520] 0 2024-05-09T00:07:37.781 INFO:tasks.workunit.client.1.smithi135.stdout:2/752: fsync d1/d12/d20/d2b/d56/f89 0 2024-05-09T00:07:37.782 INFO:tasks.workunit.client.1.smithi135.stdout:4/637: creat dc/d4a/d8c/da5/fd5 x:0 0 0 2024-05-09T00:07:37.783 INFO:tasks.workunit.client.1.smithi135.stdout:1/738: mkdir da/db/d107 0 2024-05-09T00:07:37.784 INFO:tasks.workunit.client.1.smithi135.stdout:1/739: chown da/db/d16/ca6 2046448823 1 2024-05-09T00:07:37.788 INFO:tasks.workunit.client.1.smithi135.stdout:6/767: mknod d2/d20/d3f/d4f/c107 0 2024-05-09T00:07:37.791 INFO:tasks.workunit.client.1.smithi135.stdout:4/638: link dc/d4a/d8c/l8b dc/d71/d90/ld6 0 2024-05-09T00:07:37.792 INFO:tasks.workunit.client.1.smithi135.stdout:1/740: creat da/d14/d20/d38/d3a/f108 x:0 0 0 2024-05-09T00:07:37.793 INFO:tasks.workunit.client.1.smithi135.stdout:1/741: chown da/ff1 1191 1 2024-05-09T00:07:37.793 INFO:tasks.workunit.client.1.smithi135.stdout:4/639: mkdir dc/d4a/d69/d55/dc9/dd7 0 2024-05-09T00:07:37.793 INFO:tasks.workunit.client.1.smithi135.stdout:1/742: symlink da/d24/d27/d33/d7d/l109 0 2024-05-09T00:07:37.794 INFO:tasks.workunit.client.1.smithi135.stdout:1/743: dread - da/d14/d20/d38/d3a/f108 zero size 2024-05-09T00:07:37.795 INFO:tasks.workunit.client.1.smithi135.stdout:1/744: creat da/db/d16/df2/f10a x:0 0 0 2024-05-09T00:07:37.797 INFO:tasks.workunit.client.0.smithi026.stdout:2/111: dwrite f9 [0,4194304] 0 2024-05-09T00:07:37.797 INFO:tasks.workunit.client.0.smithi026.stdout:2/112: write d14/d15/f1b [709958,45401] 0 2024-05-09T00:07:37.799 INFO:tasks.workunit.client.1.smithi135.stdout:7/844: dwrite db/d13/f73 [0,4194304] 0 2024-05-09T00:07:37.799 INFO:tasks.workunit.client.1.smithi135.stdout:7/845: fsync db/dd/d33/f3d 0 2024-05-09T00:07:37.800 INFO:tasks.workunit.client.0.smithi026.stdout:2/113: creat d14/d15/d1f/f2d x:0 0 0 2024-05-09T00:07:37.804 INFO:tasks.workunit.client.0.smithi026.stdout:2/114: link d14/d15/c16 d14/d15/d17/c2e 0 2024-05-09T00:07:37.804 INFO:tasks.workunit.client.0.smithi026.stdout:2/115: chown d14/d15/c16 0 1 2024-05-09T00:07:37.805 INFO:tasks.workunit.client.1.smithi135.stdout:8/735: dwrite d4/f20 [0,4194304] 0 2024-05-09T00:07:37.805 INFO:tasks.workunit.client.1.smithi135.stdout:3/798: dwrite d8/d13/d75/d58/f9e [0,4194304] 0 2024-05-09T00:07:37.805 INFO:tasks.workunit.client.1.smithi135.stdout:3/799: write d8/d13/d1f/f2f [384601,41223] 0 2024-05-09T00:07:37.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/646: dwrite d1/d24/d44/d54/d66/f71 [0,4194304] 0 2024-05-09T00:07:37.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/647: truncate d1/d24/d44/d7f/f9f 855258 0 2024-05-09T00:07:37.807 INFO:tasks.workunit.client.0.smithi026.stdout:7/170: dwrite d8/fc [0,4194304] 0 2024-05-09T00:07:37.808 INFO:tasks.workunit.client.1.smithi135.stdout:2/753: dwrite d1/d12/d20/d2b/d56/d72/fb9 [0,4194304] 0 2024-05-09T00:07:37.810 INFO:tasks.workunit.client.1.smithi135.stdout:1/745: dwrite da/d14/d20/fb2 [0,4194304] 0 2024-05-09T00:07:37.811 INFO:tasks.workunit.client.1.smithi135.stdout:8/736: creat d4/d7/d2a/d9f/ff9 x:0 0 0 2024-05-09T00:07:37.815 INFO:tasks.workunit.client.1.smithi135.stdout:3/800: mknod d8/d102/d63/db9/c11a 0 2024-05-09T00:07:37.815 INFO:tasks.workunit.client.1.smithi135.stdout:3/801: getdents d8/d6d/d44/d4b/da0/daa/d88/df5 0 2024-05-09T00:07:37.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/802: dread - d8/d13/d1f/fda zero size 2024-05-09T00:07:37.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/803: fdatasync d8/d6d/d44/d4b/da0/daa/d88/f115 0 2024-05-09T00:07:37.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/804: readlink d8/d102/d63/db9/lc7 0 2024-05-09T00:07:37.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/805: fdatasync d8/d13/d1f/d40/fee 0 2024-05-09T00:07:37.822 INFO:tasks.workunit.client.1.smithi135.stdout:2/754: symlink d1/d12/d27/l101 0 2024-05-09T00:07:37.822 INFO:tasks.workunit.client.1.smithi135.stdout:2/755: chown d1/lc4 0 1 2024-05-09T00:07:37.822 INFO:tasks.workunit.client.1.smithi135.stdout:2/756: fdatasync d1/d12/d21/f42 0 2024-05-09T00:07:37.822 INFO:tasks.workunit.client.1.smithi135.stdout:2/757: dread - d1/d12/d21/d57/ff4 zero size 2024-05-09T00:07:37.825 INFO:tasks.workunit.client.0.smithi026.stdout:6/98: getdents d15/d1e/d20 0 2024-05-09T00:07:37.828 INFO:tasks.workunit.client.0.smithi026.stdout:6/99: rmdir d15/d1e 39 2024-05-09T00:07:37.828 INFO:tasks.workunit.client.0.smithi026.stdout:6/100: write f11 [416264,124422] 0 2024-05-09T00:07:37.828 INFO:tasks.workunit.client.0.smithi026.stdout:6/101: read - d15/f1f zero size 2024-05-09T00:07:37.833 INFO:tasks.workunit.client.0.smithi026.stdout:5/127: rename d2/d8/d26/f27 to d2/d8/d26/f29 0 2024-05-09T00:07:37.833 INFO:tasks.workunit.client.0.smithi026.stdout:5/128: chown d2/c11 1024873931 1 2024-05-09T00:07:37.837 INFO:tasks.workunit.client.1.smithi135.stdout:1/746: dwrite da/d14/d20/f2b [4194304,4194304] 0 2024-05-09T00:07:37.837 INFO:tasks.workunit.client.1.smithi135.stdout:1/747: readlink da/d24/d27/d33/d36/l8c 0 2024-05-09T00:07:37.837 INFO:tasks.workunit.client.1.smithi135.stdout:1/748: chown da/d14/d20/d38/d3a/d40/d75/c7b 1394404927 1 2024-05-09T00:07:37.838 INFO:tasks.workunit.client.0.smithi026.stdout:5/129: dread d2/fc [0,4194304] 0 2024-05-09T00:07:37.838 INFO:tasks.workunit.client.0.smithi026.stdout:5/130: dread - d2/d8/d26/f29 zero size 2024-05-09T00:07:37.838 INFO:tasks.workunit.client.0.smithi026.stdout:5/131: dread - d2/d8/d26/f29 zero size 2024-05-09T00:07:37.839 INFO:tasks.workunit.client.1.smithi135.stdout:5/795: rename db/d84/d62/d73 to db/d24/d32/dfa 0 2024-05-09T00:07:37.840 INFO:tasks.workunit.client.0.smithi026.stdout:5/132: stat d2/d8/df/l1a 0 2024-05-09T00:07:37.844 INFO:tasks.workunit.client.1.smithi135.stdout:8/737: getdents d4/d7/d4a 0 2024-05-09T00:07:37.847 INFO:tasks.workunit.client.1.smithi135.stdout:3/806: mkdir d8/d6d/d11b 0 2024-05-09T00:07:37.851 INFO:tasks.workunit.client.1.smithi135.stdout:4/640: rename dc/dd/f7e to dc/d71/d86/fd8 0 2024-05-09T00:07:37.852 INFO:tasks.workunit.client.1.smithi135.stdout:5/796: getdents db/d24/d32/dfa/d9c/d9f/d92 0 2024-05-09T00:07:37.853 INFO:tasks.workunit.client.0.smithi026.stdout:2/116: dwrite d14/d15/d1f/f2d [0,4194304] 0 2024-05-09T00:07:37.854 INFO:tasks.workunit.client.1.smithi135.stdout:3/807: creat d8/d6d/d44/d4b/d69/f11c x:0 0 0 2024-05-09T00:07:37.854 INFO:tasks.workunit.client.1.smithi135.stdout:6/768: dwrite d2/da/d26/d57/d60/fbe [0,4194304] 0 2024-05-09T00:07:37.854 INFO:tasks.workunit.client.1.smithi135.stdout:2/758: dwrite d1/d12/d20/d2b/d56/d72/fb2 [0,4194304] 0 2024-05-09T00:07:37.858 INFO:tasks.workunit.client.0.smithi026.stdout:7/171: dwrite d8/fc [0,4194304] 0 2024-05-09T00:07:37.859 INFO:tasks.workunit.client.1.smithi135.stdout:7/846: rename db/dd/d33/d68/d10a/d3a/d40/d4c/d67/lad to db/dd/d33/d68/d10a/d3a/d40/d84/l117 0 2024-05-09T00:07:37.859 INFO:tasks.workunit.client.1.smithi135.stdout:8/738: dread d4/d8/da2/fa9 [0,4194304] 0 2024-05-09T00:07:37.859 INFO:tasks.workunit.client.1.smithi135.stdout:7/847: read db/da8/f86 [3172508,4293] 0 2024-05-09T00:07:37.859 INFO:tasks.workunit.client.1.smithi135.stdout:2/759: dread d1/d12/d21/f9f [0,4194304] 0 2024-05-09T00:07:37.859 INFO:tasks.workunit.client.0.smithi026.stdout:2/117: dread d14/d15/f1b [0,4194304] 0 2024-05-09T00:07:37.860 INFO:tasks.workunit.client.1.smithi135.stdout:5/797: creat db/d24/d32/d5b/d91/ffb x:0 0 0 2024-05-09T00:07:37.860 INFO:tasks.workunit.client.1.smithi135.stdout:5/798: chown db/d84/d31/d5e/c7d 1 1 2024-05-09T00:07:37.862 INFO:tasks.workunit.client.0.smithi026.stdout:6/102: dwrite d15/f18 [4194304,4194304] 0 2024-05-09T00:07:37.862 INFO:tasks.workunit.client.0.smithi026.stdout:6/103: chown d15/l19 827247 1 2024-05-09T00:07:37.863 INFO:tasks.workunit.client.0.smithi026.stdout:7/172: symlink d8/d12/d22/l33 0 2024-05-09T00:07:37.866 INFO:tasks.workunit.client.1.smithi135.stdout:3/808: truncate d8/d6d/d44/d4b/d69/f4d 1118628 0 2024-05-09T00:07:37.866 INFO:tasks.workunit.client.1.smithi135.stdout:3/809: write d8/d6d/d24/d106/f117 [30665,51576] 0 2024-05-09T00:07:37.868 INFO:tasks.workunit.client.1.smithi135.stdout:6/769: mknod d2/da/d49/da4/dce/dd8/c108 0 2024-05-09T00:07:37.868 INFO:tasks.workunit.client.1.smithi135.stdout:6/770: chown d2/d20/d3f/d4f/c107 0 1 2024-05-09T00:07:37.868 INFO:tasks.workunit.client.1.smithi135.stdout:6/771: truncate d2/d20/d37/d4e/f6a 430427 0 2024-05-09T00:07:37.869 INFO:tasks.workunit.client.1.smithi135.stdout:5/799: dread db/d5d/fa3 [0,4194304] 0 2024-05-09T00:07:37.869 INFO:tasks.workunit.client.1.smithi135.stdout:5/800: stat db/cc 0 2024-05-09T00:07:37.870 INFO:tasks.workunit.client.0.smithi026.stdout:6/104: rename d15/l16 to d15/d1e/l22 0 2024-05-09T00:07:37.870 INFO:tasks.workunit.client.0.smithi026.stdout:6/105: chown d15/c1a 124 1 2024-05-09T00:07:37.873 INFO:tasks.workunit.client.0.smithi026.stdout:2/118: symlink d14/l2f 0 2024-05-09T00:07:37.873 INFO:tasks.workunit.client.0.smithi026.stdout:2/119: stat d14/c1e 0 2024-05-09T00:07:37.876 INFO:tasks.workunit.client.1.smithi135.stdout:4/641: symlink dc/ld9 0 2024-05-09T00:07:37.876 INFO:tasks.workunit.client.1.smithi135.stdout:5/801: dread db/d24/d32/d5b/d91/fd3 [0,4194304] 0 2024-05-09T00:07:37.876 INFO:tasks.workunit.client.0.smithi026.stdout:7/173: rename d8/fc to d8/d1b/f34 0 2024-05-09T00:07:37.877 INFO:tasks.workunit.client.1.smithi135.stdout:4/642: write dc/d4a/f50 [250293,73603] 0 2024-05-09T00:07:37.877 INFO:tasks.workunit.client.1.smithi135.stdout:9/648: rename d1/d24/c60 to d1/d24/d44/d7f/cce 0 2024-05-09T00:07:37.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/120: mkdir d14/d15/d30 0 2024-05-09T00:07:37.880 INFO:tasks.workunit.client.0.smithi026.stdout:7/174: symlink d8/d12/d22/l35 0 2024-05-09T00:07:37.881 INFO:tasks.workunit.client.0.smithi026.stdout:0/197: sync 2024-05-09T00:07:37.881 INFO:tasks.workunit.client.0.smithi026.stdout:0/198: truncate d1d/d1e/d2d/f3b 617826 0 2024-05-09T00:07:37.881 INFO:tasks.workunit.client.0.smithi026.stdout:0/199: chown d1d/d1e/d20/f28 47 1 2024-05-09T00:07:37.882 INFO:tasks.workunit.client.1.smithi135.stdout:8/739: link d4/d7/d33/fea d4/dc6/ffa 0 2024-05-09T00:07:37.882 INFO:tasks.workunit.client.1.smithi135.stdout:7/848: symlink db/dd/d33/d58/db5/l118 0 2024-05-09T00:07:37.883 INFO:tasks.workunit.client.1.smithi135.stdout:8/740: write d4/d7/f74 [1563867,87489] 0 2024-05-09T00:07:37.884 INFO:tasks.workunit.client.0.smithi026.stdout:2/121: rename l0 to d14/d22/l31 0 2024-05-09T00:07:37.885 INFO:tasks.workunit.client.0.smithi026.stdout:7/175: mknod d8/d12/d1e/c36 0 2024-05-09T00:07:37.886 INFO:tasks.workunit.client.1.smithi135.stdout:2/760: symlink d1/d12/d21/db1/l102 0 2024-05-09T00:07:37.887 INFO:tasks.workunit.client.1.smithi135.stdout:6/772: creat d2/da/f109 x:0 0 0 2024-05-09T00:07:37.889 INFO:tasks.workunit.client.0.smithi026.stdout:0/200: mkdir d1d/d25/d3c 0 2024-05-09T00:07:37.889 INFO:tasks.workunit.client.0.smithi026.stdout:0/201: write f5 [1881525,49093] 0 2024-05-09T00:07:37.889 INFO:tasks.workunit.client.0.smithi026.stdout:0/202: write d1d/d33/f3a [169905,14516] 0 2024-05-09T00:07:37.889 INFO:tasks.workunit.client.0.smithi026.stdout:0/203: write d1d/d33/f3a [402733,40306] 0 2024-05-09T00:07:37.890 INFO:tasks.workunit.client.0.smithi026.stdout:0/204: write d1d/d33/f36 [2091940,53559] 0 2024-05-09T00:07:37.891 INFO:tasks.workunit.client.1.smithi135.stdout:6/773: dread d2/d5f/f6d [0,4194304] 0 2024-05-09T00:07:37.891 INFO:tasks.workunit.client.1.smithi135.stdout:6/774: dread - d2/da/d1d/d69/d89/f8e zero size 2024-05-09T00:07:37.891 INFO:tasks.workunit.client.1.smithi135.stdout:6/775: write d2/da/d26/d57/d59/d62/fbb [77920,95051] 0 2024-05-09T00:07:37.891 INFO:tasks.workunit.client.1.smithi135.stdout:6/776: write d2/da/d1d/d69/d89/ffb [162274,96419] 0 2024-05-09T00:07:37.892 INFO:tasks.workunit.client.1.smithi135.stdout:6/777: write d2/d20/d37/d4e/d7c/fd6 [355611,36670] 0 2024-05-09T00:07:37.895 INFO:tasks.workunit.client.0.smithi026.stdout:2/122: unlink f6 0 2024-05-09T00:07:37.896 INFO:tasks.workunit.client.1.smithi135.stdout:5/802: creat db/d5d/dac/ddc/dbf/de3/ffc x:0 0 0 2024-05-09T00:07:37.897 INFO:tasks.workunit.client.0.smithi026.stdout:7/176: creat d8/d1b/f37 x:0 0 0 2024-05-09T00:07:37.899 INFO:tasks.workunit.client.1.smithi135.stdout:9/649: rename d1/d1a/d2c/d2d/f3b to d1/d24/d86/d97/fcf 0 2024-05-09T00:07:37.900 INFO:tasks.workunit.client.0.smithi026.stdout:0/205: getdents d1d/d1e/d20 0 2024-05-09T00:07:37.902 INFO:tasks.workunit.client.1.smithi135.stdout:7/849: symlink db/dd/d33/d68/d10a/d3a/d40/d4c/l119 0 2024-05-09T00:07:37.902 INFO:tasks.workunit.client.1.smithi135.stdout:7/850: write f8 [3536136,15089] 0 2024-05-09T00:07:37.903 INFO:tasks.workunit.client.0.smithi026.stdout:5/133: unlink d2/d8/d26/f29 0 2024-05-09T00:07:37.903 INFO:tasks.workunit.client.0.smithi026.stdout:2/123: mknod d14/d22/c32 0 2024-05-09T00:07:37.904 INFO:tasks.workunit.client.1.smithi135.stdout:7/851: write db/d13/f57 [3948601,63991] 0 2024-05-09T00:07:37.905 INFO:tasks.workunit.client.0.smithi026.stdout:7/177: symlink d8/d1b/l38 0 2024-05-09T00:07:37.905 INFO:tasks.workunit.client.0.smithi026.stdout:7/178: write d8/d12/d22/d29/f1c [1231314,32728] 0 2024-05-09T00:07:37.905 INFO:tasks.workunit.client.0.smithi026.stdout:7/179: chown c4 228 1 2024-05-09T00:07:37.906 INFO:tasks.workunit.client.0.smithi026.stdout:6/106: dwrite f4 [0,4194304] 0 2024-05-09T00:07:37.906 INFO:tasks.workunit.client.1.smithi135.stdout:2/761: creat d1/d12/d20/d2b/d56/f103 x:0 0 0 2024-05-09T00:07:37.906 INFO:tasks.workunit.client.1.smithi135.stdout:2/762: write d1/d12/d21/d41/d6d/db4/f100 [708347,123705] 0 2024-05-09T00:07:37.907 INFO:tasks.workunit.client.0.smithi026.stdout:7/180: write d8/d12/f25 [135799,73939] 0 2024-05-09T00:07:37.907 INFO:tasks.workunit.client.1.smithi135.stdout:8/741: dwrite d4/d22/f8c [0,4194304] 0 2024-05-09T00:07:37.907 INFO:tasks.workunit.client.1.smithi135.stdout:8/742: stat d4/d7/d33/c93 0 2024-05-09T00:07:37.907 INFO:tasks.workunit.client.0.smithi026.stdout:7/181: write d8/f1f [855504,126864] 0 2024-05-09T00:07:37.908 INFO:tasks.workunit.client.1.smithi135.stdout:2/763: dread d1/d12/d20/d2b/fac [0,4194304] 0 2024-05-09T00:07:37.909 INFO:tasks.workunit.client.0.smithi026.stdout:0/206: mknod d1d/d1e/d2d/c3d 0 2024-05-09T00:07:37.910 INFO:tasks.workunit.client.1.smithi135.stdout:9/650: dread d1/f59 [0,4194304] 0 2024-05-09T00:07:37.912 INFO:tasks.workunit.client.0.smithi026.stdout:5/134: rename d2/d8/df/d28 to d2/d8/d2a 0 2024-05-09T00:07:37.912 INFO:tasks.workunit.client.0.smithi026.stdout:5/135: write d2/d8/df/f1f [535075,77407] 0 2024-05-09T00:07:37.915 INFO:tasks.workunit.client.0.smithi026.stdout:2/124: creat d14/d22/f33 x:0 0 0 2024-05-09T00:07:37.916 INFO:tasks.workunit.client.1.smithi135.stdout:4/643: dwrite dc/d4a/d69/d39/f9b [0,4194304] 0 2024-05-09T00:07:37.916 INFO:tasks.workunit.client.1.smithi135.stdout:7/852: dread db/dd/f35 [0,4194304] 0 2024-05-09T00:07:37.916 INFO:tasks.workunit.client.1.smithi135.stdout:7/853: chown db/dd/d33/d68/d10a/d3a/d40/d7e/f112 5624 1 2024-05-09T00:07:37.917 INFO:tasks.workunit.client.1.smithi135.stdout:4/644: read dc/dd/f11 [503971,42060] 0 2024-05-09T00:07:37.917 INFO:tasks.workunit.client.1.smithi135.stdout:4/645: truncate dc/d26/d31/db6/fc7 990134 0 2024-05-09T00:07:37.920 INFO:tasks.workunit.client.1.smithi135.stdout:8/743: mkdir d4/d8/da2/da6/dde/dfb 0 2024-05-09T00:07:37.920 INFO:tasks.workunit.client.1.smithi135.stdout:8/744: stat d4/d7/lb4 0 2024-05-09T00:07:37.923 INFO:tasks.workunit.client.0.smithi026.stdout:5/136: dread d2/d8/df/f1f [0,4194304] 0 2024-05-09T00:07:37.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/764: creat d1/d12/d21/d41/f104 x:0 0 0 2024-05-09T00:07:37.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/765: dread - d1/d12/d21/db1/fd5 zero size 2024-05-09T00:07:37.925 INFO:tasks.workunit.client.1.smithi135.stdout:5/803: dwrite f4 [0,4194304] 0 2024-05-09T00:07:37.925 INFO:tasks.workunit.client.1.smithi135.stdout:5/804: chown db/d24/d32/dfa/dbe/fe9 385842 1 2024-05-09T00:07:37.925 INFO:tasks.workunit.client.1.smithi135.stdout:5/805: chown db/d3f/fb3 2061400 1 2024-05-09T00:07:37.927 INFO:tasks.workunit.client.0.smithi026.stdout:2/125: dread d14/f18 [0,4194304] 0 2024-05-09T00:07:37.928 INFO:tasks.workunit.client.1.smithi135.stdout:9/651: mknod d1/d24/cd0 0 2024-05-09T00:07:37.928 INFO:tasks.workunit.client.0.smithi026.stdout:2/126: write fd [1158156,29475] 0 2024-05-09T00:07:37.935 INFO:tasks.workunit.client.1.smithi135.stdout:7/854: link db/dd/d33/d68/d10a/d3a/c93 db/d21/d98/c11a 0 2024-05-09T00:07:37.940 INFO:tasks.workunit.client.1.smithi135.stdout:8/745: creat d4/d22/ffc x:0 0 0 2024-05-09T00:07:37.941 INFO:tasks.workunit.client.1.smithi135.stdout:2/766: dwrite d1/d12/d21/d41/d6d/d6e/fbf [0,4194304] 0 2024-05-09T00:07:37.944 INFO:tasks.workunit.client.1.smithi135.stdout:5/806: creat db/d24/d32/dfa/d9c/d9f/d92/ffd x:0 0 0 2024-05-09T00:07:37.947 INFO:tasks.workunit.client.1.smithi135.stdout:9/652: symlink d1/d24/d44/d7f/ld1 0 2024-05-09T00:07:37.950 INFO:tasks.workunit.client.0.smithi026.stdout:7/182: dwrite d8/d1b/f34 [0,4194304] 0 2024-05-09T00:07:37.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/646: mknod dc/d26/d31/cda 0 2024-05-09T00:07:37.950 INFO:tasks.workunit.client.1.smithi135.stdout:6/778: dwrite d2/d20/d37/d4e/d7c/fd6 [0,4194304] 0 2024-05-09T00:07:37.951 INFO:tasks.workunit.client.0.smithi026.stdout:6/107: mkdir d15/d1e/d23 0 2024-05-09T00:07:37.952 INFO:tasks.workunit.client.1.smithi135.stdout:2/767: dread d1/d12/d21/d57/dbd/fd7 [0,4194304] 0 2024-05-09T00:07:37.953 INFO:tasks.workunit.client.1.smithi135.stdout:8/746: creat d4/d8/da2/ffd x:0 0 0 2024-05-09T00:07:37.953 INFO:tasks.workunit.client.1.smithi135.stdout:8/747: dread - d4/d22/fdf zero size 2024-05-09T00:07:37.955 INFO:tasks.workunit.client.0.smithi026.stdout:6/108: write f4 [3049330,55710] 0 2024-05-09T00:07:37.956 INFO:tasks.workunit.client.1.smithi135.stdout:7/855: dwrite db/d5b/f116 [0,4194304] 0 2024-05-09T00:07:37.958 INFO:tasks.workunit.client.0.smithi026.stdout:0/207: rename d1d/d1e/d20/f39 to d1d/d1e/d2d/f3e 0 2024-05-09T00:07:37.964 INFO:tasks.workunit.client.0.smithi026.stdout:5/137: link d2/d8/df/l1a d2/d8/d2a/l2b 0 2024-05-09T00:07:37.965 INFO:tasks.workunit.client.1.smithi135.stdout:5/807: getdents db/d5d/dac/ddc/dbf 0 2024-05-09T00:07:37.966 INFO:tasks.workunit.client.0.smithi026.stdout:2/127: creat d14/d15/d17/f34 x:0 0 0 2024-05-09T00:07:37.969 INFO:tasks.workunit.client.1.smithi135.stdout:9/653: link d1/d1a/d2c/d20/c75 d1/d1a/d10/db3/cd2 0 2024-05-09T00:07:37.972 INFO:tasks.workunit.client.0.smithi026.stdout:5/138: dread d2/d8/df/f12 [0,4194304] 0 2024-05-09T00:07:37.973 INFO:tasks.workunit.client.1.smithi135.stdout:4/647: rename dc/d26/d31/f5d to dc/d71/dba/fdb 0 2024-05-09T00:07:37.973 INFO:tasks.workunit.client.1.smithi135.stdout:4/648: chown dc/d4a/d69/l7c 15473 1 2024-05-09T00:07:37.973 INFO:tasks.workunit.client.1.smithi135.stdout:4/649: chown dc/dd/c8d 7 1 2024-05-09T00:07:37.974 INFO:tasks.workunit.client.1.smithi135.stdout:8/748: dread d4/d7/d33/f55 [4194304,4194304] 0 2024-05-09T00:07:37.980 INFO:tasks.workunit.client.0.smithi026.stdout:7/183: getdents d8/d12/d22/d29 0 2024-05-09T00:07:37.981 INFO:tasks.workunit.client.0.smithi026.stdout:7/184: write f7 [2203622,46258] 0 2024-05-09T00:07:37.990 INFO:tasks.workunit.client.1.smithi135.stdout:6/779: dwrite d2/da/d26/d57/d60/fdf [0,4194304] 0 2024-05-09T00:07:37.991 INFO:tasks.workunit.client.0.smithi026.stdout:0/208: creat d1d/f3f x:0 0 0 2024-05-09T00:07:37.994 INFO:tasks.workunit.client.0.smithi026.stdout:5/139: unlink d2/d8/df/c21 0 2024-05-09T00:07:37.994 INFO:tasks.workunit.client.0.smithi026.stdout:3/104: sync 2024-05-09T00:07:37.999 INFO:tasks.workunit.client.0.smithi026.stdout:0/209: creat d1d/d25/d3c/f40 x:0 0 0 2024-05-09T00:07:37.999 INFO:tasks.workunit.client.0.smithi026.stdout:0/210: chown d1d/d1e/l21 5678745 1 2024-05-09T00:07:37.999 INFO:tasks.workunit.client.0.smithi026.stdout:0/211: readlink d1d/d1e/l21 0 2024-05-09T00:07:38.002 INFO:tasks.workunit.client.1.smithi135.stdout:6/780: dread d2/d20/d3f/f44 [0,4194304] 0 2024-05-09T00:07:38.003 INFO:tasks.workunit.client.0.smithi026.stdout:5/140: link d2/d8/df/f12 d2/d8/d2a/f2c 0 2024-05-09T00:07:38.003 INFO:tasks.workunit.client.0.smithi026.stdout:5/141: chown d2/d8/df/f12 88 1 2024-05-09T00:07:38.005 INFO:tasks.workunit.client.0.smithi026.stdout:3/105: creat d5/d1e/f20 x:0 0 0 2024-05-09T00:07:38.006 INFO:tasks.workunit.client.0.smithi026.stdout:6/109: dwrite f12 [0,4194304] 0 2024-05-09T00:07:38.006 INFO:tasks.workunit.client.0.smithi026.stdout:7/185: truncate d8/d12/d22/d29/f1c 2290 0 2024-05-09T00:07:38.006 INFO:tasks.workunit.client.0.smithi026.stdout:2/128: dwrite fb [0,4194304] 0 2024-05-09T00:07:38.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/654: dwrite d1/d1a/d2c/d20/fb2 [0,4194304] 0 2024-05-09T00:07:38.007 INFO:tasks.workunit.client.1.smithi135.stdout:4/650: truncate fa 3378744 0 2024-05-09T00:07:38.009 INFO:tasks.workunit.client.0.smithi026.stdout:0/212: symlink d1d/d1e/d2d/l41 0 2024-05-09T00:07:38.012 INFO:tasks.workunit.client.0.smithi026.stdout:5/142: symlink d2/d8/df/d24/l2d 0 2024-05-09T00:07:38.014 INFO:tasks.workunit.client.1.smithi135.stdout:8/749: mkdir d4/d7/d2a/d56/dec/dfe 0 2024-05-09T00:07:38.015 INFO:tasks.workunit.client.0.smithi026.stdout:0/213: dread f5 [0,4194304] 0 2024-05-09T00:07:38.015 INFO:tasks.workunit.client.1.smithi135.stdout:8/750: write d4/d7/de/d45/dc5/fcd [643316,97881] 0 2024-05-09T00:07:38.015 INFO:tasks.workunit.client.0.smithi026.stdout:3/106: readlink d5/la 0 2024-05-09T00:07:38.022 INFO:tasks.workunit.client.0.smithi026.stdout:1/122: sync 2024-05-09T00:07:38.022 INFO:tasks.workunit.client.0.smithi026.stdout:4/103: sync 2024-05-09T00:07:38.022 INFO:tasks.workunit.client.0.smithi026.stdout:4/104: write d0/d19/f1e [1897669,98175] 0 2024-05-09T00:07:38.022 INFO:tasks.workunit.client.0.smithi026.stdout:6/110: creat d15/d1e/d23/f24 x:0 0 0 2024-05-09T00:07:38.025 INFO:tasks.workunit.client.1.smithi135.stdout:2/768: mkdir d1/d12/d20/d3b/d105 0 2024-05-09T00:07:38.031 INFO:tasks.workunit.client.0.smithi026.stdout:7/186: creat d8/d12/d22/d29/f39 x:0 0 0 2024-05-09T00:07:38.031 INFO:tasks.workunit.client.0.smithi026.stdout:7/187: fdatasync d8/f1f 0 2024-05-09T00:07:38.031 INFO:tasks.workunit.client.0.smithi026.stdout:3/107: dread d5/d9/dc/f11 [0,4194304] 0 2024-05-09T00:07:38.031 INFO:tasks.workunit.client.1.smithi135.stdout:2/769: write d1/d12/d20/d2b/f37 [1562842,36128] 0 2024-05-09T00:07:38.031 INFO:tasks.workunit.client.1.smithi135.stdout:2/770: stat d1/d12/d20/d2b/d56/d72/fae 0 2024-05-09T00:07:38.032 INFO:tasks.workunit.client.1.smithi135.stdout:9/655: dwrite d1/d24/d44/d54/d66/fac [0,4194304] 0 2024-05-09T00:07:38.033 INFO:tasks.workunit.client.0.smithi026.stdout:0/214: dwrite d1d/d33/f38 [0,4194304] 0 2024-05-09T00:07:38.033 INFO:tasks.workunit.client.0.smithi026.stdout:0/215: write d1d/d1e/f23 [1056070,61542] 0 2024-05-09T00:07:38.034 INFO:tasks.workunit.client.1.smithi135.stdout:4/651: getdents dc/d26/d4e 0 2024-05-09T00:07:38.034 INFO:tasks.workunit.client.0.smithi026.stdout:6/111: dread f1 [0,4194304] 0 2024-05-09T00:07:38.035 INFO:tasks.workunit.client.0.smithi026.stdout:5/143: mkdir d2/d8/df/d2e 0 2024-05-09T00:07:38.035 INFO:tasks.workunit.client.0.smithi026.stdout:5/144: chown d2/l6 214863938 1 2024-05-09T00:07:38.035 INFO:tasks.workunit.client.0.smithi026.stdout:5/145: readlink d2/l6 0 2024-05-09T00:07:38.038 INFO:tasks.workunit.client.0.smithi026.stdout:1/123: dread f3 [4194304,4194304] 0 2024-05-09T00:07:38.043 INFO:tasks.workunit.client.0.smithi026.stdout:7/188: mknod d8/d12/d22/c3a 0 2024-05-09T00:07:38.045 INFO:tasks.workunit.client.1.smithi135.stdout:2/771: fdatasync d1/d12/f8d 0 2024-05-09T00:07:38.048 INFO:tasks.workunit.client.0.smithi026.stdout:1/124: write d5/f7 [4958294,102371] 0 2024-05-09T00:07:38.048 INFO:tasks.workunit.client.0.smithi026.stdout:1/125: write d5/db/f1e [1008512,20717] 0 2024-05-09T00:07:38.048 INFO:tasks.workunit.client.0.smithi026.stdout:2/129: mknod d14/d15/d1f/c35 0 2024-05-09T00:07:38.050 INFO:tasks.workunit.client.0.smithi026.stdout:1/126: write d5/d16/f19 [120192,16406] 0 2024-05-09T00:07:38.050 INFO:tasks.workunit.client.0.smithi026.stdout:0/216: unlink d1d/d25/l34 0 2024-05-09T00:07:38.053 INFO:tasks.workunit.client.1.smithi135.stdout:9/656: creat d1/d1a/d2c/d20/fd3 x:0 0 0 2024-05-09T00:07:38.054 INFO:tasks.workunit.client.1.smithi135.stdout:4/652: dwrite dc/d4a/d69/f67 [0,4194304] 0 2024-05-09T00:07:38.054 INFO:tasks.workunit.client.0.smithi026.stdout:5/146: dwrite d2/d8/df/f18 [0,4194304] 0 2024-05-09T00:07:38.056 INFO:tasks.workunit.client.1.smithi135.stdout:2/772: dread d1/d22/d63/f97 [0,4194304] 0 2024-05-09T00:07:38.057 INFO:tasks.workunit.client.0.smithi026.stdout:4/105: rename d0/d12/f15 to d0/f22 0 2024-05-09T00:07:38.057 INFO:tasks.workunit.client.0.smithi026.stdout:4/106: dread - d0/f1f zero size 2024-05-09T00:07:38.058 INFO:tasks.workunit.client.1.smithi135.stdout:3/810: sync 2024-05-09T00:07:38.058 INFO:tasks.workunit.client.1.smithi135.stdout:0/745: sync 2024-05-09T00:07:38.058 INFO:tasks.workunit.client.1.smithi135.stdout:1/749: sync 2024-05-09T00:07:38.058 INFO:tasks.workunit.client.1.smithi135.stdout:1/750: chown da/d73/f78 0 1 2024-05-09T00:07:38.058 INFO:tasks.workunit.client.1.smithi135.stdout:3/811: write d8/d13/d75/d58/ff9 [480975,513] 0 2024-05-09T00:07:38.059 INFO:tasks.workunit.client.0.smithi026.stdout:5/147: dread d2/f3 [0,4194304] 0 2024-05-09T00:07:38.059 INFO:tasks.workunit.client.1.smithi135.stdout:9/657: symlink d1/d1a/d89/dad/ld4 0 2024-05-09T00:07:38.060 INFO:tasks.workunit.client.0.smithi026.stdout:7/189: mknod d8/c3b 0 2024-05-09T00:07:38.060 INFO:tasks.workunit.client.0.smithi026.stdout:6/112: dwrite d15/f1d [0,4194304] 0 2024-05-09T00:07:38.065 INFO:tasks.workunit.client.1.smithi135.stdout:4/653: rename dc/d26/d31/d96/lb3 to dc/d4a/d69/d55/d6d/ldc 0 2024-05-09T00:07:38.067 INFO:tasks.workunit.client.0.smithi026.stdout:0/217: symlink d1d/d1e/d20/l42 0 2024-05-09T00:07:38.069 INFO:tasks.workunit.client.1.smithi135.stdout:0/746: mkdir d3/dd/d3f/d3a/da4/dd9 0 2024-05-09T00:07:38.069 INFO:tasks.workunit.client.1.smithi135.stdout:0/747: stat d3/dd/d3f/d3a/ca1 0 2024-05-09T00:07:38.069 INFO:tasks.workunit.client.1.smithi135.stdout:0/748: chown d3/dd/d2d/db5/lab 3 1 2024-05-09T00:07:38.069 INFO:tasks.workunit.client.1.smithi135.stdout:0/749: fsync d3/dd/d3f/f33 0 2024-05-09T00:07:38.072 INFO:tasks.workunit.client.1.smithi135.stdout:1/751: symlink da/d24/d27/d33/d52/dfc/l10b 0 2024-05-09T00:07:38.072 INFO:tasks.workunit.client.1.smithi135.stdout:1/752: chown da/d73/f78 1016193617 1 2024-05-09T00:07:38.073 INFO:tasks.workunit.client.1.smithi135.stdout:3/812: rmdir d8/d102/d92 39 2024-05-09T00:07:38.073 INFO:tasks.workunit.client.1.smithi135.stdout:3/813: chown d8/d13/d75/la7 423357345 1 2024-05-09T00:07:38.073 INFO:tasks.workunit.client.1.smithi135.stdout:3/814: dread - d8/d13/d1f/d40/fee zero size 2024-05-09T00:07:38.074 INFO:tasks.workunit.client.1.smithi135.stdout:1/753: write da/d14/d20/d38/d3a/db7/dc6/d93/de8/fea [4063375,3081] 0 2024-05-09T00:07:38.074 INFO:tasks.workunit.client.1.smithi135.stdout:1/754: fsync da/d14/d20/f7c 0 2024-05-09T00:07:38.074 INFO:tasks.workunit.client.1.smithi135.stdout:8/751: getdents d4/d7/d2a/d56/dec 0 2024-05-09T00:07:38.075 INFO:tasks.workunit.client.1.smithi135.stdout:9/658: getdents d1/d24/d86/d97 0 2024-05-09T00:07:38.076 INFO:tasks.workunit.client.0.smithi026.stdout:5/148: mknod d2/d8/c2f 0 2024-05-09T00:07:38.077 INFO:tasks.workunit.client.1.smithi135.stdout:2/773: dwrite d1/d12/d20/d2b/d56/d72/fb9 [4194304,4194304] 0 2024-05-09T00:07:38.077 INFO:tasks.workunit.client.1.smithi135.stdout:2/774: readlink d1/d12/d21/dc7/le5 0 2024-05-09T00:07:38.077 INFO:tasks.workunit.client.0.smithi026.stdout:7/190: dread d8/d12/d22/d29/f1c [0,4194304] 0 2024-05-09T00:07:38.078 INFO:tasks.workunit.client.0.smithi026.stdout:5/149: write d2/d8/d2a/f2c [987154,94220] 0 2024-05-09T00:07:38.078 INFO:tasks.workunit.client.0.smithi026.stdout:5/150: stat d2/d8/df/f17 0 2024-05-09T00:07:38.078 INFO:tasks.workunit.client.1.smithi135.stdout:4/654: mkdir dc/d26/d31/db8/dd1/ddd 0 2024-05-09T00:07:38.079 INFO:tasks.workunit.client.0.smithi026.stdout:1/127: dwrite d5/d16/f18 [0,4194304] 0 2024-05-09T00:07:38.079 INFO:tasks.workunit.client.0.smithi026.stdout:6/113: dread fa [0,4194304] 0 2024-05-09T00:07:38.079 INFO:tasks.workunit.client.0.smithi026.stdout:6/114: chown d15/c1a 2706333 1 2024-05-09T00:07:38.079 INFO:tasks.workunit.client.1.smithi135.stdout:0/750: getdents d3/dd/d3f/d58/dae 0 2024-05-09T00:07:38.083 INFO:tasks.workunit.client.1.smithi135.stdout:3/815: creat d8/d6d/d44/d4b/da0/daa/d88/f11d x:0 0 0 2024-05-09T00:07:38.084 INFO:tasks.workunit.client.0.smithi026.stdout:0/218: unlink d1d/d25/l37 0 2024-05-09T00:07:38.085 INFO:tasks.workunit.client.0.smithi026.stdout:0/219: readlink d1d/d1e/d2d/l41 0 2024-05-09T00:07:38.085 INFO:tasks.workunit.client.0.smithi026.stdout:0/220: fdatasync d1d/d25/d3c/f40 0 2024-05-09T00:07:38.087 INFO:tasks.workunit.client.1.smithi135.stdout:8/752: creat d4/d7/d33/d39/fff x:0 0 0 2024-05-09T00:07:38.088 INFO:tasks.workunit.client.1.smithi135.stdout:8/753: truncate d4/d7/de/d45/d76/de2/fd0 673397 0 2024-05-09T00:07:38.088 INFO:tasks.workunit.client.0.smithi026.stdout:0/221: write d1d/d1e/d20/f28 [2946922,114164] 0 2024-05-09T00:07:38.089 INFO:tasks.workunit.client.1.smithi135.stdout:8/754: write d4/d7/d2a/d56/f61 [2338901,128168] 0 2024-05-09T00:07:38.089 INFO:tasks.workunit.client.1.smithi135.stdout:8/755: read - d4/d7/de/d45/d76/de2/fe4 zero size 2024-05-09T00:07:38.090 INFO:tasks.workunit.client.1.smithi135.stdout:9/659: rmdir d1/d24/d44/d54/d66 39 2024-05-09T00:07:38.091 INFO:tasks.workunit.client.0.smithi026.stdout:5/151: creat d2/d8/df/f30 x:0 0 0 2024-05-09T00:07:38.092 INFO:tasks.workunit.client.0.smithi026.stdout:0/222: dread d1d/d1e/f23 [0,4194304] 0 2024-05-09T00:07:38.092 INFO:tasks.workunit.client.0.smithi026.stdout:0/223: chown d1d/d1e/d2d/f3b 874871597 1 2024-05-09T00:07:38.094 INFO:tasks.workunit.client.0.smithi026.stdout:6/115: dread d15/d1e/d20/f21 [0,4194304] 0 2024-05-09T00:07:38.094 INFO:tasks.workunit.client.0.smithi026.stdout:6/116: truncate f11 1472214 0 2024-05-09T00:07:38.094 INFO:tasks.workunit.client.0.smithi026.stdout:6/117: truncate f11 1792922 0 2024-05-09T00:07:38.094 INFO:tasks.workunit.client.0.smithi026.stdout:9/163: sync 2024-05-09T00:07:38.095 INFO:tasks.workunit.client.0.smithi026.stdout:7/191: dread d8/ff [0,4194304] 0 2024-05-09T00:07:38.095 INFO:tasks.workunit.client.1.smithi135.stdout:1/755: dwrite da/db/f61 [0,4194304] 0 2024-05-09T00:07:38.095 INFO:tasks.workunit.client.1.smithi135.stdout:1/756: chown da/d24/d27/d33/d52/d71/cf3 31320 1 2024-05-09T00:07:38.098 INFO:tasks.workunit.client.0.smithi026.stdout:1/128: link d5/db/c11 d5/db/d1d/c25 0 2024-05-09T00:07:38.100 INFO:tasks.workunit.client.1.smithi135.stdout:2/775: creat d1/d12/d21/d41/d6d/f106 x:0 0 0 2024-05-09T00:07:38.101 INFO:tasks.workunit.client.0.smithi026.stdout:9/164: creat d7/d26/f3e x:0 0 0 2024-05-09T00:07:38.103 INFO:tasks.workunit.client.1.smithi135.stdout:4/655: creat dc/d71/d90/fde x:0 0 0 2024-05-09T00:07:38.104 INFO:tasks.workunit.client.0.smithi026.stdout:6/118: write f12 [237402,59264] 0 2024-05-09T00:07:38.105 INFO:tasks.workunit.client.0.smithi026.stdout:0/224: dread fa [0,4194304] 0 2024-05-09T00:07:38.105 INFO:tasks.workunit.client.0.smithi026.stdout:7/192: creat d8/d2e/f3c x:0 0 0 2024-05-09T00:07:38.107 INFO:tasks.workunit.client.1.smithi135.stdout:0/751: link d3/dd/d3f/d43/da3/fa7 d3/fda 0 2024-05-09T00:07:38.107 INFO:tasks.workunit.client.1.smithi135.stdout:2/776: dread d1/f32 [0,4194304] 0 2024-05-09T00:07:38.109 INFO:tasks.workunit.client.0.smithi026.stdout:1/129: symlink d5/dd/l26 0 2024-05-09T00:07:38.109 INFO:tasks.workunit.client.0.smithi026.stdout:1/130: chown d5/f1c 44763622 1 2024-05-09T00:07:38.111 INFO:tasks.workunit.client.1.smithi135.stdout:3/816: creat d8/d13/d1f/d40/d52/dd3/f11e x:0 0 0 2024-05-09T00:07:38.111 INFO:tasks.workunit.client.1.smithi135.stdout:3/817: dread - d8/d102/d63/f105 zero size 2024-05-09T00:07:38.112 INFO:tasks.workunit.client.0.smithi026.stdout:5/152: dwrite d2/d8/df/f1f [0,4194304] 0 2024-05-09T00:07:38.113 INFO:tasks.workunit.client.1.smithi135.stdout:8/756: link d4/d7/de/d45/d76/ce6 d4/d7/d2a/c100 0 2024-05-09T00:07:38.117 INFO:tasks.workunit.client.1.smithi135.stdout:9/660: rmdir d1/d1a/d89 39 2024-05-09T00:07:38.120 INFO:tasks.workunit.client.1.smithi135.stdout:0/752: dwrite d3/dd/fc0 [0,4194304] 0 2024-05-09T00:07:38.121 INFO:tasks.workunit.client.0.smithi026.stdout:9/165: unlink d7/c22 0 2024-05-09T00:07:38.121 INFO:tasks.workunit.client.0.smithi026.stdout:9/166: chown d7/f19 2 1 2024-05-09T00:07:38.121 INFO:tasks.workunit.client.0.smithi026.stdout:9/167: getdents d7/d23/d2f/d3a 0 2024-05-09T00:07:38.121 INFO:tasks.workunit.client.0.smithi026.stdout:9/168: fsync d7/d23/d29/d31/f3d 0 2024-05-09T00:07:38.124 INFO:tasks.workunit.client.0.smithi026.stdout:6/119: creat d15/d1e/d23/f25 x:0 0 0 2024-05-09T00:07:38.125 INFO:tasks.workunit.client.1.smithi135.stdout:9/661: dread d1/d1a/d10/d3c/d5c/fae [0,4194304] 0 2024-05-09T00:07:38.125 INFO:tasks.workunit.client.1.smithi135.stdout:9/662: chown d1/d1a/d2c/f8e 3345 1 2024-05-09T00:07:38.127 INFO:tasks.workunit.client.0.smithi026.stdout:0/225: mknod d1d/d1e/c43 0 2024-05-09T00:07:38.129 INFO:tasks.workunit.client.1.smithi135.stdout:1/757: link da/d24/fca da/db/d70/f10c 0 2024-05-09T00:07:38.130 INFO:tasks.workunit.client.0.smithi026.stdout:7/193: mkdir d8/d12/d1e/d3d 0 2024-05-09T00:07:38.132 INFO:tasks.workunit.client.1.smithi135.stdout:4/656: mknod dc/d4a/d69/d55/cdf 0 2024-05-09T00:07:38.133 INFO:tasks.workunit.client.0.smithi026.stdout:1/131: creat d5/f27 x:0 0 0 2024-05-09T00:07:38.133 INFO:tasks.workunit.client.1.smithi135.stdout:2/777: mknod d1/d12/d21/d41/d6d/c107 0 2024-05-09T00:07:38.134 INFO:tasks.workunit.client.1.smithi135.stdout:2/778: stat d1/d12/d27/f62 0 2024-05-09T00:07:38.134 INFO:tasks.workunit.client.1.smithi135.stdout:9/663: dread d1/d24/d44/d54/f55 [0,4194304] 0 2024-05-09T00:07:38.135 INFO:tasks.workunit.client.1.smithi135.stdout:2/779: write d1/d12/d20/d2b/d56/d72/fb9 [2812258,59285] 0 2024-05-09T00:07:38.136 INFO:tasks.workunit.client.1.smithi135.stdout:1/758: write da/d24/d27/f28 [513431,44481] 0 2024-05-09T00:07:38.136 INFO:tasks.workunit.client.1.smithi135.stdout:0/753: dwrite d3/dd/d2d/d4c/d84/fc7 [0,4194304] 0 2024-05-09T00:07:38.136 INFO:tasks.workunit.client.1.smithi135.stdout:0/754: write d3/dd/d3f/f21 [4832137,73554] 0 2024-05-09T00:07:38.137 INFO:tasks.workunit.client.1.smithi135.stdout:3/818: link d8/l79 d8/d6d/d44/d4b/d59/d90/d7b/d80/l11f 0 2024-05-09T00:07:38.137 INFO:tasks.workunit.client.1.smithi135.stdout:3/819: fdatasync d8/d13/f3b 0 2024-05-09T00:07:38.138 INFO:tasks.workunit.client.0.smithi026.stdout:8/134: sync 2024-05-09T00:07:38.138 INFO:tasks.workunit.client.0.smithi026.stdout:8/135: fdatasync de/f16 0 2024-05-09T00:07:38.138 INFO:tasks.workunit.client.0.smithi026.stdout:8/136: readlink l4 0 2024-05-09T00:07:38.139 INFO:tasks.workunit.client.1.smithi135.stdout:8/757: symlink d4/d7/de/d45/l101 0 2024-05-09T00:07:38.139 INFO:tasks.workunit.client.0.smithi026.stdout:8/137: write de/d17/d21/f22 [644100,115533] 0 2024-05-09T00:07:38.139 INFO:tasks.workunit.client.0.smithi026.stdout:8/138: getdents de/d17/d27 0 2024-05-09T00:07:38.142 INFO:tasks.workunit.client.1.smithi135.stdout:5/808: sync 2024-05-09T00:07:38.142 INFO:tasks.workunit.client.1.smithi135.stdout:7/856: sync 2024-05-09T00:07:38.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/169: symlink d7/d23/d29/d2e/l3f 0 2024-05-09T00:07:38.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/170: stat d7/f1f 0 2024-05-09T00:07:38.144 INFO:tasks.workunit.client.0.smithi026.stdout:6/120: dwrite d15/f1f [0,4194304] 0 2024-05-09T00:07:38.146 INFO:tasks.workunit.client.0.smithi026.stdout:0/226: mknod d1d/d1e/c44 0 2024-05-09T00:07:38.146 INFO:tasks.workunit.client.1.smithi135.stdout:4/657: mknod dc/d4a/d8c/ce0 0 2024-05-09T00:07:38.147 INFO:tasks.workunit.client.1.smithi135.stdout:4/658: read dc/d4a/d69/d39/f68 [237902,12392] 0 2024-05-09T00:07:38.147 INFO:tasks.workunit.client.0.smithi026.stdout:7/194: stat d8/l26 0 2024-05-09T00:07:38.149 INFO:tasks.workunit.client.1.smithi135.stdout:9/664: rmdir d1/d24/d44/d7f/da2 39 2024-05-09T00:07:38.149 INFO:tasks.workunit.client.1.smithi135.stdout:9/665: dread - d1/d24/d44/d54/d66/d6e/fbc zero size 2024-05-09T00:07:38.150 INFO:tasks.workunit.client.0.smithi026.stdout:1/132: rmdir d5/d16 39 2024-05-09T00:07:38.155 INFO:tasks.workunit.client.1.smithi135.stdout:2/780: unlink d1/d12/d21/d41/d6d/d6e/lf9 0 2024-05-09T00:07:38.155 INFO:tasks.workunit.client.1.smithi135.stdout:1/759: mkdir da/d14/d20/d38/d3a/d10d 0 2024-05-09T00:07:38.155 INFO:tasks.workunit.client.0.smithi026.stdout:9/171: mkdir d7/d23/d29/d31/d40 0 2024-05-09T00:07:38.162 INFO:tasks.workunit.client.1.smithi135.stdout:0/755: creat d3/dd/d3f/d58/dae/dd3/fdb x:0 0 0 2024-05-09T00:07:38.162 INFO:tasks.workunit.client.1.smithi135.stdout:0/756: dread - d3/dd/d3f/d43/fa9 zero size 2024-05-09T00:07:38.162 INFO:tasks.workunit.client.1.smithi135.stdout:0/757: fsync d3/dd/d3f/d29/f9c 0 2024-05-09T00:07:38.162 INFO:tasks.workunit.client.1.smithi135.stdout:0/758: fdatasync d3/f79 0 2024-05-09T00:07:38.164 INFO:tasks.workunit.client.0.smithi026.stdout:6/121: rename d15/d1e/d20 to d15/d1e/d23/d26 0 2024-05-09T00:07:38.164 INFO:tasks.workunit.client.0.smithi026.stdout:6/122: chown d15/c1b 35958 1 2024-05-09T00:07:38.164 INFO:tasks.workunit.client.0.smithi026.stdout:6/123: chown f1 663 1 2024-05-09T00:07:38.164 INFO:tasks.workunit.client.0.smithi026.stdout:6/124: truncate d15/d1e/d23/f25 50004 0 2024-05-09T00:07:38.165 INFO:tasks.workunit.client.1.smithi135.stdout:8/758: symlink d4/d7/d2a/d56/dec/dfe/l102 0 2024-05-09T00:07:38.165 INFO:tasks.workunit.client.1.smithi135.stdout:2/781: dread d1/d12/d20/d3b/d40/f8a [0,4194304] 0 2024-05-09T00:07:38.166 INFO:tasks.workunit.client.0.smithi026.stdout:0/227: symlink d1d/d25/l45 0 2024-05-09T00:07:38.166 INFO:tasks.workunit.client.0.smithi026.stdout:0/228: fdatasync d1d/d33/f38 0 2024-05-09T00:07:38.166 INFO:tasks.workunit.client.0.smithi026.stdout:0/229: dread - d1d/f3f zero size 2024-05-09T00:07:38.168 INFO:tasks.workunit.client.1.smithi135.stdout:5/809: rmdir db/d5d/dac/ddc/dbf 39 2024-05-09T00:07:38.168 INFO:tasks.workunit.client.1.smithi135.stdout:5/810: chown db/d84/d62/c6f 5973347 1 2024-05-09T00:07:38.168 INFO:tasks.workunit.client.1.smithi135.stdout:5/811: fdatasync db/f1a 0 2024-05-09T00:07:38.168 INFO:tasks.workunit.client.1.smithi135.stdout:5/812: write db/d3f/f5c [3287828,58850] 0 2024-05-09T00:07:38.170 INFO:tasks.workunit.client.1.smithi135.stdout:7/857: truncate db/dd/d33/d68/d10a/d3a/d40/d4c/f4f 606079 0 2024-05-09T00:07:38.170 INFO:tasks.workunit.client.1.smithi135.stdout:7/858: chown db/dd/d33/d68/d10a/d3a/d40/d4c/d67/l76 111 1 2024-05-09T00:07:38.172 INFO:tasks.workunit.client.0.smithi026.stdout:1/133: mknod d5/dd/c28 0 2024-05-09T00:07:38.173 INFO:tasks.workunit.client.0.smithi026.stdout:1/134: write d5/dd/fe [1994234,78097] 0 2024-05-09T00:07:38.174 INFO:tasks.workunit.client.1.smithi135.stdout:4/659: creat dc/d71/d86/fe1 x:0 0 0 2024-05-09T00:07:38.176 INFO:tasks.workunit.client.0.smithi026.stdout:6/125: creat d15/d1e/d23/d26/f27 x:0 0 0 2024-05-09T00:07:38.176 INFO:tasks.workunit.client.0.smithi026.stdout:6/126: readlink d15/d1e/l22 0 2024-05-09T00:07:38.177 INFO:tasks.workunit.client.1.smithi135.stdout:6/781: sync 2024-05-09T00:07:38.178 INFO:tasks.workunit.client.1.smithi135.stdout:9/666: rmdir d1/d1a/d2c/d2d/dc8 0 2024-05-09T00:07:38.180 INFO:tasks.workunit.client.0.smithi026.stdout:5/153: truncate d2/d8/df/f1f 2666052 0 2024-05-09T00:07:38.181 INFO:tasks.workunit.client.0.smithi026.stdout:5/154: read d2/fc [672248,57003] 0 2024-05-09T00:07:38.181 INFO:tasks.workunit.client.0.smithi026.stdout:6/127: rmdir d15/d1e 39 2024-05-09T00:07:38.184 INFO:tasks.workunit.client.1.smithi135.stdout:0/759: mknod d3/dd/d3f/d3a/d46/cdc 0 2024-05-09T00:07:38.185 INFO:tasks.workunit.client.0.smithi026.stdout:5/155: unlink d2/d8/df/l1a 0 2024-05-09T00:07:38.185 INFO:tasks.workunit.client.0.smithi026.stdout:5/156: chown d2/d8/df/f30 2 1 2024-05-09T00:07:38.187 INFO:tasks.workunit.client.1.smithi135.stdout:5/813: link db/d24/d32/l80 db/d24/db0/lfe 0 2024-05-09T00:07:38.187 INFO:tasks.workunit.client.0.smithi026.stdout:6/128: creat d15/d1e/d23/d26/f28 x:0 0 0 2024-05-09T00:07:38.187 INFO:tasks.workunit.client.0.smithi026.stdout:6/129: stat d15/c1a 0 2024-05-09T00:07:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:6/130: truncate d15/f1d 2143610 0 2024-05-09T00:07:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:0/230: dread d1d/f29 [0,4194304] 0 2024-05-09T00:07:38.190 INFO:tasks.workunit.client.1.smithi135.stdout:7/859: mkdir db/dd/d33/da5/d11b 0 2024-05-09T00:07:38.190 INFO:tasks.workunit.client.1.smithi135.stdout:4/660: creat dc/d71/d90/dce/fe2 x:0 0 0 2024-05-09T00:07:38.190 INFO:tasks.workunit.client.1.smithi135.stdout:6/782: rmdir d2/da/d49/da4 39 2024-05-09T00:07:38.192 INFO:tasks.workunit.client.1.smithi135.stdout:9/667: unlink d1/d1a/d2c/d20/f98 0 2024-05-09T00:07:38.192 INFO:tasks.workunit.client.1.smithi135.stdout:9/668: fdatasync d1/fcd 0 2024-05-09T00:07:38.193 INFO:tasks.workunit.client.1.smithi135.stdout:1/760: mkdir da/d10e 0 2024-05-09T00:07:38.194 INFO:tasks.workunit.client.1.smithi135.stdout:0/760: rename d3/dd/c59 to d3/dd/d3f/d3a/da4/dc1/cdd 0 2024-05-09T00:07:38.194 INFO:tasks.workunit.client.1.smithi135.stdout:5/814: mknod db/d5d/dac/cff 0 2024-05-09T00:07:38.196 INFO:tasks.workunit.client.0.smithi026.stdout:8/139: dwrite de/f23 [0,4194304] 0 2024-05-09T00:07:38.196 INFO:tasks.workunit.client.0.smithi026.stdout:8/140: fsync de/f23 0 2024-05-09T00:07:38.196 INFO:tasks.workunit.client.1.smithi135.stdout:4/661: getdents dc/d4a/d8c/da5 0 2024-05-09T00:07:38.200 INFO:tasks.workunit.client.1.smithi135.stdout:7/860: link db/dd/d33/l56 db/d13/l11c 0 2024-05-09T00:07:38.201 INFO:tasks.workunit.client.0.smithi026.stdout:7/195: dwrite d8/d12/d22/d29/f1c [0,4194304] 0 2024-05-09T00:07:38.201 INFO:tasks.workunit.client.0.smithi026.stdout:0/231: dread f4 [0,4194304] 0 2024-05-09T00:07:38.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/172: dwrite d7/f19 [4194304,4194304] 0 2024-05-09T00:07:38.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/173: getdents d7/d23/d29/d31/d40 0 2024-05-09T00:07:38.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/174: fsync d7/f16 0 2024-05-09T00:07:38.202 INFO:tasks.workunit.client.1.smithi135.stdout:3/820: dwrite d8/d6d/d44/d4b/da0/daa/fc1 [0,4194304] 0 2024-05-09T00:07:38.202 INFO:tasks.workunit.client.1.smithi135.stdout:3/821: chown d8/d6d/f78 33 1 2024-05-09T00:07:38.202 INFO:tasks.workunit.client.1.smithi135.stdout:6/783: mkdir d2/da/df0/d10a 0 2024-05-09T00:07:38.204 INFO:tasks.workunit.client.1.smithi135.stdout:8/759: dwrite d4/d7/fca [0,4194304] 0 2024-05-09T00:07:38.205 INFO:tasks.workunit.client.1.smithi135.stdout:9/669: symlink d1/d24/d44/d54/d66/d6e/ld5 0 2024-05-09T00:07:38.205 INFO:tasks.workunit.client.0.smithi026.stdout:8/141: creat de/d17/f29 x:0 0 0 2024-05-09T00:07:38.205 INFO:tasks.workunit.client.0.smithi026.stdout:8/142: chown fa 807699 1 2024-05-09T00:07:38.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/761: creat d3/dd/d3f/d43/da3/fde x:0 0 0 2024-05-09T00:07:38.208 INFO:tasks.workunit.client.1.smithi135.stdout:5/815: symlink db/d84/d31/d5e/l100 0 2024-05-09T00:07:38.209 INFO:tasks.workunit.client.0.smithi026.stdout:6/131: dread f12 [0,4194304] 0 2024-05-09T00:07:38.210 INFO:tasks.workunit.client.1.smithi135.stdout:0/762: read d3/dd/d2d/f49 [2465147,3057] 0 2024-05-09T00:07:38.210 INFO:tasks.workunit.client.1.smithi135.stdout:4/662: mknod dc/d26/d31/db8/ce3 0 2024-05-09T00:07:38.214 INFO:tasks.workunit.client.1.smithi135.stdout:6/784: write d2/f76 [46024,51031] 0 2024-05-09T00:07:38.215 INFO:tasks.workunit.client.1.smithi135.stdout:0/763: dread d3/dd/d3f/f7e [0,4194304] 0 2024-05-09T00:07:38.217 INFO:tasks.workunit.client.0.smithi026.stdout:0/232: rmdir d1d 39 2024-05-09T00:07:38.218 INFO:tasks.workunit.client.0.smithi026.stdout:0/233: read f11 [1160959,108288] 0 2024-05-09T00:07:38.219 INFO:tasks.workunit.client.0.smithi026.stdout:0/234: write d1d/d25/f2b [978062,28872] 0 2024-05-09T00:07:38.219 INFO:tasks.workunit.client.0.smithi026.stdout:7/196: mkdir d8/d12/d22/d29/d3e 0 2024-05-09T00:07:38.219 INFO:tasks.workunit.client.0.smithi026.stdout:7/197: write d8/d12/d22/f31 [772604,42549] 0 2024-05-09T00:07:38.220 INFO:tasks.workunit.client.0.smithi026.stdout:7/198: readlink d8/d12/d22/d29/l2b 0 2024-05-09T00:07:38.220 INFO:tasks.workunit.client.0.smithi026.stdout:7/199: chown d8/d12/d22/d29/d3e 19547021 1 2024-05-09T00:07:38.220 INFO:tasks.workunit.client.0.smithi026.stdout:7/200: write f6 [2535856,81103] 0 2024-05-09T00:07:38.222 INFO:tasks.workunit.client.1.smithi135.stdout:2/782: dwrite d1/d12/d20/d2b/f90 [4194304,4194304] 0 2024-05-09T00:07:38.222 INFO:tasks.workunit.client.1.smithi135.stdout:2/783: chown d1/d12/d21/d41/d6d/d6e/f9a 17947510 1 2024-05-09T00:07:38.223 INFO:tasks.workunit.client.0.smithi026.stdout:9/175: mkdir d7/d23/d29/d31/d40/d41 0 2024-05-09T00:07:38.223 INFO:tasks.workunit.client.1.smithi135.stdout:7/861: creat db/da8/d78/f11d x:0 0 0 2024-05-09T00:07:38.226 INFO:tasks.workunit.client.0.smithi026.stdout:8/143: unlink de/f12 0 2024-05-09T00:07:38.229 INFO:tasks.workunit.client.0.smithi026.stdout:1/135: dwrite d5/f27 [0,4194304] 0 2024-05-09T00:07:38.229 INFO:tasks.workunit.client.0.smithi026.stdout:6/132: creat d15/f29 x:0 0 0 2024-05-09T00:07:38.234 INFO:tasks.workunit.client.1.smithi135.stdout:1/761: dwrite da/d14/d5c/fe6 [4194304,4194304] 0 2024-05-09T00:07:38.234 INFO:tasks.workunit.client.1.smithi135.stdout:3/822: dwrite d8/d6d/ff7 [0,4194304] 0 2024-05-09T00:07:38.234 INFO:tasks.workunit.client.1.smithi135.stdout:3/823: fdatasync d8/d6d/d44/d4b/da0/daa/d88/f115 0 2024-05-09T00:07:38.234 INFO:tasks.workunit.client.1.smithi135.stdout:9/670: creat d1/d24/d44/daf/fd6 x:0 0 0 2024-05-09T00:07:38.234 INFO:tasks.workunit.client.1.smithi135.stdout:9/671: dread - d1/d1a/d10/d3c/d43/fb6 zero size 2024-05-09T00:07:38.234 INFO:tasks.workunit.client.1.smithi135.stdout:9/672: dread - d1/d24/d44/d54/d66/d6e/fcc zero size 2024-05-09T00:07:38.235 INFO:tasks.workunit.client.0.smithi026.stdout:9/176: rmdir d7/d26 39 2024-05-09T00:07:38.235 INFO:tasks.workunit.client.1.smithi135.stdout:4/663: dwrite dc/dd/f22 [0,4194304] 0 2024-05-09T00:07:38.237 INFO:tasks.workunit.client.0.smithi026.stdout:8/144: symlink de/d17/l2a 0 2024-05-09T00:07:38.245 INFO:tasks.workunit.client.1.smithi135.stdout:8/760: dwrite d4/d7/de/d45/fac [0,4194304] 0 2024-05-09T00:07:38.245 INFO:tasks.workunit.client.1.smithi135.stdout:6/785: rmdir d2/da/df0/d10a 0 2024-05-09T00:07:38.246 INFO:tasks.workunit.client.0.smithi026.stdout:1/136: mkdir d5/dd/d17/d29 0 2024-05-09T00:07:38.247 INFO:tasks.workunit.client.1.smithi135.stdout:3/824: dread d8/d13/f22 [0,4194304] 0 2024-05-09T00:07:38.247 INFO:tasks.workunit.client.1.smithi135.stdout:7/862: mknod db/dd/d33/d58/dc7/c11e 0 2024-05-09T00:07:38.249 INFO:tasks.workunit.client.0.smithi026.stdout:6/133: symlink d15/d1e/l2a 0 2024-05-09T00:07:38.250 INFO:tasks.workunit.client.0.smithi026.stdout:9/177: creat d7/d23/d29/d31/f42 x:0 0 0 2024-05-09T00:07:38.250 INFO:tasks.workunit.client.0.smithi026.stdout:9/178: chown d7/f1b 2183826 1 2024-05-09T00:07:38.251 INFO:tasks.workunit.client.0.smithi026.stdout:9/179: chown d7/d23/d2f 1844846 1 2024-05-09T00:07:38.251 INFO:tasks.workunit.client.0.smithi026.stdout:9/180: chown d7/d23/d29/d2e/l3f 40137845 1 2024-05-09T00:07:38.251 INFO:tasks.workunit.client.1.smithi135.stdout:1/762: chown da/d14/d20/l25 9329 1 2024-05-09T00:07:38.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/763: write da/db/f61 [110250,96870] 0 2024-05-09T00:07:38.255 INFO:tasks.workunit.client.1.smithi135.stdout:6/786: dread d2/fc [0,4194304] 0 2024-05-09T00:07:38.257 INFO:tasks.workunit.client.0.smithi026.stdout:8/145: mknod de/d17/d21/d24/c2b 0 2024-05-09T00:07:38.258 INFO:tasks.workunit.client.0.smithi026.stdout:8/146: write f7 [252679,103357] 0 2024-05-09T00:07:38.260 INFO:tasks.workunit.client.0.smithi026.stdout:1/137: creat d5/dd/d17/f2a x:0 0 0 2024-05-09T00:07:38.261 INFO:tasks.workunit.client.0.smithi026.stdout:7/201: dwrite f5 [0,4194304] 0 2024-05-09T00:07:38.265 INFO:tasks.workunit.client.0.smithi026.stdout:7/202: read f6 [172919,5209] 0 2024-05-09T00:07:38.265 INFO:tasks.workunit.client.0.smithi026.stdout:7/203: chown d8/d12/d22/d29/l17 15 1 2024-05-09T00:07:38.265 INFO:tasks.workunit.client.0.smithi026.stdout:6/134: mkdir d15/d2b 0 2024-05-09T00:07:38.265 INFO:tasks.workunit.client.0.smithi026.stdout:0/235: dwrite d1d/f29 [0,4194304] 0 2024-05-09T00:07:38.265 INFO:tasks.workunit.client.0.smithi026.stdout:5/157: dread d2/d8/df/f1f [0,4194304] 0 2024-05-09T00:07:38.267 INFO:tasks.workunit.client.0.smithi026.stdout:9/181: link d7/c3b d7/d23/c43 0 2024-05-09T00:07:38.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/673: mknod d1/d24/d44/daf/cd7 0 2024-05-09T00:07:38.270 INFO:tasks.workunit.client.0.smithi026.stdout:8/147: mknod de/d17/d21/d24/d28/c2c 0 2024-05-09T00:07:38.270 INFO:tasks.workunit.client.0.smithi026.stdout:8/148: fdatasync de/ff 0 2024-05-09T00:07:38.271 INFO:tasks.workunit.client.1.smithi135.stdout:1/764: dwrite da/db/d70/f10c [0,4194304] 0 2024-05-09T00:07:38.274 INFO:tasks.workunit.client.0.smithi026.stdout:7/204: symlink d8/d12/d1e/d3d/l3f 0 2024-05-09T00:07:38.276 INFO:tasks.workunit.client.0.smithi026.stdout:6/135: rmdir d15/d1e 39 2024-05-09T00:07:38.279 INFO:tasks.workunit.client.1.smithi135.stdout:4/664: getdents dc/d4a/d69 0 2024-05-09T00:07:38.284 INFO:tasks.workunit.client.1.smithi135.stdout:5/816: mkdir db/d84/d31/d101 0 2024-05-09T00:07:38.291 INFO:tasks.workunit.client.1.smithi135.stdout:8/761: rmdir d4/d7/de/d45/d76 39 2024-05-09T00:07:38.292 INFO:tasks.workunit.client.0.smithi026.stdout:9/182: dwrite d7/d23/f37 [0,4194304] 0 2024-05-09T00:07:38.295 INFO:tasks.workunit.client.1.smithi135.stdout:3/825: mkdir d8/d6d/d44/d4b/dc2/d120 0 2024-05-09T00:07:38.296 INFO:tasks.workunit.client.0.smithi026.stdout:7/205: dwrite d8/d12/f25 [0,4194304] 0 2024-05-09T00:07:38.297 INFO:tasks.workunit.client.0.smithi026.stdout:5/158: unlink d2/d8/c2f 0 2024-05-09T00:07:38.299 INFO:tasks.workunit.client.1.smithi135.stdout:7/863: link db/d5b/f116 db/dd/d33/da5/d11b/f11f 0 2024-05-09T00:07:38.301 INFO:tasks.workunit.client.0.smithi026.stdout:7/206: dread f7 [0,4194304] 0 2024-05-09T00:07:38.301 INFO:tasks.workunit.client.0.smithi026.stdout:0/236: creat d1d/d25/d3c/f46 x:0 0 0 2024-05-09T00:07:38.302 INFO:tasks.workunit.client.1.smithi135.stdout:6/787: creat d2/d20/d3f/d4f/d103/f10b x:0 0 0 2024-05-09T00:07:38.302 INFO:tasks.workunit.client.1.smithi135.stdout:6/788: stat d2/da/d1d/d69/d89/ffb 0 2024-05-09T00:07:38.303 INFO:tasks.workunit.client.0.smithi026.stdout:8/149: rename l4 to de/d17/l2d 0 2024-05-09T00:07:38.304 INFO:tasks.workunit.client.1.smithi135.stdout:9/674: rmdir d1/d24 39 2024-05-09T00:07:38.309 INFO:tasks.workunit.client.1.smithi135.stdout:9/675: dread d1/d24/d44/d54/f69 [0,4194304] 0 2024-05-09T00:07:38.325 INFO:tasks.workunit.client.1.smithi135.stdout:9/676: dwrite d1/d1a/d10/d3c/d5c/f63 [0,4194304] 0 2024-05-09T00:07:38.326 INFO:tasks.workunit.client.0.smithi026.stdout:8/150: dwrite f7 [0,4194304] 0 2024-05-09T00:07:38.326 INFO:tasks.workunit.client.0.smithi026.stdout:8/151: chown l5 1173681 1 2024-05-09T00:07:38.335 INFO:tasks.workunit.client.1.smithi135.stdout:9/677: dread d1/d1a/d10/d3c/d43/f83 [0,4194304] 0 2024-05-09T00:07:38.426 INFO:tasks.workunit.client.0.smithi026.stdout:6/136: symlink d15/d2b/l2c 0 2024-05-09T00:07:38.428 INFO:tasks.workunit.client.0.smithi026.stdout:6/137: write d15/d1e/d23/d26/f21 [3718531,17268] 0 2024-05-09T00:07:38.428 INFO:tasks.workunit.client.0.smithi026.stdout:6/138: chown d15/d2b/l2c 18532486 1 2024-05-09T00:07:38.428 INFO:tasks.workunit.client.0.smithi026.stdout:6/139: fsync f1 0 2024-05-09T00:07:38.428 INFO:tasks.workunit.client.0.smithi026.stdout:6/140: dread - f10 zero size 2024-05-09T00:07:38.431 INFO:tasks.workunit.client.1.smithi135.stdout:1/765: rmdir da/d24 39 2024-05-09T00:07:38.431 INFO:tasks.workunit.client.1.smithi135.stdout:1/766: dread - da/db/f64 zero size 2024-05-09T00:07:38.432 INFO:tasks.workunit.client.1.smithi135.stdout:1/767: write da/d14/d20/fb2 [1484613,47645] 0 2024-05-09T00:07:38.433 INFO:tasks.workunit.client.1.smithi135.stdout:4/665: creat dc/d71/d86/fe4 x:0 0 0 2024-05-09T00:07:38.433 INFO:tasks.workunit.client.1.smithi135.stdout:4/666: fsync dc/d4a/d69/d55/d5f/faf 0 2024-05-09T00:07:38.434 INFO:tasks.workunit.client.0.smithi026.stdout:5/159: rename d2/d8/df to d2/d8/d31 0 2024-05-09T00:07:38.436 INFO:tasks.workunit.client.1.smithi135.stdout:5/817: creat db/d24/d32/dfa/d9c/d9f/dc0/df0/f102 x:0 0 0 2024-05-09T00:07:38.436 INFO:tasks.workunit.client.1.smithi135.stdout:5/818: chown db/d24/f34 1689675017 1 2024-05-09T00:07:38.437 INFO:tasks.workunit.client.0.smithi026.stdout:7/207: mknod d8/d12/d22/c40 0 2024-05-09T00:07:38.439 INFO:tasks.workunit.client.0.smithi026.stdout:0/237: mkdir d1d/d25/d47 0 2024-05-09T00:07:38.439 INFO:tasks.workunit.client.0.smithi026.stdout:0/238: write d1d/d1e/d2d/f3e [638926,18728] 0 2024-05-09T00:07:38.440 INFO:tasks.workunit.client.1.smithi135.stdout:8/762: symlink d4/l103 0 2024-05-09T00:07:38.443 INFO:tasks.workunit.client.1.smithi135.stdout:3/826: symlink d8/d13/d75/de1/l121 0 2024-05-09T00:07:38.444 INFO:tasks.workunit.client.1.smithi135.stdout:3/827: write d8/d6d/f28 [633424,26213] 0 2024-05-09T00:07:38.445 INFO:tasks.workunit.client.0.smithi026.stdout:8/152: rename de/d17/f29 to de/d17/d21/d24/f2e 0 2024-05-09T00:07:38.445 INFO:tasks.workunit.client.0.smithi026.stdout:6/141: rename d15/d1e to d15/d1e/d2d 22 2024-05-09T00:07:38.445 INFO:tasks.workunit.client.0.smithi026.stdout:8/153: dread - de/f20 zero size 2024-05-09T00:07:38.447 INFO:tasks.workunit.client.0.smithi026.stdout:1/138: truncate d5/dd/fe 2057181 0 2024-05-09T00:07:38.448 INFO:tasks.workunit.client.0.smithi026.stdout:5/160: unlink d2/d8/f10 0 2024-05-09T00:07:38.448 INFO:tasks.workunit.client.0.smithi026.stdout:5/161: fdatasync d2/d8/d2a/f2c 0 2024-05-09T00:07:38.451 INFO:tasks.workunit.client.1.smithi135.stdout:7/864: rename db/dd/fb7 to db/dd/d33/d10e/f120 0 2024-05-09T00:07:38.451 INFO:tasks.workunit.client.1.smithi135.stdout:7/865: write db/fd2 [491293,40604] 0 2024-05-09T00:07:38.453 INFO:tasks.workunit.client.0.smithi026.stdout:0/239: link d1d/d25/l45 d1d/d25/d47/l48 0 2024-05-09T00:07:38.454 INFO:tasks.workunit.client.0.smithi026.stdout:7/208: dwrite d8/fa [0,4194304] 0 2024-05-09T00:07:38.454 INFO:tasks.workunit.client.0.smithi026.stdout:7/209: stat d8/fa 0 2024-05-09T00:07:38.457 INFO:tasks.workunit.client.0.smithi026.stdout:1/139: truncate f2 7215744 0 2024-05-09T00:07:38.462 INFO:tasks.workunit.client.1.smithi135.stdout:1/768: fsync da/d24/d27/d33/d36/fda 0 2024-05-09T00:07:38.464 INFO:tasks.workunit.client.0.smithi026.stdout:8/154: dread de/f11 [0,4194304] 0 2024-05-09T00:07:38.464 INFO:tasks.workunit.client.0.smithi026.stdout:8/155: fsync de/f20 0 2024-05-09T00:07:38.464 INFO:tasks.workunit.client.0.smithi026.stdout:8/156: write de/f20 [44849,87316] 0 2024-05-09T00:07:38.465 INFO:tasks.workunit.client.1.smithi135.stdout:4/667: unlink dc/d26/d31/d82/fb9 0 2024-05-09T00:07:38.466 INFO:tasks.workunit.client.0.smithi026.stdout:0/240: creat d1d/d1e/d2d/f49 x:0 0 0 2024-05-09T00:07:38.466 INFO:tasks.workunit.client.0.smithi026.stdout:0/241: write d1d/d1e/d2d/f3e [1331427,81606] 0 2024-05-09T00:07:38.467 INFO:tasks.workunit.client.1.smithi135.stdout:5/819: creat db/d5d/dac/f103 x:0 0 0 2024-05-09T00:07:38.468 INFO:tasks.workunit.client.0.smithi026.stdout:5/162: dwrite d2/fc [0,4194304] 0 2024-05-09T00:07:38.469 INFO:tasks.workunit.client.0.smithi026.stdout:8/157: mknod de/d17/d21/c2f 0 2024-05-09T00:07:38.472 INFO:tasks.workunit.client.1.smithi135.stdout:3/828: mkdir d8/d6d/d44/d4b/d59/d90/d7b/d80/d84/d122 0 2024-05-09T00:07:38.474 INFO:tasks.workunit.client.0.smithi026.stdout:0/242: getdents d1d 0 2024-05-09T00:07:38.476 INFO:tasks.workunit.client.1.smithi135.stdout:0/764: sync 2024-05-09T00:07:38.476 INFO:tasks.workunit.client.1.smithi135.stdout:2/784: sync 2024-05-09T00:07:38.481 INFO:tasks.workunit.client.1.smithi135.stdout:6/789: rename d2/da/d49/c68 to d2/da/d1d/d69/d89/c10c 0 2024-05-09T00:07:38.481 INFO:tasks.workunit.client.1.smithi135.stdout:6/790: chown d2/d1a/ld0 0 1 2024-05-09T00:07:38.481 INFO:tasks.workunit.client.0.smithi026.stdout:7/210: dwrite d8/d2e/f3c [0,4194304] 0 2024-05-09T00:07:38.481 INFO:tasks.workunit.client.0.smithi026.stdout:7/211: chown d8/d12/d22/d29/l2b 27257455 1 2024-05-09T00:07:38.482 INFO:tasks.workunit.client.0.smithi026.stdout:8/158: dwrite de/d17/f1a [0,4194304] 0 2024-05-09T00:07:38.484 INFO:tasks.workunit.client.0.smithi026.stdout:0/243: creat d1d/d1e/d2d/f4a x:0 0 0 2024-05-09T00:07:38.485 INFO:tasks.workunit.client.0.smithi026.stdout:0/244: readlink d1d/d25/l2f 0 2024-05-09T00:07:38.487 INFO:tasks.workunit.client.1.smithi135.stdout:7/866: unlink db/d21/d98/c11a 0 2024-05-09T00:07:38.491 INFO:tasks.workunit.client.1.smithi135.stdout:1/769: mkdir da/d24/d27/d33/d52/dfc/d10f 0 2024-05-09T00:07:38.491 INFO:tasks.workunit.client.1.smithi135.stdout:1/770: chown da/d24/d27/d33/d36/l5b 9 1 2024-05-09T00:07:38.494 INFO:tasks.workunit.client.1.smithi135.stdout:6/791: dread d2/da/f3b [4194304,4194304] 0 2024-05-09T00:07:38.494 INFO:tasks.workunit.client.1.smithi135.stdout:6/792: fsync d2/d1a/f24 0 2024-05-09T00:07:38.495 INFO:tasks.workunit.client.1.smithi135.stdout:4/668: mkdir dc/d71/de5 0 2024-05-09T00:07:38.497 INFO:tasks.workunit.client.1.smithi135.stdout:4/669: write dc/d4a/d69/d55/d5f/f6b [426575,45987] 0 2024-05-09T00:07:38.497 INFO:tasks.workunit.client.1.smithi135.stdout:9/678: sync 2024-05-09T00:07:38.498 INFO:tasks.workunit.client.1.smithi135.stdout:5/820: mknod db/d24/d32/dfa/d9c/c104 0 2024-05-09T00:07:38.501 INFO:tasks.workunit.client.1.smithi135.stdout:3/829: mkdir d8/d102/d63/db9/d123 0 2024-05-09T00:07:38.501 INFO:tasks.workunit.client.0.smithi026.stdout:0/245: getdents d1d/d33 0 2024-05-09T00:07:38.505 INFO:tasks.workunit.client.1.smithi135.stdout:2/785: link d1/d12/d21/f9f d1/d12/da3/f108 0 2024-05-09T00:07:38.505 INFO:tasks.workunit.client.1.smithi135.stdout:9/679: dread d1/d1a/d2c/d2d/f32 [0,4194304] 0 2024-05-09T00:07:38.507 INFO:tasks.workunit.client.0.smithi026.stdout:0/246: rmdir d1d 39 2024-05-09T00:07:38.507 INFO:tasks.workunit.client.0.smithi026.stdout:5/163: dread d2/fc [0,4194304] 0 2024-05-09T00:07:38.509 INFO:tasks.workunit.client.1.smithi135.stdout:0/765: link d3/dd/d3f/d29/d54/lb0 d3/dd/ldf 0 2024-05-09T00:07:38.511 INFO:tasks.workunit.client.1.smithi135.stdout:7/867: dwrite db/d21/fb3 [0,4194304] 0 2024-05-09T00:07:38.513 INFO:tasks.workunit.client.1.smithi135.stdout:8/763: rename d4/d7/de/c26 to d4/d7/d4a/c104 0 2024-05-09T00:07:38.513 INFO:tasks.workunit.client.1.smithi135.stdout:8/764: chown d4/d7/d2a/c100 15663262 1 2024-05-09T00:07:38.514 INFO:tasks.workunit.client.1.smithi135.stdout:9/680: dread d1/d1a/d2c/d20/f9c [0,4194304] 0 2024-05-09T00:07:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:1/140: write d5/dd/d1f/f21 [3532526,43380] 0 2024-05-09T00:07:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:0/247: creat d1d/d1e/f4b x:0 0 0 2024-05-09T00:07:38.519 INFO:tasks.workunit.client.1.smithi135.stdout:1/771: mknod da/d14/d5c/d83/c110 0 2024-05-09T00:07:38.521 INFO:tasks.workunit.client.0.smithi026.stdout:1/141: dread d5/db/f1e [0,4194304] 0 2024-05-09T00:07:38.522 INFO:tasks.workunit.client.1.smithi135.stdout:6/793: truncate d2/d20/d37/d4e/f6a 158528 0 2024-05-09T00:07:38.522 INFO:tasks.workunit.client.1.smithi135.stdout:1/772: dread da/d14/d5c/f91 [0,4194304] 0 2024-05-09T00:07:38.524 INFO:tasks.workunit.client.1.smithi135.stdout:1/773: dread da/d14/d20/d38/f58 [0,4194304] 0 2024-05-09T00:07:38.525 INFO:tasks.workunit.client.0.smithi026.stdout:0/248: creat d1d/d25/d3c/f4c x:0 0 0 2024-05-09T00:07:38.525 INFO:tasks.workunit.client.1.smithi135.stdout:9/681: dread d1/d1a/d2c/f28 [0,4194304] 0 2024-05-09T00:07:38.526 INFO:tasks.workunit.client.1.smithi135.stdout:2/786: mkdir d1/d12/d20/d3b/d105/d109 0 2024-05-09T00:07:38.526 INFO:tasks.workunit.client.1.smithi135.stdout:5/821: dwrite db/d3f/f4d [0,4194304] 0 2024-05-09T00:07:38.529 INFO:tasks.workunit.client.1.smithi135.stdout:0/766: mknod d3/dd/d3f/d43/ce0 0 2024-05-09T00:07:38.529 INFO:tasks.workunit.client.1.smithi135.stdout:0/767: chown d3/dd/d3f/d43/da3/cd6 189912355 1 2024-05-09T00:07:38.531 INFO:tasks.workunit.client.0.smithi026.stdout:1/142: rename d5/f10 to d5/db/f2b 0 2024-05-09T00:07:38.535 INFO:tasks.workunit.client.0.smithi026.stdout:1/143: creat d5/f2c x:0 0 0 2024-05-09T00:07:38.535 INFO:tasks.workunit.client.0.smithi026.stdout:1/144: chown d5/c23 2047474 1 2024-05-09T00:07:38.537 INFO:tasks.workunit.client.1.smithi135.stdout:3/830: dwrite d8/d13/d75/d53/fe2 [0,4194304] 0 2024-05-09T00:07:38.537 INFO:tasks.workunit.client.0.smithi026.stdout:0/249: dread d1d/d1e/d2d/f3b [0,4194304] 0 2024-05-09T00:07:38.537 INFO:tasks.workunit.client.0.smithi026.stdout:7/212: dwrite f5 [0,4194304] 0 2024-05-09T00:07:38.538 INFO:tasks.workunit.client.1.smithi135.stdout:7/868: creat db/d5b/f121 x:0 0 0 2024-05-09T00:07:38.538 INFO:tasks.workunit.client.1.smithi135.stdout:8/765: mknod d4/d7/de/d45/c105 0 2024-05-09T00:07:38.538 INFO:tasks.workunit.client.0.smithi026.stdout:0/250: write f4 [5453009,93591] 0 2024-05-09T00:07:38.538 INFO:tasks.workunit.client.0.smithi026.stdout:0/251: chown d1d/d1e/d20/l42 14352 1 2024-05-09T00:07:38.539 INFO:tasks.workunit.client.0.smithi026.stdout:1/145: creat d5/f2d x:0 0 0 2024-05-09T00:07:38.541 INFO:tasks.workunit.client.1.smithi135.stdout:4/670: rename dc/d71/d86/fe4 to dc/d71/de5/fe6 0 2024-05-09T00:07:38.541 INFO:tasks.workunit.client.1.smithi135.stdout:9/682: rename d1/d24/d86 to d1/d24/d86/d97/dd8 22 2024-05-09T00:07:38.543 INFO:tasks.workunit.client.1.smithi135.stdout:6/794: mkdir d2/da/d49/da6/dd9/d10d 0 2024-05-09T00:07:38.543 INFO:tasks.workunit.client.1.smithi135.stdout:6/795: write d2/f96 [96710,55782] 0 2024-05-09T00:07:38.545 INFO:tasks.workunit.client.0.smithi026.stdout:7/213: link d8/fa d8/d12/d1e/f41 0 2024-05-09T00:07:38.545 INFO:tasks.workunit.client.0.smithi026.stdout:7/214: fsync d8/d1b/f37 0 2024-05-09T00:07:38.548 INFO:tasks.workunit.client.1.smithi135.stdout:1/774: unlink da/d24/d27/d33/c4c 0 2024-05-09T00:07:38.548 INFO:tasks.workunit.client.1.smithi135.stdout:1/775: stat da/d14/d20/d38/d3a/d40/d75/c7b 0 2024-05-09T00:07:38.548 INFO:tasks.workunit.client.1.smithi135.stdout:1/776: fdatasync da/d14/d20/fc7 0 2024-05-09T00:07:38.551 INFO:tasks.workunit.client.1.smithi135.stdout:6/796: write d2/f77 [1489169,56402] 0 2024-05-09T00:07:38.552 INFO:tasks.workunit.client.1.smithi135.stdout:2/787: symlink d1/d12/da3/l10a 0 2024-05-09T00:07:38.552 INFO:tasks.workunit.client.1.smithi135.stdout:8/766: dread d4/d22/f51 [0,4194304] 0 2024-05-09T00:07:38.552 INFO:tasks.workunit.client.1.smithi135.stdout:8/767: write d4/d7/d33/d39/f47 [618262,17625] 0 2024-05-09T00:07:38.552 INFO:tasks.workunit.client.1.smithi135.stdout:8/768: fsync d4/d7/d33/fd7 0 2024-05-09T00:07:38.554 INFO:tasks.workunit.client.0.smithi026.stdout:1/146: unlink d5/db/f12 0 2024-05-09T00:07:38.557 INFO:tasks.workunit.client.0.smithi026.stdout:7/215: creat d8/d12/d22/f42 x:0 0 0 2024-05-09T00:07:38.557 INFO:tasks.workunit.client.0.smithi026.stdout:7/216: readlink d8/d12/d22/l33 0 2024-05-09T00:07:38.557 INFO:tasks.workunit.client.0.smithi026.stdout:0/252: getdents d1d/d1e 0 2024-05-09T00:07:38.557 INFO:tasks.workunit.client.0.smithi026.stdout:0/253: readlink d1d/d25/l45 0 2024-05-09T00:07:38.559 INFO:tasks.workunit.client.0.smithi026.stdout:1/147: creat d5/dd/d1f/f2e x:0 0 0 2024-05-09T00:07:38.561 INFO:tasks.workunit.client.0.smithi026.stdout:7/217: rename f6 to d8/d12/d1e/f43 0 2024-05-09T00:07:38.563 INFO:tasks.workunit.client.1.smithi135.stdout:5/822: dwrite db/d24/d32/d5b/f76 [0,4194304] 0 2024-05-09T00:07:38.564 INFO:tasks.workunit.client.1.smithi135.stdout:9/683: dwrite d1/d24/d86/fa0 [0,4194304] 0 2024-05-09T00:07:38.564 INFO:tasks.workunit.client.1.smithi135.stdout:3/831: getdents d8/d6d/d24 0 2024-05-09T00:07:38.564 INFO:tasks.workunit.client.1.smithi135.stdout:3/832: chown d8/d6d/d44/d4b/da0/daa/dc9/ce4 2472 1 2024-05-09T00:07:38.564 INFO:tasks.workunit.client.1.smithi135.stdout:3/833: dread - d8/d13/d1f/d40/d52/fcb zero size 2024-05-09T00:07:38.565 INFO:tasks.workunit.client.1.smithi135.stdout:5/823: write db/d5d/f68 [392321,92023] 0 2024-05-09T00:07:38.565 INFO:tasks.workunit.client.0.smithi026.stdout:8/159: dwrite f9 [4194304,4194304] 0 2024-05-09T00:07:38.565 INFO:tasks.workunit.client.0.smithi026.stdout:0/254: mkdir d1d/d1e/d20/d4d 0 2024-05-09T00:07:38.565 INFO:tasks.workunit.client.0.smithi026.stdout:0/255: chown l13 18271 1 2024-05-09T00:07:38.566 INFO:tasks.workunit.client.1.smithi135.stdout:7/869: creat db/d5b/d101/f122 x:0 0 0 2024-05-09T00:07:38.568 INFO:tasks.workunit.client.0.smithi026.stdout:1/148: rename d5/c23 to d5/c2f 0 2024-05-09T00:07:38.574 INFO:tasks.workunit.client.1.smithi135.stdout:4/671: mkdir dc/d26/d93/d9d/de7 0 2024-05-09T00:07:38.576 INFO:tasks.workunit.client.0.smithi026.stdout:8/160: symlink de/d17/d21/l30 0 2024-05-09T00:07:38.576 INFO:tasks.workunit.client.0.smithi026.stdout:8/161: chown fa 36465 1 2024-05-09T00:07:38.576 INFO:tasks.workunit.client.0.smithi026.stdout:8/162: dread - de/f25 zero size 2024-05-09T00:07:38.577 INFO:tasks.workunit.client.0.smithi026.stdout:7/218: dread d8/d12/f25 [0,4194304] 0 2024-05-09T00:07:38.580 INFO:tasks.workunit.client.0.smithi026.stdout:0/256: symlink d1d/d1e/d2d/l4e 0 2024-05-09T00:07:38.580 INFO:tasks.workunit.client.0.smithi026.stdout:0/257: readlink l1a 0 2024-05-09T00:07:38.582 INFO:tasks.workunit.client.1.smithi135.stdout:1/777: creat da/db/d16/f111 x:0 0 0 2024-05-09T00:07:38.582 INFO:tasks.workunit.client.1.smithi135.stdout:1/778: stat da/db/d16/ce1 0 2024-05-09T00:07:38.582 INFO:tasks.workunit.client.1.smithi135.stdout:1/779: fdatasync da/db/d16/f111 0 2024-05-09T00:07:38.582 INFO:tasks.workunit.client.0.smithi026.stdout:0/258: dread d1d/d1e/f23 [0,4194304] 0 2024-05-09T00:07:38.582 INFO:tasks.workunit.client.0.smithi026.stdout:0/259: fdatasync d1d/d25/d3c/f40 0 2024-05-09T00:07:38.583 INFO:tasks.workunit.client.0.smithi026.stdout:1/149: mkdir d5/db/d30 0 2024-05-09T00:07:38.583 INFO:tasks.workunit.client.0.smithi026.stdout:1/150: readlink d5/dd/l1a 0 2024-05-09T00:07:38.583 INFO:tasks.workunit.client.0.smithi026.stdout:1/151: stat d5/d16/f1b 0 2024-05-09T00:07:38.583 INFO:tasks.workunit.client.0.smithi026.stdout:1/152: write d5/f1c [955585,105699] 0 2024-05-09T00:07:38.584 INFO:tasks.workunit.client.1.smithi135.stdout:4/672: dread dc/d26/f4f [0,4194304] 0 2024-05-09T00:07:38.585 INFO:tasks.workunit.client.0.smithi026.stdout:8/163: mkdir de/d17/d21/d24/d28/d31 0 2024-05-09T00:07:38.588 INFO:tasks.workunit.client.1.smithi135.stdout:3/834: dwrite d8/d6d/d44/d4b/d59/fbe [0,4194304] 0 2024-05-09T00:07:38.588 INFO:tasks.workunit.client.1.smithi135.stdout:3/835: stat d8/d102/d63 0 2024-05-09T00:07:38.588 INFO:tasks.workunit.client.1.smithi135.stdout:6/797: link d2/da/d26/d57/d59/d62/da8/lc2 d2/l10e 0 2024-05-09T00:07:38.588 INFO:tasks.workunit.client.1.smithi135.stdout:6/798: fsync d2/d20/d3f/f44 0 2024-05-09T00:07:38.588 INFO:tasks.workunit.client.0.smithi026.stdout:1/153: dread d5/d16/f19 [0,4194304] 0 2024-05-09T00:07:38.591 INFO:tasks.workunit.client.1.smithi135.stdout:2/788: getdents d1/d12/d20/d3b 0 2024-05-09T00:07:38.592 INFO:tasks.workunit.client.1.smithi135.stdout:4/673: dread dc/dd/f80 [0,4194304] 0 2024-05-09T00:07:38.592 INFO:tasks.workunit.client.1.smithi135.stdout:4/674: stat dc/d26/d4e/fa2 0 2024-05-09T00:07:38.593 INFO:tasks.workunit.client.0.smithi026.stdout:7/219: unlink d8/d12/c23 0 2024-05-09T00:07:38.595 INFO:tasks.workunit.client.1.smithi135.stdout:8/769: link d4/d22/f51 d4/d8/da2/da6/db8/f106 0 2024-05-09T00:07:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 -- 172.21.15.26:0/1978605037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 msgr2=0x7f68840f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 --2- 172.21.15.26:0/1978605037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 0x7f68840f7c20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f6874004730 tx=0x7f6874009cb0).stop 2024-05-09T00:07:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 -- 172.21.15.26:0/1978605037 shutdown_connections 2024-05-09T00:07:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 --2- 172.21.15.26:0/1978605037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68840f8aa0 0x7f68840f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 --2- 172.21.15.26:0/1978605037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 0x7f68840f7c20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:38.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 -- 172.21.15.26:0/1978605037 >> 172.21.15.26:0/1978605037 conn(0x7f68840f2f80 msgr2=0x7f68840f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 -- 172.21.15.26:0/1978605037 shutdown_connections 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 -- 172.21.15.26:0/1978605037 wait complete. 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.601+0000 7f6889f7e700 1 Processor -- start 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f6889f7e700 1 -- start start 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f6889f7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 0x7f688410a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f6889f7e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68840f8aa0 0x7f688410a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f6889f7e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688410ac90 con 0x7f68840f7800 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f6889f7e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688410add0 con 0x7f68840f8aa0 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f68837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 0x7f688410a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f68837fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 0x7f688410a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56670/0 (socket says 172.21.15.26:56670) 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f68837fe700 1 -- 172.21.15.26:0/3785846610 learned_addr learned my addr 172.21.15.26:0/3785846610 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f6882ffd700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68840f8aa0 0x7f688410a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f68837fe700 1 -- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68840f8aa0 msgr2=0x7f688410a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:38.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f68837fe700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68840f8aa0 0x7f688410a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f68837fe700 1 -- 172.21.15.26:0/3785846610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6874005040 con 0x7f68840f7800 2024-05-09T00:07:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f68837fe700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 0x7f688410a1f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6874000c00 tx=0x7f687400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.602+0000 7f6880ff9700 1 -- 172.21.15.26:0/3785846610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6874019070 con 0x7f68840f7800 2024-05-09T00:07:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.603+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688410f810 con 0x7f68840f7800 2024-05-09T00:07:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.603+0000 7f6880ff9700 1 -- 172.21.15.26:0/3785846610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68740097d0 con 0x7f68840f7800 2024-05-09T00:07:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.603+0000 7f6880ff9700 1 -- 172.21.15.26:0/3785846610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687401ec90 con 0x7f68840f7800 2024-05-09T00:07:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.603+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688410fdd0 con 0x7f68840f7800 2024-05-09T00:07:38.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.604+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68840fffc0 con 0x7f68840f7800 2024-05-09T00:07:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.604+0000 7f6880ff9700 1 -- 172.21.15.26:0/3785846610 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f687401e600 con 0x7f68840f7800 2024-05-09T00:07:38.600 INFO:tasks.workunit.client.0.smithi026.stdout:8/164: symlink de/d17/l32 0 2024-05-09T00:07:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.605+0000 7f6880ff9700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f686c066dc0 0x7f686c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:38.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.605+0000 7f6880ff9700 1 -- 172.21.15.26:0/3785846610 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f6874085020 con 0x7f68840f7800 2024-05-09T00:07:38.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.605+0000 7f6882ffd700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f686c066dc0 0x7f686c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:38.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.605+0000 7f6882ffd700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f686c066dc0 0x7f686c069280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6878009a00 tx=0x7f687800b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:38.601 INFO:tasks.workunit.client.0.smithi026.stdout:1/154: symlink d5/dd/d17/l31 0 2024-05-09T00:07:38.601 INFO:tasks.workunit.client.0.smithi026.stdout:1/155: chown f2 14 1 2024-05-09T00:07:38.602 INFO:tasks.workunit.client.0.smithi026.stdout:1/156: write f2 [3503221,79118] 0 2024-05-09T00:07:38.603 INFO:tasks.workunit.client.0.smithi026.stdout:7/220: symlink d8/d12/d22/l44 0 2024-05-09T00:07:38.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.610+0000 7f6880ff9700 1 -- 172.21.15.26:0/3785846610 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f68740530c0 con 0x7f68840f7800 2024-05-09T00:07:38.604 INFO:tasks.workunit.client.1.smithi135.stdout:9/684: symlink d1/d24/d44/ld9 0 2024-05-09T00:07:38.608 INFO:tasks.workunit.client.1.smithi135.stdout:5/824: rename db/d3f/f4d to db/d24/d32/dfa/d9c/d9f/d92/f105 0 2024-05-09T00:07:38.609 INFO:tasks.workunit.client.0.smithi026.stdout:8/165: rename de/d17/d27 to de/d17/d21/d24/d28/d31/d33 0 2024-05-09T00:07:38.612 INFO:tasks.workunit.client.0.smithi026.stdout:1/157: unlink d5/d16/f19 0 2024-05-09T00:07:38.612 INFO:tasks.workunit.client.0.smithi026.stdout:1/158: fsync f4 0 2024-05-09T00:07:38.612 INFO:tasks.workunit.client.1.smithi135.stdout:7/870: truncate db/dd/d33/d68/d10a/d3a/f3b 3780785 0 2024-05-09T00:07:38.614 INFO:tasks.workunit.client.1.smithi135.stdout:1/780: unlink da/d14/d20/d38/d3a/d40/d96/fef 0 2024-05-09T00:07:38.618 INFO:tasks.workunit.client.0.smithi026.stdout:7/221: symlink d8/l45 0 2024-05-09T00:07:38.620 INFO:tasks.workunit.client.1.smithi135.stdout:1/781: dread da/f10 [0,4194304] 0 2024-05-09T00:07:38.620 INFO:tasks.workunit.client.1.smithi135.stdout:1/782: chown da/d24/dd0/lf4 2 1 2024-05-09T00:07:38.624 INFO:tasks.workunit.client.1.smithi135.stdout:3/836: creat d8/d6d/d44/d4b/da0/daa/dc9/f124 x:0 0 0 2024-05-09T00:07:38.625 INFO:tasks.workunit.client.1.smithi135.stdout:6/799: dwrite f1 [0,4194304] 0 2024-05-09T00:07:38.627 INFO:tasks.workunit.client.1.smithi135.stdout:4/675: truncate dc/dd/f11 811617 0 2024-05-09T00:07:38.629 INFO:tasks.workunit.client.0.smithi026.stdout:7/222: symlink d8/d12/d1e/d3d/l46 0 2024-05-09T00:07:38.629 INFO:tasks.workunit.client.0.smithi026.stdout:7/223: chown f7 6633847 1 2024-05-09T00:07:38.629 INFO:tasks.workunit.client.0.smithi026.stdout:7/224: chown d8/c13 7626 1 2024-05-09T00:07:38.629 INFO:tasks.workunit.client.0.smithi026.stdout:1/159: dwrite f3 [0,4194304] 0 2024-05-09T00:07:38.631 INFO:tasks.workunit.client.0.smithi026.stdout:8/166: truncate f9 1038768 0 2024-05-09T00:07:38.632 INFO:tasks.workunit.client.0.smithi026.stdout:8/167: truncate de/f15 1111813 0 2024-05-09T00:07:38.634 INFO:tasks.workunit.client.1.smithi135.stdout:8/770: mknod d4/d22/c107 0 2024-05-09T00:07:38.634 INFO:tasks.workunit.client.1.smithi135.stdout:8/771: chown d4/d7/d4a/fef 416 1 2024-05-09T00:07:38.634 INFO:tasks.workunit.client.1.smithi135.stdout:7/871: dwrite db/da8/d78/f87 [0,4194304] 0 2024-05-09T00:07:38.636 INFO:tasks.workunit.client.1.smithi135.stdout:9/685: rmdir d1/d1a/d10 39 2024-05-09T00:07:38.639 INFO:tasks.workunit.client.0.smithi026.stdout:7/225: rename d8/fa to d8/d1b/f47 0 2024-05-09T00:07:38.643 INFO:tasks.workunit.client.1.smithi135.stdout:2/789: rename d1/d12/d21/d41/d6d/db4 to d1/d12/d21/d57/d10b 0 2024-05-09T00:07:38.644 INFO:tasks.workunit.client.0.smithi026.stdout:1/160: dread d5/dd/ff [0,4194304] 0 2024-05-09T00:07:38.645 INFO:tasks.workunit.client.1.smithi135.stdout:5/825: truncate db/d5d/dac/f82 683483 0 2024-05-09T00:07:38.647 INFO:tasks.workunit.client.0.smithi026.stdout:8/168: symlink de/l34 0 2024-05-09T00:07:38.647 INFO:tasks.workunit.client.0.smithi026.stdout:8/169: chown de/f16 2 1 2024-05-09T00:07:38.649 INFO:tasks.workunit.client.1.smithi135.stdout:1/783: creat da/db/d16/df2/f112 x:0 0 0 2024-05-09T00:07:38.649 INFO:tasks.workunit.client.1.smithi135.stdout:1/784: dread - da/d24/d27/d33/d7d/ffe zero size 2024-05-09T00:07:38.649 INFO:tasks.workunit.client.0.smithi026.stdout:0/260: truncate f4 173265 0 2024-05-09T00:07:38.650 INFO:tasks.workunit.client.0.smithi026.stdout:0/261: fdatasync f11 0 2024-05-09T00:07:38.650 INFO:tasks.workunit.client.0.smithi026.stdout:7/226: creat d8/d12/d1e/d3d/f48 x:0 0 0 2024-05-09T00:07:38.651 INFO:tasks.workunit.client.1.smithi135.stdout:3/837: creat d8/d13/d1f/d62/d10c/f125 x:0 0 0 2024-05-09T00:07:38.653 INFO:tasks.workunit.client.0.smithi026.stdout:1/161: symlink d5/dd/d17/d29/l32 0 2024-05-09T00:07:38.654 INFO:tasks.workunit.client.1.smithi135.stdout:6/800: rmdir d2/da/d1d 39 2024-05-09T00:07:38.655 INFO:tasks.workunit.client.0.smithi026.stdout:1/162: dread d5/db/f1e [0,4194304] 0 2024-05-09T00:07:38.655 INFO:tasks.workunit.client.0.smithi026.stdout:1/163: fsync d5/f2c 0 2024-05-09T00:07:38.655 INFO:tasks.workunit.client.0.smithi026.stdout:8/170: symlink de/d17/d21/d24/l35 0 2024-05-09T00:07:38.658 INFO:tasks.workunit.client.0.smithi026.stdout:7/227: symlink d8/d12/d22/d29/l49 0 2024-05-09T00:07:38.658 INFO:tasks.workunit.client.0.smithi026.stdout:7/228: write d8/d12/d1e/f41 [798283,125925] 0 2024-05-09T00:07:38.660 INFO:tasks.workunit.client.1.smithi135.stdout:1/785: dread da/d14/d5c/f6b [0,4194304] 0 2024-05-09T00:07:38.660 INFO:tasks.workunit.client.1.smithi135.stdout:4/676: dread dc/f4b [0,4194304] 0 2024-05-09T00:07:38.661 INFO:tasks.workunit.client.0.smithi026.stdout:1/164: symlink d5/db/d30/l33 0 2024-05-09T00:07:38.661 INFO:tasks.workunit.client.0.smithi026.stdout:1/165: write d5/dd/fe [2350510,46629] 0 2024-05-09T00:07:38.661 INFO:tasks.workunit.client.1.smithi135.stdout:8/772: mkdir d4/d7/de/d108 0 2024-05-09T00:07:38.662 INFO:tasks.workunit.client.1.smithi135.stdout:0/768: sync 2024-05-09T00:07:38.663 INFO:tasks.workunit.client.0.smithi026.stdout:8/171: symlink de/d17/d21/l36 0 2024-05-09T00:07:38.664 INFO:tasks.workunit.client.0.smithi026.stdout:8/172: stat de/d17/d21/l30 0 2024-05-09T00:07:38.664 INFO:tasks.workunit.client.0.smithi026.stdout:8/173: chown de/f20 268303 1 2024-05-09T00:07:38.667 INFO:tasks.workunit.client.1.smithi135.stdout:7/872: symlink db/dd/d33/da5/l123 0 2024-05-09T00:07:38.668 INFO:tasks.workunit.client.1.smithi135.stdout:9/686: mknod d1/d24/d44/d7f/da2/dca/cda 0 2024-05-09T00:07:38.668 INFO:tasks.workunit.client.1.smithi135.stdout:6/801: dwrite d2/da/d26/d57/ddc/fee [0,4194304] 0 2024-05-09T00:07:38.669 INFO:tasks.workunit.client.0.smithi026.stdout:7/229: creat d8/d2e/f4a x:0 0 0 2024-05-09T00:07:38.669 INFO:tasks.workunit.client.0.smithi026.stdout:3/108: sync 2024-05-09T00:07:38.671 INFO:tasks.workunit.client.1.smithi135.stdout:7/873: dread db/dd/d33/d68/d10a/d3a/d40/d4c/d67/fa0 [0,4194304] 0 2024-05-09T00:07:38.671 INFO:tasks.workunit.client.1.smithi135.stdout:2/790: mknod d1/d12/d21/d57/d10b/c10c 0 2024-05-09T00:07:38.674 INFO:tasks.workunit.client.1.smithi135.stdout:7/874: write db/f37 [3206435,14455] 0 2024-05-09T00:07:38.674 INFO:tasks.workunit.client.1.smithi135.stdout:7/875: fsync db/ff1 0 2024-05-09T00:07:38.675 INFO:tasks.workunit.client.1.smithi135.stdout:5/826: symlink db/d24/d32/dfa/d9c/d9f/dc0/l106 0 2024-05-09T00:07:38.675 INFO:tasks.workunit.client.1.smithi135.stdout:5/827: write db/d24/d32/dfa/d9c/d9f/d92/ffd [940944,5190] 0 2024-05-09T00:07:38.675 INFO:tasks.workunit.client.1.smithi135.stdout:5/828: chown db/d84/d31/d5e/ddf/lf9 30895 1 2024-05-09T00:07:38.676 INFO:tasks.workunit.client.1.smithi135.stdout:7/876: write db/dd/f2d [1656532,15470] 0 2024-05-09T00:07:38.677 INFO:tasks.workunit.client.0.smithi026.stdout:3/109: dread f0 [0,4194304] 0 2024-05-09T00:07:38.678 INFO:tasks.workunit.client.1.smithi135.stdout:0/769: dwrite d3/dd/d3f/d29/f9c [0,4194304] 0 2024-05-09T00:07:38.683 INFO:tasks.workunit.client.0.smithi026.stdout:8/174: truncate de/d17/d21/f22 227578 0 2024-05-09T00:07:38.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/786: getdents da/d24 0 2024-05-09T00:07:38.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/787: truncate da/d14/d20/d38/d3a/d40/fd6 851940 0 2024-05-09T00:07:38.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/788: write da/d24/d27/d33/f60 [743671,24297] 0 2024-05-09T00:07:38.685 INFO:tasks.workunit.client.1.smithi135.stdout:3/838: rename d8/d6d/d44/d4b/d59/d90/d7b/d80/c10b to d8/d6d/d44/d4b/da0/daa/c126 0 2024-05-09T00:07:38.687 INFO:tasks.workunit.client.1.smithi135.stdout:3/839: dread d8/d102/fd6 [0,4194304] 0 2024-05-09T00:07:38.688 INFO:tasks.workunit.client.0.smithi026.stdout:7/230: mknod d8/d12/c4b 0 2024-05-09T00:07:38.688 INFO:tasks.workunit.client.0.smithi026.stdout:7/231: chown d8/d12/d1e/d3d/f48 2 1 2024-05-09T00:07:38.688 INFO:tasks.workunit.client.0.smithi026.stdout:7/232: dread - d8/d12/d22/f42 zero size 2024-05-09T00:07:38.689 INFO:tasks.workunit.client.1.smithi135.stdout:4/677: creat dc/d4a/d69/fe8 x:0 0 0 2024-05-09T00:07:38.690 INFO:tasks.workunit.client.0.smithi026.stdout:1/166: rmdir d5/dd/d17 39 2024-05-09T00:07:38.692 INFO:tasks.workunit.client.0.smithi026.stdout:2/130: sync 2024-05-09T00:07:38.693 INFO:tasks.workunit.client.0.smithi026.stdout:4/107: sync 2024-05-09T00:07:38.693 INFO:tasks.workunit.client.0.smithi026.stdout:2/131: stat fd 0 2024-05-09T00:07:38.693 INFO:tasks.workunit.client.1.smithi135.stdout:8/773: link d4/d7/de/d45/l86 d4/d7/de/d45/dc5/l109 0 2024-05-09T00:07:38.693 INFO:tasks.workunit.client.0.smithi026.stdout:8/175: mknod de/d17/d21/d24/d28/d31/d33/c37 0 2024-05-09T00:07:38.694 INFO:tasks.workunit.client.0.smithi026.stdout:8/176: fsync de/f23 0 2024-05-09T00:07:38.694 INFO:tasks.workunit.client.1.smithi135.stdout:7/877: dwrite db/d21/f8b [0,4194304] 0 2024-05-09T00:07:38.695 INFO:tasks.workunit.client.0.smithi026.stdout:8/177: truncate de/d17/f1a 4946195 0 2024-05-09T00:07:38.695 INFO:tasks.workunit.client.0.smithi026.stdout:0/262: read f4 [77916,12087] 0 2024-05-09T00:07:38.695 INFO:tasks.workunit.client.0.smithi026.stdout:0/263: write d1d/d1e/f32 [181482,130072] 0 2024-05-09T00:07:38.696 INFO:tasks.workunit.client.0.smithi026.stdout:4/108: write d0/d19/f1e [23356,108082] 0 2024-05-09T00:07:38.696 INFO:tasks.workunit.client.0.smithi026.stdout:4/109: truncate d0/f21 931215 0 2024-05-09T00:07:38.696 INFO:tasks.workunit.client.0.smithi026.stdout:4/110: readlink d0/lf 0 2024-05-09T00:07:38.697 INFO:tasks.workunit.client.1.smithi135.stdout:9/687: unlink d1/d1a/d89/d99/cc7 0 2024-05-09T00:07:38.697 INFO:tasks.workunit.client.1.smithi135.stdout:9/688: chown d1/d1a/d89 26306 1 2024-05-09T00:07:38.697 INFO:tasks.workunit.client.0.smithi026.stdout:7/233: mknod d8/c4c 0 2024-05-09T00:07:38.697 INFO:tasks.workunit.client.0.smithi026.stdout:7/234: stat d8/d12/d22/l35 0 2024-05-09T00:07:38.730 INFO:tasks.workunit.client.0.smithi026.stdout:8/178: dwrite de/f20 [0,4194304] 0 2024-05-09T00:07:38.730 INFO:tasks.workunit.client.0.smithi026.stdout:2/132: creat d14/d15/d20/f36 x:0 0 0 2024-05-09T00:07:38.735 INFO:tasks.workunit.client.1.smithi135.stdout:8/774: dwrite d4/d7/d33/d39/f47 [0,4194304] 0 2024-05-09T00:07:38.736 INFO:tasks.workunit.client.0.smithi026.stdout:0/264: mknod d1d/d1e/d20/c4f 0 2024-05-09T00:07:38.740 INFO:tasks.workunit.client.0.smithi026.stdout:7/235: dwrite d8/d2e/f4a [0,4194304] 0 2024-05-09T00:07:38.741 INFO:tasks.workunit.client.1.smithi135.stdout:5/829: dread db/d24/f2c [0,4194304] 0 2024-05-09T00:07:38.742 INFO:tasks.workunit.client.0.smithi026.stdout:4/111: getdents d0/d19 0 2024-05-09T00:07:38.753 INFO:tasks.workunit.client.1.smithi135.stdout:1/789: mkdir da/d14/d20/d38/d3a/d113 0 2024-05-09T00:07:38.753 INFO:tasks.workunit.client.1.smithi135.stdout:1/790: fdatasync da/d14/d20/d38/d3a/db7/de9/f105 0 2024-05-09T00:07:38.755 INFO:tasks.workunit.client.1.smithi135.stdout:8/775: dwrite d4/d7/de/d45/d76/de2/f9e [0,4194304] 0 2024-05-09T00:07:38.755 INFO:tasks.workunit.client.1.smithi135.stdout:8/776: write d4/d7/f8f [943125,98673] 0 2024-05-09T00:07:38.757 INFO:tasks.workunit.client.1.smithi135.stdout:4/678: readlink dc/d4a/d69/d39/l4d 0 2024-05-09T00:07:38.757 INFO:tasks.workunit.client.1.smithi135.stdout:4/679: fdatasync dc/d26/d93/fc8 0 2024-05-09T00:07:38.757 INFO:tasks.workunit.client.1.smithi135.stdout:4/680: chown dc/d4a/d69/fe8 3393 1 2024-05-09T00:07:38.758 INFO:tasks.workunit.client.1.smithi135.stdout:6/802: dwrite d2/da/d26/d57/d60/fd3 [8388608,4194304] 0 2024-05-09T00:07:38.758 INFO:tasks.workunit.client.0.smithi026.stdout:3/110: link d5/le d5/l21 0 2024-05-09T00:07:38.759 INFO:tasks.workunit.client.0.smithi026.stdout:3/111: chown d5/d1e/f20 3 1 2024-05-09T00:07:38.759 INFO:tasks.workunit.client.0.smithi026.stdout:3/112: chown d5 839 1 2024-05-09T00:07:38.761 INFO:tasks.workunit.client.1.smithi135.stdout:6/803: read d2/fd [2737893,32776] 0 2024-05-09T00:07:38.761 INFO:tasks.workunit.client.1.smithi135.stdout:6/804: chown d2/d20/d2e/cc5 24 1 2024-05-09T00:07:38.763 INFO:tasks.workunit.client.0.smithi026.stdout:3/113: dread d5/f12 [0,4194304] 0 2024-05-09T00:07:38.765 INFO:tasks.workunit.client.0.smithi026.stdout:3/114: read d5/d9/dc/f11 [4184674,92417] 0 2024-05-09T00:07:38.767 INFO:tasks.workunit.client.0.smithi026.stdout:3/115: dread d5/d9/dc/f1b [0,4194304] 0 2024-05-09T00:07:38.769 INFO:tasks.workunit.client.0.smithi026.stdout:2/133: creat d14/f37 x:0 0 0 2024-05-09T00:07:38.771 INFO:tasks.workunit.client.0.smithi026.stdout:0/265: unlink ce 0 2024-05-09T00:07:38.771 INFO:tasks.workunit.client.0.smithi026.stdout:0/266: chown d1d/c24 5 1 2024-05-09T00:07:38.774 INFO:tasks.workunit.client.0.smithi026.stdout:3/116: dread f0 [0,4194304] 0 2024-05-09T00:07:38.777 INFO:tasks.workunit.client.1.smithi135.stdout:7/878: getdents db/dd/d33/d68/d10a/d3a/d40/d4c/d67/dc8 0 2024-05-09T00:07:38.779 INFO:tasks.workunit.client.0.smithi026.stdout:7/236: mknod d8/d12/c4d 0 2024-05-09T00:07:38.780 INFO:tasks.workunit.client.0.smithi026.stdout:0/267: dread d1d/d33/f36 [0,4194304] 0 2024-05-09T00:07:38.781 INFO:tasks.workunit.client.1.smithi135.stdout:9/689: creat d1/d1a/d89/dad/fdb x:0 0 0 2024-05-09T00:07:38.781 INFO:tasks.workunit.client.1.smithi135.stdout:2/791: dwrite d1/d12/fb3 [4194304,4194304] 0 2024-05-09T00:07:38.782 INFO:tasks.workunit.client.1.smithi135.stdout:2/792: write d1/d12/d20/d2b/d56/d86/fda [177046,60061] 0 2024-05-09T00:07:38.782 INFO:tasks.workunit.client.0.smithi026.stdout:4/112: mknod d0/d19/c23 0 2024-05-09T00:07:38.782 INFO:tasks.workunit.client.0.smithi026.stdout:4/113: readlink d0/l5 0 2024-05-09T00:07:38.783 INFO:tasks.workunit.client.1.smithi135.stdout:8/777: dwrite d4/d7/d33/f55 [4194304,4194304] 0 2024-05-09T00:07:38.785 INFO:tasks.workunit.client.0.smithi026.stdout:2/134: getdents d14/d15/d20 0 2024-05-09T00:07:38.785 INFO:tasks.workunit.client.0.smithi026.stdout:2/135: read - d14/d15/f25 zero size 2024-05-09T00:07:38.791 INFO:tasks.workunit.client.0.smithi026.stdout:7/237: rmdir d8/d12/d22/d29/d3e 0 2024-05-09T00:07:38.792 INFO:tasks.workunit.client.1.smithi135.stdout:5/830: unlink db/d84/ldd 0 2024-05-09T00:07:38.792 INFO:tasks.workunit.client.1.smithi135.stdout:5/831: fdatasync db/d5d/fe4 0 2024-05-09T00:07:38.793 INFO:tasks.workunit.client.0.smithi026.stdout:0/268: stat c3 0 2024-05-09T00:07:38.794 INFO:tasks.workunit.client.1.smithi135.stdout:8/778: dread d4/f20 [0,4194304] 0 2024-05-09T00:07:38.794 INFO:tasks.workunit.client.1.smithi135.stdout:8/779: chown d4/d7/d4a/d9c/cd8 4762 1 2024-05-09T00:07:38.797 INFO:tasks.workunit.client.1.smithi135.stdout:1/791: creat da/db/d16/f114 x:0 0 0 2024-05-09T00:07:38.798 INFO:tasks.workunit.client.0.smithi026.stdout:2/136: creat d14/d15/d1f/f38 x:0 0 0 2024-05-09T00:07:38.801 INFO:tasks.workunit.client.0.smithi026.stdout:3/117: dwrite d5/d9/dc/f11 [0,4194304] 0 2024-05-09T00:07:38.804 INFO:tasks.workunit.client.0.smithi026.stdout:0/269: unlink d1d/d25/l2f 0 2024-05-09T00:07:38.806 INFO:tasks.workunit.client.1.smithi135.stdout:2/793: dwrite d1/d12/d21/d41/d6d/d6e/f9a [0,4194304] 0 2024-05-09T00:07:38.807 INFO:tasks.workunit.client.1.smithi135.stdout:3/840: truncate d8/d6d/d44/d4b/d59/fbe 3722347 0 2024-05-09T00:07:38.807 INFO:tasks.workunit.client.0.smithi026.stdout:4/114: mknod d0/c24 0 2024-05-09T00:07:38.813 INFO:tasks.workunit.client.0.smithi026.stdout:2/137: creat d14/d15/f39 x:0 0 0 2024-05-09T00:07:38.813 INFO:tasks.workunit.client.0.smithi026.stdout:2/138: write d14/d15/d17/f1c [5148261,73606] 0 2024-05-09T00:07:38.813 INFO:tasks.workunit.client.0.smithi026.stdout:2/139: dread - d14/d15/f26 zero size 2024-05-09T00:07:38.814 INFO:tasks.workunit.client.1.smithi135.stdout:4/681: symlink dc/dd/le9 0 2024-05-09T00:07:38.816 INFO:tasks.workunit.client.0.smithi026.stdout:3/118: dwrite d5/d9/dc/f18 [0,4194304] 0 2024-05-09T00:07:38.818 INFO:tasks.workunit.client.0.smithi026.stdout:0/270: symlink d1d/d1e/d2d/l50 0 2024-05-09T00:07:38.819 INFO:tasks.workunit.client.1.smithi135.stdout:6/805: creat d2/da/d1d/d69/dfc/f10f x:0 0 0 2024-05-09T00:07:38.821 INFO:tasks.workunit.client.0.smithi026.stdout:4/115: rename d0/fb to d0/d12/d1b/f25 0 2024-05-09T00:07:38.822 INFO:tasks.workunit.client.1.smithi135.stdout:7/879: symlink db/dd/d33/d68/d10a/d3a/d40/d4c/d67/def/l124 0 2024-05-09T00:07:38.823 INFO:tasks.workunit.client.0.smithi026.stdout:3/119: creat d5/f22 x:0 0 0 2024-05-09T00:07:38.825 INFO:tasks.workunit.client.0.smithi026.stdout:0/271: mkdir d1d/d1e/d20/d51 0 2024-05-09T00:07:38.825 INFO:tasks.workunit.client.0.smithi026.stdout:0/272: dread - d1d/d25/d3c/f4c zero size 2024-05-09T00:07:38.826 INFO:tasks.workunit.client.0.smithi026.stdout:0/273: stat d1d/d33/f38 0 2024-05-09T00:07:38.828 INFO:tasks.workunit.client.0.smithi026.stdout:4/116: creat d0/d12/d1b/f26 x:0 0 0 2024-05-09T00:07:38.829 INFO:tasks.workunit.client.0.smithi026.stdout:3/120: creat d5/d9/dc/f23 x:0 0 0 2024-05-09T00:07:38.831 INFO:tasks.workunit.client.0.smithi026.stdout:4/117: symlink d0/d12/d1b/l27 0 2024-05-09T00:07:38.836 INFO:tasks.workunit.client.1.smithi135.stdout:8/780: unlink d4/d7/f8f 0 2024-05-09T00:07:38.837 INFO:tasks.workunit.client.1.smithi135.stdout:6/806: dread d2/fd [0,4194304] 0 2024-05-09T00:07:38.837 INFO:tasks.workunit.client.0.smithi026.stdout:3/121: dread d5/d9/f16 [0,4194304] 0 2024-05-09T00:07:38.837 INFO:tasks.workunit.client.0.smithi026.stdout:3/122: write d5/d1e/f20 [878505,45077] 0 2024-05-09T00:07:38.838 INFO:tasks.workunit.client.1.smithi135.stdout:1/792: creat da/d14/d20/d38/d3a/d40/d75/f115 x:0 0 0 2024-05-09T00:07:38.840 INFO:tasks.workunit.client.0.smithi026.stdout:4/118: rename d0/d12/d1b/c1c to d0/c28 0 2024-05-09T00:07:38.840 INFO:tasks.workunit.client.0.smithi026.stdout:4/119: fdatasync d0/f21 0 2024-05-09T00:07:38.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/123: creat d5/d9/f24 x:0 0 0 2024-05-09T00:07:38.848 INFO:tasks.workunit.client.1.smithi135.stdout:2/794: rename d1/d12/d20/c2c to d1/d12/d21/d41/c10d 0 2024-05-09T00:07:38.848 INFO:tasks.workunit.client.1.smithi135.stdout:4/682: write dc/d4a/d69/f51 [663033,6069] 0 2024-05-09T00:07:38.848 INFO:tasks.workunit.client.1.smithi135.stdout:4/683: readlink dc/dd/l1c 0 2024-05-09T00:07:38.848 INFO:tasks.workunit.client.1.smithi135.stdout:2/795: chown d1/d12/d20/d2b/d56/l5d 75 1 2024-05-09T00:07:38.848 INFO:tasks.workunit.client.1.smithi135.stdout:4/684: truncate dc/d4a/d69/d55/d5f/f53 1215999 0 2024-05-09T00:07:38.849 INFO:tasks.workunit.client.1.smithi135.stdout:3/841: mknod d8/d102/d63/c127 0 2024-05-09T00:07:38.851 INFO:tasks.workunit.client.1.smithi135.stdout:7/880: mkdir db/d125 0 2024-05-09T00:07:38.851 INFO:tasks.workunit.client.0.smithi026.stdout:7/238: dwrite d8/d2e/f4a [4194304,4194304] 0 2024-05-09T00:07:38.854 INFO:tasks.workunit.client.1.smithi135.stdout:8/781: mkdir d4/d22/d8b/d10a 0 2024-05-09T00:07:38.854 INFO:tasks.workunit.client.1.smithi135.stdout:1/793: mknod da/d24/d27/d33/d36/c116 0 2024-05-09T00:07:38.858 INFO:tasks.workunit.client.1.smithi135.stdout:2/796: creat d1/d12/d20/d3b/d105/f10e x:0 0 0 2024-05-09T00:07:38.858 INFO:tasks.workunit.client.1.smithi135.stdout:1/794: write da/f62 [2606362,80398] 0 2024-05-09T00:07:38.861 INFO:tasks.workunit.client.0.smithi026.stdout:7/239: symlink d8/l4e 0 2024-05-09T00:07:38.861 INFO:tasks.workunit.client.0.smithi026.stdout:7/240: readlink d8/d12/l16 0 2024-05-09T00:07:38.862 INFO:tasks.workunit.client.1.smithi135.stdout:2/797: dread d1/d12/d21/d57/d10b/f100 [0,4194304] 0 2024-05-09T00:07:38.862 INFO:tasks.workunit.client.1.smithi135.stdout:2/798: stat d1/d12/d20/d2b/d94 0 2024-05-09T00:07:38.862 INFO:tasks.workunit.client.1.smithi135.stdout:2/799: chown d1/d12/d27/l4c 6 1 2024-05-09T00:07:38.863 INFO:tasks.workunit.client.1.smithi135.stdout:3/842: dread d8/f26 [0,4194304] 0 2024-05-09T00:07:38.863 INFO:tasks.workunit.client.1.smithi135.stdout:7/881: link db/l32 db/l126 0 2024-05-09T00:07:38.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/795: dread da/d14/d5c/f6b [0,4194304] 0 2024-05-09T00:07:38.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/796: write da/db/d16/f3e [661802,126651] 0 2024-05-09T00:07:38.865 INFO:tasks.workunit.client.1.smithi135.stdout:8/782: mknod d4/d7/d2a/d56/c10b 0 2024-05-09T00:07:38.865 INFO:tasks.workunit.client.1.smithi135.stdout:7/882: dread db/dd/d33/f9e [0,4194304] 0 2024-05-09T00:07:38.866 INFO:tasks.workunit.client.1.smithi135.stdout:2/800: truncate d1/d12/d21/d57/f95 606835 0 2024-05-09T00:07:38.866 INFO:tasks.workunit.client.1.smithi135.stdout:2/801: write d1/d22/f81 [635439,6681] 0 2024-05-09T00:07:38.876 INFO:tasks.workunit.client.1.smithi135.stdout:8/783: rename d4/d7/d2a/d56/fbe to d4/d8/da2/da6/db8/dd1/f10c 0 2024-05-09T00:07:38.876 INFO:tasks.workunit.client.1.smithi135.stdout:7/883: rmdir db/dd/d33/d68/d10a/d3a/d40/d4c/da3 39 2024-05-09T00:07:38.876 INFO:tasks.workunit.client.1.smithi135.stdout:2/802: creat d1/d12/d20/d2b/d7c/db5/f10f x:0 0 0 2024-05-09T00:07:38.879 INFO:tasks.workunit.client.1.smithi135.stdout:8/784: write d4/d22/f72 [8149668,47014] 0 2024-05-09T00:07:38.879 INFO:tasks.workunit.client.1.smithi135.stdout:8/785: chown d4/d7/d2a/d56/lbd 278 1 2024-05-09T00:07:38.880 INFO:tasks.workunit.client.1.smithi135.stdout:7/884: mkdir db/dd/d33/d68/d10a/d94/d127 0 2024-05-09T00:07:38.880 INFO:tasks.workunit.client.1.smithi135.stdout:7/885: dread - db/dd/d33/d58/dc7/f107 zero size 2024-05-09T00:07:38.880 INFO:tasks.workunit.client.0.smithi026.stdout:0/274: dwrite d1d/d25/d3c/f40 [0,4194304] 0 2024-05-09T00:07:38.881 INFO:tasks.workunit.client.1.smithi135.stdout:6/807: dwrite d2/da/d1d/d69/d78/fc9 [0,4194304] 0 2024-05-09T00:07:38.882 INFO:tasks.workunit.client.1.smithi135.stdout:0/770: sync 2024-05-09T00:07:38.882 INFO:tasks.workunit.client.1.smithi135.stdout:6/808: write d2/f17 [1613988,6659] 0 2024-05-09T00:07:38.884 INFO:tasks.workunit.client.1.smithi135.stdout:6/809: write d2/da/d26/d57/d60/fdf [3428779,58755] 0 2024-05-09T00:07:38.884 INFO:tasks.workunit.client.1.smithi135.stdout:8/786: unlink d4/d8/da2/ffd 0 2024-05-09T00:07:38.884 INFO:tasks.workunit.client.0.smithi026.stdout:3/124: dwrite d5/d9/ff [0,4194304] 0 2024-05-09T00:07:38.887 INFO:tasks.workunit.client.1.smithi135.stdout:7/886: creat db/da8/d78/f128 x:0 0 0 2024-05-09T00:07:38.887 INFO:tasks.workunit.client.0.smithi026.stdout:4/120: dwrite d0/f22 [0,4194304] 0 2024-05-09T00:07:38.891 INFO:tasks.workunit.client.0.smithi026.stdout:0/275: symlink d1d/d25/d47/l52 0 2024-05-09T00:07:38.899 INFO:tasks.workunit.client.0.smithi026.stdout:3/125: creat d5/d9/d13/f25 x:0 0 0 2024-05-09T00:07:38.901 INFO:tasks.workunit.client.1.smithi135.stdout:0/771: write d3/dd/d3f/f72 [4168798,47724] 0 2024-05-09T00:07:38.901 INFO:tasks.workunit.client.1.smithi135.stdout:0/772: read - d3/dd/d3f/d29/d54/f99 zero size 2024-05-09T00:07:38.903 INFO:tasks.workunit.client.0.smithi026.stdout:0/276: symlink d1d/d25/d3c/l53 0 2024-05-09T00:07:38.904 INFO:tasks.workunit.client.0.smithi026.stdout:0/277: getdents d1d/d1e/d20/d51 0 2024-05-09T00:07:38.905 INFO:tasks.workunit.client.1.smithi135.stdout:6/810: mkdir d2/da/d49/da6/dd9/d10d/d110 0 2024-05-09T00:07:38.905 INFO:tasks.workunit.client.1.smithi135.stdout:1/797: dwrite da/d14/d20/d38/d3a/d40/fc5 [0,4194304] 0 2024-05-09T00:07:38.905 INFO:tasks.workunit.client.1.smithi135.stdout:1/798: chown da/d14/d20/d38/d3a/f8b 261 1 2024-05-09T00:07:38.905 INFO:tasks.workunit.client.1.smithi135.stdout:3/843: dwrite d8/d13/d1f/f2f [0,4194304] 0 2024-05-09T00:07:38.905 INFO:tasks.workunit.client.1.smithi135.stdout:3/844: fdatasync d8/d6d/d44/d4b/d59/d90/d7b/fc0 0 2024-05-09T00:07:38.905 INFO:tasks.workunit.client.1.smithi135.stdout:3/845: stat d8/d13/f2d 0 2024-05-09T00:07:38.907 INFO:tasks.workunit.client.0.smithi026.stdout:7/241: dwrite d8/d12/d22/f42 [0,4194304] 0 2024-05-09T00:07:38.907 INFO:tasks.workunit.client.1.smithi135.stdout:7/887: rmdir db/dd 39 2024-05-09T00:07:38.907 INFO:tasks.workunit.client.1.smithi135.stdout:7/888: write db/da8/d78/f11d [467975,69431] 0 2024-05-09T00:07:38.907 INFO:tasks.workunit.client.1.smithi135.stdout:8/787: dwrite d4/d7/de/d45/d76/de2/f9e [4194304,4194304] 0 2024-05-09T00:07:38.908 INFO:tasks.workunit.client.1.smithi135.stdout:8/788: stat d4/d7/de/f35 0 2024-05-09T00:07:38.908 INFO:tasks.workunit.client.0.smithi026.stdout:4/121: rename d0/d12/c20 to d0/d19/c29 0 2024-05-09T00:07:38.912 INFO:tasks.workunit.client.1.smithi135.stdout:0/773: unlink d3/dd/d2d/d4c/fc5 0 2024-05-09T00:07:38.914 INFO:tasks.workunit.client.1.smithi135.stdout:6/811: rmdir d2/d1a 39 2024-05-09T00:07:38.914 INFO:tasks.workunit.client.1.smithi135.stdout:6/812: write d2/d20/d37/d4e/f6a [1042193,74676] 0 2024-05-09T00:07:38.920 INFO:tasks.workunit.client.0.smithi026.stdout:7/242: dread d8/d12/d1e/f32 [0,4194304] 0 2024-05-09T00:07:38.921 INFO:tasks.workunit.client.0.smithi026.stdout:7/243: write d8/f10 [702308,3652] 0 2024-05-09T00:07:38.922 INFO:tasks.workunit.client.0.smithi026.stdout:0/278: rename d1d/d1e/f26 to d1d/d25/f54 0 2024-05-09T00:07:38.923 INFO:tasks.workunit.client.0.smithi026.stdout:0/279: chown d1d/d1e/d2d/l50 1347092 1 2024-05-09T00:07:38.926 INFO:tasks.workunit.client.0.smithi026.stdout:3/126: link d5/c17 d5/c26 0 2024-05-09T00:07:38.930 INFO:tasks.workunit.client.0.smithi026.stdout:0/280: dread f19 [0,4194304] 0 2024-05-09T00:07:38.930 INFO:tasks.workunit.client.0.smithi026.stdout:0/281: chown d1d/d25/d47/l52 25596 1 2024-05-09T00:07:38.932 INFO:tasks.workunit.client.0.smithi026.stdout:7/244: symlink d8/d12/d22/l4f 0 2024-05-09T00:07:38.934 INFO:tasks.workunit.client.1.smithi135.stdout:3/846: creat d8/d102/d63/d89/f128 x:0 0 0 2024-05-09T00:07:38.934 INFO:tasks.workunit.client.1.smithi135.stdout:3/847: fdatasync d8/d13/d75/fac 0 2024-05-09T00:07:38.935 INFO:tasks.workunit.client.0.smithi026.stdout:3/127: mknod d5/d9/dc/c27 0 2024-05-09T00:07:38.938 INFO:tasks.workunit.client.1.smithi135.stdout:7/889: rename db/dd/d33/d68/d10a/d3a/d40/d84/f85 to db/dd/d33/d68/d10a/d94/f129 0 2024-05-09T00:07:38.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.946+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6884059120 con 0x7f686c066dc0 2024-05-09T00:07:38.942 INFO:tasks.workunit.client.0.smithi026.stdout:3/128: rename d5/d9/d13 to d5/d9/dc/d28 0 2024-05-09T00:07:38.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.947+0000 7f6880ff9700 1 -- 172.21.15.26:0/3785846610 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6884059120 con 0x7f686c066dc0 2024-05-09T00:07:38.945 INFO:tasks.workunit.client.0.smithi026.stdout:0/282: dread f5 [0,4194304] 0 2024-05-09T00:07:38.945 INFO:tasks.workunit.client.1.smithi135.stdout:8/789: unlink d4/d7/da4/lad 0 2024-05-09T00:07:38.947 INFO:tasks.workunit.client.0.smithi026.stdout:3/129: mkdir d5/d1e/d29 0 2024-05-09T00:07:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.953+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f686c066dc0 msgr2=0x7f686c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.953+0000 7f6889f7e700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f686c066dc0 0x7f686c069280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6878009a00 tx=0x7f687800b040).stop 2024-05-09T00:07:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.953+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 msgr2=0x7f688410a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.953+0000 7f6889f7e700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 0x7f688410a1f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6874000c00 tx=0x7f687400b040).stop 2024-05-09T00:07:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.954+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 shutdown_connections 2024-05-09T00:07:38.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.954+0000 7f6889f7e700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f686c066dc0 0x7f686c069280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:38.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.954+0000 7f6889f7e700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68840f7800 0x7f688410a1f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:38.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.954+0000 7f6889f7e700 1 --2- 172.21.15.26:0/3785846610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68840f8aa0 0x7f688410a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:38.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.954+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 >> 172.21.15.26:0/3785846610 conn(0x7f68840f2f80 msgr2=0x7f688406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:38.953 INFO:tasks.workunit.client.0.smithi026.stdout:4/122: dwrite d0/d19/f1e [0,4194304] 0 2024-05-09T00:07:38.953 INFO:tasks.workunit.client.0.smithi026.stdout:4/123: chown d0/d12/d1b 487040 1 2024-05-09T00:07:38.955 INFO:tasks.workunit.client.1.smithi135.stdout:0/774: symlink d3/dd/d3f/d3a/da4/le1 0 2024-05-09T00:07:38.955 INFO:tasks.workunit.client.1.smithi135.stdout:0/775: chown d3/dd/d3f/d43/f8e 55 1 2024-05-09T00:07:38.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.960+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 shutdown_connections 2024-05-09T00:07:38.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:38.960+0000 7f6889f7e700 1 -- 172.21.15.26:0/3785846610 wait complete. 2024-05-09T00:07:38.957 INFO:tasks.workunit.client.0.smithi026.stdout:3/130: creat d5/d9/f2a x:0 0 0 2024-05-09T00:07:38.957 INFO:tasks.workunit.client.0.smithi026.stdout:3/131: truncate d5/d9/dc/d28/f25 1033844 0 2024-05-09T00:07:38.957 INFO:tasks.workunit.client.0.smithi026.stdout:3/132: fdatasync d5/d9/f2a 0 2024-05-09T00:07:38.957 INFO:tasks.workunit.client.1.smithi135.stdout:8/790: dread d4/d7/fca [0,4194304] 0 2024-05-09T00:07:38.958 INFO:tasks.workunit.client.1.smithi135.stdout:8/791: chown d4/d7/l79 7 1 2024-05-09T00:07:38.958 INFO:tasks.workunit.client.1.smithi135.stdout:6/813: link d2/da/d26/d57/d59/ce2 d2/da/d1d/d69/d89/c111 0 2024-05-09T00:07:38.961 INFO:tasks.workunit.client.1.smithi135.stdout:1/799: mknod da/db/c117 0 2024-05-09T00:07:38.961 INFO:tasks.workunit.client.1.smithi135.stdout:1/800: fsync da/d14/d5c/d83/fcb 0 2024-05-09T00:07:38.962 INFO:tasks.workunit.client.0.smithi026.stdout:3/133: rename d5/d1e/d29 to d5/d9/d2b 0 2024-05-09T00:07:38.963 INFO:tasks.workunit.client.0.smithi026.stdout:0/283: dwrite d1d/d25/f2b [0,4194304] 0 2024-05-09T00:07:38.963 INFO:tasks.workunit.client.0.smithi026.stdout:0/284: readlink d1d/d1e/d2d/l4e 0 2024-05-09T00:07:38.964 INFO:tasks.workunit.client.0.smithi026.stdout:0/285: readlink d1d/d1e/d2d/l50 0 2024-05-09T00:07:38.964 INFO:tasks.workunit.client.0.smithi026.stdout:7/245: dwrite d8/d12/d1e/f43 [0,4194304] 0 2024-05-09T00:07:38.966 INFO:tasks.workunit.client.0.smithi026.stdout:3/134: mkdir d5/d9/dc/d28/d2c 0 2024-05-09T00:07:38.966 INFO:tasks.workunit.client.0.smithi026.stdout:3/135: write d5/d9/dc/d28/f25 [967088,39262] 0 2024-05-09T00:07:38.967 INFO:tasks.workunit.client.1.smithi135.stdout:9/690: sync 2024-05-09T00:07:38.967 INFO:tasks.workunit.client.1.smithi135.stdout:9/691: stat d1/d24/d44/d54/d66 0 2024-05-09T00:07:38.969 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:07:38.969 INFO:tasks.workunit.client.0.smithi026.stdout:9/183: sync 2024-05-09T00:07:38.971 INFO:tasks.workunit.client.1.smithi135.stdout:3/848: rename d8/d6d/d44/d4b/d59 to d8/d6d/d44/d4b/dc2/d120/d129 0 2024-05-09T00:07:38.974 INFO:tasks.workunit.client.1.smithi135.stdout:7/890: getdents db/d5b 0 2024-05-09T00:07:38.977 INFO:tasks.workunit.client.0.smithi026.stdout:0/286: creat d1d/d25/f55 x:0 0 0 2024-05-09T00:07:38.978 INFO:tasks.workunit.client.1.smithi135.stdout:3/849: write d8/d6d/d44/d4b/d69/fca [2768932,32258] 0 2024-05-09T00:07:38.978 INFO:tasks.workunit.client.1.smithi135.stdout:3/850: chown d8/d6d/d24/l56 12 1 2024-05-09T00:07:38.979 INFO:tasks.workunit.client.1.smithi135.stdout:0/776: mkdir d3/dd/d3f/d3a/da4/de2 0 2024-05-09T00:07:38.979 INFO:tasks.workunit.client.1.smithi135.stdout:0/777: truncate d3/dd/d3f/d29/d7c/daa/fce 961423 0 2024-05-09T00:07:38.979 INFO:tasks.workunit.client.1.smithi135.stdout:0/778: truncate d3/dd/d3f/d29/f9c 4475122 0 2024-05-09T00:07:38.980 INFO:tasks.workunit.client.0.smithi026.stdout:7/246: rename d8/d1b/f47 to d8/d12/f50 0 2024-05-09T00:07:38.981 INFO:tasks.workunit.client.1.smithi135.stdout:8/792: creat d4/d22/f10d x:0 0 0 2024-05-09T00:07:38.982 INFO:tasks.workunit.client.0.smithi026.stdout:4/124: dwrite d0/f9 [0,4194304] 0 2024-05-09T00:07:38.982 INFO:tasks.workunit.client.0.smithi026.stdout:4/125: truncate d0/f1f 434704 0 2024-05-09T00:07:38.983 INFO:tasks.workunit.client.0.smithi026.stdout:3/136: creat d5/d9/d2b/f2d x:0 0 0 2024-05-09T00:07:38.984 INFO:tasks.workunit.client.1.smithi135.stdout:1/801: mknod da/d24/d27/d33/d52/dfc/c118 0 2024-05-09T00:07:38.990 INFO:tasks.workunit.client.1.smithi135.stdout:1/802: read da/d14/d20/d38/d3a/db7/dc6/d93/de8/fea [1483286,59914] 0 2024-05-09T00:07:38.990 INFO:tasks.workunit.client.0.smithi026.stdout:0/287: symlink d1d/d25/d47/l56 0 2024-05-09T00:07:38.991 INFO:tasks.workunit.client.1.smithi135.stdout:9/692: dwrite d1/d1a/f51 [4194304,4194304] 0 2024-05-09T00:07:38.994 INFO:tasks.workunit.client.0.smithi026.stdout:9/184: rename d7/fd to d7/d23/d2f/d3a/f44 0 2024-05-09T00:07:38.996 INFO:tasks.workunit.client.1.smithi135.stdout:6/814: rename d2/da/d1d/d69/d78/lf8 to d2/d1a/d7a/l112 0 2024-05-09T00:07:38.998 INFO:tasks.workunit.client.0.smithi026.stdout:7/247: creat d8/d12/d1e/d3d/f51 x:0 0 0 2024-05-09T00:07:38.999 INFO:tasks.workunit.client.1.smithi135.stdout:7/891: creat db/d125/f12a x:0 0 0 2024-05-09T00:07:39.001 INFO:tasks.workunit.client.1.smithi135.stdout:3/851: creat d8/d6d/d44/d4b/da0/daa/f12a x:0 0 0 2024-05-09T00:07:39.003 INFO:tasks.workunit.client.1.smithi135.stdout:1/803: mknod da/d14/d5c/d83/c119 0 2024-05-09T00:07:39.004 INFO:tasks.workunit.client.1.smithi135.stdout:0/779: dwrite d3/dd/d3f/d3a/d46/f38 [0,4194304] 0 2024-05-09T00:07:39.004 INFO:tasks.workunit.client.1.smithi135.stdout:0/780: getdents d3/dd/d3f/d3a/da4/de2 0 2024-05-09T00:07:39.005 INFO:tasks.workunit.client.1.smithi135.stdout:5/832: sync 2024-05-09T00:07:39.005 INFO:tasks.workunit.client.1.smithi135.stdout:2/803: sync 2024-05-09T00:07:39.005 INFO:tasks.workunit.client.1.smithi135.stdout:4/685: sync 2024-05-09T00:07:39.006 INFO:tasks.workunit.client.0.smithi026.stdout:4/126: mknod d0/d12/d1b/c2a 0 2024-05-09T00:07:39.006 INFO:tasks.workunit.client.0.smithi026.stdout:4/127: fdatasync d0/d12/d1b/f25 0 2024-05-09T00:07:39.006 INFO:tasks.workunit.client.1.smithi135.stdout:2/804: write d1/d22/f43 [2368410,74262] 0 2024-05-09T00:07:39.007 INFO:tasks.workunit.client.1.smithi135.stdout:5/833: write db/d24/d32/dfa/d9c/d9f/dc0/dc4/fcb [557133,126595] 0 2024-05-09T00:07:39.007 INFO:tasks.workunit.client.1.smithi135.stdout:8/793: dwrite d4/d8/da2/da6/db8/fcb [0,4194304] 0 2024-05-09T00:07:39.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/693: symlink d1/d1a/d89/d99/ldc 0 2024-05-09T00:07:39.010 INFO:tasks.workunit.client.0.smithi026.stdout:3/137: creat d5/d9/dc/d28/f2e x:0 0 0 2024-05-09T00:07:39.010 INFO:tasks.workunit.client.1.smithi135.stdout:6/815: creat d2/d1a/d7a/f113 x:0 0 0 2024-05-09T00:07:39.013 INFO:tasks.workunit.client.0.smithi026.stdout:0/288: creat d1d/d1e/d20/d51/f57 x:0 0 0 2024-05-09T00:07:39.014 INFO:tasks.workunit.client.1.smithi135.stdout:7/892: symlink db/dd/d33/d68/d10a/d3a/d40/d4c/d67/def/l12b 0 2024-05-09T00:07:39.016 INFO:tasks.workunit.client.1.smithi135.stdout:3/852: rmdir d8/d13/d1f/d40 39 2024-05-09T00:07:39.016 INFO:tasks.workunit.client.1.smithi135.stdout:3/853: truncate d8/d102/d63/f105 928133 0 2024-05-09T00:07:39.016 INFO:tasks.workunit.client.1.smithi135.stdout:3/854: stat d8/d6d/d44/d4b/d69/l5e 0 2024-05-09T00:07:39.018 INFO:tasks.workunit.client.1.smithi135.stdout:1/804: unlink da/d14/d20/c102 0 2024-05-09T00:07:39.019 INFO:tasks.workunit.client.1.smithi135.stdout:9/694: dwrite d1/d1a/d10/d3c/d43/fc3 [0,4194304] 0 2024-05-09T00:07:39.019 INFO:tasks.workunit.client.1.smithi135.stdout:9/695: chown d1/d1a/d2c/c93 5137 1 2024-05-09T00:07:39.019 INFO:tasks.workunit.client.1.smithi135.stdout:7/893: write db/dd/d33/d68/d10a/fc5 [2221154,40906] 0 2024-05-09T00:07:39.019 INFO:tasks.workunit.client.1.smithi135.stdout:7/894: stat db/dd/d33/d68/dde 0 2024-05-09T00:07:39.020 INFO:tasks.workunit.client.1.smithi135.stdout:7/895: read db/f42 [3479763,53424] 0 2024-05-09T00:07:39.021 INFO:tasks.workunit.client.0.smithi026.stdout:9/185: creat d7/d23/d2f/f45 x:0 0 0 2024-05-09T00:07:39.022 INFO:tasks.workunit.client.1.smithi135.stdout:0/781: creat d3/dd/d2d/d4c/fe3 x:0 0 0 2024-05-09T00:07:39.023 INFO:tasks.workunit.client.0.smithi026.stdout:7/248: creat d8/d12/f52 x:0 0 0 2024-05-09T00:07:39.025 INFO:tasks.workunit.client.1.smithi135.stdout:4/686: rename dc/d4a/d69/f7b to dc/d71/d90/fea 0 2024-05-09T00:07:39.026 INFO:tasks.workunit.client.0.smithi026.stdout:4/128: mkdir d0/d12/d1b/d2b 0 2024-05-09T00:07:39.026 INFO:tasks.workunit.client.0.smithi026.stdout:4/129: write d0/f22 [4552434,76039] 0 2024-05-09T00:07:39.028 INFO:tasks.workunit.client.1.smithi135.stdout:2/805: symlink d1/d12/d21/d57/l110 0 2024-05-09T00:07:39.028 INFO:tasks.workunit.client.1.smithi135.stdout:2/806: chown d1/d12/d20/d3b/d4f/f64 24 1 2024-05-09T00:07:39.030 INFO:tasks.workunit.client.0.smithi026.stdout:3/138: rename d5/d9/d2b to d5/d9/dc/d28/d2c/d2f 0 2024-05-09T00:07:39.030 INFO:tasks.workunit.client.0.smithi026.stdout:3/139: readlink d5/l15 0 2024-05-09T00:07:39.031 INFO:tasks.workunit.client.1.smithi135.stdout:5/834: truncate db/d24/f2c 49452 0 2024-05-09T00:07:39.031 INFO:tasks.workunit.client.1.smithi135.stdout:5/835: write db/d5d/dac/ddc/fda [309298,48463] 0 2024-05-09T00:07:39.031 INFO:tasks.workunit.client.1.smithi135.stdout:5/836: truncate db/d24/d32/d5b/fea 294379 0 2024-05-09T00:07:39.032 INFO:tasks.workunit.client.1.smithi135.stdout:5/837: dread - db/d84/d62/fef zero size 2024-05-09T00:07:39.032 INFO:tasks.workunit.client.0.smithi026.stdout:9/186: symlink d7/d23/d29/d31/d40/l46 0 2024-05-09T00:07:39.032 INFO:tasks.workunit.client.0.smithi026.stdout:9/187: chown d7 211 1 2024-05-09T00:07:39.032 INFO:tasks.workunit.client.0.smithi026.stdout:5/164: sync 2024-05-09T00:07:39.034 INFO:tasks.workunit.client.0.smithi026.stdout:7/249: creat d8/d12/d22/d29/f53 x:0 0 0 2024-05-09T00:07:39.035 INFO:tasks.workunit.client.0.smithi026.stdout:7/250: dread - d8/d12/d1e/d3d/f48 zero size 2024-05-09T00:07:39.036 INFO:tasks.workunit.client.0.smithi026.stdout:7/251: write d8/f1f [117383,82423] 0 2024-05-09T00:07:39.037 INFO:tasks.workunit.client.1.smithi135.stdout:3/855: mkdir d8/d6d/d24/d106/d12b 0 2024-05-09T00:07:39.037 INFO:tasks.workunit.client.1.smithi135.stdout:3/856: truncate d8/d13/d1f/fda 80898 0 2024-05-09T00:07:39.039 INFO:tasks.workunit.client.1.smithi135.stdout:2/807: dread d1/d12/f8d [0,4194304] 0 2024-05-09T00:07:39.039 INFO:tasks.workunit.client.0.smithi026.stdout:1/167: sync 2024-05-09T00:07:39.039 INFO:tasks.workunit.client.0.smithi026.stdout:6/142: sync 2024-05-09T00:07:39.043 INFO:tasks.workunit.client.1.smithi135.stdout:0/782: dwrite d3/dd/d3f/d43/da3/fd7 [0,4194304] 0 2024-05-09T00:07:39.045 INFO:tasks.workunit.client.1.smithi135.stdout:7/896: dwrite db/dd/d33/d68/d10a/d3a/d40/d4c/f4f [0,4194304] 0 2024-05-09T00:07:39.046 INFO:tasks.workunit.client.1.smithi135.stdout:7/897: truncate db/dd/d33/d68/d10a/d3a/d40/d4c/f4f 4657156 0 2024-05-09T00:07:39.046 INFO:tasks.workunit.client.0.smithi026.stdout:4/130: creat d0/d12/f2c x:0 0 0 2024-05-09T00:07:39.047 INFO:tasks.workunit.client.1.smithi135.stdout:6/816: rmdir d2/d1a/d7a 39 2024-05-09T00:07:39.050 INFO:tasks.workunit.client.1.smithi135.stdout:9/696: rmdir d1/d1a/d89 39 2024-05-09T00:07:39.053 INFO:tasks.workunit.client.0.smithi026.stdout:3/140: symlink d5/d9/l30 0 2024-05-09T00:07:39.053 INFO:tasks.workunit.client.0.smithi026.stdout:4/131: write d0/f9 [3976912,130427] 0 2024-05-09T00:07:39.054 INFO:tasks.workunit.client.0.smithi026.stdout:9/188: fsync d7/d23/d2f/f45 0 2024-05-09T00:07:39.056 INFO:tasks.workunit.client.1.smithi135.stdout:8/794: rename d4/d7/de/d45/caa to d4/c10e 0 2024-05-09T00:07:39.057 INFO:tasks.workunit.client.1.smithi135.stdout:8/795: chown d4/d7/d2a/l32 4259 1 2024-05-09T00:07:39.057 INFO:tasks.workunit.client.1.smithi135.stdout:6/817: dread d2/da/d26/d57/d60/fd3 [0,4194304] 0 2024-05-09T00:07:39.061 INFO:tasks.workunit.client.0.smithi026.stdout:8/179: sync 2024-05-09T00:07:39.061 INFO:tasks.workunit.client.0.smithi026.stdout:2/140: sync 2024-05-09T00:07:39.061 INFO:tasks.workunit.client.1.smithi135.stdout:4/687: creat dc/d26/d31/db8/dd1/feb x:0 0 0 2024-05-09T00:07:39.062 INFO:tasks.workunit.client.0.smithi026.stdout:6/143: readlink l0 0 2024-05-09T00:07:39.067 INFO:tasks.workunit.client.0.smithi026.stdout:1/168: creat d5/dd/f34 x:0 0 0 2024-05-09T00:07:39.069 INFO:tasks.workunit.client.0.smithi026.stdout:7/252: dwrite d8/d12/d22/d29/f1c [0,4194304] 0 2024-05-09T00:07:39.070 INFO:tasks.workunit.client.0.smithi026.stdout:3/141: creat d5/d9/dc/f31 x:0 0 0 2024-05-09T00:07:39.071 INFO:tasks.workunit.client.1.smithi135.stdout:5/838: symlink db/d84/d62/l107 0 2024-05-09T00:07:39.071 INFO:tasks.workunit.client.1.smithi135.stdout:3/857: symlink d8/d13/d1f/d40/d52/dd3/l12c 0 2024-05-09T00:07:39.071 INFO:tasks.workunit.client.1.smithi135.stdout:5/839: chown db/d24/d32/dfa 0 1 2024-05-09T00:07:39.071 INFO:tasks.workunit.client.1.smithi135.stdout:3/858: dread - d8/d6d/d44/d4b/da0/daa/f12a zero size 2024-05-09T00:07:39.071 INFO:tasks.workunit.client.1.smithi135.stdout:2/808: dwrite d1/d12/d20/d2b/f37 [0,4194304] 0 2024-05-09T00:07:39.071 INFO:tasks.workunit.client.1.smithi135.stdout:2/809: chown d1/d12/d20/d2b/d56/d86/fda 0 1 2024-05-09T00:07:39.072 INFO:tasks.workunit.client.0.smithi026.stdout:4/132: creat d0/d12/d1b/d2b/f2d x:0 0 0 2024-05-09T00:07:39.073 INFO:tasks.workunit.client.0.smithi026.stdout:9/189: creat d7/d23/d29/d2e/f47 x:0 0 0 2024-05-09T00:07:39.073 INFO:tasks.workunit.client.0.smithi026.stdout:9/190: truncate d7/d23/f39 472153 0 2024-05-09T00:07:39.074 INFO:tasks.workunit.client.1.smithi135.stdout:0/783: rmdir d3/dd/d3f/d3a/da4/dd9 0 2024-05-09T00:07:39.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/165: mkdir d2/d8/d31/d32 0 2024-05-09T00:07:39.076 INFO:tasks.workunit.client.0.smithi026.stdout:8/180: mknod de/d17/d21/d24/d28/c38 0 2024-05-09T00:07:39.077 INFO:tasks.workunit.client.1.smithi135.stdout:9/697: truncate d1/f59 898745 0 2024-05-09T00:07:39.077 INFO:tasks.workunit.client.1.smithi135.stdout:9/698: fsync d1/d1a/d2c/d2d/f73 0 2024-05-09T00:07:39.077 INFO:tasks.workunit.client.0.smithi026.stdout:6/144: getdents d15/d1e 0 2024-05-09T00:07:39.078 INFO:tasks.workunit.client.0.smithi026.stdout:6/145: truncate d15/d1e/d23/f25 273080 0 2024-05-09T00:07:39.079 INFO:tasks.workunit.client.1.smithi135.stdout:1/805: rename da/d24/d27/d33/d48/c9f to da/d14/d20/d38/d3a/db7/dc6/c11a 0 2024-05-09T00:07:39.079 INFO:tasks.workunit.client.0.smithi026.stdout:7/253: creat d8/d2e/f54 x:0 0 0 2024-05-09T00:07:39.080 INFO:tasks.workunit.client.1.smithi135.stdout:8/796: rmdir d4/d8/da2/dab 39 2024-05-09T00:07:39.080 INFO:tasks.workunit.client.1.smithi135.stdout:7/898: dwrite db/dd/d33/d68/d10a/d3a/d40/d4c/d67/fea [0,4194304] 0 2024-05-09T00:07:39.080 INFO:tasks.workunit.client.1.smithi135.stdout:7/899: stat db/dd/l2e 0 2024-05-09T00:07:39.081 INFO:tasks.workunit.client.0.smithi026.stdout:3/142: symlink d5/d9/dc/d28/d2c/d2f/l32 0 2024-05-09T00:07:39.082 INFO:tasks.workunit.client.1.smithi135.stdout:6/818: creat d2/d20/d3f/d4f/d7f/f114 x:0 0 0 2024-05-09T00:07:39.083 INFO:tasks.workunit.client.1.smithi135.stdout:5/840: read - db/d24/fb5 zero size 2024-05-09T00:07:39.085 INFO:tasks.workunit.client.0.smithi026.stdout:9/191: rename d7/d23/d29/d31/f3c to d7/d23/d29/d31/d40/f48 0 2024-05-09T00:07:39.085 INFO:tasks.workunit.client.0.smithi026.stdout:9/192: readlink d7/la 0 2024-05-09T00:07:39.085 INFO:tasks.workunit.client.1.smithi135.stdout:4/688: dwrite dc/d4a/d69/f67 [0,4194304] 0 2024-05-09T00:07:39.085 INFO:tasks.workunit.client.1.smithi135.stdout:3/859: mknod d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/c12d 0 2024-05-09T00:07:39.087 INFO:tasks.workunit.client.1.smithi135.stdout:2/810: creat d1/d22/f111 x:0 0 0 2024-05-09T00:07:39.089 INFO:tasks.workunit.client.0.smithi026.stdout:8/181: rename de/d17/l2d to de/d17/l39 0 2024-05-09T00:07:39.091 INFO:tasks.workunit.client.1.smithi135.stdout:9/699: mknod d1/d24/d44/d7f/cdd 0 2024-05-09T00:07:39.091 INFO:tasks.workunit.client.1.smithi135.stdout:9/700: chown d1/d1a/d10/db3/lcb 6565 1 2024-05-09T00:07:39.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/146: mknod d15/d1e/d23/d26/c2e 0 2024-05-09T00:07:39.093 INFO:tasks.workunit.client.0.smithi026.stdout:2/141: dwrite d14/f37 [0,4194304] 0 2024-05-09T00:07:39.100 INFO:tasks.workunit.client.0.smithi026.stdout:8/182: dread de/d17/f1a [0,4194304] 0 2024-05-09T00:07:39.100 INFO:tasks.workunit.client.0.smithi026.stdout:8/183: chown de/f20 0 1 2024-05-09T00:07:39.102 INFO:tasks.workunit.client.1.smithi135.stdout:1/806: mknod da/d24/d27/d33/d52/d71/d8d/d104/c11b 0 2024-05-09T00:07:39.103 INFO:tasks.workunit.client.1.smithi135.stdout:8/797: creat d4/d7/d2a/d67/f10f x:0 0 0 2024-05-09T00:07:39.104 INFO:tasks.workunit.client.0.smithi026.stdout:3/143: creat d5/d9/f33 x:0 0 0 2024-05-09T00:07:39.105 INFO:tasks.workunit.client.1.smithi135.stdout:2/811: dread d1/d12/d21/d57/f6c [0,4194304] 0 2024-05-09T00:07:39.105 INFO:tasks.workunit.client.1.smithi135.stdout:2/812: stat d1/d22/ff5 0 2024-05-09T00:07:39.106 INFO:tasks.workunit.client.1.smithi135.stdout:7/900: truncate db/d5b/f71 2905900 0 2024-05-09T00:07:39.107 INFO:tasks.workunit.client.1.smithi135.stdout:8/798: dread d4/f58 [0,4194304] 0 2024-05-09T00:07:39.108 INFO:tasks.workunit.client.1.smithi135.stdout:6/819: mknod d2/d1a/d7a/c115 0 2024-05-09T00:07:39.112 INFO:tasks.workunit.client.0.smithi026.stdout:7/254: rename d8/d12 to d8/d2e/d55 0 2024-05-09T00:07:39.112 INFO:tasks.workunit.client.0.smithi026.stdout:7/255: stat d8/d2e/d55/d22/l4f 0 2024-05-09T00:07:39.112 INFO:tasks.workunit.client.0.smithi026.stdout:6/147: dwrite d15/f1d [0,4194304] 0 2024-05-09T00:07:39.112 INFO:tasks.workunit.client.0.smithi026.stdout:6/148: chown d15/d1e/d23/f24 2352518 1 2024-05-09T00:07:39.113 INFO:tasks.workunit.client.1.smithi135.stdout:5/841: rmdir db/d5d/dac/ddc/dbf/de3 39 2024-05-09T00:07:39.114 INFO:tasks.workunit.client.0.smithi026.stdout:7/256: read d8/d2e/d55/d1e/f43 [3433210,105106] 0 2024-05-09T00:07:39.115 INFO:tasks.workunit.client.0.smithi026.stdout:9/193: symlink d7/d23/d29/d31/l49 0 2024-05-09T00:07:39.115 INFO:tasks.workunit.client.0.smithi026.stdout:9/194: chown d7/f16 9173846 1 2024-05-09T00:07:39.116 INFO:tasks.workunit.client.1.smithi135.stdout:4/689: truncate dc/d4a/d69/f70 526857 0 2024-05-09T00:07:39.118 INFO:tasks.workunit.client.0.smithi026.stdout:5/166: truncate d2/d8/d31/f18 1133352 0 2024-05-09T00:07:39.119 INFO:tasks.workunit.client.0.smithi026.stdout:5/167: readlink d2/d8/d2a/l2b 0 2024-05-09T00:07:39.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.125+0000 7f4066c5e700 1 -- 172.21.15.26:0/3487810479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 msgr2=0x7f40600f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:39.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.125+0000 7f4066c5e700 1 --2- 172.21.15.26:0/3487810479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 0x7f40600f7c30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f40540047f0 tx=0x7f4054009cb0).stop 2024-05-09T00:07:39.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.125+0000 7f4066c5e700 1 -- 172.21.15.26:0/3487810479 shutdown_connections 2024-05-09T00:07:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.125+0000 7f4066c5e700 1 --2- 172.21.15.26:0/3487810479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40600f8ab0 0x7f40600f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.125+0000 7f4066c5e700 1 --2- 172.21.15.26:0/3487810479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 0x7f40600f7c30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.125+0000 7f4066c5e700 1 -- 172.21.15.26:0/3487810479 >> 172.21.15.26:0/3487810479 conn(0x7f40600f2f50 msgr2=0x7f40600f5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.125+0000 7f4066c5e700 1 -- 172.21.15.26:0/3487810479 shutdown_connections 2024-05-09T00:07:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.125+0000 7f4066c5e700 1 -- 172.21.15.26:0/3487810479 wait complete. 2024-05-09T00:07:39.122 INFO:tasks.workunit.client.1.smithi135.stdout:0/784: symlink d3/dd/d3f/d3a/le4 0 2024-05-09T00:07:39.122 INFO:tasks.workunit.client.1.smithi135.stdout:9/701: creat d1/fde x:0 0 0 2024-05-09T00:07:39.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.126+0000 7f4066c5e700 1 Processor -- start 2024-05-09T00:07:39.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.126+0000 7f4066c5e700 1 -- start start 2024-05-09T00:07:39.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.126+0000 7f4066c5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 0x7f40601080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:39.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.126+0000 7f4066c5e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40600f8ab0 0x7f4060108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.126+0000 7f4066c5e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060108b40 con 0x7f40600f7810 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.126+0000 7f4066c5e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060108c80 con 0x7f40600f8ab0 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40600f8ab0 0x7f4060108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40600f8ab0 0x7f4060108590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:57214/0 (socket says 172.21.15.26:57214) 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405ffff700 1 -- 172.21.15.26:0/3640340407 learned_addr learned my addr 172.21.15.26:0/3640340407 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f40649fa700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 0x7f40601080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405ffff700 1 -- 172.21.15.26:0/3640340407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 msgr2=0x7f40601080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405ffff700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 0x7f40601080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405ffff700 1 -- 172.21.15.26:0/3640340407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054005040 con 0x7f40600f8ab0 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f40649fa700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 0x7f40601080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405ffff700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40600f8ab0 0x7f4060108590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f404c00e8f0 tx=0x7f404c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405dffb700 1 -- 172.21.15.26:0/3640340407 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f404c00ee90 con 0x7f40600f8ab0 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406010d720 con 0x7f40600f8ab0 2024-05-09T00:07:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405dffb700 1 -- 172.21.15.26:0/3640340407 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f404c00f040 con 0x7f40600f8ab0 2024-05-09T00:07:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.127+0000 7f405dffb700 1 -- 172.21.15.26:0/3640340407 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f404c00c930 con 0x7f40600f8ab0 2024-05-09T00:07:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.128+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406010dce0 con 0x7f40600f8ab0 2024-05-09T00:07:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.128+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40600fffd0 con 0x7f40600f8ab0 2024-05-09T00:07:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.129+0000 7f405dffb700 1 -- 172.21.15.26:0/3640340407 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f404c009090 con 0x7f40600f8ab0 2024-05-09T00:07:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.130+0000 7f405dffb700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4050066dc0 0x7f4050069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:39.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.130+0000 7f405dffb700 1 -- 172.21.15.26:0/3640340407 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f404c083e60 con 0x7f40600f8ab0 2024-05-09T00:07:39.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.130+0000 7f40649fa700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4050066dc0 0x7f4050069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:39.126 INFO:tasks.workunit.client.0.smithi026.stdout:2/142: unlink d14/f1d 0 2024-05-09T00:07:39.126 INFO:tasks.workunit.client.0.smithi026.stdout:2/143: write d14/d15/d20/f36 [777224,130698] 0 2024-05-09T00:07:39.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.130+0000 7f40649fa700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4050066dc0 0x7f4050069280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4054004e60 tx=0x7f405400b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:39.127 INFO:tasks.workunit.client.1.smithi135.stdout:1/807: dwrite da/d14/d20/d38/d3a/db7/dc6/d93/de8/fea [0,4194304] 0 2024-05-09T00:07:39.127 INFO:tasks.workunit.client.0.smithi026.stdout:8/184: getdents de/d17/d21 0 2024-05-09T00:07:39.127 INFO:tasks.workunit.client.0.smithi026.stdout:8/185: readlink de/d17/l1b 0 2024-05-09T00:07:39.129 INFO:tasks.workunit.client.0.smithi026.stdout:3/144: symlink d5/d9/dc/d28/d2c/d2f/l34 0 2024-05-09T00:07:39.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.135+0000 7f405dffb700 1 -- 172.21.15.26:0/3640340407 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f404c051ff0 con 0x7f40600f8ab0 2024-05-09T00:07:39.131 INFO:tasks.workunit.client.0.smithi026.stdout:4/133: link d0/cd d0/d19/c2e 0 2024-05-09T00:07:39.131 INFO:tasks.workunit.client.0.smithi026.stdout:4/134: readlink d0/lf 0 2024-05-09T00:07:39.134 INFO:tasks.workunit.client.0.smithi026.stdout:6/149: mknod d15/d1e/d23/c2f 0 2024-05-09T00:07:39.134 INFO:tasks.workunit.client.0.smithi026.stdout:6/150: dread - d15/d1e/d23/d26/f28 zero size 2024-05-09T00:07:39.137 INFO:tasks.workunit.client.0.smithi026.stdout:7/257: creat d8/f56 x:0 0 0 2024-05-09T00:07:39.137 INFO:tasks.workunit.client.0.smithi026.stdout:7/258: chown d8/d2e/d55/d22/l33 1984940162 1 2024-05-09T00:07:39.139 INFO:tasks.workunit.client.0.smithi026.stdout:9/195: creat d7/f4a x:0 0 0 2024-05-09T00:07:39.148 INFO:tasks.workunit.client.0.smithi026.stdout:8/186: symlink de/d17/d21/l3a 0 2024-05-09T00:07:39.148 INFO:tasks.workunit.client.0.smithi026.stdout:8/187: fsync de/f13 0 2024-05-09T00:07:39.148 INFO:tasks.workunit.client.0.smithi026.stdout:8/188: chown l8 46036 1 2024-05-09T00:07:39.149 INFO:tasks.workunit.client.0.smithi026.stdout:8/189: read de/d17/d21/f22 [60280,97429] 0 2024-05-09T00:07:39.150 INFO:tasks.workunit.client.0.smithi026.stdout:3/145: chown d5/fd 653661 1 2024-05-09T00:07:39.152 INFO:tasks.workunit.client.0.smithi026.stdout:4/135: creat d0/d19/f2f x:0 0 0 2024-05-09T00:07:39.154 INFO:tasks.workunit.client.0.smithi026.stdout:7/259: creat d8/f57 x:0 0 0 2024-05-09T00:07:39.155 INFO:tasks.workunit.client.1.smithi135.stdout:2/813: truncate d1/d12/d20/feb 4079575 0 2024-05-09T00:07:39.156 INFO:tasks.workunit.client.0.smithi026.stdout:9/196: mknod d7/d23/c4b 0 2024-05-09T00:07:39.157 INFO:tasks.workunit.client.1.smithi135.stdout:2/814: write d1/d12/d21/d41/d6d/f92 [7081397,1641] 0 2024-05-09T00:07:39.157 INFO:tasks.workunit.client.1.smithi135.stdout:7/901: truncate db/dd/d33/da5/d11b/f11f 63787 0 2024-05-09T00:07:39.158 INFO:tasks.workunit.client.0.smithi026.stdout:5/168: mkdir d2/d8/d31/d2e/d33 0 2024-05-09T00:07:39.159 INFO:tasks.workunit.client.0.smithi026.stdout:5/169: chown d2 248 1 2024-05-09T00:07:39.160 INFO:tasks.workunit.client.1.smithi135.stdout:8/799: mkdir d4/d8/da2/d110 0 2024-05-09T00:07:39.162 INFO:tasks.workunit.client.0.smithi026.stdout:3/146: link f2 d5/d9/dc/d28/f35 0 2024-05-09T00:07:39.164 INFO:tasks.workunit.client.1.smithi135.stdout:6/820: mkdir d2/da/d26/d57/ddc/d116 0 2024-05-09T00:07:39.166 INFO:tasks.workunit.client.0.smithi026.stdout:4/136: unlink d0/f21 0 2024-05-09T00:07:39.166 INFO:tasks.workunit.client.0.smithi026.stdout:4/137: truncate d0/d12/f13 585846 0 2024-05-09T00:07:39.166 INFO:tasks.workunit.client.0.smithi026.stdout:4/138: truncate d0/d12/f1d 1041716 0 2024-05-09T00:07:39.166 INFO:tasks.workunit.client.0.smithi026.stdout:4/139: chown d0/c18 3396000 1 2024-05-09T00:07:39.168 INFO:tasks.workunit.client.0.smithi026.stdout:7/260: symlink d8/d2e/l58 0 2024-05-09T00:07:39.169 INFO:tasks.workunit.client.0.smithi026.stdout:8/190: dwrite de/f13 [0,4194304] 0 2024-05-09T00:07:39.171 INFO:tasks.workunit.client.1.smithi135.stdout:4/690: mkdir dc/d4a/d69/d55/d6d/dec 0 2024-05-09T00:07:39.172 INFO:tasks.workunit.client.0.smithi026.stdout:9/197: symlink d7/d23/d2f/l4c 0 2024-05-09T00:07:39.178 INFO:tasks.workunit.client.1.smithi135.stdout:0/785: rmdir d3/dd/d2d/db5 39 2024-05-09T00:07:39.178 INFO:tasks.workunit.client.0.smithi026.stdout:5/170: stat d2/d8/d31/c19 0 2024-05-09T00:07:39.178 INFO:tasks.workunit.client.0.smithi026.stdout:5/171: fdatasync d2/d8/d31/f18 0 2024-05-09T00:07:39.180 INFO:tasks.workunit.client.1.smithi135.stdout:9/702: symlink d1/d24/d44/d7f/da2/ldf 0 2024-05-09T00:07:39.181 INFO:tasks.workunit.client.0.smithi026.stdout:3/147: creat d5/d1e/f36 x:0 0 0 2024-05-09T00:07:39.183 INFO:tasks.workunit.client.1.smithi135.stdout:1/808: creat da/d24/d27/d33/d7d/f11c x:0 0 0 2024-05-09T00:07:39.183 INFO:tasks.workunit.client.0.smithi026.stdout:8/191: mkdir de/d17/d21/d24/d3b 0 2024-05-09T00:07:39.185 INFO:tasks.workunit.client.1.smithi135.stdout:2/815: truncate d1/d12/d20/f54 2804554 0 2024-05-09T00:07:39.185 INFO:tasks.workunit.client.1.smithi135.stdout:2/816: chown d1/d12/f48 394410469 1 2024-05-09T00:07:39.186 INFO:tasks.workunit.client.0.smithi026.stdout:5/172: mknod d2/d8/d31/d2e/d33/c34 0 2024-05-09T00:07:39.186 INFO:tasks.workunit.client.0.smithi026.stdout:8/192: dread f7 [0,4194304] 0 2024-05-09T00:07:39.188 INFO:tasks.workunit.client.1.smithi135.stdout:7/902: rename db/dd/d33/d68/d10a/d3a/d40/ff4 to db/dd/d33/d68/d10a/d3a/dfc/f12c 0 2024-05-09T00:07:39.189 INFO:tasks.workunit.client.1.smithi135.stdout:7/903: read db/dd/d33/d68/d10a/d3a/d40/d4c/f53 [2694540,51267] 0 2024-05-09T00:07:39.190 INFO:tasks.workunit.client.1.smithi135.stdout:7/904: readlink db/d13/l11c 0 2024-05-09T00:07:39.190 INFO:tasks.workunit.client.1.smithi135.stdout:8/800: mknod d4/d7/d2a/d56/dec/c111 0 2024-05-09T00:07:39.193 INFO:tasks.workunit.client.0.smithi026.stdout:8/193: creat de/d17/d21/d24/d28/f3c x:0 0 0 2024-05-09T00:07:39.199 INFO:tasks.workunit.client.1.smithi135.stdout:4/691: unlink dc/d4a/d69/d55/d5f/f20 0 2024-05-09T00:07:39.199 INFO:tasks.workunit.client.1.smithi135.stdout:4/692: chown dc/d4a/d69/d55/dc9 13826527 1 2024-05-09T00:07:39.199 INFO:tasks.workunit.client.1.smithi135.stdout:4/693: fsync dc/d26/d4e/f54 0 2024-05-09T00:07:39.200 INFO:tasks.workunit.client.0.smithi026.stdout:8/194: dread de/f15 [0,4194304] 0 2024-05-09T00:07:39.200 INFO:tasks.workunit.client.1.smithi135.stdout:2/817: dread d1/d12/d21/d41/d6d/d6e/f9a [0,4194304] 0 2024-05-09T00:07:39.200 INFO:tasks.workunit.client.1.smithi135.stdout:0/786: symlink d3/d9e/le5 0 2024-05-09T00:07:39.200 INFO:tasks.workunit.client.1.smithi135.stdout:7/905: dread db/dd/d33/f9d [0,4194304] 0 2024-05-09T00:07:39.200 INFO:tasks.workunit.client.1.smithi135.stdout:7/906: dread - db/d21/fc4 zero size 2024-05-09T00:07:39.201 INFO:tasks.workunit.client.1.smithi135.stdout:6/821: dwrite d2/d20/d37/d4e/d9d/fb8 [0,4194304] 0 2024-05-09T00:07:39.201 INFO:tasks.workunit.client.1.smithi135.stdout:6/822: stat d2/da/cff 0 2024-05-09T00:07:39.201 INFO:tasks.workunit.client.1.smithi135.stdout:9/703: mknod d1/d24/d44/d54/d66/d6e/ce0 0 2024-05-09T00:07:39.201 INFO:tasks.workunit.client.1.smithi135.stdout:9/704: readlink d1/d1a/d2c/l3a 0 2024-05-09T00:07:39.203 INFO:tasks.workunit.client.0.smithi026.stdout:4/140: dwrite d0/f22 [0,4194304] 0 2024-05-09T00:07:39.204 INFO:tasks.workunit.client.0.smithi026.stdout:7/261: dwrite d8/ff [4194304,4194304] 0 2024-05-09T00:07:39.204 INFO:tasks.workunit.client.0.smithi026.stdout:7/262: chown d8/l11 4 1 2024-05-09T00:07:39.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/809: unlink da/d24/d27/d33/d7d/lcc 0 2024-05-09T00:07:39.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/810: chown da/d14/d20/fc7 3791 1 2024-05-09T00:07:39.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/811: getdents da/d14/d20/d38/d3a/d113 0 2024-05-09T00:07:39.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/812: readlink da/d24/d27/d33/d36/l8c 0 2024-05-09T00:07:39.207 INFO:tasks.workunit.client.1.smithi135.stdout:4/694: dread dc/d26/f4f [0,4194304] 0 2024-05-09T00:07:39.207 INFO:tasks.workunit.client.0.smithi026.stdout:8/195: mkdir de/d17/d21/d24/d3b/d3d 0 2024-05-09T00:07:39.208 INFO:tasks.workunit.client.0.smithi026.stdout:5/173: dwrite d2/d8/d2a/f2c [0,4194304] 0 2024-05-09T00:07:39.209 INFO:tasks.workunit.client.1.smithi135.stdout:4/695: write fa [831648,50239] 0 2024-05-09T00:07:39.210 INFO:tasks.workunit.client.0.smithi026.stdout:4/141: creat d0/d12/f30 x:0 0 0 2024-05-09T00:07:39.210 INFO:tasks.workunit.client.0.smithi026.stdout:4/142: chown d0/c28 0 1 2024-05-09T00:07:39.211 INFO:tasks.workunit.client.0.smithi026.stdout:8/196: write de/f16 [1635103,119668] 0 2024-05-09T00:07:39.214 INFO:tasks.workunit.client.1.smithi135.stdout:8/801: creat d4/d7/d2a/d9f/f112 x:0 0 0 2024-05-09T00:07:39.215 INFO:tasks.workunit.client.0.smithi026.stdout:7/263: symlink d8/d2e/d55/d1e/l59 0 2024-05-09T00:07:39.216 INFO:tasks.workunit.client.0.smithi026.stdout:7/264: chown d8/le 2229893 1 2024-05-09T00:07:39.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/705: dwrite d1/d1a/d10/d3c/d5c/fab [4194304,4194304] 0 2024-05-09T00:07:39.220 INFO:tasks.workunit.client.1.smithi135.stdout:9/706: fdatasync d1/d1a/d10/d3c/d43/fb6 0 2024-05-09T00:07:39.248 INFO:tasks.workunit.client.1.smithi135.stdout:2/818: mknod d1/d12/d20/d3b/d105/d109/c112 0 2024-05-09T00:07:39.248 INFO:tasks.workunit.client.1.smithi135.stdout:2/819: truncate d1/d12/d20/d2b/f71 6774220 0 2024-05-09T00:07:39.250 INFO:tasks.workunit.client.1.smithi135.stdout:0/787: mkdir d3/dd/d3f/d3a/da4/dc1/de6 0 2024-05-09T00:07:39.252 INFO:tasks.workunit.client.1.smithi135.stdout:7/907: mkdir db/d12d 0 2024-05-09T00:07:39.256 INFO:tasks.workunit.client.0.smithi026.stdout:8/197: mkdir de/d17/d21/d24/d28/d31/d33/d3e 0 2024-05-09T00:07:39.258 INFO:tasks.workunit.client.1.smithi135.stdout:6/823: getdents d2/da 0 2024-05-09T00:07:39.259 INFO:tasks.workunit.client.0.smithi026.stdout:7/265: symlink d8/d2e/d55/d22/l5a 0 2024-05-09T00:07:39.259 INFO:tasks.workunit.client.0.smithi026.stdout:7/266: readlink d8/d2e/d55/d22/d29/l17 0 2024-05-09T00:07:39.261 INFO:tasks.workunit.client.0.smithi026.stdout:4/143: mknod d0/c31 0 2024-05-09T00:07:39.262 INFO:tasks.workunit.client.1.smithi135.stdout:4/696: getdents dc 0 2024-05-09T00:07:39.262 INFO:tasks.workunit.client.1.smithi135.stdout:4/697: fdatasync dc/d4a/d69/f67 0 2024-05-09T00:07:39.262 INFO:tasks.workunit.client.1.smithi135.stdout:4/698: fsync dc/dd/f80 0 2024-05-09T00:07:39.262 INFO:tasks.workunit.client.1.smithi135.stdout:4/699: fdatasync dc/d26/d31/f99 0 2024-05-09T00:07:39.263 INFO:tasks.workunit.client.0.smithi026.stdout:8/198: mknod de/d17/d21/d24/d28/c3f 0 2024-05-09T00:07:39.264 INFO:tasks.workunit.client.1.smithi135.stdout:0/788: dwrite d3/dd/fc0 [0,4194304] 0 2024-05-09T00:07:39.264 INFO:tasks.workunit.client.1.smithi135.stdout:0/789: chown d3/dd/d3f/d3a/f4a 80341048 1 2024-05-09T00:07:39.265 INFO:tasks.workunit.client.1.smithi135.stdout:8/802: mkdir d4/d7/d2a/d56/dec/dfe/d113 0 2024-05-09T00:07:39.265 INFO:tasks.workunit.client.1.smithi135.stdout:8/803: read - d4/d7/de/d45/d76/de2/fe4 zero size 2024-05-09T00:07:39.267 INFO:tasks.workunit.client.0.smithi026.stdout:7/267: creat d8/d1b/f5b x:0 0 0 2024-05-09T00:07:39.267 INFO:tasks.workunit.client.0.smithi026.stdout:7/268: readlink d8/l26 0 2024-05-09T00:07:39.270 INFO:tasks.workunit.client.0.smithi026.stdout:4/144: mknod d0/d12/c32 0 2024-05-09T00:07:39.270 INFO:tasks.workunit.client.0.smithi026.stdout:4/145: chown d0/d12/d1b/c2a 12 1 2024-05-09T00:07:39.271 INFO:tasks.workunit.client.1.smithi135.stdout:9/707: creat d1/fe1 x:0 0 0 2024-05-09T00:07:39.273 INFO:tasks.workunit.client.0.smithi026.stdout:8/199: creat de/d17/d21/d24/d3b/d3d/f40 x:0 0 0 2024-05-09T00:07:39.273 INFO:tasks.workunit.client.0.smithi026.stdout:8/200: truncate de/d17/d21/d24/d28/f3c 184222 0 2024-05-09T00:07:39.273 INFO:tasks.workunit.client.0.smithi026.stdout:8/201: fsync de/d17/d21/d24/d28/f3c 0 2024-05-09T00:07:39.275 INFO:tasks.workunit.client.1.smithi135.stdout:2/820: symlink d1/d12/d20/d2b/d7c/db5/dfd/l113 0 2024-05-09T00:07:39.275 INFO:tasks.workunit.client.1.smithi135.stdout:3/860: sync 2024-05-09T00:07:39.275 INFO:tasks.workunit.client.1.smithi135.stdout:3/861: write d8/d6d/d44/d4b/da0/f104 [370467,67671] 0 2024-05-09T00:07:39.275 INFO:tasks.workunit.client.1.smithi135.stdout:3/862: chown d8/d6d/la5 130850 1 2024-05-09T00:07:39.276 INFO:tasks.workunit.client.0.smithi026.stdout:7/269: mkdir d8/d5c 0 2024-05-09T00:07:39.276 INFO:tasks.workunit.client.0.smithi026.stdout:7/270: stat d8/d2e/d55/d1e/d3d/f51 0 2024-05-09T00:07:39.278 INFO:tasks.workunit.client.1.smithi135.stdout:7/908: mknod db/dd/d33/dd3/c12e 0 2024-05-09T00:07:39.283 INFO:tasks.workunit.client.0.smithi026.stdout:7/271: dread d8/d2e/d55/d22/f31 [0,4194304] 0 2024-05-09T00:07:39.286 INFO:tasks.workunit.client.1.smithi135.stdout:1/813: symlink da/d24/d27/d33/d52/l11d 0 2024-05-09T00:07:39.287 INFO:tasks.workunit.client.1.smithi135.stdout:9/708: dwrite d1/d1a/d2c/d2d/f32 [0,4194304] 0 2024-05-09T00:07:39.287 INFO:tasks.workunit.client.1.smithi135.stdout:9/709: stat d1/d1a/d10/c77 0 2024-05-09T00:07:39.288 INFO:tasks.workunit.client.1.smithi135.stdout:9/710: write d1/d1a/d10/d3c/d5c/f63 [159709,100604] 0 2024-05-09T00:07:39.288 INFO:tasks.workunit.client.1.smithi135.stdout:9/711: write d1/d1a/d2c/f5d [5301597,55243] 0 2024-05-09T00:07:39.288 INFO:tasks.workunit.client.1.smithi135.stdout:0/790: creat d3/dd/d2d/d4c/fe7 x:0 0 0 2024-05-09T00:07:39.292 INFO:tasks.workunit.client.1.smithi135.stdout:8/804: rename d4/d7/de/d45/d76/de2/fd0 to d4/d7/de/d45/d76/de2/f114 0 2024-05-09T00:07:39.296 INFO:tasks.workunit.client.1.smithi135.stdout:3/863: creat d8/d6d/d44/f12e x:0 0 0 2024-05-09T00:07:39.297 INFO:tasks.workunit.client.0.smithi026.stdout:4/146: symlink d0/d12/l33 0 2024-05-09T00:07:39.297 INFO:tasks.workunit.client.0.smithi026.stdout:4/147: fsync d0/d12/d1b/f25 0 2024-05-09T00:07:39.297 INFO:tasks.workunit.client.0.smithi026.stdout:4/148: chown d0/c31 7 1 2024-05-09T00:07:39.298 INFO:tasks.workunit.client.0.smithi026.stdout:4/149: write d0/d12/d1b/f25 [419858,64459] 0 2024-05-09T00:07:39.301 INFO:tasks.workunit.client.1.smithi135.stdout:6/824: rename d2/d20/d3f/d4f/l80 to d2/da/d26/d57/d60/l117 0 2024-05-09T00:07:39.301 INFO:tasks.workunit.client.1.smithi135.stdout:6/825: write d2/d20/fe6 [874397,87784] 0 2024-05-09T00:07:39.304 INFO:tasks.workunit.client.0.smithi026.stdout:8/202: symlink de/d17/d21/d24/d3b/d3d/l41 0 2024-05-09T00:07:39.304 INFO:tasks.workunit.client.1.smithi135.stdout:5/842: sync 2024-05-09T00:07:39.307 INFO:tasks.workunit.client.1.smithi135.stdout:6/826: dread d2/d5f/fba [0,4194304] 0 2024-05-09T00:07:39.309 INFO:tasks.workunit.client.1.smithi135.stdout:9/712: mknod d1/d24/d44/ce2 0 2024-05-09T00:07:39.309 INFO:tasks.workunit.client.0.smithi026.stdout:7/272: rmdir d8/d2e/d55/d1e 39 2024-05-09T00:07:39.311 INFO:tasks.workunit.client.1.smithi135.stdout:0/791: mknod d3/dd/d2d/db5/ce8 0 2024-05-09T00:07:39.312 INFO:tasks.workunit.client.0.smithi026.stdout:4/150: mkdir d0/d12/d34 0 2024-05-09T00:07:39.313 INFO:tasks.workunit.client.0.smithi026.stdout:4/151: write d0/fc [5827614,16337] 0 2024-05-09T00:07:39.313 INFO:tasks.workunit.client.0.smithi026.stdout:4/152: write d0/d12/d1b/d2b/f2d [745998,66921] 0 2024-05-09T00:07:39.318 INFO:tasks.workunit.client.0.smithi026.stdout:8/203: rename de/d17/d21/c2f to de/d17/c42 0 2024-05-09T00:07:39.319 INFO:tasks.workunit.client.1.smithi135.stdout:3/864: rmdir d8/d6d/d44/d4b/da0/daa 39 2024-05-09T00:07:39.321 INFO:tasks.workunit.client.1.smithi135.stdout:6/827: dread d2/d20/d2e/f8d [4194304,4194304] 0 2024-05-09T00:07:39.322 INFO:tasks.workunit.client.1.smithi135.stdout:6/828: getdents d2/da/d1d 0 2024-05-09T00:07:39.322 INFO:tasks.workunit.client.1.smithi135.stdout:6/829: stat d2/da/d49/c56 0 2024-05-09T00:07:39.322 INFO:tasks.workunit.client.1.smithi135.stdout:4/700: rename dc/d26/d93/d9d/fb7 to dc/d4a/d8c/da5/fed 0 2024-05-09T00:07:39.322 INFO:tasks.workunit.client.1.smithi135.stdout:6/830: read d2/d5f/f6d [892922,25413] 0 2024-05-09T00:07:39.323 INFO:tasks.workunit.client.0.smithi026.stdout:4/153: unlink d0/d12/d1b/f25 0 2024-05-09T00:07:39.325 INFO:tasks.workunit.client.1.smithi135.stdout:9/713: mkdir d1/d1a/d89/dad/de3 0 2024-05-09T00:07:39.328 INFO:tasks.workunit.client.1.smithi135.stdout:6/831: write d2/da/d26/d57/f6c [2850236,85948] 0 2024-05-09T00:07:39.329 INFO:tasks.workunit.client.1.smithi135.stdout:2/821: dwrite d1/d12/d20/d3b/d4f/f64 [0,4194304] 0 2024-05-09T00:07:39.330 INFO:tasks.workunit.client.0.smithi026.stdout:7/273: rename d8/f57 to d8/d2e/f5d 0 2024-05-09T00:07:39.330 INFO:tasks.workunit.client.1.smithi135.stdout:4/701: unlink dc/d4a/d69/d55/d5f/f21 0 2024-05-09T00:07:39.330 INFO:tasks.workunit.client.1.smithi135.stdout:4/702: write dc/d4a/d69/d55/d6d/f94 [5006367,58153] 0 2024-05-09T00:07:39.331 INFO:tasks.workunit.client.1.smithi135.stdout:9/714: mknod d1/d1a/d10/d3c/ce4 0 2024-05-09T00:07:39.332 INFO:tasks.workunit.client.0.smithi026.stdout:4/154: link d0/d12/f2c d0/d12/d1b/d2b/f35 0 2024-05-09T00:07:39.332 INFO:tasks.workunit.client.0.smithi026.stdout:4/155: dread - d0/d12/f30 zero size 2024-05-09T00:07:39.335 INFO:tasks.workunit.client.0.smithi026.stdout:8/204: rename de/f15 to de/d17/f43 0 2024-05-09T00:07:39.336 INFO:tasks.workunit.client.0.smithi026.stdout:8/205: truncate de/d17/d21/d24/d3b/d3d/f40 888082 0 2024-05-09T00:07:39.336 INFO:tasks.workunit.client.0.smithi026.stdout:8/206: chown fa 1598997 1 2024-05-09T00:07:39.336 INFO:tasks.workunit.client.0.smithi026.stdout:8/207: chown de/d17/l32 7 1 2024-05-09T00:07:39.337 INFO:tasks.workunit.client.1.smithi135.stdout:2/822: symlink d1/d12/d20/d2b/d56/l114 0 2024-05-09T00:07:39.341 INFO:tasks.workunit.client.0.smithi026.stdout:8/208: write de/f23 [791849,21021] 0 2024-05-09T00:07:39.341 INFO:tasks.workunit.client.0.smithi026.stdout:7/274: mknod d8/d2e/c5e 0 2024-05-09T00:07:39.342 INFO:tasks.workunit.client.1.smithi135.stdout:9/715: symlink d1/d1a/d10/d3c/le5 0 2024-05-09T00:07:39.342 INFO:tasks.workunit.client.1.smithi135.stdout:9/716: write d1/d1a/d2c/d20/fd3 [228985,65017] 0 2024-05-09T00:07:39.342 INFO:tasks.workunit.client.1.smithi135.stdout:9/717: chown d1/d1a/d89/dad/ld4 136569617 1 2024-05-09T00:07:39.342 INFO:tasks.workunit.client.1.smithi135.stdout:8/805: dwrite d4/d7/de/d45/d76/de2/f114 [0,4194304] 0 2024-05-09T00:07:39.342 INFO:tasks.workunit.client.1.smithi135.stdout:7/909: dwrite db/dd/f2d [4194304,4194304] 0 2024-05-09T00:07:39.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/156: creat d0/d12/d34/f36 x:0 0 0 2024-05-09T00:07:39.345 INFO:tasks.workunit.client.1.smithi135.stdout:2/823: mkdir d1/d12/d20/d2b/d56/d115 0 2024-05-09T00:07:39.345 INFO:tasks.workunit.client.1.smithi135.stdout:5/843: dwrite db/d24/fb5 [0,4194304] 0 2024-05-09T00:07:39.345 INFO:tasks.workunit.client.1.smithi135.stdout:5/844: dread - db/d84/fb2 zero size 2024-05-09T00:07:39.346 INFO:tasks.workunit.client.1.smithi135.stdout:8/806: read d4/d7/d33/d39/f70 [8000521,47093] 0 2024-05-09T00:07:39.346 INFO:tasks.workunit.client.1.smithi135.stdout:1/814: dwrite da/d73/fb3 [0,4194304] 0 2024-05-09T00:07:39.348 INFO:tasks.workunit.client.1.smithi135.stdout:9/718: rename d1/d24/d44/d54/d66 to d1/d1a/d2c/d2d/de6 0 2024-05-09T00:07:39.351 INFO:tasks.workunit.client.0.smithi026.stdout:8/209: mknod de/d17/d21/d24/d3b/c44 0 2024-05-09T00:07:39.352 INFO:tasks.workunit.client.0.smithi026.stdout:8/210: write f3 [4149548,75249] 0 2024-05-09T00:07:39.357 INFO:tasks.workunit.client.0.smithi026.stdout:7/275: creat d8/d2e/d55/d1e/d3d/f5f x:0 0 0 2024-05-09T00:07:39.357 INFO:tasks.workunit.client.0.smithi026.stdout:7/276: readlink d8/d2e/d55/d22/d29/l2b 0 2024-05-09T00:07:39.358 INFO:tasks.workunit.client.1.smithi135.stdout:7/910: mknod db/dd/d33/d68/d10a/d3a/dfc/c12f 0 2024-05-09T00:07:39.360 INFO:tasks.workunit.client.1.smithi135.stdout:0/792: dwrite d3/dd/d3f/d3a/f48 [0,4194304] 0 2024-05-09T00:07:39.361 INFO:tasks.workunit.client.1.smithi135.stdout:3/865: dwrite d8/d6d/d44/d4b/da0/daa/d88/f115 [0,4194304] 0 2024-05-09T00:07:39.361 INFO:tasks.workunit.client.1.smithi135.stdout:3/866: chown d8/d6d/d24/d106/l109 157 1 2024-05-09T00:07:39.361 INFO:tasks.workunit.client.1.smithi135.stdout:6/832: dwrite d2/da/d1d/d69/d78/f84 [0,4194304] 0 2024-05-09T00:07:39.362 INFO:tasks.workunit.client.1.smithi135.stdout:4/703: dwrite dc/dd/f80 [0,4194304] 0 2024-05-09T00:07:39.365 INFO:tasks.workunit.client.1.smithi135.stdout:2/824: mknod d1/d12/d21/de6/c116 0 2024-05-09T00:07:39.372 INFO:tasks.workunit.client.0.smithi026.stdout:7/277: rename d8/d2e/d55/d22/d29/c1a to d8/c60 0 2024-05-09T00:07:39.373 INFO:tasks.workunit.client.0.smithi026.stdout:4/157: dread d0/f9 [0,4194304] 0 2024-05-09T00:07:39.373 INFO:tasks.workunit.client.0.smithi026.stdout:4/158: readlink d0/d12/l33 0 2024-05-09T00:07:39.374 INFO:tasks.workunit.client.1.smithi135.stdout:5/845: mknod db/d24/d32/dfa/d9c/d9f/dc0/c108 0 2024-05-09T00:07:39.374 INFO:tasks.workunit.client.1.smithi135.stdout:5/846: chown db/d3f/f5f 14534642 1 2024-05-09T00:07:39.374 INFO:tasks.workunit.client.1.smithi135.stdout:5/847: stat db/d84/d31/d5e/l86 0 2024-05-09T00:07:39.377 INFO:tasks.workunit.client.1.smithi135.stdout:8/807: mkdir d4/d8/d115 0 2024-05-09T00:07:39.377 INFO:tasks.workunit.client.1.smithi135.stdout:8/808: fdatasync d4/f94 0 2024-05-09T00:07:39.377 INFO:tasks.workunit.client.1.smithi135.stdout:8/809: write d4/d7/ff4 [886476,86808] 0 2024-05-09T00:07:39.377 INFO:tasks.workunit.client.1.smithi135.stdout:8/810: write d4/d7/de/d45/d76/de2/fe4 [1008392,126812] 0 2024-05-09T00:07:39.377 INFO:tasks.workunit.client.1.smithi135.stdout:8/811: readlink d4/d7/lb4 0 2024-05-09T00:07:39.378 INFO:tasks.workunit.client.0.smithi026.stdout:7/278: creat d8/d2e/d55/d1e/d3d/f61 x:0 0 0 2024-05-09T00:07:39.378 INFO:tasks.workunit.client.0.smithi026.stdout:7/279: write d8/f56 [869356,108789] 0 2024-05-09T00:07:39.378 INFO:tasks.workunit.client.0.smithi026.stdout:7/280: write d8/d1b/f37 [194501,87674] 0 2024-05-09T00:07:39.381 INFO:tasks.workunit.client.0.smithi026.stdout:4/159: symlink d0/d12/d34/l37 0 2024-05-09T00:07:39.382 INFO:tasks.workunit.client.1.smithi135.stdout:8/812: read d4/d22/f27 [145392,58641] 0 2024-05-09T00:07:39.382 INFO:tasks.workunit.client.1.smithi135.stdout:8/813: chown d4/d7/da4/fc4 0 1 2024-05-09T00:07:39.382 INFO:tasks.workunit.client.1.smithi135.stdout:8/814: readlink l1 0 2024-05-09T00:07:39.383 INFO:tasks.workunit.client.1.smithi135.stdout:9/719: dwrite d1/d1a/d10/f68 [0,4194304] 0 2024-05-09T00:07:39.383 INFO:tasks.workunit.client.0.smithi026.stdout:7/281: mknod d8/d5c/c62 0 2024-05-09T00:07:39.384 INFO:tasks.workunit.client.1.smithi135.stdout:7/911: dwrite db/dd/d33/d58/dc7/f107 [0,4194304] 0 2024-05-09T00:07:39.385 INFO:tasks.workunit.client.1.smithi135.stdout:1/815: creat da/d14/d20/d38/d3a/db7/de9/dfd/f11e x:0 0 0 2024-05-09T00:07:39.388 INFO:tasks.workunit.client.1.smithi135.stdout:7/912: read db/dd/d33/d68/d10a/fcb [1264386,63311] 0 2024-05-09T00:07:39.388 INFO:tasks.workunit.client.1.smithi135.stdout:0/793: creat d3/d9e/dd0/fe9 x:0 0 0 2024-05-09T00:07:39.389 INFO:tasks.workunit.client.0.smithi026.stdout:7/282: write d8/d2e/d55/d22/d29/f18 [173566,79029] 0 2024-05-09T00:07:39.389 INFO:tasks.workunit.client.0.smithi026.stdout:7/283: truncate d8/d2e/d55/d1e/d3d/f5f 193877 0 2024-05-09T00:07:39.390 INFO:tasks.workunit.client.1.smithi135.stdout:3/867: mkdir d8/d13/d75/d12f 0 2024-05-09T00:07:39.393 INFO:tasks.workunit.client.0.smithi026.stdout:7/284: creat d8/d2e/d55/d1e/d3d/f63 x:0 0 0 2024-05-09T00:07:39.394 INFO:tasks.workunit.client.1.smithi135.stdout:6/833: mkdir d2/da/d49/da6/dd9/d10d/d110/d118 0 2024-05-09T00:07:39.397 INFO:tasks.workunit.client.1.smithi135.stdout:4/704: mkdir dc/d4a/d69/d55/d6d/dec/dee 0 2024-05-09T00:07:39.398 INFO:tasks.workunit.client.0.smithi026.stdout:0/289: sync 2024-05-09T00:07:39.398 INFO:tasks.workunit.client.1.smithi135.stdout:4/705: write dc/d4a/d69/d55/fab [413370,87398] 0 2024-05-09T00:07:39.400 INFO:tasks.workunit.client.0.smithi026.stdout:7/285: creat d8/d2e/d55/d1e/f64 x:0 0 0 2024-05-09T00:07:39.400 INFO:tasks.workunit.client.0.smithi026.stdout:7/286: fsync d8/d2e/d55/d22/d29/f2f 0 2024-05-09T00:07:39.403 INFO:tasks.workunit.client.0.smithi026.stdout:4/160: dwrite d0/f22 [0,4194304] 0 2024-05-09T00:07:39.403 INFO:tasks.workunit.client.0.smithi026.stdout:4/161: fdatasync d0/d12/f1d 0 2024-05-09T00:07:39.403 INFO:tasks.workunit.client.0.smithi026.stdout:4/162: dread - d0/d12/d1b/f26 zero size 2024-05-09T00:07:39.405 INFO:tasks.workunit.client.0.smithi026.stdout:0/290: mkdir d1d/d1e/d20/d4d/d58 0 2024-05-09T00:07:39.407 INFO:tasks.workunit.client.1.smithi135.stdout:2/825: unlink d1/d12/d20/d2b/d56/d72/fb9 0 2024-05-09T00:07:39.407 INFO:tasks.workunit.client.1.smithi135.stdout:2/826: chown d1/d12/d21/dc7/le5 78910731 1 2024-05-09T00:07:39.408 INFO:tasks.workunit.client.1.smithi135.stdout:8/815: unlink d4/d8/l4f 0 2024-05-09T00:07:39.410 INFO:tasks.workunit.client.0.smithi026.stdout:7/287: creat d8/d2e/d55/d22/f65 x:0 0 0 2024-05-09T00:07:39.410 INFO:tasks.workunit.client.0.smithi026.stdout:7/288: readlink d8/le 0 2024-05-09T00:07:39.410 INFO:tasks.workunit.client.0.smithi026.stdout:7/289: fdatasync d8/f56 0 2024-05-09T00:07:39.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/163: creat d0/d12/d34/f38 x:0 0 0 2024-05-09T00:07:39.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/164: read - d0/d19/f2f zero size 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:6/151: sync 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:1/169: sync 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:2/144: sync 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:9/198: sync 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:3/148: sync 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:1/170: dread - d5/dd/f34 zero size 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:9/199: write d7/d23/f33 [614658,62321] 0 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:9/200: write d7/d23/f36 [1473315,87361] 0 2024-05-09T00:07:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:5/174: sync 2024-05-09T00:07:39.415 INFO:tasks.workunit.client.0.smithi026.stdout:0/291: mknod d1d/d1e/d20/d51/c59 0 2024-05-09T00:07:39.416 INFO:tasks.workunit.client.1.smithi135.stdout:1/816: dwrite da/db/d16/df2/f112 [0,4194304] 0 2024-05-09T00:07:39.416 INFO:tasks.workunit.client.1.smithi135.stdout:1/817: stat da/d14/d20/d38/d3a/f8b 0 2024-05-09T00:07:39.416 INFO:tasks.workunit.client.1.smithi135.stdout:4/706: dwrite dc/dd/f22 [0,4194304] 0 2024-05-09T00:07:39.418 INFO:tasks.workunit.client.0.smithi026.stdout:7/290: mknod d8/c66 0 2024-05-09T00:07:39.420 INFO:tasks.workunit.client.0.smithi026.stdout:4/165: getdents d0/d19 0 2024-05-09T00:07:39.426 INFO:tasks.workunit.client.0.smithi026.stdout:3/149: unlink d5/d9/dc/d28/f25 0 2024-05-09T00:07:39.431 INFO:tasks.workunit.client.0.smithi026.stdout:6/152: mkdir d15/d1e/d30 0 2024-05-09T00:07:39.432 INFO:tasks.workunit.client.0.smithi026.stdout:1/171: dwrite f2 [4194304,4194304] 0 2024-05-09T00:07:39.436 INFO:tasks.workunit.client.0.smithi026.stdout:7/291: dwrite d8/f10 [0,4194304] 0 2024-05-09T00:07:39.436 INFO:tasks.workunit.client.0.smithi026.stdout:0/292: creat d1d/d25/d47/f5a x:0 0 0 2024-05-09T00:07:39.436 INFO:tasks.workunit.client.0.smithi026.stdout:0/293: stat d1d/d1e/d20/d4d/d58 0 2024-05-09T00:07:39.440 INFO:tasks.workunit.client.0.smithi026.stdout:3/150: creat d5/d9/dc/d28/d2c/d2f/f37 x:0 0 0 2024-05-09T00:07:39.444 INFO:tasks.workunit.client.0.smithi026.stdout:2/145: rename d14/d15/d17/l1a to d14/l3a 0 2024-05-09T00:07:39.447 INFO:tasks.workunit.client.0.smithi026.stdout:6/153: mkdir d15/d1e/d31 0 2024-05-09T00:07:39.447 INFO:tasks.workunit.client.0.smithi026.stdout:6/154: write f10 [967684,10067] 0 2024-05-09T00:07:39.453 INFO:tasks.workunit.client.0.smithi026.stdout:2/146: dread f5 [0,4194304] 0 2024-05-09T00:07:39.453 INFO:tasks.workunit.client.0.smithi026.stdout:2/147: fsync f8 0 2024-05-09T00:07:39.453 INFO:tasks.workunit.client.0.smithi026.stdout:2/148: truncate d14/d15/d17/f34 166038 0 2024-05-09T00:07:39.455 INFO:tasks.workunit.client.0.smithi026.stdout:1/172: mknod d5/db/d30/c35 0 2024-05-09T00:07:39.456 INFO:tasks.workunit.client.0.smithi026.stdout:9/201: rename d7/la to d7/l4d 0 2024-05-09T00:07:39.457 INFO:tasks.workunit.client.0.smithi026.stdout:9/202: write d7/d23/f36 [50828,81476] 0 2024-05-09T00:07:39.458 INFO:tasks.workunit.client.0.smithi026.stdout:7/292: symlink d8/d5c/l67 0 2024-05-09T00:07:39.460 INFO:tasks.workunit.client.0.smithi026.stdout:3/151: dwrite d5/d9/dc/d28/d2c/d2f/f2d [0,4194304] 0 2024-05-09T00:07:39.460 INFO:tasks.workunit.client.0.smithi026.stdout:3/152: readlink d5/d9/l30 0 2024-05-09T00:07:39.461 INFO:tasks.workunit.client.0.smithi026.stdout:0/294: creat d1d/f5b x:0 0 0 2024-05-09T00:07:39.462 INFO:tasks.workunit.client.0.smithi026.stdout:6/155: dwrite fa [4194304,4194304] 0 2024-05-09T00:07:39.463 INFO:tasks.workunit.client.0.smithi026.stdout:5/175: rename d2/d8/d26 to d2/d8/d31/d2e/d35 0 2024-05-09T00:07:39.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.470+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4060059120 con 0x7f4050066dc0 2024-05-09T00:07:39.465 INFO:tasks.workunit.client.0.smithi026.stdout:2/149: mkdir d14/d15/d3b 0 2024-05-09T00:07:39.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.472+0000 7f405dffb700 1 -- 172.21.15.26:0/3640340407 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4060059120 con 0x7f4050066dc0 2024-05-09T00:07:39.467 INFO:tasks.workunit.client.0.smithi026.stdout:9/203: creat d7/f4e x:0 0 0 2024-05-09T00:07:39.469 INFO:tasks.workunit.client.1.smithi135.stdout:7/913: mkdir db/dd/d33/d68/d10a/d3a/d130 0 2024-05-09T00:07:39.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4050066dc0 msgr2=0x7f4050069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:39.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4050066dc0 0x7f4050069280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4054004e60 tx=0x7f405400b040).stop 2024-05-09T00:07:39.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40600f8ab0 msgr2=0x7f4060108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40600f8ab0 0x7f4060108590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f404c00e8f0 tx=0x7f404c00b040).stop 2024-05-09T00:07:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 shutdown_connections 2024-05-09T00:07:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4050066dc0 0x7f4050069280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40600f7810 0x7f40601080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 --2- 172.21.15.26:0/3640340407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40600f8ab0 0x7f4060108590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 >> 172.21.15.26:0/3640340407 conn(0x7f40600f2f50 msgr2=0x7f40600fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 shutdown_connections 2024-05-09T00:07:39.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.474+0000 7f4066c5e700 1 -- 172.21.15.26:0/3640340407 wait complete. 2024-05-09T00:07:39.471 INFO:tasks.workunit.client.1.smithi135.stdout:0/794: unlink d3/dd/f62 0 2024-05-09T00:07:39.471 INFO:tasks.workunit.client.1.smithi135.stdout:0/795: fdatasync d3/f34 0 2024-05-09T00:07:39.471 INFO:tasks.workunit.client.1.smithi135.stdout:0/796: readlink d3/dd/d2d/d4c/d84/l9b 0 2024-05-09T00:07:39.474 INFO:tasks.workunit.client.0.smithi026.stdout:3/153: getdents d5/d9/dc 0 2024-05-09T00:07:39.475 INFO:tasks.workunit.client.1.smithi135.stdout:3/868: mknod d8/d6d/d24/c130 0 2024-05-09T00:07:39.475 INFO:tasks.workunit.client.1.smithi135.stdout:6/834: truncate d2/da/d26/f55 6586378 0 2024-05-09T00:07:39.475 INFO:tasks.workunit.client.1.smithi135.stdout:6/835: stat d2/da/d1d/d69/d78/c85 0 2024-05-09T00:07:39.475 INFO:tasks.workunit.client.1.smithi135.stdout:6/836: stat d2/d20/d37/d4e/d7c 0 2024-05-09T00:07:39.476 INFO:tasks.workunit.client.0.smithi026.stdout:0/295: creat d1d/d1e/d20/d51/f5c x:0 0 0 2024-05-09T00:07:39.476 INFO:tasks.workunit.client.1.smithi135.stdout:0/797: write d3/f79 [1304743,27880] 0 2024-05-09T00:07:39.476 INFO:tasks.workunit.client.1.smithi135.stdout:0/798: chown d3/dd/d2d/d4c/l66 2611420 1 2024-05-09T00:07:39.476 INFO:tasks.workunit.client.1.smithi135.stdout:0/799: dread - d3/dd/d3f/d3a/d46/f9d zero size 2024-05-09T00:07:39.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/827: truncate d1/d12/f8d 4086812 0 2024-05-09T00:07:39.479 INFO:tasks.workunit.client.1.smithi135.stdout:8/816: symlink d4/d7/d33/l116 0 2024-05-09T00:07:39.479 INFO:tasks.workunit.client.1.smithi135.stdout:8/817: chown d4/d8 4 1 2024-05-09T00:07:39.479 INFO:tasks.workunit.client.1.smithi135.stdout:8/818: readlink d4/ld 0 2024-05-09T00:07:39.481 INFO:tasks.workunit.client.0.smithi026.stdout:7/293: rename d8/d2e/d55/d1e/c2c to d8/d5c/c68 0 2024-05-09T00:07:39.481 INFO:tasks.workunit.client.0.smithi026.stdout:7/294: write d8/d2e/d55/d1e/d3d/f48 [767441,82775] 0 2024-05-09T00:07:39.481 INFO:tasks.workunit.client.0.smithi026.stdout:7/295: chown d8/d2e/d55/d1e/d3d/l3f 1 1 2024-05-09T00:07:39.484 INFO:tasks.workunit.client.0.smithi026.stdout:5/176: unlink d2/d8/d31/d2e/d33/c34 0 2024-05-09T00:07:39.485 INFO:tasks.workunit.client.0.smithi026.stdout:5/177: write d2/d8/d31/f18 [273345,86702] 0 2024-05-09T00:07:39.485 INFO:tasks.workunit.client.0.smithi026.stdout:5/178: stat d2/la 0 2024-05-09T00:07:39.485 INFO:tasks.workunit.client.0.smithi026.stdout:0/296: dread d1d/d1e/f32 [0,4194304] 0 2024-05-09T00:07:39.487 INFO:tasks.workunit.client.1.smithi135.stdout:9/720: dread d1/d1a/d2c/f8e [0,4194304] 0 2024-05-09T00:07:39.489 INFO:tasks.workunit.client.0.smithi026.stdout:0/297: dread d1d/d33/f3a [0,4194304] 0 2024-05-09T00:07:39.490 INFO:tasks.workunit.client.0.smithi026.stdout:3/154: mknod d5/d9/dc/d28/d2c/c38 0 2024-05-09T00:07:39.491 INFO:tasks.workunit.client.1.smithi135.stdout:1/818: stat da/l54 0 2024-05-09T00:07:39.492 INFO:tasks.workunit.client.0.smithi026.stdout:7/296: rename d8/d2e/d55/d1e/c30 to d8/d2e/d55/d1e/c69 0 2024-05-09T00:07:39.493 INFO:tasks.workunit.client.0.smithi026.stdout:7/297: stat d8/d2e/d55/d22/c3a 0 2024-05-09T00:07:39.495 INFO:tasks.workunit.client.0.smithi026.stdout:2/150: dread d14/d15/d1f/f28 [0,4194304] 0 2024-05-09T00:07:39.495 INFO:tasks.workunit.client.0.smithi026.stdout:2/151: truncate d14/d15/d17/f34 1050060 0 2024-05-09T00:07:39.497 INFO:tasks.workunit.client.0.smithi026.stdout:3/155: dread d5/f12 [0,4194304] 0 2024-05-09T00:07:39.497 INFO:tasks.workunit.client.0.smithi026.stdout:3/156: read - d5/d9/dc/f23 zero size 2024-05-09T00:07:39.497 INFO:tasks.workunit.client.1.smithi135.stdout:4/707: getdents dc/d26/d31 0 2024-05-09T00:07:39.497 INFO:tasks.workunit.client.1.smithi135.stdout:4/708: chown dc/d4a/d69/d55/d5f/d5a/c8e 12613 1 2024-05-09T00:07:39.497 INFO:tasks.workunit.client.1.smithi135.stdout:4/709: getdents dc/d26/d93/d9d/de7 0 2024-05-09T00:07:39.497 INFO:tasks.workunit.client.1.smithi135.stdout:4/710: chown dc/dd/f22 26 1 2024-05-09T00:07:39.498 INFO:tasks.workunit.client.0.smithi026.stdout:5/179: mkdir d2/d8/d36 0 2024-05-09T00:07:39.500 INFO:tasks.workunit.client.0.smithi026.stdout:0/298: getdents d1d/d1e/d20/d4d 0 2024-05-09T00:07:39.500 INFO:tasks.workunit.client.0.smithi026.stdout:0/299: stat f19 0 2024-05-09T00:07:39.500 INFO:tasks.workunit.client.1.smithi135.stdout:4/711: write fa [938152,36544] 0 2024-05-09T00:07:39.502 INFO:tasks.workunit.client.0.smithi026.stdout:7/298: rename d8/d2e/d55/d22/d29/l2b to d8/d1b/l6a 0 2024-05-09T00:07:39.502 INFO:tasks.workunit.client.0.smithi026.stdout:7/299: truncate d8/d2e/d55/f52 846971 0 2024-05-09T00:07:39.502 INFO:tasks.workunit.client.0.smithi026.stdout:7/300: chown d8/f1f 908 1 2024-05-09T00:07:39.504 INFO:tasks.workunit.client.0.smithi026.stdout:3/157: dread d5/d9/dc/f18 [0,4194304] 0 2024-05-09T00:07:39.506 INFO:tasks.workunit.client.1.smithi135.stdout:2/828: dwrite d1/d12/d20/d3b/d105/f10e [0,4194304] 0 2024-05-09T00:07:39.506 INFO:tasks.workunit.client.0.smithi026.stdout:2/152: mknod d14/d15/d3b/c3c 0 2024-05-09T00:07:39.506 INFO:tasks.workunit.client.0.smithi026.stdout:9/204: dwrite d7/d23/d29/f30 [0,4194304] 0 2024-05-09T00:07:39.507 INFO:tasks.workunit.client.0.smithi026.stdout:1/173: dwrite d5/d16/f1b [0,4194304] 0 2024-05-09T00:07:39.507 INFO:tasks.workunit.client.0.smithi026.stdout:6/156: dwrite d15/d1e/d23/d26/f28 [0,4194304] 0 2024-05-09T00:07:39.507 INFO:tasks.workunit.client.0.smithi026.stdout:5/180: truncate d2/fc 1109174 0 2024-05-09T00:07:39.509 INFO:tasks.workunit.client.1.smithi135.stdout:2/829: write d1/d22/d63/fed [2367440,1291] 0 2024-05-09T00:07:39.509 INFO:tasks.workunit.client.1.smithi135.stdout:2/830: fdatasync d1/d12/d20/d2b/d56/d86/f88 0 2024-05-09T00:07:39.512 INFO:tasks.workunit.client.1.smithi135.stdout:7/914: rename db/dd/d33/f3d to db/d5b/d101/f131 0 2024-05-09T00:07:39.512 INFO:tasks.workunit.client.0.smithi026.stdout:7/301: mkdir d8/d2e/d55/d1e/d3d/d6b 0 2024-05-09T00:07:39.512 INFO:tasks.workunit.client.0.smithi026.stdout:7/302: chown d8/d2e/f54 3229757 1 2024-05-09T00:07:39.512 INFO:tasks.workunit.client.0.smithi026.stdout:7/303: truncate d8/d1b/f5b 837635 0 2024-05-09T00:07:39.517 INFO:tasks.workunit.client.1.smithi135.stdout:3/869: unlink d8/d6d/d44/d4b/da0/daa/dc9/ce4 0 2024-05-09T00:07:39.518 INFO:tasks.workunit.client.1.smithi135.stdout:4/712: dread dc/d26/d4e/f6e [0,4194304] 0 2024-05-09T00:07:39.523 INFO:tasks.workunit.client.0.smithi026.stdout:0/300: dwrite d1d/d1e/d20/d51/f5c [0,4194304] 0 2024-05-09T00:07:39.524 INFO:tasks.workunit.client.1.smithi135.stdout:6/837: creat d2/d1a/d7a/f119 x:0 0 0 2024-05-09T00:07:39.524 INFO:tasks.workunit.client.1.smithi135.stdout:6/838: chown d2/d20/d37/d4e/d9d 25 1 2024-05-09T00:07:39.524 INFO:tasks.workunit.client.1.smithi135.stdout:6/839: write d2/da/d26/d57/ddc/ff5 [897780,63756] 0 2024-05-09T00:07:39.527 INFO:tasks.workunit.client.1.smithi135.stdout:0/800: mkdir d3/dd/d3f/d43/da3/dea 0 2024-05-09T00:07:39.527 INFO:tasks.workunit.client.1.smithi135.stdout:0/801: write d3/dd/d3f/d58/dae/fb4 [100128,65298] 0 2024-05-09T00:07:39.528 INFO:tasks.workunit.client.1.smithi135.stdout:8/819: getdents d4/dc6 0 2024-05-09T00:07:39.528 INFO:tasks.workunit.client.1.smithi135.stdout:8/820: write d4/d7/de/f7d [160569,49912] 0 2024-05-09T00:07:39.530 INFO:tasks.workunit.client.0.smithi026.stdout:3/158: dwrite d5/d9/dc/f1b [0,4194304] 0 2024-05-09T00:07:39.531 INFO:tasks.workunit.client.1.smithi135.stdout:6/840: dread d2/d20/fe6 [0,4194304] 0 2024-05-09T00:07:39.533 INFO:tasks.workunit.client.1.smithi135.stdout:6/841: dread d2/d5f/fba [0,4194304] 0 2024-05-09T00:07:39.533 INFO:tasks.workunit.client.1.smithi135.stdout:6/842: write d2/fc [4774965,117881] 0 2024-05-09T00:07:39.533 INFO:tasks.workunit.client.1.smithi135.stdout:9/721: unlink d1/d1a/d10/c7b 0 2024-05-09T00:07:39.534 INFO:tasks.workunit.client.0.smithi026.stdout:1/174: unlink d5/db/f2b 0 2024-05-09T00:07:39.535 INFO:tasks.workunit.client.1.smithi135.stdout:1/819: rmdir da/d24/d27/d33/d52/d71/d8d 39 2024-05-09T00:07:39.535 INFO:tasks.workunit.client.1.smithi135.stdout:1/820: getdents da/d14/d20/d38/d3a/d10d 0 2024-05-09T00:07:39.536 INFO:tasks.workunit.client.0.smithi026.stdout:6/157: mkdir d15/d1e/d30/d32 0 2024-05-09T00:07:39.540 INFO:tasks.workunit.client.0.smithi026.stdout:5/181: rename d2/l7 to d2/d8/d31/d2e/d33/l37 0 2024-05-09T00:07:39.543 INFO:tasks.workunit.client.1.smithi135.stdout:7/915: unlink db/d21/l104 0 2024-05-09T00:07:39.545 INFO:tasks.workunit.client.0.smithi026.stdout:2/153: dwrite f4 [0,4194304] 0 2024-05-09T00:07:39.545 INFO:tasks.workunit.client.1.smithi135.stdout:3/870: mkdir d8/d6d/d44/d4b/d131 0 2024-05-09T00:07:39.546 INFO:tasks.workunit.client.1.smithi135.stdout:5/848: sync 2024-05-09T00:07:39.548 INFO:tasks.workunit.client.1.smithi135.stdout:0/802: mkdir d3/dd/d3f/d58/dae/dd3/deb 0 2024-05-09T00:07:39.550 INFO:tasks.workunit.client.1.smithi135.stdout:4/713: dwrite dc/d4a/d69/f51 [0,4194304] 0 2024-05-09T00:07:39.550 INFO:tasks.workunit.client.1.smithi135.stdout:4/714: fsync dc/d4a/fa4 0 2024-05-09T00:07:39.550 INFO:tasks.workunit.client.1.smithi135.stdout:4/715: dread - dc/d71/d90/fde zero size 2024-05-09T00:07:39.551 INFO:tasks.workunit.client.0.smithi026.stdout:0/301: symlink d1d/d1e/d2d/l5d 0 2024-05-09T00:07:39.554 INFO:tasks.workunit.client.1.smithi135.stdout:2/831: dwrite d1/d12/d21/d57/d10b/f100 [0,4194304] 0 2024-05-09T00:07:39.554 INFO:tasks.workunit.client.1.smithi135.stdout:2/832: chown d1/d12/d21/l39 555777 1 2024-05-09T00:07:39.554 INFO:tasks.workunit.client.1.smithi135.stdout:5/849: dread db/d24/d32/d5b/d91/fa2 [0,4194304] 0 2024-05-09T00:07:39.555 INFO:tasks.workunit.client.0.smithi026.stdout:6/158: dwrite d15/f18 [8388608,4194304] 0 2024-05-09T00:07:39.555 INFO:tasks.workunit.client.1.smithi135.stdout:8/821: rename d4/d7/d33/d39/f84 to d4/d7/de/d45/f117 0 2024-05-09T00:07:39.558 INFO:tasks.workunit.client.1.smithi135.stdout:9/722: symlink d1/da4/le7 0 2024-05-09T00:07:39.560 INFO:tasks.workunit.client.1.smithi135.stdout:1/821: mkdir da/d24/d27/d11f 0 2024-05-09T00:07:39.564 INFO:tasks.workunit.client.1.smithi135.stdout:7/916: creat db/dd/d33/da5/d11b/f132 x:0 0 0 2024-05-09T00:07:39.564 INFO:tasks.workunit.client.1.smithi135.stdout:7/917: fsync db/dd/d33/d58/f8d 0 2024-05-09T00:07:39.570 INFO:tasks.workunit.client.1.smithi135.stdout:3/871: symlink d8/d6d/d44/d4b/dc2/d120/d129/d90/l132 0 2024-05-09T00:07:39.570 INFO:tasks.workunit.client.1.smithi135.stdout:0/803: truncate d3/dd/d3f/d29/d7c/fa8 22129 0 2024-05-09T00:07:39.570 INFO:tasks.workunit.client.1.smithi135.stdout:0/804: dread - d3/dd/d2d/d4c/fe3 zero size 2024-05-09T00:07:39.571 INFO:tasks.workunit.client.1.smithi135.stdout:0/805: write d3/dd/d3f/d29/fd4 [304530,109247] 0 2024-05-09T00:07:39.571 INFO:tasks.workunit.client.1.smithi135.stdout:0/806: write d3/dd/f32 [9290029,28454] 0 2024-05-09T00:07:39.580 INFO:tasks.workunit.client.1.smithi135.stdout:7/918: dwrite db/f30 [0,4194304] 0 2024-05-09T00:07:39.581 INFO:tasks.workunit.client.1.smithi135.stdout:7/919: write db/d5b/d101/f131 [4575823,92453] 0 2024-05-09T00:07:39.583 INFO:tasks.workunit.client.1.smithi135.stdout:5/850: creat db/d24/d32/dfa/dbe/f109 x:0 0 0 2024-05-09T00:07:39.588 INFO:tasks.workunit.client.1.smithi135.stdout:6/843: rename d2/d20/d3f/d4f/d7f/ld2 to d2/da/d49/da6/dd9/l11a 0 2024-05-09T00:07:39.588 INFO:tasks.workunit.client.1.smithi135.stdout:4/716: rename dc/d4a to dc/d4a/d69/d55/d5f/d5a/def 22 2024-05-09T00:07:39.588 INFO:tasks.workunit.client.1.smithi135.stdout:6/844: fdatasync d2/fd 0 2024-05-09T00:07:39.590 INFO:tasks.workunit.client.1.smithi135.stdout:8/822: dwrite d4/d7/d2a/faf [0,4194304] 0 2024-05-09T00:07:39.590 INFO:tasks.workunit.client.1.smithi135.stdout:3/872: mkdir d8/d6d/d24/d133 0 2024-05-09T00:07:39.594 INFO:tasks.workunit.client.0.smithi026.stdout:7/304: rename d8/d2e/d55/d22/d29/l17 to d8/d2e/d55/d1e/d3d/l6c 0 2024-05-09T00:07:39.595 INFO:tasks.workunit.client.1.smithi135.stdout:9/723: dwrite d1/d1a/d10/d3c/d5c/f6b [0,4194304] 0 2024-05-09T00:07:39.595 INFO:tasks.workunit.client.1.smithi135.stdout:0/807: dwrite d3/dd/d3f/d3a/f48 [4194304,4194304] 0 2024-05-09T00:07:39.595 INFO:tasks.workunit.client.1.smithi135.stdout:5/851: dread db/d24/d32/f44 [0,4194304] 0 2024-05-09T00:07:39.599 INFO:tasks.workunit.client.0.smithi026.stdout:5/182: link d2/c14 d2/d8/d31/d2e/d35/c38 0 2024-05-09T00:07:39.603 INFO:tasks.workunit.client.0.smithi026.stdout:2/154: creat d14/d15/d20/f3d x:0 0 0 2024-05-09T00:07:39.604 INFO:tasks.workunit.client.1.smithi135.stdout:7/920: creat db/d5b/d101/f133 x:0 0 0 2024-05-09T00:07:39.605 INFO:tasks.workunit.client.1.smithi135.stdout:2/833: rename d1/d12/d21/db1/cc5 to d1/d12/d20/d3b/d40/c117 0 2024-05-09T00:07:39.607 INFO:tasks.workunit.client.0.smithi026.stdout:0/302: symlink d1d/d25/l5e 0 2024-05-09T00:07:39.608 INFO:tasks.workunit.client.1.smithi135.stdout:4/717: symlink dc/d26/d31/d82/lf0 0 2024-05-09T00:07:39.609 INFO:tasks.workunit.client.1.smithi135.stdout:5/852: dread db/d84/f4b [0,4194304] 0 2024-05-09T00:07:39.610 INFO:tasks.workunit.client.1.smithi135.stdout:4/718: dread dc/f4b [0,4194304] 0 2024-05-09T00:07:39.612 INFO:tasks.workunit.client.0.smithi026.stdout:6/159: mkdir d15/d2b/d33 0 2024-05-09T00:07:39.615 INFO:tasks.workunit.client.1.smithi135.stdout:8/823: unlink d4/d8/lbc 0 2024-05-09T00:07:39.615 INFO:tasks.workunit.client.1.smithi135.stdout:8/824: fdatasync d4/d7/de/f7d 0 2024-05-09T00:07:39.617 INFO:tasks.workunit.client.1.smithi135.stdout:3/873: truncate d8/d13/d1f/f30 6204811 0 2024-05-09T00:07:39.617 INFO:tasks.workunit.client.1.smithi135.stdout:3/874: write d8/d6d/d44/d4b/da0/daa/dc9/f124 [935846,20610] 0 2024-05-09T00:07:39.618 INFO:tasks.workunit.client.1.smithi135.stdout:9/724: dwrite d1/d1a/f51 [4194304,4194304] 0 2024-05-09T00:07:39.618 INFO:tasks.workunit.client.0.smithi026.stdout:7/305: link d8/d1b/c1d d8/d5c/c6d 0 2024-05-09T00:07:39.619 INFO:tasks.workunit.client.1.smithi135.stdout:8/825: dread d4/d7/f52 [8388608,4194304] 0 2024-05-09T00:07:39.620 INFO:tasks.workunit.client.0.smithi026.stdout:5/183: mknod d2/d8/c39 0 2024-05-09T00:07:39.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.626+0000 7f4fff0a8700 1 -- 172.21.15.26:0/2842622173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 msgr2=0x7f4ff80f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:39.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.626+0000 7f4fff0a8700 1 --2- 172.21.15.26:0/2842622173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 0x7f4ff80f5ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f4fec0047f0 tx=0x7f4fec009cb0).stop 2024-05-09T00:07:39.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.626+0000 7f4fff0a8700 1 -- 172.21.15.26:0/2842622173 shutdown_connections 2024-05-09T00:07:39.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.626+0000 7f4fff0a8700 1 --2- 172.21.15.26:0/2842622173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff80f6450 0x7f4ff80f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:07:39.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.626+0000 7f4fff0a8700 1 --2- 172.21.15.26:0/2842622173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 0x7f4ff80f5ed0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.626+0000 7f4fff0a8700 1 -- 172.21.15.26:0/2842622173 >> 172.21.15.26:0/2842622173 conn(0x7f4ff80f15d0 msgr2=0x7f4ff80f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:39.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.627+0000 7f4fff0a8700 1 -- 172.21.15.26:0/2842622173 shutdown_connections 2024-05-09T00:07:39.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.627+0000 7f4fff0a8700 1 -- 172.21.15.26:0/2842622173 wait complete. 2024-05-09T00:07:39.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.627+0000 7f4fff0a8700 1 Processor -- start 2024-05-09T00:07:39.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/303: mkdir d1d/d25/d3c/d5f 0 2024-05-09T00:07:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.627+0000 7f4fff0a8700 1 -- start start 2024-05-09T00:07:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4fff0a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 0x7f4ff8069e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:39.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4fff0a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff80f6450 0x7f4ff806a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4fff0a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff8115ad0 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4fff0a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff806a810 con 0x7f4ff80f6450 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ffce44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 0x7f4ff8069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ffce44700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 0x7f4ff8069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56698/0 (socket says 172.21.15.26:56698) 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ffce44700 1 -- 172.21.15.26:0/1329664388 learned_addr learned my addr 172.21.15.26:0/1329664388 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ffce44700 1 -- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff80f6450 msgr2=0x7f4ff806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ff7fff700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff80f6450 0x7f4ff806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ffce44700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff80f6450 0x7f4ff806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ffce44700 1 -- 172.21.15.26:0/1329664388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec005040 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ff7fff700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff80f6450 0x7f4ff806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.628+0000 7f4ffce44700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 0x7f4ff8069e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f4fec013620 tx=0x7f4fec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:39.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.629+0000 7f4ff5ffb700 1 -- 172.21.15.26:0/1329664388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fec00e030 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.629+0000 7f4ff5ffb700 1 -- 172.21.15.26:0/1329664388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fec007e90 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.629+0000 7f4ff5ffb700 1 -- 172.21.15.26:0/1329664388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fec018070 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.629+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff806aa90 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.629+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff80f71d0 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.625 INFO:tasks.workunit.client.0.smithi026.stdout:6/160: mkdir d15/d34 0 2024-05-09T00:07:39.625 INFO:tasks.workunit.client.0.smithi026.stdout:6/161: fsync d15/f1f 0 2024-05-09T00:07:39.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.631+0000 7f4ff5ffb700 1 -- 172.21.15.26:0/1329664388 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f4fec01d9d0 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.631+0000 7f4ff5ffb700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4fe8066dc0 0x7f4fe8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:39.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.631+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff80f8a20 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.631+0000 7f4ff5ffb700 1 -- 172.21.15.26:0/1329664388 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f4fec085620 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.633+0000 7f4ff7fff700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4fe8066dc0 0x7f4fe8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:39.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.633+0000 7f4ff7fff700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4fe8066dc0 0x7f4fe8069280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4ff80f69e0 tx=0x7f4fe4008040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:39.630 INFO:tasks.workunit.client.0.smithi026.stdout:3/159: rename d5/d9/f24 to d5/f39 0 2024-05-09T00:07:39.630 INFO:tasks.workunit.client.0.smithi026.stdout:3/160: write d5/d1e/f1c [792034,21082] 0 2024-05-09T00:07:39.630 INFO:tasks.workunit.client.0.smithi026.stdout:3/161: truncate d5/d1e/f36 627102 0 2024-05-09T00:07:39.630 INFO:tasks.workunit.client.0.smithi026.stdout:3/162: chown d5/d9/dc/c27 80829448 1 2024-05-09T00:07:39.630 INFO:tasks.workunit.client.0.smithi026.stdout:7/306: creat d8/d2e/d55/d1e/f6e x:0 0 0 2024-05-09T00:07:39.630 INFO:tasks.workunit.client.0.smithi026.stdout:7/307: chown d8/d2e/d55/d1e/d3d/f63 11 1 2024-05-09T00:07:39.631 INFO:tasks.workunit.client.0.smithi026.stdout:3/163: write d5/d9/dc/f1b [1130168,88118] 0 2024-05-09T00:07:39.632 INFO:tasks.workunit.client.0.smithi026.stdout:3/164: write d5/d9/ff [4819185,71493] 0 2024-05-09T00:07:39.632 INFO:tasks.workunit.client.0.smithi026.stdout:3/165: chown d5/d9/dc 60182791 1 2024-05-09T00:07:39.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.637+0000 7f4ff5ffb700 1 -- 172.21.15.26:0/1329664388 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f4fec053740 con 0x7f4ff80f5ab0 2024-05-09T00:07:39.632 INFO:tasks.workunit.client.1.smithi135.stdout:9/725: dwrite d1/d1a/d10/d3c/d43/f83 [0,4194304] 0 2024-05-09T00:07:39.632 INFO:tasks.workunit.client.1.smithi135.stdout:9/726: fsync d1/d1a/d89/d99/fa5 0 2024-05-09T00:07:39.634 INFO:tasks.workunit.client.0.smithi026.stdout:0/304: symlink d1d/d25/l60 0 2024-05-09T00:07:39.635 INFO:tasks.workunit.client.0.smithi026.stdout:0/305: write f5 [1659976,115840] 0 2024-05-09T00:07:39.637 INFO:tasks.workunit.client.0.smithi026.stdout:6/162: link d15/d1e/d23/f24 d15/d1e/d30/f35 0 2024-05-09T00:07:39.637 INFO:tasks.workunit.client.0.smithi026.stdout:6/163: fsync d15/f1f 0 2024-05-09T00:07:39.641 INFO:tasks.workunit.client.0.smithi026.stdout:1/175: rename d5/db/d1d/c20 to d5/dd/d17/d29/c36 0 2024-05-09T00:07:39.641 INFO:tasks.workunit.client.0.smithi026.stdout:2/155: rename d14/d15/d30 to d14/d15/d30/d3e 22 2024-05-09T00:07:39.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:37.906044+0000 mgr.smithi135.kkrhgf (mgr.24419) 48 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 92 MiB/s rd, 187 MiB/s wr, 276 op/s 2024-05-09T00:07:39.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:37.906044+0000 mgr.smithi135.kkrhgf (mgr.24419) 48 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 92 MiB/s rd, 187 MiB/s wr, 276 op/s 2024-05-09T00:07:39.647 INFO:tasks.workunit.client.1.smithi135.stdout:7/921: getdents db/dd/dca 0 2024-05-09T00:07:39.648 INFO:tasks.workunit.client.0.smithi026.stdout:3/166: rmdir d5/d9/dc/d28/d2c 39 2024-05-09T00:07:39.648 INFO:tasks.workunit.client.0.smithi026.stdout:3/167: chown d5/f39 212611568 1 2024-05-09T00:07:39.649 INFO:tasks.workunit.client.0.smithi026.stdout:5/184: dwrite d2/d8/d31/f1f [0,4194304] 0 2024-05-09T00:07:39.653 INFO:tasks.workunit.client.1.smithi135.stdout:2/834: mkdir d1/d12/d20/d2b/d56/ddd/d118 0 2024-05-09T00:07:39.656 INFO:tasks.workunit.client.0.smithi026.stdout:6/164: unlink d15/d1e/d23/d26/f21 0 2024-05-09T00:07:39.656 INFO:tasks.workunit.client.0.smithi026.stdout:6/165: fdatasync f11 0 2024-05-09T00:07:39.656 INFO:tasks.workunit.client.0.smithi026.stdout:6/166: chown d15/d2b/d33 13 1 2024-05-09T00:07:39.658 INFO:tasks.workunit.client.1.smithi135.stdout:5/853: creat db/d24/db0/f10a x:0 0 0 2024-05-09T00:07:39.658 INFO:tasks.workunit.client.1.smithi135.stdout:5/854: chown db/d24/d32/dfa/d9c/d9f/d92/ffd 0 1 2024-05-09T00:07:39.658 INFO:tasks.workunit.client.1.smithi135.stdout:7/922: dread db/d5b/d101/f131 [0,4194304] 0 2024-05-09T00:07:39.658 INFO:tasks.workunit.client.1.smithi135.stdout:7/923: chown db/f30 19 1 2024-05-09T00:07:39.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/308: rename d8/f10 to d8/d2e/f6f 0 2024-05-09T00:07:39.662 INFO:tasks.workunit.client.0.smithi026.stdout:2/156: rmdir d14/d22 39 2024-05-09T00:07:39.663 INFO:tasks.workunit.client.0.smithi026.stdout:2/157: write d14/d15/d17/f1c [3073961,117097] 0 2024-05-09T00:07:39.665 INFO:tasks.workunit.client.1.smithi135.stdout:4/719: mknod dc/d26/d31/d96/cf1 0 2024-05-09T00:07:39.667 INFO:tasks.workunit.client.0.smithi026.stdout:1/176: link d5/l6 d5/dd/d1f/l37 0 2024-05-09T00:07:39.667 INFO:tasks.workunit.client.1.smithi135.stdout:7/924: dread db/d13/f2a [4194304,4194304] 0 2024-05-09T00:07:39.668 INFO:tasks.workunit.client.0.smithi026.stdout:5/185: dwrite d2/d8/d31/f1f [0,4194304] 0 2024-05-09T00:07:39.668 INFO:tasks.workunit.client.1.smithi135.stdout:3/875: mknod d8/d6d/d24/c134 0 2024-05-09T00:07:39.670 INFO:tasks.workunit.client.0.smithi026.stdout:3/168: symlink d5/d1e/l3a 0 2024-05-09T00:07:39.670 INFO:tasks.workunit.client.0.smithi026.stdout:2/158: dread d14/d15/d17/f1c [4194304,4194304] 0 2024-05-09T00:07:39.671 INFO:tasks.workunit.client.1.smithi135.stdout:8/826: mknod d4/d7/d2a/d56/dec/dfe/d113/c118 0 2024-05-09T00:07:39.671 INFO:tasks.workunit.client.1.smithi135.stdout:8/827: write d4/dc6/ffa [5209264,50473] 0 2024-05-09T00:07:39.677 INFO:tasks.workunit.client.0.smithi026.stdout:6/167: mkdir d15/d1e/d30/d32/d36 0 2024-05-09T00:07:39.677 INFO:tasks.workunit.client.0.smithi026.stdout:0/306: rename f14 to d1d/d33/f61 0 2024-05-09T00:07:39.678 INFO:tasks.workunit.client.0.smithi026.stdout:0/307: chown d1d/d1e/f32 353 1 2024-05-09T00:07:39.679 INFO:tasks.workunit.client.1.smithi135.stdout:9/727: creat d1/d1a/fe8 x:0 0 0 2024-05-09T00:07:39.679 INFO:tasks.workunit.client.1.smithi135.stdout:9/728: stat d1/d24/d44/daf/fd6 0 2024-05-09T00:07:39.680 INFO:tasks.workunit.client.1.smithi135.stdout:9/729: read d1/fcd [110909,122954] 0 2024-05-09T00:07:39.680 INFO:tasks.workunit.client.1.smithi135.stdout:9/730: fsync d1/d1a/d10/d3c/d5c/fae 0 2024-05-09T00:07:39.681 INFO:tasks.workunit.client.0.smithi026.stdout:7/309: mknod d8/c70 0 2024-05-09T00:07:39.683 INFO:tasks.workunit.client.1.smithi135.stdout:3/876: dread d8/d13/f19 [0,4194304] 0 2024-05-09T00:07:39.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/822: rename da/d14/d20/d2c/f32 to da/f120 0 2024-05-09T00:07:39.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/823: truncate da/db/f95 742920 0 2024-05-09T00:07:39.687 INFO:tasks.workunit.client.0.smithi026.stdout:1/177: unlink d5/dd/d1f/l22 0 2024-05-09T00:07:39.687 INFO:tasks.workunit.client.0.smithi026.stdout:1/178: fsync d5/dd/ff 0 2024-05-09T00:07:39.689 INFO:tasks.workunit.client.1.smithi135.stdout:2/835: mkdir d1/d12/d21/d57/d10b/d119 0 2024-05-09T00:07:39.689 INFO:tasks.workunit.client.1.smithi135.stdout:2/836: fdatasync d1/d12/d27/ff3 0 2024-05-09T00:07:39.691 INFO:tasks.workunit.client.0.smithi026.stdout:0/308: mkdir d1d/d1e/d20/d4d/d58/d62 0 2024-05-09T00:07:39.692 INFO:tasks.workunit.client.1.smithi135.stdout:4/720: truncate dc/d26/d31/f6f 4068915 0 2024-05-09T00:07:39.692 INFO:tasks.workunit.client.1.smithi135.stdout:7/925: creat db/da8/f134 x:0 0 0 2024-05-09T00:07:39.692 INFO:tasks.workunit.client.1.smithi135.stdout:7/926: write db/dd/d33/d68/d10a/d94/f129 [447679,39420] 0 2024-05-09T00:07:39.693 INFO:tasks.workunit.client.0.smithi026.stdout:2/159: rename d14/d15/d20/f3d to d14/d15/d3b/f3f 0 2024-05-09T00:07:39.694 INFO:tasks.workunit.client.1.smithi135.stdout:7/927: write db/da8/faf [2851507,103736] 0 2024-05-09T00:07:39.694 INFO:tasks.workunit.client.0.smithi026.stdout:7/310: symlink d8/d2e/d55/l71 0 2024-05-09T00:07:39.697 INFO:tasks.workunit.client.1.smithi135.stdout:9/731: mknod d1/d1a/d10/db3/ce9 0 2024-05-09T00:07:39.697 INFO:tasks.workunit.client.0.smithi026.stdout:5/186: mknod d2/d8/d31/d24/c3a 0 2024-05-09T00:07:39.698 INFO:tasks.workunit.client.0.smithi026.stdout:0/309: rename d1d/d25/l45 to d1d/d1e/d2d/l63 0 2024-05-09T00:07:39.700 INFO:tasks.workunit.client.0.smithi026.stdout:2/160: mkdir d14/d15/d3b/d40 0 2024-05-09T00:07:39.701 INFO:tasks.workunit.client.1.smithi135.stdout:6/845: rename d2/d20/fe6 to d2/da/d26/f11b 0 2024-05-09T00:07:39.701 INFO:tasks.workunit.client.0.smithi026.stdout:7/311: dread d8/d2e/d55/d1e/d3d/f5f [0,4194304] 0 2024-05-09T00:07:39.702 INFO:tasks.workunit.client.1.smithi135.stdout:1/824: mkdir da/d14/d20/d38/d3a/d10d/d121 0 2024-05-09T00:07:39.702 INFO:tasks.workunit.client.1.smithi135.stdout:1/825: write da/d24/d27/f9b [388159,107854] 0 2024-05-09T00:07:39.703 INFO:tasks.workunit.client.0.smithi026.stdout:5/187: unlink d2/d8/d31/d2e/d33/l37 0 2024-05-09T00:07:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:9/732: write d1/d1a/d10/d3c/d5c/fab [1380879,71733] 0 2024-05-09T00:07:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:9/733: write d1/fba [613857,65008] 0 2024-05-09T00:07:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:2/837: mkdir d1/d12/d21/d11a 0 2024-05-09T00:07:39.705 INFO:tasks.workunit.client.0.smithi026.stdout:0/310: write d1d/f29 [3888451,124871] 0 2024-05-09T00:07:39.705 INFO:tasks.workunit.client.0.smithi026.stdout:2/161: chown d14/d15/d1f/l29 253328 1 2024-05-09T00:07:39.705 INFO:tasks.workunit.client.1.smithi135.stdout:6/846: write d2/d20/d3f/f44 [1321293,15836] 0 2024-05-09T00:07:39.707 INFO:tasks.workunit.client.0.smithi026.stdout:7/312: rename d8/d2e/d55/d22/l35 to d8/d2e/d55/d22/l72 0 2024-05-09T00:07:39.707 INFO:tasks.workunit.client.0.smithi026.stdout:7/313: fsync d8/d2e/d55/d1e/d3d/f61 0 2024-05-09T00:07:39.708 INFO:tasks.workunit.client.0.smithi026.stdout:7/314: write d8/d2e/f54 [765385,53285] 0 2024-05-09T00:07:39.709 INFO:tasks.workunit.client.1.smithi135.stdout:4/721: creat dc/d4a/d69/d55/d6d/dec/ff2 x:0 0 0 2024-05-09T00:07:39.709 INFO:tasks.workunit.client.1.smithi135.stdout:4/722: fsync dc/dd/f14 0 2024-05-09T00:07:39.709 INFO:tasks.workunit.client.1.smithi135.stdout:4/723: dread - dc/d71/de5/fe6 zero size 2024-05-09T00:07:39.709 INFO:tasks.workunit.client.1.smithi135.stdout:4/724: chown dc/l81 4821 1 2024-05-09T00:07:39.712 INFO:tasks.workunit.client.1.smithi135.stdout:5/855: rename db/d24/db0/lc2 to db/d24/d32/dfa/d9c/d9f/dc0/l10b 0 2024-05-09T00:07:39.714 INFO:tasks.workunit.client.1.smithi135.stdout:3/877: dwrite d8/d6d/d44/d4b/da0/daa/dc9/f114 [0,4194304] 0 2024-05-09T00:07:39.715 INFO:tasks.workunit.client.0.smithi026.stdout:0/311: mkdir d1d/d33/d64 0 2024-05-09T00:07:39.715 INFO:tasks.workunit.client.0.smithi026.stdout:3/169: dwrite d5/d9/f33 [0,4194304] 0 2024-05-09T00:07:39.715 INFO:tasks.workunit.client.1.smithi135.stdout:1/826: mkdir da/d73/d122 0 2024-05-09T00:07:39.715 INFO:tasks.workunit.client.1.smithi135.stdout:1/827: chown da/d73 43853901 1 2024-05-09T00:07:39.715 INFO:tasks.workunit.client.1.smithi135.stdout:1/828: chown da/d14/d20/d38/d3a/f108 33 1 2024-05-09T00:07:39.716 INFO:tasks.workunit.client.0.smithi026.stdout:6/168: dwrite d15/f1d [0,4194304] 0 2024-05-09T00:07:39.717 INFO:tasks.workunit.client.1.smithi135.stdout:5/856: dread db/d84/d31/f90 [0,4194304] 0 2024-05-09T00:07:39.717 INFO:tasks.workunit.client.1.smithi135.stdout:7/928: dwrite db/d5b/d101/f131 [4194304,4194304] 0 2024-05-09T00:07:39.717 INFO:tasks.workunit.client.1.smithi135.stdout:2/838: rmdir d1/d12/d20/d2b/d56/d72 39 2024-05-09T00:07:39.719 INFO:tasks.workunit.client.1.smithi135.stdout:9/734: dread d1/d1a/d2c/f6d [0,4194304] 0 2024-05-09T00:07:39.720 INFO:tasks.workunit.client.0.smithi026.stdout:3/170: mknod d5/d9/dc/c3b 0 2024-05-09T00:07:39.723 INFO:tasks.workunit.client.1.smithi135.stdout:6/847: rename d2/d20/d3f/d4f/d103 to d2/d20/d3f/d4f/ddb/d11c 0 2024-05-09T00:07:39.723 INFO:tasks.workunit.client.1.smithi135.stdout:4/725: write dc/dd/f1d [778962,95325] 0 2024-05-09T00:07:39.723 INFO:tasks.workunit.client.1.smithi135.stdout:4/726: chown dc/dd/fbc 8 1 2024-05-09T00:07:39.723 INFO:tasks.workunit.client.1.smithi135.stdout:4/727: stat dc/d26/d31/d96/cf1 0 2024-05-09T00:07:39.723 INFO:tasks.workunit.client.1.smithi135.stdout:4/728: chown dc/dd/l1c 6382 1 2024-05-09T00:07:39.725 INFO:tasks.workunit.client.0.smithi026.stdout:3/171: stat d5/c17 0 2024-05-09T00:07:39.725 INFO:tasks.workunit.client.0.smithi026.stdout:3/172: chown d5/d9/dc/d28/d2c/d2f/f2d 9824366 1 2024-05-09T00:07:39.725 INFO:tasks.workunit.client.0.smithi026.stdout:3/173: dread - d5/d9/f2a zero size 2024-05-09T00:07:39.727 INFO:tasks.workunit.client.1.smithi135.stdout:3/878: symlink d8/d13/d75/d58/l135 0 2024-05-09T00:07:39.727 INFO:tasks.workunit.client.1.smithi135.stdout:3/879: chown d8/d13/d1f/fad 12364331 1 2024-05-09T00:07:39.728 INFO:tasks.workunit.client.0.smithi026.stdout:3/174: mknod d5/d9/dc/d28/c3c 0 2024-05-09T00:07:39.729 INFO:tasks.workunit.client.0.smithi026.stdout:6/169: write d15/f18 [9232578,70955] 0 2024-05-09T00:07:39.729 INFO:tasks.workunit.client.0.smithi026.stdout:6/170: chown d15/d1e/d23/d26/c2e 7738 1 2024-05-09T00:07:39.730 INFO:tasks.workunit.client.1.smithi135.stdout:1/829: mknod da/d14/d20/d38/d3a/c123 0 2024-05-09T00:07:39.730 INFO:tasks.workunit.client.1.smithi135.stdout:1/830: dread - da/d24/ff9 zero size 2024-05-09T00:07:39.730 INFO:tasks.workunit.client.1.smithi135.stdout:1/831: write da/d14/d20/d38/d3a/db7/de9/f105 [2132901,124414] 0 2024-05-09T00:07:39.730 INFO:tasks.workunit.client.0.smithi026.stdout:5/188: dwrite d2/fc [0,4194304] 0 2024-05-09T00:07:39.730 INFO:tasks.workunit.client.1.smithi135.stdout:5/857: mknod db/d5d/dac/c10c 0 2024-05-09T00:07:39.734 INFO:tasks.workunit.client.1.smithi135.stdout:7/929: mkdir db/dd/d33/d68/d10a/d3a/d40/d135 0 2024-05-09T00:07:39.735 INFO:tasks.workunit.client.0.smithi026.stdout:6/171: unlink d15/d1e/l22 0 2024-05-09T00:07:39.735 INFO:tasks.workunit.client.0.smithi026.stdout:2/162: dwrite d14/d15/d1f/f28 [0,4194304] 0 2024-05-09T00:07:39.735 INFO:tasks.workunit.client.0.smithi026.stdout:7/315: dwrite d8/d2e/d55/d1e/d3d/f5f [0,4194304] 0 2024-05-09T00:07:39.735 INFO:tasks.workunit.client.0.smithi026.stdout:7/316: readlink d8/d2e/d55/l16 0 2024-05-09T00:07:39.736 INFO:tasks.workunit.client.0.smithi026.stdout:7/317: readlink d8/l4e 0 2024-05-09T00:07:39.736 INFO:tasks.workunit.client.1.smithi135.stdout:2/839: creat d1/d12/d20/d2b/d56/d86/f11b x:0 0 0 2024-05-09T00:07:39.739 INFO:tasks.workunit.client.1.smithi135.stdout:9/735: mkdir d1/d24/d44/d7f/da2/dca/dea 0 2024-05-09T00:07:39.740 INFO:tasks.workunit.client.0.smithi026.stdout:5/189: symlink d2/d8/d31/d2e/d35/l3b 0 2024-05-09T00:07:39.744 INFO:tasks.workunit.client.0.smithi026.stdout:6/172: truncate d15/d1e/d23/d26/f28 3923170 0 2024-05-09T00:07:39.744 INFO:tasks.workunit.client.0.smithi026.stdout:6/173: chown d15/d1e/d23/f25 70725 1 2024-05-09T00:07:39.744 INFO:tasks.workunit.client.0.smithi026.stdout:6/174: fsync d15/d1e/d23/f25 0 2024-05-09T00:07:39.744 INFO:tasks.workunit.client.0.smithi026.stdout:1/179: rmdir d5/dd/d1f 39 2024-05-09T00:07:39.747 INFO:tasks.workunit.client.1.smithi135.stdout:6/848: unlink d2/d20/d37/d4e/l70 0 2024-05-09T00:07:39.748 INFO:tasks.workunit.client.0.smithi026.stdout:6/175: read d15/f1f [3348150,121823] 0 2024-05-09T00:07:39.753 INFO:tasks.workunit.client.1.smithi135.stdout:3/880: creat d8/d6d/d44/d4b/dc2/d120/d129/d90/f136 x:0 0 0 2024-05-09T00:07:39.756 INFO:tasks.workunit.client.0.smithi026.stdout:0/312: dwrite d1d/f29 [4194304,4194304] 0 2024-05-09T00:07:39.756 INFO:tasks.workunit.client.0.smithi026.stdout:0/313: chown d1d/d33/c35 17 1 2024-05-09T00:07:39.758 INFO:tasks.workunit.client.1.smithi135.stdout:1/832: mknod da/d24/d27/d33/d7d/c124 0 2024-05-09T00:07:39.763 INFO:tasks.workunit.client.1.smithi135.stdout:9/736: dwrite d1/d1a/d2c/f53 [0,4194304] 0 2024-05-09T00:07:39.766 INFO:tasks.workunit.client.0.smithi026.stdout:2/163: dwrite d14/d15/f39 [0,4194304] 0 2024-05-09T00:07:39.770 INFO:tasks.workunit.client.1.smithi135.stdout:5/858: truncate db/f7f 1159790 0 2024-05-09T00:07:39.774 INFO:tasks.workunit.client.1.smithi135.stdout:4/729: getdents dc/d4a/d69/d55/d6d/dec 0 2024-05-09T00:07:39.777 INFO:tasks.workunit.client.0.smithi026.stdout:7/318: mknod d8/d2e/c73 0 2024-05-09T00:07:39.781 INFO:tasks.workunit.client.1.smithi135.stdout:6/849: dwrite d2/f105 [0,4194304] 0 2024-05-09T00:07:39.781 INFO:tasks.workunit.client.0.smithi026.stdout:5/190: creat d2/d8/d36/f3c x:0 0 0 2024-05-09T00:07:39.781 INFO:tasks.workunit.client.1.smithi135.stdout:6/850: write d2/da/d26/d57/d60/fd3 [3384739,27435] 0 2024-05-09T00:07:39.781 INFO:tasks.workunit.client.1.smithi135.stdout:6/851: write d2/da/d1d/d69/f9c [865595,42493] 0 2024-05-09T00:07:39.782 INFO:tasks.workunit.client.1.smithi135.stdout:6/852: write d2/d20/d3f/d4f/d7f/fca [5404366,21196] 0 2024-05-09T00:07:39.783 INFO:tasks.workunit.client.0.smithi026.stdout:6/176: dwrite f1 [0,4194304] 0 2024-05-09T00:07:39.784 INFO:tasks.workunit.client.1.smithi135.stdout:9/737: dwrite d1/d1a/f67 [0,4194304] 0 2024-05-09T00:07:39.785 INFO:tasks.workunit.client.0.smithi026.stdout:1/180: getdents d5/dd/d17/d29 0 2024-05-09T00:07:39.785 INFO:tasks.workunit.client.0.smithi026.stdout:1/181: truncate d5/db/f1e 1557804 0 2024-05-09T00:07:39.785 INFO:tasks.workunit.client.0.smithi026.stdout:1/182: fdatasync d5/dd/d17/f2a 0 2024-05-09T00:07:39.786 INFO:tasks.workunit.client.0.smithi026.stdout:1/183: stat d5/f2d 0 2024-05-09T00:07:39.788 INFO:tasks.workunit.client.1.smithi135.stdout:7/930: rename db/dd/d33/d68/d10a/d3a/d40/d7e/f112 to db/dd/d33/d68/d10a/d3a/d40/d84/f136 0 2024-05-09T00:07:39.790 INFO:tasks.workunit.client.0.smithi026.stdout:0/314: creat d1d/d25/f65 x:0 0 0 2024-05-09T00:07:39.790 INFO:tasks.workunit.client.0.smithi026.stdout:0/315: write d1d/f5b [318007,69905] 0 2024-05-09T00:07:39.792 INFO:tasks.workunit.client.1.smithi135.stdout:2/840: creat d1/d12/d21/d11a/f11c x:0 0 0 2024-05-09T00:07:39.794 INFO:tasks.workunit.client.1.smithi135.stdout:3/881: creat d8/d6d/d44/d4b/da0/daa/dc9/dfe/f137 x:0 0 0 2024-05-09T00:07:39.795 INFO:tasks.workunit.client.0.smithi026.stdout:3/175: rmdir d5/d9/dc/d28 39 2024-05-09T00:07:39.795 INFO:tasks.workunit.client.0.smithi026.stdout:3/176: dread - d5/d9/dc/d28/d2c/d2f/f37 zero size 2024-05-09T00:07:39.798 INFO:tasks.workunit.client.1.smithi135.stdout:1/833: rmdir da/d73/d122 0 2024-05-09T00:07:39.798 INFO:tasks.workunit.client.0.smithi026.stdout:2/164: mkdir d14/d15/d20/d41 0 2024-05-09T00:07:39.805 INFO:tasks.workunit.client.0.smithi026.stdout:7/319: mknod d8/d2e/d55/d1e/d3d/c74 0 2024-05-09T00:07:39.807 INFO:tasks.workunit.client.1.smithi135.stdout:5/859: mknod db/d3f/de1/c10d 0 2024-05-09T00:07:39.810 INFO:tasks.workunit.client.1.smithi135.stdout:4/730: creat dc/d26/d31/db8/dd1/ddd/ff3 x:0 0 0 2024-05-09T00:07:39.813 INFO:tasks.workunit.client.0.smithi026.stdout:6/177: unlink d15/f1c 0 2024-05-09T00:07:39.814 INFO:tasks.workunit.client.1.smithi135.stdout:9/738: dwrite d1/d1a/d89/d99/fc4 [0,4194304] 0 2024-05-09T00:07:39.814 INFO:tasks.workunit.client.1.smithi135.stdout:9/739: readlink d1/d1a/d10/d3c/d43/l85 0 2024-05-09T00:07:39.814 INFO:tasks.workunit.client.1.smithi135.stdout:9/740: dread - d1/d1a/d10/d3c/d5c/f5f zero size 2024-05-09T00:07:39.815 INFO:tasks.workunit.client.0.smithi026.stdout:1/184: dwrite d5/dd/d1f/f2e [0,4194304] 0 2024-05-09T00:07:39.816 INFO:tasks.workunit.client.0.smithi026.stdout:0/316: truncate f11 230989 0 2024-05-09T00:07:39.816 INFO:tasks.workunit.client.0.smithi026.stdout:0/317: rename d1d to d1d/d1e/d20/d4d/d58/d62/d66 22 2024-05-09T00:07:39.818 INFO:tasks.workunit.client.0.smithi026.stdout:3/177: creat d5/d1e/f3d x:0 0 0 2024-05-09T00:07:39.818 INFO:tasks.workunit.client.0.smithi026.stdout:3/178: chown d5/d9/l30 0 1 2024-05-09T00:07:39.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/165: mknod d14/d15/c42 0 2024-05-09T00:07:39.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/166: chown d14/d15/d1f/l29 220718321 1 2024-05-09T00:07:39.823 INFO:tasks.workunit.client.0.smithi026.stdout:7/320: creat d8/d5c/f75 x:0 0 0 2024-05-09T00:07:39.824 INFO:tasks.workunit.client.1.smithi135.stdout:6/853: link d2/da/d49/f67 d2/d20/d2e/f11d 0 2024-05-09T00:07:39.826 INFO:tasks.workunit.client.0.smithi026.stdout:5/191: creat d2/d8/d36/f3d x:0 0 0 2024-05-09T00:07:39.830 INFO:tasks.workunit.client.1.smithi135.stdout:7/931: rmdir db/d125 39 2024-05-09T00:07:39.833 INFO:tasks.workunit.client.0.smithi026.stdout:6/178: unlink d15/d1e/d23/f25 0 2024-05-09T00:07:39.833 INFO:tasks.workunit.client.0.smithi026.stdout:6/179: fdatasync f11 0 2024-05-09T00:07:39.833 INFO:tasks.workunit.client.0.smithi026.stdout:6/180: chown f12 1829770 1 2024-05-09T00:07:39.836 INFO:tasks.workunit.client.1.smithi135.stdout:3/882: mkdir d8/d13/d1f/d138 0 2024-05-09T00:07:39.840 INFO:tasks.workunit.client.0.smithi026.stdout:1/185: rmdir d5/dd/d17 39 2024-05-09T00:07:39.840 INFO:tasks.workunit.client.1.smithi135.stdout:5/860: mkdir db/d24/db0/dcd/d10e 0 2024-05-09T00:07:39.843 INFO:tasks.workunit.client.0.smithi026.stdout:0/318: symlink d1d/d1e/l67 0 2024-05-09T00:07:39.844 INFO:tasks.workunit.client.0.smithi026.stdout:8/211: sync 2024-05-09T00:07:39.844 INFO:tasks.workunit.client.0.smithi026.stdout:8/212: fdatasync de/f14 0 2024-05-09T00:07:39.847 INFO:tasks.workunit.client.1.smithi135.stdout:5/861: write db/d84/d62/fa1 [3288454,88471] 0 2024-05-09T00:07:39.847 INFO:tasks.workunit.client.1.smithi135.stdout:5/862: truncate db/d5d/fe6 671259 0 2024-05-09T00:07:39.847 INFO:tasks.workunit.client.1.smithi135.stdout:5/863: readlink db/d24/db0/dcd/le8 0 2024-05-09T00:07:39.847 INFO:tasks.workunit.client.1.smithi135.stdout:5/864: truncate db/d84/d62/fed 73403 0 2024-05-09T00:07:39.848 INFO:tasks.workunit.client.0.smithi026.stdout:5/192: dwrite d2/d8/d31/f18 [0,4194304] 0 2024-05-09T00:07:39.848 INFO:tasks.workunit.client.0.smithi026.stdout:3/179: mkdir d5/d1e/d3e 0 2024-05-09T00:07:39.848 INFO:tasks.workunit.client.0.smithi026.stdout:9/205: sync 2024-05-09T00:07:39.848 INFO:tasks.workunit.client.0.smithi026.stdout:4/166: sync 2024-05-09T00:07:39.848 INFO:tasks.workunit.client.0.smithi026.stdout:4/167: chown d0/d19 230 1 2024-05-09T00:07:39.848 INFO:tasks.workunit.client.0.smithi026.stdout:9/206: write d7/d23/f39 [1061729,39880] 0 2024-05-09T00:07:39.849 INFO:tasks.workunit.client.1.smithi135.stdout:9/741: symlink d1/d1a/d2c/leb 0 2024-05-09T00:07:39.849 INFO:tasks.workunit.client.1.smithi135.stdout:9/742: getdents d1/d24/d86/d97 0 2024-05-09T00:07:39.849 INFO:tasks.workunit.client.1.smithi135.stdout:9/743: write d1/d1a/d89/d99/fa5 [1783261,77815] 0 2024-05-09T00:07:39.851 INFO:tasks.workunit.client.0.smithi026.stdout:2/167: rename d14/d15/d20/c24 to d14/d15/d20/d41/c43 0 2024-05-09T00:07:39.852 INFO:tasks.workunit.client.0.smithi026.stdout:2/168: fdatasync d14/d15/f26 0 2024-05-09T00:07:39.852 INFO:tasks.workunit.client.0.smithi026.stdout:2/169: write d14/d15/f26 [697653,108188] 0 2024-05-09T00:07:39.853 INFO:tasks.workunit.client.1.smithi135.stdout:7/932: unlink db/dd/d33/dd3/c12e 0 2024-05-09T00:07:39.853 INFO:tasks.workunit.client.1.smithi135.stdout:8/828: sync 2024-05-09T00:07:39.853 INFO:tasks.workunit.client.1.smithi135.stdout:0/808: sync 2024-05-09T00:07:39.855 INFO:tasks.workunit.client.0.smithi026.stdout:0/319: creat d1d/d1e/d20/f68 x:0 0 0 2024-05-09T00:07:39.857 INFO:tasks.workunit.client.1.smithi135.stdout:0/809: read d3/dd/d3f/f5b [4181528,130783] 0 2024-05-09T00:07:39.857 INFO:tasks.workunit.client.1.smithi135.stdout:0/810: truncate d3/dd/d2d/d4c/fe7 328705 0 2024-05-09T00:07:39.858 INFO:tasks.workunit.client.0.smithi026.stdout:8/213: mkdir de/d17/d21/d24/d3b/d45 0 2024-05-09T00:07:39.862 INFO:tasks.workunit.client.1.smithi135.stdout:2/841: rename d1/d12/d21/dc7/fcf to d1/d12/f11d 0 2024-05-09T00:07:39.862 INFO:tasks.workunit.client.1.smithi135.stdout:2/842: chown d1/d12/d20/d2b/d56/d86/f11b 343302494 1 2024-05-09T00:07:39.864 INFO:tasks.workunit.client.0.smithi026.stdout:6/181: dwrite f10 [0,4194304] 0 2024-05-09T00:07:39.864 INFO:tasks.workunit.client.0.smithi026.stdout:6/182: dread - d15/f29 zero size 2024-05-09T00:07:39.864 INFO:tasks.workunit.client.0.smithi026.stdout:6/183: chown d15/c1a 0 1 2024-05-09T00:07:39.864 INFO:tasks.workunit.client.0.smithi026.stdout:6/184: readlink l0 0 2024-05-09T00:07:39.866 INFO:tasks.workunit.client.0.smithi026.stdout:5/193: symlink d2/d8/d2a/l3e 0 2024-05-09T00:07:39.866 INFO:tasks.workunit.client.0.smithi026.stdout:5/194: read - d2/d8/d36/f3d zero size 2024-05-09T00:07:39.867 INFO:tasks.workunit.client.1.smithi135.stdout:3/883: dwrite d8/d102/d63/d89/fea [4194304,4194304] 0 2024-05-09T00:07:39.869 INFO:tasks.workunit.client.1.smithi135.stdout:7/933: symlink db/dd/l137 0 2024-05-09T00:07:39.871 INFO:tasks.workunit.client.0.smithi026.stdout:4/168: link d0/d19/f2f d0/d19/f39 0 2024-05-09T00:07:39.877 INFO:tasks.workunit.client.1.smithi135.stdout:1/834: rename da/d14/d20/l25 to da/d24/d27/d11f/l125 0 2024-05-09T00:07:39.878 INFO:tasks.workunit.client.0.smithi026.stdout:3/180: dread d5/d9/ff [0,4194304] 0 2024-05-09T00:07:39.880 INFO:tasks.workunit.client.0.smithi026.stdout:9/207: mknod d7/d23/d29/d2e/c4f 0 2024-05-09T00:07:39.884 INFO:tasks.workunit.client.1.smithi135.stdout:5/865: dwrite db/fe [0,4194304] 0 2024-05-09T00:07:39.884 INFO:tasks.workunit.client.1.smithi135.stdout:2/843: dwrite d1/d12/d20/d2b/d7c/db5/f7a [0,4194304] 0 2024-05-09T00:07:39.884 INFO:tasks.workunit.client.1.smithi135.stdout:2/844: write d1/fd [1392605,103832] 0 2024-05-09T00:07:39.888 INFO:tasks.workunit.client.0.smithi026.stdout:2/170: rmdir d14/d15/d1f 39 2024-05-09T00:07:39.889 INFO:tasks.workunit.client.1.smithi135.stdout:3/884: mkdir d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d80/d84/d139 0 2024-05-09T00:07:39.890 INFO:tasks.workunit.client.1.smithi135.stdout:5/866: dread f9 [0,4194304] 0 2024-05-09T00:07:39.891 INFO:tasks.workunit.client.1.smithi135.stdout:7/934: creat db/dd/d33/d68/d10a/d109/f138 x:0 0 0 2024-05-09T00:07:39.896 INFO:tasks.workunit.client.1.smithi135.stdout:7/935: dread db/dd/d33/d58/f8d [0,4194304] 0 2024-05-09T00:07:39.897 INFO:tasks.workunit.client.0.smithi026.stdout:7/321: rename d8/l26 to d8/d2e/d55/d1e/l76 0 2024-05-09T00:07:39.897 INFO:tasks.workunit.client.1.smithi135.stdout:2/845: dread d1/d12/d21/d57/f6c [0,4194304] 0 2024-05-09T00:07:39.897 INFO:tasks.workunit.client.1.smithi135.stdout:2/846: chown d1/d12/f24 113788583 1 2024-05-09T00:07:39.898 INFO:tasks.workunit.client.1.smithi135.stdout:7/936: dread db/dd/d33/f9d [0,4194304] 0 2024-05-09T00:07:39.899 INFO:tasks.workunit.client.1.smithi135.stdout:0/811: link d3/dd/d3f/d3a/da4/dc1/lc8 d3/dd/d3f/d3a/lec 0 2024-05-09T00:07:39.901 INFO:tasks.workunit.client.1.smithi135.stdout:7/937: read db/dd/d33/d58/f8f [2950391,32266] 0 2024-05-09T00:07:39.901 INFO:tasks.workunit.client.1.smithi135.stdout:5/867: dread db/d24/d32/d5b/f88 [0,4194304] 0 2024-05-09T00:07:39.902 INFO:tasks.workunit.client.0.smithi026.stdout:0/320: unlink l1a 0 2024-05-09T00:07:39.906 INFO:tasks.workunit.client.1.smithi135.stdout:1/835: dwrite da/ff1 [0,4194304] 0 2024-05-09T00:07:39.906 INFO:tasks.workunit.client.1.smithi135.stdout:4/731: rename dc/d4a/d69/d39 to dc/d26/df4 0 2024-05-09T00:07:39.907 INFO:tasks.workunit.client.0.smithi026.stdout:3/181: dwrite d5/d9/dc/d28/d2c/d2f/f2d [4194304,4194304] 0 2024-05-09T00:07:39.907 INFO:tasks.workunit.client.0.smithi026.stdout:3/182: write d5/d9/f33 [5178993,19591] 0 2024-05-09T00:07:39.907 INFO:tasks.workunit.client.0.smithi026.stdout:3/183: chown d5/d1e/f20 981031046 1 2024-05-09T00:07:39.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/184: read - d5/f39 zero size 2024-05-09T00:07:39.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/185: read d5/f1f [684924,113643] 0 2024-05-09T00:07:39.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/186: fsync d5/d9/dc/d28/f35 0 2024-05-09T00:07:39.908 INFO:tasks.workunit.client.1.smithi135.stdout:1/836: write da/d14/d20/d38/f8e [2097166,91858] 0 2024-05-09T00:07:39.908 INFO:tasks.workunit.client.0.smithi026.stdout:6/185: symlink d15/d2b/l37 0 2024-05-09T00:07:39.911 INFO:tasks.workunit.client.0.smithi026.stdout:4/169: mknod d0/d12/d1b/c3a 0 2024-05-09T00:07:39.913 INFO:tasks.workunit.client.0.smithi026.stdout:9/208: getdents d7/d23/d29/d31/d40 0 2024-05-09T00:07:39.914 INFO:tasks.workunit.client.0.smithi026.stdout:2/171: mknod d14/d15/d30/c44 0 2024-05-09T00:07:39.917 INFO:tasks.workunit.client.0.smithi026.stdout:8/214: rename l8 to de/d17/d21/d24/d28/l46 0 2024-05-09T00:07:39.919 INFO:tasks.workunit.client.0.smithi026.stdout:0/321: creat d1d/d1e/f69 x:0 0 0 2024-05-09T00:07:39.921 INFO:tasks.workunit.client.1.smithi135.stdout:3/885: creat d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d80/d84/f13a x:0 0 0 2024-05-09T00:07:39.921 INFO:tasks.workunit.client.1.smithi135.stdout:3/886: write d8/d13/d75/f119 [100177,35260] 0 2024-05-09T00:07:39.923 INFO:tasks.workunit.client.0.smithi026.stdout:0/322: dread ff [0,4194304] 0 2024-05-09T00:07:39.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/847: rmdir d1/d12/d21/d41/d6d/d6e 39 2024-05-09T00:07:39.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/848: write d1/d12/d20/d2b/d56/d86/f11b [126026,26921] 0 2024-05-09T00:07:39.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/849: chown d1/d12/d21/f3f 155056343 1 2024-05-09T00:07:39.930 INFO:tasks.workunit.client.1.smithi135.stdout:7/938: mkdir db/dd/d33/d68/d10a/d3a/dfc/d139 0 2024-05-09T00:07:39.931 INFO:tasks.workunit.client.0.smithi026.stdout:3/187: getdents d5/d9/dc/d28/d2c 0 2024-05-09T00:07:39.931 INFO:tasks.workunit.client.0.smithi026.stdout:3/188: getdents d5/d9/dc/d28/d2c 0 2024-05-09T00:07:39.932 INFO:tasks.workunit.client.0.smithi026.stdout:3/189: write d5/d9/ff [1294712,5821] 0 2024-05-09T00:07:39.933 INFO:tasks.workunit.client.1.smithi135.stdout:5/868: creat db/d24/d32/dfa/d9c/d9f/dc0/df0/f10f x:0 0 0 2024-05-09T00:07:39.934 INFO:tasks.workunit.client.0.smithi026.stdout:6/186: symlink d15/d1e/d30/l38 0 2024-05-09T00:07:39.938 INFO:tasks.workunit.client.0.smithi026.stdout:5/195: symlink d2/l3f 0 2024-05-09T00:07:39.942 INFO:tasks.workunit.client.1.smithi135.stdout:3/887: dwrite d8/d6d/d44/d4b/da0/f104 [0,4194304] 0 2024-05-09T00:07:39.943 INFO:tasks.workunit.client.0.smithi026.stdout:9/209: unlink d7/d23/d29/d31/f34 0 2024-05-09T00:07:39.943 INFO:tasks.workunit.client.0.smithi026.stdout:9/210: fdatasync d7/d23/d2f/f45 0 2024-05-09T00:07:39.945 INFO:tasks.workunit.client.1.smithi135.stdout:3/888: read d8/d6d/d44/d4b/da0/daa/dc9/f101 [3984493,88870] 0 2024-05-09T00:07:39.946 INFO:tasks.workunit.client.1.smithi135.stdout:3/889: chown d8/d6d/d44/d4b/dc2/d120/d129/d90/l132 29 1 2024-05-09T00:07:39.949 INFO:tasks.workunit.client.0.smithi026.stdout:4/170: rename d0/l5 to d0/d12/d1b/l3b 0 2024-05-09T00:07:39.951 INFO:tasks.workunit.client.0.smithi026.stdout:3/190: dwrite d5/f22 [0,4194304] 0 2024-05-09T00:07:39.953 INFO:tasks.workunit.client.1.smithi135.stdout:9/744: rename d1/d1a/d10/d3c/d43 to d1/d24/d86/d97/dec 0 2024-05-09T00:07:39.954 INFO:tasks.workunit.client.0.smithi026.stdout:8/215: getdents de/d17/d21/d24/d3b 0 2024-05-09T00:07:39.955 INFO:tasks.workunit.client.0.smithi026.stdout:6/187: dwrite f1 [4194304,4194304] 0 2024-05-09T00:07:39.958 INFO:tasks.workunit.client.1.smithi135.stdout:4/732: creat dc/d26/df4/ff5 x:0 0 0 2024-05-09T00:07:39.959 INFO:tasks.workunit.client.0.smithi026.stdout:5/196: rmdir d2/d8 39 2024-05-09T00:07:39.962 INFO:tasks.workunit.client.1.smithi135.stdout:1/837: stat da/d14/d20/d38/d3a/d40/d96/la9 0 2024-05-09T00:07:39.962 INFO:tasks.workunit.client.1.smithi135.stdout:1/838: write da/d24/d27/d33/d36/fda [63298,83057] 0 2024-05-09T00:07:39.962 INFO:tasks.workunit.client.1.smithi135.stdout:1/839: fsync da/d24/d27/faf 0 2024-05-09T00:07:39.964 INFO:tasks.workunit.client.1.smithi135.stdout:1/840: read da/db/d16/f18 [599396,13344] 0 2024-05-09T00:07:39.968 INFO:tasks.workunit.client.0.smithi026.stdout:9/211: mkdir d7/d23/d2f/d50 0 2024-05-09T00:07:39.970 INFO:tasks.workunit.client.0.smithi026.stdout:2/172: rename cf to d14/d15/d17/c45 0 2024-05-09T00:07:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.975+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ff8100230 con 0x7f4fe8066dc0 2024-05-09T00:07:39.972 INFO:tasks.workunit.client.1.smithi135.stdout:2/850: symlink d1/d12/d21/d41/l11e 0 2024-05-09T00:07:39.973 INFO:tasks.workunit.client.1.smithi135.stdout:5/869: rmdir db/d84 39 2024-05-09T00:07:39.974 INFO:tasks.workunit.client.1.smithi135.stdout:5/870: write db/d84/d31/f90 [1599767,121706] 0 2024-05-09T00:07:39.976 INFO:tasks.workunit.client.0.smithi026.stdout:3/191: mknod d5/d9/dc/d28/d2c/d2f/c3f 0 2024-05-09T00:07:39.978 INFO:tasks.workunit.client.0.smithi026.stdout:8/216: truncate f3 3792783 0 2024-05-09T00:07:39.978 INFO:tasks.workunit.client.0.smithi026.stdout:8/217: write de/d17/d21/f22 [744799,18582] 0 2024-05-09T00:07:39.978 INFO:tasks.workunit.client.0.smithi026.stdout:8/218: chown de/d17/d21/d24/d3b/d3d 15 1 2024-05-09T00:07:39.979 INFO:tasks.workunit.client.1.smithi135.stdout:3/890: dread d8/d102/f86 [0,4194304] 0 2024-05-09T00:07:39.979 INFO:tasks.workunit.client.1.smithi135.stdout:3/891: read - d8/d6d/d44/d4b/d69/f11c zero size 2024-05-09T00:07:39.979 INFO:tasks.workunit.client.1.smithi135.stdout:9/745: dwrite d1/d1a/d10/d3c/d5c/fae [0,4194304] 0 2024-05-09T00:07:39.980 INFO:tasks.workunit.client.1.smithi135.stdout:0/812: rename d3/d9e/c88 to d3/dd/ced 0 2024-05-09T00:07:39.980 INFO:tasks.workunit.client.1.smithi135.stdout:7/939: rename db/dd to db/dd/d33/d68/d10a/d3a/d130/d13a 22 2024-05-09T00:07:39.980 INFO:tasks.workunit.client.1.smithi135.stdout:7/940: chown db/dd/d33/d68/d10a/d3a/d40/d4c/leb 120731 1 2024-05-09T00:07:39.980 INFO:tasks.workunit.client.1.smithi135.stdout:0/813: write d3/dd/d3f/d29/d7c/fa5 [415595,110840] 0 2024-05-09T00:07:39.981 INFO:tasks.workunit.client.0.smithi026.stdout:6/188: mknod d15/d1e/d23/d26/c39 0 2024-05-09T00:07:39.981 INFO:tasks.workunit.client.1.smithi135.stdout:7/941: read db/dd/d33/d68/d10a/d94/f9a [2007221,106174] 0 2024-05-09T00:07:39.982 INFO:tasks.workunit.client.1.smithi135.stdout:4/733: truncate dc/d71/f91 492168 0 2024-05-09T00:07:39.984 INFO:tasks.workunit.client.0.smithi026.stdout:4/171: dwrite d0/d19/f2f [0,4194304] 0 2024-05-09T00:07:39.984 INFO:tasks.workunit.client.0.smithi026.stdout:4/172: fsync d0/d19/f39 0 2024-05-09T00:07:39.984 INFO:tasks.workunit.client.0.smithi026.stdout:4/173: chown d0/d12/d1b/l3b 16 1 2024-05-09T00:07:39.984 INFO:tasks.workunit.client.0.smithi026.stdout:4/174: fdatasync d0/d12/d34/f36 0 2024-05-09T00:07:39.984 INFO:tasks.workunit.client.0.smithi026.stdout:4/175: chown d0/d12/d1b/l3b 1884321672 1 2024-05-09T00:07:39.984 INFO:tasks.workunit.client.0.smithi026.stdout:4/176: readlink d0/lf 0 2024-05-09T00:07:39.985 INFO:tasks.workunit.client.0.smithi026.stdout:5/197: stat d2/c14 0 2024-05-09T00:07:39.986 INFO:tasks.workunit.client.1.smithi135.stdout:2/851: dread d1/d12/d20/d3b/f91 [0,4194304] 0 2024-05-09T00:07:39.986 INFO:tasks.workunit.client.1.smithi135.stdout:1/841: creat da/d24/d27/d33/d7d/f126 x:0 0 0 2024-05-09T00:07:39.986 INFO:tasks.workunit.client.1.smithi135.stdout:4/734: read dc/d71/dba/fdb [3795553,18161] 0 2024-05-09T00:07:39.986 INFO:tasks.workunit.client.1.smithi135.stdout:4/735: rename dc/d4a to dc/d4a/d69/d55/d5f/d5a/dbd/df6 22 2024-05-09T00:07:39.986 INFO:tasks.workunit.client.1.smithi135.stdout:4/736: stat dc/d26/df4/f68 0 2024-05-09T00:07:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.991+0000 7f4ff5ffb700 1 -- 172.21.15.26:0/1329664388 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4ff8100230 con 0x7f4fe8066dc0 2024-05-09T00:07:39.987 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:07:39.987 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (6m) 44s ago 8m 23.8M - 0.23.0 ba2b418f427c e4c5eae7b44c 2024-05-09T00:07:39.987 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (8m) 44s ago 8m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:07:39.987 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (7m) 35s ago 7m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:07:39.987 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (6m) 44s ago 8m 58.1M - 8.3.5 dad864ee21e9 0d0dbb754a90 2024-05-09T00:07:39.987 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (2m) 44s ago 2m 12.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:07:39.987 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (3m) 44s ago 3m 106M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (2m) 35s ago 2m 12.6M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (3m) 35s ago 3m 12.4M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:9283 running (9m) 44s ago 9m 320M - 16.2.15-1-g8963e9de 727f386679cb 405cee21e657 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (60s) 35s ago 7m 479M - 18.2.2-1322-gd21e4f96 af23193ff691 8681491889c9 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (9m) 44s ago 9m 48.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (7m) 35s ago 7m 40.7M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (8m) 44s ago 8m 25.3M - 1.3.1 1dbe0e931976 eb62f1a664c9 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (7m) 35s ago 7m 25.8M - 1.3.1 1dbe0e931976 0ef67083c290 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (7m) 44s ago 7m 82.7M 1911M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (6m) 44s ago 6m 81.8M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (5m) 44s ago 5m 67.7M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (5m) 35s ago 5m 87.4M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (5m) 35s ago 5m 84.2M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (4m) 35s ago 4m 82.1M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:07:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (7m) 35s ago 7m 62.8M - 2.33.4 514e6a882f6e dbc569e4b23d 2024-05-09T00:07:39.989 INFO:tasks.workunit.client.0.smithi026.stdout:9/212: truncate d7/f16 612306 0 2024-05-09T00:07:39.989 INFO:tasks.workunit.client.0.smithi026.stdout:0/323: rename d1d/d1e/d2d/l63 to d1d/d33/l6a 0 2024-05-09T00:07:39.990 INFO:tasks.workunit.client.1.smithi135.stdout:5/871: symlink db/d5d/dac/ddc/l110 0 2024-05-09T00:07:39.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4fe8066dc0 msgr2=0x7f4fe8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:39.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4fe8066dc0 0x7f4fe8069280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4ff80f69e0 tx=0x7f4fe4008040).stop 2024-05-09T00:07:39.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 msgr2=0x7f4ff8069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:39.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 0x7f4ff8069e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f4fec013620 tx=0x7f4fec009cb0).stop 2024-05-09T00:07:39.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 shutdown_connections 2024-05-09T00:07:39.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4fe8066dc0 0x7f4fe8069280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff80f5ab0 0x7f4ff8069e30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 --2- 172.21.15.26:0/1329664388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff80f6450 0x7f4ff806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 >> 172.21.15.26:0/1329664388 conn(0x7f4ff80f15d0 msgr2=0x7f4ff80fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 shutdown_connections 2024-05-09T00:07:39.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:39.995+0000 7f4fff0a8700 1 -- 172.21.15.26:0/1329664388 wait complete. 2024-05-09T00:07:39.991 INFO:tasks.workunit.client.1.smithi135.stdout:3/892: mkdir d8/d6d/d44/d4b/da0/daa/dc9/d13b 0 2024-05-09T00:07:39.992 INFO:tasks.workunit.client.0.smithi026.stdout:2/173: truncate f8 361237 0 2024-05-09T00:07:39.992 INFO:tasks.workunit.client.1.smithi135.stdout:9/746: mkdir d1/d1a/d89/dad/ded 0 2024-05-09T00:07:39.993 INFO:tasks.workunit.client.0.smithi026.stdout:3/192: symlink d5/d1e/d3e/l40 0 2024-05-09T00:07:39.993 INFO:tasks.workunit.client.1.smithi135.stdout:6/854: sync 2024-05-09T00:07:39.994 INFO:tasks.workunit.client.1.smithi135.stdout:6/855: chown d2/da/l28 0 1 2024-05-09T00:07:39.994 INFO:tasks.workunit.client.1.smithi135.stdout:6/856: chown d2/da/d1d/d69/d89/ffb 9077 1 2024-05-09T00:07:39.994 INFO:tasks.workunit.client.1.smithi135.stdout:1/842: fdatasync da/d24/d27/d33/d36/fda 0 2024-05-09T00:07:39.994 INFO:tasks.workunit.client.1.smithi135.stdout:1/843: readlink da/d14/d20/d38/d3a/d40/d75/lb4 0 2024-05-09T00:07:39.994 INFO:tasks.workunit.client.1.smithi135.stdout:4/737: dread dc/d26/d31/d82/fa9 [0,4194304] 0 2024-05-09T00:07:39.994 INFO:tasks.workunit.client.1.smithi135.stdout:7/942: mkdir db/dd/d33/d68/d10a/de6/d13b 0 2024-05-09T00:07:39.995 INFO:tasks.workunit.client.1.smithi135.stdout:6/857: write d2/d20/d37/d4e/f6a [49124,120096] 0 2024-05-09T00:07:39.996 INFO:tasks.workunit.client.0.smithi026.stdout:8/219: creat de/d17/d21/d24/d3b/f47 x:0 0 0 2024-05-09T00:07:39.996 INFO:tasks.workunit.client.0.smithi026.stdout:8/220: truncate de/d17/d21/d24/f2e 388172 0 2024-05-09T00:07:39.998 INFO:tasks.workunit.client.1.smithi135.stdout:6/858: dread d2/d5f/fba [0,4194304] 0 2024-05-09T00:07:39.998 INFO:tasks.workunit.client.1.smithi135.stdout:6/859: write d2/d20/d2e/f11d [5133441,41968] 0 2024-05-09T00:07:39.998 INFO:tasks.workunit.client.1.smithi135.stdout:2/852: symlink d1/d12/d21/l11f 0 2024-05-09T00:07:40.006 INFO:tasks.workunit.client.0.smithi026.stdout:4/177: truncate d0/f22 1480752 0 2024-05-09T00:07:40.006 INFO:tasks.workunit.client.0.smithi026.stdout:4/178: chown d0/d12/f1d 0 1 2024-05-09T00:07:40.008 INFO:tasks.workunit.client.1.smithi135.stdout:3/893: symlink d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d80/l13c 0 2024-05-09T00:07:40.009 INFO:tasks.workunit.client.1.smithi135.stdout:8/829: sync 2024-05-09T00:07:40.009 INFO:tasks.workunit.client.1.smithi135.stdout:4/738: dread dc/d26/df4/f48 [0,4194304] 0 2024-05-09T00:07:40.009 INFO:tasks.workunit.client.1.smithi135.stdout:4/739: readlink dc/dd/lb1 0 2024-05-09T00:07:40.012 INFO:tasks.workunit.client.1.smithi135.stdout:9/747: creat d1/d1a/d2c/d2d/de6/d6e/fee x:0 0 0 2024-05-09T00:07:40.012 INFO:tasks.workunit.client.1.smithi135.stdout:9/748: chown d1/d1a/d2c/d2d/l9b 19826960 1 2024-05-09T00:07:40.012 INFO:tasks.workunit.client.1.smithi135.stdout:7/943: dwrite db/d21/fb1 [0,4194304] 0 2024-05-09T00:07:40.012 INFO:tasks.workunit.client.1.smithi135.stdout:8/830: dread d4/d7/de/f7d [0,4194304] 0 2024-05-09T00:07:40.014 INFO:tasks.workunit.client.0.smithi026.stdout:9/213: unlink d7/d26/f27 0 2024-05-09T00:07:40.017 INFO:tasks.workunit.client.0.smithi026.stdout:6/189: rename d15/d1e/d31 to d15/d1e/d23/d3a 0 2024-05-09T00:07:40.019 INFO:tasks.workunit.client.0.smithi026.stdout:0/324: getdents d1d 0 2024-05-09T00:07:40.020 INFO:tasks.workunit.client.0.smithi026.stdout:0/325: write d1d/d1e/f69 [867153,24460] 0 2024-05-09T00:07:40.021 INFO:tasks.workunit.client.1.smithi135.stdout:4/740: dread dc/d4a/d69/f4c [0,4194304] 0 2024-05-09T00:07:40.022 INFO:tasks.workunit.client.0.smithi026.stdout:2/174: stat d14/d15/d17/c2e 0 2024-05-09T00:07:40.024 INFO:tasks.workunit.client.0.smithi026.stdout:2/175: write d14/d15/f39 [3064483,35337] 0 2024-05-09T00:07:40.024 INFO:tasks.workunit.client.0.smithi026.stdout:2/176: chown d14/d15/d20/f2a 773 1 2024-05-09T00:07:40.025 INFO:tasks.workunit.client.1.smithi135.stdout:4/741: write dc/d26/d31/f6f [513192,104271] 0 2024-05-09T00:07:40.026 INFO:tasks.workunit.client.1.smithi135.stdout:5/872: dwrite db/d5d/dac/fa4 [0,4194304] 0 2024-05-09T00:07:40.026 INFO:tasks.workunit.client.1.smithi135.stdout:5/873: chown db/d5d/c67 2576 1 2024-05-09T00:07:40.026 INFO:tasks.workunit.client.0.smithi026.stdout:4/179: creat d0/d12/d1b/f3c x:0 0 0 2024-05-09T00:07:40.026 INFO:tasks.workunit.client.0.smithi026.stdout:4/180: write d0/d12/d1b/d2b/f35 [349350,33590] 0 2024-05-09T00:07:40.026 INFO:tasks.workunit.client.0.smithi026.stdout:8/221: dwrite de/d17/d21/d24/f2e [0,4194304] 0 2024-05-09T00:07:40.027 INFO:tasks.workunit.client.0.smithi026.stdout:8/222: write f7 [1646437,3318] 0 2024-05-09T00:07:40.027 INFO:tasks.workunit.client.1.smithi135.stdout:8/831: dread d4/d7/d2a/d56/f61 [0,4194304] 0 2024-05-09T00:07:40.027 INFO:tasks.workunit.client.1.smithi135.stdout:1/844: creat da/db/d107/f127 x:0 0 0 2024-05-09T00:07:40.027 INFO:tasks.workunit.client.1.smithi135.stdout:1/845: readlink da/d14/d20/d2c/l7a 0 2024-05-09T00:07:40.028 INFO:tasks.workunit.client.0.smithi026.stdout:5/198: fdatasync d2/d8/d31/f12 0 2024-05-09T00:07:40.033 INFO:tasks.workunit.client.0.smithi026.stdout:8/223: fsync f9 0 2024-05-09T00:07:40.033 INFO:tasks.workunit.client.0.smithi026.stdout:8/224: chown de/d17/d21/d24/d3b/f47 118948 1 2024-05-09T00:07:40.034 INFO:tasks.workunit.client.0.smithi026.stdout:4/181: dread d0/fc [0,4194304] 0 2024-05-09T00:07:40.034 INFO:tasks.workunit.client.0.smithi026.stdout:4/182: write d0/d12/d1b/f26 [36688,2507] 0 2024-05-09T00:07:40.034 INFO:tasks.workunit.client.1.smithi135.stdout:6/860: mkdir d2/da/d1d/d86/d11e 0 2024-05-09T00:07:40.037 INFO:tasks.workunit.client.0.smithi026.stdout:9/214: write f3 [215165,22405] 0 2024-05-09T00:07:40.037 INFO:tasks.workunit.client.0.smithi026.stdout:9/215: chown d7/d23/d29/d31/f32 1293470 1 2024-05-09T00:07:40.037 INFO:tasks.workunit.client.0.smithi026.stdout:9/216: write d7/d23/d2f/f45 [960491,91712] 0 2024-05-09T00:07:40.038 INFO:tasks.workunit.client.0.smithi026.stdout:2/177: write f8 [833898,120375] 0 2024-05-09T00:07:40.038 INFO:tasks.workunit.client.1.smithi135.stdout:2/853: symlink d1/d12/d21/d11a/l120 0 2024-05-09T00:07:40.038 INFO:tasks.workunit.client.1.smithi135.stdout:1/846: dread da/d14/d20/f97 [0,4194304] 0 2024-05-09T00:07:40.038 INFO:tasks.workunit.client.1.smithi135.stdout:1/847: truncate da/db/f2a 2302582 0 2024-05-09T00:07:40.038 INFO:tasks.workunit.client.1.smithi135.stdout:1/848: truncate da/d24/d27/d33/d7d/ffe 827932 0 2024-05-09T00:07:40.039 INFO:tasks.workunit.client.0.smithi026.stdout:0/326: symlink d1d/d33/d64/l6b 0 2024-05-09T00:07:40.039 INFO:tasks.workunit.client.0.smithi026.stdout:0/327: truncate d1d/d25/d3c/f46 739716 0 2024-05-09T00:07:40.039 INFO:tasks.workunit.client.0.smithi026.stdout:0/328: chown d1d/d25/d3c/f46 28130761 1 2024-05-09T00:07:40.039 INFO:tasks.workunit.client.0.smithi026.stdout:0/329: write d1d/d1e/d20/f68 [717537,90125] 0 2024-05-09T00:07:40.040 INFO:tasks.workunit.client.1.smithi135.stdout:3/894: link d8/f14 d8/d6d/d24/d106/d12b/f13d 0 2024-05-09T00:07:40.043 INFO:tasks.workunit.client.1.smithi135.stdout:9/749: rename d1/d24/d86/fa0 to d1/d1a/d2c/d2d/fef 0 2024-05-09T00:07:40.044 INFO:tasks.workunit.client.1.smithi135.stdout:3/895: write d8/d102/d63/d89/fea [11774071,95631] 0 2024-05-09T00:07:40.044 INFO:tasks.workunit.client.1.smithi135.stdout:9/750: read d1/d1a/d10/fa7 [1505627,3214] 0 2024-05-09T00:07:40.048 INFO:tasks.workunit.client.0.smithi026.stdout:5/199: unlink d2/l3f 0 2024-05-09T00:07:40.050 INFO:tasks.workunit.client.0.smithi026.stdout:8/225: dread de/f23 [0,4194304] 0 2024-05-09T00:07:40.050 INFO:tasks.workunit.client.0.smithi026.stdout:0/330: dread f11 [0,4194304] 0 2024-05-09T00:07:40.053 INFO:tasks.workunit.client.1.smithi135.stdout:4/742: mknod dc/d4a/d69/d55/d6d/dec/cf7 0 2024-05-09T00:07:40.053 INFO:tasks.workunit.client.1.smithi135.stdout:5/874: truncate db/d24/fb5 155445 0 2024-05-09T00:07:40.055 INFO:tasks.workunit.client.1.smithi135.stdout:1/849: dwrite da/d14/d5c/f8f [0,4194304] 0 2024-05-09T00:07:40.058 INFO:tasks.workunit.client.0.smithi026.stdout:4/183: unlink d0/c28 0 2024-05-09T00:07:40.061 INFO:tasks.workunit.client.1.smithi135.stdout:3/896: dwrite d8/d13/d1f/d40/fcd [0,4194304] 0 2024-05-09T00:07:40.064 INFO:tasks.workunit.client.1.smithi135.stdout:8/832: creat d4/d22/d8b/d10a/f119 x:0 0 0 2024-05-09T00:07:40.066 INFO:tasks.workunit.client.1.smithi135.stdout:5/875: dread db/d84/d31/d5e/f55 [0,4194304] 0 2024-05-09T00:07:40.067 INFO:tasks.workunit.client.1.smithi135.stdout:5/876: write db/d84/d31/f3d [873418,23253] 0 2024-05-09T00:07:40.067 INFO:tasks.workunit.client.1.smithi135.stdout:5/877: chown db/d84/d31/d5e/ddf/lf9 8865 1 2024-05-09T00:07:40.068 INFO:tasks.workunit.client.1.smithi135.stdout:6/861: mknod d2/da/d26/d57/d59/c11f 0 2024-05-09T00:07:40.070 INFO:tasks.workunit.client.1.smithi135.stdout:8/833: write d4/d8/da2/da6/db8/f106 [819323,64731] 0 2024-05-09T00:07:40.070 INFO:tasks.workunit.client.1.smithi135.stdout:8/834: chown d4/d7/l3f 18414 1 2024-05-09T00:07:40.074 INFO:tasks.workunit.client.0.smithi026.stdout:3/193: rename d5/d9/dc/d28/d2c/d2f to d5/d41 0 2024-05-09T00:07:40.074 INFO:tasks.workunit.client.0.smithi026.stdout:6/190: rename d15/d2b to d15/d2b/d3b 22 2024-05-09T00:07:40.075 INFO:tasks.workunit.client.1.smithi135.stdout:2/854: symlink d1/d12/d20/d3b/d40/l121 0 2024-05-09T00:07:40.075 INFO:tasks.workunit.client.1.smithi135.stdout:2/855: chown d1/fdf 30987 1 2024-05-09T00:07:40.075 INFO:tasks.workunit.client.1.smithi135.stdout:2/856: stat d1/d12/d20/d2b/f55 0 2024-05-09T00:07:40.076 INFO:tasks.workunit.client.0.smithi026.stdout:4/184: dread d0/d19/f2f [0,4194304] 0 2024-05-09T00:07:40.079 INFO:tasks.workunit.client.0.smithi026.stdout:0/331: dwrite d1d/d1e/d2d/f3b [0,4194304] 0 2024-05-09T00:07:40.082 INFO:tasks.workunit.client.1.smithi135.stdout:4/743: dwrite dc/d26/d31/f99 [0,4194304] 0 2024-05-09T00:07:40.089 INFO:tasks.workunit.client.0.smithi026.stdout:9/217: getdents d7/d23 0 2024-05-09T00:07:40.091 INFO:tasks.workunit.client.0.smithi026.stdout:3/194: dwrite d5/d9/f33 [0,4194304] 0 2024-05-09T00:07:40.091 INFO:tasks.workunit.client.1.smithi135.stdout:4/744: dread dc/d4a/f58 [0,4194304] 0 2024-05-09T00:07:40.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/191: dread d15/d1e/d23/d26/f28 [0,4194304] 0 2024-05-09T00:07:40.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/192: fsync d15/d1e/d23/d26/f27 0 2024-05-09T00:07:40.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/193: fsync f10 0 2024-05-09T00:07:40.093 INFO:tasks.workunit.client.0.smithi026.stdout:9/218: write d7/d23/d2f/d3a/f44 [4519438,56936] 0 2024-05-09T00:07:40.093 INFO:tasks.workunit.client.1.smithi135.stdout:9/751: symlink d1/d1a/d10/db3/lf0 0 2024-05-09T00:07:40.093 INFO:tasks.workunit.client.1.smithi135.stdout:9/752: readlink d1/d1a/d89/d99/ldc 0 2024-05-09T00:07:40.094 INFO:tasks.workunit.client.1.smithi135.stdout:9/753: write d1/d1a/d10/d3c/d5c/fab [6801692,98760] 0 2024-05-09T00:07:40.095 INFO:tasks.workunit.client.1.smithi135.stdout:3/897: symlink d8/d6d/d44/d4b/d69/l13e 0 2024-05-09T00:07:40.095 INFO:tasks.workunit.client.1.smithi135.stdout:3/898: fdatasync d8/d6d/d44/d4b/d69/fca 0 2024-05-09T00:07:40.095 INFO:tasks.workunit.client.1.smithi135.stdout:3/899: fdatasync d8/d13/f19 0 2024-05-09T00:07:40.095 INFO:tasks.workunit.client.1.smithi135.stdout:3/900: stat d8/d6d/d44/f12e 0 2024-05-09T00:07:40.095 INFO:tasks.workunit.client.1.smithi135.stdout:3/901: write d8/d6d/d44/d4b/dc2/d120/d129/deb/ffa [537272,78415] 0 2024-05-09T00:07:40.097 INFO:tasks.workunit.client.0.smithi026.stdout:2/178: rename d14/d22/l31 to d14/d15/d3b/l46 0 2024-05-09T00:07:40.099 INFO:tasks.workunit.client.1.smithi135.stdout:5/878: getdents db/d84/d31/d5e 0 2024-05-09T00:07:40.099 INFO:tasks.workunit.client.1.smithi135.stdout:5/879: truncate db/d24/d32/d5b/d91/ffb 147525 0 2024-05-09T00:07:40.101 INFO:tasks.workunit.client.1.smithi135.stdout:8/835: dwrite d4/f58 [0,4194304] 0 2024-05-09T00:07:40.103 INFO:tasks.workunit.client.1.smithi135.stdout:2/857: mknod d1/d12/d20/d2b/d56/c122 0 2024-05-09T00:07:40.103 INFO:tasks.workunit.client.1.smithi135.stdout:2/858: chown d1/d22/f111 10254536 1 2024-05-09T00:07:40.107 INFO:tasks.workunit.client.1.smithi135.stdout:9/754: dwrite d1/d24/d86/d97/dec/fb6 [0,4194304] 0 2024-05-09T00:07:40.125 INFO:tasks.workunit.client.0.smithi026.stdout:0/332: creat d1d/d1e/d20/d51/f6c x:0 0 0 2024-05-09T00:07:40.127 INFO:tasks.workunit.client.0.smithi026.stdout:6/194: creat d15/d1e/d23/d26/f3c x:0 0 0 2024-05-09T00:07:40.128 INFO:tasks.workunit.client.0.smithi026.stdout:6/195: stat d15/f18 0 2024-05-09T00:07:40.128 INFO:tasks.workunit.client.1.smithi135.stdout:4/745: rmdir dc/d4a/d69/d55/d6d 39 2024-05-09T00:07:40.129 INFO:tasks.workunit.client.0.smithi026.stdout:9/219: mknod d7/d23/d2f/d3a/c51 0 2024-05-09T00:07:40.133 INFO:tasks.workunit.client.0.smithi026.stdout:5/200: mknod d2/c40 0 2024-05-09T00:07:40.135 INFO:tasks.workunit.client.1.smithi135.stdout:3/902: rename d8/d6d/d44/d4b/da0/daa/dc9 to d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d13f 0 2024-05-09T00:07:40.136 INFO:tasks.workunit.client.1.smithi135.stdout:3/903: write d8/d6d/d44/d4b/da0/daa/d88/f115 [4795841,38437] 0 2024-05-09T00:07:40.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.141+0000 7fa1b8694700 1 -- 172.21.15.26:0/3810412924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 msgr2=0x7fa1b00ff0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:40.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.141+0000 7fa1b8694700 1 --2- 172.21.15.26:0/3810412924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 0x7fa1b00ff0d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa1a0004820 tx=0x7fa1a0009cb0).stop 2024-05-09T00:07:40.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.141+0000 7fa1b8694700 1 -- 172.21.15.26:0/3810412924 shutdown_connections 2024-05-09T00:07:40.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.141+0000 7fa1b8694700 1 --2- 172.21.15.26:0/3810412924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 0x7fa1b00ff0d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:40.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.141+0000 7fa1b8694700 1 --2- 172.21.15.26:0/3810412924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1b00f7da0 0x7fa1b00f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:07:40.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.141+0000 7fa1b8694700 1 -- 172.21.15.26:0/3810412924 >> 172.21.15.26:0/3810412924 conn(0x7fa1b00f15d0 msgr2=0x7fa1b00f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:40.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.141+0000 7fa1b8694700 1 -- 172.21.15.26:0/3810412924 shutdown_connections 2024-05-09T00:07:40.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.141+0000 7fa1b8694700 1 -- 172.21.15.26:0/3810412924 wait complete. 2024-05-09T00:07:40.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.142+0000 7fa1b8694700 1 Processor -- start 2024-05-09T00:07:40.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.142+0000 7fa1b8694700 1 -- start start 2024-05-09T00:07:40.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.143+0000 7fa1b8694700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1b00f7da0 0x7fa1b0105da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:40.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.143+0000 7fa1b8694700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 0x7fa1b0106290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:40.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.143+0000 7fa1b8694700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01068d0 con 0x7fa1b00f86b0 2024-05-09T00:07:40.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.143+0000 7fa1b8694700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0106a10 con 0x7fa1b00f7da0 2024-05-09T00:07:40.138 INFO:tasks.workunit.client.0.smithi026.stdout:8/226: rename de/d17/d21/d24/d28/d31/d33 to de/d48 0 2024-05-09T00:07:40.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.143+0000 7fa1b5c2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 0x7fa1b0106290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:40.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.143+0000 7fa1b5c2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 0x7fa1b0106290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56714/0 (socket says 172.21.15.26:56714) 2024-05-09T00:07:40.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.143+0000 7fa1b5c2f700 1 -- 172.21.15.26:0/4012192433 learned_addr learned my addr 172.21.15.26:0/4012192433 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:40.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.143+0000 7fa1b6430700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1b00f7da0 0x7fa1b0105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:40.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1b5c2f700 1 -- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1b00f7da0 msgr2=0x7fa1b0105da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:40.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1b5c2f700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1b00f7da0 0x7fa1b0105da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:40.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1b5c2f700 1 -- 172.21.15.26:0/4012192433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0005040 con 0x7fa1b00f86b0 2024-05-09T00:07:40.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1b5c2f700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 0x7fa1b0106290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fa1a0004f00 tx=0x7fa1a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:40.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1a77fe700 1 -- 172.21.15.26:0/4012192433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1a000e030 con 0x7fa1b00f86b0 2024-05-09T00:07:40.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1a77fe700 1 -- 172.21.15.26:0/4012192433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa1a0007e90 con 0x7fa1b00f86b0 2024-05-09T00:07:40.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b0109440 con 0x7fa1b00f86b0 2024-05-09T00:07:40.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1a77fe700 1 -- 172.21.15.26:0/4012192433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1a0018070 con 0x7fa1b00f86b0 2024-05-09T00:07:40.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.144+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b0109920 con 0x7fa1b00f86b0 2024-05-09T00:07:40.141 INFO:tasks.workunit.client.0.smithi026.stdout:2/179: mkdir d14/d15/d3b/d40/d47 0 2024-05-09T00:07:40.141 INFO:tasks.workunit.client.1.smithi135.stdout:5/880: truncate db/d24/f2d 4776027 0 2024-05-09T00:07:40.141 INFO:tasks.workunit.client.1.smithi135.stdout:6/862: symlink d2/d20/d3f/l120 0 2024-05-09T00:07:40.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.145+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b0102250 con 0x7fa1b00f86b0 2024-05-09T00:07:40.141 INFO:tasks.workunit.client.0.smithi026.stdout:0/333: mknod d1d/c6d 0 2024-05-09T00:07:40.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.147+0000 7fa1a77fe700 1 -- 172.21.15.26:0/4012192433 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fa1a0012710 con 0x7fa1b00f86b0 2024-05-09T00:07:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.148+0000 7fa1a77fe700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa19c066d50 0x7fa19c069210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.148+0000 7fa1a77fe700 1 -- 172.21.15.26:0/4012192433 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fa1a0085910 con 0x7fa1b00f86b0 2024-05-09T00:07:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.148+0000 7fa1b6430700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa19c066d50 0x7fa19c069210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:40.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.148+0000 7fa1b6430700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa19c066d50 0x7fa19c069210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa1ac00b910 tx=0x7fa1ac008040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:40.146 INFO:tasks.workunit.client.1.smithi135.stdout:4/746: dwrite dc/d26/d31/f6f [0,4194304] 0 2024-05-09T00:07:40.146 INFO:tasks.workunit.client.1.smithi135.stdout:8/836: mkdir d4/d8/da2/dab/d11a 0 2024-05-09T00:07:40.146 INFO:tasks.workunit.client.0.smithi026.stdout:6/196: mkdir d15/d1e/d3d 0 2024-05-09T00:07:40.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.154+0000 7fa1a77fe700 1 -- 172.21.15.26:0/4012192433 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7fa1a00539d0 con 0x7fa1b00f86b0 2024-05-09T00:07:40.149 INFO:tasks.workunit.client.0.smithi026.stdout:9/220: link d7/d23/d2f/f45 d7/d23/d29/d31/d40/d41/f52 0 2024-05-09T00:07:40.149 INFO:tasks.workunit.client.0.smithi026.stdout:9/221: chown d7/l15 767 1 2024-05-09T00:07:40.150 INFO:tasks.workunit.client.0.smithi026.stdout:5/201: chown d2/c1d 179674144 1 2024-05-09T00:07:40.151 INFO:tasks.workunit.client.0.smithi026.stdout:5/202: write d2/d8/d36/f3d [426140,105778] 0 2024-05-09T00:07:40.151 INFO:tasks.workunit.client.1.smithi135.stdout:2/859: creat d1/d12/d20/d2b/d7c/db5/dfd/f123 x:0 0 0 2024-05-09T00:07:40.153 INFO:tasks.workunit.client.1.smithi135.stdout:2/860: write d1/d12/d20/d3b/f5f [296011,83894] 0 2024-05-09T00:07:40.153 INFO:tasks.workunit.client.0.smithi026.stdout:4/185: rename d0/c31 to d0/d12/d1b/c3d 0 2024-05-09T00:07:40.154 INFO:tasks.workunit.client.0.smithi026.stdout:2/180: mknod d14/d15/d3b/d40/d47/c48 0 2024-05-09T00:07:40.155 INFO:tasks.workunit.client.0.smithi026.stdout:2/181: write d14/d15/d1f/f28 [1677180,108451] 0 2024-05-09T00:07:40.156 INFO:tasks.workunit.client.0.smithi026.stdout:0/334: mkdir d1d/d25/d47/d6e 0 2024-05-09T00:07:40.157 INFO:tasks.workunit.client.1.smithi135.stdout:5/881: dread db/d5d/fa3 [0,4194304] 0 2024-05-09T00:07:40.157 INFO:tasks.workunit.client.0.smithi026.stdout:2/182: dread d14/d15/d20/f36 [0,4194304] 0 2024-05-09T00:07:40.158 INFO:tasks.workunit.client.1.smithi135.stdout:3/904: mkdir d8/d13/d75/d140 0 2024-05-09T00:07:40.158 INFO:tasks.workunit.client.1.smithi135.stdout:5/882: dread db/d24/f2c [0,4194304] 0 2024-05-09T00:07:40.158 INFO:tasks.workunit.client.1.smithi135.stdout:0/814: sync 2024-05-09T00:07:40.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/197: creat d15/d2b/f3e x:0 0 0 2024-05-09T00:07:40.160 INFO:tasks.workunit.client.1.smithi135.stdout:6/863: creat d2/da/d49/da4/dce/dd8/f121 x:0 0 0 2024-05-09T00:07:40.160 INFO:tasks.workunit.client.1.smithi135.stdout:6/864: fsync d2/da/d26/d57/d59/d62/fe4 0 2024-05-09T00:07:40.163 INFO:tasks.workunit.client.1.smithi135.stdout:4/747: link dc/dd/f22 dc/d26/ff8 0 2024-05-09T00:07:40.163 INFO:tasks.workunit.client.1.smithi135.stdout:2/861: dread d1/d12/d20/d3b/d105/f10e [0,4194304] 0 2024-05-09T00:07:40.164 INFO:tasks.workunit.client.0.smithi026.stdout:9/222: mknod d7/d23/d2f/d50/c53 0 2024-05-09T00:07:40.166 INFO:tasks.workunit.client.1.smithi135.stdout:8/837: mkdir d4/d7/d2a/d56/dec/dfe/d113/d11b 0 2024-05-09T00:07:40.169 INFO:tasks.workunit.client.0.smithi026.stdout:5/203: creat d2/f41 x:0 0 0 2024-05-09T00:07:40.172 INFO:tasks.workunit.client.0.smithi026.stdout:4/186: rmdir d0/d12/d34 39 2024-05-09T00:07:40.172 INFO:tasks.workunit.client.0.smithi026.stdout:4/187: truncate d0/d12/d1b/f3c 451643 0 2024-05-09T00:07:40.172 INFO:tasks.workunit.client.0.smithi026.stdout:4/188: stat d0/d12/d1b/c2a 0 2024-05-09T00:07:40.172 INFO:tasks.workunit.client.0.smithi026.stdout:4/189: fdatasync d0/d12/f13 0 2024-05-09T00:07:40.175 INFO:tasks.workunit.client.0.smithi026.stdout:3/195: rename d5/d1e/f1c to d5/d9/f42 0 2024-05-09T00:07:40.177 INFO:tasks.workunit.client.0.smithi026.stdout:0/335: creat d1d/d1e/d20/d4d/f6f x:0 0 0 2024-05-09T00:07:40.179 INFO:tasks.workunit.client.0.smithi026.stdout:2/183: symlink d14/d15/d3b/l49 0 2024-05-09T00:07:40.180 INFO:tasks.workunit.client.0.smithi026.stdout:9/223: dwrite d7/f19 [4194304,4194304] 0 2024-05-09T00:07:40.180 INFO:tasks.workunit.client.0.smithi026.stdout:9/224: chown d7/c1e 16203510 1 2024-05-09T00:07:40.181 INFO:tasks.workunit.client.1.smithi135.stdout:3/905: creat d8/d13/d75/de1/f141 x:0 0 0 2024-05-09T00:07:40.181 INFO:tasks.workunit.client.1.smithi135.stdout:3/906: chown d8/d6d/d24/fb7 0 1 2024-05-09T00:07:40.182 INFO:tasks.workunit.client.0.smithi026.stdout:1/186: sync 2024-05-09T00:07:40.183 INFO:tasks.workunit.client.1.smithi135.stdout:5/883: mknod db/d24/d32/dfa/dbe/c111 0 2024-05-09T00:07:40.185 INFO:tasks.workunit.client.1.smithi135.stdout:0/815: mkdir d3/dd/d2d/d4c/dee 0 2024-05-09T00:07:40.188 INFO:tasks.workunit.client.1.smithi135.stdout:6/865: creat d2/da/d26/d57/ddc/dd7/f122 x:0 0 0 2024-05-09T00:07:40.189 INFO:tasks.workunit.client.1.smithi135.stdout:7/944: sync 2024-05-09T00:07:40.189 INFO:tasks.workunit.client.1.smithi135.stdout:1/850: sync 2024-05-09T00:07:40.190 INFO:tasks.workunit.client.0.smithi026.stdout:4/190: link d0/d19/c29 d0/d12/d1b/c3e 0 2024-05-09T00:07:40.190 INFO:tasks.workunit.client.0.smithi026.stdout:7/322: sync 2024-05-09T00:07:40.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/945: write db/d21/f8b [1607491,67070] 0 2024-05-09T00:07:40.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/946: chown db/dd/l49 1030 1 2024-05-09T00:07:40.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/947: write db/dd/d33/d68/d10a/fe7 [515438,105676] 0 2024-05-09T00:07:40.191 INFO:tasks.workunit.client.0.smithi026.stdout:5/204: dread d2/f3 [0,4194304] 0 2024-05-09T00:07:40.192 INFO:tasks.workunit.client.1.smithi135.stdout:5/884: dread db/d3f/f57 [0,4194304] 0 2024-05-09T00:07:40.193 INFO:tasks.workunit.client.1.smithi135.stdout:0/816: write d3/dd/d3f/d29/f47 [37434,18838] 0 2024-05-09T00:07:40.193 INFO:tasks.workunit.client.1.smithi135.stdout:0/817: truncate d3/dd/d3f/d29/f9c 5258333 0 2024-05-09T00:07:40.193 INFO:tasks.workunit.client.1.smithi135.stdout:0/818: fdatasync d3/dd/d3f/d43/f53 0 2024-05-09T00:07:40.193 INFO:tasks.workunit.client.1.smithi135.stdout:0/819: readlink d3/l2b 0 2024-05-09T00:07:40.193 INFO:tasks.workunit.client.1.smithi135.stdout:0/820: fsync d3/dd/d3f/f21 0 2024-05-09T00:07:40.193 INFO:tasks.workunit.client.1.smithi135.stdout:2/862: link d1/d12/f11d d1/d12/d21/dc7/f124 0 2024-05-09T00:07:40.195 INFO:tasks.workunit.client.1.smithi135.stdout:5/885: dread f9 [0,4194304] 0 2024-05-09T00:07:40.195 INFO:tasks.workunit.client.0.smithi026.stdout:3/196: creat d5/d41/f43 x:0 0 0 2024-05-09T00:07:40.195 INFO:tasks.workunit.client.0.smithi026.stdout:7/323: dread d8/d2e/d55/d22/f31 [0,4194304] 0 2024-05-09T00:07:40.197 INFO:tasks.workunit.client.0.smithi026.stdout:0/336: creat d1d/d25/d3c/f70 x:0 0 0 2024-05-09T00:07:40.201 INFO:tasks.workunit.client.1.smithi135.stdout:8/838: mkdir d4/d7/d2a/d56/dec/d11c 0 2024-05-09T00:07:40.201 INFO:tasks.workunit.client.1.smithi135.stdout:8/839: chown d4/d8/da2/da6/db8/dd1/cd2 267650558 1 2024-05-09T00:07:40.201 INFO:tasks.workunit.client.1.smithi135.stdout:8/840: truncate d4/d7/d4a/ff6 391039 0 2024-05-09T00:07:40.201 INFO:tasks.workunit.client.1.smithi135.stdout:8/841: write d4/d7/da4/fed [1230454,82792] 0 2024-05-09T00:07:40.202 INFO:tasks.workunit.client.1.smithi135.stdout:8/842: write d4/d7/d2a/d9f/f112 [164673,95383] 0 2024-05-09T00:07:40.202 INFO:tasks.workunit.client.1.smithi135.stdout:8/843: stat d4/d7/d33/d39/f70 0 2024-05-09T00:07:40.203 INFO:tasks.workunit.client.1.smithi135.stdout:3/907: mknod d8/d6d/d44/d4b/dc2/d120/d129/d90/c142 0 2024-05-09T00:07:40.203 INFO:tasks.workunit.client.1.smithi135.stdout:3/908: truncate d8/d6d/d24/d106/f117 653023 0 2024-05-09T00:07:40.206 INFO:tasks.workunit.client.1.smithi135.stdout:6/866: mknod d2/da/d26/d57/ddc/dd7/c123 0 2024-05-09T00:07:40.208 INFO:tasks.workunit.client.0.smithi026.stdout:9/225: mkdir d7/d23/d29/d31/d40/d41/d54 0 2024-05-09T00:07:40.211 INFO:tasks.workunit.client.1.smithi135.stdout:3/909: dread d8/fe [0,4194304] 0 2024-05-09T00:07:40.213 INFO:tasks.workunit.client.0.smithi026.stdout:1/187: rename d5/dd/c14 to d5/db/c38 0 2024-05-09T00:07:40.213 INFO:tasks.workunit.client.0.smithi026.stdout:1/188: truncate d5/f2d 52224 0 2024-05-09T00:07:40.215 INFO:tasks.workunit.client.0.smithi026.stdout:4/191: creat d0/d12/d1b/d2b/f3f x:0 0 0 2024-05-09T00:07:40.215 INFO:tasks.workunit.client.0.smithi026.stdout:4/192: truncate d0/d12/f13 837877 0 2024-05-09T00:07:40.215 INFO:tasks.workunit.client.1.smithi135.stdout:9/755: sync 2024-05-09T00:07:40.217 INFO:tasks.workunit.client.1.smithi135.stdout:7/948: link db/dd/d33/d68/d10a/d3a/d40/d4c/f10c db/dd/d33/d68/d10a/d3a/d40/d135/f13c 0 2024-05-09T00:07:40.217 INFO:tasks.workunit.client.0.smithi026.stdout:5/205: truncate d2/fc 4624971 0 2024-05-09T00:07:40.217 INFO:tasks.workunit.client.0.smithi026.stdout:5/206: truncate d2/d8/d31/f12 4269434 0 2024-05-09T00:07:40.217 INFO:tasks.workunit.client.0.smithi026.stdout:5/207: fdatasync d2/d8/d2a/f2c 0 2024-05-09T00:07:40.218 INFO:tasks.workunit.client.1.smithi135.stdout:1/851: dread da/f13 [4194304,4194304] 0 2024-05-09T00:07:40.218 INFO:tasks.workunit.client.1.smithi135.stdout:5/886: mkdir db/d24/d32/d112 0 2024-05-09T00:07:40.221 INFO:tasks.workunit.client.1.smithi135.stdout:4/748: dread dc/d26/d4e/fa2 [0,4194304] 0 2024-05-09T00:07:40.222 INFO:tasks.workunit.client.0.smithi026.stdout:0/337: mknod d1d/d1e/d2d/c71 0 2024-05-09T00:07:40.222 INFO:tasks.workunit.client.0.smithi026.stdout:0/338: fsync d1d/d1e/d20/d51/f5c 0 2024-05-09T00:07:40.222 INFO:tasks.workunit.client.0.smithi026.stdout:2/184: link d14/f18 d14/d15/d1f/f4a 0 2024-05-09T00:07:40.222 INFO:tasks.workunit.client.0.smithi026.stdout:2/185: write d14/d15/d17/f34 [360926,86691] 0 2024-05-09T00:07:40.223 INFO:tasks.workunit.client.0.smithi026.stdout:0/339: write d1d/d33/f38 [719715,61968] 0 2024-05-09T00:07:40.223 INFO:tasks.workunit.client.0.smithi026.stdout:0/340: readlink l13 0 2024-05-09T00:07:40.223 INFO:tasks.workunit.client.0.smithi026.stdout:5/208: write d2/d8/d2a/f2c [2409593,45928] 0 2024-05-09T00:07:40.224 INFO:tasks.workunit.client.1.smithi135.stdout:8/844: link d4/d7/d33/d39/c7b d4/d7/d2a/d9f/de1/c11d 0 2024-05-09T00:07:40.224 INFO:tasks.workunit.client.1.smithi135.stdout:0/821: dwrite d3/dd/d3f/d43/da3/fd7 [0,4194304] 0 2024-05-09T00:07:40.224 INFO:tasks.workunit.client.1.smithi135.stdout:0/822: write d3/dd/d3f/d58/dae/dd3/fdb [455720,23221] 0 2024-05-09T00:07:40.224 INFO:tasks.workunit.client.1.smithi135.stdout:2/863: dwrite d1/d12/d20/d3b/f7e [0,4194304] 0 2024-05-09T00:07:40.225 INFO:tasks.workunit.client.0.smithi026.stdout:9/226: creat d7/d23/d2f/d3a/f55 x:0 0 0 2024-05-09T00:07:40.225 INFO:tasks.workunit.client.0.smithi026.stdout:9/227: fsync d7/d23/d2f/f45 0 2024-05-09T00:07:40.226 INFO:tasks.workunit.client.0.smithi026.stdout:3/197: dwrite d5/d41/f2d [0,4194304] 0 2024-05-09T00:07:40.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/867: symlink d2/d20/d3f/d4f/ddb/l124 0 2024-05-09T00:07:40.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/868: readlink d2/d1a/lc1 0 2024-05-09T00:07:40.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/869: chown d2/da/d1d/d69/d78/f84 494296 1 2024-05-09T00:07:40.227 INFO:tasks.workunit.client.1.smithi135.stdout:0/823: dread d3/dd/d3f/d29/d7c/fa5 [0,4194304] 0 2024-05-09T00:07:40.228 INFO:tasks.workunit.client.0.smithi026.stdout:7/324: rename d8/d5c/c62 to d8/d1b/c77 0 2024-05-09T00:07:40.228 INFO:tasks.workunit.client.0.smithi026.stdout:2/186: rename d14/d15 to d14/d15/d20/d4b 22 2024-05-09T00:07:40.228 INFO:tasks.workunit.client.0.smithi026.stdout:2/187: chown le 369731 1 2024-05-09T00:07:40.229 INFO:tasks.workunit.client.0.smithi026.stdout:4/193: creat d0/d12/d1b/d2b/f40 x:0 0 0 2024-05-09T00:07:40.232 INFO:tasks.workunit.client.0.smithi026.stdout:0/341: creat d1d/d25/d3c/d5f/f72 x:0 0 0 2024-05-09T00:07:40.234 INFO:tasks.workunit.client.0.smithi026.stdout:1/189: dwrite d5/dd/f34 [0,4194304] 0 2024-05-09T00:07:40.237 INFO:tasks.workunit.client.1.smithi135.stdout:9/756: mknod d1/d1a/d10/cf1 0 2024-05-09T00:07:40.237 INFO:tasks.workunit.client.1.smithi135.stdout:7/949: creat db/dd/d33/d68/d10a/d3a/d40/d135/f13d x:0 0 0 2024-05-09T00:07:40.237 INFO:tasks.workunit.client.1.smithi135.stdout:7/950: fsync db/dd/d33/d68/d10a/d94/f9a 0 2024-05-09T00:07:40.237 INFO:tasks.workunit.client.1.smithi135.stdout:7/951: write db/da8/f134 [915450,124271] 0 2024-05-09T00:07:40.237 INFO:tasks.workunit.client.1.smithi135.stdout:7/952: read - db/dd/d33/d68/d10a/d94/fb8 zero size 2024-05-09T00:07:40.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/749: mknod dc/d4a/d69/d55/d5f/d5a/dbd/cf9 0 2024-05-09T00:07:40.240 INFO:tasks.workunit.client.0.smithi026.stdout:9/228: mknod d7/d23/d2f/d50/c56 0 2024-05-09T00:07:40.240 INFO:tasks.workunit.client.0.smithi026.stdout:9/229: chown d7/l15 10 1 2024-05-09T00:07:40.245 INFO:tasks.workunit.client.1.smithi135.stdout:3/910: dwrite d8/d6d/d44/d4b/dc2/f111 [0,4194304] 0 2024-05-09T00:07:40.245 INFO:tasks.workunit.client.0.smithi026.stdout:7/325: symlink d8/d5c/l78 0 2024-05-09T00:07:40.246 INFO:tasks.workunit.client.1.smithi135.stdout:8/845: creat d4/d7/da4/f11e x:0 0 0 2024-05-09T00:07:40.247 INFO:tasks.workunit.client.1.smithi135.stdout:4/750: dread dc/dd/f80 [0,4194304] 0 2024-05-09T00:07:40.247 INFO:tasks.workunit.client.1.smithi135.stdout:4/751: dread - dc/d71/d90/fde zero size 2024-05-09T00:07:40.248 INFO:tasks.workunit.client.0.smithi026.stdout:2/188: truncate d14/f18 4067318 0 2024-05-09T00:07:40.249 INFO:tasks.workunit.client.1.smithi135.stdout:4/752: write dc/d4a/d69/d55/fa3 [1470084,42071] 0 2024-05-09T00:07:40.249 INFO:tasks.workunit.client.1.smithi135.stdout:4/753: readlink dc/d26/df4/la1 0 2024-05-09T00:07:40.249 INFO:tasks.workunit.client.0.smithi026.stdout:2/189: dread fd [0,4194304] 0 2024-05-09T00:07:40.250 INFO:tasks.workunit.client.1.smithi135.stdout:2/864: getdents d1/d12/d21/dc7 0 2024-05-09T00:07:40.250 INFO:tasks.workunit.client.1.smithi135.stdout:2/865: write d1/d12/d21/d57/f95 [1467819,38431] 0 2024-05-09T00:07:40.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/342: getdents d1d/d25/d47 0 2024-05-09T00:07:40.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/343: chown d1d/d1e/d20 363590 1 2024-05-09T00:07:40.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/344: write d1d/d25/d3c/f40 [4342846,58610] 0 2024-05-09T00:07:40.254 INFO:tasks.workunit.client.1.smithi135.stdout:2/866: dread d1/f1c [0,4194304] 0 2024-05-09T00:07:40.254 INFO:tasks.workunit.client.1.smithi135.stdout:2/867: chown d1/d12/d20/d3b/d4f/cf6 61846 1 2024-05-09T00:07:40.260 INFO:tasks.workunit.client.0.smithi026.stdout:1/190: mkdir d5/dd/d1f/d39 0 2024-05-09T00:07:40.262 INFO:tasks.workunit.client.1.smithi135.stdout:2/868: dread d1/d22/d63/fed [0,4194304] 0 2024-05-09T00:07:40.262 INFO:tasks.workunit.client.1.smithi135.stdout:6/870: rename d2/d5f/cb0 to d2/d20/d3f/d4f/ddb/d11c/c125 0 2024-05-09T00:07:40.264 INFO:tasks.workunit.client.1.smithi135.stdout:0/824: symlink d3/dd/d2d/d4c/lef 0 2024-05-09T00:07:40.264 INFO:tasks.workunit.client.0.smithi026.stdout:0/345: dwrite d1d/d1e/f69 [0,4194304] 0 2024-05-09T00:07:40.269 INFO:tasks.workunit.client.0.smithi026.stdout:9/230: getdents d7/d23/d29/d31/d40/d41 0 2024-05-09T00:07:40.269 INFO:tasks.workunit.client.0.smithi026.stdout:3/198: mkdir d5/d44 0 2024-05-09T00:07:40.283 INFO:tasks.workunit.client.1.smithi135.stdout:6/871: dwrite d2/d20/d37/d4e/d9d/fb8 [0,4194304] 0 2024-05-09T00:07:40.293 INFO:tasks.workunit.client.1.smithi135.stdout:6/872: dread d2/f9 [0,4194304] 0 2024-05-09T00:07:40.293 INFO:tasks.workunit.client.1.smithi135.stdout:6/873: fdatasync d2/d20/d37/d4e/f6a 0 2024-05-09T00:07:40.295 INFO:tasks.workunit.client.1.smithi135.stdout:6/874: dread d2/d5f/fba [0,4194304] 0 2024-05-09T00:07:40.295 INFO:tasks.workunit.client.1.smithi135.stdout:6/875: dread - d2/d20/d37/d4e/d7c/fa5 zero size 2024-05-09T00:07:40.312 INFO:tasks.workunit.client.0.smithi026.stdout:7/326: creat d8/f79 x:0 0 0 2024-05-09T00:07:40.357 INFO:tasks.workunit.client.0.smithi026.stdout:4/194: dread d0/d12/d1b/f3c [0,4194304] 0 2024-05-09T00:07:40.357 INFO:tasks.workunit.client.0.smithi026.stdout:4/195: stat d0/d12/f30 0 2024-05-09T00:07:40.357 INFO:tasks.workunit.client.0.smithi026.stdout:4/196: fdatasync d0/d12/d34/f36 0 2024-05-09T00:07:40.358 INFO:tasks.workunit.client.0.smithi026.stdout:2/190: unlink d14/l3a 0 2024-05-09T00:07:40.363 INFO:tasks.workunit.client.0.smithi026.stdout:1/191: unlink d5/db/d1d/c25 0 2024-05-09T00:07:40.364 INFO:tasks.workunit.client.1.smithi135.stdout:7/953: symlink db/dd/d33/d68/d10a/d3a/dfc/l13e 0 2024-05-09T00:07:40.365 INFO:tasks.workunit.client.0.smithi026.stdout:5/209: link d2/l16 d2/l42 0 2024-05-09T00:07:40.372 INFO:tasks.workunit.client.0.smithi026.stdout:0/346: symlink d1d/d25/l73 0 2024-05-09T00:07:40.373 INFO:tasks.workunit.client.1.smithi135.stdout:3/911: unlink d8/c5b 0 2024-05-09T00:07:40.373 INFO:tasks.workunit.client.1.smithi135.stdout:3/912: fsync d8/d6d/d44/f12e 0 2024-05-09T00:07:40.377 INFO:tasks.workunit.client.0.smithi026.stdout:9/231: mknod d7/d23/d29/d31/c57 0 2024-05-09T00:07:40.377 INFO:tasks.workunit.client.0.smithi026.stdout:9/232: dread - d7/d23/d29/d31/f42 zero size 2024-05-09T00:07:40.377 INFO:tasks.workunit.client.0.smithi026.stdout:9/233: write d7/d23/d2f/d3a/f55 [244807,72159] 0 2024-05-09T00:07:40.379 INFO:tasks.workunit.client.1.smithi135.stdout:4/754: unlink dc/d71/d86/fcf 0 2024-05-09T00:07:40.379 INFO:tasks.workunit.client.1.smithi135.stdout:4/755: chown dc/d4a/d69/d55/d5f/faf 10585673 1 2024-05-09T00:07:40.379 INFO:tasks.workunit.client.1.smithi135.stdout:4/756: chown dc/f4b 968 1 2024-05-09T00:07:40.380 INFO:tasks.workunit.client.0.smithi026.stdout:3/199: mkdir d5/d9/dc/d28/d45 0 2024-05-09T00:07:40.381 INFO:tasks.workunit.client.0.smithi026.stdout:7/327: truncate d8/d2e/d55/d1e/f43 2400057 0 2024-05-09T00:07:40.382 INFO:tasks.workunit.client.0.smithi026.stdout:7/328: dread - d8/d2e/d55/d1e/f64 zero size 2024-05-09T00:07:40.385 INFO:tasks.workunit.client.1.smithi135.stdout:9/757: rename d1/d1a/d2c/d2d/de6/l7c to d1/d1a/d89/dad/lf2 0 2024-05-09T00:07:40.386 INFO:tasks.workunit.client.1.smithi135.stdout:9/758: readlink d1/d1a/d89/dad/lf2 0 2024-05-09T00:07:40.387 INFO:tasks.workunit.client.0.smithi026.stdout:2/191: dwrite f11 [0,4194304] 0 2024-05-09T00:07:40.395 INFO:tasks.workunit.client.1.smithi135.stdout:6/876: symlink d2/d20/d3f/d4f/ddb/d11c/l126 0 2024-05-09T00:07:40.395 INFO:tasks.workunit.client.1.smithi135.stdout:6/877: fsync d2/da/d26/d57/d60/f6f 0 2024-05-09T00:07:40.398 INFO:tasks.workunit.client.0.smithi026.stdout:0/347: dwrite d1d/f29 [0,4194304] 0 2024-05-09T00:07:40.401 INFO:tasks.workunit.client.0.smithi026.stdout:4/197: getdents d0/d12 0 2024-05-09T00:07:40.404 INFO:tasks.workunit.client.0.smithi026.stdout:9/234: dwrite d7/f1b [0,4194304] 0 2024-05-09T00:07:40.406 INFO:tasks.workunit.client.1.smithi135.stdout:5/887: rename db/d24/c35 to db/d24/c113 0 2024-05-09T00:07:40.408 INFO:tasks.workunit.client.0.smithi026.stdout:1/192: unlink d5/f1c 0 2024-05-09T00:07:40.413 INFO:tasks.workunit.client.1.smithi135.stdout:7/954: rename db/dd/d33/d68/d10a/la4 to db/dd/d33/d68/d10a/d3a/d40/d4c/da3/l13f 0 2024-05-09T00:07:40.413 INFO:tasks.workunit.client.1.smithi135.stdout:7/955: readlink db/dd/d33/d68/d10a/d3a/d40/d4c/da3/l13f 0 2024-05-09T00:07:40.414 INFO:tasks.workunit.client.0.smithi026.stdout:5/210: rmdir d2/d8/d31/d2e 39 2024-05-09T00:07:40.414 INFO:tasks.workunit.client.0.smithi026.stdout:5/211: chown d2/d8/d2a/l3e 3 1 2024-05-09T00:07:40.415 INFO:tasks.workunit.client.0.smithi026.stdout:5/212: dread d2/fc [4194304,4194304] 0 2024-05-09T00:07:40.417 INFO:tasks.workunit.client.1.smithi135.stdout:9/759: creat d1/d1a/d10/db3/ff3 x:0 0 0 2024-05-09T00:07:40.418 INFO:tasks.workunit.client.0.smithi026.stdout:3/200: mknod d5/d9/dc/c46 0 2024-05-09T00:07:40.419 INFO:tasks.workunit.client.1.smithi135.stdout:6/878: dwrite d2/da/d26/d57/d60/fdf [0,4194304] 0 2024-05-09T00:07:40.420 INFO:tasks.workunit.client.1.smithi135.stdout:5/888: mkdir db/d24/d32/d114 0 2024-05-09T00:07:40.421 INFO:tasks.workunit.client.1.smithi135.stdout:6/879: write d2/da/d26/d57/d60/fbe [2813153,83819] 0 2024-05-09T00:07:40.422 INFO:tasks.workunit.client.0.smithi026.stdout:7/329: link d8/l45 d8/d1b/l7a 0 2024-05-09T00:07:40.423 INFO:tasks.workunit.client.0.smithi026.stdout:7/330: chown d8/d2e/d55/l71 14430 1 2024-05-09T00:07:40.428 INFO:tasks.workunit.client.1.smithi135.stdout:3/913: rename d8/d13/d1f/d62/fa9 to d8/d13/d75/f143 0 2024-05-09T00:07:40.432 INFO:tasks.workunit.client.1.smithi135.stdout:7/956: creat db/dd/d33/d68/d10a/de6/d13b/f140 x:0 0 0 2024-05-09T00:07:40.433 INFO:tasks.workunit.client.1.smithi135.stdout:7/957: read db/d13/f2a [5208832,54411] 0 2024-05-09T00:07:40.433 INFO:tasks.workunit.client.1.smithi135.stdout:7/958: truncate db/dd/d33/da5/d11b/f132 531920 0 2024-05-09T00:07:40.441 INFO:tasks.workunit.client.1.smithi135.stdout:9/760: creat d1/d1a/d89/dad/de3/ff4 x:0 0 0 2024-05-09T00:07:40.442 INFO:tasks.workunit.client.0.smithi026.stdout:1/193: dwrite d5/db/f1e [0,4194304] 0 2024-05-09T00:07:40.442 INFO:tasks.workunit.client.0.smithi026.stdout:7/331: dread d8/d2e/d55/d22/d29/f18 [0,4194304] 0 2024-05-09T00:07:40.442 INFO:tasks.workunit.client.0.smithi026.stdout:7/332: fdatasync d8/d2e/f4a 0 2024-05-09T00:07:40.444 INFO:tasks.workunit.client.0.smithi026.stdout:2/192: rename le to d14/d22/l4c 0 2024-05-09T00:07:40.445 INFO:tasks.workunit.client.1.smithi135.stdout:6/880: dwrite d2/da/d1d/d69/d89/f8e [0,4194304] 0 2024-05-09T00:07:40.445 INFO:tasks.workunit.client.0.smithi026.stdout:3/201: dwrite d5/d9/dc/d28/f35 [0,4194304] 0 2024-05-09T00:07:40.445 INFO:tasks.workunit.client.0.smithi026.stdout:3/202: dread - d5/d1e/f3d zero size 2024-05-09T00:07:40.449 INFO:tasks.workunit.client.1.smithi135.stdout:5/889: stat db/d84/d62/c97 0 2024-05-09T00:07:40.457 INFO:tasks.workunit.client.0.smithi026.stdout:0/348: link d1d/d1e/d2d/c71 d1d/d1e/d20/d4d/d58/d62/c74 0 2024-05-09T00:07:40.459 INFO:tasks.workunit.client.0.smithi026.stdout:4/198: getdents d0/d12/d1b 0 2024-05-09T00:07:40.467 INFO:tasks.workunit.client.1.smithi135.stdout:3/914: unlink d8/d13/d75/d58/f9e 0 2024-05-09T00:07:40.468 INFO:tasks.workunit.client.1.smithi135.stdout:3/915: dread - d8/d102/d63/d89/f128 zero size 2024-05-09T00:07:40.472 INFO:tasks.workunit.client.1.smithi135.stdout:9/761: link d1/d1a/d2c/d2d/f32 d1/d24/d86/d97/ff5 0 2024-05-09T00:07:40.473 INFO:tasks.workunit.client.0.smithi026.stdout:5/213: creat d2/d8/d31/d24/f43 x:0 0 0 2024-05-09T00:07:40.474 INFO:tasks.workunit.client.0.smithi026.stdout:5/214: write d2/d8/d36/f3c [289118,113718] 0 2024-05-09T00:07:40.475 INFO:tasks.workunit.client.0.smithi026.stdout:5/215: write d2/d8/d2a/f2c [3935508,114188] 0 2024-05-09T00:07:40.476 INFO:tasks.workunit.client.0.smithi026.stdout:5/216: read d2/d8/d31/f12 [1045961,97275] 0 2024-05-09T00:07:40.476 INFO:tasks.workunit.client.0.smithi026.stdout:5/217: chown d2/d8/c9 19330 1 2024-05-09T00:07:40.477 INFO:tasks.workunit.client.0.smithi026.stdout:1/194: dwrite d5/dd/d17/f2a [0,4194304] 0 2024-05-09T00:07:40.477 INFO:tasks.workunit.client.0.smithi026.stdout:3/203: dwrite d5/d9/dc/f11 [0,4194304] 0 2024-05-09T00:07:40.478 INFO:tasks.workunit.client.1.smithi135.stdout:7/959: dwrite db/dd/d33/d58/db5/fdf [4194304,4194304] 0 2024-05-09T00:07:40.478 INFO:tasks.workunit.client.0.smithi026.stdout:2/193: dwrite d14/d15/d17/f34 [0,4194304] 0 2024-05-09T00:07:40.479 INFO:tasks.workunit.client.1.smithi135.stdout:9/762: write d1/d1a/d2c/d2d/fef [3118543,93812] 0 2024-05-09T00:07:40.479 INFO:tasks.workunit.client.1.smithi135.stdout:5/890: dwrite db/d24/d32/d5b/fea [0,4194304] 0 2024-05-09T00:07:40.481 INFO:tasks.workunit.client.1.smithi135.stdout:5/891: write db/d84/f4b [1082505,105934] 0 2024-05-09T00:07:40.482 INFO:tasks.workunit.client.0.smithi026.stdout:7/333: creat d8/d1b/f7b x:0 0 0 2024-05-09T00:07:40.485 INFO:tasks.workunit.client.0.smithi026.stdout:9/235: rename c0 to d7/d23/d29/d31/c58 0 2024-05-09T00:07:40.486 INFO:tasks.workunit.client.0.smithi026.stdout:9/236: write d7/d23/d2f/f45 [496489,21512] 0 2024-05-09T00:07:40.488 INFO:tasks.workunit.client.1.smithi135.stdout:3/916: mkdir d8/d13/d144 0 2024-05-09T00:07:40.494 INFO:tasks.workunit.client.1.smithi135.stdout:7/960: creat db/d21/dd0/f141 x:0 0 0 2024-05-09T00:07:40.495 INFO:tasks.workunit.client.0.smithi026.stdout:0/349: creat d1d/d25/d3c/d5f/f75 x:0 0 0 2024-05-09T00:07:40.496 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:38.947481+0000 mgr.smithi135.kkrhgf (mgr.24419) 49 : audit [DBG] from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:40.496 INFO:tasks.workunit.client.1.smithi135.stdout:7/961: write db/ff [2804880,20608] 0 2024-05-09T00:07:40.497 INFO:tasks.workunit.client.0.smithi026.stdout:4/199: mknod d0/d12/d1b/c41 0 2024-05-09T00:07:40.498 INFO:tasks.workunit.client.0.smithi026.stdout:7/334: dwrite d8/d2e/d55/d1e/f32 [0,4194304] 0 2024-05-09T00:07:40.499 INFO:tasks.workunit.client.0.smithi026.stdout:4/200: write d0/fc [5295743,92546] 0 2024-05-09T00:07:40.500 INFO:tasks.workunit.client.0.smithi026.stdout:5/218: creat d2/f44 x:0 0 0 2024-05-09T00:07:40.501 INFO:tasks.workunit.client.1.smithi135.stdout:9/763: dwrite d1/d1a/d10/d3c/d5c/fab [4194304,4194304] 0 2024-05-09T00:07:40.507 INFO:tasks.workunit.client.1.smithi135.stdout:3/917: mknod d8/d13/d75/d140/c145 0 2024-05-09T00:07:40.507 INFO:tasks.workunit.client.1.smithi135.stdout:3/918: chown d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d80/d84 2 1 2024-05-09T00:07:40.507 INFO:tasks.workunit.client.1.smithi135.stdout:3/919: dread - d8/d6d/d44/f12e zero size 2024-05-09T00:07:40.508 INFO:tasks.workunit.client.0.smithi026.stdout:1/195: symlink d5/dd/l3a 0 2024-05-09T00:07:40.513 INFO:tasks.workunit.client.0.smithi026.stdout:3/204: creat d5/d41/f47 x:0 0 0 2024-05-09T00:07:40.514 INFO:tasks.workunit.client.1.smithi135.stdout:9/764: symlink d1/d1a/d89/dad/lf6 0 2024-05-09T00:07:40.515 INFO:tasks.workunit.client.1.smithi135.stdout:9/765: stat d1/d1a/d10/db3 0 2024-05-09T00:07:40.517 INFO:tasks.workunit.client.0.smithi026.stdout:2/194: mknod d14/d15/d20/d41/c4d 0 2024-05-09T00:07:40.520 INFO:tasks.workunit.client.1.smithi135.stdout:5/892: symlink db/d24/l115 0 2024-05-09T00:07:40.521 INFO:tasks.workunit.client.0.smithi026.stdout:9/237: mkdir d7/d23/d29/d59 0 2024-05-09T00:07:40.523 INFO:tasks.workunit.client.1.smithi135.stdout:3/920: truncate d8/d13/f22 2691745 0 2024-05-09T00:07:40.524 INFO:tasks.workunit.client.1.smithi135.stdout:3/921: stat d8 0 2024-05-09T00:07:40.527 INFO:tasks.workunit.client.1.smithi135.stdout:2/869: creat d1/d12/d21/d41/d6d/d6e/f125 x:0 0 0 2024-05-09T00:07:40.529 INFO:tasks.workunit.client.1.smithi135.stdout:9/766: rmdir d1/da4 39 2024-05-09T00:07:40.529 INFO:tasks.workunit.client.1.smithi135.stdout:9/767: write d1/d1a/d2c/d2d/de6/d6e/fcc [966267,86714] 0 2024-05-09T00:07:40.529 INFO:tasks.workunit.client.1.smithi135.stdout:9/768: fsync d1/d1a/f42 0 2024-05-09T00:07:40.535 INFO:tasks.workunit.client.0.smithi026.stdout:3/205: dwrite d5/d9/f16 [0,4194304] 0 2024-05-09T00:07:40.535 INFO:tasks.workunit.client.0.smithi026.stdout:3/206: write d5/d9/dc/f31 [438872,83264] 0 2024-05-09T00:07:40.535 INFO:tasks.workunit.client.0.smithi026.stdout:7/335: unlink d8/c70 0 2024-05-09T00:07:40.535 INFO:tasks.workunit.client.0.smithi026.stdout:7/336: chown d8/d5c/l67 32713 1 2024-05-09T00:07:40.537 INFO:tasks.workunit.client.1.smithi135.stdout:3/922: link d8/d6d/d24/fb7 d8/d13/d1f/d62/f146 0 2024-05-09T00:07:40.537 INFO:tasks.workunit.client.1.smithi135.stdout:3/923: dread - d8/d13/d1f/d40/d52/fcb zero size 2024-05-09T00:07:40.539 INFO:tasks.workunit.client.1.smithi135.stdout:9/769: link d1/d1a/d10/db3/cd2 d1/cf7 0 2024-05-09T00:07:40.541 INFO:tasks.workunit.client.0.smithi026.stdout:4/201: mknod d0/d12/c42 0 2024-05-09T00:07:40.542 INFO:tasks.workunit.client.0.smithi026.stdout:9/238: dwrite d7/d26/f3e [0,4194304] 0 2024-05-09T00:07:40.542 INFO:tasks.workunit.client.1.smithi135.stdout:5/893: dwrite db/d84/d31/fbb [0,4194304] 0 2024-05-09T00:07:40.543 INFO:tasks.workunit.client.0.smithi026.stdout:5/219: mkdir d2/d8/d31/d2e/d45 0 2024-05-09T00:07:40.543 INFO:tasks.workunit.client.0.smithi026.stdout:5/220: chown d2/d8/d31/c19 30899 1 2024-05-09T00:07:40.543 INFO:tasks.workunit.client.1.smithi135.stdout:5/894: write db/fe [3018469,96490] 0 2024-05-09T00:07:40.548 INFO:tasks.workunit.client.1.smithi135.stdout:3/924: mkdir d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d80/d147 0 2024-05-09T00:07:40.550 INFO:tasks.workunit.client.1.smithi135.stdout:9/770: creat d1/da4/ff8 x:0 0 0 2024-05-09T00:07:40.552 INFO:tasks.workunit.client.0.smithi026.stdout:1/196: creat d5/d16/f3b x:0 0 0 2024-05-09T00:07:40.553 INFO:tasks.workunit.client.0.smithi026.stdout:1/197: write d5/dd/f34 [1567819,19897] 0 2024-05-09T00:07:40.555 INFO:tasks.workunit.client.0.smithi026.stdout:2/195: symlink d14/d15/d3b/d40/l4e 0 2024-05-09T00:07:40.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.565+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa1b00f9e30 con 0x7fa1b00f86b0 2024-05-09T00:07:40.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.565+0000 7fa1a77fe700 1 -- 172.21.15.26:0/4012192433 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fa1a00535c0 con 0x7fa1b00f86b0 2024-05-09T00:07:40.560 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:07:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:07:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:07:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:07:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:07:40.560 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:07:40.561 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:07:40.562 INFO:tasks.workunit.client.1.smithi135.stdout:5/895: creat db/d5d/dac/ddc/dbf/de3/f116 x:0 0 0 2024-05-09T00:07:40.562 INFO:tasks.workunit.client.1.smithi135.stdout:5/896: truncate db/d24/f2c 973915 0 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.567+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa19c066d50 msgr2=0x7fa19c069210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.567+0000 7fa1b8694700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa19c066d50 0x7fa19c069210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa1ac00b910 tx=0x7fa1ac008040).stop 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.567+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 msgr2=0x7fa1b0106290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.567+0000 7fa1b8694700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 0x7fa1b0106290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fa1a0004f00 tx=0x7fa1a0009cb0).stop 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.568+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 shutdown_connections 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.568+0000 7fa1b8694700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa19c066d50 0x7fa19c069210 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.568+0000 7fa1b8694700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1b00f7da0 0x7fa1b0105da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.568+0000 7fa1b8694700 1 --2- 172.21.15.26:0/4012192433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1b00f86b0 0x7fa1b0106290 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.568+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 >> 172.21.15.26:0/4012192433 conn(0x7fa1b00f15d0 msgr2=0x7fa1b00f39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.568+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 shutdown_connections 2024-05-09T00:07:40.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.568+0000 7fa1b8694700 1 -- 172.21.15.26:0/4012192433 wait complete. 2024-05-09T00:07:40.564 INFO:tasks.workunit.client.0.smithi026.stdout:3/207: mknod d5/d41/c48 0 2024-05-09T00:07:40.565 INFO:tasks.workunit.client.1.smithi135.stdout:3/925: mkdir d8/d6d/d44/d4b/da0/daa/d148 0 2024-05-09T00:07:40.568 INFO:tasks.workunit.client.0.smithi026.stdout:7/337: rename d8/d2e/d55/d22/d29/f53 to d8/d2e/d55/d1e/f7c 0 2024-05-09T00:07:40.571 INFO:tasks.workunit.client.1.smithi135.stdout:9/771: mknod d1/d1a/d2c/d2d/de6/d6e/cf9 0 2024-05-09T00:07:40.573 INFO:tasks.workunit.client.0.smithi026.stdout:4/202: mkdir d0/d19/d43 0 2024-05-09T00:07:40.576 INFO:tasks.workunit.client.1.smithi135.stdout:3/926: getdents d8/d6d/d24/d106 0 2024-05-09T00:07:40.576 INFO:tasks.workunit.client.1.smithi135.stdout:3/927: chown d8/d13/d144 2 1 2024-05-09T00:07:40.576 INFO:tasks.workunit.client.1.smithi135.stdout:3/928: getdents d8/d13/d75/d12f 0 2024-05-09T00:07:40.576 INFO:tasks.workunit.client.1.smithi135.stdout:3/929: chown d8/d102/d63/db9/lc7 1282628257 1 2024-05-09T00:07:40.577 INFO:tasks.workunit.client.0.smithi026.stdout:7/338: dread d8/d2e/f6f [0,4194304] 0 2024-05-09T00:07:40.580 INFO:tasks.workunit.client.1.smithi135.stdout:9/772: stat d1/d1a/d2c/d20/c75 0 2024-05-09T00:07:40.582 INFO:tasks.workunit.client.0.smithi026.stdout:9/239: symlink d7/d23/d29/d31/d40/l5a 0 2024-05-09T00:07:40.582 INFO:tasks.workunit.client.0.smithi026.stdout:9/240: chown d7/d23/c4b 468 1 2024-05-09T00:07:40.584 INFO:tasks.workunit.client.1.smithi135.stdout:5/897: dwrite db/d84/f49 [0,4194304] 0 2024-05-09T00:07:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:5/221: rename d2/d8/c1c to d2/d8/d36/c46 0 2024-05-09T00:07:40.592 INFO:tasks.workunit.client.1.smithi135.stdout:3/930: creat d8/d6d/d24/d133/f149 x:0 0 0 2024-05-09T00:07:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:4/203: link d0/d12/f30 d0/d19/d43/f44 0 2024-05-09T00:07:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:4/204: truncate d0/d12/f2c 1428853 0 2024-05-09T00:07:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:4/205: stat d0/d12/f2c 0 2024-05-09T00:07:40.596 INFO:tasks.workunit.client.1.smithi135.stdout:5/898: symlink db/d24/d32/dfa/dbe/l117 0 2024-05-09T00:07:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:9/241: mknod d7/d23/c5b 0 2024-05-09T00:07:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:9/242: readlink d7/l1c 0 2024-05-09T00:07:40.599 INFO:tasks.workunit.client.1.smithi135.stdout:3/931: unlink d8/d6d/d44/d4b/fdb 0 2024-05-09T00:07:40.600 INFO:tasks.workunit.client.0.smithi026.stdout:1/198: mknod d5/d16/c3c 0 2024-05-09T00:07:40.601 INFO:tasks.workunit.client.1.smithi135.stdout:9/773: dwrite d1/da4/ff8 [0,4194304] 0 2024-05-09T00:07:40.603 INFO:tasks.workunit.client.1.smithi135.stdout:5/899: mkdir db/d24/d32/d118 0 2024-05-09T00:07:40.604 INFO:tasks.workunit.client.0.smithi026.stdout:2/196: mkdir d14/d15/d1f/d4f 0 2024-05-09T00:07:40.607 INFO:tasks.workunit.client.1.smithi135.stdout:3/932: getdents d8/d13/d1f/d62/d10c 0 2024-05-09T00:07:40.614 INFO:tasks.workunit.client.0.smithi026.stdout:4/206: dread d0/fe [0,4194304] 0 2024-05-09T00:07:40.617 INFO:tasks.workunit.client.0.smithi026.stdout:7/339: dread d8/d2e/d55/d22/f42 [0,4194304] 0 2024-05-09T00:07:40.618 INFO:tasks.workunit.client.0.smithi026.stdout:7/340: truncate d8/d2e/d55/d1e/f6e 524986 0 2024-05-09T00:07:40.618 INFO:tasks.workunit.client.0.smithi026.stdout:7/341: dread - d8/f79 zero size 2024-05-09T00:07:40.618 INFO:tasks.workunit.client.0.smithi026.stdout:4/207: write d0/d19/f1e [1203592,71532] 0 2024-05-09T00:07:40.618 INFO:tasks.workunit.client.0.smithi026.stdout:9/243: getdents d7/d26 0 2024-05-09T00:07:40.622 INFO:tasks.workunit.client.0.smithi026.stdout:1/199: creat d5/dd/d1f/d39/f3d x:0 0 0 2024-05-09T00:07:40.622 INFO:tasks.workunit.client.0.smithi026.stdout:1/200: chown d5/dd/d1f/f2e 44078 1 2024-05-09T00:07:40.624 INFO:tasks.workunit.client.0.smithi026.stdout:2/197: mknod d14/d15/d3b/d40/d47/c50 0 2024-05-09T00:07:40.624 INFO:tasks.workunit.client.0.smithi026.stdout:2/198: truncate d14/d15/f25 700388 0 2024-05-09T00:07:40.626 INFO:tasks.workunit.client.0.smithi026.stdout:4/208: truncate d0/d12/d1b/d2b/f3f 483976 0 2024-05-09T00:07:40.628 INFO:tasks.workunit.client.0.smithi026.stdout:9/244: mkdir d7/d23/d29/d31/d40/d41/d54/d5c 0 2024-05-09T00:07:40.633 INFO:tasks.workunit.client.0.smithi026.stdout:2/199: mkdir d14/d15/d20/d41/d51 0 2024-05-09T00:07:40.635 INFO:tasks.workunit.client.1.smithi135.stdout:5/900: dwrite db/d5d/fb6 [4194304,4194304] 0 2024-05-09T00:07:40.636 INFO:tasks.workunit.client.0.smithi026.stdout:4/209: creat d0/d19/f45 x:0 0 0 2024-05-09T00:07:40.638 INFO:tasks.workunit.client.0.smithi026.stdout:9/245: mknod d7/d23/d2f/d3a/c5d 0 2024-05-09T00:07:40.638 INFO:tasks.workunit.client.1.smithi135.stdout:9/774: dwrite d1/d24/f47 [0,4194304] 0 2024-05-09T00:07:40.645 INFO:tasks.workunit.client.0.smithi026.stdout:2/200: link f4 d14/d22/f52 0 2024-05-09T00:07:40.646 INFO:tasks.workunit.client.0.smithi026.stdout:4/210: mknod d0/d12/d1b/d2b/c46 0 2024-05-09T00:07:40.647 INFO:tasks.workunit.client.0.smithi026.stdout:9/246: symlink d7/d23/d29/d31/d40/l5e 0 2024-05-09T00:07:40.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:38.947481+0000 mgr.smithi135.kkrhgf (mgr.24419) 49 : audit [DBG] from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:40.648 INFO:tasks.workunit.client.0.smithi026.stdout:2/201: mknod d14/d15/c53 0 2024-05-09T00:07:40.648 INFO:tasks.workunit.client.0.smithi026.stdout:2/202: stat d14/d15/d3b/d40 0 2024-05-09T00:07:40.648 INFO:tasks.workunit.client.0.smithi026.stdout:2/203: chown d14/d15/d17 490425 1 2024-05-09T00:07:40.649 INFO:tasks.workunit.client.1.smithi135.stdout:5/901: dread db/d24/d32/d5b/f76 [0,4194304] 0 2024-05-09T00:07:40.652 INFO:tasks.workunit.client.1.smithi135.stdout:5/902: creat db/d24/db0/dcd/d10e/f119 x:0 0 0 2024-05-09T00:07:40.655 INFO:tasks.workunit.client.1.smithi135.stdout:5/903: dread db/d24/d32/dfa/d9c/d9f/d92/ffd [0,4194304] 0 2024-05-09T00:07:40.657 INFO:tasks.workunit.client.0.smithi026.stdout:5/222: dwrite d2/d8/d31/f17 [0,4194304] 0 2024-05-09T00:07:40.657 INFO:tasks.workunit.client.0.smithi026.stdout:7/342: dwrite d8/d1b/f5b [0,4194304] 0 2024-05-09T00:07:40.659 INFO:tasks.workunit.client.0.smithi026.stdout:2/204: symlink d14/d15/d1f/l54 0 2024-05-09T00:07:40.660 INFO:tasks.workunit.client.0.smithi026.stdout:7/343: read d8/d1b/f34 [2205553,15402] 0 2024-05-09T00:07:40.661 INFO:tasks.workunit.client.1.smithi135.stdout:9/775: dwrite d1/d24/d86/d97/dec/fc3 [0,4194304] 0 2024-05-09T00:07:40.662 INFO:tasks.workunit.client.0.smithi026.stdout:1/201: dwrite d5/dd/f34 [0,4194304] 0 2024-05-09T00:07:40.662 INFO:tasks.workunit.client.0.smithi026.stdout:1/202: write d5/f2d [514948,14794] 0 2024-05-09T00:07:40.662 INFO:tasks.workunit.client.0.smithi026.stdout:1/203: fsync d5/dd/fe 0 2024-05-09T00:07:40.662 INFO:tasks.workunit.client.0.smithi026.stdout:5/223: symlink d2/d8/d2a/l47 0 2024-05-09T00:07:40.669 INFO:tasks.workunit.client.0.smithi026.stdout:4/211: dwrite d0/d12/d1b/f3c [0,4194304] 0 2024-05-09T00:07:40.672 INFO:tasks.workunit.client.0.smithi026.stdout:1/204: mknod d5/dd/c3e 0 2024-05-09T00:07:40.672 INFO:tasks.workunit.client.0.smithi026.stdout:1/205: readlink d5/dd/l26 0 2024-05-09T00:07:40.672 INFO:tasks.workunit.client.0.smithi026.stdout:1/206: chown d5/dd 11 1 2024-05-09T00:07:40.673 INFO:tasks.workunit.client.0.smithi026.stdout:5/224: mkdir d2/d8/d31/d32/d48 0 2024-05-09T00:07:40.679 INFO:tasks.workunit.client.0.smithi026.stdout:1/207: fdatasync d5/f2d 0 2024-05-09T00:07:40.681 INFO:tasks.workunit.client.0.smithi026.stdout:5/225: dread d2/d8/d31/f18 [0,4194304] 0 2024-05-09T00:07:40.682 INFO:tasks.workunit.client.0.smithi026.stdout:4/212: symlink d0/d19/l47 0 2024-05-09T00:07:40.685 INFO:tasks.workunit.client.0.smithi026.stdout:1/208: creat d5/dd/f3f x:0 0 0 2024-05-09T00:07:40.688 INFO:tasks.workunit.client.0.smithi026.stdout:5/226: stat d2/l6 0 2024-05-09T00:07:40.691 INFO:tasks.workunit.client.0.smithi026.stdout:1/209: write d5/dd/d1f/f21 [269579,22145] 0 2024-05-09T00:07:40.691 INFO:tasks.workunit.client.0.smithi026.stdout:4/213: dread d0/f22 [0,4194304] 0 2024-05-09T00:07:40.694 INFO:tasks.workunit.client.0.smithi026.stdout:5/227: mknod d2/d8/d31/d32/d48/c49 0 2024-05-09T00:07:40.697 INFO:tasks.workunit.client.0.smithi026.stdout:8/227: sync 2024-05-09T00:07:40.697 INFO:tasks.workunit.client.0.smithi026.stdout:1/210: mknod d5/db/c40 0 2024-05-09T00:07:40.700 INFO:tasks.workunit.client.0.smithi026.stdout:8/228: mknod de/d17/c49 0 2024-05-09T00:07:40.704 INFO:tasks.workunit.client.0.smithi026.stdout:1/211: symlink d5/l41 0 2024-05-09T00:07:40.704 INFO:tasks.workunit.client.0.smithi026.stdout:6/198: sync 2024-05-09T00:07:40.706 INFO:tasks.workunit.client.0.smithi026.stdout:1/212: write d5/dd/d17/f2a [2584838,58678] 0 2024-05-09T00:07:40.706 INFO:tasks.workunit.client.0.smithi026.stdout:1/213: stat d5/dd/d17/d29 0 2024-05-09T00:07:40.706 INFO:tasks.workunit.client.0.smithi026.stdout:5/228: dread d2/fc [0,4194304] 0 2024-05-09T00:07:40.707 INFO:tasks.workunit.client.0.smithi026.stdout:5/229: read - d2/d8/d31/d24/f43 zero size 2024-05-09T00:07:40.714 INFO:tasks.workunit.client.0.smithi026.stdout:6/199: creat d15/d1e/d30/f3f x:0 0 0 2024-05-09T00:07:40.715 INFO:tasks.workunit.client.0.smithi026.stdout:1/214: symlink d5/dd/d17/d29/l42 0 2024-05-09T00:07:40.720 INFO:tasks.workunit.client.0.smithi026.stdout:6/200: creat d15/d1e/d30/d32/d36/f40 x:0 0 0 2024-05-09T00:07:40.720 INFO:tasks.workunit.client.0.smithi026.stdout:6/201: chown d15/d2b 8 1 2024-05-09T00:07:40.720 INFO:tasks.workunit.client.0.smithi026.stdout:6/202: dread - d15/f29 zero size 2024-05-09T00:07:40.720 INFO:tasks.workunit.client.0.smithi026.stdout:6/203: chown d15/d1e/d23/d26/c39 0 1 2024-05-09T00:07:40.720 INFO:tasks.workunit.client.0.smithi026.stdout:6/204: chown d15/d1e/d30/d32/d36 155 1 2024-05-09T00:07:40.724 INFO:tasks.workunit.client.0.smithi026.stdout:8/229: dwrite f7 [0,4194304] 0 2024-05-09T00:07:40.726 INFO:tasks.workunit.client.0.smithi026.stdout:8/230: creat de/d17/f4a x:0 0 0 2024-05-09T00:07:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.734+0000 7f55cbb56700 1 -- 172.21.15.26:0/949208824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40616f0 msgr2=0x7f55c40fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.734+0000 7f55cbb56700 1 --2- 172.21.15.26:0/949208824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40616f0 0x7f55c40fa530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f55c00047f0 tx=0x7f55c0009cb0).stop 2024-05-09T00:07:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.734+0000 7f55cbb56700 1 -- 172.21.15.26:0/949208824 shutdown_connections 2024-05-09T00:07:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.734+0000 7f55cbb56700 1 --2- 172.21.15.26:0/949208824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c40faa20 0x7f55c40fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:07:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.734+0000 7f55cbb56700 1 --2- 172.21.15.26:0/949208824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40616f0 0x7f55c40fa530 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.734+0000 7f55cbb56700 1 -- 172.21.15.26:0/949208824 >> 172.21.15.26:0/949208824 conn(0x7f55c40f1f10 msgr2=0x7f55c40f4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.734+0000 7f55cbb56700 1 -- 172.21.15.26:0/949208824 shutdown_connections 2024-05-09T00:07:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.734+0000 7f55cbb56700 1 -- 172.21.15.26:0/949208824 wait complete. 2024-05-09T00:07:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.735+0000 7f55cbb56700 1 Processor -- start 2024-05-09T00:07:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.736+0000 7f55cbb56700 1 -- start start 2024-05-09T00:07:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.736+0000 7f55cbb56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40616f0 0x7f55c40f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.736+0000 7f55cbb56700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c40faa20 0x7f55c40f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.736+0000 7f55cbb56700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40f6920 con 0x7f55c40616f0 2024-05-09T00:07:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.736+0000 7f55cbb56700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40f6a60 con 0x7f55c40faa20 2024-05-09T00:07:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.736+0000 7f55c90f1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c40faa20 0x7f55c40f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.736+0000 7f55c90f1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c40faa20 0x7f55c40f6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:57244/0 (socket says 172.21.15.26:57244) 2024-05-09T00:07:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.736+0000 7f55c90f1700 1 -- 172.21.15.26:0/47400604 learned_addr learned my addr 172.21.15.26:0/47400604 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.737+0000 7f55c98f2700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40616f0 0x7f55c40f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:40.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.737+0000 7f55c90f1700 1 -- 172.21.15.26:0/47400604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40616f0 msgr2=0x7f55c40f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:40.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.737+0000 7f55c90f1700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40616f0 0x7f55c40f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:40.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.737+0000 7f55c90f1700 1 -- 172.21.15.26:0/47400604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0005040 con 0x7f55c40faa20 2024-05-09T00:07:40.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.737+0000 7f55c90f1700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c40faa20 0x7f55c40f6430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f55b400b4b0 tx=0x7f55b40090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:40.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.738+0000 7f55baffd700 1 -- 172.21.15.26:0/47400604 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b4002500 con 0x7f55c40faa20 2024-05-09T00:07:40.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.738+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c40f6d40 con 0x7f55c40faa20 2024-05-09T00:07:40.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.738+0000 7f55baffd700 1 -- 172.21.15.26:0/47400604 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f55b4002b10 con 0x7f55c40faa20 2024-05-09T00:07:40.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.738+0000 7f55baffd700 1 -- 172.21.15.26:0/47400604 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b4012cb0 con 0x7f55c40faa20 2024-05-09T00:07:40.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.738+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c40f7280 con 0x7f55c40faa20 2024-05-09T00:07:40.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.740+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c4100060 con 0x7f55c40faa20 2024-05-09T00:07:40.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.740+0000 7f55baffd700 1 -- 172.21.15.26:0/47400604 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f55b4002660 con 0x7f55c40faa20 2024-05-09T00:07:40.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.741+0000 7f55baffd700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f55b0066dc0 0x7f55b0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:40.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.741+0000 7f55baffd700 1 -- 172.21.15.26:0/47400604 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f55b4084270 con 0x7f55c40faa20 2024-05-09T00:07:40.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.741+0000 7f55c98f2700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f55b0066dc0 0x7f55b0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:40.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.742+0000 7f55c98f2700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f55b0066dc0 0x7f55b0069280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f55c0004f10 tx=0x7f55c0009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:40.738 INFO:tasks.workunit.client.0.smithi026.stdout:6/205: dwrite d15/f1f [0,4194304] 0 2024-05-09T00:07:40.740 INFO:tasks.workunit.client.1.smithi135.stdout:4/757: rename dc/d71/dba to dc/d4a/d69/d55/dc9/dd7/dfa 0 2024-05-09T00:07:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:40.747+0000 7f55baffd700 1 -- 172.21.15.26:0/47400604 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f55b4052580 con 0x7f55c40faa20 2024-05-09T00:07:40.743 INFO:tasks.workunit.client.1.smithi135.stdout:3/933: rename d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d80/d84/fd4 to d8/d6d/d44/d4b/da0/daa/d88/f14a 0 2024-05-09T00:07:40.745 INFO:tasks.workunit.client.1.smithi135.stdout:4/758: symlink dc/d26/d31/db8/dd1/lfb 0 2024-05-09T00:07:40.747 INFO:tasks.workunit.client.0.smithi026.stdout:8/231: dwrite de/d17/d21/d24/d28/f3c [0,4194304] 0 2024-05-09T00:07:40.748 INFO:tasks.workunit.client.1.smithi135.stdout:9/776: rename d1/d1a/d2c/f8e to d1/d1a/d89/dad/de3/ffa 0 2024-05-09T00:07:40.748 INFO:tasks.workunit.client.1.smithi135.stdout:3/934: symlink d8/d13/d75/d53/d6a/d116/l14b 0 2024-05-09T00:07:40.749 INFO:tasks.workunit.client.1.smithi135.stdout:3/935: fdatasync d8/d6d/d44/d4b/dc2/d120/d129/d90/f9c 0 2024-05-09T00:07:40.750 INFO:tasks.workunit.client.1.smithi135.stdout:4/759: dread dc/dd/f11 [0,4194304] 0 2024-05-09T00:07:40.751 INFO:tasks.workunit.client.1.smithi135.stdout:3/936: mkdir d8/d6d/d44/d4b/da0/daa/d14c 0 2024-05-09T00:07:40.753 INFO:tasks.workunit.client.1.smithi135.stdout:4/760: mknod dc/d26/d31/d82/cfc 0 2024-05-09T00:07:40.754 INFO:tasks.workunit.client.0.smithi026.stdout:8/232: truncate de/f11 930896 0 2024-05-09T00:07:40.757 INFO:tasks.workunit.client.1.smithi135.stdout:4/761: mknod dc/d26/d93/d9d/de7/cfd 0 2024-05-09T00:07:40.757 INFO:tasks.workunit.client.1.smithi135.stdout:4/762: chown dc/d26/d93/d9d/de7/cfd 22173282 1 2024-05-09T00:07:40.759 INFO:tasks.workunit.client.1.smithi135.stdout:4/763: unlink dc/d71/d86/fe1 0 2024-05-09T00:07:40.759 INFO:tasks.workunit.client.0.smithi026.stdout:6/206: dwrite f12 [4194304,4194304] 0 2024-05-09T00:07:40.760 INFO:tasks.workunit.client.1.smithi135.stdout:9/777: dread d1/d1a/d10/d3c/d5c/f63 [0,4194304] 0 2024-05-09T00:07:40.760 INFO:tasks.workunit.client.1.smithi135.stdout:9/778: fsync d1/d1a/d2c/d2d/de6/fac 0 2024-05-09T00:07:40.761 INFO:tasks.workunit.client.0.smithi026.stdout:6/207: mkdir d15/d41 0 2024-05-09T00:07:40.761 INFO:tasks.workunit.client.0.smithi026.stdout:6/208: write d15/d1e/d30/f35 [690343,86161] 0 2024-05-09T00:07:40.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/764: creat dc/d26/d31/ffe x:0 0 0 2024-05-09T00:07:40.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/765: truncate dc/d4a/d69/f4c 4634874 0 2024-05-09T00:07:40.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/766: truncate dc/d26/df4/f48 4520408 0 2024-05-09T00:07:40.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/767: dread - dc/d4a/d8c/da5/fd5 zero size 2024-05-09T00:07:40.764 INFO:tasks.workunit.client.1.smithi135.stdout:9/779: creat d1/d1a/d10/d3c/ffb x:0 0 0 2024-05-09T00:07:40.764 INFO:tasks.workunit.client.0.smithi026.stdout:6/209: getdents d15/d1e/d30/d32 0 2024-05-09T00:07:40.766 INFO:tasks.workunit.client.1.smithi135.stdout:9/780: mknod d1/d1a/d2c/d2d/cfc 0 2024-05-09T00:07:40.766 INFO:tasks.workunit.client.0.smithi026.stdout:6/210: creat d15/d2b/f42 x:0 0 0 2024-05-09T00:07:40.767 INFO:tasks.workunit.client.1.smithi135.stdout:9/781: write d1/d1a/d2c/f28 [1073223,75773] 0 2024-05-09T00:07:40.768 INFO:tasks.workunit.client.0.smithi026.stdout:6/211: getdents d15/d1e 0 2024-05-09T00:07:40.769 INFO:tasks.workunit.client.1.smithi135.stdout:3/937: dwrite d8/d13/f22 [0,4194304] 0 2024-05-09T00:07:40.771 INFO:tasks.workunit.client.0.smithi026.stdout:6/212: mknod d15/d1e/d30/d32/c43 0 2024-05-09T00:07:40.771 INFO:tasks.workunit.client.0.smithi026.stdout:6/213: dread - d15/d2b/f3e zero size 2024-05-09T00:07:40.774 INFO:tasks.workunit.client.1.smithi135.stdout:9/782: unlink d1/d1a/d2c/f5d 0 2024-05-09T00:07:40.775 INFO:tasks.workunit.client.1.smithi135.stdout:3/938: truncate d8/d6d/d44/d4b/da0/daa/f8e 30309 0 2024-05-09T00:07:40.776 INFO:tasks.workunit.client.1.smithi135.stdout:4/768: dwrite dc/d26/d31/f99 [4194304,4194304] 0 2024-05-09T00:07:40.776 INFO:tasks.workunit.client.1.smithi135.stdout:4/769: getdents dc 0 2024-05-09T00:07:40.776 INFO:tasks.workunit.client.1.smithi135.stdout:4/770: fdatasync dc/d26/d31/f99 0 2024-05-09T00:07:40.777 INFO:tasks.workunit.client.1.smithi135.stdout:4/771: readlink dc/d4a/d8c/l8b 0 2024-05-09T00:07:40.777 INFO:tasks.workunit.client.0.smithi026.stdout:6/214: mknod d15/d1e/c44 0 2024-05-09T00:07:40.781 INFO:tasks.workunit.client.1.smithi135.stdout:3/939: mkdir d8/d6d/d44/d4b/da0/daa/d14d 0 2024-05-09T00:07:40.784 INFO:tasks.workunit.client.1.smithi135.stdout:4/772: rmdir dc/d26/d31/db6 39 2024-05-09T00:07:40.784 INFO:tasks.workunit.client.1.smithi135.stdout:4/773: read dc/d4a/d69/d55/d5f/faf [148187,95522] 0 2024-05-09T00:07:40.786 INFO:tasks.workunit.client.1.smithi135.stdout:3/940: creat d8/d102/d63/db9/d123/f14e x:0 0 0 2024-05-09T00:07:40.786 INFO:tasks.workunit.client.1.smithi135.stdout:3/941: write d8/d6d/d24/fb7 [1548226,110321] 0 2024-05-09T00:07:40.789 INFO:tasks.workunit.client.1.smithi135.stdout:4/774: mknod dc/d26/d93/d9d/cff 0 2024-05-09T00:07:40.789 INFO:tasks.workunit.client.1.smithi135.stdout:4/775: fdatasync dc/d71/d90/dce/fe2 0 2024-05-09T00:07:40.790 INFO:tasks.workunit.client.1.smithi135.stdout:7/962: mknod db/da8/c142 0 2024-05-09T00:07:40.790 INFO:tasks.workunit.client.1.smithi135.stdout:7/963: write db/dd/d33/d68/d10a/d3a/d40/d84/f136 [179706,81965] 0 2024-05-09T00:07:40.792 INFO:tasks.workunit.client.1.smithi135.stdout:3/942: dread d8/d13/d1f/d62/f146 [0,4194304] 0 2024-05-09T00:07:40.793 INFO:tasks.workunit.client.1.smithi135.stdout:4/776: rmdir dc/d26/d4e 39 2024-05-09T00:07:40.793 INFO:tasks.workunit.client.1.smithi135.stdout:3/943: write d8/d6d/d44/d4b/f60 [518411,72795] 0 2024-05-09T00:07:40.799 INFO:tasks.workunit.client.1.smithi135.stdout:3/944: creat d8/d102/d63/db9/f14f x:0 0 0 2024-05-09T00:07:40.799 INFO:tasks.workunit.client.1.smithi135.stdout:3/945: getdents d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d80/d84/d122 0 2024-05-09T00:07:40.799 INFO:tasks.workunit.client.1.smithi135.stdout:9/783: rmdir d1/da4 39 2024-05-09T00:07:40.801 INFO:tasks.workunit.client.1.smithi135.stdout:3/946: mknod d8/d6d/d44/d4b/c150 0 2024-05-09T00:07:40.803 INFO:tasks.workunit.client.1.smithi135.stdout:9/784: truncate d1/d1a/f67 3621341 0 2024-05-09T00:07:40.804 INFO:tasks.workunit.client.1.smithi135.stdout:3/947: truncate d8/fb4 775333 0 2024-05-09T00:07:40.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/785: symlink d1/d24/d44/lfd 0 2024-05-09T00:07:40.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/786: fsync d1/d1a/d2c/d2d/f32 0 2024-05-09T00:07:40.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/787: chown d1/d24/d86/d97/dec/l58 21 1 2024-05-09T00:07:40.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/788: write d1/d1a/d89/d99/fa5 [1496023,1426] 0 2024-05-09T00:07:40.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/789: readlink d1/da4/le7 0 2024-05-09T00:07:40.806 INFO:tasks.workunit.client.1.smithi135.stdout:3/948: mkdir d8/d102/d151 0 2024-05-09T00:07:40.807 INFO:tasks.workunit.client.1.smithi135.stdout:8/846: creat d4/d7/de/d45/f11f x:0 0 0 2024-05-09T00:07:40.808 INFO:tasks.workunit.client.1.smithi135.stdout:3/949: getdents d8/d13/d1f/d40/d52/dd3 0 2024-05-09T00:07:40.810 INFO:tasks.workunit.client.1.smithi135.stdout:3/950: dread d8/d6d/d44/d4b/dc2/d120/d129/deb/ffa [0,4194304] 0 2024-05-09T00:07:40.810 INFO:tasks.workunit.client.1.smithi135.stdout:7/964: dwrite db/f30 [0,4194304] 0 2024-05-09T00:07:40.811 INFO:tasks.workunit.client.1.smithi135.stdout:8/847: mkdir d4/d7/d33/d39/d120 0 2024-05-09T00:07:40.811 INFO:tasks.workunit.client.1.smithi135.stdout:3/951: read d8/d102/d63/d89/fea [8387111,102212] 0 2024-05-09T00:07:40.811 INFO:tasks.workunit.client.1.smithi135.stdout:3/952: chown d8/d6d/d44/d4b/dc2/d120/d129/d90/lcf 12286636 1 2024-05-09T00:07:40.811 INFO:tasks.workunit.client.1.smithi135.stdout:3/953: readlink d8/d13/d75/d53/d6a/laf 0 2024-05-09T00:07:40.811 INFO:tasks.workunit.client.1.smithi135.stdout:3/954: chown d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d80/d84/f8d 70 1 2024-05-09T00:07:40.812 INFO:tasks.workunit.client.1.smithi135.stdout:3/955: truncate d8/d6d/d44/d4b/da0/daa/f12a 1032270 0 2024-05-09T00:07:40.812 INFO:tasks.workunit.client.1.smithi135.stdout:3/956: fdatasync d8/d102/f86 0 2024-05-09T00:07:40.815 INFO:tasks.workunit.client.1.smithi135.stdout:7/965: rmdir db/dd/d33/d68/d10a/d3a/d40/d7e 39 2024-05-09T00:07:40.817 INFO:tasks.workunit.client.1.smithi135.stdout:8/848: truncate d4/d22/f72 6612576 0 2024-05-09T00:07:40.818 INFO:tasks.workunit.client.1.smithi135.stdout:8/849: write d4/d7/d2a/d9f/f112 [666832,8095] 0 2024-05-09T00:07:40.818 INFO:tasks.workunit.client.1.smithi135.stdout:8/850: fdatasync d4/d7/d33/fea 0 2024-05-09T00:07:40.818 INFO:tasks.workunit.client.1.smithi135.stdout:8/851: chown d4/d22/f8c 3768614 1 2024-05-09T00:07:40.822 INFO:tasks.workunit.client.1.smithi135.stdout:7/966: creat db/dd/d33/d68/dde/f143 x:0 0 0 2024-05-09T00:07:40.823 INFO:tasks.workunit.client.1.smithi135.stdout:8/852: symlink d4/d8/da2/da6/db8/l121 0 2024-05-09T00:07:40.824 INFO:tasks.workunit.client.1.smithi135.stdout:8/853: creat d4/dc6/f122 x:0 0 0 2024-05-09T00:07:40.826 INFO:tasks.workunit.client.1.smithi135.stdout:8/854: mkdir d4/d7/d2a/d56/d123 0 2024-05-09T00:07:40.834 INFO:tasks.workunit.client.1.smithi135.stdout:3/957: dwrite d8/d102/fd6 [0,4194304] 0 2024-05-09T00:07:40.835 INFO:tasks.workunit.client.1.smithi135.stdout:5/904: unlink db/d24/d32/d5b/fea 0 2024-05-09T00:07:40.835 INFO:tasks.workunit.client.1.smithi135.stdout:5/905: fsync db/d84/d31/d5e/f55 0 2024-05-09T00:07:40.835 INFO:tasks.workunit.client.1.smithi135.stdout:5/906: dread - db/fb9 zero size 2024-05-09T00:07:40.836 INFO:tasks.workunit.client.1.smithi135.stdout:3/958: write d8/d13/d1f/f6b [5386162,77911] 0 2024-05-09T00:07:40.837 INFO:tasks.workunit.client.1.smithi135.stdout:5/907: mkdir db/d24/d32/d114/d11a 0 2024-05-09T00:07:40.844 INFO:tasks.workunit.client.1.smithi135.stdout:8/855: dwrite d4/d7/d2a/fb5 [0,4194304] 0 2024-05-09T00:07:40.847 INFO:tasks.workunit.client.1.smithi135.stdout:8/856: dread d4/d22/f27 [0,4194304] 0 2024-05-09T00:07:40.867 INFO:tasks.workunit.client.1.smithi135.stdout:3/959: creat d8/d6d/d44/d4b/d131/f152 x:0 0 0 2024-05-09T00:07:40.869 INFO:tasks.workunit.client.1.smithi135.stdout:5/908: mkdir db/d24/d32/dfa/d9c/d9f/d92/d11b 0 2024-05-09T00:07:40.869 INFO:tasks.workunit.client.1.smithi135.stdout:5/909: chown db/d84/c37 1073689 1 2024-05-09T00:07:40.872 INFO:tasks.workunit.client.1.smithi135.stdout:6/881: unlink d2/da/d49/lae 0 2024-05-09T00:07:40.874 INFO:tasks.workunit.client.1.smithi135.stdout:8/857: creat d4/d8/da2/da6/db8/dd1/f124 x:0 0 0 2024-05-09T00:07:40.884 INFO:tasks.workunit.client.1.smithi135.stdout:6/882: rename d2/da/d49/da4/dce/dd8/c108 to d2/d20/d37/d4e/d7c/c127 0 2024-05-09T00:07:40.884 INFO:tasks.workunit.client.1.smithi135.stdout:6/883: dread - d2/d20/d37/d4e/d7c/fa5 zero size 2024-05-09T00:07:40.885 INFO:tasks.workunit.client.1.smithi135.stdout:8/858: truncate d4/d7/de/f95 1031175 0 2024-05-09T00:07:40.885 INFO:tasks.workunit.client.1.smithi135.stdout:8/859: readlink d4/l90 0 2024-05-09T00:07:40.886 INFO:tasks.workunit.client.1.smithi135.stdout:6/884: truncate d2/f9 655339 0 2024-05-09T00:07:40.889 INFO:tasks.workunit.client.1.smithi135.stdout:5/910: dwrite db/d24/d32/fd4 [4194304,4194304] 0 2024-05-09T00:07:40.889 INFO:tasks.workunit.client.0.smithi026.stdout:7/344: rmdir d8 39 2024-05-09T00:07:40.890 INFO:tasks.workunit.client.1.smithi135.stdout:3/960: dwrite d8/d6d/d44/d4b/da0/daa/d88/f93 [0,4194304] 0 2024-05-09T00:07:40.890 INFO:tasks.workunit.client.1.smithi135.stdout:6/885: rmdir d2/d20/d2e 39 2024-05-09T00:07:40.890 INFO:tasks.workunit.client.1.smithi135.stdout:6/886: chown d2/da/d1d/d69/d89/cda 22 1 2024-05-09T00:07:40.890 INFO:tasks.workunit.client.1.smithi135.stdout:6/887: chown d2/da/d1d/d69/d78/c85 10040 1 2024-05-09T00:07:40.890 INFO:tasks.workunit.client.1.smithi135.stdout:8/860: dread d4/d7/de/d45/d76/de2/fe4 [0,4194304] 0 2024-05-09T00:07:40.891 INFO:tasks.workunit.client.0.smithi026.stdout:7/345: truncate d8/d1b/f2d 5775394 0 2024-05-09T00:07:40.895 INFO:tasks.workunit.client.0.smithi026.stdout:5/230: rename d2/d8/d36 to d2/d8/d31/d2e/d4a 0 2024-05-09T00:07:40.896 INFO:tasks.workunit.client.1.smithi135.stdout:3/961: creat d8/d102/d63/db9/d123/f153 x:0 0 0 2024-05-09T00:07:40.898 INFO:tasks.workunit.client.1.smithi135.stdout:3/962: dread d8/d13/d75/d53/f81 [0,4194304] 0 2024-05-09T00:07:40.899 INFO:tasks.workunit.client.0.smithi026.stdout:1/215: rename d5/c2f to d5/dd/d17/d29/c43 0 2024-05-09T00:07:40.899 INFO:tasks.workunit.client.0.smithi026.stdout:1/216: fsync d5/dd/d17/f2a 0 2024-05-09T00:07:40.907 INFO:tasks.workunit.client.1.smithi135.stdout:8/861: creat d4/d7/d2a/d56/dec/f125 x:0 0 0 2024-05-09T00:07:40.907 INFO:tasks.workunit.client.1.smithi135.stdout:6/888: creat d2/d20/d37/d4e/d9d/f128 x:0 0 0 2024-05-09T00:07:40.907 INFO:tasks.workunit.client.1.smithi135.stdout:6/889: chown d2/da/d49/da4/dce/dd8 501431 1 2024-05-09T00:07:40.908 INFO:tasks.workunit.client.1.smithi135.stdout:6/890: chown d2/da/d1d/d86 21869 1 2024-05-09T00:07:40.908 INFO:tasks.workunit.client.1.smithi135.stdout:6/891: truncate d2/da/d26/d57/ddc/ff5 1550101 0 2024-05-09T00:07:40.909 INFO:tasks.workunit.client.0.smithi026.stdout:8/233: rename de/d17/d21/d24/d3b/d45 to de/d17/d21/d24/d4b 0 2024-05-09T00:07:40.909 INFO:tasks.workunit.client.0.smithi026.stdout:8/234: readlink de/l19 0 2024-05-09T00:07:40.912 INFO:tasks.workunit.client.1.smithi135.stdout:3/963: rename d8/d102/d63/cd1 to d8/d6d/d11b/c154 0 2024-05-09T00:07:40.914 INFO:tasks.workunit.client.0.smithi026.stdout:5/231: mkdir d2/d8/d31/d4b 0 2024-05-09T00:07:40.917 INFO:tasks.workunit.client.1.smithi135.stdout:5/911: dwrite db/d24/d32/f44 [0,4194304] 0 2024-05-09T00:07:40.917 INFO:tasks.workunit.client.1.smithi135.stdout:5/912: fdatasync db/d24/f72 0 2024-05-09T00:07:40.917 INFO:tasks.workunit.client.1.smithi135.stdout:8/862: symlink d4/l126 0 2024-05-09T00:07:40.918 INFO:tasks.workunit.client.1.smithi135.stdout:6/892: rmdir d2/da/d26/d57/d59/d62 39 2024-05-09T00:07:40.919 INFO:tasks.workunit.client.0.smithi026.stdout:5/232: dread d2/f3 [0,4194304] 0 2024-05-09T00:07:40.920 INFO:tasks.workunit.client.1.smithi135.stdout:5/913: symlink db/d24/d32/d112/l11c 0 2024-05-09T00:07:40.921 INFO:tasks.workunit.client.0.smithi026.stdout:1/217: dwrite d5/dd/f3f [0,4194304] 0 2024-05-09T00:07:40.921 INFO:tasks.workunit.client.0.smithi026.stdout:1/218: dread - d5/dd/d1f/d39/f3d zero size 2024-05-09T00:07:40.923 INFO:tasks.workunit.client.1.smithi135.stdout:8/863: rename d4/l103 to d4/d8/d115/l127 0 2024-05-09T00:07:40.923 INFO:tasks.workunit.client.1.smithi135.stdout:8/864: chown d4/d7/de/c7e 24180041 1 2024-05-09T00:07:40.925 INFO:tasks.workunit.client.0.smithi026.stdout:1/219: write f3 [2113661,99378] 0 2024-05-09T00:07:40.925 INFO:tasks.workunit.client.0.smithi026.stdout:1/220: chown d5/db/d30/c35 3 1 2024-05-09T00:07:40.925 INFO:tasks.workunit.client.0.smithi026.stdout:5/233: mknod d2/d8/c4c 0 2024-05-09T00:07:40.926 INFO:tasks.workunit.client.1.smithi135.stdout:6/893: truncate d2/da/d1d/d69/f87 4478053 0 2024-05-09T00:07:40.927 INFO:tasks.workunit.client.1.smithi135.stdout:3/964: dwrite d8/d13/d75/d58/fa6 [0,4194304] 0 2024-05-09T00:07:40.929 INFO:tasks.workunit.client.1.smithi135.stdout:5/914: creat db/d24/d32/d118/f11d x:0 0 0 2024-05-09T00:07:40.932 INFO:tasks.workunit.client.0.smithi026.stdout:1/221: symlink d5/db/l44 0 2024-05-09T00:07:40.932 INFO:tasks.workunit.client.0.smithi026.stdout:1/222: write d5/dd/d1f/f2e [4624816,13167] 0 2024-05-09T00:07:40.934 INFO:tasks.workunit.client.1.smithi135.stdout:8/865: rmdir d4/d7/d33/d39/d120 0 2024-05-09T00:07:41.010 INFO:tasks.workunit.client.0.smithi026.stdout:5/234: truncate d2/fc 3185036 0 2024-05-09T00:07:41.013 INFO:tasks.workunit.client.1.smithi135.stdout:3/965: unlink d8/d6d/d24/f50 0 2024-05-09T00:07:41.013 INFO:tasks.workunit.client.1.smithi135.stdout:3/966: read d8/d13/d75/d53/f81 [61214,21045] 0 2024-05-09T00:07:41.015 INFO:tasks.workunit.client.1.smithi135.stdout:5/915: truncate db/d84/f41 159155 0 2024-05-09T00:07:41.018 INFO:tasks.workunit.client.0.smithi026.stdout:5/235: mknod d2/d8/c4d 0 2024-05-09T00:07:41.021 INFO:tasks.workunit.client.0.smithi026.stdout:1/223: mkdir d5/d16/d45 0 2024-05-09T00:07:41.023 INFO:tasks.workunit.client.0.smithi026.stdout:5/236: mkdir d2/d8/d2a/d4e 0 2024-05-09T00:07:41.026 INFO:tasks.workunit.client.0.smithi026.stdout:1/224: mknod d5/dd/d1f/d39/c46 0 2024-05-09T00:07:41.029 INFO:tasks.workunit.client.1.smithi135.stdout:8/866: symlink d4/d8/l128 0 2024-05-09T00:07:41.030 INFO:tasks.workunit.client.1.smithi135.stdout:6/894: symlink d2/d20/d3f/l129 0 2024-05-09T00:07:41.032 INFO:tasks.workunit.client.0.smithi026.stdout:1/225: mkdir d5/dd/d1f/d39/d47 0 2024-05-09T00:07:41.032 INFO:tasks.workunit.client.0.smithi026.stdout:1/226: truncate d5/f2c 1001193 0 2024-05-09T00:07:41.033 INFO:tasks.workunit.client.1.smithi135.stdout:5/916: dwrite db/d24/d32/f44 [4194304,4194304] 0 2024-05-09T00:07:41.033 INFO:tasks.workunit.client.1.smithi135.stdout:5/917: read - db/d24/d32/dfa/dbe/f109 zero size 2024-05-09T00:07:41.033 INFO:tasks.workunit.client.1.smithi135.stdout:3/967: link d8/d13/d75/d58/l135 d8/d6d/d24/l155 0 2024-05-09T00:07:41.033 INFO:tasks.workunit.client.1.smithi135.stdout:3/968: chown d8/d6d/d44/d4b/dc2/f111 834725403 1 2024-05-09T00:07:41.035 INFO:tasks.workunit.client.0.smithi026.stdout:9/247: write d7/d23/d29/d31/f32 [2655636,110481] 0 2024-05-09T00:07:41.036 INFO:tasks.workunit.client.0.smithi026.stdout:1/227: fsync d5/d16/f24 0 2024-05-09T00:07:41.039 INFO:tasks.workunit.client.0.smithi026.stdout:9/248: creat d7/d23/d29/d59/f5f x:0 0 0 2024-05-09T00:07:41.040 INFO:tasks.workunit.client.1.smithi135.stdout:8/867: getdents d4/d8/da2/dab 0 2024-05-09T00:07:41.043 INFO:tasks.workunit.client.1.smithi135.stdout:3/969: symlink d8/d6d/d44/d4b/da0/daa/d148/l156 0 2024-05-09T00:07:41.044 INFO:tasks.workunit.client.1.smithi135.stdout:8/868: getdents d4/d22/d8b 0 2024-05-09T00:07:41.046 INFO:tasks.workunit.client.1.smithi135.stdout:8/869: mkdir d4/d8/da2/da6/db8/d129 0 2024-05-09T00:07:41.046 INFO:tasks.workunit.client.1.smithi135.stdout:3/970: write d8/d6d/d44/d4b/da0/f104 [2311952,129056] 0 2024-05-09T00:07:41.047 INFO:tasks.workunit.client.1.smithi135.stdout:8/870: symlink d4/d22/d8b/l12a 0 2024-05-09T00:07:41.050 INFO:tasks.workunit.client.1.smithi135.stdout:8/871: rename d4/d7/d2a/d67/l85 to d4/d7/de/d45/l12b 0 2024-05-09T00:07:41.050 INFO:tasks.workunit.client.1.smithi135.stdout:8/872: fdatasync d4/d7/d2a/d56/f7c 0 2024-05-09T00:07:41.054 INFO:tasks.workunit.client.0.smithi026.stdout:9/249: dwrite d7/d23/d29/f30 [4194304,4194304] 0 2024-05-09T00:07:41.057 INFO:tasks.workunit.client.0.smithi026.stdout:9/250: truncate f2 355252 0 2024-05-09T00:07:41.058 INFO:tasks.workunit.client.0.smithi026.stdout:1/228: dread d5/dd/d1f/f21 [0,4194304] 0 2024-05-09T00:07:41.059 INFO:tasks.workunit.client.0.smithi026.stdout:9/251: creat d7/d23/d29/d59/f60 x:0 0 0 2024-05-09T00:07:41.061 INFO:tasks.workunit.client.0.smithi026.stdout:1/229: creat d5/db/d1d/f48 x:0 0 0 2024-05-09T00:07:41.062 INFO:tasks.workunit.client.0.smithi026.stdout:1/230: creat d5/dd/f49 x:0 0 0 2024-05-09T00:07:41.062 INFO:tasks.workunit.client.0.smithi026.stdout:1/231: readlink d5/l41 0 2024-05-09T00:07:41.063 INFO:tasks.workunit.client.0.smithi026.stdout:1/232: link d5/dd/l26 d5/l4a 0 2024-05-09T00:07:41.063 INFO:tasks.workunit.client.0.smithi026.stdout:1/233: fdatasync d5/dd/ff 0 2024-05-09T00:07:41.064 INFO:tasks.workunit.client.1.smithi135.stdout:3/971: dwrite d8/d6d/d44/f72 [0,4194304] 0 2024-05-09T00:07:41.064 INFO:tasks.workunit.client.1.smithi135.stdout:3/972: dread - d8/d6d/d44/d4b/da0/ff1 zero size 2024-05-09T00:07:41.065 INFO:tasks.workunit.client.0.smithi026.stdout:1/234: mknod d5/d16/c4b 0 2024-05-09T00:07:41.066 INFO:tasks.workunit.client.0.smithi026.stdout:1/235: symlink d5/db/d1d/l4c 0 2024-05-09T00:07:41.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.073+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f55c4101ed0 con 0x7f55c40faa20 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.074+0000 7f55baffd700 1 -- 172.21.15.26:0/47400604 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7f55b4052170 con 0x7f55c40faa20 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:07:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:07:41.070 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:07:41.071 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:07:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f55b0066dc0 msgr2=0x7f55b0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f55b0066dc0 0x7f55b0069280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f55c0004f10 tx=0x7f55c0009cb0).stop 2024-05-09T00:07:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c40faa20 msgr2=0x7f55c40f6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:41.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c40faa20 0x7f55c40f6430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f55b400b4b0 tx=0x7f55b40090f0).stop 2024-05-09T00:07:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 shutdown_connections 2024-05-09T00:07:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f55b0066dc0 0x7f55b0069280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55c40616f0 0x7f55c40f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 --2- 172.21.15.26:0/47400604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c40faa20 0x7f55c40f6430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 >> 172.21.15.26:0/47400604 conn(0x7f55c40f1f10 msgr2=0x7f55c40f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 shutdown_connections 2024-05-09T00:07:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.081+0000 7f55cbb56700 1 -- 172.21.15.26:0/47400604 wait complete. 2024-05-09T00:07:41.077 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:07:41.078 INFO:tasks.workunit.client.1.smithi135.stdout:4/777: getdents dc/d71/d86 0 2024-05-09T00:07:41.082 INFO:tasks.workunit.client.1.smithi135.stdout:4/778: read dc/f2d [2252091,7002] 0 2024-05-09T00:07:41.083 INFO:tasks.workunit.client.1.smithi135.stdout:4/779: creat dc/d26/d31/f100 x:0 0 0 2024-05-09T00:07:41.083 INFO:tasks.workunit.client.1.smithi135.stdout:4/780: write dc/d4a/d69/d55/d6d/dec/ff2 [127104,123254] 0 2024-05-09T00:07:41.083 INFO:tasks.workunit.client.0.smithi026.stdout:1/236: dwrite f3 [0,4194304] 0 2024-05-09T00:07:41.085 INFO:tasks.workunit.client.1.smithi135.stdout:3/973: dwrite d8/d13/d75/fec [0,4194304] 0 2024-05-09T00:07:41.086 INFO:tasks.workunit.client.1.smithi135.stdout:4/781: rename dc/d26/d31/db6 to dc/d26/d93/d9d/d101 0 2024-05-09T00:07:41.086 INFO:tasks.workunit.client.1.smithi135.stdout:4/782: dread - dc/dd/fbc zero size 2024-05-09T00:07:41.091 INFO:tasks.workunit.client.0.smithi026.stdout:1/237: rmdir d5/d16/d45 0 2024-05-09T00:07:41.091 INFO:tasks.workunit.client.0.smithi026.stdout:1/238: chown d5 1505576 1 2024-05-09T00:07:41.098 INFO:tasks.workunit.client.1.smithi135.stdout:3/974: rmdir d8/d6d/d44/d4b/dc2/d120/d129/d90 39 2024-05-09T00:07:41.098 INFO:tasks.workunit.client.1.smithi135.stdout:3/975: dread - d8/d13/d1f/d40/fee zero size 2024-05-09T00:07:41.102 INFO:tasks.workunit.client.1.smithi135.stdout:3/976: mknod d8/d13/d1f/d62/d10c/c157 0 2024-05-09T00:07:41.103 INFO:tasks.workunit.client.1.smithi135.stdout:3/977: rename d8/d13/d75/d53 to d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d13f/d158 0 2024-05-09T00:07:41.105 INFO:tasks.workunit.client.1.smithi135.stdout:3/978: creat d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d13f/d158/d6a/d116/f159 x:0 0 0 2024-05-09T00:07:41.106 INFO:tasks.workunit.client.1.smithi135.stdout:3/979: symlink d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d13f/d13b/l15a 0 2024-05-09T00:07:41.106 INFO:tasks.workunit.client.1.smithi135.stdout:3/980: stat d8/d6d/d44/d4b/d69/l5e 0 2024-05-09T00:07:41.106 INFO:tasks.workunit.client.1.smithi135.stdout:3/981: dread - d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/fc0 zero size 2024-05-09T00:07:41.111 INFO:tasks.workunit.client.1.smithi135.stdout:4/783: dwrite dc/d26/df4/f48 [0,4194304] 0 2024-05-09T00:07:41.113 INFO:tasks.workunit.client.1.smithi135.stdout:1/852: sync 2024-05-09T00:07:41.113 INFO:tasks.workunit.client.1.smithi135.stdout:0/825: sync 2024-05-09T00:07:41.113 INFO:tasks.workunit.client.1.smithi135.stdout:1/853: stat da/d14/d20/d38/d3a/ff6 0 2024-05-09T00:07:41.113 INFO:tasks.workunit.client.1.smithi135.stdout:1/854: read da/d24/fca [3733013,5642] 0 2024-05-09T00:07:41.114 INFO:tasks.workunit.client.1.smithi135.stdout:4/784: rename dc/d4a/d69/d55/fa3 to dc/d26/df4/f102 0 2024-05-09T00:07:41.115 INFO:tasks.workunit.client.1.smithi135.stdout:0/826: creat d3/dd/d2d/d4c/d84/ff0 x:0 0 0 2024-05-09T00:07:41.115 INFO:tasks.workunit.client.1.smithi135.stdout:0/827: fsync d3/f34 0 2024-05-09T00:07:41.116 INFO:tasks.workunit.client.1.smithi135.stdout:0/828: write d3/dd/d3f/d58/dae/fb8 [255886,95321] 0 2024-05-09T00:07:41.116 INFO:tasks.workunit.client.1.smithi135.stdout:0/829: write d3/dd/d2d/d4c/fe3 [976539,99550] 0 2024-05-09T00:07:41.117 INFO:tasks.workunit.client.1.smithi135.stdout:1/855: mkdir da/d10e/d128 0 2024-05-09T00:07:41.118 INFO:tasks.workunit.client.1.smithi135.stdout:4/785: symlink dc/l103 0 2024-05-09T00:07:41.118 INFO:tasks.workunit.client.1.smithi135.stdout:4/786: chown dc/d4a/d69/dac 0 1 2024-05-09T00:07:41.118 INFO:tasks.workunit.client.1.smithi135.stdout:1/856: write da/d14/f1a [5919676,123570] 0 2024-05-09T00:07:41.118 INFO:tasks.workunit.client.1.smithi135.stdout:1/857: chown da/d24/d27/d33/d48/c57 5 1 2024-05-09T00:07:41.120 INFO:tasks.workunit.client.1.smithi135.stdout:0/830: rename d3/dd/d3f/d58/dae/fb8 to d3/dd/d3f/d3a/da4/dc1/de6/ff1 0 2024-05-09T00:07:41.121 INFO:tasks.workunit.client.1.smithi135.stdout:0/831: read d3/dd/d3f/f7e [171157,120863] 0 2024-05-09T00:07:41.122 INFO:tasks.workunit.client.1.smithi135.stdout:4/787: unlink dc/c77 0 2024-05-09T00:07:41.126 INFO:tasks.workunit.client.1.smithi135.stdout:1/858: rename da/d24/d27/d33/d52/f80 to da/d14/d20/d38/d3a/f129 0 2024-05-09T00:07:41.127 INFO:tasks.workunit.client.1.smithi135.stdout:0/832: unlink d3/dd/f2f 0 2024-05-09T00:07:41.128 INFO:tasks.workunit.client.1.smithi135.stdout:1/859: write da/d14/f1a [2185380,122931] 0 2024-05-09T00:07:41.129 INFO:tasks.workunit.client.1.smithi135.stdout:0/833: mkdir d3/dd/d3f/d29/d7c/daa/df2 0 2024-05-09T00:07:41.130 INFO:tasks.workunit.client.1.smithi135.stdout:1/860: unlink da/db/c29 0 2024-05-09T00:07:41.131 INFO:tasks.workunit.client.1.smithi135.stdout:4/788: dread dc/d26/d31/f3c [0,4194304] 0 2024-05-09T00:07:41.131 INFO:tasks.workunit.client.1.smithi135.stdout:0/834: mknod d3/dd/d3f/d29/d7c/daa/df2/cf3 0 2024-05-09T00:07:41.136 INFO:tasks.workunit.client.1.smithi135.stdout:1/861: mkdir da/d24/d27/d33/d52/d12a 0 2024-05-09T00:07:41.140 INFO:tasks.workunit.client.1.smithi135.stdout:1/862: link da/f63 da/db/d107/f12b 0 2024-05-09T00:07:41.141 INFO:tasks.workunit.client.1.smithi135.stdout:1/863: creat da/d14/d20/d2c/f12c x:0 0 0 2024-05-09T00:07:41.144 INFO:tasks.workunit.client.1.smithi135.stdout:2/870: sync 2024-05-09T00:07:41.144 INFO:tasks.workunit.client.1.smithi135.stdout:1/864: dread da/db/d16/f3e [0,4194304] 0 2024-05-09T00:07:41.144 INFO:tasks.workunit.client.1.smithi135.stdout:0/835: dwrite d3/dd/d3f/f76 [4194304,4194304] 0 2024-05-09T00:07:41.145 INFO:tasks.workunit.client.1.smithi135.stdout:2/871: creat d1/d12/d21/d41/d6d/f126 x:0 0 0 2024-05-09T00:07:41.147 INFO:tasks.workunit.client.1.smithi135.stdout:1/865: mknod da/d24/dd0/d101/c12d 0 2024-05-09T00:07:41.168 INFO:tasks.workunit.client.1.smithi135.stdout:1/866: dwrite da/db/f64 [0,4194304] 0 2024-05-09T00:07:41.170 INFO:tasks.workunit.client.0.smithi026.stdout:7/346: dwrite d8/d1b/f2d [0,4194304] 0 2024-05-09T00:07:41.171 INFO:tasks.workunit.client.1.smithi135.stdout:1/867: mkdir da/db/d70/d12e 0 2024-05-09T00:07:41.171 INFO:tasks.workunit.client.1.smithi135.stdout:1/868: write da/d14/d20/d2c/f12c [235522,108208] 0 2024-05-09T00:07:41.173 INFO:tasks.workunit.client.0.smithi026.stdout:7/347: creat d8/d5c/f7d x:0 0 0 2024-05-09T00:07:41.173 INFO:tasks.workunit.client.1.smithi135.stdout:7/967: sync 2024-05-09T00:07:41.173 INFO:tasks.workunit.client.1.smithi135.stdout:9/790: sync 2024-05-09T00:07:41.173 INFO:tasks.workunit.client.1.smithi135.stdout:7/968: write db/dd/d33/d58/dc7/fff [575,46526] 0 2024-05-09T00:07:41.177 INFO:tasks.workunit.client.1.smithi135.stdout:9/791: getdents d1/d1a/d89/dad 0 2024-05-09T00:07:41.177 INFO:tasks.workunit.client.1.smithi135.stdout:9/792: truncate d1/d1a/d2c/d2d/de6/d6e/fee 576159 0 2024-05-09T00:07:41.181 INFO:tasks.workunit.client.1.smithi135.stdout:7/969: mknod db/dd/d33/d68/d10a/d3a/d40/d4c/da3/ded/c144 0 2024-05-09T00:07:41.181 INFO:tasks.workunit.client.1.smithi135.stdout:7/970: chown db/dd/d33/d68/d10a/d3a/d40/d4c/d67/dc8 453191075 1 2024-05-09T00:07:41.181 INFO:tasks.workunit.client.1.smithi135.stdout:7/971: truncate db/dd/d33/d68/d10a/d94/fe8 1209894 0 2024-05-09T00:07:41.181 INFO:tasks.workunit.client.1.smithi135.stdout:7/972: truncate db/dd/d33/d68/d10a/d3a/d40/d4c/f6b 297577 0 2024-05-09T00:07:41.181 INFO:tasks.workunit.client.1.smithi135.stdout:7/973: chown db/dd/d33/f9e 13 1 2024-05-09T00:07:41.182 INFO:tasks.workunit.client.1.smithi135.stdout:9/793: mkdir d1/d24/d44/dfe 0 2024-05-09T00:07:41.183 INFO:tasks.workunit.client.1.smithi135.stdout:7/974: mkdir db/dd/d33/d68/d10a/d3a/d40/d4c/d67/d145 0 2024-05-09T00:07:41.183 INFO:tasks.workunit.client.1.smithi135.stdout:7/975: stat db/dd/d33/da5/fac 0 2024-05-09T00:07:41.185 INFO:tasks.workunit.client.0.smithi026.stdout:0/350: sync 2024-05-09T00:07:41.185 INFO:tasks.workunit.client.1.smithi135.stdout:7/976: mknod db/dd/d33/d68/d10a/d94/c146 0 2024-05-09T00:07:41.188 INFO:tasks.workunit.client.0.smithi026.stdout:0/351: truncate d1d/d1e/d20/f68 760047 0 2024-05-09T00:07:41.188 INFO:tasks.workunit.client.0.smithi026.stdout:0/352: chown d1d/d25/l73 644565453 1 2024-05-09T00:07:41.191 INFO:tasks.workunit.client.1.smithi135.stdout:9/794: dread d1/d24/f35 [0,4194304] 0 2024-05-09T00:07:41.191 INFO:tasks.workunit.client.0.smithi026.stdout:0/353: link d1d/d1e/d2d/l50 d1d/d25/l76 0 2024-05-09T00:07:41.191 INFO:tasks.workunit.client.0.smithi026.stdout:0/354: truncate d1d/d25/f65 77426 0 2024-05-09T00:07:41.193 INFO:tasks.workunit.client.1.smithi135.stdout:9/795: write d1/d1a/d89/d99/fc4 [76282,116601] 0 2024-05-09T00:07:41.193 INFO:tasks.workunit.client.0.smithi026.stdout:0/355: creat d1d/d1e/d2d/f77 x:0 0 0 2024-05-09T00:07:41.194 INFO:tasks.workunit.client.1.smithi135.stdout:7/977: dread db/dd/d33/d68/d10a/ffb [0,4194304] 0 2024-05-09T00:07:41.198 INFO:tasks.workunit.client.1.smithi135.stdout:9/796: mknod d1/d1a/d10/d3c/d5c/cff 0 2024-05-09T00:07:41.198 INFO:tasks.workunit.client.1.smithi135.stdout:8/873: write d4/d8/f6b [728102,63046] 0 2024-05-09T00:07:41.198 INFO:tasks.workunit.client.1.smithi135.stdout:8/874: write d4/d7/fdc [497858,13774] 0 2024-05-09T00:07:41.199 INFO:tasks.workunit.client.1.smithi135.stdout:8/875: readlink d4/d8/lf0 0 2024-05-09T00:07:41.202 INFO:tasks.workunit.client.0.smithi026.stdout:7/348: dwrite d8/d2e/f4a [4194304,4194304] 0 2024-05-09T00:07:41.204 INFO:tasks.workunit.client.0.smithi026.stdout:7/349: getdents d8/d2e/d55/d22 0 2024-05-09T00:07:41.204 INFO:tasks.workunit.client.0.smithi026.stdout:7/350: readlink d8/d2e/d55/d1e/l59 0 2024-05-09T00:07:41.204 INFO:tasks.workunit.client.1.smithi135.stdout:1/869: dwrite da/d24/d27/d33/f98 [0,4194304] 0 2024-05-09T00:07:41.204 INFO:tasks.workunit.client.1.smithi135.stdout:8/876: dread d4/d7/d4a/ff6 [0,4194304] 0 2024-05-09T00:07:41.208 INFO:tasks.workunit.client.1.smithi135.stdout:8/877: truncate d4/d7/d33/f55 3783122 0 2024-05-09T00:07:41.209 INFO:tasks.workunit.client.0.smithi026.stdout:7/351: read d8/d2e/d55/d22/f42 [2746525,53010] 0 2024-05-09T00:07:41.209 INFO:tasks.workunit.client.0.smithi026.stdout:7/352: stat d8/d2e/d55/d1e/d3d/l46 0 2024-05-09T00:07:41.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/252: dread f2 [0,4194304] 0 2024-05-09T00:07:41.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/253: fsync d7/f4e 0 2024-05-09T00:07:41.209 INFO:tasks.workunit.client.1.smithi135.stdout:8/878: symlink d4/d7/d2a/d56/dec/dfe/d113/d11b/l12c 0 2024-05-09T00:07:41.210 INFO:tasks.workunit.client.1.smithi135.stdout:8/879: truncate d4/d7/d2a/d56/f61 3916600 0 2024-05-09T00:07:41.210 INFO:tasks.workunit.client.0.smithi026.stdout:7/353: write d8/d2e/d55/d22/d29/f1c [2265603,123334] 0 2024-05-09T00:07:41.211 INFO:tasks.workunit.client.0.smithi026.stdout:9/254: rename d7/d23/f36 to d7/d23/f61 0 2024-05-09T00:07:41.213 INFO:tasks.workunit.client.1.smithi135.stdout:8/880: unlink d4/d22/c107 0 2024-05-09T00:07:41.213 INFO:tasks.workunit.client.1.smithi135.stdout:8/881: chown d4/ld 3118 1 2024-05-09T00:07:41.213 INFO:tasks.workunit.client.1.smithi135.stdout:8/882: chown d4/d7/d2a/c6d 5676688 1 2024-05-09T00:07:41.213 INFO:tasks.workunit.client.1.smithi135.stdout:8/883: dread - d4/d22/f8a zero size 2024-05-09T00:07:41.215 INFO:tasks.workunit.client.0.smithi026.stdout:0/356: dwrite d1d/f3f [0,4194304] 0 2024-05-09T00:07:41.215 INFO:tasks.workunit.client.1.smithi135.stdout:9/797: dwrite d1/d24/d44/daf/fd6 [0,4194304] 0 2024-05-09T00:07:41.216 INFO:tasks.workunit.client.0.smithi026.stdout:9/255: getdents d7/d23/d29/d31/d40/d41/d54 0 2024-05-09T00:07:41.216 INFO:tasks.workunit.client.0.smithi026.stdout:9/256: write d7/f4e [62693,114313] 0 2024-05-09T00:07:41.218 INFO:tasks.workunit.client.1.smithi135.stdout:8/884: symlink d4/d8/da2/da6/dde/l12d 0 2024-05-09T00:07:41.218 INFO:tasks.workunit.client.1.smithi135.stdout:8/885: chown d4/d7/de/d45 7656 1 2024-05-09T00:07:41.221 INFO:tasks.workunit.client.0.smithi026.stdout:7/354: dread f7 [0,4194304] 0 2024-05-09T00:07:41.227 INFO:tasks.workunit.client.0.smithi026.stdout:0/357: mkdir d1d/d1e/d20/d4d/d58/d62/d78 0 2024-05-09T00:07:41.229 INFO:tasks.workunit.client.0.smithi026.stdout:3/208: sync 2024-05-09T00:07:41.229 INFO:tasks.workunit.client.0.smithi026.stdout:9/257: mknod d7/d23/d29/d31/d40/d41/d54/c62 0 2024-05-09T00:07:41.229 INFO:tasks.workunit.client.0.smithi026.stdout:9/258: read - d7/d23/d29/d2e/f47 zero size 2024-05-09T00:07:41.229 INFO:tasks.workunit.client.0.smithi026.stdout:9/259: write d7/d23/d2f/f45 [1075791,32156] 0 2024-05-09T00:07:41.231 INFO:tasks.workunit.client.0.smithi026.stdout:9/260: read d7/f19 [7415430,118407] 0 2024-05-09T00:07:41.231 INFO:tasks.workunit.client.1.smithi135.stdout:6/895: sync 2024-05-09T00:07:41.231 INFO:tasks.workunit.client.1.smithi135.stdout:5/918: sync 2024-05-09T00:07:41.231 INFO:tasks.workunit.client.1.smithi135.stdout:5/919: fdatasync db/d24/db0/f10a 0 2024-05-09T00:07:41.232 INFO:tasks.workunit.client.0.smithi026.stdout:7/355: getdents d8/d2e 0 2024-05-09T00:07:41.235 INFO:tasks.workunit.client.0.smithi026.stdout:3/209: mkdir d5/d9/d49 0 2024-05-09T00:07:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.241+0000 7fcecb328700 1 -- 172.21.15.26:0/2753420250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec40641f0 msgr2=0x7fcec4064610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.241+0000 7fcecb328700 1 --2- 172.21.15.26:0/2753420250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec40641f0 0x7fcec4064610 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fcec00047f0 tx=0x7fcec0009cb0).stop 2024-05-09T00:07:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.241+0000 7fcecb328700 1 -- 172.21.15.26:0/2753420250 shutdown_connections 2024-05-09T00:07:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.241+0000 7fcecb328700 1 --2- 172.21.15.26:0/2753420250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcec4064b00 0x7fcec4065580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.241+0000 7fcecb328700 1 --2- 172.21.15.26:0/2753420250 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec40641f0 0x7fcec4064610 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.241+0000 7fcecb328700 1 -- 172.21.15.26:0/2753420250 >> 172.21.15.26:0/2753420250 conn(0x7fcec4061b60 msgr2=0x7fcec4061f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.241+0000 7fcecb328700 1 -- 172.21.15.26:0/2753420250 shutdown_connections 2024-05-09T00:07:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.241+0000 7fcecb328700 1 -- 172.21.15.26:0/2753420250 wait complete. 2024-05-09T00:07:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.242+0000 7fcecb328700 1 Processor -- start 2024-05-09T00:07:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.242+0000 7fcecb328700 1 -- start start 2024-05-09T00:07:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.242+0000 7fcecb328700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcec40641f0 0x7fcec4116d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.242+0000 7fcecb328700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4064b00 0x7fcec4117280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.242+0000 7fcecb328700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec4117830 con 0x7fcec4064b00 2024-05-09T00:07:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.242+0000 7fcecb328700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec4117970 con 0x7fcec40641f0 2024-05-09T00:07:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.243+0000 7fcec88c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4064b00 0x7fcec4117280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.243+0000 7fcec88c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4064b00 0x7fcec4117280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56754/0 (socket says 172.21.15.26:56754) 2024-05-09T00:07:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.243+0000 7fcec88c3700 1 -- 172.21.15.26:0/1777945515 learned_addr learned my addr 172.21.15.26:0/1777945515 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.243+0000 7fcec88c3700 1 -- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcec40641f0 msgr2=0x7fcec4116d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:07:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.243+0000 7fcec88c3700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcec40641f0 0x7fcec4116d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:07:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.243+0000 7fcec88c3700 1 -- 172.21.15.26:0/1777945515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0005040 con 0x7fcec4064b00 2024-05-09T00:07:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.243+0000 7fcec88c3700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4064b00 0x7fcec4117280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fceb40041d0 tx=0x7fceb4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:41.240 INFO:tasks.workunit.client.1.smithi135.stdout:8/886: dwrite d4/d7/de/f7d [0,4194304] 0 2024-05-09T00:07:41.240 INFO:tasks.workunit.client.1.smithi135.stdout:8/887: truncate d4/d7/d4a/d9c/fe9 957924 0 2024-05-09T00:07:41.240 INFO:tasks.workunit.client.1.smithi135.stdout:8/888: dread - d4/d7/de/d45/d76/de2/fdd zero size 2024-05-09T00:07:41.240 INFO:tasks.workunit.client.1.smithi135.stdout:8/889: stat d4/d7/de/d45/d76 0 2024-05-09T00:07:41.240 INFO:tasks.workunit.client.0.smithi026.stdout:7/356: rename d8/d5c/l67 to d8/d2e/l7e 0 2024-05-09T00:07:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.245+0000 7fceba7fc700 1 -- 172.21.15.26:0/1777945515 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceb4002d90 con 0x7fcec4064b00 2024-05-09T00:07:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.245+0000 7fceba7fc700 1 -- 172.21.15.26:0/1777945515 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fceb400f040 con 0x7fcec4064b00 2024-05-09T00:07:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.245+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec411c410 con 0x7fcec4064b00 2024-05-09T00:07:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.245+0000 7fceba7fc700 1 -- 172.21.15.26:0/1777945515 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceb400d800 con 0x7fcec4064b00 2024-05-09T00:07:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.245+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec411c9d0 con 0x7fcec4064b00 2024-05-09T00:07:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.246+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec410ee40 con 0x7fcec4064b00 2024-05-09T00:07:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.248+0000 7fceba7fc700 1 -- 172.21.15.26:0/1777945515 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fceb400da70 con 0x7fcec4064b00 2024-05-09T00:07:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.248+0000 7fceba7fc700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fceb0066e60 0x7fceb0069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.248+0000 7fceba7fc700 1 -- 172.21.15.26:0/1777945515 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fceb4084720 con 0x7fcec4064b00 2024-05-09T00:07:41.245 INFO:tasks.workunit.client.1.smithi135.stdout:9/798: dwrite d1/d24/d44/d54/f69 [0,4194304] 0 2024-05-09T00:07:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.251+0000 7fcec90c4700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fceb0066e60 0x7fceb0069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.252+0000 7fcec90c4700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fceb0066e60 0x7fceb0069320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcec00047f0 tx=0x7fcec0009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:41.250 INFO:tasks.workunit.client.0.smithi026.stdout:0/358: dwrite d1d/d1e/d20/d51/f5c [0,4194304] 0 2024-05-09T00:07:41.250 INFO:tasks.workunit.client.1.smithi135.stdout:9/799: write d1/d1a/d2c/d20/f92 [2793908,88709] 0 2024-05-09T00:07:41.251 INFO:tasks.workunit.client.0.smithi026.stdout:3/210: mkdir d5/d9/d4a 0 2024-05-09T00:07:41.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.259+0000 7fceba7fc700 1 -- 172.21.15.26:0/1777945515 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7fceb4053400 con 0x7fcec4064b00 2024-05-09T00:07:41.258 INFO:tasks.workunit.client.0.smithi026.stdout:0/359: dread f10 [0,4194304] 0 2024-05-09T00:07:41.258 INFO:tasks.workunit.client.0.smithi026.stdout:0/360: write d1d/d33/f3a [465864,37434] 0 2024-05-09T00:07:41.259 INFO:tasks.workunit.client.0.smithi026.stdout:7/357: rmdir d8/d2e/d55/d22 39 2024-05-09T00:07:41.259 INFO:tasks.workunit.client.1.smithi135.stdout:5/920: dwrite db/fde [0,4194304] 0 2024-05-09T00:07:41.259 INFO:tasks.workunit.client.1.smithi135.stdout:5/921: readlink db/d84/d31/d5e/l100 0 2024-05-09T00:07:41.261 INFO:tasks.workunit.client.1.smithi135.stdout:6/896: mknod d2/d20/d37/d4e/d9d/c12a 0 2024-05-09T00:07:41.261 INFO:tasks.workunit.client.1.smithi135.stdout:6/897: write f1 [4393367,23340] 0 2024-05-09T00:07:41.261 INFO:tasks.workunit.client.1.smithi135.stdout:6/898: chown d2/da/d1d/d69/l74 15 1 2024-05-09T00:07:41.263 INFO:tasks.workunit.client.0.smithi026.stdout:3/211: dread d5/d41/f2d [0,4194304] 0 2024-05-09T00:07:41.263 INFO:tasks.workunit.client.0.smithi026.stdout:3/212: write d5/d1e/f3d [787252,58541] 0 2024-05-09T00:07:41.264 INFO:tasks.workunit.client.1.smithi135.stdout:6/899: dread d2/d20/d37/d4e/faa [0,4194304] 0 2024-05-09T00:07:41.265 INFO:tasks.workunit.client.0.smithi026.stdout:7/358: dread f7 [0,4194304] 0 2024-05-09T00:07:41.268 INFO:tasks.workunit.client.0.smithi026.stdout:0/361: creat d1d/d25/d3c/f79 x:0 0 0 2024-05-09T00:07:41.268 INFO:tasks.workunit.client.0.smithi026.stdout:0/362: fdatasync d1d/d25/f54 0 2024-05-09T00:07:41.268 INFO:tasks.workunit.client.0.smithi026.stdout:9/261: dwrite d7/f1d [0,4194304] 0 2024-05-09T00:07:41.268 INFO:tasks.workunit.client.0.smithi026.stdout:9/262: dread - d7/d23/d29/d2e/f47 zero size 2024-05-09T00:07:41.269 INFO:tasks.workunit.client.1.smithi135.stdout:8/890: mknod d4/d8/da2/c12e 0 2024-05-09T00:07:41.270 INFO:tasks.workunit.client.0.smithi026.stdout:3/213: creat d5/d9/dc/d28/d2c/f4b x:0 0 0 2024-05-09T00:07:41.274 INFO:tasks.workunit.client.1.smithi135.stdout:0/836: rename d3/dd/d3f/d29/d7c to d3/dd/d2d/db5/df4 0 2024-05-09T00:07:41.278 INFO:tasks.workunit.client.1.smithi135.stdout:9/800: truncate d1/d1a/d10/d3c/d5c/f63 104505 0 2024-05-09T00:07:41.279 INFO:tasks.workunit.client.1.smithi135.stdout:9/801: write d1/d1a/d2c/d20/f92 [3519142,111427] 0 2024-05-09T00:07:41.279 INFO:tasks.workunit.client.1.smithi135.stdout:9/802: fdatasync d1/d1a/d2c/f6d 0 2024-05-09T00:07:41.283 INFO:tasks.workunit.client.1.smithi135.stdout:0/837: dread d3/dd/d2d/f68 [0,4194304] 0 2024-05-09T00:07:41.283 INFO:tasks.workunit.client.1.smithi135.stdout:5/922: mknod db/d24/d32/d114/d11a/c11e 0 2024-05-09T00:07:41.285 INFO:tasks.workunit.client.1.smithi135.stdout:6/900: unlink d2/da/f3b 0 2024-05-09T00:07:41.288 INFO:tasks.workunit.client.1.smithi135.stdout:7/978: rename db/dd/d33/d68/d10a/d3a/d40/ce1 to db/dd/d33/d68/d10a/d109/c147 0 2024-05-09T00:07:41.291 INFO:tasks.workunit.client.1.smithi135.stdout:8/891: dwrite d4/d8/da2/fa9 [0,4194304] 0 2024-05-09T00:07:41.291 INFO:tasks.workunit.client.0.smithi026.stdout:9/263: symlink d7/d23/d2f/d50/l63 0 2024-05-09T00:07:41.291 INFO:tasks.workunit.client.0.smithi026.stdout:9/264: write d7/d23/f33 [1509902,10906] 0 2024-05-09T00:07:41.293 INFO:tasks.workunit.client.1.smithi135.stdout:0/838: rmdir d3/dd/d3f/d58/dae/dd3/deb 0 2024-05-09T00:07:41.298 INFO:tasks.workunit.client.0.smithi026.stdout:3/214: creat d5/d9/dc/d28/f4c x:0 0 0 2024-05-09T00:07:41.298 INFO:tasks.workunit.client.1.smithi135.stdout:8/892: write d4/d8/f1e [1508359,34022] 0 2024-05-09T00:07:41.298 INFO:tasks.workunit.client.1.smithi135.stdout:5/923: mkdir db/d24/d32/dfa/d9c/d9f/d92/d11b/d11f 0 2024-05-09T00:07:41.299 INFO:tasks.workunit.client.0.smithi026.stdout:7/359: link d8/d2e/f3c d8/d2e/d55/f7f 0 2024-05-09T00:07:41.301 INFO:tasks.workunit.client.1.smithi135.stdout:7/979: mknod db/dd/d33/d68/dde/c148 0 2024-05-09T00:07:41.303 INFO:tasks.workunit.client.1.smithi135.stdout:6/901: dwrite d2/da/d26/f55 [0,4194304] 0 2024-05-09T00:07:41.305 INFO:tasks.workunit.client.0.smithi026.stdout:7/360: mkdir d8/d2e/d55/d1e/d80 0 2024-05-09T00:07:41.307 INFO:tasks.workunit.client.1.smithi135.stdout:9/803: mknod d1/d1a/d10/db3/c100 0 2024-05-09T00:07:41.309 INFO:tasks.workunit.client.0.smithi026.stdout:3/215: rename d5/c26 to d5/c4d 0 2024-05-09T00:07:41.310 INFO:tasks.workunit.client.0.smithi026.stdout:3/216: write d5/fd [4198255,31462] 0 2024-05-09T00:07:41.311 INFO:tasks.workunit.client.1.smithi135.stdout:0/839: creat d3/d64/ff5 x:0 0 0 2024-05-09T00:07:41.311 INFO:tasks.workunit.client.1.smithi135.stdout:0/840: fsync d3/dd/d3f/d58/f71 0 2024-05-09T00:07:41.312 INFO:tasks.workunit.client.1.smithi135.stdout:0/841: write d3/dd/d3f/f33 [650106,94894] 0 2024-05-09T00:07:41.312 INFO:tasks.workunit.client.0.smithi026.stdout:9/265: dwrite d7/d23/f25 [0,4194304] 0 2024-05-09T00:07:41.313 INFO:tasks.workunit.client.1.smithi135.stdout:8/893: mkdir d4/d7/de/d45/dc5/d12f 0 2024-05-09T00:07:41.313 INFO:tasks.workunit.client.1.smithi135.stdout:8/894: chown d4/d7/de/d45/fac 0 1 2024-05-09T00:07:41.313 INFO:tasks.workunit.client.1.smithi135.stdout:8/895: stat d4/d22/fda 0 2024-05-09T00:07:41.317 INFO:tasks.workunit.client.1.smithi135.stdout:5/924: unlink db/d24/d32/dfa/d9c/fe2 0 2024-05-09T00:07:41.319 INFO:tasks.workunit.client.0.smithi026.stdout:3/217: rename d5/d41/c48 to d5/d44/c4e 0 2024-05-09T00:07:41.322 INFO:tasks.workunit.client.1.smithi135.stdout:7/980: unlink db/dd/d33/d68/d10a/d3a/f52 0 2024-05-09T00:07:41.322 INFO:tasks.workunit.client.1.smithi135.stdout:7/981: dread - db/d21/dd0/f141 zero size 2024-05-09T00:07:41.322 INFO:tasks.workunit.client.1.smithi135.stdout:7/982: fsync db/dd/d33/d58/f8d 0 2024-05-09T00:07:41.326 INFO:tasks.workunit.client.1.smithi135.stdout:1/870: rename da/d14/d20/f7c to da/d24/d27/d33/d52/f12f 0 2024-05-09T00:07:41.326 INFO:tasks.workunit.client.1.smithi135.stdout:1/871: readlink da/d14/d5c/ld9 0 2024-05-09T00:07:41.331 INFO:tasks.workunit.client.1.smithi135.stdout:6/902: dwrite d2/d20/d37/d4e/d9d/f128 [0,4194304] 0 2024-05-09T00:07:41.331 INFO:tasks.workunit.client.1.smithi135.stdout:6/903: chown d2/d20/d37 273273064 1 2024-05-09T00:07:41.331 INFO:tasks.workunit.client.0.smithi026.stdout:7/361: dwrite d8/ff [4194304,4194304] 0 2024-05-09T00:07:41.333 INFO:tasks.workunit.client.0.smithi026.stdout:9/266: symlink d7/d23/d2f/d3a/l64 0 2024-05-09T00:07:41.333 INFO:tasks.workunit.client.0.smithi026.stdout:9/267: chown d7/d23/d29/d31/d40/f48 2 1 2024-05-09T00:07:41.335 INFO:tasks.workunit.client.1.smithi135.stdout:8/896: rmdir d4/d8 39 2024-05-09T00:07:41.335 INFO:tasks.workunit.client.0.smithi026.stdout:9/268: dread d7/d23/f61 [0,4194304] 0 2024-05-09T00:07:41.335 INFO:tasks.workunit.client.0.smithi026.stdout:3/218: getdents d5/d1e/d3e 0 2024-05-09T00:07:41.336 INFO:tasks.workunit.client.1.smithi135.stdout:5/925: symlink db/d24/d32/d114/l120 0 2024-05-09T00:07:41.338 INFO:tasks.workunit.client.0.smithi026.stdout:7/362: unlink d8/d2e/d55/d22/d29/f1c 0 2024-05-09T00:07:41.340 INFO:tasks.workunit.client.1.smithi135.stdout:9/804: rename d1/d24/d44/d54/f55 to d1/d1a/d2c/d20/f101 0 2024-05-09T00:07:41.340 INFO:tasks.workunit.client.1.smithi135.stdout:9/805: write d1/d1a/d2c/d2d/de6/d6e/fee [1152178,107363] 0 2024-05-09T00:07:41.341 INFO:tasks.workunit.client.0.smithi026.stdout:9/269: link d7/d23/d2f/d3a/l64 d7/d23/d29/d31/d40/d41/l65 0 2024-05-09T00:07:41.341 INFO:tasks.workunit.client.0.smithi026.stdout:3/219: dread d5/d1e/f3d [0,4194304] 0 2024-05-09T00:07:41.341 INFO:tasks.workunit.client.0.smithi026.stdout:3/220: truncate d5/d9/ff 5439078 0 2024-05-09T00:07:41.342 INFO:tasks.workunit.client.1.smithi135.stdout:9/806: write d1/d1a/d2c/d2d/de6/f71 [2803055,37075] 0 2024-05-09T00:07:41.342 INFO:tasks.workunit.client.1.smithi135.stdout:9/807: fdatasync d1/d1a/d10/d3c/f4b 0 2024-05-09T00:07:41.342 INFO:tasks.workunit.client.0.smithi026.stdout:0/363: getdents d1d/d1e/d20/d4d/d58/d62 0 2024-05-09T00:07:41.346 INFO:tasks.workunit.client.0.smithi026.stdout:7/363: creat d8/d2e/d55/d1e/d80/f81 x:0 0 0 2024-05-09T00:07:41.352 INFO:tasks.workunit.client.0.smithi026.stdout:3/221: rename d5/d9/f33 to d5/d9/dc/d28/f4f 0 2024-05-09T00:07:41.353 INFO:tasks.workunit.client.0.smithi026.stdout:0/364: creat d1d/d25/d3c/f7a x:0 0 0 2024-05-09T00:07:41.353 INFO:tasks.workunit.client.0.smithi026.stdout:0/365: truncate d1d/d25/d3c/f46 1005898 0 2024-05-09T00:07:41.355 INFO:tasks.workunit.client.1.smithi135.stdout:5/926: dwrite db/d24/db0/f10a [0,4194304] 0 2024-05-09T00:07:41.355 INFO:tasks.workunit.client.1.smithi135.stdout:5/927: readlink db/d24/d32/d112/l11c 0 2024-05-09T00:07:41.356 INFO:tasks.workunit.client.0.smithi026.stdout:7/364: mkdir d8/d5c/d82 0 2024-05-09T00:07:41.357 INFO:tasks.workunit.client.1.smithi135.stdout:0/842: mknod d3/dd/d3f/d3a/cf6 0 2024-05-09T00:07:41.358 INFO:tasks.workunit.client.0.smithi026.stdout:9/270: mkdir d7/d23/d29/d31/d40/d41/d54/d5c/d66 0 2024-05-09T00:07:41.358 INFO:tasks.workunit.client.0.smithi026.stdout:9/271: write d7/d23/f61 [261979,119311] 0 2024-05-09T00:07:41.359 INFO:tasks.workunit.client.0.smithi026.stdout:9/272: chown d7/l15 317506 1 2024-05-09T00:07:41.362 INFO:tasks.workunit.client.0.smithi026.stdout:3/222: symlink d5/d1e/l50 0 2024-05-09T00:07:41.362 INFO:tasks.workunit.client.0.smithi026.stdout:3/223: write d5/d9/f42 [1662012,38048] 0 2024-05-09T00:07:41.362 INFO:tasks.workunit.client.1.smithi135.stdout:8/897: symlink d4/d7/de/d45/l130 0 2024-05-09T00:07:41.363 INFO:tasks.workunit.client.0.smithi026.stdout:0/366: mknod d1d/d25/d47/c7b 0 2024-05-09T00:07:41.363 INFO:tasks.workunit.client.0.smithi026.stdout:0/367: truncate f5 2619085 0 2024-05-09T00:07:41.364 INFO:tasks.workunit.client.1.smithi135.stdout:7/983: rename db/dd/d33/d68/d10a/d3a/d40/d4c/d67/c91 to db/dd/d33/da5/c149 0 2024-05-09T00:07:41.365 INFO:tasks.workunit.client.1.smithi135.stdout:7/984: dread db/dd/d33/d58/f8d [0,4194304] 0 2024-05-09T00:07:41.369 INFO:tasks.workunit.client.1.smithi135.stdout:3/982: sync 2024-05-09T00:07:41.369 INFO:tasks.workunit.client.1.smithi135.stdout:4/789: sync 2024-05-09T00:07:41.370 INFO:tasks.workunit.client.1.smithi135.stdout:3/983: getdents d8/d6d/d44/d4b/da0/daa/d14d 0 2024-05-09T00:07:41.370 INFO:tasks.workunit.client.1.smithi135.stdout:2/872: sync 2024-05-09T00:07:41.371 INFO:tasks.workunit.client.0.smithi026.stdout:9/273: symlink d7/d26/l67 0 2024-05-09T00:07:41.371 INFO:tasks.workunit.client.1.smithi135.stdout:2/873: dread d1/d22/f81 [0,4194304] 0 2024-05-09T00:07:41.372 INFO:tasks.workunit.client.1.smithi135.stdout:5/928: getdents db/d3f 0 2024-05-09T00:07:41.372 INFO:tasks.workunit.client.1.smithi135.stdout:9/808: write d1/d1a/f67 [815873,91753] 0 2024-05-09T00:07:41.373 INFO:tasks.workunit.client.0.smithi026.stdout:3/224: mknod d5/d9/d49/c51 0 2024-05-09T00:07:41.373 INFO:tasks.workunit.client.0.smithi026.stdout:3/225: write d5/d41/f37 [317457,75810] 0 2024-05-09T00:07:41.375 INFO:tasks.workunit.client.1.smithi135.stdout:0/843: symlink d3/dd/d2d/db5/df4/daa/df2/lf7 0 2024-05-09T00:07:41.375 INFO:tasks.workunit.client.1.smithi135.stdout:0/844: chown d3/dd/d3f/f21 4775 1 2024-05-09T00:07:41.375 INFO:tasks.workunit.client.0.smithi026.stdout:3/226: write d5/d9/f16 [2771798,36489] 0 2024-05-09T00:07:41.376 INFO:tasks.workunit.client.0.smithi026.stdout:0/368: creat d1d/d1e/d20/f7c x:0 0 0 2024-05-09T00:07:41.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/845: dread d3/dd/d3f/d58/dae/dd3/fdb [0,4194304] 0 2024-05-09T00:07:41.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/846: fdatasync d3/d9e/dd0/fe9 0 2024-05-09T00:07:41.377 INFO:tasks.workunit.client.1.smithi135.stdout:8/898: creat d4/d7/d2a/d56/f131 x:0 0 0 2024-05-09T00:07:41.378 INFO:tasks.workunit.client.0.smithi026.stdout:7/365: mknod d8/d2e/c83 0 2024-05-09T00:07:41.382 INFO:tasks.workunit.client.1.smithi135.stdout:6/904: rename d2/d20/d37/l5d to d2/d20/d37/d4e/d9d/l12b 0 2024-05-09T00:07:41.382 INFO:tasks.workunit.client.1.smithi135.stdout:6/905: fdatasync d2/da/d1d/d69/d78/fc9 0 2024-05-09T00:07:41.385 INFO:tasks.workunit.client.1.smithi135.stdout:7/985: mknod db/dd/d33/da5/c14a 0 2024-05-09T00:07:41.386 INFO:tasks.workunit.client.1.smithi135.stdout:9/809: dread d1/d1a/d2c/d2d/de6/f71 [0,4194304] 0 2024-05-09T00:07:41.387 INFO:tasks.workunit.client.0.smithi026.stdout:0/369: symlink d1d/d25/d47/l7d 0 2024-05-09T00:07:41.387 INFO:tasks.workunit.client.0.smithi026.stdout:9/274: dread d7/f1f [0,4194304] 0 2024-05-09T00:07:41.387 INFO:tasks.workunit.client.0.smithi026.stdout:9/275: write d7/d23/d29/d59/f5f [289188,18596] 0 2024-05-09T00:07:41.388 INFO:tasks.workunit.client.1.smithi135.stdout:3/984: truncate d8/d6d/f28 702977 0 2024-05-09T00:07:41.389 INFO:tasks.workunit.client.0.smithi026.stdout:4/214: sync 2024-05-09T00:07:41.390 INFO:tasks.workunit.client.0.smithi026.stdout:2/205: sync 2024-05-09T00:07:41.390 INFO:tasks.workunit.client.0.smithi026.stdout:4/215: dread - d0/d19/d43/f44 zero size 2024-05-09T00:07:41.395 INFO:tasks.workunit.client.1.smithi135.stdout:2/874: unlink d1/d12/d20/f68 0 2024-05-09T00:07:41.396 INFO:tasks.workunit.client.1.smithi135.stdout:2/875: write d1/d12/d20/d2b/d7c/db5/f7a [2713983,104416] 0 2024-05-09T00:07:41.398 INFO:tasks.workunit.client.0.smithi026.stdout:0/370: creat d1d/d25/f7e x:0 0 0 2024-05-09T00:07:41.398 INFO:tasks.workunit.client.0.smithi026.stdout:0/371: dread - d1d/d1e/d20/d4d/f6f zero size 2024-05-09T00:07:41.401 INFO:tasks.workunit.client.0.smithi026.stdout:3/227: dwrite d5/d9/dc/f11 [0,4194304] 0 2024-05-09T00:07:41.402 INFO:tasks.workunit.client.1.smithi135.stdout:5/929: unlink db/d24/l115 0 2024-05-09T00:07:41.402 INFO:tasks.workunit.client.1.smithi135.stdout:5/930: write db/d84/faf [2165133,77497] 0 2024-05-09T00:07:41.404 INFO:tasks.workunit.client.0.smithi026.stdout:9/276: symlink d7/d23/l68 0 2024-05-09T00:07:41.407 INFO:tasks.workunit.client.0.smithi026.stdout:7/366: mkdir d8/d2e/d84 0 2024-05-09T00:07:41.407 INFO:tasks.workunit.client.0.smithi026.stdout:7/367: chown d8/d2e/d55/d22/l72 49662 1 2024-05-09T00:07:41.408 INFO:tasks.workunit.client.0.smithi026.stdout:7/368: read d8/f1f [3316915,4216] 0 2024-05-09T00:07:41.408 INFO:tasks.workunit.client.0.smithi026.stdout:7/369: chown d8/d2e/d55/d1e/c69 1488 1 2024-05-09T00:07:41.408 INFO:tasks.workunit.client.0.smithi026.stdout:7/370: chown d8/d1b/c77 1 1 2024-05-09T00:07:41.409 INFO:tasks.workunit.client.1.smithi135.stdout:4/790: rename dc/d26/d31/d82/fcd to dc/d4a/d69/d55/dc9/f104 0 2024-05-09T00:07:41.409 INFO:tasks.workunit.client.1.smithi135.stdout:5/931: dread db/d84/f49 [0,4194304] 0 2024-05-09T00:07:41.410 INFO:tasks.workunit.client.0.smithi026.stdout:4/216: creat d0/d12/d1b/d2b/f48 x:0 0 0 2024-05-09T00:07:41.412 INFO:tasks.workunit.client.0.smithi026.stdout:2/206: dwrite fd [0,4194304] 0 2024-05-09T00:07:41.412 INFO:tasks.workunit.client.1.smithi135.stdout:6/906: creat d2/da/d49/f12c x:0 0 0 2024-05-09T00:07:41.413 INFO:tasks.workunit.client.0.smithi026.stdout:0/372: truncate d1d/d33/f3a 392189 0 2024-05-09T00:07:41.413 INFO:tasks.workunit.client.0.smithi026.stdout:0/373: chown f1b 15 1 2024-05-09T00:07:41.415 INFO:tasks.workunit.client.1.smithi135.stdout:3/985: dwrite d8/d13/d1f/d40/d52/f7d [0,4194304] 0 2024-05-09T00:07:41.416 INFO:tasks.workunit.client.1.smithi135.stdout:7/986: link db/dd/ccf db/dd/d33/d58/db5/c14b 0 2024-05-09T00:07:41.416 INFO:tasks.workunit.client.1.smithi135.stdout:7/987: chown db/ff1 6577996 1 2024-05-09T00:07:41.421 INFO:tasks.workunit.client.1.smithi135.stdout:2/876: symlink d1/d12/d20/d2b/dbb/l127 0 2024-05-09T00:07:41.427 INFO:tasks.workunit.client.1.smithi135.stdout:0/847: rename d3/d9e/dd0 to d3/dd/d2d/db5/df8 0 2024-05-09T00:07:41.429 INFO:tasks.workunit.client.1.smithi135.stdout:4/791: truncate dc/d4a/d69/d55/fab 390858 0 2024-05-09T00:07:41.430 INFO:tasks.workunit.client.1.smithi135.stdout:6/907: mkdir d2/d5f/d12d 0 2024-05-09T00:07:41.432 INFO:tasks.workunit.client.0.smithi026.stdout:9/277: symlink d7/d23/d2f/l69 0 2024-05-09T00:07:41.434 INFO:tasks.workunit.client.1.smithi135.stdout:6/908: dread d2/da/d26/d57/ddc/ff5 [0,4194304] 0 2024-05-09T00:07:41.437 INFO:tasks.workunit.client.0.smithi026.stdout:7/371: creat d8/d2e/d55/d22/f85 x:0 0 0 2024-05-09T00:07:41.438 INFO:tasks.workunit.client.1.smithi135.stdout:3/986: symlink d8/d6d/d44/d4b/da0/daa/d88/l15b 0 2024-05-09T00:07:41.442 INFO:tasks.workunit.client.0.smithi026.stdout:4/217: truncate d0/d12/d1b/d2b/f2d 216091 0 2024-05-09T00:07:41.444 INFO:tasks.workunit.client.1.smithi135.stdout:0/848: dread d3/dd/d3f/f21 [0,4194304] 0 2024-05-09T00:07:41.444 INFO:tasks.workunit.client.1.smithi135.stdout:7/988: dwrite db/da8/f134 [0,4194304] 0 2024-05-09T00:07:41.449 INFO:tasks.workunit.client.1.smithi135.stdout:0/849: rmdir d3/dd/d3f/d43 39 2024-05-09T00:07:41.451 INFO:tasks.workunit.client.0.smithi026.stdout:2/207: mkdir d14/d22/d55 0 2024-05-09T00:07:41.451 INFO:tasks.workunit.client.0.smithi026.stdout:2/208: fdatasync d14/d15/d3b/f3f 0 2024-05-09T00:07:41.455 INFO:tasks.workunit.client.0.smithi026.stdout:0/374: rename d1d/d25/d47/l56 to d1d/d25/l7f 0 2024-05-09T00:07:41.455 INFO:tasks.workunit.client.0.smithi026.stdout:0/375: write d1d/d25/d3c/f46 [2017317,63453] 0 2024-05-09T00:07:41.455 INFO:tasks.workunit.client.1.smithi135.stdout:9/810: dwrite d1/d1a/d10/fa7 [4194304,4194304] 0 2024-05-09T00:07:41.458 INFO:tasks.workunit.client.1.smithi135.stdout:0/850: getdents d3/dd/d3f/d3a/da4/dc1/de6 0 2024-05-09T00:07:41.462 INFO:tasks.workunit.client.0.smithi026.stdout:3/228: link d5/d9/dc/d28/f4c d5/d9/d4a/f52 0 2024-05-09T00:07:41.462 INFO:tasks.workunit.client.0.smithi026.stdout:3/229: truncate d5/f39 141199 0 2024-05-09T00:07:41.462 INFO:tasks.workunit.client.1.smithi135.stdout:4/792: dwrite dc/d26/d31/ffe [0,4194304] 0 2024-05-09T00:07:41.463 INFO:tasks.workunit.client.1.smithi135.stdout:4/793: write dc/dd/fbc [1011143,36278] 0 2024-05-09T00:07:41.464 INFO:tasks.workunit.client.0.smithi026.stdout:4/218: mkdir d0/d19/d43/d49 0 2024-05-09T00:07:41.465 INFO:tasks.workunit.client.1.smithi135.stdout:6/909: dwrite d2/da/d49/fc6 [0,4194304] 0 2024-05-09T00:07:41.465 INFO:tasks.workunit.client.1.smithi135.stdout:6/910: fdatasync d2/da/d1d/fab 0 2024-05-09T00:07:41.465 INFO:tasks.workunit.client.0.smithi026.stdout:4/219: read d0/fc [1727869,18678] 0 2024-05-09T00:07:41.466 INFO:tasks.workunit.client.0.smithi026.stdout:3/230: read d5/fd [834233,116324] 0 2024-05-09T00:07:41.466 INFO:tasks.workunit.client.0.smithi026.stdout:3/231: write d5/d9/dc/d28/f2e [965888,129073] 0 2024-05-09T00:07:41.467 INFO:tasks.workunit.client.0.smithi026.stdout:7/372: dwrite d8/d2e/d55/d1e/f32 [0,4194304] 0 2024-05-09T00:07:41.471 INFO:tasks.workunit.client.0.smithi026.stdout:2/209: rename d14/d15/d1f/f4a to d14/d22/d55/f56 0 2024-05-09T00:07:41.471 INFO:tasks.workunit.client.0.smithi026.stdout:2/210: stat fc 0 2024-05-09T00:07:41.477 INFO:tasks.workunit.client.0.smithi026.stdout:0/376: getdents d1d/d25/d3c 0 2024-05-09T00:07:41.477 INFO:tasks.workunit.client.0.smithi026.stdout:0/377: chown d1d/d1e/d20/d51/f6c 820 1 2024-05-09T00:07:41.480 INFO:tasks.workunit.client.0.smithi026.stdout:4/220: mknod d0/d12/d34/c4a 0 2024-05-09T00:07:41.480 INFO:tasks.workunit.client.0.smithi026.stdout:4/221: write d0/d12/f2c [2296743,64738] 0 2024-05-09T00:07:41.480 INFO:tasks.workunit.client.0.smithi026.stdout:4/222: fsync d0/f22 0 2024-05-09T00:07:41.481 INFO:tasks.workunit.client.1.smithi135.stdout:6/911: dread d2/f76 [0,4194304] 0 2024-05-09T00:07:41.484 INFO:tasks.workunit.client.0.smithi026.stdout:3/232: symlink d5/d9/dc/l53 0 2024-05-09T00:07:41.484 INFO:tasks.workunit.client.0.smithi026.stdout:3/233: dread - d5/d41/f47 zero size 2024-05-09T00:07:41.485 INFO:tasks.workunit.client.1.smithi135.stdout:6/912: dread d2/d20/d37/d4e/f6a [0,4194304] 0 2024-05-09T00:07:41.486 INFO:tasks.workunit.client.0.smithi026.stdout:0/378: unlink d1d/d1e/d2d/l41 0 2024-05-09T00:07:41.486 INFO:tasks.workunit.client.0.smithi026.stdout:0/379: stat d1d/d1e/d2d/f77 0 2024-05-09T00:07:41.488 INFO:tasks.workunit.client.1.smithi135.stdout:3/987: dwrite d8/fb4 [0,4194304] 0 2024-05-09T00:07:41.490 INFO:tasks.workunit.client.1.smithi135.stdout:6/913: rmdir d2/da/d1d/d86 39 2024-05-09T00:07:41.491 INFO:tasks.workunit.client.1.smithi135.stdout:4/794: dread dc/dd/fbc [0,4194304] 0 2024-05-09T00:07:41.491 INFO:tasks.workunit.client.1.smithi135.stdout:4/795: chown dc/d4a/fa4 25 1 2024-05-09T00:07:41.491 INFO:tasks.workunit.client.1.smithi135.stdout:4/796: stat dc/l73 0 2024-05-09T00:07:41.491 INFO:tasks.workunit.client.1.smithi135.stdout:4/797: chown dc/d4a/d69/f70 347214 1 2024-05-09T00:07:41.491 INFO:tasks.workunit.client.0.smithi026.stdout:3/234: mknod d5/d41/c54 0 2024-05-09T00:07:41.492 INFO:tasks.workunit.client.0.smithi026.stdout:4/223: symlink d0/d12/d1b/d2b/l4b 0 2024-05-09T00:07:41.496 INFO:tasks.workunit.client.0.smithi026.stdout:4/224: creat d0/f4c x:0 0 0 2024-05-09T00:07:41.498 INFO:tasks.workunit.client.1.smithi135.stdout:9/811: dwrite d1/d1a/d10/d3c/d5c/fae [0,4194304] 0 2024-05-09T00:07:41.499 INFO:tasks.workunit.client.1.smithi135.stdout:0/851: dwrite d3/dd/f7b [0,4194304] 0 2024-05-09T00:07:41.502 INFO:tasks.workunit.client.0.smithi026.stdout:7/373: dwrite d8/d5c/f7d [0,4194304] 0 2024-05-09T00:07:41.502 INFO:tasks.workunit.client.0.smithi026.stdout:2/211: dwrite d14/d15/d1f/f28 [0,4194304] 0 2024-05-09T00:07:41.502 INFO:tasks.workunit.client.1.smithi135.stdout:7/989: dwrite db/dd/d33/d68/d10a/d94/f129 [0,4194304] 0 2024-05-09T00:07:41.502 INFO:tasks.workunit.client.1.smithi135.stdout:3/988: symlink d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d13f/d158/d6a/l15c 0 2024-05-09T00:07:41.503 INFO:tasks.workunit.client.0.smithi026.stdout:7/374: write d8/d2e/d55/d1e/f43 [1216669,39300] 0 2024-05-09T00:07:41.504 INFO:tasks.workunit.client.1.smithi135.stdout:6/914: creat d2/da/d49/da4/dce/f12e x:0 0 0 2024-05-09T00:07:41.507 INFO:tasks.workunit.client.0.smithi026.stdout:3/235: dwrite f0 [0,4194304] 0 2024-05-09T00:07:41.509 INFO:tasks.workunit.client.0.smithi026.stdout:2/212: unlink d14/f37 0 2024-05-09T00:07:41.511 INFO:tasks.workunit.client.1.smithi135.stdout:9/812: mkdir d1/d1a/d10/d3c/d102 0 2024-05-09T00:07:41.515 INFO:tasks.workunit.client.1.smithi135.stdout:4/798: unlink dc/d4a/d69/d55/dc9/f104 0 2024-05-09T00:07:41.517 INFO:tasks.workunit.client.0.smithi026.stdout:7/375: rmdir d8/d2e/d55/d1e 39 2024-05-09T00:07:41.518 INFO:tasks.workunit.client.0.smithi026.stdout:0/380: fsync d1d/d33/f3a 0 2024-05-09T00:07:41.519 INFO:tasks.workunit.client.0.smithi026.stdout:0/381: write d1d/d25/d3c/f7a [911603,2293] 0 2024-05-09T00:07:41.521 INFO:tasks.workunit.client.0.smithi026.stdout:2/213: rmdir d14/d15/d3b/d40 39 2024-05-09T00:07:41.521 INFO:tasks.workunit.client.0.smithi026.stdout:2/214: write d14/d15/d1f/f38 [289242,24028] 0 2024-05-09T00:07:41.522 INFO:tasks.workunit.client.1.smithi135.stdout:0/852: truncate d3/dd/d3f/d3a/f48 5295361 0 2024-05-09T00:07:41.522 INFO:tasks.workunit.client.0.smithi026.stdout:7/376: creat d8/d5c/d82/f86 x:0 0 0 2024-05-09T00:07:41.524 INFO:tasks.workunit.client.0.smithi026.stdout:2/215: rmdir d14/d15/d30 39 2024-05-09T00:07:41.526 INFO:tasks.workunit.client.1.smithi135.stdout:4/799: dread dc/f2d [0,4194304] 0 2024-05-09T00:07:41.526 INFO:tasks.workunit.client.1.smithi135.stdout:1/872: sync 2024-05-09T00:07:41.527 INFO:tasks.workunit.client.0.smithi026.stdout:7/377: creat d8/d2e/f87 x:0 0 0 2024-05-09T00:07:41.530 INFO:tasks.workunit.client.0.smithi026.stdout:6/215: sync 2024-05-09T00:07:41.530 INFO:tasks.workunit.client.0.smithi026.stdout:8/235: sync 2024-05-09T00:07:41.530 INFO:tasks.workunit.client.1.smithi135.stdout:7/990: mkdir db/dd/d33/d68/d10a/d3a/d130/d14c 0 2024-05-09T00:07:41.531 INFO:tasks.workunit.client.1.smithi135.stdout:3/989: mknod d8/d102/d92/c15d 0 2024-05-09T00:07:41.536 INFO:tasks.workunit.client.0.smithi026.stdout:8/236: rename de/f14 to de/d48/d3e/f4c 0 2024-05-09T00:07:41.540 INFO:tasks.workunit.client.0.smithi026.stdout:2/216: dread f4 [0,4194304] 0 2024-05-09T00:07:41.541 INFO:tasks.workunit.client.0.smithi026.stdout:3/236: dwrite d5/d9/d4a/f52 [0,4194304] 0 2024-05-09T00:07:41.542 INFO:tasks.workunit.client.1.smithi135.stdout:9/813: dwrite d1/d1a/d10/db3/ff3 [0,4194304] 0 2024-05-09T00:07:41.542 INFO:tasks.workunit.client.1.smithi135.stdout:7/991: dread db/dd/d33/da5/fc6 [0,4194304] 0 2024-05-09T00:07:41.542 INFO:tasks.workunit.client.1.smithi135.stdout:6/915: mknod d2/da/d49/da4/dce/c12f 0 2024-05-09T00:07:41.542 INFO:tasks.workunit.client.0.smithi026.stdout:3/237: write f2 [4508102,35073] 0 2024-05-09T00:07:41.543 INFO:tasks.workunit.client.0.smithi026.stdout:3/238: fsync d5/d9/dc/d28/d2c/f4b 0 2024-05-09T00:07:41.546 INFO:tasks.workunit.client.1.smithi135.stdout:6/916: write d2/d20/d3f/d4f/d7f/fca [134046,83958] 0 2024-05-09T00:07:41.546 INFO:tasks.workunit.client.1.smithi135.stdout:6/917: chown d2/d20/d37 0 1 2024-05-09T00:07:41.546 INFO:tasks.workunit.client.0.smithi026.stdout:8/237: unlink de/d17/c49 0 2024-05-09T00:07:41.548 INFO:tasks.workunit.client.1.smithi135.stdout:0/853: link d3/dd/d3f/d58/fb3 d3/dd/d3f/d3a/da4/de2/ff9 0 2024-05-09T00:07:41.548 INFO:tasks.workunit.client.1.smithi135.stdout:0/854: stat d3/dd/fc0 0 2024-05-09T00:07:41.548 INFO:tasks.workunit.client.1.smithi135.stdout:0/855: chown d3/dd/d2d/l3c 109 1 2024-05-09T00:07:41.552 INFO:tasks.workunit.client.0.smithi026.stdout:8/238: dread de/f1e [0,4194304] 0 2024-05-09T00:07:41.553 INFO:tasks.workunit.client.1.smithi135.stdout:1/873: dwrite da/db/d70/f10c [0,4194304] 0 2024-05-09T00:07:41.554 INFO:tasks.workunit.client.0.smithi026.stdout:8/239: dread de/f1e [0,4194304] 0 2024-05-09T00:07:41.554 INFO:tasks.workunit.client.0.smithi026.stdout:7/378: dwrite d8/d1b/f37 [0,4194304] 0 2024-05-09T00:07:41.555 INFO:tasks.workunit.client.0.smithi026.stdout:6/216: dwrite f1 [4194304,4194304] 0 2024-05-09T00:07:41.555 INFO:tasks.workunit.client.1.smithi135.stdout:7/992: dread db/dd/d33/d58/db5/fdf [0,4194304] 0 2024-05-09T00:07:41.556 INFO:tasks.workunit.client.1.smithi135.stdout:1/874: write da/f62 [1395535,11556] 0 2024-05-09T00:07:41.556 INFO:tasks.workunit.client.1.smithi135.stdout:9/814: symlink d1/d24/d44/d54/l103 0 2024-05-09T00:07:41.556 INFO:tasks.workunit.client.1.smithi135.stdout:9/815: chown d1/d24/d44/d54/f69 49485 1 2024-05-09T00:07:41.556 INFO:tasks.workunit.client.1.smithi135.stdout:9/816: fdatasync d1/d24/d86/d97/fcf 0 2024-05-09T00:07:41.557 INFO:tasks.workunit.client.1.smithi135.stdout:6/918: rmdir d2/da/d1d/d86 39 2024-05-09T00:07:41.559 INFO:tasks.workunit.client.0.smithi026.stdout:3/239: creat d5/d9/dc/d28/d2c/f55 x:0 0 0 2024-05-09T00:07:41.560 INFO:tasks.workunit.client.0.smithi026.stdout:3/240: readlink d5/d9/dc/l53 0 2024-05-09T00:07:41.560 INFO:tasks.workunit.client.1.smithi135.stdout:0/856: dread d3/dd/d3f/f76 [0,4194304] 0 2024-05-09T00:07:41.560 INFO:tasks.workunit.client.0.smithi026.stdout:5/237: sync 2024-05-09T00:07:41.560 INFO:tasks.workunit.client.0.smithi026.stdout:1/239: sync 2024-05-09T00:07:41.560 INFO:tasks.workunit.client.0.smithi026.stdout:5/238: fsync d2/d8/d31/d2e/d4a/f3c 0 2024-05-09T00:07:41.561 INFO:tasks.workunit.client.0.smithi026.stdout:4/225: getdents d0/d19/d43 0 2024-05-09T00:07:41.562 INFO:tasks.workunit.client.0.smithi026.stdout:5/239: write d2/d8/d31/f1f [3626159,125232] 0 2024-05-09T00:07:41.562 INFO:tasks.workunit.client.1.smithi135.stdout:0/857: dread d3/dd/d3f/d58/f5c [0,4194304] 0 2024-05-09T00:07:41.562 INFO:tasks.workunit.client.1.smithi135.stdout:0/858: fdatasync d3/dd/d2d/f49 0 2024-05-09T00:07:41.562 INFO:tasks.workunit.client.1.smithi135.stdout:0/859: write d3/dd/d3f/d58/dae/dd3/fdb [830960,14771] 0 2024-05-09T00:07:41.563 INFO:tasks.workunit.client.1.smithi135.stdout:0/860: chown d3/dd/d3f/d29/d54/l78 3 1 2024-05-09T00:07:41.563 INFO:tasks.workunit.client.0.smithi026.stdout:5/240: write d2/d8/d31/f12 [2669057,15528] 0 2024-05-09T00:07:41.563 INFO:tasks.workunit.client.0.smithi026.stdout:5/241: write d2/f44 [69973,58435] 0 2024-05-09T00:07:41.564 INFO:tasks.workunit.client.1.smithi135.stdout:7/993: dread db/dd/d33/d68/d10a/f7c [0,4194304] 0 2024-05-09T00:07:41.564 INFO:tasks.workunit.client.1.smithi135.stdout:7/994: stat db/dd/d33/d68/d10a/d3a/d40/d4c/da3/ded/ff7 0 2024-05-09T00:07:41.565 INFO:tasks.workunit.client.0.smithi026.stdout:2/217: rmdir d14/d15 39 2024-05-09T00:07:41.566 INFO:tasks.workunit.client.1.smithi135.stdout:7/995: write db/dd/d33/d68/d10a/d94/f9a [2833628,85253] 0 2024-05-09T00:07:41.568 INFO:tasks.workunit.client.1.smithi135.stdout:1/875: unlink da/d14/d20/f2b 0 2024-05-09T00:07:41.569 INFO:tasks.workunit.client.0.smithi026.stdout:5/242: fdatasync d2/d8/d31/f12 0 2024-05-09T00:07:41.569 INFO:tasks.workunit.client.0.smithi026.stdout:8/240: creat de/d17/d21/d24/d4b/f4d x:0 0 0 2024-05-09T00:07:41.570 INFO:tasks.workunit.client.1.smithi135.stdout:9/817: truncate d1/d1a/d2c/d2d/f32 10499447 0 2024-05-09T00:07:41.570 INFO:tasks.workunit.client.1.smithi135.stdout:9/818: write d1/d1a/d2c/f28 [4315488,26836] 0 2024-05-09T00:07:41.571 INFO:tasks.workunit.client.0.smithi026.stdout:5/243: write d2/d8/d31/f12 [1001056,126723] 0 2024-05-09T00:07:41.571 INFO:tasks.workunit.client.0.smithi026.stdout:5/244: chown d2/l6 11931836 1 2024-05-09T00:07:41.571 INFO:tasks.workunit.client.0.smithi026.stdout:8/241: write de/f23 [3501258,24784] 0 2024-05-09T00:07:41.571 INFO:tasks.workunit.client.0.smithi026.stdout:8/242: stat f9 0 2024-05-09T00:07:41.571 INFO:tasks.workunit.client.0.smithi026.stdout:8/243: write de/d17/d21/d24/f26 [676462,78009] 0 2024-05-09T00:07:41.572 INFO:tasks.workunit.client.1.smithi135.stdout:6/919: symlink d2/d20/d37/d4e/d7c/l130 0 2024-05-09T00:07:41.573 INFO:tasks.workunit.client.1.smithi135.stdout:6/920: readlink d2/da/d26/d57/d59/lfd 0 2024-05-09T00:07:41.574 INFO:tasks.workunit.client.0.smithi026.stdout:4/226: dwrite d0/d12/d1b/f3c [0,4194304] 0 2024-05-09T00:07:41.577 INFO:tasks.workunit.client.1.smithi135.stdout:0/861: mkdir d3/dd/d3f/d58/dae/dd3/dfa 0 2024-05-09T00:07:41.579 INFO:tasks.workunit.client.0.smithi026.stdout:6/217: mknod d15/d41/c45 0 2024-05-09T00:07:41.581 INFO:tasks.workunit.client.1.smithi135.stdout:7/996: creat db/dd/d33/d68/d10a/d3a/d40/d7e/f14d x:0 0 0 2024-05-09T00:07:41.581 INFO:tasks.workunit.client.1.smithi135.stdout:7/997: dread - db/da8/d78/f128 zero size 2024-05-09T00:07:41.582 INFO:tasks.workunit.client.0.smithi026.stdout:3/241: stat d5/l21 0 2024-05-09T00:07:41.582 INFO:tasks.workunit.client.0.smithi026.stdout:3/242: chown d5/d9/dc/d28/d45 7930136 1 2024-05-09T00:07:41.582 INFO:tasks.workunit.client.0.smithi026.stdout:3/243: fdatasync d5/d41/f37 0 2024-05-09T00:07:41.582 INFO:tasks.workunit.client.1.smithi135.stdout:7/998: write db/ff1 [3276164,9603] 0 2024-05-09T00:07:41.583 INFO:tasks.workunit.client.1.smithi135.stdout:7/999: fdatasync db/dd/d33/dd3/fda 0 2024-05-09T00:07:41.584 INFO:tasks.workunit.client.1.smithi135.stdout:1/876: link da/d14/d20/d38/d3a/d40/d75/fc2 da/d24/d27/d33/d52/d71/f130 0 2024-05-09T00:07:41.586 INFO:tasks.workunit.client.0.smithi026.stdout:1/240: creat d5/db/d30/f4d x:0 0 0 2024-05-09T00:07:41.589 INFO:tasks.workunit.client.0.smithi026.stdout:2/218: creat d14/d15/d1f/d4f/f57 x:0 0 0 2024-05-09T00:07:41.589 INFO:tasks.workunit.client.0.smithi026.stdout:3/244: dread d5/d9/dc/f1b [0,4194304] 0 2024-05-09T00:07:41.591 INFO:tasks.workunit.client.1.smithi135.stdout:9/819: mknod d1/d24/c104 0 2024-05-09T00:07:41.591 INFO:tasks.workunit.client.1.smithi135.stdout:9/820: stat d1/d24/d86/d97 0 2024-05-09T00:07:41.591 INFO:tasks.workunit.client.1.smithi135.stdout:9/821: fsync d1/fc6 0 2024-05-09T00:07:41.592 INFO:tasks.workunit.client.0.smithi026.stdout:5/245: creat d2/d8/d2a/f4f x:0 0 0 2024-05-09T00:07:41.595 INFO:tasks.workunit.client.0.smithi026.stdout:7/379: dwrite d8/d2e/f54 [0,4194304] 0 2024-05-09T00:07:41.597 INFO:tasks.workunit.client.1.smithi135.stdout:0/862: mknod d3/d64/cfb 0 2024-05-09T00:07:41.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/244: symlink de/d17/d21/d24/d3b/l4e 0 2024-05-09T00:07:41.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/245: write de/d48/d3e/f4c [580240,21303] 0 2024-05-09T00:07:41.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.608+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcec4059120 con 0x7fceb0066e60 2024-05-09T00:07:41.603 INFO:tasks.workunit.client.0.smithi026.stdout:4/227: creat d0/d12/d34/f4d x:0 0 0 2024-05-09T00:07:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.609+0000 7fceba7fc700 1 -- 172.21.15.26:0/1777945515 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fcec4059120 con 0x7fceb0066e60 2024-05-09T00:07:41.604 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:07:41.604 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:07:41.604 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:07:41.604 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:07:41.604 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [], 2024-05-09T00:07:41.604 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "1/21 daemons upgraded", 2024-05-09T00:07:41.604 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "", 2024-05-09T00:07:41.605 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:07:41.605 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:07:41.605 INFO:tasks.workunit.client.1.smithi135.stdout:1/877: getdents da/d24/d27/d33/d52/dfc 0 2024-05-09T00:07:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fceb0066e60 msgr2=0x7fceb0069320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fceb0066e60 0x7fceb0069320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcec00047f0 tx=0x7fcec0009cb0).stop 2024-05-09T00:07:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4064b00 msgr2=0x7fcec4117280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4064b00 0x7fcec4117280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fceb40041d0 tx=0x7fceb4009f60).stop 2024-05-09T00:07:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 shutdown_connections 2024-05-09T00:07:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fceb0066e60 0x7fceb0069320 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcec40641f0 0x7fcec4116d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:07:41.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 --2- 172.21.15.26:0/1777945515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcec4064b00 0x7fcec4117280 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 >> 172.21.15.26:0/1777945515 conn(0x7fcec4061b60 msgr2=0x7fcec410ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:41.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 shutdown_connections 2024-05-09T00:07:41.608 INFO:tasks.workunit.client.0.smithi026.stdout:6/218: rename f10 to d15/d1e/d30/f46 0 2024-05-09T00:07:41.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.612+0000 7fcecb328700 1 -- 172.21.15.26:0/1777945515 wait complete. 2024-05-09T00:07:41.609 INFO:tasks.workunit.client.1.smithi135.stdout:8/899: sync 2024-05-09T00:07:41.609 INFO:tasks.workunit.client.1.smithi135.stdout:9/822: rename d1/fde to d1/d24/d86/f105 0 2024-05-09T00:07:41.609 INFO:tasks.workunit.client.0.smithi026.stdout:1/241: symlink d5/dd/d17/l4e 0 2024-05-09T00:07:41.611 INFO:tasks.workunit.client.0.smithi026.stdout:2/219: symlink d14/d15/d17/l58 0 2024-05-09T00:07:41.612 INFO:tasks.workunit.client.0.smithi026.stdout:5/246: dwrite d2/d8/d2a/f4f [0,4194304] 0 2024-05-09T00:07:41.616 INFO:tasks.workunit.client.0.smithi026.stdout:3/245: creat d5/d9/f56 x:0 0 0 2024-05-09T00:07:41.618 INFO:tasks.workunit.client.1.smithi135.stdout:5/932: sync 2024-05-09T00:07:41.618 INFO:tasks.workunit.client.1.smithi135.stdout:5/933: chown db/d3f/de1 9016 1 2024-05-09T00:07:41.619 INFO:tasks.workunit.client.1.smithi135.stdout:1/878: truncate da/d24/d27/f28 340744 0 2024-05-09T00:07:41.619 INFO:tasks.workunit.client.1.smithi135.stdout:1/879: truncate da/f120 5015545 0 2024-05-09T00:07:41.620 INFO:tasks.workunit.client.1.smithi135.stdout:1/880: write da/d14/d20/fb2 [1627013,81904] 0 2024-05-09T00:07:41.621 INFO:tasks.workunit.client.1.smithi135.stdout:8/900: rmdir d4/d7/d33 39 2024-05-09T00:07:41.622 INFO:tasks.workunit.client.1.smithi135.stdout:8/901: read d4/d7/d2a/d67/f75 [3281584,57232] 0 2024-05-09T00:07:41.622 INFO:tasks.workunit.client.1.smithi135.stdout:2/877: sync 2024-05-09T00:07:41.624 INFO:tasks.workunit.client.0.smithi026.stdout:7/380: creat d8/d2e/d55/d1e/d3d/d6b/f88 x:0 0 0 2024-05-09T00:07:41.626 INFO:tasks.workunit.client.1.smithi135.stdout:9/823: rename d1/fcd to d1/d1a/d89/dad/ded/f106 0 2024-05-09T00:07:41.627 INFO:tasks.workunit.client.0.smithi026.stdout:8/246: mkdir de/d17/d21/d24/d28/d31/d4f 0 2024-05-09T00:07:41.632 INFO:tasks.workunit.client.0.smithi026.stdout:6/219: creat d15/d1e/d3d/f47 x:0 0 0 2024-05-09T00:07:41.634 INFO:tasks.workunit.client.1.smithi135.stdout:1/881: rename da/d24/cad to da/d24/d27/c131 0 2024-05-09T00:07:41.636 INFO:tasks.workunit.client.1.smithi135.stdout:9/824: creat d1/d24/d44/d7f/da2/dca/dea/f107 x:0 0 0 2024-05-09T00:07:41.636 INFO:tasks.workunit.client.1.smithi135.stdout:9/825: readlink d1/d1a/d2c/d2d/de6/d6e/ld5 0 2024-05-09T00:07:41.639 INFO:tasks.workunit.client.1.smithi135.stdout:1/882: creat da/d14/d20/f132 x:0 0 0 2024-05-09T00:07:41.640 INFO:tasks.workunit.client.0.smithi026.stdout:5/247: creat d2/d8/d2a/f50 x:0 0 0 2024-05-09T00:07:41.642 INFO:tasks.workunit.client.1.smithi135.stdout:2/878: dwrite d1/d12/d20/d2b/fa5 [0,4194304] 0 2024-05-09T00:07:41.642 INFO:tasks.workunit.client.1.smithi135.stdout:2/879: dread - d1/d12/d21/d41/d6d/f126 zero size 2024-05-09T00:07:41.642 INFO:tasks.workunit.client.1.smithi135.stdout:2/880: fsync d1/d12/d20/d2b/d56/d86/fad 0 2024-05-09T00:07:41.642 INFO:tasks.workunit.client.1.smithi135.stdout:2/881: write d1/d22/d63/fed [3451787,114] 0 2024-05-09T00:07:41.642 INFO:tasks.workunit.client.1.smithi135.stdout:9/826: creat d1/d1a/d89/f108 x:0 0 0 2024-05-09T00:07:41.642 INFO:tasks.workunit.client.1.smithi135.stdout:9/827: readlink d1/d24/d44/lb4 0 2024-05-09T00:07:41.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:39.472061+0000 mgr.smithi135.kkrhgf (mgr.24419) 50 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:41.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:39.906543+0000 mgr.smithi135.kkrhgf (mgr.24419) 51 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 153 MiB/s rd, 322 MiB/s wr, 491 op/s 2024-05-09T00:07:41.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:39.977164+0000 mgr.smithi135.kkrhgf (mgr.24419) 52 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:41.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:40.565931+0000 mon.smithi026 (mon.0) 690 : audit [DBG] from='client.? 172.21.15.26:0/4012192433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:07:41.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:41.074526+0000 mon.smithi135 (mon.1) 60 : audit [DBG] from='client.? 172.21.15.26:0/47400604' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:07:41.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:39.472061+0000 mgr.smithi135.kkrhgf (mgr.24419) 50 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:41.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:39.906543+0000 mgr.smithi135.kkrhgf (mgr.24419) 51 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 153 MiB/s rd, 322 MiB/s wr, 491 op/s 2024-05-09T00:07:41.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:39.977164+0000 mgr.smithi135.kkrhgf (mgr.24419) 52 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:41.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:40.565931+0000 mon.smithi026 (mon.0) 690 : audit [DBG] from='client.? 172.21.15.26:0/4012192433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:07:41.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:41 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:41.074526+0000 mon.smithi135 (mon.1) 60 : audit [DBG] from='client.? 172.21.15.26:0/47400604' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:07:41.649 INFO:tasks.workunit.client.1.smithi135.stdout:2/882: mkdir d1/d12/d20/d2b/d7c/d128 0 2024-05-09T00:07:41.652 INFO:tasks.workunit.client.1.smithi135.stdout:9/828: unlink d1/d1a/d2c/d2d/de6/lb1 0 2024-05-09T00:07:41.657 INFO:tasks.workunit.client.1.smithi135.stdout:2/883: dread d1/d12/d20/d2b/fa5 [0,4194304] 0 2024-05-09T00:07:41.665 INFO:tasks.workunit.client.0.smithi026.stdout:7/381: mkdir d8/d1b/d89 0 2024-05-09T00:07:41.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/884: rename d1/d12/d20/d3b/d40/c65 to d1/d12/d21/d57/d10b/d119/c129 0 2024-05-09T00:07:41.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/885: write d1/d12/d20/fea [1004356,92821] 0 2024-05-09T00:07:41.667 INFO:tasks.workunit.client.0.smithi026.stdout:8/247: creat de/d48/d3e/f50 x:0 0 0 2024-05-09T00:07:41.669 INFO:tasks.workunit.client.0.smithi026.stdout:4/228: mkdir d0/d12/d1b/d4e 0 2024-05-09T00:07:41.670 INFO:tasks.workunit.client.0.smithi026.stdout:6/220: symlink d15/d2b/d33/l48 0 2024-05-09T00:07:41.670 INFO:tasks.workunit.client.0.smithi026.stdout:6/221: dread - d15/d1e/d30/f3f zero size 2024-05-09T00:07:41.671 INFO:tasks.workunit.client.1.smithi135.stdout:9/829: dwrite d1/d1a/d2c/f53 [4194304,4194304] 0 2024-05-09T00:07:41.672 INFO:tasks.workunit.client.0.smithi026.stdout:1/242: link d5/dd/d1f/d39/c46 d5/d16/c4f 0 2024-05-09T00:07:41.672 INFO:tasks.workunit.client.0.smithi026.stdout:1/243: write d5/dd/d1f/d39/f3d [111369,43071] 0 2024-05-09T00:07:41.673 INFO:tasks.workunit.client.1.smithi135.stdout:6/921: truncate d2/d20/d3f/d4f/d7f/fca 5330389 0 2024-05-09T00:07:41.675 INFO:tasks.workunit.client.0.smithi026.stdout:5/248: mkdir d2/d8/d31/d4b/d51 0 2024-05-09T00:07:41.676 INFO:tasks.workunit.client.0.smithi026.stdout:4/229: dread d0/f22 [0,4194304] 0 2024-05-09T00:07:41.676 INFO:tasks.workunit.client.0.smithi026.stdout:4/230: write d0/d12/d1b/d2b/f40 [512941,109837] 0 2024-05-09T00:07:41.676 INFO:tasks.workunit.client.0.smithi026.stdout:4/231: dread - d0/d12/d34/f4d zero size 2024-05-09T00:07:41.676 INFO:tasks.workunit.client.0.smithi026.stdout:4/232: fsync d0/d12/f2c 0 2024-05-09T00:07:41.677 INFO:tasks.workunit.client.0.smithi026.stdout:3/246: dread d5/f39 [0,4194304] 0 2024-05-09T00:07:41.677 INFO:tasks.workunit.client.0.smithi026.stdout:3/247: stat d5/d44 0 2024-05-09T00:07:41.677 INFO:tasks.workunit.client.0.smithi026.stdout:3/248: chown d5/l21 377536 1 2024-05-09T00:07:41.679 INFO:tasks.workunit.client.1.smithi135.stdout:9/830: unlink d1/d1a/d2c/l3a 0 2024-05-09T00:07:41.681 INFO:tasks.workunit.client.0.smithi026.stdout:7/382: getdents d8/d2e/d55/d22 0 2024-05-09T00:07:41.683 INFO:tasks.workunit.client.0.smithi026.stdout:3/249: write d5/d9/dc/f11 [3289776,31887] 0 2024-05-09T00:07:41.683 INFO:tasks.workunit.client.0.smithi026.stdout:3/250: write d5/d9/f2a [728937,58182] 0 2024-05-09T00:07:41.685 INFO:tasks.workunit.client.0.smithi026.stdout:8/248: creat de/d17/d21/d24/d3b/d3d/f51 x:0 0 0 2024-05-09T00:07:41.685 INFO:tasks.workunit.client.0.smithi026.stdout:8/249: dread - de/d17/d21/d24/d3b/f47 zero size 2024-05-09T00:07:41.685 INFO:tasks.workunit.client.1.smithi135.stdout:9/831: creat d1/d1a/d89/f109 x:0 0 0 2024-05-09T00:07:41.686 INFO:tasks.workunit.client.1.smithi135.stdout:2/886: dwrite d1/d12/d20/f80 [0,4194304] 0 2024-05-09T00:07:41.691 INFO:tasks.workunit.client.0.smithi026.stdout:6/222: link d15/d1e/d23/d26/f27 d15/d34/f49 0 2024-05-09T00:07:41.691 INFO:tasks.workunit.client.0.smithi026.stdout:6/223: write d15/d1e/d23/f24 [1405680,17256] 0 2024-05-09T00:07:41.691 INFO:tasks.workunit.client.0.smithi026.stdout:6/224: write d15/d1e/d30/d32/d36/f40 [703347,115295] 0 2024-05-09T00:07:41.691 INFO:tasks.workunit.client.0.smithi026.stdout:1/244: creat d5/dd/d1f/d39/d47/f50 x:0 0 0 2024-05-09T00:07:41.691 INFO:tasks.workunit.client.0.smithi026.stdout:1/245: stat d5/dd/d17/f2a 0 2024-05-09T00:07:41.691 INFO:tasks.workunit.client.0.smithi026.stdout:1/246: dread - d5/dd/f49 zero size 2024-05-09T00:07:41.691 INFO:tasks.workunit.client.1.smithi135.stdout:6/922: dwrite d2/f96 [0,4194304] 0 2024-05-09T00:07:41.692 INFO:tasks.workunit.client.1.smithi135.stdout:9/832: creat d1/d1a/f10a x:0 0 0 2024-05-09T00:07:41.694 INFO:tasks.workunit.client.0.smithi026.stdout:8/250: dread de/ff [0,4194304] 0 2024-05-09T00:07:41.694 INFO:tasks.workunit.client.0.smithi026.stdout:5/249: unlink d2/d8/d2a/f2c 0 2024-05-09T00:07:41.695 INFO:tasks.workunit.client.0.smithi026.stdout:8/251: write de/d17/d21/f22 [1318413,76859] 0 2024-05-09T00:07:41.695 INFO:tasks.workunit.client.1.smithi135.stdout:8/902: write d4/d7/d4a/d9c/fe9 [1159044,58208] 0 2024-05-09T00:07:41.700 INFO:tasks.workunit.client.1.smithi135.stdout:9/833: dread d1/d1a/d10/d3c/d5c/fab [0,4194304] 0 2024-05-09T00:07:41.700 INFO:tasks.workunit.client.0.smithi026.stdout:7/383: mkdir d8/d2e/d55/d1e/d8a 0 2024-05-09T00:07:41.700 INFO:tasks.workunit.client.0.smithi026.stdout:7/384: chown d8/f56 266098856 1 2024-05-09T00:07:41.700 INFO:tasks.workunit.client.0.smithi026.stdout:7/385: fsync d8/d1b/f2d 0 2024-05-09T00:07:41.701 INFO:tasks.workunit.client.0.smithi026.stdout:3/251: dwrite d5/d9/dc/d28/d2c/f55 [0,4194304] 0 2024-05-09T00:07:41.701 INFO:tasks.workunit.client.0.smithi026.stdout:3/252: readlink d5/d9/dc/d28/l1d 0 2024-05-09T00:07:41.703 INFO:tasks.workunit.client.1.smithi135.stdout:2/887: fsync d1/d12/d21/d57/d10b/fbe 0 2024-05-09T00:07:41.710 INFO:tasks.workunit.client.0.smithi026.stdout:6/225: creat d15/d1e/d23/f4a x:0 0 0 2024-05-09T00:07:41.712 INFO:tasks.workunit.client.0.smithi026.stdout:1/247: rmdir d5/db/d30 39 2024-05-09T00:07:41.712 INFO:tasks.workunit.client.1.smithi135.stdout:6/923: dwrite d2/da/d49/f67 [4194304,4194304] 0 2024-05-09T00:07:41.712 INFO:tasks.workunit.client.1.smithi135.stdout:9/834: dread d1/d1a/d10/d3c/f4b [4194304,4194304] 0 2024-05-09T00:07:41.713 INFO:tasks.workunit.client.0.smithi026.stdout:5/250: creat d2/d8/d31/d24/f52 x:0 0 0 2024-05-09T00:07:41.714 INFO:tasks.workunit.client.1.smithi135.stdout:8/903: mkdir d4/d8/da2/d132 0 2024-05-09T00:07:41.714 INFO:tasks.workunit.client.1.smithi135.stdout:8/904: chown d4/d7/lb4 608 1 2024-05-09T00:07:41.716 INFO:tasks.workunit.client.0.smithi026.stdout:8/252: rename de/f11 to de/d48/f52 0 2024-05-09T00:07:41.720 INFO:tasks.workunit.client.1.smithi135.stdout:9/835: dread d1/d1a/d2c/d20/f9c [0,4194304] 0 2024-05-09T00:07:41.720 INFO:tasks.workunit.client.1.smithi135.stdout:9/836: truncate d1/d1a/d2c/d20/fd3 695926 0 2024-05-09T00:07:41.721 INFO:tasks.workunit.client.0.smithi026.stdout:7/386: symlink d8/d1b/d89/l8b 0 2024-05-09T00:07:41.721 INFO:tasks.workunit.client.0.smithi026.stdout:8/253: write fa [475107,72672] 0 2024-05-09T00:07:41.723 INFO:tasks.workunit.client.1.smithi135.stdout:6/924: mknod d2/da/d26/d57/d59/d62/da8/c131 0 2024-05-09T00:07:41.726 INFO:tasks.workunit.client.0.smithi026.stdout:7/387: write d8/ff [5919924,11394] 0 2024-05-09T00:07:41.727 INFO:tasks.workunit.client.1.smithi135.stdout:8/905: mkdir d4/d22/d8b/d10a/d133 0 2024-05-09T00:07:41.727 INFO:tasks.workunit.client.1.smithi135.stdout:8/906: truncate d4/d7/de/d45/fc8 368076 0 2024-05-09T00:07:41.729 INFO:tasks.workunit.client.1.smithi135.stdout:9/837: creat d1/d24/d86/d97/dec/f10b x:0 0 0 2024-05-09T00:07:41.729 INFO:tasks.workunit.client.1.smithi135.stdout:8/907: write d4/d7/d33/d39/f47 [1755462,122288] 0 2024-05-09T00:07:41.729 INFO:tasks.workunit.client.0.smithi026.stdout:5/251: dwrite d2/d8/d31/d2e/d4a/f3c [0,4194304] 0 2024-05-09T00:07:41.730 INFO:tasks.workunit.client.0.smithi026.stdout:5/252: stat d2/d8 0 2024-05-09T00:07:41.731 INFO:tasks.workunit.client.1.smithi135.stdout:6/925: link d2/d20/d37/d4e/d9d/f128 d2/da/d1d/d69/dfc/f132 0 2024-05-09T00:07:41.731 INFO:tasks.workunit.client.1.smithi135.stdout:6/926: stat d2/f96 0 2024-05-09T00:07:41.733 INFO:tasks.workunit.client.1.smithi135.stdout:9/838: symlink d1/d1a/d10/d3c/l10c 0 2024-05-09T00:07:41.736 INFO:tasks.workunit.client.0.smithi026.stdout:6/226: link d15/d1e/d23/d26/f3c d15/d41/f4b 0 2024-05-09T00:07:41.739 INFO:tasks.workunit.client.0.smithi026.stdout:4/233: getdents d0/d12/d1b 0 2024-05-09T00:07:41.739 INFO:tasks.workunit.client.0.smithi026.stdout:4/234: write d0/d12/d34/f38 [101065,131029] 0 2024-05-09T00:07:41.741 INFO:tasks.workunit.client.1.smithi135.stdout:6/927: link d2/da/d26/d57/d59/lf2 d2/da/d1d/d69/d78/l133 0 2024-05-09T00:07:41.744 INFO:tasks.workunit.client.1.smithi135.stdout:9/839: getdents d1/d24/d44/d7f 0 2024-05-09T00:07:41.745 INFO:tasks.workunit.client.1.smithi135.stdout:4/800: sync 2024-05-09T00:07:41.745 INFO:tasks.workunit.client.1.smithi135.stdout:3/990: sync 2024-05-09T00:07:41.747 INFO:tasks.workunit.client.1.smithi135.stdout:8/908: dwrite d4/d7/d33/f55 [0,4194304] 0 2024-05-09T00:07:41.749 INFO:tasks.workunit.client.1.smithi135.stdout:6/928: unlink d2/d20/d3f/l129 0 2024-05-09T00:07:41.750 INFO:tasks.workunit.client.0.smithi026.stdout:1/248: mkdir d5/dd/d1f/d51 0 2024-05-09T00:07:41.752 INFO:tasks.workunit.client.1.smithi135.stdout:9/840: mkdir d1/d24/d86/d10d 0 2024-05-09T00:07:41.753 INFO:tasks.workunit.client.1.smithi135.stdout:9/841: readlink d1/d1a/d89/la3 0 2024-05-09T00:07:41.753 INFO:tasks.workunit.client.1.smithi135.stdout:9/842: write d1/d1a/d10/d3c/d5c/fae [4012678,96224] 0 2024-05-09T00:07:41.755 INFO:tasks.workunit.client.0.smithi026.stdout:8/254: rename de/d17/l1f to de/d17/d21/l53 0 2024-05-09T00:07:41.756 INFO:tasks.workunit.client.1.smithi135.stdout:6/929: dread d2/da/d26/d57/f6c [0,4194304] 0 2024-05-09T00:07:41.756 INFO:tasks.workunit.client.1.smithi135.stdout:4/801: creat dc/d26/d31/d82/f105 x:0 0 0 2024-05-09T00:07:41.757 INFO:tasks.workunit.client.0.smithi026.stdout:7/388: symlink d8/d5c/l8c 0 2024-05-09T00:07:41.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.763+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/2399843984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f7070 msgr2=0x7f5ee00f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:41.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.763+0000 7f5ee4c4b700 1 --2- 172.21.15.26:0/2399843984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f7070 0x7f5ee00f74f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5ed40048f0 tx=0x7f5ed400adc0).stop 2024-05-09T00:07:41.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.764+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/2399843984 shutdown_connections 2024-05-09T00:07:41.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.764+0000 7f5ee4c4b700 1 --2- 172.21.15.26:0/2399843984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f7070 0x7f5ee00f74f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.764+0000 7f5ee4c4b700 1 --2- 172.21.15.26:0/2399843984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee00f5e70 0x7f5ee00f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.764+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/2399843984 >> 172.21.15.26:0/2399843984 conn(0x7f5ee00f15d0 msgr2=0x7f5ee00f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:41.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.764+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/2399843984 shutdown_connections 2024-05-09T00:07:41.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.764+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/2399843984 wait complete. 2024-05-09T00:07:41.760 INFO:tasks.workunit.client.1.smithi135.stdout:4/802: dread dc/dd/f14 [0,4194304] 0 2024-05-09T00:07:41.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.765+0000 7f5ee4c4b700 1 Processor -- start 2024-05-09T00:07:41.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.765+0000 7f5ee4c4b700 1 -- start start 2024-05-09T00:07:41.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.765+0000 7f5ee4c4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f5e70 0x7f5ee0108070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:41.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.765+0000 7f5ee4c4b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee00f7070 0x7f5ee0108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:41.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.765+0000 7f5ee4c4b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0108b10 con 0x7f5ee00f5e70 2024-05-09T00:07:41.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.765+0000 7f5ee4c4b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0108c50 con 0x7f5ee00f7070 2024-05-09T00:07:41.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5ede59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f5e70 0x7f5ee0108070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:41.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5ede59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f5e70 0x7f5ee0108070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49502/0 (socket says 172.21.15.26:49502) 2024-05-09T00:07:41.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5ede59c700 1 -- 172.21.15.26:0/533051966 learned_addr learned my addr 172.21.15.26:0/533051966 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:07:41.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5eddd9b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee00f7070 0x7f5ee0108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:07:41.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5ede59c700 1 -- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee00f7070 msgr2=0x7f5ee0108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:41.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5ede59c700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee00f7070 0x7f5ee0108560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:41.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5ede59c700 1 -- 172.21.15.26:0/533051966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4005040 con 0x7f5ee00f5e70 2024-05-09T00:07:41.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5eddd9b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee00f7070 0x7f5ee0108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:07:41.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.766+0000 7f5ede59c700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f5e70 0x7f5ee0108070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f5ed000e910 tx=0x7f5ed000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:41.763 INFO:tasks.workunit.client.1.smithi135.stdout:6/930: dread d2/da/d1d/d69/d89/f8e [0,4194304] 0 2024-05-09T00:07:41.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.767+0000 7f5ecf7fe700 1 -- 172.21.15.26:0/533051966 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0007b40 con 0x7f5ee00f5e70 2024-05-09T00:07:41.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.767+0000 7f5ecf7fe700 1 -- 172.21.15.26:0/533051966 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ed000f040 con 0x7f5ee00f5e70 2024-05-09T00:07:41.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.767+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee010d690 con 0x7f5ee00f5e70 2024-05-09T00:07:41.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.767+0000 7f5ecf7fe700 1 -- 172.21.15.26:0/533051966 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0014920 con 0x7f5ee00f5e70 2024-05-09T00:07:41.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.767+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee010dc50 con 0x7f5ee00f5e70 2024-05-09T00:07:41.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.768+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee00fddd0 con 0x7f5ee00f5e70 2024-05-09T00:07:41.765 INFO:tasks.workunit.client.1.smithi135.stdout:3/991: unlink d8/d6d/d24/c130 0 2024-05-09T00:07:41.765 INFO:tasks.workunit.client.1.smithi135.stdout:3/992: readlink d8/d6d/d44/d4b/dc2/d120/d129/d90/d7b/d13f/d158/d6a/d116/l14b 0 2024-05-09T00:07:41.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.770+0000 7f5ecf7fe700 1 -- 172.21.15.26:0/533051966 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f5ed0007ca0 con 0x7f5ee00f5e70 2024-05-09T00:07:41.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.771+0000 7f5ecf7fe700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f5ec8066e00 0x7f5ec80692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:07:41.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.771+0000 7f5ecf7fe700 1 -- 172.21.15.26:0/533051966 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f5ed0083d40 con 0x7f5ee00f5e70 2024-05-09T00:07:41.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.771+0000 7f5eddd9b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f5ec8066e00 0x7f5ec80692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:41.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.771+0000 7f5eddd9b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f5ec8066e00 0x7f5ec80692c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5ed400aac0 tx=0x7f5ed4017040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:41.767 INFO:tasks.workunit.client.1.smithi135.stdout:8/909: symlink d4/d8/da2/dab/d11a/l134 0 2024-05-09T00:07:41.767 INFO:tasks.workunit.client.1.smithi135.stdout:8/910: write d4/dc6/ffa [6132608,5974] 0 2024-05-09T00:07:41.767 INFO:tasks.workunit.client.1.smithi135.stdout:8/911: chown d4/d7/lb4 516232355 1 2024-05-09T00:07:41.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:41.775+0000 7f5ecf7fe700 1 -- 172.21.15.26:0/533051966 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f5ed0051ee0 con 0x7f5ee00f5e70 2024-05-09T00:07:41.770 INFO:tasks.workunit.client.1.smithi135.stdout:9/843: symlink d1/d24/d44/d7f/l10e 0 2024-05-09T00:07:41.772 INFO:tasks.workunit.client.1.smithi135.stdout:9/844: write d1/d1a/d2c/d2d/f32 [3359330,26295] 0 2024-05-09T00:07:41.773 INFO:tasks.workunit.client.1.smithi135.stdout:4/803: rename dc/d71/d86/fd8 to dc/d26/d31/d96/f106 0 2024-05-09T00:07:41.774 INFO:tasks.workunit.client.0.smithi026.stdout:1/249: truncate d5/f2c 213126 0 2024-05-09T00:07:41.775 INFO:tasks.workunit.client.1.smithi135.stdout:6/931: mknod d2/da/d49/c134 0 2024-05-09T00:07:41.775 INFO:tasks.workunit.client.1.smithi135.stdout:6/932: fsync d2/da/d49/f23 0 2024-05-09T00:07:41.776 INFO:tasks.workunit.client.1.smithi135.stdout:6/933: write d2/da/d49/f67 [6551715,11339] 0 2024-05-09T00:07:41.778 INFO:tasks.workunit.client.0.smithi026.stdout:6/227: rename d15/d1e/d30/d32/d36 to d15/d1e/d3d/d4c 0 2024-05-09T00:07:41.778 INFO:tasks.workunit.client.0.smithi026.stdout:6/228: chown f4 348705695 1 2024-05-09T00:07:41.779 INFO:tasks.workunit.client.1.smithi135.stdout:0/863: sync 2024-05-09T00:07:41.782 INFO:tasks.workunit.client.1.smithi135.stdout:3/993: dwrite d8/d6d/d44/d4b/fd9 [0,4194304] 0 2024-05-09T00:07:41.782 INFO:tasks.workunit.client.1.smithi135.stdout:3/994: stat d8/d13/d75 0 2024-05-09T00:07:41.783 INFO:tasks.workunit.client.1.smithi135.stdout:8/912: mkdir d4/d7/d2a/d56/d123/d135 0 2024-05-09T00:07:41.784 INFO:tasks.workunit.client.1.smithi135.stdout:3/995: dread d8/d6d/d44/d4b/da0/daa/f8f [0,4194304] 0 2024-05-09T00:07:41.784 INFO:tasks.workunit.client.0.smithi026.stdout:6/229: write d15/f18 [516285,84439] 0 2024-05-09T00:07:41.784 INFO:tasks.workunit.client.0.smithi026.stdout:8/255: dwrite f3 [0,4194304] 0 2024-05-09T00:07:41.784 INFO:tasks.workunit.client.0.smithi026.stdout:1/250: dread f3 [0,4194304] 0 2024-05-09T00:07:41.789 INFO:tasks.workunit.client.0.smithi026.stdout:4/235: rename d0/d12/d34/l37 to d0/d12/d1b/d4e/l4f 0 2024-05-09T00:07:41.790 INFO:tasks.workunit.client.1.smithi135.stdout:9/845: write d1/d1a/d10/f6a [3317284,68728] 0 2024-05-09T00:07:41.790 INFO:tasks.workunit.client.1.smithi135.stdout:5/934: sync 2024-05-09T00:07:41.790 INFO:tasks.workunit.client.1.smithi135.stdout:1/883: sync 2024-05-09T00:07:41.792 INFO:tasks.workunit.client.1.smithi135.stdout:4/804: creat dc/d4a/d8c/f107 x:0 0 0 2024-05-09T00:07:41.794 INFO:tasks.workunit.client.0.smithi026.stdout:8/256: mkdir de/d48/d3e/d54 0 2024-05-09T00:07:41.797 INFO:tasks.workunit.client.1.smithi135.stdout:6/934: rename d2/d1a/lc1 to d2/da/df0/l135 0 2024-05-09T00:07:41.797 INFO:tasks.workunit.client.0.smithi026.stdout:1/251: creat d5/dd/f52 x:0 0 0 2024-05-09T00:07:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:4/236: truncate d0/d12/d1b/d2b/f35 482438 0 2024-05-09T00:07:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:8/257: dread de/ff [0,4194304] 0 2024-05-09T00:07:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:4/237: write d0/d12/d1b/f26 [111020,71850] 0 2024-05-09T00:07:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:4/238: stat d0/d19/f1e 0 2024-05-09T00:07:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:4/239: dread - d0/f4c zero size 2024-05-09T00:07:41.804 INFO:tasks.workunit.client.0.smithi026.stdout:1/252: mknod d5/dd/d1f/d39/d47/c53 0 2024-05-09T00:07:41.808 INFO:tasks.workunit.client.0.smithi026.stdout:8/258: dread de/ff [0,4194304] 0 2024-05-09T00:07:41.808 INFO:tasks.workunit.client.1.smithi135.stdout:8/913: creat d4/d22/d8b/d10a/d133/f136 x:0 0 0 2024-05-09T00:07:41.810 INFO:tasks.workunit.client.1.smithi135.stdout:8/914: dread d4/d7/de/d45/d76/de2/fe4 [0,4194304] 0 2024-05-09T00:07:41.810 INFO:tasks.workunit.client.1.smithi135.stdout:8/915: write d4/d7/de/d45/d76/f97 [4385524,15605] 0 2024-05-09T00:07:41.811 INFO:tasks.workunit.client.1.smithi135.stdout:3/996: rmdir d8/d6d/d24/d133 39 2024-05-09T00:07:41.818 INFO:tasks.workunit.client.0.smithi026.stdout:1/253: link d5/ca d5/db/d30/c54 0 2024-05-09T00:07:41.820 INFO:tasks.workunit.client.1.smithi135.stdout:9/846: mknod d1/d24/d86/c10f 0 2024-05-09T00:07:41.822 INFO:tasks.workunit.client.1.smithi135.stdout:9/847: read d1/d1a/f51 [3355786,42955] 0 2024-05-09T00:07:41.822 INFO:tasks.workunit.client.1.smithi135.stdout:5/935: readlink db/d24/l27 0 2024-05-09T00:07:41.823 INFO:tasks.workunit.client.1.smithi135.stdout:6/935: dwrite d2/da/d1d/fab [4194304,4194304] 0 2024-05-09T00:07:41.823 INFO:tasks.workunit.client.1.smithi135.stdout:1/884: dwrite da/d14/d20/d38/d3a/d40/d75/fc2 [0,4194304] 0 2024-05-09T00:07:41.824 INFO:tasks.workunit.client.0.smithi026.stdout:7/389: dwrite d8/d2e/f4a [0,4194304] 0 2024-05-09T00:07:41.826 INFO:tasks.workunit.client.0.smithi026.stdout:8/259: dwrite de/d17/f4a [0,4194304] 0 2024-05-09T00:07:41.826 INFO:tasks.workunit.client.0.smithi026.stdout:6/230: dwrite d15/d1e/d23/f24 [0,4194304] 0 2024-05-09T00:07:41.826 INFO:tasks.workunit.client.0.smithi026.stdout:6/231: write d15/d2b/f42 [318959,98550] 0 2024-05-09T00:07:41.826 INFO:tasks.workunit.client.0.smithi026.stdout:1/254: creat d5/db/d30/f55 x:0 0 0 2024-05-09T00:07:41.829 INFO:tasks.workunit.client.1.smithi135.stdout:4/805: mknod dc/d26/d31/db8/dd1/ddd/c108 0 2024-05-09T00:07:41.831 INFO:tasks.workunit.client.0.smithi026.stdout:7/390: truncate d8/d2e/d55/d1e/f41 3138756 0 2024-05-09T00:07:41.831 INFO:tasks.workunit.client.0.smithi026.stdout:7/391: getdents d8/d2e/d55/d1e/d8a 0 2024-05-09T00:07:41.832 INFO:tasks.workunit.client.1.smithi135.stdout:0/864: rename d3/dd/d3f/d3a/d46/f38 to d3/d9e/ffc 0 2024-05-09T00:07:41.834 INFO:tasks.workunit.client.1.smithi135.stdout:9/848: unlink d1/d24/d86/d97/dec/f83 0 2024-05-09T00:07:41.836 INFO:tasks.workunit.client.1.smithi135.stdout:5/936: creat db/d24/d32/dfa/d9c/d9f/dc0/dc4/f121 x:0 0 0 2024-05-09T00:07:41.836 INFO:tasks.workunit.client.1.smithi135.stdout:5/937: chown db/d24/d32/d5b/d91/f6b 5 1 2024-05-09T00:07:41.840 INFO:tasks.workunit.client.1.smithi135.stdout:6/936: mknod d2/da/d26/d57/ddc/d116/c136 0 2024-05-09T00:07:41.842 INFO:tasks.workunit.client.1.smithi135.stdout:8/916: dwrite d4/d8/da2/da6/db8/fcb [0,4194304] 0 2024-05-09T00:07:41.842 INFO:tasks.workunit.client.0.smithi026.stdout:4/240: dwrite d0/d12/d1b/f26 [0,4194304] 0 2024-05-09T00:07:41.845 INFO:tasks.workunit.client.0.smithi026.stdout:8/260: symlink de/l55 0 2024-05-09T00:07:41.847 INFO:tasks.workunit.client.0.smithi026.stdout:1/255: rename d5/dd/l3a to d5/dd/d1f/l56 0 2024-05-09T00:07:41.851 INFO:tasks.workunit.client.0.smithi026.stdout:7/392: mkdir d8/d1b/d89/d8d 0 2024-05-09T00:07:41.851 INFO:tasks.workunit.client.0.smithi026.stdout:7/393: fdatasync d8/d2e/d55/d1e/f43 0 2024-05-09T00:07:41.852 INFO:tasks.workunit.client.1.smithi135.stdout:4/806: unlink dc/l16 0 2024-05-09T00:07:41.852 INFO:tasks.workunit.client.1.smithi135.stdout:4/807: write dc/d4a/d69/d55/dc9/dd7/dfa/fdb [4557031,60811] 0 2024-05-09T00:07:41.854 INFO:tasks.workunit.client.1.smithi135.stdout:0/865: symlink d3/dd/d3f/d58/dae/lfd 0 2024-05-09T00:07:41.854 INFO:tasks.workunit.client.1.smithi135.stdout:0/866: stat d3/dd/d3f/d29/d54/f87 0 2024-05-09T00:07:41.855 INFO:tasks.workunit.client.0.smithi026.stdout:8/261: link de/d17/f1c de/d17/d21/d24/d3b/d3d/f56 0 2024-05-09T00:07:41.857 INFO:tasks.workunit.client.1.smithi135.stdout:9/849: creat d1/d24/d44/dfe/f110 x:0 0 0 2024-05-09T00:07:41.858 INFO:tasks.workunit.client.0.smithi026.stdout:1/256: link d5/dd/d17/f2a d5/dd/d1f/f57 0 2024-05-09T00:07:41.858 INFO:tasks.workunit.client.0.smithi026.stdout:1/257: chown d5/dd/f52 18102363 1 2024-05-09T00:07:41.859 INFO:tasks.workunit.client.1.smithi135.stdout:2/888: sync 2024-05-09T00:07:41.859 INFO:tasks.workunit.client.1.smithi135.stdout:5/938: truncate db/fde 1298756 0 2024-05-09T00:07:41.859 INFO:tasks.workunit.client.1.smithi135.stdout:5/939: truncate db/d5d/dac/f103 465982 0 2024-05-09T00:07:41.860 INFO:tasks.workunit.client.0.smithi026.stdout:7/394: creat d8/d1b/d89/f8e x:0 0 0 2024-05-09T00:07:41.863 INFO:tasks.workunit.client.1.smithi135.stdout:6/937: creat d2/da/d1d/f137 x:0 0 0 2024-05-09T00:07:41.863 INFO:tasks.workunit.client.1.smithi135.stdout:2/889: write d1/d12/d21/f38 [1063905,10300] 0 2024-05-09T00:07:41.865 INFO:tasks.workunit.client.0.smithi026.stdout:8/262: creat de/d17/d21/d24/d28/d31/f57 x:0 0 0 2024-05-09T00:07:41.867 INFO:tasks.workunit.client.1.smithi135.stdout:4/808: dwrite dc/d4a/d69/d55/d5f/f53 [0,4194304] 0 2024-05-09T00:07:41.868 INFO:tasks.workunit.client.0.smithi026.stdout:1/258: link d5/dd/d1f/f57 d5/dd/f58 0 2024-05-09T00:07:41.870 INFO:tasks.workunit.client.1.smithi135.stdout:8/917: rename d4/d7/de/d45/dc5/fcd to d4/d7/de/d45/d76/f137 0 2024-05-09T00:07:41.871 INFO:tasks.workunit.client.0.smithi026.stdout:8/263: symlink de/d17/d21/d24/l58 0 2024-05-09T00:07:41.873 INFO:tasks.workunit.client.0.smithi026.stdout:8/264: read de/f20 [500564,71098] 0 2024-05-09T00:07:41.876 INFO:tasks.workunit.client.1.smithi135.stdout:1/885: mkdir da/d14/d20/d38/d3a/d40/d96/d133 0 2024-05-09T00:07:41.877 INFO:tasks.workunit.client.1.smithi135.stdout:0/867: mknod d3/dd/d2d/d4c/d84/cfe 0 2024-05-09T00:07:41.877 INFO:tasks.workunit.client.1.smithi135.stdout:0/868: chown d3/fda 14411536 1 2024-05-09T00:07:41.877 INFO:tasks.workunit.client.1.smithi135.stdout:0/869: truncate d3/dd/d3f/d58/f5c 863657 0 2024-05-09T00:07:41.878 INFO:tasks.workunit.client.1.smithi135.stdout:9/850: mknod d1/d1a/d10/d3c/c111 0 2024-05-09T00:07:41.880 INFO:tasks.workunit.client.1.smithi135.stdout:6/938: mknod d2/da/d1d/d69/c138 0 2024-05-09T00:07:41.880 INFO:tasks.workunit.client.1.smithi135.stdout:6/939: write d2/da/d1d/d69/f9c [1378797,33652] 0 2024-05-09T00:07:41.881 INFO:tasks.workunit.client.1.smithi135.stdout:6/940: readlink d2/da/d26/d57/ddc/lf3 0 2024-05-09T00:07:41.882 INFO:tasks.workunit.client.0.smithi026.stdout:8/265: unlink de/d17/d21/d24/d28/c2c 0 2024-05-09T00:07:41.882 INFO:tasks.workunit.client.0.smithi026.stdout:8/266: stat de/d17/d21/d24/d28/d31/f57 0 2024-05-09T00:07:41.887 INFO:tasks.workunit.client.0.smithi026.stdout:8/267: truncate fa 5936 0 2024-05-09T00:07:41.888 INFO:tasks.workunit.client.1.smithi135.stdout:2/890: rename d1/l1d to d1/d22/l12a 0 2024-05-09T00:07:41.889 INFO:tasks.workunit.client.1.smithi135.stdout:2/891: write d1/d12/d20/d2b/ff0 [231734,102683] 0 2024-05-09T00:07:41.889 INFO:tasks.workunit.client.1.smithi135.stdout:1/886: symlink da/d24/d27/d33/d7d/l134 0 2024-05-09T00:07:41.890 INFO:tasks.workunit.client.1.smithi135.stdout:1/887: write da/d24/d27/d33/d52/d71/faa [1717111,79359] 0 2024-05-09T00:07:41.890 INFO:tasks.workunit.client.1.smithi135.stdout:1/888: fdatasync da/d24/d27/d33/d52/d71/f87 0 2024-05-09T00:07:41.891 INFO:tasks.workunit.client.0.smithi026.stdout:8/268: mknod de/d17/d21/d24/d28/d31/c59 0 2024-05-09T00:07:41.891 INFO:tasks.workunit.client.1.smithi135.stdout:9/851: creat d1/d1a/d2c/d20/f112 x:0 0 0 2024-05-09T00:07:41.893 INFO:tasks.workunit.client.0.smithi026.stdout:8/269: symlink de/d17/d21/d24/d3b/d3d/l5a 0 2024-05-09T00:07:41.894 INFO:tasks.workunit.client.1.smithi135.stdout:6/941: mknod d2/da/d26/d57/d59/c139 0 2024-05-09T00:07:41.894 INFO:tasks.workunit.client.0.smithi026.stdout:9/278: sync 2024-05-09T00:07:41.895 INFO:tasks.workunit.client.0.smithi026.stdout:9/279: write d7/f16 [512671,30686] 0 2024-05-09T00:07:41.896 INFO:tasks.workunit.client.1.smithi135.stdout:0/870: rename d3/dd/d2d/d4c/fcc to d3/fff 0 2024-05-09T00:07:41.897 INFO:tasks.workunit.client.0.smithi026.stdout:8/270: mkdir de/d17/d21/d24/d5b 0 2024-05-09T00:07:41.899 INFO:tasks.workunit.client.1.smithi135.stdout:2/892: unlink d1/d12/d20/d2b/fe2 0 2024-05-09T00:07:41.899 INFO:tasks.workunit.client.0.smithi026.stdout:9/280: creat d7/d23/d29/f6a x:0 0 0 2024-05-09T00:07:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:8/271: link de/d17/d21/l53 de/d17/d21/l5c 0 2024-05-09T00:07:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:9/281: dread d7/f28 [0,4194304] 0 2024-05-09T00:07:41.905 INFO:tasks.workunit.client.1.smithi135.stdout:1/889: link da/d24/d27/d33/d7d/f126 da/d24/d27/d33/d48/f135 0 2024-05-09T00:07:41.905 INFO:tasks.workunit.client.1.smithi135.stdout:1/890: stat da/d14/d20/d38/d3a/d40/fd6 0 2024-05-09T00:07:41.907 INFO:tasks.workunit.client.1.smithi135.stdout:9/852: mkdir d1/d24/d44/d7f/da2/dca/d113 0 2024-05-09T00:07:41.910 INFO:tasks.workunit.client.0.smithi026.stdout:8/272: rename de/f20 to de/f5d 0 2024-05-09T00:07:41.911 INFO:tasks.workunit.client.1.smithi135.stdout:6/942: truncate d2/f76 4099308 0 2024-05-09T00:07:41.914 INFO:tasks.workunit.client.0.smithi026.stdout:9/282: creat d7/d26/f6b x:0 0 0 2024-05-09T00:07:41.916 INFO:tasks.workunit.client.1.smithi135.stdout:2/893: mknod d1/d12/d20/d3b/d105/c12b 0 2024-05-09T00:07:41.918 INFO:tasks.workunit.client.0.smithi026.stdout:9/283: symlink d7/d23/d29/d31/d40/d41/l6c 0 2024-05-09T00:07:41.918 INFO:tasks.workunit.client.0.smithi026.stdout:9/284: readlink d7/d23/d2f/d3a/l64 0 2024-05-09T00:07:41.918 INFO:tasks.workunit.client.0.smithi026.stdout:9/285: write d7/d23/d29/d31/f42 [361785,41759] 0 2024-05-09T00:07:41.920 INFO:tasks.workunit.client.1.smithi135.stdout:9/853: creat d1/d1a/d10/d3c/d5c/f114 x:0 0 0 2024-05-09T00:07:41.921 INFO:tasks.workunit.client.1.smithi135.stdout:4/809: dwrite dc/d26/d31/f9a [0,4194304] 0 2024-05-09T00:07:41.921 INFO:tasks.workunit.client.1.smithi135.stdout:6/943: mkdir d2/d5f/d13a 0 2024-05-09T00:07:41.921 INFO:tasks.workunit.client.1.smithi135.stdout:8/918: dwrite d4/d7/de/d45/d76/f97 [0,4194304] 0 2024-05-09T00:07:41.922 INFO:tasks.workunit.client.0.smithi026.stdout:1/259: dwrite d5/dd/fe [0,4194304] 0 2024-05-09T00:07:41.922 INFO:tasks.workunit.client.1.smithi135.stdout:0/871: dwrite d3/dd/f32 [8388608,4194304] 0 2024-05-09T00:07:41.922 INFO:tasks.workunit.client.0.smithi026.stdout:9/286: truncate d7/d23/d29/d31/d40/d41/f52 678260 0 2024-05-09T00:07:41.923 INFO:tasks.workunit.client.1.smithi135.stdout:5/940: dwrite db/d24/d32/dfa/d9c/d9f/dc0/df0/f10f [0,4194304] 0 2024-05-09T00:07:41.924 INFO:tasks.workunit.client.1.smithi135.stdout:5/941: truncate db/d24/d32/d5b/f6a 1968977 0 2024-05-09T00:07:41.924 INFO:tasks.workunit.client.1.smithi135.stdout:1/891: dwrite da/d24/d27/d33/f60 [0,4194304] 0 2024-05-09T00:07:41.924 INFO:tasks.workunit.client.0.smithi026.stdout:9/287: read d7/f1b [15258,61163] 0 2024-05-09T00:07:41.924 INFO:tasks.workunit.client.0.smithi026.stdout:7/395: dwrite d8/d1b/f34 [0,4194304] 0 2024-05-09T00:07:41.924 INFO:tasks.workunit.client.0.smithi026.stdout:9/288: write d7/d23/f37 [4238490,38695] 0 2024-05-09T00:07:41.925 INFO:tasks.workunit.client.0.smithi026.stdout:7/396: chown d8/d2e/d55/d22/l33 1 1 2024-05-09T00:07:41.930 INFO:tasks.workunit.client.0.smithi026.stdout:1/260: creat d5/dd/d1f/d39/d47/f59 x:0 0 0 2024-05-09T00:07:41.931 INFO:tasks.workunit.client.1.smithi135.stdout:2/894: truncate d1/d12/d20/d2b/d56/d72/f87 2386446 0 2024-05-09T00:07:41.931 INFO:tasks.workunit.client.1.smithi135.stdout:2/895: dread - d1/d12/d21/d41/d6d/f126 zero size 2024-05-09T00:07:41.933 INFO:tasks.workunit.client.1.smithi135.stdout:9/854: rename d1/d24/d44/d54/c76 to d1/d1a/d10/d3c/d102/c115 0 2024-05-09T00:07:41.935 INFO:tasks.workunit.client.1.smithi135.stdout:0/872: dread d3/f3b [0,4194304] 0 2024-05-09T00:07:41.935 INFO:tasks.workunit.client.1.smithi135.stdout:4/810: mknod dc/c109 0 2024-05-09T00:07:41.937 INFO:tasks.workunit.client.1.smithi135.stdout:6/944: getdents d2/da/d1d/d69/d89 0 2024-05-09T00:07:41.937 INFO:tasks.workunit.client.1.smithi135.stdout:6/945: chown d2/da/d26/d57/ddc/d116 788 1 2024-05-09T00:07:41.937 INFO:tasks.workunit.client.1.smithi135.stdout:6/946: write d2/da/d49/da4/dce/f12e [353326,15133] 0 2024-05-09T00:07:41.938 INFO:tasks.workunit.client.0.smithi026.stdout:9/289: symlink d7/d26/l6d 0 2024-05-09T00:07:41.940 INFO:tasks.workunit.client.0.smithi026.stdout:7/397: truncate d8/d2e/f5d 592660 0 2024-05-09T00:07:41.940 INFO:tasks.workunit.client.0.smithi026.stdout:7/398: dread - d8/d2e/d55/d22/f65 zero size 2024-05-09T00:07:41.940 INFO:tasks.workunit.client.1.smithi135.stdout:8/919: dwrite d4/dc6/f122 [0,4194304] 0 2024-05-09T00:07:41.941 INFO:tasks.workunit.client.0.smithi026.stdout:1/261: dread d5/dd/ff [0,4194304] 0 2024-05-09T00:07:41.944 INFO:tasks.workunit.client.0.smithi026.stdout:9/290: link d7/d23/d29/d59/f60 d7/d23/d2f/d50/f6e 0 2024-05-09T00:07:41.945 INFO:tasks.workunit.client.0.smithi026.stdout:7/399: mkdir d8/d1b/d8f 0 2024-05-09T00:07:41.947 INFO:tasks.workunit.client.0.smithi026.stdout:1/262: symlink d5/db/d1d/l5a 0 2024-05-09T00:07:41.947 INFO:tasks.workunit.client.0.smithi026.stdout:1/263: write d5/dd/d1f/d39/f3d [944397,282] 0 2024-05-09T00:07:41.948 INFO:tasks.workunit.client.0.smithi026.stdout:1/264: chown d5/db/l44 3183392 1 2024-05-09T00:07:41.950 INFO:tasks.workunit.client.0.smithi026.stdout:9/291: creat d7/d23/d29/d2e/f6f x:0 0 0 2024-05-09T00:07:41.959 INFO:tasks.workunit.client.0.smithi026.stdout:9/292: unlink d7/d26/l38 0 2024-05-09T00:07:41.963 INFO:tasks.workunit.client.0.smithi026.stdout:9/293: symlink d7/d23/d29/d31/d40/l70 0 2024-05-09T00:07:41.965 INFO:tasks.workunit.client.0.smithi026.stdout:7/400: dwrite d8/d1b/f2d [8388608,4194304] 0 2024-05-09T00:07:41.965 INFO:tasks.workunit.client.1.smithi135.stdout:5/942: mknod db/d84/d31/d5e/c122 0 2024-05-09T00:07:41.968 INFO:tasks.workunit.client.0.smithi026.stdout:9/294: creat d7/d26/f71 x:0 0 0 2024-05-09T00:07:41.968 INFO:tasks.workunit.client.0.smithi026.stdout:9/295: chown d7/l15 202 1 2024-05-09T00:07:41.972 INFO:tasks.workunit.client.0.smithi026.stdout:7/401: creat d8/d2e/d55/d22/d29/f90 x:0 0 0 2024-05-09T00:07:41.972 INFO:tasks.workunit.client.0.smithi026.stdout:7/402: write d8/d2e/f87 [909128,113052] 0 2024-05-09T00:07:41.974 INFO:tasks.workunit.client.0.smithi026.stdout:9/296: symlink d7/d23/d29/d59/l72 0 2024-05-09T00:07:41.974 INFO:tasks.workunit.client.0.smithi026.stdout:9/297: read - d7/d23/d29/d2e/f6f zero size 2024-05-09T00:07:41.974 INFO:tasks.workunit.client.0.smithi026.stdout:9/298: dread - d7/f4a zero size 2024-05-09T00:07:41.976 INFO:tasks.workunit.client.1.smithi135.stdout:1/892: rename da/d14/d20/d38/d3a/d40/l84 to da/d24/dd0/l136 0 2024-05-09T00:07:41.976 INFO:tasks.workunit.client.1.smithi135.stdout:1/893: fsync da/d14/d20/d2c/f12c 0 2024-05-09T00:07:41.978 INFO:tasks.workunit.client.1.smithi135.stdout:9/855: creat d1/d24/d44/d7f/da2/dca/f116 x:0 0 0 2024-05-09T00:07:41.981 INFO:tasks.workunit.client.1.smithi135.stdout:0/873: mkdir d3/dd/d3f/d3a/da4/dc1/d100 0 2024-05-09T00:07:41.981 INFO:tasks.workunit.client.1.smithi135.stdout:0/874: chown d3/dd/d3f/d43/da3/cbe 830740 1 2024-05-09T00:07:41.981 INFO:tasks.workunit.client.1.smithi135.stdout:0/875: stat d3/dd/d2d/db5/df4/daa/df2/cf3 0 2024-05-09T00:07:41.981 INFO:tasks.workunit.client.0.smithi026.stdout:7/403: dread d8/d2e/d55/d1e/d3d/f5f [0,4194304] 0 2024-05-09T00:07:41.982 INFO:tasks.workunit.client.0.smithi026.stdout:7/404: readlink d8/d2e/d55/d22/l4f 0 2024-05-09T00:07:41.982 INFO:tasks.workunit.client.0.smithi026.stdout:7/405: readlink d8/d5c/l78 0 2024-05-09T00:07:41.984 INFO:tasks.workunit.client.1.smithi135.stdout:4/811: mkdir dc/d71/d86/d10a 0 2024-05-09T00:07:41.985 INFO:tasks.workunit.client.0.smithi026.stdout:9/299: mkdir d7/d23/d2f/d73 0 2024-05-09T00:07:41.987 INFO:tasks.workunit.client.1.smithi135.stdout:6/947: creat d2/da/d26/d57/d59/d62/f13b x:0 0 0 2024-05-09T00:07:41.987 INFO:tasks.workunit.client.1.smithi135.stdout:1/894: dread da/d14/d20/d38/d3a/d40/d75/fdf [0,4194304] 0 2024-05-09T00:07:41.987 INFO:tasks.workunit.client.0.smithi026.stdout:7/406: stat d8/d2e/d55/d1e/l76 0 2024-05-09T00:07:41.988 INFO:tasks.workunit.client.0.smithi026.stdout:7/407: write d8/d2e/d55/d1e/f6e [201100,103497] 0 2024-05-09T00:07:41.997 INFO:tasks.workunit.client.1.smithi135.stdout:5/943: creat db/d24/db0/f123 x:0 0 0 2024-05-09T00:07:41.998 INFO:tasks.workunit.client.1.smithi135.stdout:2/896: rename d1/d12/d27/ff3 to d1/d12/d20/d2b/dbb/f12c 0 2024-05-09T00:07:42.000 INFO:tasks.workunit.client.0.smithi026.stdout:7/408: dwrite f5 [4194304,4194304] 0 2024-05-09T00:07:42.000 INFO:tasks.workunit.client.1.smithi135.stdout:0/876: symlink d3/dd/d3f/d43/l101 0 2024-05-09T00:07:42.001 INFO:tasks.workunit.client.1.smithi135.stdout:0/877: write d3/dd/d3f/d3a/d46/f3d [1346410,108382] 0 2024-05-09T00:07:42.001 INFO:tasks.workunit.client.1.smithi135.stdout:0/878: readlink d3/dd/d2d/l97 0 2024-05-09T00:07:42.001 INFO:tasks.workunit.client.1.smithi135.stdout:4/812: creat dc/d4a/f10b x:0 0 0 2024-05-09T00:07:42.003 INFO:tasks.workunit.client.1.smithi135.stdout:2/897: dread d1/d12/d21/f42 [0,4194304] 0 2024-05-09T00:07:42.003 INFO:tasks.workunit.client.1.smithi135.stdout:2/898: fdatasync d1/d12/da3/fd8 0 2024-05-09T00:07:42.003 INFO:tasks.workunit.client.1.smithi135.stdout:2/899: write d1/d12/f5a [9405256,90127] 0 2024-05-09T00:07:42.003 INFO:tasks.workunit.client.1.smithi135.stdout:1/895: chown da/d14/d20/d2c/l50 103316947 1 2024-05-09T00:07:42.004 INFO:tasks.workunit.client.0.smithi026.stdout:7/409: getdents d8/d2e/d55/d1e/d3d/d6b 0 2024-05-09T00:07:42.006 INFO:tasks.workunit.client.0.smithi026.stdout:7/410: mknod d8/d1b/d8f/c91 0 2024-05-09T00:07:42.006 INFO:tasks.workunit.client.0.smithi026.stdout:7/411: readlink d8/d5c/l78 0 2024-05-09T00:07:42.008 INFO:tasks.workunit.client.1.smithi135.stdout:3/997: sync 2024-05-09T00:07:42.009 INFO:tasks.workunit.client.1.smithi135.stdout:8/920: rename d4/d7/d2a/d9f/cb2 to d4/d7/d4a/dee/c138 0 2024-05-09T00:07:42.010 INFO:tasks.workunit.client.0.smithi026.stdout:7/412: symlink d8/d1b/d89/d8d/l92 0 2024-05-09T00:07:42.012 INFO:tasks.workunit.client.1.smithi135.stdout:9/856: link d1/d1a/d10/c3f d1/d1a/d89/dad/de3/c117 0 2024-05-09T00:07:42.013 INFO:tasks.workunit.client.0.smithi026.stdout:7/413: link d8/d2e/d55/d1e/f7c d8/d2e/d55/d1e/f93 0 2024-05-09T00:07:42.014 INFO:tasks.workunit.client.0.smithi026.stdout:7/414: write d8/d2e/d55/d22/d29/f90 [922272,115730] 0 2024-05-09T00:07:42.015 INFO:tasks.workunit.client.1.smithi135.stdout:4/813: mknod dc/d26/d31/db8/dd1/c10c 0 2024-05-09T00:07:42.015 INFO:tasks.workunit.client.1.smithi135.stdout:0/879: dwrite d3/dd/d3f/d29/f9c [0,4194304] 0 2024-05-09T00:07:42.015 INFO:tasks.workunit.client.1.smithi135.stdout:0/880: dread - d3/dd/d3f/d58/dae/fb9 zero size 2024-05-09T00:07:42.016 INFO:tasks.workunit.client.1.smithi135.stdout:9/857: dread d1/d1a/d89/dad/ded/f106 [0,4194304] 0 2024-05-09T00:07:42.017 INFO:tasks.workunit.client.1.smithi135.stdout:1/896: mknod da/d14/d20/d38/d3a/d40/c137 0 2024-05-09T00:07:42.019 INFO:tasks.workunit.client.1.smithi135.stdout:3/998: truncate d8/d6d/d44/d4b/da0/daa/d88/f93 1079181 0 2024-05-09T00:07:42.019 INFO:tasks.workunit.client.1.smithi135.stdout:3/999: chown d8/d6d/d44/d4b/dc2/d120/d129/d90/c10f 970802655 1 2024-05-09T00:07:42.026 INFO:tasks.workunit.client.0.smithi026.stdout:7/415: dwrite d8/d1b/f7b [0,4194304] 0 2024-05-09T00:07:42.107 INFO:tasks.workunit.client.1.smithi135.stdout:5/944: rename db/d24/db0/dcd/cf1 to db/d24/d32/dfa/dbe/c124 0 2024-05-09T00:07:42.107 INFO:tasks.workunit.client.1.smithi135.stdout:5/945: truncate db/d24/d32/dfa/d9c/d9f/d92/fa0 809816 0 2024-05-09T00:07:42.108 INFO:tasks.workunit.client.1.smithi135.stdout:8/921: unlink d4/d8/f6b 0 2024-05-09T00:07:42.108 INFO:tasks.workunit.client.1.smithi135.stdout:8/922: write d4/d7/d4a/ff6 [371203,120306] 0 2024-05-09T00:07:42.109 INFO:tasks.workunit.client.1.smithi135.stdout:4/814: creat dc/d4a/d69/d55/d6d/dec/dee/f10d x:0 0 0 2024-05-09T00:07:42.111 INFO:tasks.workunit.client.1.smithi135.stdout:2/900: mkdir d1/d12/d12d 0 2024-05-09T00:07:42.112 INFO:tasks.workunit.client.0.smithi026.stdout:7/416: creat d8/d2e/d55/d22/d29/f94 x:0 0 0 2024-05-09T00:07:42.113 INFO:tasks.workunit.client.1.smithi135.stdout:9/858: chown d1/d1a/d10/f90 0 1 2024-05-09T00:07:42.115 INFO:tasks.workunit.client.1.smithi135.stdout:1/897: symlink da/d14/d20/d38/d3a/d113/l138 0 2024-05-09T00:07:42.115 INFO:tasks.workunit.client.1.smithi135.stdout:1/898: write da/d14/d20/d38/d3a/d40/fd6 [363945,60268] 0 2024-05-09T00:07:42.117 INFO:tasks.workunit.client.0.smithi026.stdout:0/382: sync 2024-05-09T00:07:42.117 INFO:tasks.workunit.client.0.smithi026.stdout:2/220: sync 2024-05-09T00:07:42.118 INFO:tasks.workunit.client.0.smithi026.stdout:2/221: readlink d14/d15/d17/l2c 0 2024-05-09T00:07:42.118 INFO:tasks.workunit.client.0.smithi026.stdout:9/300: rmdir d7 39 2024-05-09T00:07:42.121 INFO:tasks.workunit.client.0.smithi026.stdout:7/417: rename d8/d5c/d82 to d8/d2e/d55/d95 0 2024-05-09T00:07:42.123 INFO:tasks.workunit.client.0.smithi026.stdout:0/383: mkdir d1d/d1e/d20/d4d/d58/d62/d78/d80 0 2024-05-09T00:07:42.124 INFO:tasks.workunit.client.1.smithi135.stdout:0/881: rename d3/c20 to d3/dd/d2d/c102 0 2024-05-09T00:07:42.125 INFO:tasks.workunit.client.0.smithi026.stdout:2/222: unlink d14/d22/f52 0 2024-05-09T00:07:42.128 INFO:tasks.workunit.client.1.smithi135.stdout:5/946: link db/d24/d32/d5b/d91/f7c db/d24/d32/dfa/f125 0 2024-05-09T00:07:42.128 INFO:tasks.workunit.client.1.smithi135.stdout:5/947: chown db/d24/d32/d5b/l66 181 1 2024-05-09T00:07:42.129 INFO:tasks.workunit.client.0.smithi026.stdout:9/301: symlink d7/d26/l74 0 2024-05-09T00:07:42.129 INFO:tasks.workunit.client.0.smithi026.stdout:9/302: fsync d7/d23/f25 0 2024-05-09T00:07:42.130 INFO:tasks.workunit.client.1.smithi135.stdout:8/923: mkdir d4/d8/da2/da6/dde/dfb/d139 0 2024-05-09T00:07:42.131 INFO:tasks.workunit.client.0.smithi026.stdout:7/418: mknod d8/d2e/d55/d1e/d3d/c96 0 2024-05-09T00:07:42.133 INFO:tasks.workunit.client.1.smithi135.stdout:2/901: creat d1/d12/d20/d2b/d56/ddd/f12e x:0 0 0 2024-05-09T00:07:42.133 INFO:tasks.workunit.client.1.smithi135.stdout:2/902: read - d1/d12/d21/d41/d6d/d6e/f125 zero size 2024-05-09T00:07:42.134 INFO:tasks.workunit.client.1.smithi135.stdout:2/903: read d1/f33 [219055,54283] 0 2024-05-09T00:07:42.134 INFO:tasks.workunit.client.0.smithi026.stdout:0/384: rmdir d1d 39 2024-05-09T00:07:42.135 INFO:tasks.workunit.client.1.smithi135.stdout:9/859: truncate d1/d1a/d2c/f6d 1924318 0 2024-05-09T00:07:42.136 INFO:tasks.workunit.client.0.smithi026.stdout:7/419: dread d8/d2e/d55/d1e/d3d/f48 [0,4194304] 0 2024-05-09T00:07:42.139 INFO:tasks.workunit.client.1.smithi135.stdout:9/860: write d1/f59 [576550,91669] 0 2024-05-09T00:07:42.139 INFO:tasks.workunit.client.0.smithi026.stdout:9/303: unlink d7/c2a 0 2024-05-09T00:07:42.143 INFO:tasks.workunit.client.0.smithi026.stdout:7/420: creat d8/d1b/d8f/f97 x:0 0 0 2024-05-09T00:07:42.143 INFO:tasks.workunit.client.0.smithi026.stdout:7/421: fsync d8/d2e/d55/f7f 0 2024-05-09T00:07:42.145 INFO:tasks.workunit.client.0.smithi026.stdout:7/422: write d8/d1b/f5b [2891374,109923] 0 2024-05-09T00:07:42.145 INFO:tasks.workunit.client.0.smithi026.stdout:7/423: chown f7 24872084 1 2024-05-09T00:07:42.145 INFO:tasks.workunit.client.0.smithi026.stdout:7/424: write d8/d2e/d55/d22/d29/f94 [1026728,49256] 0 2024-05-09T00:07:42.146 INFO:tasks.workunit.client.1.smithi135.stdout:1/899: unlink da/db/f61 0 2024-05-09T00:07:42.146 INFO:tasks.workunit.client.1.smithi135.stdout:1/900: fsync da/f1f 0 2024-05-09T00:07:42.146 INFO:tasks.workunit.client.0.smithi026.stdout:9/304: symlink d7/d23/d29/d31/d40/d41/l75 0 2024-05-09T00:07:42.148 INFO:tasks.workunit.client.1.smithi135.stdout:4/815: rename dc/d4a/d69/l46 to dc/d26/d31/d82/l10e 0 2024-05-09T00:07:42.148 INFO:tasks.workunit.client.1.smithi135.stdout:4/816: truncate dc/d71/d90/fde 42621 0 2024-05-09T00:07:42.150 INFO:tasks.workunit.client.1.smithi135.stdout:0/882: mkdir d3/dd/d2d/db5/df4/d103 0 2024-05-09T00:07:42.152 INFO:tasks.workunit.client.0.smithi026.stdout:7/425: creat d8/d1b/d89/d8d/f98 x:0 0 0 2024-05-09T00:07:42.155 INFO:tasks.workunit.client.0.smithi026.stdout:0/385: dwrite d1d/d1e/f23 [0,4194304] 0 2024-05-09T00:07:42.155 INFO:tasks.workunit.client.0.smithi026.stdout:0/386: truncate d1d/d25/d3c/f7a 987661 0 2024-05-09T00:07:42.156 INFO:tasks.workunit.client.0.smithi026.stdout:2/223: dwrite d14/d15/f39 [0,4194304] 0 2024-05-09T00:07:42.156 INFO:tasks.workunit.client.0.smithi026.stdout:9/305: mkdir d7/d23/d76 0 2024-05-09T00:07:42.156 INFO:tasks.workunit.client.0.smithi026.stdout:9/306: stat d7/d23/d29/d2e/l3f 0 2024-05-09T00:07:42.157 INFO:tasks.workunit.client.1.smithi135.stdout:5/948: mknod db/d5d/dac/ddc/dbf/de3/c126 0 2024-05-09T00:07:42.157 INFO:tasks.workunit.client.1.smithi135.stdout:5/949: dread - db/d24/d32/d5b/d91/f6b zero size 2024-05-09T00:07:42.160 INFO:tasks.workunit.client.1.smithi135.stdout:8/924: unlink d4/d7/l5a 0 2024-05-09T00:07:42.161 INFO:tasks.workunit.client.1.smithi135.stdout:8/925: read d4/d7/f52 [2796859,50305] 0 2024-05-09T00:07:42.164 INFO:tasks.workunit.client.1.smithi135.stdout:0/883: dread d3/dd/fd5 [4194304,4194304] 0 2024-05-09T00:07:42.165 INFO:tasks.workunit.client.1.smithi135.stdout:9/861: creat d1/f118 x:0 0 0 2024-05-09T00:07:42.169 INFO:tasks.workunit.client.0.smithi026.stdout:2/224: unlink l12 0 2024-05-09T00:07:42.170 INFO:tasks.workunit.client.0.smithi026.stdout:2/225: fdatasync d14/d22/d55/f56 0 2024-05-09T00:07:42.172 INFO:tasks.workunit.client.1.smithi135.stdout:1/901: symlink da/d24/dd0/l139 0 2024-05-09T00:07:42.177 INFO:tasks.workunit.client.0.smithi026.stdout:0/387: dwrite d1d/d1e/d2d/f3b [0,4194304] 0 2024-05-09T00:07:42.177 INFO:tasks.workunit.client.0.smithi026.stdout:0/388: stat d1d/d25/f54 0 2024-05-09T00:07:42.178 INFO:tasks.workunit.client.1.smithi135.stdout:4/817: link dc/d26/df4/f48 dc/d26/d93/d9d/f10f 0 2024-05-09T00:07:42.178 INFO:tasks.workunit.client.1.smithi135.stdout:4/818: write dc/d26/df4/fc5 [99871,123069] 0 2024-05-09T00:07:42.179 INFO:tasks.workunit.client.1.smithi135.stdout:6/948: sync 2024-05-09T00:07:42.181 INFO:tasks.workunit.client.1.smithi135.stdout:4/819: dread dc/f4b [0,4194304] 0 2024-05-09T00:07:42.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.185+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5ee0101c50 con 0x7f5ee00f5e70 2024-05-09T00:07:42.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.186+0000 7f5ecf7fe700 1 -- 172.21.15.26:0/533051966 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5ed0051ad0 con 0x7f5ee00f5e70 2024-05-09T00:07:42.183 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:07:42.183 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:07:42.183 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:07:42.183 INFO:tasks.workunit.client.0.smithi026.stdout:9/307: rename d7/d23/d29/d31/d40/d41/f52 to d7/d23/d29/d31/d40/d41/d54/f77 0 2024-05-09T00:07:42.184 INFO:tasks.workunit.client.1.smithi135.stdout:5/950: getdents db/d24/d32/dfa/d9c/d9f/dc0/dc4 0 2024-05-09T00:07:42.184 INFO:tasks.workunit.client.1.smithi135.stdout:5/951: fdatasync db/fdb 0 2024-05-09T00:07:42.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f5ec8066e00 msgr2=0x7f5ec80692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f5ec8066e00 0x7f5ec80692c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5ed400aac0 tx=0x7f5ed4017040).stop 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f5e70 msgr2=0x7f5ee0108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f5e70 0x7f5ee0108070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f5ed000e910 tx=0x7f5ed000b040).stop 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 shutdown_connections 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f5ec8066e00 0x7f5ec80692c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ee00f5e70 0x7f5ee0108070 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 --2- 172.21.15.26:0/533051966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ee00f7070 0x7f5ee0108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 >> 172.21.15.26:0/533051966 conn(0x7f5ee00f15d0 msgr2=0x7f5ee00f21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.189+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 shutdown_connections 2024-05-09T00:07:42.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:07:42.190+0000 7f5ee4c4b700 1 -- 172.21.15.26:0/533051966 wait complete. 2024-05-09T00:07:42.187 INFO:tasks.workunit.client.1.smithi135.stdout:8/926: mknod d4/dc6/c13a 0 2024-05-09T00:07:42.187 INFO:tasks.workunit.client.1.smithi135.stdout:9/862: dwrite d1/d1a/f42 [0,4194304] 0 2024-05-09T00:07:42.189 INFO:tasks.workunit.client.1.smithi135.stdout:0/884: dread d3/dd/d3f/d43/da3/fa7 [0,4194304] 0 2024-05-09T00:07:42.193 INFO:tasks.workunit.client.1.smithi135.stdout:1/902: getdents da/d14/d20/d38/d3a/db7/dc6/d93/de8 0 2024-05-09T00:07:42.195 INFO:tasks.workunit.client.0.smithi026.stdout:0/389: rename d1d/d1e/d20/c27 to d1d/d25/c81 0 2024-05-09T00:07:42.197 INFO:tasks.workunit.client.1.smithi135.stdout:6/949: truncate d2/da/d49/da4/fc7 168906 0 2024-05-09T00:07:42.197 INFO:tasks.workunit.client.1.smithi135.stdout:8/927: dread d4/d7/d33/fea [0,4194304] 0 2024-05-09T00:07:42.197 INFO:tasks.workunit.client.1.smithi135.stdout:8/928: fdatasync d4/d7/d33/f7f 0 2024-05-09T00:07:42.197 INFO:tasks.workunit.client.1.smithi135.stdout:8/929: chown d4/d7/d33/fea 2579969 1 2024-05-09T00:07:42.199 INFO:tasks.workunit.client.1.smithi135.stdout:4/820: mkdir dc/d110 0 2024-05-09T00:07:42.202 INFO:tasks.workunit.client.1.smithi135.stdout:5/952: getdents db/d24/d32/dfa/d9c/d9f/dc0/df0 0 2024-05-09T00:07:42.203 INFO:tasks.workunit.client.0.smithi026.stdout:0/390: dread d1d/d25/d3c/f46 [0,4194304] 0 2024-05-09T00:07:42.203 INFO:tasks.workunit.client.0.smithi026.stdout:2/226: dwrite f8 [0,4194304] 0 2024-05-09T00:07:42.203 INFO:tasks.workunit.client.0.smithi026.stdout:7/426: getdents d8/d1b/d8f 0 2024-05-09T00:07:42.203 INFO:tasks.workunit.client.0.smithi026.stdout:7/427: fsync d8/d2e/d55/d1e/d3d/f61 0 2024-05-09T00:07:42.203 INFO:tasks.workunit.client.0.smithi026.stdout:7/428: chown d8/d2e/d55/d22/c40 6202043 1 2024-05-09T00:07:42.203 INFO:tasks.workunit.client.0.smithi026.stdout:7/429: truncate d8/d2e/d55/d1e/d3d/f48 1010768 0 2024-05-09T00:07:42.204 INFO:tasks.workunit.client.1.smithi135.stdout:1/903: dread da/d14/d20/d38/d3a/d40/f82 [0,4194304] 0 2024-05-09T00:07:42.204 INFO:tasks.workunit.client.1.smithi135.stdout:9/863: symlink d1/d24/d44/d7f/da2/dca/d113/l119 0 2024-05-09T00:07:42.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/953: read db/d84/d62/fa1 [4173298,88102] 0 2024-05-09T00:07:42.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/954: truncate db/d24/d32/dfa/d9c/d9f/fb4 1617514 0 2024-05-09T00:07:42.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/955: readlink db/d84/d62/l107 0 2024-05-09T00:07:42.211 INFO:tasks.workunit.client.1.smithi135.stdout:1/904: write da/d14/d20/d38/f4d [3100852,36551] 0 2024-05-09T00:07:42.213 INFO:tasks.workunit.client.1.smithi135.stdout:9/864: dread d1/da4/ff8 [0,4194304] 0 2024-05-09T00:07:42.214 INFO:tasks.workunit.client.1.smithi135.stdout:4/821: dread dc/d26/d93/fc8 [0,4194304] 0 2024-05-09T00:07:42.214 INFO:tasks.workunit.client.1.smithi135.stdout:4/822: fsync dc/d4a/d69/d55/d5f/d5a/f5b 0 2024-05-09T00:07:42.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/308: dwrite d7/d23/d29/d31/f3d [0,4194304] 0 2024-05-09T00:07:42.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/309: write d7/f4a [475836,70966] 0 2024-05-09T00:07:42.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/310: readlink d7/d23/d29/d31/d40/d41/l75 0 2024-05-09T00:07:42.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/311: chown d7/f1d 75400 1 2024-05-09T00:07:42.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/312: truncate d7/f16 1158778 0 2024-05-09T00:07:42.216 INFO:tasks.workunit.client.0.smithi026.stdout:9/313: dread d7/d23/d2f/d3a/f55 [0,4194304] 0 2024-05-09T00:07:42.216 INFO:tasks.workunit.client.0.smithi026.stdout:2/227: rmdir d14/d22/d55 39 2024-05-09T00:07:42.216 INFO:tasks.workunit.client.0.smithi026.stdout:2/228: chown d14/d15/d20/f2a 7 1 2024-05-09T00:07:42.220 INFO:tasks.workunit.client.0.smithi026.stdout:7/430: creat d8/d5c/f99 x:0 0 0 2024-05-09T00:07:42.227 INFO:tasks.workunit.client.0.smithi026.stdout:9/314: dread d7/d23/d29/d31/f3d [0,4194304] 0 2024-05-09T00:07:42.232 INFO:tasks.workunit.client.1.smithi135.stdout:1/905: mknod da/d14/d20/d38/d3a/d113/c13a 0 2024-05-09T00:07:42.233 INFO:tasks.workunit.client.0.smithi026.stdout:7/431: mkdir d8/d5c/d9a 0 2024-05-09T00:07:42.233 INFO:tasks.workunit.client.0.smithi026.stdout:7/432: chown d8/d1b/f7b 52892218 1 2024-05-09T00:07:42.234 INFO:tasks.workunit.client.1.smithi135.stdout:4/823: symlink dc/d26/d4e/l111 0 2024-05-09T00:07:42.234 INFO:tasks.workunit.client.1.smithi135.stdout:4/824: stat dc/d71/d86/d10a 0 2024-05-09T00:07:42.235 INFO:tasks.workunit.client.1.smithi135.stdout:5/956: dread db/d84/d62/fed [0,4194304] 0 2024-05-09T00:07:42.235 INFO:tasks.workunit.client.1.smithi135.stdout:5/957: chown db/d24/db0/dcd/df7 632 1 2024-05-09T00:07:42.237 INFO:tasks.workunit.client.1.smithi135.stdout:4/825: truncate dc/f42 525337 0 2024-05-09T00:07:42.237 INFO:tasks.workunit.client.0.smithi026.stdout:2/229: dwrite d14/d15/d20/f36 [0,4194304] 0 2024-05-09T00:07:42.237 INFO:tasks.workunit.client.0.smithi026.stdout:2/230: chown d14/d15/f39 1566477 1 2024-05-09T00:07:42.238 INFO:tasks.workunit.client.1.smithi135.stdout:1/906: dread da/d24/d27/f28 [0,4194304] 0 2024-05-09T00:07:42.240 INFO:tasks.workunit.client.1.smithi135.stdout:4/826: symlink dc/l112 0 2024-05-09T00:07:42.240 INFO:tasks.workunit.client.1.smithi135.stdout:4/827: fsync dc/d26/d93/d9d/f10f 0 2024-05-09T00:07:42.240 INFO:tasks.workunit.client.0.smithi026.stdout:9/315: dread d7/d23/f37 [0,4194304] 0 2024-05-09T00:07:42.243 INFO:tasks.workunit.client.1.smithi135.stdout:1/907: write da/d14/d20/d2c/f99 [141027,3839] 0 2024-05-09T00:07:42.244 INFO:tasks.workunit.client.0.smithi026.stdout:9/316: symlink d7/d23/d76/l78 0 2024-05-09T00:07:42.246 INFO:tasks.workunit.client.0.smithi026.stdout:2/231: dread f11 [0,4194304] 0 2024-05-09T00:07:42.246 INFO:tasks.workunit.client.0.smithi026.stdout:2/232: fdatasync f9 0 2024-05-09T00:07:42.246 INFO:tasks.workunit.client.0.smithi026.stdout:2/233: dread - d14/d15/d3b/f3f zero size 2024-05-09T00:07:42.248 INFO:tasks.workunit.client.0.smithi026.stdout:9/317: unlink d7/d26/f3e 0 2024-05-09T00:07:42.250 INFO:tasks.workunit.client.0.smithi026.stdout:9/318: dread d7/f16 [0,4194304] 0 2024-05-09T00:07:42.250 INFO:tasks.workunit.client.0.smithi026.stdout:2/234: creat d14/d15/d3b/d40/f59 x:0 0 0 2024-05-09T00:07:42.251 INFO:tasks.workunit.client.0.smithi026.stdout:9/319: getdents d7/d23/d2f/d50 0 2024-05-09T00:07:42.251 INFO:tasks.workunit.client.0.smithi026.stdout:9/320: fdatasync d7/f4e 0 2024-05-09T00:07:42.251 INFO:tasks.workunit.client.1.smithi135.stdout:4/828: dread dc/d4a/d69/d55/d5f/d5a/f5b [0,4194304] 0 2024-05-09T00:07:42.253 INFO:tasks.workunit.client.0.smithi026.stdout:0/391: dwrite d1d/d1e/d20/f68 [0,4194304] 0 2024-05-09T00:07:42.253 INFO:tasks.workunit.client.0.smithi026.stdout:0/392: chown d1d/d1e/d20/c4f 8962 1 2024-05-09T00:07:42.253 INFO:tasks.workunit.client.0.smithi026.stdout:9/321: chown d7/c11 103 1 2024-05-09T00:07:42.253 INFO:tasks.workunit.client.0.smithi026.stdout:3/253: sync 2024-05-09T00:07:42.254 INFO:tasks.workunit.client.0.smithi026.stdout:3/254: chown d5/d9/dc/f1b 247447 1 2024-05-09T00:07:42.254 INFO:tasks.workunit.client.1.smithi135.stdout:6/950: dwrite d2/d20/d3f/f44 [0,4194304] 0 2024-05-09T00:07:42.255 INFO:tasks.workunit.client.1.smithi135.stdout:8/930: dwrite d4/d22/f8c [0,4194304] 0 2024-05-09T00:07:42.255 INFO:tasks.workunit.client.1.smithi135.stdout:8/931: fdatasync d4/d7/de/d45/d76/de2/f114 0 2024-05-09T00:07:42.257 INFO:tasks.workunit.client.0.smithi026.stdout:7/433: dwrite d8/d2e/d55/d22/d29/f90 [0,4194304] 0 2024-05-09T00:07:42.259 INFO:tasks.workunit.client.1.smithi135.stdout:9/865: dwrite d1/fe1 [0,4194304] 0 2024-05-09T00:07:42.259 INFO:tasks.workunit.client.0.smithi026.stdout:4/241: sync 2024-05-09T00:07:42.259 INFO:tasks.workunit.client.0.smithi026.stdout:5/253: sync 2024-05-09T00:07:42.261 INFO:tasks.workunit.client.0.smithi026.stdout:0/393: rename d1d/d1e/d20/f28 to d1d/d1e/d20/d4d/f82 0 2024-05-09T00:07:42.264 INFO:tasks.workunit.client.1.smithi135.stdout:8/932: dread d4/d7/d2a/d56/f61 [0,4194304] 0 2024-05-09T00:07:42.264 INFO:tasks.workunit.client.0.smithi026.stdout:3/255: dread d5/d9/d4a/f52 [0,4194304] 0 2024-05-09T00:07:42.268 INFO:tasks.workunit.client.0.smithi026.stdout:8/273: sync 2024-05-09T00:07:42.268 INFO:tasks.workunit.client.0.smithi026.stdout:6/232: sync 2024-05-09T00:07:42.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/866: write d1/f59 [208317,96130] 0 2024-05-09T00:07:42.274 INFO:tasks.workunit.client.0.smithi026.stdout:7/434: creat d8/d2e/d55/d22/f9b x:0 0 0 2024-05-09T00:07:42.277 INFO:tasks.workunit.client.0.smithi026.stdout:5/254: chown d2/la 995393732 1 2024-05-09T00:07:42.280 INFO:tasks.workunit.client.1.smithi135.stdout:9/867: unlink d1/d24/d86/d97/dec/fb6 0 2024-05-09T00:07:42.281 INFO:tasks.workunit.client.0.smithi026.stdout:4/242: creat d0/d12/d1b/d4e/f50 x:0 0 0 2024-05-09T00:07:42.282 INFO:tasks.workunit.client.0.smithi026.stdout:4/243: dread d0/d12/d34/f38 [0,4194304] 0 2024-05-09T00:07:42.283 INFO:tasks.workunit.client.0.smithi026.stdout:4/244: chown d0/d12/d1b/l27 9 1 2024-05-09T00:07:42.283 INFO:tasks.workunit.client.0.smithi026.stdout:0/394: mkdir d1d/d1e/d20/d4d/d83 0 2024-05-09T00:07:42.283 INFO:tasks.workunit.client.0.smithi026.stdout:0/395: read - d1d/d1e/d2d/f4a zero size 2024-05-09T00:07:42.284 INFO:tasks.workunit.client.0.smithi026.stdout:0/396: write d1d/d25/d47/f5a [896198,34842] 0 2024-05-09T00:07:42.284 INFO:tasks.workunit.client.0.smithi026.stdout:0/397: truncate d1d/d1e/d20/d4d/f82 4374769 0 2024-05-09T00:07:42.285 INFO:tasks.workunit.client.0.smithi026.stdout:8/274: truncate de/f16 488569 0 2024-05-09T00:07:42.286 INFO:tasks.workunit.client.1.smithi135.stdout:9/868: truncate d1/d24/f47 1612110 0 2024-05-09T00:07:42.287 INFO:tasks.workunit.client.0.smithi026.stdout:6/233: mkdir d15/d1e/d3d/d4c/d4d 0 2024-05-09T00:07:42.288 INFO:tasks.workunit.client.0.smithi026.stdout:5/255: creat d2/d8/d31/d4b/d51/f53 x:0 0 0 2024-05-09T00:07:42.289 INFO:tasks.workunit.client.0.smithi026.stdout:4/245: creat d0/d12/d1b/f51 x:0 0 0 2024-05-09T00:07:42.289 INFO:tasks.workunit.client.0.smithi026.stdout:1/265: sync 2024-05-09T00:07:42.290 INFO:tasks.workunit.client.0.smithi026.stdout:0/398: getdents d1d/d1e/d2d 0 2024-05-09T00:07:42.292 INFO:tasks.workunit.client.0.smithi026.stdout:6/234: rename lb to d15/d1e/d30/d32/l4e 0 2024-05-09T00:07:42.293 INFO:tasks.workunit.client.0.smithi026.stdout:6/235: stat d15/d1e/d3d/d4c/d4d 0 2024-05-09T00:07:42.294 INFO:tasks.workunit.client.0.smithi026.stdout:5/256: mknod d2/d8/d31/d4b/c54 0 2024-05-09T00:07:42.294 INFO:tasks.workunit.client.0.smithi026.stdout:6/236: write d15/f18 [6364325,94176] 0 2024-05-09T00:07:42.295 INFO:tasks.workunit.client.0.smithi026.stdout:4/246: symlink d0/d12/d1b/d4e/l52 0 2024-05-09T00:07:42.295 INFO:tasks.workunit.client.0.smithi026.stdout:4/247: fdatasync d0/d12/f2c 0 2024-05-09T00:07:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:0/399: mkdir d1d/d1e/d20/d4d/d58/d62/d84 0 2024-05-09T00:07:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:0/400: dread - d1d/d1e/f4b zero size 2024-05-09T00:07:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:0/401: dread - d1d/d1e/d20/d51/f57 zero size 2024-05-09T00:07:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:0/402: fsync d1d/d25/d3c/f7a 0 2024-05-09T00:07:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:5/257: creat d2/f55 x:0 0 0 2024-05-09T00:07:42.298 INFO:tasks.workunit.client.0.smithi026.stdout:6/237: creat d15/d1e/d30/f4f x:0 0 0 2024-05-09T00:07:42.298 INFO:tasks.workunit.client.0.smithi026.stdout:6/238: write f11 [616434,29853] 0 2024-05-09T00:07:42.299 INFO:tasks.workunit.client.0.smithi026.stdout:4/248: link d0/d12/d1b/d4e/f50 d0/d12/d1b/f53 0 2024-05-09T00:07:42.299 INFO:tasks.workunit.client.0.smithi026.stdout:4/249: write d0/d12/d1b/f53 [6897,47530] 0 2024-05-09T00:07:42.300 INFO:tasks.workunit.client.0.smithi026.stdout:4/250: fsync d0/d12/d1b/d2b/f40 0 2024-05-09T00:07:42.300 INFO:tasks.workunit.client.0.smithi026.stdout:4/251: write d0/d12/d34/f36 [317001,54553] 0 2024-05-09T00:07:42.301 INFO:tasks.workunit.client.0.smithi026.stdout:0/403: unlink d1d/d25/l5e 0 2024-05-09T00:07:42.302 INFO:tasks.workunit.client.0.smithi026.stdout:5/258: truncate d2/d8/d31/f30 126980 0 2024-05-09T00:07:42.302 INFO:tasks.workunit.client.0.smithi026.stdout:5/259: chown d2/f41 4852241 1 2024-05-09T00:07:42.303 INFO:tasks.workunit.client.0.smithi026.stdout:6/239: symlink d15/l50 0 2024-05-09T00:07:42.303 INFO:tasks.workunit.client.0.smithi026.stdout:6/240: chown d15/d2b/d33 3353 1 2024-05-09T00:07:42.303 INFO:tasks.workunit.client.0.smithi026.stdout:6/241: write d15/f18 [13572918,94499] 0 2024-05-09T00:07:42.304 INFO:tasks.workunit.client.0.smithi026.stdout:0/404: link d1d/d1e/d20/d51/f57 d1d/d25/d47/f85 0 2024-05-09T00:07:42.304 INFO:tasks.workunit.client.0.smithi026.stdout:0/405: truncate d1d/d25/d3c/d5f/f72 231737 0 2024-05-09T00:07:42.304 INFO:tasks.workunit.client.0.smithi026.stdout:0/406: chown d1d/d1e/d2d/f3e 123 1 2024-05-09T00:07:42.307 INFO:tasks.workunit.client.0.smithi026.stdout:0/407: link d1d/d25/d3c/d5f/f72 d1d/d1e/d20/d51/f86 0 2024-05-09T00:07:42.308 INFO:tasks.workunit.client.0.smithi026.stdout:5/260: truncate d2/d8/d31/f12 1078954 0 2024-05-09T00:07:42.308 INFO:tasks.workunit.client.0.smithi026.stdout:0/408: write d1d/d25/d3c/f46 [1785285,112116] 0 2024-05-09T00:07:42.308 INFO:tasks.workunit.client.0.smithi026.stdout:0/409: chown d1d/d25/l60 1700 1 2024-05-09T00:07:42.309 INFO:tasks.workunit.client.0.smithi026.stdout:5/261: symlink d2/d8/d2a/l56 0 2024-05-09T00:07:42.309 INFO:tasks.workunit.client.0.smithi026.stdout:5/262: chown d2/d8/d31/d32/d48/c49 26 1 2024-05-09T00:07:42.310 INFO:tasks.workunit.client.0.smithi026.stdout:0/410: creat d1d/d25/d3c/f87 x:0 0 0 2024-05-09T00:07:42.311 INFO:tasks.workunit.client.0.smithi026.stdout:5/263: creat d2/d8/d31/d2e/d4a/f57 x:0 0 0 2024-05-09T00:07:42.311 INFO:tasks.workunit.client.0.smithi026.stdout:0/411: dread f4 [0,4194304] 0 2024-05-09T00:07:42.311 INFO:tasks.workunit.client.0.smithi026.stdout:0/412: read - d1d/d1e/d2d/f77 zero size 2024-05-09T00:07:42.313 INFO:tasks.workunit.client.0.smithi026.stdout:2/235: dwrite d14/d15/d20/f23 [0,4194304] 0 2024-05-09T00:07:42.314 INFO:tasks.workunit.client.0.smithi026.stdout:2/236: read d14/d15/f26 [586174,92039] 0 2024-05-09T00:07:42.317 INFO:tasks.workunit.client.0.smithi026.stdout:2/237: mkdir d14/d15/d17/d5a 0 2024-05-09T00:07:42.317 INFO:tasks.workunit.client.0.smithi026.stdout:2/238: chown d14/d15/d17/f1c 17 1 2024-05-09T00:07:42.320 INFO:tasks.workunit.client.0.smithi026.stdout:2/239: mkdir d14/d15/d1f/d4f/d5b 0 2024-05-09T00:07:42.327 INFO:tasks.workunit.client.1.smithi135.stdout:1/908: dwrite da/db/d107/f12b [0,4194304] 0 2024-05-09T00:07:42.331 INFO:tasks.workunit.client.0.smithi026.stdout:9/322: dwrite d7/d23/d29/d31/d40/d41/d54/f77 [0,4194304] 0 2024-05-09T00:07:42.331 INFO:tasks.workunit.client.0.smithi026.stdout:9/323: chown d7/d23/d76/l78 1221398 1 2024-05-09T00:07:42.331 INFO:tasks.workunit.client.0.smithi026.stdout:3/256: dwrite d5/f39 [0,4194304] 0 2024-05-09T00:07:42.334 INFO:tasks.workunit.client.1.smithi135.stdout:4/829: dwrite dc/d26/d31/f3c [0,4194304] 0 2024-05-09T00:07:42.335 INFO:tasks.workunit.client.0.smithi026.stdout:9/324: read d7/d23/d2f/d3a/f55 [228958,47286] 0 2024-05-09T00:07:42.335 INFO:tasks.workunit.client.0.smithi026.stdout:1/266: dread d5/dd/f3f [0,4194304] 0 2024-05-09T00:07:42.335 INFO:tasks.workunit.client.0.smithi026.stdout:1/267: truncate d5/dd/f52 330608 0 2024-05-09T00:07:42.335 INFO:tasks.workunit.client.0.smithi026.stdout:9/325: write d7/d23/d29/d2e/f47 [796073,31694] 0 2024-05-09T00:07:42.337 INFO:tasks.workunit.client.0.smithi026.stdout:1/268: creat d5/dd/d17/f5b x:0 0 0 2024-05-09T00:07:42.337 INFO:tasks.workunit.client.0.smithi026.stdout:1/269: write f4 [8958954,81928] 0 2024-05-09T00:07:42.338 INFO:tasks.workunit.client.0.smithi026.stdout:3/257: dread d5/d9/dc/d28/f2e [0,4194304] 0 2024-05-09T00:07:42.338 INFO:tasks.workunit.client.0.smithi026.stdout:3/258: fdatasync d5/f1f 0 2024-05-09T00:07:42.338 INFO:tasks.workunit.client.0.smithi026.stdout:9/326: creat d7/d23/d2f/f79 x:0 0 0 2024-05-09T00:07:42.338 INFO:tasks.workunit.client.1.smithi135.stdout:2/904: sync 2024-05-09T00:07:42.340 INFO:tasks.workunit.client.0.smithi026.stdout:3/259: dread d5/d41/f37 [0,4194304] 0 2024-05-09T00:07:42.340 INFO:tasks.workunit.client.0.smithi026.stdout:1/270: rename d5/l41 to d5/l5c 0 2024-05-09T00:07:42.340 INFO:tasks.workunit.client.0.smithi026.stdout:1/271: truncate d5/dd/ff 1372809 0 2024-05-09T00:07:42.340 INFO:tasks.workunit.client.1.smithi135.stdout:6/951: dwrite d2/da/d26/f55 [0,4194304] 0 2024-05-09T00:07:42.340 INFO:tasks.workunit.client.0.smithi026.stdout:9/327: creat d7/d23/d29/d31/d40/d41/d54/d5c/f7a x:0 0 0 2024-05-09T00:07:42.341 INFO:tasks.workunit.client.1.smithi135.stdout:2/905: chown d1/l19 144621530 1 2024-05-09T00:07:42.342 INFO:tasks.workunit.client.0.smithi026.stdout:3/260: truncate d5/d9/dc/d28/d2c/f55 3656646 0 2024-05-09T00:07:42.346 INFO:tasks.workunit.client.1.smithi135.stdout:9/869: dwrite d1/d24/d86/d97/ff5 [0,4194304] 0 2024-05-09T00:07:42.347 INFO:tasks.workunit.client.1.smithi135.stdout:4/830: dread dc/d26/df4/f48 [0,4194304] 0 2024-05-09T00:07:42.347 INFO:tasks.workunit.client.0.smithi026.stdout:7/435: dwrite d8/d1b/f34 [0,4194304] 0 2024-05-09T00:07:42.347 INFO:tasks.workunit.client.0.smithi026.stdout:3/261: dread d5/d9/dc/f1b [0,4194304] 0 2024-05-09T00:07:42.347 INFO:tasks.workunit.client.0.smithi026.stdout:0/413: dwrite d1d/d33/f38 [0,4194304] 0 2024-05-09T00:07:42.347 INFO:tasks.workunit.client.0.smithi026.stdout:8/275: dwrite de/d17/d21/f22 [0,4194304] 0 2024-05-09T00:07:42.347 INFO:tasks.workunit.client.0.smithi026.stdout:2/240: dwrite fb [0,4194304] 0 2024-05-09T00:07:42.350 INFO:tasks.workunit.client.0.smithi026.stdout:9/328: creat d7/d23/f7b x:0 0 0 2024-05-09T00:07:42.350 INFO:tasks.workunit.client.0.smithi026.stdout:9/329: chown d7/d26/f6b 49 1 2024-05-09T00:07:42.350 INFO:tasks.workunit.client.0.smithi026.stdout:0/414: write d1d/d1e/f23 [496568,38339] 0 2024-05-09T00:07:42.351 INFO:tasks.workunit.client.0.smithi026.stdout:9/330: write d7/f9 [442295,18149] 0 2024-05-09T00:07:42.354 INFO:tasks.workunit.client.1.smithi135.stdout:1/909: dwrite da/f62 [0,4194304] 0 2024-05-09T00:07:42.354 INFO:tasks.workunit.client.1.smithi135.stdout:6/952: mknod d2/d20/d2e/c13c 0 2024-05-09T00:07:42.354 INFO:tasks.workunit.client.1.smithi135.stdout:1/910: write da/d24/d27/d33/d52/f12f [649176,116985] 0 2024-05-09T00:07:42.354 INFO:tasks.workunit.client.1.smithi135.stdout:1/911: truncate da/db/d107/f127 315311 0 2024-05-09T00:07:42.355 INFO:tasks.workunit.client.0.smithi026.stdout:8/276: dread de/f5d [0,4194304] 0 2024-05-09T00:07:42.356 INFO:tasks.workunit.client.1.smithi135.stdout:2/906: creat d1/d12/d21/dc7/f12f x:0 0 0 2024-05-09T00:07:42.357 INFO:tasks.workunit.client.0.smithi026.stdout:7/436: creat d8/d5c/d9a/f9c x:0 0 0 2024-05-09T00:07:42.360 INFO:tasks.workunit.client.0.smithi026.stdout:9/331: dread d7/d23/f33 [0,4194304] 0 2024-05-09T00:07:42.360 INFO:tasks.workunit.client.0.smithi026.stdout:6/242: rmdir d15/d1e/d3d 39 2024-05-09T00:07:42.362 INFO:tasks.workunit.client.0.smithi026.stdout:1/272: dread d5/d16/f18 [0,4194304] 0 2024-05-09T00:07:42.363 INFO:tasks.workunit.client.1.smithi135.stdout:9/870: creat d1/d1a/d89/d99/f11a x:0 0 0 2024-05-09T00:07:42.364 INFO:tasks.workunit.client.1.smithi135.stdout:9/871: write d1/d1a/d2c/d20/fb2 [2425846,73721] 0 2024-05-09T00:07:42.365 INFO:tasks.workunit.client.1.smithi135.stdout:4/831: mkdir dc/d4a/d69/d55/d5f/d5a/d9e/d113 0 2024-05-09T00:07:42.369 INFO:tasks.workunit.client.1.smithi135.stdout:1/912: rename da/db/f34 to da/d14/d20/d38/d3a/db7/de9/f13b 0 2024-05-09T00:07:42.371 INFO:tasks.workunit.client.0.smithi026.stdout:2/241: rename d14/d15/d20/d41/c4d to d14/d15/d20/d41/c5c 0 2024-05-09T00:07:42.376 INFO:tasks.workunit.client.1.smithi135.stdout:6/953: dwrite d2/d20/d37/d4e/d9d/fb8 [4194304,4194304] 0 2024-05-09T00:07:42.376 INFO:tasks.workunit.client.1.smithi135.stdout:4/832: creat dc/d71/d90/f114 x:0 0 0 2024-05-09T00:07:42.376 INFO:tasks.workunit.client.0.smithi026.stdout:3/262: dwrite d5/d9/dc/d28/f4f [0,4194304] 0 2024-05-09T00:07:42.378 INFO:tasks.workunit.client.1.smithi135.stdout:9/872: dread d1/d1a/d10/db3/ff3 [0,4194304] 0 2024-05-09T00:07:42.378 INFO:tasks.workunit.client.0.smithi026.stdout:0/415: rename f10 to d1d/d25/d3c/f88 0 2024-05-09T00:07:42.378 INFO:tasks.workunit.client.0.smithi026.stdout:3/263: write d5/d9/dc/d28/f2e [772783,9687] 0 2024-05-09T00:07:42.378 INFO:tasks.workunit.client.0.smithi026.stdout:3/264: fsync f0 0 2024-05-09T00:07:42.385 INFO:tasks.workunit.client.0.smithi026.stdout:9/332: unlink d7/d23/d76/l78 0 2024-05-09T00:07:42.385 INFO:tasks.workunit.client.1.smithi135.stdout:6/954: dread d2/d20/d3f/f44 [0,4194304] 0 2024-05-09T00:07:42.385 INFO:tasks.workunit.client.1.smithi135.stdout:6/955: dread - d2/da/d49/f12c zero size 2024-05-09T00:07:42.386 INFO:tasks.workunit.client.1.smithi135.stdout:4/833: creat dc/d26/d93/d9d/d101/f115 x:0 0 0 2024-05-09T00:07:42.387 INFO:tasks.workunit.client.0.smithi026.stdout:6/243: creat d15/d2b/d33/f51 x:0 0 0 2024-05-09T00:07:42.387 INFO:tasks.workunit.client.0.smithi026.stdout:6/244: write d15/d1e/d3d/d4c/f40 [1425000,125415] 0 2024-05-09T00:07:42.388 INFO:tasks.workunit.client.0.smithi026.stdout:6/245: read - d15/d1e/d23/f4a zero size 2024-05-09T00:07:42.388 INFO:tasks.workunit.client.0.smithi026.stdout:2/242: dwrite d14/d15/d17/f34 [4194304,4194304] 0 2024-05-09T00:07:42.388 INFO:tasks.workunit.client.0.smithi026.stdout:2/243: fsync fc 0 2024-05-09T00:07:42.388 INFO:tasks.workunit.client.0.smithi026.stdout:2/244: dread - d14/d15/d3b/d40/f59 zero size 2024-05-09T00:07:42.390 INFO:tasks.workunit.client.1.smithi135.stdout:9/873: rename d1/d1a/d10/db3/lf0 to d1/d1a/l11b 0 2024-05-09T00:07:42.390 INFO:tasks.workunit.client.1.smithi135.stdout:9/874: read - d1/d1a/d89/f91 zero size 2024-05-09T00:07:42.391 INFO:tasks.workunit.client.1.smithi135.stdout:6/956: write d2/da/d49/f5a [983286,41963] 0 2024-05-09T00:07:42.391 INFO:tasks.workunit.client.0.smithi026.stdout:1/273: creat d5/db/f5d x:0 0 0 2024-05-09T00:07:42.392 INFO:tasks.workunit.client.1.smithi135.stdout:4/834: chown dc/dd/l1c 1242081 1 2024-05-09T00:07:42.392 INFO:tasks.workunit.client.1.smithi135.stdout:4/835: chown dc/d4a/c52 18 1 2024-05-09T00:07:42.392 INFO:tasks.workunit.client.1.smithi135.stdout:4/836: fdatasync dc/f2d 0 2024-05-09T00:07:42.394 INFO:tasks.workunit.client.1.smithi135.stdout:1/913: dwrite da/d14/d20/d38/d3a/d40/d75/f115 [0,4194304] 0 2024-05-09T00:07:42.396 INFO:tasks.workunit.client.1.smithi135.stdout:9/875: rename d1/d24/d44/d7f/cdd to d1/d1a/d89/dad/de3/c11c 0 2024-05-09T00:07:42.398 INFO:tasks.workunit.client.0.smithi026.stdout:8/277: rename de/d17/d21/d24/c2b to de/d17/d21/d24/d28/c5e 0 2024-05-09T00:07:42.401 INFO:tasks.workunit.client.1.smithi135.stdout:6/957: link d2/d20/d37/d4e/d7c/c95 d2/da/d26/d57/d59/c13d 0 2024-05-09T00:07:42.401 INFO:tasks.workunit.client.1.smithi135.stdout:6/958: dread - d2/da/d26/d57/ddc/dd7/f122 zero size 2024-05-09T00:07:42.402 INFO:tasks.workunit.client.0.smithi026.stdout:0/416: mknod d1d/d1e/d20/d4d/d83/c89 0 2024-05-09T00:07:42.403 INFO:tasks.workunit.client.0.smithi026.stdout:9/333: creat d7/d23/f7c x:0 0 0 2024-05-09T00:07:42.404 INFO:tasks.workunit.client.1.smithi135.stdout:4/837: dwrite dc/d26/fa7 [0,4194304] 0 2024-05-09T00:07:42.406 INFO:tasks.workunit.client.0.smithi026.stdout:6/246: mkdir d15/d34/d52 0 2024-05-09T00:07:42.410 INFO:tasks.workunit.client.0.smithi026.stdout:1/274: symlink d5/db/l5e 0 2024-05-09T00:07:42.410 INFO:tasks.workunit.client.0.smithi026.stdout:1/275: chown d5/dd/d17/d29/c36 186203094 1 2024-05-09T00:07:42.415 INFO:tasks.workunit.client.1.smithi135.stdout:0/885: sync 2024-05-09T00:07:42.420 INFO:tasks.workunit.client.1.smithi135.stdout:1/914: symlink da/d24/d27/d33/d52/d71/d8d/d104/l13c 0 2024-05-09T00:07:42.423 INFO:tasks.workunit.client.1.smithi135.stdout:9/876: mknod d1/d24/d44/dfe/c11d 0 2024-05-09T00:07:42.423 INFO:tasks.workunit.client.1.smithi135.stdout:9/877: fdatasync d1/d24/f35 0 2024-05-09T00:07:42.423 INFO:tasks.workunit.client.1.smithi135.stdout:5/958: sync 2024-05-09T00:07:42.424 INFO:tasks.workunit.client.1.smithi135.stdout:5/959: stat db/d5d/dac/f103 0 2024-05-09T00:07:42.424 INFO:tasks.workunit.client.1.smithi135.stdout:5/960: readlink db/d84/d31/lf4 0 2024-05-09T00:07:42.424 INFO:tasks.workunit.client.1.smithi135.stdout:5/961: write db/d24/db0/f123 [85060,103489] 0 2024-05-09T00:07:42.424 INFO:tasks.workunit.client.0.smithi026.stdout:9/334: dwrite d7/d23/d2f/d50/f6e [0,4194304] 0 2024-05-09T00:07:42.426 INFO:tasks.workunit.client.1.smithi135.stdout:6/959: mknod d2/da/d26/d57/ddc/c13e 0 2024-05-09T00:07:42.426 INFO:tasks.workunit.client.1.smithi135.stdout:6/960: readlink d2/d1a/d7a/l112 0 2024-05-09T00:07:42.431 INFO:tasks.workunit.client.1.smithi135.stdout:4/838: symlink dc/d26/d31/d82/l116 0 2024-05-09T00:07:42.432 INFO:tasks.workunit.client.1.smithi135.stdout:6/961: dread d2/f76 [0,4194304] 0 2024-05-09T00:07:42.434 INFO:tasks.workunit.client.1.smithi135.stdout:0/886: mknod d3/dd/d3f/c104 0 2024-05-09T00:07:42.434 INFO:tasks.workunit.client.0.smithi026.stdout:9/335: dread d7/f1b [0,4194304] 0 2024-05-09T00:07:42.438 INFO:tasks.workunit.client.1.smithi135.stdout:1/915: creat da/d24/d27/d33/d36/f13d x:0 0 0 2024-05-09T00:07:42.440 INFO:tasks.workunit.client.1.smithi135.stdout:9/878: unlink d1/d24/d44/d7f/l8d 0 2024-05-09T00:07:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:7/437: rename d8/d1b/c77 to d8/d1b/d89/c9d 0 2024-05-09T00:07:42.444 INFO:tasks.workunit.client.1.smithi135.stdout:6/962: dread d2/f105 [0,4194304] 0 2024-05-09T00:07:42.445 INFO:tasks.workunit.client.1.smithi135.stdout:5/962: mknod db/d24/d32/dfa/d9c/d9f/d92/c127 0 2024-05-09T00:07:42.447 INFO:tasks.workunit.client.1.smithi135.stdout:0/887: symlink d3/dd/d2d/db5/df4/daa/l105 0 2024-05-09T00:07:42.449 INFO:tasks.workunit.client.0.smithi026.stdout:0/417: mknod d1d/d1e/c8a 0 2024-05-09T00:07:42.451 INFO:tasks.workunit.client.1.smithi135.stdout:9/879: link d1/d1a/d10/fa7 d1/d1a/d2c/d2d/de6/f11e 0 2024-05-09T00:07:42.452 INFO:tasks.workunit.client.1.smithi135.stdout:1/916: dread da/d14/d20/d38/d3a/f8b [0,4194304] 0 2024-05-09T00:07:42.453 INFO:tasks.workunit.client.0.smithi026.stdout:6/247: creat d15/d34/f53 x:0 0 0 2024-05-09T00:07:42.456 INFO:tasks.workunit.client.0.smithi026.stdout:1/276: mknod d5/dd/d1f/d39/d47/c5f 0 2024-05-09T00:07:42.459 INFO:tasks.workunit.client.1.smithi135.stdout:4/839: dwrite dc/d26/d93/d9d/d101/fc7 [0,4194304] 0 2024-05-09T00:07:42.461 INFO:tasks.workunit.client.1.smithi135.stdout:0/888: creat d3/dd/d3f/d3a/da4/dcd/f106 x:0 0 0 2024-05-09T00:07:42.463 INFO:tasks.workunit.client.1.smithi135.stdout:2/907: dwrite d1/d12/d20/f54 [0,4194304] 0 2024-05-09T00:07:42.463 INFO:tasks.workunit.client.1.smithi135.stdout:9/880: link d1/d1a/d10/d3c/d5c/f6b d1/f11f 0 2024-05-09T00:07:42.464 INFO:tasks.workunit.client.1.smithi135.stdout:9/881: read - d1/d1a/d89/d99/f11a zero size 2024-05-09T00:07:42.464 INFO:tasks.workunit.client.0.smithi026.stdout:9/336: mkdir d7/d23/d2f/d7d 0 2024-05-09T00:07:42.467 INFO:tasks.workunit.client.1.smithi135.stdout:6/963: rename d2/da/d26/d57/d59 to d2/d20/d3f/d13f 0 2024-05-09T00:07:42.469 INFO:tasks.workunit.client.0.smithi026.stdout:3/265: rename d5/fd to d5/d9/dc/d28/d45/f57 0 2024-05-09T00:07:42.469 INFO:tasks.workunit.client.0.smithi026.stdout:3/266: chown d5/d41 60 1 2024-05-09T00:07:42.470 INFO:tasks.workunit.client.0.smithi026.stdout:8/278: dread de/d17/d21/d24/d3b/d3d/f40 [0,4194304] 0 2024-05-09T00:07:42.472 INFO:tasks.workunit.client.0.smithi026.stdout:9/337: dread d7/d23/d29/d31/f32 [0,4194304] 0 2024-05-09T00:07:42.472 INFO:tasks.workunit.client.0.smithi026.stdout:9/338: chown d7/d23/d2f/d50/c56 674383934 1 2024-05-09T00:07:42.472 INFO:tasks.workunit.client.0.smithi026.stdout:6/248: mkdir d15/d1e/d3d/d4c/d4d/d54 0 2024-05-09T00:07:42.472 INFO:tasks.workunit.client.0.smithi026.stdout:6/249: stat d15/d2b/l37 0 2024-05-09T00:07:42.472 INFO:tasks.workunit.client.0.smithi026.stdout:6/250: fsync d15/d41/f4b 0 2024-05-09T00:07:42.472 INFO:tasks.workunit.client.0.smithi026.stdout:6/251: chown c14 492081371 1 2024-05-09T00:07:42.476 INFO:tasks.workunit.client.1.smithi135.stdout:2/908: mkdir d1/d12/d20/d2b/d56/d86/d130 0 2024-05-09T00:07:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:7/438: dwrite d8/d1b/d89/d8d/f98 [0,4194304] 0 2024-05-09T00:07:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:3/267: rename d5/d1e/f36 to d5/d9/dc/d28/d2c/f58 0 2024-05-09T00:07:42.480 INFO:tasks.workunit.client.1.smithi135.stdout:9/882: link d1/d24/l95 d1/d1a/d89/dad/de3/l120 0 2024-05-09T00:07:42.482 INFO:tasks.workunit.client.1.smithi135.stdout:1/917: dwrite da/d14/d20/d38/d3a/db7/fe5 [0,4194304] 0 2024-05-09T00:07:42.483 INFO:tasks.workunit.client.0.smithi026.stdout:8/279: truncate de/d17/d21/f22 1560766 0 2024-05-09T00:07:42.483 INFO:tasks.workunit.client.0.smithi026.stdout:8/280: chown de/f1e 2 1 2024-05-09T00:07:42.483 INFO:tasks.workunit.client.0.smithi026.stdout:0/418: dwrite d1d/d1e/d20/d51/f57 [0,4194304] 0 2024-05-09T00:07:42.483 INFO:tasks.workunit.client.0.smithi026.stdout:0/419: readlink d1d/d33/l6a 0 2024-05-09T00:07:42.484 INFO:tasks.workunit.client.1.smithi135.stdout:6/964: getdents d2/d20/d3f/d4f 0 2024-05-09T00:07:42.484 INFO:tasks.workunit.client.1.smithi135.stdout:8/933: sync 2024-05-09T00:07:42.484 INFO:tasks.workunit.client.1.smithi135.stdout:8/934: chown d4/d7/d2a/d56/dec 1486 1 2024-05-09T00:07:42.488 INFO:tasks.workunit.client.0.smithi026.stdout:9/339: creat d7/d23/d76/f7e x:0 0 0 2024-05-09T00:07:42.490 INFO:tasks.workunit.client.0.smithi026.stdout:8/281: dread de/d48/f52 [0,4194304] 0 2024-05-09T00:07:42.492 INFO:tasks.workunit.client.1.smithi135.stdout:4/840: truncate dc/dd/f1d 4341388 0 2024-05-09T00:07:42.495 INFO:tasks.workunit.client.0.smithi026.stdout:7/439: dwrite d8/d2e/d55/d1e/d3d/f61 [0,4194304] 0 2024-05-09T00:07:42.495 INFO:tasks.workunit.client.0.smithi026.stdout:7/440: fdatasync d8/d2e/d55/d22/f42 0 2024-05-09T00:07:42.495 INFO:tasks.workunit.client.0.smithi026.stdout:1/277: unlink d5/d16/f1b 0 2024-05-09T00:07:42.498 INFO:tasks.workunit.client.1.smithi135.stdout:2/909: mknod d1/d12/d21/d57/d10b/d119/c131 0 2024-05-09T00:07:42.498 INFO:tasks.workunit.client.1.smithi135.stdout:2/910: readlink d1/d12/d20/d2b/d94/la6 0 2024-05-09T00:07:42.502 INFO:tasks.workunit.client.0.smithi026.stdout:0/420: dwrite d1d/d25/d3c/f46 [0,4194304] 0 2024-05-09T00:07:42.505 INFO:tasks.workunit.client.0.smithi026.stdout:3/268: link d5/d41/l34 d5/d9/d4a/l59 0 2024-05-09T00:07:42.509 INFO:tasks.workunit.client.1.smithi135.stdout:8/935: rename d4/d7/d2a/d56/f7c to d4/d8/da2/da6/db8/dd1/f13b 0 2024-05-09T00:07:42.510 INFO:tasks.workunit.client.1.smithi135.stdout:4/841: creat dc/d4a/d69/d55/dc9/dd7/dfa/f117 x:0 0 0 2024-05-09T00:07:42.510 INFO:tasks.workunit.client.1.smithi135.stdout:4/842: chown dc/d110 49536 1 2024-05-09T00:07:42.511 INFO:tasks.workunit.client.0.smithi026.stdout:0/421: dread d1d/d33/f38 [0,4194304] 0 2024-05-09T00:07:42.511 INFO:tasks.workunit.client.0.smithi026.stdout:0/422: dread - d1d/d1e/f4b zero size 2024-05-09T00:07:42.512 INFO:tasks.workunit.client.1.smithi135.stdout:8/936: creat d4/d8/da2/da6/dde/f13c x:0 0 0 2024-05-09T00:07:42.512 INFO:tasks.workunit.client.1.smithi135.stdout:8/937: chown d4/dc6/f122 9759892 1 2024-05-09T00:07:42.514 INFO:tasks.workunit.client.0.smithi026.stdout:8/282: link de/f23 de/d17/d21/d24/d3b/d3d/f5f 0 2024-05-09T00:07:42.514 INFO:tasks.workunit.client.0.smithi026.stdout:8/283: dread - de/d17/d21/d24/d4b/f4d zero size 2024-05-09T00:07:42.515 INFO:tasks.workunit.client.0.smithi026.stdout:8/284: write de/d48/f52 [660143,28258] 0 2024-05-09T00:07:42.515 INFO:tasks.workunit.client.0.smithi026.stdout:8/285: read - de/d17/d21/d24/d3b/d3d/f56 zero size 2024-05-09T00:07:42.516 INFO:tasks.workunit.client.1.smithi135.stdout:4/843: unlink dc/d26/d31/d82/l10e 0 2024-05-09T00:07:42.516 INFO:tasks.workunit.client.1.smithi135.stdout:4/844: getdents dc/d26/d93/d9d/dd2 0 2024-05-09T00:07:42.518 INFO:tasks.workunit.client.1.smithi135.stdout:8/938: mknod d4/d7/d33/d39/c13d 0 2024-05-09T00:07:42.520 INFO:tasks.workunit.client.1.smithi135.stdout:4/845: creat dc/d26/d31/db8/dd1/f118 x:0 0 0 2024-05-09T00:07:42.520 INFO:tasks.workunit.client.1.smithi135.stdout:4/846: write dc/d26/d31/fc4 [138143,91579] 0 2024-05-09T00:07:42.520 INFO:tasks.workunit.client.0.smithi026.stdout:1/278: rmdir d5/dd/d17/d29 39 2024-05-09T00:07:42.524 INFO:tasks.workunit.client.1.smithi135.stdout:4/847: rename dc/d4a/d69/d55/f57 to dc/d26/d93/d9d/dd2/f119 0 2024-05-09T00:07:42.526 INFO:tasks.workunit.client.0.smithi026.stdout:3/269: creat d5/d9/f5a x:0 0 0 2024-05-09T00:07:42.529 INFO:tasks.workunit.client.0.smithi026.stdout:3/270: write d5/d9/d4a/f52 [1217106,75559] 0 2024-05-09T00:07:42.530 INFO:tasks.workunit.client.1.smithi135.stdout:4/848: write dc/d4a/d69/f51 [1851652,39232] 0 2024-05-09T00:07:42.530 INFO:tasks.workunit.client.1.smithi135.stdout:4/849: truncate dc/d4a/d69/d55/d6d/dec/ff2 722984 0 2024-05-09T00:07:42.530 INFO:tasks.workunit.client.0.smithi026.stdout:0/423: link c16 d1d/d1e/d20/d4d/d58/d62/c8b 0 2024-05-09T00:07:42.530 INFO:tasks.workunit.client.0.smithi026.stdout:8/286: mkdir de/d60 0 2024-05-09T00:07:42.530 INFO:tasks.workunit.client.0.smithi026.stdout:8/287: write de/d17/d21/d24/d3b/d3d/f56 [911862,9939] 0 2024-05-09T00:07:42.530 INFO:tasks.workunit.client.0.smithi026.stdout:8/288: chown de/d48/f52 144 1 2024-05-09T00:07:42.531 INFO:tasks.workunit.client.1.smithi135.stdout:4/850: dread dc/d4a/d69/d55/fab [0,4194304] 0 2024-05-09T00:07:42.531 INFO:tasks.workunit.client.1.smithi135.stdout:4/851: read - dc/d26/d31/db8/dd1/f118 zero size 2024-05-09T00:07:42.533 INFO:tasks.workunit.client.0.smithi026.stdout:0/424: symlink d1d/d1e/d20/d4d/l8c 0 2024-05-09T00:07:42.533 INFO:tasks.workunit.client.1.smithi135.stdout:9/883: dwrite d1/d1a/d2c/d20/fb2 [0,4194304] 0 2024-05-09T00:07:42.533 INFO:tasks.workunit.client.1.smithi135.stdout:9/884: chown d1/d1a/d10/db3/ff3 3744 1 2024-05-09T00:07:42.534 INFO:tasks.workunit.client.0.smithi026.stdout:8/289: symlink de/d17/d21/d24/d3b/d3d/l61 0 2024-05-09T00:07:42.534 INFO:tasks.workunit.client.0.smithi026.stdout:8/290: chown de/d48/c37 307362521 1 2024-05-09T00:07:42.535 INFO:tasks.workunit.client.0.smithi026.stdout:3/271: dread d5/f39 [0,4194304] 0 2024-05-09T00:07:42.536 INFO:tasks.workunit.client.0.smithi026.stdout:3/272: stat d5/d9/dc/d28/l14 0 2024-05-09T00:07:42.537 INFO:tasks.workunit.client.1.smithi135.stdout:4/852: symlink dc/d71/d90/l11a 0 2024-05-09T00:07:42.537 INFO:tasks.workunit.client.1.smithi135.stdout:9/885: read d1/d1a/d2c/d2d/f32 [9278715,32696] 0 2024-05-09T00:07:42.538 INFO:tasks.workunit.client.0.smithi026.stdout:1/279: mkdir d5/d16/d60 0 2024-05-09T00:07:42.538 INFO:tasks.workunit.client.0.smithi026.stdout:1/280: chown d5/dd/d1f/l37 14 1 2024-05-09T00:07:42.539 INFO:tasks.workunit.client.0.smithi026.stdout:1/281: write d5/dd/f49 [504410,122151] 0 2024-05-09T00:07:42.539 INFO:tasks.workunit.client.0.smithi026.stdout:1/282: readlink d5/l4a 0 2024-05-09T00:07:42.542 INFO:tasks.workunit.client.1.smithi135.stdout:6/965: rmdir d2/d20/d3f/d13f 39 2024-05-09T00:07:42.542 INFO:tasks.workunit.client.1.smithi135.stdout:2/911: dwrite d1/d12/da3/fd8 [0,4194304] 0 2024-05-09T00:07:42.545 INFO:tasks.workunit.client.1.smithi135.stdout:5/963: dwrite db/d24/d32/d5b/f6a [0,4194304] 0 2024-05-09T00:07:42.549 INFO:tasks.workunit.client.0.smithi026.stdout:7/441: dwrite d8/d2e/d55/d1e/d3d/f51 [0,4194304] 0 2024-05-09T00:07:42.549 INFO:tasks.workunit.client.0.smithi026.stdout:7/442: fdatasync d8/d2e/d55/d22/f85 0 2024-05-09T00:07:42.552 INFO:tasks.workunit.client.1.smithi135.stdout:6/966: dread d2/d20/d2e/f8d [0,4194304] 0 2024-05-09T00:07:42.554 INFO:tasks.workunit.client.1.smithi135.stdout:2/912: dread d1/d12/d21/f38 [0,4194304] 0 2024-05-09T00:07:42.554 INFO:tasks.workunit.client.1.smithi135.stdout:2/913: fsync d1/d22/ff5 0 2024-05-09T00:07:42.556 INFO:tasks.workunit.client.0.smithi026.stdout:9/340: dwrite d7/d23/d29/f6a [0,4194304] 0 2024-05-09T00:07:42.557 INFO:tasks.workunit.client.1.smithi135.stdout:1/918: dwrite da/d73/f78 [0,4194304] 0 2024-05-09T00:07:42.557 INFO:tasks.workunit.client.1.smithi135.stdout:8/939: dwrite d4/f2b [4194304,4194304] 0 2024-05-09T00:07:42.558 INFO:tasks.workunit.client.1.smithi135.stdout:9/886: dwrite d1/d1a/d10/f6a [0,4194304] 0 2024-05-09T00:07:42.559 INFO:tasks.workunit.client.1.smithi135.stdout:1/919: write da/db/d16/f18 [3184311,60441] 0 2024-05-09T00:07:42.574 INFO:tasks.workunit.client.1.smithi135.stdout:1/920: dwrite da/d73/fd5 [0,4194304] 0 2024-05-09T00:07:42.574 INFO:tasks.workunit.client.1.smithi135.stdout:1/921: stat da/d24/d27/d33/d7d/ffe 0 2024-05-09T00:07:42.578 INFO:tasks.workunit.client.0.smithi026.stdout:8/291: unlink de/l55 0 2024-05-09T00:07:42.580 INFO:tasks.workunit.client.0.smithi026.stdout:3/273: mkdir d5/d9/dc/d5b 0 2024-05-09T00:07:42.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/283: symlink d5/db/l61 0 2024-05-09T00:07:42.583 INFO:tasks.workunit.client.0.smithi026.stdout:1/284: write d5/dd/f3f [2021688,108431] 0 2024-05-09T00:07:42.587 INFO:tasks.workunit.client.0.smithi026.stdout:8/292: dread de/d17/f4a [0,4194304] 0 2024-05-09T00:07:42.597 INFO:tasks.workunit.client.1.smithi135.stdout:4/853: dread dc/dd/f80 [0,4194304] 0 2024-05-09T00:07:42.597 INFO:tasks.workunit.client.1.smithi135.stdout:4/854: chown fa 4072 1 2024-05-09T00:07:42.605 INFO:tasks.workunit.client.0.smithi026.stdout:1/285: dwrite d5/dd/f34 [0,4194304] 0 2024-05-09T00:07:42.606 INFO:tasks.workunit.client.1.smithi135.stdout:0/889: dwrite d3/dd/d3f/f27 [0,4194304] 0 2024-05-09T00:07:42.632 INFO:tasks.workunit.client.0.smithi026.stdout:1/286: dwrite d5/dd/d17/f5b [0,4194304] 0 2024-05-09T00:07:42.632 INFO:tasks.workunit.client.0.smithi026.stdout:1/287: fsync d5/dd/d17/f2a 0 2024-05-09T00:07:42.632 INFO:tasks.workunit.client.1.smithi135.stdout:0/890: dwrite d3/dd/d3f/f41 [0,4194304] 0 2024-05-09T00:07:42.632 INFO:tasks.workunit.client.1.smithi135.stdout:4/855: dwrite dc/d26/d31/f100 [0,4194304] 0 2024-05-09T00:07:42.632 INFO:tasks.workunit.client.1.smithi135.stdout:4/856: dread - dc/d26/d31/db8/dd1/f118 zero size 2024-05-09T00:07:42.641 INFO:tasks.workunit.client.1.smithi135.stdout:5/964: rename db/d24/l27 to db/d24/d32/dfa/d9c/d9f/d92/d11b/l128 0 2024-05-09T00:07:42.644 INFO:tasks.workunit.client.1.smithi135.stdout:8/940: symlink d4/d7/d2a/d56/dec/dfe/d113/d11b/l13e 0 2024-05-09T00:07:42.644 INFO:tasks.workunit.client.1.smithi135.stdout:8/941: stat d4/l5f 0 2024-05-09T00:07:42.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:42.186514+0000 mon.smithi026 (mon.0) 691 : audit [DBG] from='client.? 172.21.15.26:0/533051966' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:07:42.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:42.186514+0000 mon.smithi026 (mon.0) 691 : audit [DBG] from='client.? 172.21.15.26:0/533051966' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:07:42.647 INFO:tasks.workunit.client.1.smithi135.stdout:9/887: creat d1/d24/d44/d7f/da2/dca/dea/f121 x:0 0 0 2024-05-09T00:07:42.647 INFO:tasks.workunit.client.1.smithi135.stdout:9/888: truncate d1/d1a/d2c/d2d/de6/d6e/fee 1835622 0 2024-05-09T00:07:42.648 INFO:tasks.workunit.client.1.smithi135.stdout:9/889: write d1/d1a/d10/fa7 [5049232,33724] 0 2024-05-09T00:07:42.653 INFO:tasks.workunit.client.1.smithi135.stdout:1/922: creat da/d14/d20/d2c/f13e x:0 0 0 2024-05-09T00:07:42.656 INFO:tasks.workunit.client.0.smithi026.stdout:3/274: link d5/d41/c54 d5/d9/dc/d28/d2c/c5c 0 2024-05-09T00:07:42.656 INFO:tasks.workunit.client.0.smithi026.stdout:3/275: stat d5/d1e/f3d 0 2024-05-09T00:07:42.656 INFO:tasks.workunit.client.0.smithi026.stdout:3/276: write d5/d41/f43 [98646,102110] 0 2024-05-09T00:07:42.662 INFO:tasks.workunit.client.0.smithi026.stdout:8/293: unlink fa 0 2024-05-09T00:07:42.662 INFO:tasks.workunit.client.0.smithi026.stdout:8/294: read de/d17/d21/d24/d3b/d3d/f40 [596633,120955] 0 2024-05-09T00:07:42.665 INFO:tasks.workunit.client.1.smithi135.stdout:0/891: creat d3/dd/d3f/d43/f107 x:0 0 0 2024-05-09T00:07:42.668 INFO:tasks.workunit.client.1.smithi135.stdout:4/857: creat dc/d26/d93/d9d/d101/f11b x:0 0 0 2024-05-09T00:07:42.668 INFO:tasks.workunit.client.1.smithi135.stdout:4/858: write dc/dd/f80 [4348181,107341] 0 2024-05-09T00:07:42.668 INFO:tasks.workunit.client.1.smithi135.stdout:4/859: readlink dc/d26/df4/l64 0 2024-05-09T00:07:42.668 INFO:tasks.workunit.client.1.smithi135.stdout:4/860: readlink dc/l44 0 2024-05-09T00:07:42.670 INFO:tasks.workunit.client.1.smithi135.stdout:1/923: dwrite da/d14/d20/d38/f4d [0,4194304] 0 2024-05-09T00:07:42.670 INFO:tasks.workunit.client.0.smithi026.stdout:1/288: creat d5/db/f62 x:0 0 0 2024-05-09T00:07:42.670 INFO:tasks.workunit.client.0.smithi026.stdout:1/289: chown d5/dd/d1f/d39/d47/f50 59 1 2024-05-09T00:07:42.670 INFO:tasks.workunit.client.0.smithi026.stdout:1/290: read - d5/db/f5d zero size 2024-05-09T00:07:42.670 INFO:tasks.workunit.client.0.smithi026.stdout:1/291: fdatasync f2 0 2024-05-09T00:07:42.671 INFO:tasks.workunit.client.0.smithi026.stdout:1/292: truncate d5/d16/f18 4233525 0 2024-05-09T00:07:42.671 INFO:tasks.workunit.client.0.smithi026.stdout:1/293: truncate d5/db/f62 20283 0 2024-05-09T00:07:42.671 INFO:tasks.workunit.client.1.smithi135.stdout:5/965: rmdir db/d5d 39 2024-05-09T00:07:42.671 INFO:tasks.workunit.client.0.smithi026.stdout:1/294: write f4 [732268,103808] 0 2024-05-09T00:07:42.672 INFO:tasks.workunit.client.0.smithi026.stdout:8/295: dread de/f23 [0,4194304] 0 2024-05-09T00:07:42.672 INFO:tasks.workunit.client.0.smithi026.stdout:7/443: rename d8/d2e/l58 to d8/d2e/d55/l9e 0 2024-05-09T00:07:42.673 INFO:tasks.workunit.client.1.smithi135.stdout:5/966: read db/f28 [2257802,77654] 0 2024-05-09T00:07:42.674 INFO:tasks.workunit.client.1.smithi135.stdout:8/942: mknod d4/d22/d8b/d10a/c13f 0 2024-05-09T00:07:42.675 INFO:tasks.workunit.client.1.smithi135.stdout:8/943: write d4/d8/da2/da6/db8/f106 [1464374,79153] 0 2024-05-09T00:07:42.675 INFO:tasks.workunit.client.1.smithi135.stdout:8/944: truncate d4/d8/da2/da6/db8/dd1/f10c 5136362 0 2024-05-09T00:07:42.675 INFO:tasks.workunit.client.1.smithi135.stdout:8/945: chown d4/d7/de/fc9 7104 1 2024-05-09T00:07:42.675 INFO:tasks.workunit.client.0.smithi026.stdout:3/277: mkdir d5/d9/dc/d5d 0 2024-05-09T00:07:42.677 INFO:tasks.workunit.client.1.smithi135.stdout:9/890: mkdir d1/d1a/d2c/d2d/de6/d6e/d122 0 2024-05-09T00:07:42.678 INFO:tasks.workunit.client.1.smithi135.stdout:5/967: write db/d24/d32/dfa/d9c/d9f/dc0/df0/f10f [2174953,87667] 0 2024-05-09T00:07:42.678 INFO:tasks.workunit.client.1.smithi135.stdout:5/968: fsync db/f12 0 2024-05-09T00:07:42.680 INFO:tasks.workunit.client.0.smithi026.stdout:1/295: dread d5/dd/d1f/f57 [0,4194304] 0 2024-05-09T00:07:42.680 INFO:tasks.workunit.client.0.smithi026.stdout:8/296: unlink de/d17/d21/d24/d3b/l4e 0 2024-05-09T00:07:42.684 INFO:tasks.workunit.client.1.smithi135.stdout:0/892: truncate d3/dd/d2d/d4c/fe3 491242 0 2024-05-09T00:07:42.685 INFO:tasks.workunit.client.1.smithi135.stdout:4/861: rmdir dc/d26/d93/d9d/de7 39 2024-05-09T00:07:42.685 INFO:tasks.workunit.client.1.smithi135.stdout:4/862: fsync dc/fb5 0 2024-05-09T00:07:42.685 INFO:tasks.workunit.client.0.smithi026.stdout:3/278: dread d5/f1f [0,4194304] 0 2024-05-09T00:07:42.685 INFO:tasks.workunit.client.0.smithi026.stdout:3/279: chown d5/d9/dc/d28/l14 1823 1 2024-05-09T00:07:42.685 INFO:tasks.workunit.client.0.smithi026.stdout:3/280: fsync d5/d1e/f3d 0 2024-05-09T00:07:42.685 INFO:tasks.workunit.client.0.smithi026.stdout:3/281: write d5/d9/dc/f31 [1484954,102132] 0 2024-05-09T00:07:42.686 INFO:tasks.workunit.client.0.smithi026.stdout:3/282: fsync d5/d9/f16 0 2024-05-09T00:07:42.686 INFO:tasks.workunit.client.0.smithi026.stdout:7/444: rmdir d8/d2e/d55/d22 39 2024-05-09T00:07:42.687 INFO:tasks.workunit.client.0.smithi026.stdout:7/445: chown d8/f1f 361 1 2024-05-09T00:07:42.687 INFO:tasks.workunit.client.1.smithi135.stdout:9/891: dread d1/d1a/d2c/f53 [0,4194304] 0 2024-05-09T00:07:42.687 INFO:tasks.workunit.client.1.smithi135.stdout:9/892: chown d1/d1a/d2c/c93 22564853 1 2024-05-09T00:07:42.689 INFO:tasks.workunit.client.1.smithi135.stdout:6/967: rename d2/da/df0 to d2/d20/d3f/d140 0 2024-05-09T00:07:42.689 INFO:tasks.workunit.client.1.smithi135.stdout:6/968: readlink d2/d20/d3f/d13f/lfd 0 2024-05-09T00:07:42.690 INFO:tasks.workunit.client.1.smithi135.stdout:6/969: fsync d2/fc 0 2024-05-09T00:07:42.690 INFO:tasks.workunit.client.1.smithi135.stdout:5/969: write db/d24/d32/fd4 [7962180,21331] 0 2024-05-09T00:07:42.690 INFO:tasks.workunit.client.1.smithi135.stdout:5/970: dread - db/d24/d32/dfa/d9c/d9f/dc0/dc4/f121 zero size 2024-05-09T00:07:42.692 INFO:tasks.workunit.client.0.smithi026.stdout:8/297: mkdir de/d17/d21/d24/d4b/d62 0 2024-05-09T00:07:42.693 INFO:tasks.workunit.client.0.smithi026.stdout:7/446: dread d8/d2e/d55/d1e/d3d/f48 [0,4194304] 0 2024-05-09T00:07:42.693 INFO:tasks.workunit.client.0.smithi026.stdout:7/447: write d8/d2e/d55/f52 [1532329,3088] 0 2024-05-09T00:07:42.693 INFO:tasks.workunit.client.1.smithi135.stdout:9/893: dread d1/f59 [0,4194304] 0 2024-05-09T00:07:42.695 INFO:tasks.workunit.client.0.smithi026.stdout:9/341: rename d7/d23/f25 to d7/f7f 0 2024-05-09T00:07:42.697 INFO:tasks.workunit.client.1.smithi135.stdout:8/946: dwrite d4/d7/da4/fed [0,4194304] 0 2024-05-09T00:07:42.697 INFO:tasks.workunit.client.1.smithi135.stdout:8/947: chown d4/d7/de/fc9 700224707 1 2024-05-09T00:07:42.698 INFO:tasks.workunit.client.1.smithi135.stdout:1/924: dwrite da/d24/d27/d33/d7d/f126 [0,4194304] 0 2024-05-09T00:07:42.698 INFO:tasks.workunit.client.0.smithi026.stdout:8/298: creat de/d60/f63 x:0 0 0 2024-05-09T00:07:42.698 INFO:tasks.workunit.client.0.smithi026.stdout:3/283: dwrite d5/d9/f42 [0,4194304] 0 2024-05-09T00:07:42.700 INFO:tasks.workunit.client.0.smithi026.stdout:8/299: read de/f23 [3528863,80051] 0 2024-05-09T00:07:42.701 INFO:tasks.workunit.client.0.smithi026.stdout:7/448: mkdir d8/d5c/d9a/d9f 0 2024-05-09T00:07:42.703 INFO:tasks.workunit.client.1.smithi135.stdout:0/893: mknod d3/dd/d3f/d3a/da4/c108 0 2024-05-09T00:07:42.703 INFO:tasks.workunit.client.1.smithi135.stdout:0/894: write d3/dd/f4e [6037863,50139] 0 2024-05-09T00:07:42.704 INFO:tasks.workunit.client.1.smithi135.stdout:0/895: write d3/dd/f4e [5949977,86592] 0 2024-05-09T00:07:42.706 INFO:tasks.workunit.client.0.smithi026.stdout:1/296: rename d5/db/l61 to d5/db/d1d/l63 0 2024-05-09T00:07:42.711 INFO:tasks.workunit.client.1.smithi135.stdout:2/914: rename d1/d12/d20/d3b/d4f/f98 to d1/d12/d21/dc7/f132 0 2024-05-09T00:07:42.711 INFO:tasks.workunit.client.1.smithi135.stdout:6/970: rmdir d2/d5f 39 2024-05-09T00:07:42.715 INFO:tasks.workunit.client.0.smithi026.stdout:3/284: rmdir d5/d1e/d3e 39 2024-05-09T00:07:42.717 INFO:tasks.workunit.client.1.smithi135.stdout:5/971: mkdir db/d84/d62/d129 0 2024-05-09T00:07:42.718 INFO:tasks.workunit.client.0.smithi026.stdout:7/449: unlink d8/l11 0 2024-05-09T00:07:42.720 INFO:tasks.workunit.client.1.smithi135.stdout:9/894: dwrite d1/d1a/d2c/d2d/de6/fac [0,4194304] 0 2024-05-09T00:07:42.720 INFO:tasks.workunit.client.1.smithi135.stdout:4/863: dwrite dc/d26/d31/db8/dd1/ddd/ff3 [0,4194304] 0 2024-05-09T00:07:42.721 INFO:tasks.workunit.client.0.smithi026.stdout:1/297: mknod d5/d16/d60/c64 0 2024-05-09T00:07:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:9/342: rename d7/d26/l67 to d7/d23/d29/d31/d40/l80 0 2024-05-09T00:07:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:8/300: dwrite de/f5d [0,4194304] 0 2024-05-09T00:07:42.726 INFO:tasks.workunit.client.1.smithi135.stdout:8/948: creat d4/d8/da2/da6/db8/d129/f140 x:0 0 0 2024-05-09T00:07:42.726 INFO:tasks.workunit.client.1.smithi135.stdout:8/949: truncate d4/dc6/ff5 468549 0 2024-05-09T00:07:42.734 INFO:tasks.workunit.client.1.smithi135.stdout:6/971: truncate d2/da/d1d/d69/f87 2972722 0 2024-05-09T00:07:42.734 INFO:tasks.workunit.client.0.smithi026.stdout:3/285: link d5/f12 d5/d9/dc/d28/f5e 0 2024-05-09T00:07:42.734 INFO:tasks.workunit.client.0.smithi026.stdout:9/343: symlink d7/d23/d2f/l81 0 2024-05-09T00:07:42.735 INFO:tasks.workunit.client.1.smithi135.stdout:0/896: dwrite d3/fff [0,4194304] 0 2024-05-09T00:07:42.735 INFO:tasks.workunit.client.1.smithi135.stdout:2/915: rename d1/d12/d21/d41/d6d/cfe to d1/d12/d20/d3b/c133 0 2024-05-09T00:07:42.737 INFO:tasks.workunit.client.1.smithi135.stdout:5/972: creat db/d24/d32/d114/d11a/f12a x:0 0 0 2024-05-09T00:07:42.738 INFO:tasks.workunit.client.0.smithi026.stdout:8/301: rename de/d17/d21/f22 to de/d17/f64 0 2024-05-09T00:07:42.738 INFO:tasks.workunit.client.0.smithi026.stdout:8/302: dread - de/f25 zero size 2024-05-09T00:07:42.738 INFO:tasks.workunit.client.0.smithi026.stdout:8/303: chown de/d17/d21/d24/d4b 0 1 2024-05-09T00:07:42.738 INFO:tasks.workunit.client.0.smithi026.stdout:8/304: write de/d17/d21/d24/d28/d31/f57 [202329,52174] 0 2024-05-09T00:07:42.738 INFO:tasks.workunit.client.0.smithi026.stdout:8/305: readlink l5 0 2024-05-09T00:07:42.739 INFO:tasks.workunit.client.0.smithi026.stdout:8/306: write de/d17/f4a [4448029,112122] 0 2024-05-09T00:07:42.739 INFO:tasks.workunit.client.1.smithi135.stdout:6/972: write d2/d20/d2e/fbf [321627,41055] 0 2024-05-09T00:07:42.739 INFO:tasks.workunit.client.1.smithi135.stdout:9/895: creat d1/d1a/d10/db3/f123 x:0 0 0 2024-05-09T00:07:42.740 INFO:tasks.workunit.client.0.smithi026.stdout:4/252: sync 2024-05-09T00:07:42.742 INFO:tasks.workunit.client.0.smithi026.stdout:3/286: mkdir d5/d9/d4a/d5f 0 2024-05-09T00:07:42.742 INFO:tasks.workunit.client.0.smithi026.stdout:3/287: write d5/d9/dc/d28/f2e [1444228,104875] 0 2024-05-09T00:07:42.742 INFO:tasks.workunit.client.0.smithi026.stdout:3/288: truncate d5/d41/f43 1146358 0 2024-05-09T00:07:42.746 INFO:tasks.workunit.client.1.smithi135.stdout:8/950: rmdir d4/d8/d115 39 2024-05-09T00:07:42.746 INFO:tasks.workunit.client.1.smithi135.stdout:8/951: dread - d4/d22/fdf zero size 2024-05-09T00:07:42.748 INFO:tasks.workunit.client.0.smithi026.stdout:9/344: rename d7/d23/d29/d31/f42 to d7/d23/d29/d31/d40/f82 0 2024-05-09T00:07:42.748 INFO:tasks.workunit.client.0.smithi026.stdout:9/345: readlink d7/d23/d29/d31/d40/l80 0 2024-05-09T00:07:42.756 INFO:tasks.workunit.client.0.smithi026.stdout:8/307: unlink de/d17/f1c 0 2024-05-09T00:07:42.756 INFO:tasks.workunit.client.0.smithi026.stdout:8/308: readlink de/d17/l2a 0 2024-05-09T00:07:42.757 INFO:tasks.workunit.client.1.smithi135.stdout:0/897: dwrite d3/fda [0,4194304] 0 2024-05-09T00:07:42.759 INFO:tasks.workunit.client.0.smithi026.stdout:4/253: rmdir d0/d19 39 2024-05-09T00:07:42.759 INFO:tasks.workunit.client.0.smithi026.stdout:4/254: fsync d0/d12/d1b/d2b/f35 0 2024-05-09T00:07:42.763 INFO:tasks.workunit.client.0.smithi026.stdout:9/346: dwrite d7/d23/d2f/d3a/f44 [0,4194304] 0 2024-05-09T00:07:42.766 INFO:tasks.workunit.client.0.smithi026.stdout:3/289: dwrite d5/d1e/f3d [0,4194304] 0 2024-05-09T00:07:42.770 INFO:tasks.workunit.client.0.smithi026.stdout:8/309: unlink de/d17/d21/d24/d3b/c44 0 2024-05-09T00:07:42.770 INFO:tasks.workunit.client.0.smithi026.stdout:3/290: dread d5/f1f [0,4194304] 0 2024-05-09T00:07:42.771 INFO:tasks.workunit.client.0.smithi026.stdout:3/291: read f0 [2246710,23197] 0 2024-05-09T00:07:42.771 INFO:tasks.workunit.client.0.smithi026.stdout:3/292: chown d5/d9/dc/d5b 7038 1 2024-05-09T00:07:42.773 INFO:tasks.workunit.client.0.smithi026.stdout:3/293: write d5/d9/dc/d28/f2e [714418,48980] 0 2024-05-09T00:07:42.773 INFO:tasks.workunit.client.0.smithi026.stdout:9/347: symlink d7/d23/d29/d31/d40/l83 0 2024-05-09T00:07:42.775 INFO:tasks.workunit.client.0.smithi026.stdout:4/255: dwrite d0/f9 [0,4194304] 0 2024-05-09T00:07:42.780 INFO:tasks.workunit.client.0.smithi026.stdout:8/310: write de/d17/d21/d24/d3b/d3d/f56 [127426,8204] 0 2024-05-09T00:07:42.780 INFO:tasks.workunit.client.0.smithi026.stdout:8/311: chown de/d17/d21/d24/d3b/d3d/f40 261685 1 2024-05-09T00:07:42.781 INFO:tasks.workunit.client.0.smithi026.stdout:3/294: dread d5/d9/dc/d28/f2e [0,4194304] 0 2024-05-09T00:07:42.781 INFO:tasks.workunit.client.0.smithi026.stdout:9/348: creat d7/d23/f84 x:0 0 0 2024-05-09T00:07:42.783 INFO:tasks.workunit.client.0.smithi026.stdout:4/256: creat d0/d19/d43/d49/f54 x:0 0 0 2024-05-09T00:07:42.783 INFO:tasks.workunit.client.0.smithi026.stdout:4/257: write d0/d12/d1b/f51 [48807,34377] 0 2024-05-09T00:07:42.787 INFO:tasks.workunit.client.0.smithi026.stdout:8/312: rename de/d17/d21/l30 to de/d48/d3e/d54/l65 0 2024-05-09T00:07:42.787 INFO:tasks.workunit.client.0.smithi026.stdout:8/313: chown de/d17/d21/d24/d3b/d3d/l61 3937963 1 2024-05-09T00:07:42.789 INFO:tasks.workunit.client.0.smithi026.stdout:3/295: mknod d5/d9/dc/d28/d45/c60 0 2024-05-09T00:07:42.792 INFO:tasks.workunit.client.0.smithi026.stdout:1/298: truncate d5/d16/f18 3539613 0 2024-05-09T00:07:42.792 INFO:tasks.workunit.client.0.smithi026.stdout:1/299: chown d5/dd/d17/l4e 2 1 2024-05-09T00:07:42.793 INFO:tasks.workunit.client.0.smithi026.stdout:9/349: symlink d7/d23/d29/d2e/l85 0 2024-05-09T00:07:42.800 INFO:tasks.workunit.client.0.smithi026.stdout:8/314: truncate de/d48/f52 263148 0 2024-05-09T00:07:42.800 INFO:tasks.workunit.client.0.smithi026.stdout:8/315: write de/d48/d3e/f50 [688551,88783] 0 2024-05-09T00:07:42.800 INFO:tasks.workunit.client.0.smithi026.stdout:8/316: fdatasync de/d17/f4a 0 2024-05-09T00:07:42.801 INFO:tasks.workunit.client.0.smithi026.stdout:1/300: symlink d5/dd/d17/l65 0 2024-05-09T00:07:42.805 INFO:tasks.workunit.client.0.smithi026.stdout:9/350: mknod d7/d23/c86 0 2024-05-09T00:07:42.806 INFO:tasks.workunit.client.1.smithi135.stdout:1/925: dwrite da/d14/d20/d38/f46 [0,4194304] 0 2024-05-09T00:07:42.806 INFO:tasks.workunit.client.1.smithi135.stdout:2/916: mkdir d1/d12/d21/db1/d134 0 2024-05-09T00:07:42.807 INFO:tasks.workunit.client.0.smithi026.stdout:4/258: link d0/d12/d1b/c41 d0/c55 0 2024-05-09T00:07:42.810 INFO:tasks.workunit.client.1.smithi135.stdout:5/973: getdents db/d24/db0/dcd/d10e 0 2024-05-09T00:07:42.817 INFO:tasks.workunit.client.1.smithi135.stdout:1/926: dread da/d14/d20/d38/d3a/db7/fe5 [0,4194304] 0 2024-05-09T00:07:42.817 INFO:tasks.workunit.client.1.smithi135.stdout:1/927: readlink da/d14/d5c/ld9 0 2024-05-09T00:07:42.818 INFO:tasks.workunit.client.1.smithi135.stdout:9/896: creat d1/d24/f124 x:0 0 0 2024-05-09T00:07:42.819 INFO:tasks.workunit.client.0.smithi026.stdout:8/317: symlink de/d17/d21/d24/d5b/l66 0 2024-05-09T00:07:42.820 INFO:tasks.workunit.client.1.smithi135.stdout:8/952: creat d4/f141 x:0 0 0 2024-05-09T00:07:42.821 INFO:tasks.workunit.client.1.smithi135.stdout:1/928: write da/d24/d27/f6e [3478073,71590] 0 2024-05-09T00:07:42.822 INFO:tasks.workunit.client.0.smithi026.stdout:1/301: mkdir d5/d16/d60/d66 0 2024-05-09T00:07:42.824 INFO:tasks.workunit.client.1.smithi135.stdout:2/917: dwrite d1/d12/d21/dc7/f132 [0,4194304] 0 2024-05-09T00:07:42.824 INFO:tasks.workunit.client.0.smithi026.stdout:9/351: rename d7/d23/d2f/d73 to d7/d23/d2f/d7d/d87 0 2024-05-09T00:07:42.828 INFO:tasks.workunit.client.0.smithi026.stdout:4/259: stat d0/cd 0 2024-05-09T00:07:42.828 INFO:tasks.workunit.client.0.smithi026.stdout:4/260: write d0/f1f [1282980,105616] 0 2024-05-09T00:07:42.828 INFO:tasks.workunit.client.1.smithi135.stdout:1/929: dread da/d14/d20/fb2 [0,4194304] 0 2024-05-09T00:07:42.829 INFO:tasks.workunit.client.1.smithi135.stdout:0/898: symlink d3/dd/d2d/db5/l109 0 2024-05-09T00:07:42.832 INFO:tasks.workunit.client.0.smithi026.stdout:8/318: fdatasync de/d17/d21/d24/d3b/d3d/f40 0 2024-05-09T00:07:42.832 INFO:tasks.workunit.client.0.smithi026.stdout:8/319: chown f3 838890851 1 2024-05-09T00:07:42.836 INFO:tasks.workunit.client.0.smithi026.stdout:9/352: symlink d7/d23/d76/l88 0 2024-05-09T00:07:42.836 INFO:tasks.workunit.client.0.smithi026.stdout:9/353: chown d7/d23/d2f/f45 27239454 1 2024-05-09T00:07:42.837 INFO:tasks.workunit.client.0.smithi026.stdout:1/302: dwrite d5/dd/fe [0,4194304] 0 2024-05-09T00:07:42.837 INFO:tasks.workunit.client.0.smithi026.stdout:1/303: fdatasync d5/f2c 0 2024-05-09T00:07:42.837 INFO:tasks.workunit.client.0.smithi026.stdout:1/304: dread - d5/db/d30/f55 zero size 2024-05-09T00:07:42.837 INFO:tasks.workunit.client.0.smithi026.stdout:1/305: write d5/db/d30/f55 [1008738,106612] 0 2024-05-09T00:07:42.838 INFO:tasks.workunit.client.1.smithi135.stdout:5/974: creat db/d24/db0/dcd/d10e/f12b x:0 0 0 2024-05-09T00:07:42.838 INFO:tasks.workunit.client.1.smithi135.stdout:5/975: chown db/d3f/f61 815594 1 2024-05-09T00:07:42.840 INFO:tasks.workunit.client.1.smithi135.stdout:6/973: mkdir d2/da/d26/d57/d141 0 2024-05-09T00:07:42.841 INFO:tasks.workunit.client.1.smithi135.stdout:6/974: write d2/d20/d2e/f11d [2307851,120968] 0 2024-05-09T00:07:42.841 INFO:tasks.workunit.client.1.smithi135.stdout:6/975: readlink d2/da/d26/l4b 0 2024-05-09T00:07:42.842 INFO:tasks.workunit.client.0.smithi026.stdout:4/261: creat d0/d19/f56 x:0 0 0 2024-05-09T00:07:42.845 INFO:tasks.workunit.client.1.smithi135.stdout:9/897: unlink d1/d24/d86/d97/dec/c7e 0 2024-05-09T00:07:42.845 INFO:tasks.workunit.client.0.smithi026.stdout:5/264: sync 2024-05-09T00:07:42.846 INFO:tasks.workunit.client.0.smithi026.stdout:5/265: stat d2/d8/d2a/f4f 0 2024-05-09T00:07:42.848 INFO:tasks.workunit.client.1.smithi135.stdout:8/953: symlink d4/d7/d2a/d56/dec/l142 0 2024-05-09T00:07:42.848 INFO:tasks.workunit.client.1.smithi135.stdout:8/954: write d4/d7/de/f7d [4347496,123694] 0 2024-05-09T00:07:42.848 INFO:tasks.workunit.client.1.smithi135.stdout:8/955: fdatasync d4/d7/de/d45/d76/f137 0 2024-05-09T00:07:42.848 INFO:tasks.workunit.client.1.smithi135.stdout:8/956: write d4/d7/da4/f11e [608367,34317] 0 2024-05-09T00:07:42.849 INFO:tasks.workunit.client.0.smithi026.stdout:8/320: write de/d17/d21/d24/d3b/d3d/f51 [1003878,1840] 0 2024-05-09T00:07:42.849 INFO:tasks.workunit.client.1.smithi135.stdout:8/957: read d4/d7/d33/d39/f3b [409058,85173] 0 2024-05-09T00:07:42.850 INFO:tasks.workunit.client.1.smithi135.stdout:8/958: dread d4/d7/d33/f7f [0,4194304] 0 2024-05-09T00:07:42.852 INFO:tasks.workunit.client.0.smithi026.stdout:1/306: creat d5/dd/f67 x:0 0 0 2024-05-09T00:07:42.852 INFO:tasks.workunit.client.0.smithi026.stdout:1/307: fdatasync d5/dd/f49 0 2024-05-09T00:07:42.852 INFO:tasks.workunit.client.0.smithi026.stdout:1/308: write d5/dd/f67 [790115,99933] 0 2024-05-09T00:07:42.852 INFO:tasks.workunit.client.0.smithi026.stdout:1/309: fdatasync d5/dd/d17/f5b 0 2024-05-09T00:07:42.852 INFO:tasks.workunit.client.0.smithi026.stdout:1/310: read - d5/db/d30/f4d zero size 2024-05-09T00:07:42.852 INFO:tasks.workunit.client.0.smithi026.stdout:1/311: write f2 [9401790,79983] 0 2024-05-09T00:07:42.853 INFO:tasks.workunit.client.0.smithi026.stdout:1/312: fsync d5/dd/f58 0 2024-05-09T00:07:42.854 INFO:tasks.workunit.client.1.smithi135.stdout:2/918: getdents d1/d12/d21/d41/d6d/d6e 0 2024-05-09T00:07:42.854 INFO:tasks.workunit.client.1.smithi135.stdout:2/919: fsync d1/d12/d21/d41/d6d/d6e/f75 0 2024-05-09T00:07:42.855 INFO:tasks.workunit.client.0.smithi026.stdout:4/262: creat d0/d19/f57 x:0 0 0 2024-05-09T00:07:42.855 INFO:tasks.workunit.client.0.smithi026.stdout:4/263: chown d0/d12/d1b/d2b/f35 234308 1 2024-05-09T00:07:42.857 INFO:tasks.workunit.client.1.smithi135.stdout:1/930: creat da/d14/d20/d38/d3a/db7/de9/dfd/f13f x:0 0 0 2024-05-09T00:07:42.857 INFO:tasks.workunit.client.0.smithi026.stdout:4/264: dread d0/d12/d34/f38 [0,4194304] 0 2024-05-09T00:07:42.857 INFO:tasks.workunit.client.0.smithi026.stdout:5/266: creat d2/d8/d2a/f58 x:0 0 0 2024-05-09T00:07:42.859 INFO:tasks.workunit.client.1.smithi135.stdout:0/899: rename d3/dd/d3f/cd1 to d3/dd/d3f/d3a/da4/de2/c10a 0 2024-05-09T00:07:42.861 INFO:tasks.workunit.client.0.smithi026.stdout:8/321: mknod de/d17/d21/d24/c67 0 2024-05-09T00:07:42.863 INFO:tasks.workunit.client.1.smithi135.stdout:5/976: mkdir db/d24/d32/d114/d12c 0 2024-05-09T00:07:42.867 INFO:tasks.workunit.client.0.smithi026.stdout:8/322: dread de/d17/f43 [0,4194304] 0 2024-05-09T00:07:42.868 INFO:tasks.workunit.client.0.smithi026.stdout:1/313: creat d5/dd/f68 x:0 0 0 2024-05-09T00:07:42.870 INFO:tasks.workunit.client.0.smithi026.stdout:5/267: creat d2/d8/f59 x:0 0 0 2024-05-09T00:07:42.871 INFO:tasks.workunit.client.0.smithi026.stdout:8/323: dread de/d48/d3e/f4c [0,4194304] 0 2024-05-09T00:07:42.871 INFO:tasks.workunit.client.1.smithi135.stdout:6/976: creat d2/d1a/d7a/f142 x:0 0 0 2024-05-09T00:07:42.871 INFO:tasks.workunit.client.1.smithi135.stdout:6/977: chown d2/da/d1d/d69/l74 695469576 1 2024-05-09T00:07:42.872 INFO:tasks.workunit.client.0.smithi026.stdout:4/265: dread d0/d12/d1b/f26 [0,4194304] 0 2024-05-09T00:07:42.874 INFO:tasks.workunit.client.0.smithi026.stdout:1/314: unlink d5/dd/d1f/d39/d47/c53 0 2024-05-09T00:07:42.876 INFO:tasks.workunit.client.1.smithi135.stdout:8/959: creat d4/d22/d8b/d10a/d133/f143 x:0 0 0 2024-05-09T00:07:42.876 INFO:tasks.workunit.client.1.smithi135.stdout:2/920: dwrite d1/d12/f8d [4194304,4194304] 0 2024-05-09T00:07:42.880 INFO:tasks.workunit.client.1.smithi135.stdout:9/898: rename d1/d1a/d10/db3/ce9 to d1/d24/d86/c125 0 2024-05-09T00:07:42.880 INFO:tasks.workunit.client.1.smithi135.stdout:9/899: fdatasync d1/d1a/d10/d3c/d5c/fab 0 2024-05-09T00:07:42.881 INFO:tasks.workunit.client.0.smithi026.stdout:4/266: mkdir d0/d19/d43/d58 0 2024-05-09T00:07:42.882 INFO:tasks.workunit.client.1.smithi135.stdout:4/864: sync 2024-05-09T00:07:42.882 INFO:tasks.workunit.client.1.smithi135.stdout:4/865: dread - dc/d4a/d8c/da5/fae zero size 2024-05-09T00:07:42.882 INFO:tasks.workunit.client.1.smithi135.stdout:4/866: chown dc/d4a/c52 1819908 1 2024-05-09T00:07:42.882 INFO:tasks.workunit.client.1.smithi135.stdout:0/900: mkdir d3/dd/d3f/d43/da3/d10b 0 2024-05-09T00:07:42.882 INFO:tasks.workunit.client.1.smithi135.stdout:0/901: chown d3/dd/d3f/d43/da3/fd7 0 1 2024-05-09T00:07:42.882 INFO:tasks.workunit.client.1.smithi135.stdout:0/902: chown d3/d64/l85 0 1 2024-05-09T00:07:42.883 INFO:tasks.workunit.client.1.smithi135.stdout:1/931: dwrite da/d14/d20/d38/f58 [0,4194304] 0 2024-05-09T00:07:42.883 INFO:tasks.workunit.client.1.smithi135.stdout:1/932: write da/db/d16/f18 [8552947,72640] 0 2024-05-09T00:07:42.883 INFO:tasks.workunit.client.0.smithi026.stdout:1/315: creat d5/db/f69 x:0 0 0 2024-05-09T00:07:42.885 INFO:tasks.workunit.client.0.smithi026.stdout:5/268: mkdir d2/d5a 0 2024-05-09T00:07:42.885 INFO:tasks.workunit.client.0.smithi026.stdout:5/269: write d2/f41 [440342,126685] 0 2024-05-09T00:07:42.886 INFO:tasks.workunit.client.1.smithi135.stdout:8/960: mkdir d4/d7/d2a/d56/dec/d144 0 2024-05-09T00:07:42.886 INFO:tasks.workunit.client.1.smithi135.stdout:8/961: chown d4/d7/de/d45/cf3 490031422 1 2024-05-09T00:07:42.888 INFO:tasks.workunit.client.0.smithi026.stdout:4/267: mknod d0/d19/d43/d49/c59 0 2024-05-09T00:07:42.890 INFO:tasks.workunit.client.1.smithi135.stdout:2/921: getdents d1/d12/d21/d11a 0 2024-05-09T00:07:42.890 INFO:tasks.workunit.client.0.smithi026.stdout:1/316: mknod d5/db/d30/c6a 0 2024-05-09T00:07:42.890 INFO:tasks.workunit.client.0.smithi026.stdout:1/317: chown d5/l13 565844923 1 2024-05-09T00:07:42.892 INFO:tasks.workunit.client.1.smithi135.stdout:9/900: unlink d1/d1a/d10/d3c/c78 0 2024-05-09T00:07:42.892 INFO:tasks.workunit.client.1.smithi135.stdout:0/903: dread d3/fff [0,4194304] 0 2024-05-09T00:07:42.892 INFO:tasks.workunit.client.1.smithi135.stdout:9/901: write d1/d1a/d2c/d2d/f73 [744914,17372] 0 2024-05-09T00:07:42.892 INFO:tasks.workunit.client.1.smithi135.stdout:9/902: write d1/d1a/d10/d3c/d5c/f63 [1898770,82158] 0 2024-05-09T00:07:42.894 INFO:tasks.workunit.client.0.smithi026.stdout:8/324: mknod de/d17/d21/d24/d3b/d3d/c68 0 2024-05-09T00:07:42.896 INFO:tasks.workunit.client.1.smithi135.stdout:4/867: link fa dc/d26/d31/db8/dd1/f11c 0 2024-05-09T00:07:42.901 INFO:tasks.workunit.client.1.smithi135.stdout:6/978: dwrite d2/d20/d3f/f44 [0,4194304] 0 2024-05-09T00:07:42.902 INFO:tasks.workunit.client.1.smithi135.stdout:1/933: creat da/d24/d27/d33/d52/d71/d8d/f140 x:0 0 0 2024-05-09T00:07:42.902 INFO:tasks.workunit.client.1.smithi135.stdout:1/934: stat da/db/d70/l94 0 2024-05-09T00:07:42.903 INFO:tasks.workunit.client.0.smithi026.stdout:5/270: mkdir d2/d8/d31/d32/d5b 0 2024-05-09T00:07:42.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/962: creat d4/d7/de/d45/d76/de2/dc2/f145 x:0 0 0 2024-05-09T00:07:42.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/963: chown d4/d7/d4a/d9c/ld4 58126 1 2024-05-09T00:07:42.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/964: dread - d4/d8/da2/da6/db8/d129/f140 zero size 2024-05-09T00:07:42.905 INFO:tasks.workunit.client.1.smithi135.stdout:6/979: dread d2/d20/d37/f54 [0,4194304] 0 2024-05-09T00:07:42.905 INFO:tasks.workunit.client.1.smithi135.stdout:6/980: fdatasync d2/da/d1d/d69/dfc/f10f 0 2024-05-09T00:07:42.906 INFO:tasks.workunit.client.0.smithi026.stdout:4/268: creat d0/d19/d43/d49/f5a x:0 0 0 2024-05-09T00:07:42.906 INFO:tasks.workunit.client.1.smithi135.stdout:8/965: write d4/d7/d2a/d56/f61 [267969,86344] 0 2024-05-09T00:07:42.910 INFO:tasks.workunit.client.0.smithi026.stdout:1/318: mknod d5/dd/d1f/d51/c6b 0 2024-05-09T00:07:42.910 INFO:tasks.workunit.client.0.smithi026.stdout:1/319: write d5/dd/d1f/d39/d47/f50 [335469,116291] 0 2024-05-09T00:07:42.910 INFO:tasks.workunit.client.1.smithi135.stdout:2/922: creat d1/d12/d20/d2b/d7c/f135 x:0 0 0 2024-05-09T00:07:42.911 INFO:tasks.workunit.client.1.smithi135.stdout:0/904: creat d3/dd/d3f/d3a/da4/de2/f10c x:0 0 0 2024-05-09T00:07:42.911 INFO:tasks.workunit.client.0.smithi026.stdout:8/325: dwrite de/d17/d21/d24/f2e [4194304,4194304] 0 2024-05-09T00:07:42.911 INFO:tasks.workunit.client.0.smithi026.stdout:8/326: write de/d17/f64 [2259505,90454] 0 2024-05-09T00:07:42.912 INFO:tasks.workunit.client.0.smithi026.stdout:4/269: creat d0/d12/d1b/d4e/f5b x:0 0 0 2024-05-09T00:07:42.912 INFO:tasks.workunit.client.0.smithi026.stdout:4/270: truncate d0/d19/d43/d49/f5a 517035 0 2024-05-09T00:07:42.913 INFO:tasks.workunit.client.1.smithi135.stdout:6/981: write d2/d1a/d7a/f8a [351300,36195] 0 2024-05-09T00:07:42.914 INFO:tasks.workunit.client.1.smithi135.stdout:9/903: mkdir d1/d1a/d89/dad/ded/d126 0 2024-05-09T00:07:42.914 INFO:tasks.workunit.client.1.smithi135.stdout:9/904: write d1/d1a/d89/dad/ded/f106 [1538265,10956] 0 2024-05-09T00:07:42.914 INFO:tasks.workunit.client.1.smithi135.stdout:9/905: chown d1/d1a/d10/d3c/d5c/lc1 225311 1 2024-05-09T00:07:42.914 INFO:tasks.workunit.client.1.smithi135.stdout:9/906: write d1/d1a/d10/db3/f123 [906268,45898] 0 2024-05-09T00:07:42.915 INFO:tasks.workunit.client.0.smithi026.stdout:1/320: symlink d5/db/l6c 0 2024-05-09T00:07:42.915 INFO:tasks.workunit.client.0.smithi026.stdout:1/321: chown d5/d16/c4b 27804 1 2024-05-09T00:07:42.915 INFO:tasks.workunit.client.1.smithi135.stdout:4/868: readlink dc/dd/l30 0 2024-05-09T00:07:42.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/966: mkdir d4/d7/d2a/d56/d123/d146 0 2024-05-09T00:07:42.925 INFO:tasks.workunit.client.1.smithi135.stdout:0/905: mkdir d3/dd/d2d/db5/df4/daa/df2/d10d 0 2024-05-09T00:07:42.926 INFO:tasks.workunit.client.1.smithi135.stdout:6/982: getdents d2/da/d26 0 2024-05-09T00:07:42.927 INFO:tasks.workunit.client.1.smithi135.stdout:0/906: write d3/dd/f32 [6612329,24795] 0 2024-05-09T00:07:42.928 INFO:tasks.workunit.client.1.smithi135.stdout:0/907: fdatasync d3/dd/d3f/d3a/f48 0 2024-05-09T00:07:42.928 INFO:tasks.workunit.client.1.smithi135.stdout:9/907: creat d1/d24/d44/d7f/da2/dca/dea/f127 x:0 0 0 2024-05-09T00:07:42.930 INFO:tasks.workunit.client.1.smithi135.stdout:4/869: unlink dc/d26/d93/lca 0 2024-05-09T00:07:42.932 INFO:tasks.workunit.client.1.smithi135.stdout:8/967: rmdir d4/d7/d33 39 2024-05-09T00:07:42.935 INFO:tasks.workunit.client.0.smithi026.stdout:1/322: dread d5/dd/f3f [0,4194304] 0 2024-05-09T00:07:42.936 INFO:tasks.workunit.client.1.smithi135.stdout:0/908: rmdir d3/dd/d3f/d43/da3 39 2024-05-09T00:07:42.938 INFO:tasks.workunit.client.1.smithi135.stdout:9/908: mknod d1/d24/d44/d7f/da2/dca/d113/c128 0 2024-05-09T00:07:42.943 INFO:tasks.workunit.client.1.smithi135.stdout:8/968: symlink d4/d8/da2/d132/l147 0 2024-05-09T00:07:42.945 INFO:tasks.workunit.client.0.smithi026.stdout:1/323: creat d5/d16/d60/f6d x:0 0 0 2024-05-09T00:07:42.946 INFO:tasks.workunit.client.0.smithi026.stdout:1/324: write d5/db/d1d/f48 [5215,122117] 0 2024-05-09T00:07:42.946 INFO:tasks.workunit.client.0.smithi026.stdout:1/325: chown d5/dd/f68 349 1 2024-05-09T00:07:42.946 INFO:tasks.workunit.client.0.smithi026.stdout:1/326: chown d5/db/d30/c54 35 1 2024-05-09T00:07:42.946 INFO:tasks.workunit.client.0.smithi026.stdout:1/327: write d5/db/f62 [159874,8937] 0 2024-05-09T00:07:42.946 INFO:tasks.workunit.client.0.smithi026.stdout:8/327: write de/f16 [454661,8704] 0 2024-05-09T00:07:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:5/271: dwrite d2/d8/d31/f17 [0,4194304] 0 2024-05-09T00:07:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:5/272: fdatasync d2/f3 0 2024-05-09T00:07:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:5/273: write d2/f3 [4671129,38730] 0 2024-05-09T00:07:42.954 INFO:tasks.workunit.client.1.smithi135.stdout:2/923: dwrite d1/d12/d20/d3b/d105/f10e [0,4194304] 0 2024-05-09T00:07:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:4/271: dread d0/d19/f39 [0,4194304] 0 2024-05-09T00:07:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:5/274: mkdir d2/d8/d31/d32/d5c 0 2024-05-09T00:07:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:5/275: chown d2/d8/d31/d24 12 1 2024-05-09T00:07:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:1/328: dread d5/dd/f58 [0,4194304] 0 2024-05-09T00:07:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:8/328: dread de/d17/d21/d24/f26 [0,4194304] 0 2024-05-09T00:07:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:8/329: chown de/d17/l1b 4 1 2024-05-09T00:07:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:8/330: fsync de/d17/d21/d24/d28/f3c 0 2024-05-09T00:07:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:8/331: fdatasync de/d17/d21/d24/f2e 0 2024-05-09T00:07:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:8/332: fdatasync de/d17/d21/d24/d28/f3c 0 2024-05-09T00:07:42.958 INFO:tasks.workunit.client.1.smithi135.stdout:2/924: creat d1/d12/d21/f136 x:0 0 0 2024-05-09T00:07:42.959 INFO:tasks.workunit.client.1.smithi135.stdout:2/925: fdatasync d1/d12/d20/d2b/d56/d72/fae 0 2024-05-09T00:07:42.959 INFO:tasks.workunit.client.1.smithi135.stdout:8/969: dread d4/d7/de/d45/d76/de2/f114 [0,4194304] 0 2024-05-09T00:07:42.961 INFO:tasks.workunit.client.0.smithi026.stdout:4/272: rename d0/d12/d34/f4d to d0/d19/f5c 0 2024-05-09T00:07:42.961 INFO:tasks.workunit.client.0.smithi026.stdout:4/273: truncate d0/d12/d34/f38 730497 0 2024-05-09T00:07:42.961 INFO:tasks.workunit.client.0.smithi026.stdout:4/274: truncate d0/d12/d1b/d2b/f3f 1497583 0 2024-05-09T00:07:42.961 INFO:tasks.workunit.client.0.smithi026.stdout:4/275: fdatasync d0/d12/f30 0 2024-05-09T00:07:42.962 INFO:tasks.workunit.client.1.smithi135.stdout:2/926: mknod d1/d12/d21/d57/c137 0 2024-05-09T00:07:42.962 INFO:tasks.workunit.client.1.smithi135.stdout:0/909: dread d3/dd/d3f/d3a/f4a [0,4194304] 0 2024-05-09T00:07:42.964 INFO:tasks.workunit.client.1.smithi135.stdout:8/970: creat d4/d7/de/d45/d76/f148 x:0 0 0 2024-05-09T00:07:42.967 INFO:tasks.workunit.client.1.smithi135.stdout:2/927: symlink d1/d12/d21/d41/l138 0 2024-05-09T00:07:42.967 INFO:tasks.workunit.client.1.smithi135.stdout:2/928: chown d1/d12/d20/d2b 8256730 1 2024-05-09T00:07:42.968 INFO:tasks.workunit.client.0.smithi026.stdout:2/245: sync 2024-05-09T00:07:42.968 INFO:tasks.workunit.client.0.smithi026.stdout:0/425: sync 2024-05-09T00:07:42.968 INFO:tasks.workunit.client.0.smithi026.stdout:6/252: sync 2024-05-09T00:07:42.969 INFO:tasks.workunit.client.0.smithi026.stdout:2/246: truncate f2 4943701 0 2024-05-09T00:07:42.969 INFO:tasks.workunit.client.0.smithi026.stdout:0/426: fdatasync d1d/d33/f61 0 2024-05-09T00:07:42.969 INFO:tasks.workunit.client.1.smithi135.stdout:4/870: dwrite dc/d26/d31/db8/dd1/ddd/ff3 [4194304,4194304] 0 2024-05-09T00:07:42.969 INFO:tasks.workunit.client.1.smithi135.stdout:4/871: chown dc/d4a/d69/d55/cdf 299 1 2024-05-09T00:07:42.971 INFO:tasks.workunit.client.1.smithi135.stdout:6/983: dwrite d2/d20/d3f/d13f/d62/f13b [0,4194304] 0 2024-05-09T00:07:42.971 INFO:tasks.workunit.client.1.smithi135.stdout:0/910: unlink d3/dd/c5d 0 2024-05-09T00:07:42.973 INFO:tasks.workunit.client.1.smithi135.stdout:9/909: dwrite d1/fe1 [0,4194304] 0 2024-05-09T00:07:42.974 INFO:tasks.workunit.client.1.smithi135.stdout:0/911: dread d3/dd/d2d/f6a [0,4194304] 0 2024-05-09T00:07:42.974 INFO:tasks.workunit.client.1.smithi135.stdout:0/912: chown d3/dd/d3f/d58/f6d 3 1 2024-05-09T00:07:42.998 INFO:tasks.workunit.client.1.smithi135.stdout:8/971: dwrite d4/d7/de/d45/d76/de2/fe4 [0,4194304] 0 2024-05-09T00:07:43.011 INFO:tasks.workunit.client.1.smithi135.stdout:0/913: dwrite d3/dd/d2d/db5/df4/fa8 [0,4194304] 0 2024-05-09T00:07:43.011 INFO:tasks.workunit.client.1.smithi135.stdout:4/872: dwrite dc/d4a/d69/d55/d6d/dec/dee/f10d [0,4194304] 0 2024-05-09T00:07:43.011 INFO:tasks.workunit.client.1.smithi135.stdout:4/873: dread - dc/d71/de5/fe6 zero size 2024-05-09T00:07:43.011 INFO:tasks.workunit.client.1.smithi135.stdout:2/929: dwrite d1/d12/d20/d2b/d56/d86/f88 [4194304,4194304] 0 2024-05-09T00:07:43.012 INFO:tasks.workunit.client.1.smithi135.stdout:8/972: dread d4/d7/d33/fea [0,4194304] 0 2024-05-09T00:07:43.012 INFO:tasks.workunit.client.1.smithi135.stdout:8/973: read - d4/d7/de/d45/d76/f148 zero size 2024-05-09T00:07:43.015 INFO:tasks.workunit.client.1.smithi135.stdout:4/874: read dc/d4a/d69/f51 [1194152,117223] 0 2024-05-09T00:07:43.020 INFO:tasks.workunit.client.1.smithi135.stdout:8/974: dread d4/d7/d33/d39/f47 [0,4194304] 0 2024-05-09T00:07:43.021 INFO:tasks.workunit.client.0.smithi026.stdout:1/329: mknod d5/dd/c6e 0 2024-05-09T00:07:43.025 INFO:tasks.workunit.client.0.smithi026.stdout:8/333: unlink de/d17/d21/d24/d28/d31/f57 0 2024-05-09T00:07:43.025 INFO:tasks.workunit.client.0.smithi026.stdout:8/334: read f9 [4169154,82755] 0 2024-05-09T00:07:43.026 INFO:tasks.workunit.client.1.smithi135.stdout:4/875: dread dc/d26/df4/f48 [0,4194304] 0 2024-05-09T00:07:43.026 INFO:tasks.workunit.client.0.smithi026.stdout:8/335: write de/d17/f43 [867531,71347] 0 2024-05-09T00:07:43.027 INFO:tasks.workunit.client.1.smithi135.stdout:6/984: rename d2/da/d49/da4/fc7 to d2/da/d49/f143 0 2024-05-09T00:07:43.029 INFO:tasks.workunit.client.0.smithi026.stdout:4/276: symlink d0/d12/d34/l5d 0 2024-05-09T00:07:43.031 INFO:tasks.workunit.client.0.smithi026.stdout:0/427: link d1d/d1e/f69 d1d/d1e/d20/f8d 0 2024-05-09T00:07:43.031 INFO:tasks.workunit.client.0.smithi026.stdout:1/330: write f4 [7769327,3448] 0 2024-05-09T00:07:43.032 INFO:tasks.workunit.client.1.smithi135.stdout:2/930: dwrite d1/d12/d20/d2b/dbb/f12c [0,4194304] 0 2024-05-09T00:07:43.032 INFO:tasks.workunit.client.1.smithi135.stdout:2/931: stat d1/d12/d20/d3b/d40 0 2024-05-09T00:07:43.033 INFO:tasks.workunit.client.0.smithi026.stdout:6/253: rmdir d15/d1e/d23/d26 39 2024-05-09T00:07:43.033 INFO:tasks.workunit.client.0.smithi026.stdout:6/254: getdents d15/d1e/d23/d3a 0 2024-05-09T00:07:43.037 INFO:tasks.workunit.client.0.smithi026.stdout:5/276: rmdir d2 39 2024-05-09T00:07:43.039 INFO:tasks.workunit.client.0.smithi026.stdout:8/336: creat de/d17/f69 x:0 0 0 2024-05-09T00:07:43.041 INFO:tasks.workunit.client.0.smithi026.stdout:4/277: creat d0/d12/d1b/d2b/f5e x:0 0 0 2024-05-09T00:07:43.042 INFO:tasks.workunit.client.1.smithi135.stdout:9/910: truncate d1/d24/d44/daf/fd6 569940 0 2024-05-09T00:07:43.043 INFO:tasks.workunit.client.0.smithi026.stdout:1/331: creat d5/dd/d1f/d51/f6f x:0 0 0 2024-05-09T00:07:43.046 INFO:tasks.workunit.client.0.smithi026.stdout:6/255: rmdir d15/d1e/d3d/d4c/d4d 39 2024-05-09T00:07:43.049 INFO:tasks.workunit.client.0.smithi026.stdout:5/277: rmdir d2/d8/d31/d32/d5b 0 2024-05-09T00:07:43.052 INFO:tasks.workunit.client.0.smithi026.stdout:8/337: rename de/d17/d21/d24/d4b to de/d17/d6a 0 2024-05-09T00:07:43.054 INFO:tasks.workunit.client.0.smithi026.stdout:4/278: creat d0/d12/d1b/f5f x:0 0 0 2024-05-09T00:07:43.056 INFO:tasks.workunit.client.0.smithi026.stdout:1/332: mknod d5/c70 0 2024-05-09T00:07:43.057 INFO:tasks.workunit.client.0.smithi026.stdout:1/333: write d5/dd/f58 [1371415,67814] 0 2024-05-09T00:07:43.057 INFO:tasks.workunit.client.1.smithi135.stdout:8/975: mkdir d4/d8/da2/da6/dde/dfb/d139/d149 0 2024-05-09T00:07:43.058 INFO:tasks.workunit.client.0.smithi026.stdout:5/278: getdents d2/d8/d31/d2e/d4a 0 2024-05-09T00:07:43.060 INFO:tasks.workunit.client.1.smithi135.stdout:4/876: creat dc/d4a/d69/f11d x:0 0 0 2024-05-09T00:07:43.063 INFO:tasks.workunit.client.0.smithi026.stdout:6/256: rename d15/d1e/d3d/d4c/d4d/d54 to d15/d2b/d33/d55 0 2024-05-09T00:07:43.067 INFO:tasks.workunit.client.1.smithi135.stdout:6/985: rename d2/d1a to d2/da/d49/da4/dce/dd8/d144 0 2024-05-09T00:07:43.068 INFO:tasks.workunit.client.1.smithi135.stdout:6/986: fsync d2/f77 0 2024-05-09T00:07:43.069 INFO:tasks.workunit.client.0.smithi026.stdout:8/338: mknod de/d17/d21/d24/d28/d31/d4f/c6b 0 2024-05-09T00:07:43.070 INFO:tasks.workunit.client.0.smithi026.stdout:4/279: creat d0/d19/d43/d49/f60 x:0 0 0 2024-05-09T00:07:43.073 INFO:tasks.workunit.client.1.smithi135.stdout:9/911: creat d1/d24/d86/d10d/f129 x:0 0 0 2024-05-09T00:07:43.073 INFO:tasks.workunit.client.1.smithi135.stdout:9/912: truncate d1/d24/d44/d7f/f9f 1295413 0 2024-05-09T00:07:43.073 INFO:tasks.workunit.client.1.smithi135.stdout:9/913: fdatasync d1/d1a/d89/d99/fc4 0 2024-05-09T00:07:43.073 INFO:tasks.workunit.client.1.smithi135.stdout:9/914: fdatasync d1/d1a/d10/d3c/d5c/f6b 0 2024-05-09T00:07:43.074 INFO:tasks.workunit.client.1.smithi135.stdout:5/977: sync 2024-05-09T00:07:43.074 INFO:tasks.workunit.client.1.smithi135.stdout:4/877: mkdir dc/d71/d90/d11e 0 2024-05-09T00:07:43.077 INFO:tasks.workunit.client.1.smithi135.stdout:2/932: rename d1/d12/d21/d41/d6d/l9c to d1/d12/d20/d2b/d56/ddd/d118/l139 0 2024-05-09T00:07:43.077 INFO:tasks.workunit.client.0.smithi026.stdout:6/257: dread f4 [0,4194304] 0 2024-05-09T00:07:43.079 INFO:tasks.workunit.client.0.smithi026.stdout:5/279: mkdir d2/d8/d31/d2e/d5d 0 2024-05-09T00:07:43.079 INFO:tasks.workunit.client.0.smithi026.stdout:7/450: sync 2024-05-09T00:07:43.082 INFO:tasks.workunit.client.1.smithi135.stdout:8/976: dwrite d4/d7/de/d45/d76/de2/f9e [4194304,4194304] 0 2024-05-09T00:07:43.083 INFO:tasks.workunit.client.1.smithi135.stdout:4/878: mknod dc/d4a/d69/d55/d5f/d5a/d9e/d113/c11f 0 2024-05-09T00:07:43.084 INFO:tasks.workunit.client.1.smithi135.stdout:6/987: dwrite d2/d20/d3f/d13f/d62/fe4 [0,4194304] 0 2024-05-09T00:07:43.085 INFO:tasks.workunit.client.1.smithi135.stdout:5/978: dread db/d24/f8c [0,4194304] 0 2024-05-09T00:07:43.085 INFO:tasks.workunit.client.1.smithi135.stdout:5/979: stat db/d5d/dac/ddc/dbf/de3/f116 0 2024-05-09T00:07:43.086 INFO:tasks.workunit.client.1.smithi135.stdout:5/980: truncate db/d84/fb2 465522 0 2024-05-09T00:07:43.088 INFO:tasks.workunit.client.0.smithi026.stdout:4/280: symlink d0/d12/d1b/d4e/l61 0 2024-05-09T00:07:43.089 INFO:tasks.workunit.client.1.smithi135.stdout:9/915: rename d1/d1a/d89/dad/ded/d126 to d1/d24/d86/d97/dec/d12a 0 2024-05-09T00:07:43.089 INFO:tasks.workunit.client.1.smithi135.stdout:9/916: readlink d1/d1a/d10/d3c/d5c/lc1 0 2024-05-09T00:07:43.090 INFO:tasks.workunit.client.0.smithi026.stdout:1/334: mknod d5/d16/c71 0 2024-05-09T00:07:43.091 INFO:tasks.workunit.client.1.smithi135.stdout:2/933: creat d1/d12/d20/d2b/d7c/db5/dfd/f13a x:0 0 0 2024-05-09T00:07:43.092 INFO:tasks.workunit.client.0.smithi026.stdout:7/451: mknod d8/d5c/d9a/ca0 0 2024-05-09T00:07:43.094 INFO:tasks.workunit.client.1.smithi135.stdout:8/977: mkdir d4/d7/d2a/d56/dec/dfe/d113/d11b/d14a 0 2024-05-09T00:07:43.095 INFO:tasks.workunit.client.0.smithi026.stdout:1/335: creat d5/d16/f72 x:0 0 0 2024-05-09T00:07:43.095 INFO:tasks.workunit.client.1.smithi135.stdout:1/935: sync 2024-05-09T00:07:43.096 INFO:tasks.workunit.client.0.smithi026.stdout:6/258: dwrite d15/d34/f53 [0,4194304] 0 2024-05-09T00:07:43.097 INFO:tasks.workunit.client.1.smithi135.stdout:4/879: link dc/d4a/d69/d55/d5f/d5a/f5b dc/d4a/f120 0 2024-05-09T00:07:43.102 INFO:tasks.workunit.client.0.smithi026.stdout:4/281: dread d0/d12/d1b/f26 [0,4194304] 0 2024-05-09T00:07:43.102 INFO:tasks.workunit.client.1.smithi135.stdout:6/988: link d2/da/d49/ld4 d2/d20/d3f/d4f/ddb/d11c/l145 0 2024-05-09T00:07:43.103 INFO:tasks.workunit.client.0.smithi026.stdout:1/336: dread f3 [0,4194304] 0 2024-05-09T00:07:43.107 INFO:tasks.workunit.client.1.smithi135.stdout:5/981: getdents db/d24/db0/dcd/d10e 0 2024-05-09T00:07:43.109 INFO:tasks.workunit.client.0.smithi026.stdout:8/339: rename de/d17/d21/d24/d28 to de/d6c 0 2024-05-09T00:07:43.110 INFO:tasks.workunit.client.0.smithi026.stdout:4/282: creat d0/d12/f62 x:0 0 0 2024-05-09T00:07:43.112 INFO:tasks.workunit.client.1.smithi135.stdout:6/989: dread d2/da/d49/da4/dce/dd8/d144/d7a/f8a [0,4194304] 0 2024-05-09T00:07:43.112 INFO:tasks.workunit.client.1.smithi135.stdout:6/990: getdents d2/da/d49/da6/dd9/d10d/d110/d118 0 2024-05-09T00:07:43.112 INFO:tasks.workunit.client.0.smithi026.stdout:5/280: rename d2/d8/d31/f18 to d2/d8/d31/d4b/d51/f5e 0 2024-05-09T00:07:43.113 INFO:tasks.workunit.client.1.smithi135.stdout:9/917: rmdir d1/d1a/d10/d3c/d102 39 2024-05-09T00:07:43.114 INFO:tasks.workunit.client.0.smithi026.stdout:8/340: creat de/d17/d6a/f6d x:0 0 0 2024-05-09T00:07:43.117 INFO:tasks.workunit.client.1.smithi135.stdout:2/934: rename d1/fd to d1/d12/d20/d2b/d56/ddd/d118/f13b 0 2024-05-09T00:07:43.118 INFO:tasks.workunit.client.0.smithi026.stdout:4/283: link d0/d12/d1b/f3c d0/d12/d1b/d2b/f63 0 2024-05-09T00:07:43.120 INFO:tasks.workunit.client.1.smithi135.stdout:0/914: sync 2024-05-09T00:07:43.122 INFO:tasks.workunit.client.1.smithi135.stdout:8/978: creat d4/d8/da2/d110/f14b x:0 0 0 2024-05-09T00:07:43.122 INFO:tasks.workunit.client.1.smithi135.stdout:8/979: truncate d4/d7/d2a/d9f/fe3 359309 0 2024-05-09T00:07:43.122 INFO:tasks.workunit.client.1.smithi135.stdout:8/980: readlink d4/d7/de/d45/l101 0 2024-05-09T00:07:43.122 INFO:tasks.workunit.client.0.smithi026.stdout:5/281: creat d2/d5a/f5f x:0 0 0 2024-05-09T00:07:43.123 INFO:tasks.workunit.client.0.smithi026.stdout:5/282: chown d2/d8/d31/d2e/d35/l3b 0 1 2024-05-09T00:07:43.123 INFO:tasks.workunit.client.0.smithi026.stdout:5/283: readlink d2/la 0 2024-05-09T00:07:43.124 INFO:tasks.workunit.client.0.smithi026.stdout:4/284: getdents d0 0 2024-05-09T00:07:43.125 INFO:tasks.workunit.client.1.smithi135.stdout:4/880: readlink dc/d26/df4/l3b 0 2024-05-09T00:07:43.126 INFO:tasks.workunit.client.0.smithi026.stdout:5/284: creat d2/f60 x:0 0 0 2024-05-09T00:07:43.126 INFO:tasks.workunit.client.0.smithi026.stdout:5/285: read d2/fc [1355208,7970] 0 2024-05-09T00:07:43.127 INFO:tasks.workunit.client.0.smithi026.stdout:4/285: mkdir d0/d12/d64 0 2024-05-09T00:07:43.129 INFO:tasks.workunit.client.1.smithi135.stdout:6/991: rename d2/da/c29 to d2/d20/c146 0 2024-05-09T00:07:43.131 INFO:tasks.workunit.client.0.smithi026.stdout:5/286: creat d2/d8/d31/d2e/d33/f61 x:0 0 0 2024-05-09T00:07:43.132 INFO:tasks.workunit.client.1.smithi135.stdout:2/935: symlink d1/d12/d20/d2b/d56/l13c 0 2024-05-09T00:07:43.133 INFO:tasks.workunit.client.0.smithi026.stdout:4/286: symlink d0/d19/d43/l65 0 2024-05-09T00:07:43.135 INFO:tasks.workunit.client.1.smithi135.stdout:8/981: creat d4/d7/de/d108/f14c x:0 0 0 2024-05-09T00:07:43.136 INFO:tasks.workunit.client.1.smithi135.stdout:1/936: link da/d14/d20/d38/d86/cdc da/d14/d20/c141 0 2024-05-09T00:07:43.136 INFO:tasks.workunit.client.1.smithi135.stdout:1/937: fsync da/db/d16/df2/f10a 0 2024-05-09T00:07:43.137 INFO:tasks.workunit.client.0.smithi026.stdout:4/287: write d0/d19/f2f [1555067,106413] 0 2024-05-09T00:07:43.137 INFO:tasks.workunit.client.0.smithi026.stdout:7/452: dwrite d8/d1b/f34 [0,4194304] 0 2024-05-09T00:07:43.138 INFO:tasks.workunit.client.1.smithi135.stdout:9/918: rename d1/d1a/d89/f109 to d1/d1a/d2c/d20/f12b 0 2024-05-09T00:07:43.139 INFO:tasks.workunit.client.1.smithi135.stdout:2/936: creat d1/d12/d21/d57/dbd/f13d x:0 0 0 2024-05-09T00:07:43.139 INFO:tasks.workunit.client.1.smithi135.stdout:8/982: write d4/d7/f52 [3259136,106704] 0 2024-05-09T00:07:43.140 INFO:tasks.workunit.client.1.smithi135.stdout:9/919: dread d1/d1a/d2c/d2d/f73 [0,4194304] 0 2024-05-09T00:07:43.141 INFO:tasks.workunit.client.0.smithi026.stdout:4/288: mkdir d0/d12/d1b/d2b/d66 0 2024-05-09T00:07:43.142 INFO:tasks.workunit.client.1.smithi135.stdout:0/915: dwrite d3/dd/d3f/d43/f8e [0,4194304] 0 2024-05-09T00:07:43.145 INFO:tasks.workunit.client.1.smithi135.stdout:6/992: rename d2/da/d1d/d69/f87 to d2/da/d1d/d69/dfc/f147 0 2024-05-09T00:07:43.146 INFO:tasks.workunit.client.0.smithi026.stdout:6/259: dwrite f12 [0,4194304] 0 2024-05-09T00:07:43.146 INFO:tasks.workunit.client.0.smithi026.stdout:7/453: mkdir d8/d2e/d55/d22/da1 0 2024-05-09T00:07:43.146 INFO:tasks.workunit.client.0.smithi026.stdout:1/337: dwrite d5/d16/f18 [0,4194304] 0 2024-05-09T00:07:43.147 INFO:tasks.workunit.client.0.smithi026.stdout:7/454: dread d8/d2e/d55/f52 [0,4194304] 0 2024-05-09T00:07:43.149 INFO:tasks.workunit.client.0.smithi026.stdout:4/289: mkdir d0/d12/d67 0 2024-05-09T00:07:43.149 INFO:tasks.workunit.client.0.smithi026.stdout:8/341: dwrite de/d17/f69 [0,4194304] 0 2024-05-09T00:07:43.149 INFO:tasks.workunit.client.1.smithi135.stdout:8/983: mkdir d4/d7/de/d45/d76/d14d 0 2024-05-09T00:07:43.149 INFO:tasks.workunit.client.1.smithi135.stdout:8/984: truncate d4/d8/da2/da6/db8/d129/f140 539546 0 2024-05-09T00:07:43.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/985: write d4/f141 [339068,24102] 0 2024-05-09T00:07:43.150 INFO:tasks.workunit.client.0.smithi026.stdout:8/342: write de/ff [632645,30558] 0 2024-05-09T00:07:43.153 INFO:tasks.workunit.client.0.smithi026.stdout:6/260: symlink d15/d1e/d3d/l56 0 2024-05-09T00:07:43.153 INFO:tasks.workunit.client.0.smithi026.stdout:6/261: truncate d15/f29 555949 0 2024-05-09T00:07:43.153 INFO:tasks.workunit.client.1.smithi135.stdout:1/938: dread da/d24/d27/d33/d7d/ffe [0,4194304] 0 2024-05-09T00:07:43.155 INFO:tasks.workunit.client.1.smithi135.stdout:1/939: dread da/db/d16/f2f [0,4194304] 0 2024-05-09T00:07:43.156 INFO:tasks.workunit.client.1.smithi135.stdout:4/881: dwrite dc/d4a/d69/d55/d5f/f53 [0,4194304] 0 2024-05-09T00:07:43.156 INFO:tasks.workunit.client.1.smithi135.stdout:9/920: mkdir d1/d24/d44/d7f/da2/dca/d113/d12c 0 2024-05-09T00:07:43.159 INFO:tasks.workunit.client.0.smithi026.stdout:7/455: rmdir d8/d5c/d9a 39 2024-05-09T00:07:43.178 INFO:tasks.workunit.client.1.smithi135.stdout:0/916: mkdir d3/dd/d3f/d3a/d46/d10e 0 2024-05-09T00:07:43.181 INFO:tasks.workunit.client.0.smithi026.stdout:5/287: dwrite d2/d8/d31/d2e/d4a/f3c [0,4194304] 0 2024-05-09T00:07:43.181 INFO:tasks.workunit.client.1.smithi135.stdout:6/993: dwrite d2/da/d1d/d69/d78/fc9 [0,4194304] 0 2024-05-09T00:07:43.181 INFO:tasks.workunit.client.1.smithi135.stdout:2/937: dwrite d1/f32 [0,4194304] 0 2024-05-09T00:07:43.182 INFO:tasks.workunit.client.0.smithi026.stdout:1/338: dwrite d5/db/f62 [0,4194304] 0 2024-05-09T00:07:43.182 INFO:tasks.workunit.client.1.smithi135.stdout:0/917: dread d3/dd/d3f/d58/dae/dd3/fdb [0,4194304] 0 2024-05-09T00:07:43.182 INFO:tasks.workunit.client.1.smithi135.stdout:0/918: readlink d3/dd/d3f/d3a/da4/dc1/lc8 0 2024-05-09T00:07:43.182 INFO:tasks.workunit.client.1.smithi135.stdout:0/919: fsync d3/dd/f4e 0 2024-05-09T00:07:43.182 INFO:tasks.workunit.client.1.smithi135.stdout:8/986: unlink d4/d7/de/l9a 0 2024-05-09T00:07:43.183 INFO:tasks.workunit.client.0.smithi026.stdout:8/343: rename de/d6c/c38 to de/d6c/c6e 0 2024-05-09T00:07:43.185 INFO:tasks.workunit.client.1.smithi135.stdout:1/940: rename da/d14/d20/d38/d3a/db7/dc6/ca7 to da/db/d107/c142 0 2024-05-09T00:07:43.186 INFO:tasks.workunit.client.0.smithi026.stdout:5/288: dread d2/f41 [0,4194304] 0 2024-05-09T00:07:43.186 INFO:tasks.workunit.client.0.smithi026.stdout:6/262: symlink d15/d1e/d30/l57 0 2024-05-09T00:07:43.187 INFO:tasks.workunit.client.0.smithi026.stdout:6/263: write d15/f29 [710197,67168] 0 2024-05-09T00:07:43.188 INFO:tasks.workunit.client.1.smithi135.stdout:4/882: symlink dc/d26/d31/db8/dd1/l121 0 2024-05-09T00:07:43.189 INFO:tasks.workunit.client.0.smithi026.stdout:7/456: mkdir d8/d2e/d55/d1e/d80/da2 0 2024-05-09T00:07:43.192 INFO:tasks.workunit.client.1.smithi135.stdout:9/921: creat d1/d24/d44/d7f/da2/dca/d113/d12c/f12d x:0 0 0 2024-05-09T00:07:43.194 INFO:tasks.workunit.client.1.smithi135.stdout:9/922: dread d1/d1a/d2c/d2d/f73 [0,4194304] 0 2024-05-09T00:07:43.199 INFO:tasks.workunit.client.1.smithi135.stdout:5/982: write db/d5d/f6d [754071,24488] 0 2024-05-09T00:07:43.199 INFO:tasks.workunit.client.1.smithi135.stdout:6/994: mkdir d2/da/d26/d57/d141/d148 0 2024-05-09T00:07:43.200 INFO:tasks.workunit.client.1.smithi135.stdout:2/938: creat d1/d12/d21/d41/d6d/d6e/f13e x:0 0 0 2024-05-09T00:07:43.200 INFO:tasks.workunit.client.1.smithi135.stdout:6/995: read f1 [2458749,29650] 0 2024-05-09T00:07:43.200 INFO:tasks.workunit.client.1.smithi135.stdout:6/996: truncate d2/f17 1739304 0 2024-05-09T00:07:43.202 INFO:tasks.workunit.client.1.smithi135.stdout:8/987: creat d4/d7/d2a/d9f/de1/f14e x:0 0 0 2024-05-09T00:07:43.203 INFO:tasks.workunit.client.1.smithi135.stdout:0/920: dwrite d3/f4f [0,4194304] 0 2024-05-09T00:07:43.203 INFO:tasks.workunit.client.0.smithi026.stdout:5/289: dwrite d2/d8/d31/d4b/d51/f5e [0,4194304] 0 2024-05-09T00:07:43.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/941: creat da/d14/d20/d38/d3a/f143 x:0 0 0 2024-05-09T00:07:43.207 INFO:tasks.workunit.client.1.smithi135.stdout:4/883: symlink dc/d26/d93/l122 0 2024-05-09T00:07:43.210 INFO:tasks.workunit.client.1.smithi135.stdout:9/923: mkdir d1/d1a/d89/dad/ded/d12e 0 2024-05-09T00:07:43.210 INFO:tasks.workunit.client.0.smithi026.stdout:4/290: getdents d0/d12/d1b/d2b 0 2024-05-09T00:07:43.212 INFO:tasks.workunit.client.0.smithi026.stdout:4/291: dread d0/d12/f2c [0,4194304] 0 2024-05-09T00:07:43.213 INFO:tasks.workunit.client.1.smithi135.stdout:5/983: creat db/d24/d32/dfa/d9c/f12d x:0 0 0 2024-05-09T00:07:43.214 INFO:tasks.workunit.client.1.smithi135.stdout:8/988: dread d4/f2b [0,4194304] 0 2024-05-09T00:07:43.214 INFO:tasks.workunit.client.0.smithi026.stdout:1/339: truncate d5/dd/f34 1865601 0 2024-05-09T00:07:43.216 INFO:tasks.workunit.client.1.smithi135.stdout:2/939: unlink d1/d12/d20/d3b/d4f/cf6 0 2024-05-09T00:07:43.217 INFO:tasks.workunit.client.0.smithi026.stdout:8/344: mkdir de/d17/d21/d6f 0 2024-05-09T00:07:43.217 INFO:tasks.workunit.client.0.smithi026.stdout:8/345: fdatasync de/f13 0 2024-05-09T00:07:43.219 INFO:tasks.workunit.client.1.smithi135.stdout:6/997: rename d2/da/d49/da4/la7 to d2/da/d1d/d86/d11e/l149 0 2024-05-09T00:07:43.220 INFO:tasks.workunit.client.0.smithi026.stdout:6/264: mkdir d15/d1e/d23/d26/d58 0 2024-05-09T00:07:43.222 INFO:tasks.workunit.client.0.smithi026.stdout:7/457: truncate d8/d2e/d55/d1e/d3d/f5f 2789873 0 2024-05-09T00:07:43.223 INFO:tasks.workunit.client.1.smithi135.stdout:2/940: dread d1/d12/f8d [0,4194304] 0 2024-05-09T00:07:43.223 INFO:tasks.workunit.client.1.smithi135.stdout:0/921: symlink d3/dd/d3f/d3a/d46/l10f 0 2024-05-09T00:07:43.224 INFO:tasks.workunit.client.1.smithi135.stdout:0/922: truncate d3/dd/d3f/d43/f69 1006837 0 2024-05-09T00:07:43.224 INFO:tasks.workunit.client.1.smithi135.stdout:2/941: write d1/d12/d21/d41/d6d/d6e/fbf [2909145,25432] 0 2024-05-09T00:07:43.227 INFO:tasks.workunit.client.1.smithi135.stdout:1/942: link da/d24/d27/d33/d36/l8c da/d24/d27/d33/d48/l144 0 2024-05-09T00:07:43.230 INFO:tasks.workunit.client.0.smithi026.stdout:5/290: rmdir d2/d8/d31/d32/d48 39 2024-05-09T00:07:43.230 INFO:tasks.workunit.client.0.smithi026.stdout:5/291: chown d2/d8/c9 5653199 1 2024-05-09T00:07:43.230 INFO:tasks.workunit.client.0.smithi026.stdout:5/292: readlink d2/d8/d31/d24/l2d 0 2024-05-09T00:07:43.234 INFO:tasks.workunit.client.1.smithi135.stdout:4/884: link dc/d71/lad dc/d26/d31/db8/dd1/l123 0 2024-05-09T00:07:43.235 INFO:tasks.workunit.client.0.smithi026.stdout:4/292: creat d0/d12/f68 x:0 0 0 2024-05-09T00:07:43.236 INFO:tasks.workunit.client.1.smithi135.stdout:9/924: getdents d1/d1a/d10/d3c/d102 0 2024-05-09T00:07:43.236 INFO:tasks.workunit.client.1.smithi135.stdout:9/925: chown d1/d24/d44/d7f/cce 1728355 1 2024-05-09T00:07:43.237 INFO:tasks.workunit.client.1.smithi135.stdout:9/926: chown d1/d24/d44/lb4 0 1 2024-05-09T00:07:43.238 INFO:tasks.workunit.client.0.smithi026.stdout:1/340: rename d5/dd/d17/d29 to d5/dd/d17/d73 0 2024-05-09T00:07:43.238 INFO:tasks.workunit.client.0.smithi026.stdout:1/341: readlink d5/db/l6c 0 2024-05-09T00:07:43.239 INFO:tasks.workunit.client.0.smithi026.stdout:1/342: truncate d5/dd/d17/f2a 4577482 0 2024-05-09T00:07:43.240 INFO:tasks.workunit.client.1.smithi135.stdout:5/984: unlink db/d24/db0/fc1 0 2024-05-09T00:07:43.241 INFO:tasks.workunit.client.0.smithi026.stdout:8/346: mkdir de/d48/d70 0 2024-05-09T00:07:43.242 INFO:tasks.workunit.client.1.smithi135.stdout:8/989: mknod d4/d7/d2a/d9f/c14f 0 2024-05-09T00:07:43.243 INFO:tasks.workunit.client.0.smithi026.stdout:6/265: mknod d15/d1e/d23/c59 0 2024-05-09T00:07:43.244 INFO:tasks.workunit.client.0.smithi026.stdout:6/266: chown d15/d1e/d23/f4a 4331106 1 2024-05-09T00:07:43.244 INFO:tasks.workunit.client.0.smithi026.stdout:6/267: chown d15/d1e/d3d/d4c 285506 1 2024-05-09T00:07:43.244 INFO:tasks.workunit.client.0.smithi026.stdout:6/268: chown d15/l19 776461 1 2024-05-09T00:07:43.244 INFO:tasks.workunit.client.1.smithi135.stdout:5/985: write db/d5d/fb6 [944922,102179] 0 2024-05-09T00:07:43.245 INFO:tasks.workunit.client.1.smithi135.stdout:5/986: chown db/d5d/dac/ddc/dbf/de3/c126 247808 1 2024-05-09T00:07:43.245 INFO:tasks.workunit.client.1.smithi135.stdout:5/987: dread - db/d5d/dac/ddc/dbf/de3/ffc zero size 2024-05-09T00:07:43.245 INFO:tasks.workunit.client.1.smithi135.stdout:5/988: fdatasync db/d24/db0/dcd/d10e/f12b 0 2024-05-09T00:07:43.245 INFO:tasks.workunit.client.1.smithi135.stdout:5/989: fdatasync db/d84/d62/f99 0 2024-05-09T00:07:43.246 INFO:tasks.workunit.client.0.smithi026.stdout:5/293: rename d2/d8/d31/f1f to d2/d8/d31/d24/f62 0 2024-05-09T00:07:43.248 INFO:tasks.workunit.client.1.smithi135.stdout:0/923: dwrite d3/d9e/f8f [0,4194304] 0 2024-05-09T00:07:43.249 INFO:tasks.workunit.client.0.smithi026.stdout:1/343: creat d5/d16/d60/f74 x:0 0 0 2024-05-09T00:07:43.249 INFO:tasks.workunit.client.1.smithi135.stdout:2/942: getdents d1/d12/d27 0 2024-05-09T00:07:43.250 INFO:tasks.workunit.client.1.smithi135.stdout:6/998: dwrite d2/da/d1d/d69/dfc/f10f [0,4194304] 0 2024-05-09T00:07:43.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/347: creat de/d6c/d31/f71 x:0 0 0 2024-05-09T00:07:43.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/348: chown f7 589 1 2024-05-09T00:07:43.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/349: readlink de/l19 0 2024-05-09T00:07:43.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/350: write de/f1e [152275,58907] 0 2024-05-09T00:07:43.253 INFO:tasks.workunit.client.0.smithi026.stdout:7/458: dwrite d8/d5c/f7d [0,4194304] 0 2024-05-09T00:07:43.253 INFO:tasks.workunit.client.0.smithi026.stdout:7/459: write d8/d2e/d55/d22/f65 [1046273,34309] 0 2024-05-09T00:07:43.253 INFO:tasks.workunit.client.1.smithi135.stdout:0/924: read d3/dd/d3f/d43/f8e [3527177,97793] 0 2024-05-09T00:07:43.254 INFO:tasks.workunit.client.1.smithi135.stdout:0/925: write d3/dd/d2d/d4c/fe7 [927171,105846] 0 2024-05-09T00:07:43.254 INFO:tasks.workunit.client.0.smithi026.stdout:1/344: write d5/d16/f18 [260748,47039] 0 2024-05-09T00:07:43.255 INFO:tasks.workunit.client.0.smithi026.stdout:6/269: unlink d15/d2b/l2c 0 2024-05-09T00:07:43.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/943: symlink da/d14/d20/d38/d3a/d40/l145 0 2024-05-09T00:07:43.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/944: chown da/d24/d27/d33/cd4 630027 1 2024-05-09T00:07:43.255 INFO:tasks.workunit.client.1.smithi135.stdout:6/999: write d2/da/d49/da4/dce/dd8/d144/d7a/f8a [2980094,122882] 0 2024-05-09T00:07:43.260 INFO:tasks.workunit.client.0.smithi026.stdout:5/294: dwrite d2/d8/d31/d2e/d4a/f57 [0,4194304] 0 2024-05-09T00:07:43.260 INFO:tasks.workunit.client.0.smithi026.stdout:5/295: chown d2/d8/d31/d2e/d4a/f3c 112517265 1 2024-05-09T00:07:43.261 INFO:tasks.workunit.client.0.smithi026.stdout:4/293: rename d0/d19/f56 to d0/d19/d43/d58/f69 0 2024-05-09T00:07:43.264 INFO:tasks.workunit.client.0.smithi026.stdout:8/351: getdents de/d6c 0 2024-05-09T00:07:43.264 INFO:tasks.workunit.client.0.smithi026.stdout:8/352: stat de/d17/d21/d24/l58 0 2024-05-09T00:07:43.269 INFO:tasks.workunit.client.1.smithi135.stdout:4/885: rename dc/d4a/d69/d55 to dc/d26/d93/d124 0 2024-05-09T00:07:43.269 INFO:tasks.workunit.client.1.smithi135.stdout:9/927: symlink d1/da4/l12f 0 2024-05-09T00:07:43.269 INFO:tasks.workunit.client.1.smithi135.stdout:8/990: mkdir d4/dc6/d150 0 2024-05-09T00:07:43.270 INFO:tasks.workunit.client.1.smithi135.stdout:8/991: truncate d4/d7/de/d45/d76/de2/dc2/f145 933048 0 2024-05-09T00:07:43.271 INFO:tasks.workunit.client.1.smithi135.stdout:5/990: dread db/d84/d62/fed [0,4194304] 0 2024-05-09T00:07:43.274 INFO:tasks.workunit.client.0.smithi026.stdout:9/354: sync 2024-05-09T00:07:43.274 INFO:tasks.workunit.client.0.smithi026.stdout:3/296: sync 2024-05-09T00:07:43.276 INFO:tasks.workunit.client.1.smithi135.stdout:1/945: dwrite da/d73/f78 [4194304,4194304] 0 2024-05-09T00:07:43.278 INFO:tasks.workunit.client.0.smithi026.stdout:1/345: mkdir d5/db/d30/d75 0 2024-05-09T00:07:43.279 INFO:tasks.workunit.client.1.smithi135.stdout:2/943: symlink d1/d12/d20/d2b/d56/d72/l13f 0 2024-05-09T00:07:43.282 INFO:tasks.workunit.client.1.smithi135.stdout:8/992: dread d4/d8/f1e [0,4194304] 0 2024-05-09T00:07:43.282 INFO:tasks.workunit.client.1.smithi135.stdout:8/993: chown d4/d22/l69 26 1 2024-05-09T00:07:43.282 INFO:tasks.workunit.client.1.smithi135.stdout:8/994: stat d4/d7/de/d45/d76/f148 0 2024-05-09T00:07:43.282 INFO:tasks.workunit.client.0.smithi026.stdout:6/270: unlink d15/d1e/d30/f4f 0 2024-05-09T00:07:43.282 INFO:tasks.workunit.client.0.smithi026.stdout:6/271: readlink l0 0 2024-05-09T00:07:43.289 INFO:tasks.workunit.client.1.smithi135.stdout:0/926: symlink d3/dd/d3f/d43/da3/dea/l110 0 2024-05-09T00:07:43.293 INFO:tasks.workunit.client.1.smithi135.stdout:4/886: unlink dc/d26/df4/c66 0 2024-05-09T00:07:43.298 INFO:tasks.workunit.client.1.smithi135.stdout:5/991: rename db/d24/db0/f10a to db/d24/d32/dfa/d9c/d9f/f12e 0 2024-05-09T00:07:43.298 INFO:tasks.workunit.client.1.smithi135.stdout:1/946: getdents da/d14/d20/d38/d3a/d10d 0 2024-05-09T00:07:43.301 INFO:tasks.workunit.client.1.smithi135.stdout:2/944: rmdir d1/d12/d21/d57 39 2024-05-09T00:07:43.301 INFO:tasks.workunit.client.1.smithi135.stdout:2/945: chown d1/d12/d20/d3b/d105/d109 130478 1 2024-05-09T00:07:43.301 INFO:tasks.workunit.client.1.smithi135.stdout:2/946: chown d1/d12/d27 4183 1 2024-05-09T00:07:43.301 INFO:tasks.workunit.client.1.smithi135.stdout:2/947: chown d1/d12/d20/d2b/d7c/db5/f82 5594 1 2024-05-09T00:07:43.303 INFO:tasks.workunit.client.0.smithi026.stdout:4/294: truncate d0/d12/d1b/f3c 990030 0 2024-05-09T00:07:43.304 INFO:tasks.workunit.client.0.smithi026.stdout:6/272: dread d15/f18 [0,4194304] 0 2024-05-09T00:07:43.304 INFO:tasks.workunit.client.1.smithi135.stdout:5/992: truncate db/d24/d32/dfa/f83 7143372 0 2024-05-09T00:07:43.306 INFO:tasks.workunit.client.0.smithi026.stdout:8/353: creat de/d48/d3e/f72 x:0 0 0 2024-05-09T00:07:43.306 INFO:tasks.workunit.client.0.smithi026.stdout:6/273: write d15/d1e/d30/f46 [1694062,54053] 0 2024-05-09T00:07:43.306 INFO:tasks.workunit.client.0.smithi026.stdout:6/274: fdatasync d15/f1d 0 2024-05-09T00:07:43.306 INFO:tasks.workunit.client.1.smithi135.stdout:1/947: creat da/d14/d20/d38/d3a/d10d/d121/f146 x:0 0 0 2024-05-09T00:07:43.308 INFO:tasks.workunit.client.0.smithi026.stdout:9/355: unlink c1 0 2024-05-09T00:07:43.308 INFO:tasks.workunit.client.0.smithi026.stdout:9/356: dread - d7/d23/f84 zero size 2024-05-09T00:07:43.309 INFO:tasks.workunit.client.1.smithi135.stdout:2/948: mknod d1/d12/d27/c140 0 2024-05-09T00:07:43.310 INFO:tasks.workunit.client.0.smithi026.stdout:3/297: symlink d5/d1e/d3e/l61 0 2024-05-09T00:07:43.310 INFO:tasks.workunit.client.0.smithi026.stdout:3/298: write d5/d9/f16 [4665949,96143] 0 2024-05-09T00:07:43.311 INFO:tasks.workunit.client.0.smithi026.stdout:1/346: creat d5/d16/d60/d66/f76 x:0 0 0 2024-05-09T00:07:43.312 INFO:tasks.workunit.client.0.smithi026.stdout:5/296: mkdir d2/d8/d31/d63 0 2024-05-09T00:07:43.312 INFO:tasks.workunit.client.0.smithi026.stdout:5/297: fdatasync d2/d8/d2a/f4f 0 2024-05-09T00:07:43.313 INFO:tasks.workunit.client.1.smithi135.stdout:1/948: creat da/d14/d20/d38/d3a/f147 x:0 0 0 2024-05-09T00:07:43.313 INFO:tasks.workunit.client.1.smithi135.stdout:9/928: dwrite d1/d1a/d10/d3c/d5c/f63 [0,4194304] 0 2024-05-09T00:07:43.313 INFO:tasks.workunit.client.1.smithi135.stdout:9/929: write d1/d1a/d2c/f53 [8950532,53647] 0 2024-05-09T00:07:43.314 INFO:tasks.workunit.client.0.smithi026.stdout:8/354: mkdir de/d48/d73 0 2024-05-09T00:07:43.316 INFO:tasks.workunit.client.1.smithi135.stdout:2/949: mkdir d1/d12/d20/d2b/d56/d72/d141 0 2024-05-09T00:07:43.317 INFO:tasks.workunit.client.0.smithi026.stdout:7/460: dwrite d8/d2e/d55/d1e/f43 [0,4194304] 0 2024-05-09T00:07:43.319 INFO:tasks.workunit.client.1.smithi135.stdout:1/949: rename da/d24/d27/d33/d36/dfa/lff to da/d14/d5c/de0/l148 0 2024-05-09T00:07:43.320 INFO:tasks.workunit.client.1.smithi135.stdout:2/950: write d1/d12/d21/dc7/f132 [3863216,69934] 0 2024-05-09T00:07:43.321 INFO:tasks.workunit.client.0.smithi026.stdout:6/275: symlink d15/d1e/d30/d32/l5a 0 2024-05-09T00:07:43.323 INFO:tasks.workunit.client.0.smithi026.stdout:9/357: rmdir d7/d23/d29/d2e 39 2024-05-09T00:07:43.324 INFO:tasks.workunit.client.1.smithi135.stdout:5/993: dread db/d24/f2d [0,4194304] 0 2024-05-09T00:07:43.325 INFO:tasks.workunit.client.1.smithi135.stdout:8/995: dwrite d4/d7/d2a/d9f/ff9 [0,4194304] 0 2024-05-09T00:07:43.325 INFO:tasks.workunit.client.1.smithi135.stdout:9/930: creat d1/d1a/d89/f130 x:0 0 0 2024-05-09T00:07:43.325 INFO:tasks.workunit.client.1.smithi135.stdout:9/931: fdatasync d1/d1a/fe8 0 2024-05-09T00:07:43.325 INFO:tasks.workunit.client.1.smithi135.stdout:0/927: dwrite d3/dd/d2d/db5/df4/fa8 [0,4194304] 0 2024-05-09T00:07:43.326 INFO:tasks.workunit.client.0.smithi026.stdout:4/295: dwrite d0/d12/f62 [0,4194304] 0 2024-05-09T00:07:43.326 INFO:tasks.workunit.client.1.smithi135.stdout:4/887: dwrite dc/d26/f4f [0,4194304] 0 2024-05-09T00:07:43.326 INFO:tasks.workunit.client.1.smithi135.stdout:0/928: write d3/dd/d3f/f5b [4065706,111794] 0 2024-05-09T00:07:43.327 INFO:tasks.workunit.client.0.smithi026.stdout:4/296: dread d0/d12/d34/f38 [0,4194304] 0 2024-05-09T00:07:43.327 INFO:tasks.workunit.client.0.smithi026.stdout:3/299: symlink d5/d9/dc/d28/d45/l62 0 2024-05-09T00:07:43.328 INFO:tasks.workunit.client.0.smithi026.stdout:2/247: sync 2024-05-09T00:07:43.329 INFO:tasks.workunit.client.1.smithi135.stdout:1/950: link da/d14/d20/d38/f8e da/d24/d27/d33/d52/d12a/f149 0 2024-05-09T00:07:43.331 INFO:tasks.workunit.client.0.smithi026.stdout:1/347: creat d5/db/f77 x:0 0 0 2024-05-09T00:07:43.334 INFO:tasks.workunit.client.0.smithi026.stdout:1/348: write d5/dd/fe [3123823,24594] 0 2024-05-09T00:07:43.335 INFO:tasks.workunit.client.0.smithi026.stdout:5/298: creat d2/d8/d31/d2e/d4a/f64 x:0 0 0 2024-05-09T00:07:43.337 INFO:tasks.workunit.client.0.smithi026.stdout:8/355: creat de/d6c/d31/f74 x:0 0 0 2024-05-09T00:07:43.337 INFO:tasks.workunit.client.0.smithi026.stdout:8/356: dread - de/d6c/d31/f71 zero size 2024-05-09T00:07:43.337 INFO:tasks.workunit.client.0.smithi026.stdout:8/357: fsync de/f16 0 2024-05-09T00:07:43.339 INFO:tasks.workunit.client.1.smithi135.stdout:5/994: creat db/d5d/deb/f12f x:0 0 0 2024-05-09T00:07:43.340 INFO:tasks.workunit.client.1.smithi135.stdout:4/888: dread dc/d26/d93/d124/d6d/f94 [0,4194304] 0 2024-05-09T00:07:43.341 INFO:tasks.workunit.client.0.smithi026.stdout:1/349: dread d5/dd/d1f/f21 [4194304,4194304] 0 2024-05-09T00:07:43.342 INFO:tasks.workunit.client.0.smithi026.stdout:7/461: rename d8/f56 to d8/d2e/d55/d1e/d3d/d6b/fa3 0 2024-05-09T00:07:43.342 INFO:tasks.workunit.client.0.smithi026.stdout:0/428: sync 2024-05-09T00:07:43.343 INFO:tasks.workunit.client.0.smithi026.stdout:6/276: symlink d15/d41/l5b 0 2024-05-09T00:07:43.344 INFO:tasks.workunit.client.0.smithi026.stdout:6/277: write d15/d1e/d23/f24 [1242798,50352] 0 2024-05-09T00:07:43.344 INFO:tasks.workunit.client.1.smithi135.stdout:8/996: mkdir d4/d8/da2/da6/dde/dfb/d139/d149/d151 0 2024-05-09T00:07:43.350 INFO:tasks.workunit.client.0.smithi026.stdout:9/358: mknod d7/d23/d29/d31/d40/d41/d54/d5c/d66/c89 0 2024-05-09T00:07:43.350 INFO:tasks.workunit.client.0.smithi026.stdout:9/359: write d7/d23/f37 [1362537,38929] 0 2024-05-09T00:07:43.350 INFO:tasks.workunit.client.0.smithi026.stdout:1/350: write d5/db/f1e [1731108,84599] 0 2024-05-09T00:07:43.350 INFO:tasks.workunit.client.0.smithi026.stdout:2/248: dwrite d14/d15/f39 [4194304,4194304] 0 2024-05-09T00:07:43.350 INFO:tasks.workunit.client.0.smithi026.stdout:2/249: fsync f2 0 2024-05-09T00:07:43.350 INFO:tasks.workunit.client.0.smithi026.stdout:6/278: fdatasync d15/d1e/d30/f46 0 2024-05-09T00:07:43.351 INFO:tasks.workunit.client.0.smithi026.stdout:6/279: fsync d15/f1d 0 2024-05-09T00:07:43.351 INFO:tasks.workunit.client.1.smithi135.stdout:9/932: creat d1/d24/d86/d97/dec/f131 x:0 0 0 2024-05-09T00:07:43.353 INFO:tasks.workunit.client.0.smithi026.stdout:3/300: mkdir d5/d9/dc/d28/d63 0 2024-05-09T00:07:43.354 INFO:tasks.workunit.client.0.smithi026.stdout:3/301: write d5/d9/dc/f18 [5082564,55332] 0 2024-05-09T00:07:43.358 INFO:tasks.workunit.client.0.smithi026.stdout:8/358: mknod de/d17/d6a/c75 0 2024-05-09T00:07:43.358 INFO:tasks.workunit.client.0.smithi026.stdout:8/359: write de/d48/d3e/f72 [475250,45472] 0 2024-05-09T00:07:43.358 INFO:tasks.workunit.client.0.smithi026.stdout:8/360: write de/d6c/d31/f74 [257963,7328] 0 2024-05-09T00:07:43.359 INFO:tasks.workunit.client.1.smithi135.stdout:0/929: mkdir d3/dd/d2d/d4c/dee/d111 0 2024-05-09T00:07:43.359 INFO:tasks.workunit.client.1.smithi135.stdout:0/930: fsync d3/dd/d2d/db5/df4/fa8 0 2024-05-09T00:07:43.359 INFO:tasks.workunit.client.1.smithi135.stdout:0/931: chown d3/d64/c8c 8624 1 2024-05-09T00:07:43.359 INFO:tasks.workunit.client.0.smithi026.stdout:4/297: rename d0/d12/d1b/d2b/f2d to d0/d19/d43/d58/f6a 0 2024-05-09T00:07:43.360 INFO:tasks.workunit.client.1.smithi135.stdout:0/932: write d3/dd/d3f/d3a/f4a [932631,112567] 0 2024-05-09T00:07:43.361 INFO:tasks.workunit.client.1.smithi135.stdout:1/951: mknod da/d24/c14a 0 2024-05-09T00:07:43.380 INFO:tasks.workunit.client.0.smithi026.stdout:6/280: dwrite f1 [0,4194304] 0 2024-05-09T00:07:43.380 INFO:tasks.workunit.client.0.smithi026.stdout:6/281: fsync d15/d1e/d3d/d4c/f40 0 2024-05-09T00:07:43.387 INFO:tasks.workunit.client.1.smithi135.stdout:0/933: dwrite d3/dd/d2d/f6e [0,4194304] 0 2024-05-09T00:07:43.389 INFO:tasks.workunit.client.0.smithi026.stdout:8/361: dwrite f7 [4194304,4194304] 0 2024-05-09T00:07:43.400 INFO:tasks.workunit.client.0.smithi026.stdout:7/462: mknod d8/d2e/d55/d1e/d3d/ca4 0 2024-05-09T00:07:43.400 INFO:tasks.workunit.client.0.smithi026.stdout:7/463: stat d8/d2e/d55 0 2024-05-09T00:07:43.402 INFO:tasks.workunit.client.0.smithi026.stdout:0/429: creat d1d/d25/d47/d6e/f8e x:0 0 0 2024-05-09T00:07:43.403 INFO:tasks.workunit.client.1.smithi135.stdout:5/995: getdents db/d24/d32/dfa/dbe 0 2024-05-09T00:07:43.403 INFO:tasks.workunit.client.1.smithi135.stdout:5/996: stat db/c1f 0 2024-05-09T00:07:43.418 INFO:tasks.workunit.client.0.smithi026.stdout:7/464: dwrite d8/d2e/d55/f52 [0,4194304] 0 2024-05-09T00:07:43.418 INFO:tasks.workunit.client.0.smithi026.stdout:7/465: getdents d8/d2e/d55/d1e/d8a 0 2024-05-09T00:07:43.477 INFO:tasks.workunit.client.1.smithi135.stdout:4/889: unlink dc/d26/d31/f9a 0 2024-05-09T00:07:43.479 INFO:tasks.workunit.client.1.smithi135.stdout:8/997: rmdir d4/d8/da2 39 2024-05-09T00:07:43.482 INFO:tasks.workunit.client.1.smithi135.stdout:9/933: unlink d1/da4/l12f 0 2024-05-09T00:07:43.487 INFO:tasks.workunit.client.0.smithi026.stdout:1/351: mknod d5/d16/d60/d66/c78 0 2024-05-09T00:07:43.487 INFO:tasks.workunit.client.0.smithi026.stdout:1/352: write d5/dd/f68 [826112,43757] 0 2024-05-09T00:07:43.490 INFO:tasks.workunit.client.1.smithi135.stdout:2/951: truncate d1/d12/d21/dc7/f132 2374478 0 2024-05-09T00:07:43.491 INFO:tasks.workunit.client.1.smithi135.stdout:1/952: mkdir da/db/d70/d14b 0 2024-05-09T00:07:43.494 INFO:tasks.workunit.client.0.smithi026.stdout:2/250: mknod d14/d15/d3b/d40/d47/c5d 0 2024-05-09T00:07:43.494 INFO:tasks.workunit.client.0.smithi026.stdout:2/251: chown d14/d15/d3b/f3f 134486 1 2024-05-09T00:07:43.498 INFO:tasks.workunit.client.0.smithi026.stdout:2/252: dread d14/d15/f1b [0,4194304] 0 2024-05-09T00:07:43.498 INFO:tasks.workunit.client.0.smithi026.stdout:2/253: stat d14/d15/d17 0 2024-05-09T00:07:43.498 INFO:tasks.workunit.client.0.smithi026.stdout:2/254: write fb [4342279,24695] 0 2024-05-09T00:07:43.499 INFO:tasks.workunit.client.0.smithi026.stdout:5/299: rename d2/d8/d31/d2e/d4a/f57 to d2/d8/d31/d24/f65 0 2024-05-09T00:07:43.502 INFO:tasks.workunit.client.1.smithi135.stdout:0/934: mkdir d3/d112 0 2024-05-09T00:07:43.502 INFO:tasks.workunit.client.1.smithi135.stdout:0/935: truncate d3/d64/fac 149015 0 2024-05-09T00:07:43.505 INFO:tasks.workunit.client.0.smithi026.stdout:4/298: creat d0/d19/d43/d58/f6b x:0 0 0 2024-05-09T00:07:43.505 INFO:tasks.workunit.client.0.smithi026.stdout:4/299: chown d0/lf 56916 1 2024-05-09T00:07:43.507 INFO:tasks.workunit.client.1.smithi135.stdout:5/997: creat db/d24/d32/dfa/d9c/d9f/dc0/f130 x:0 0 0 2024-05-09T00:07:43.510 INFO:tasks.workunit.client.1.smithi135.stdout:4/890: getdents dc/d71/d90 0 2024-05-09T00:07:43.510 INFO:tasks.workunit.client.1.smithi135.stdout:1/953: dread da/d24/d27/d33/fb0 [0,4194304] 0 2024-05-09T00:07:43.510 INFO:tasks.workunit.client.1.smithi135.stdout:4/891: write dc/d26/f4f [5057027,20930] 0 2024-05-09T00:07:43.513 INFO:tasks.workunit.client.1.smithi135.stdout:8/998: mknod d4/d7/de/c152 0 2024-05-09T00:07:43.514 INFO:tasks.workunit.client.0.smithi026.stdout:6/282: mkdir d15/d1e/d23/d26/d58/d5c 0 2024-05-09T00:07:43.514 INFO:tasks.workunit.client.0.smithi026.stdout:6/283: dread - d15/d1e/d23/f4a zero size 2024-05-09T00:07:43.514 INFO:tasks.workunit.client.0.smithi026.stdout:6/284: stat d15/d2b/f3e 0 2024-05-09T00:07:43.515 INFO:tasks.workunit.client.1.smithi135.stdout:2/952: dwrite d1/d12/d21/d57/f6c [0,4194304] 0 2024-05-09T00:07:43.518 INFO:tasks.workunit.client.0.smithi026.stdout:0/430: link d1d/d1e/d20/d51/f86 d1d/d1e/d2d/f8f 0 2024-05-09T00:07:43.518 INFO:tasks.workunit.client.0.smithi026.stdout:0/431: truncate d1d/d25/d47/f5a 1562690 0 2024-05-09T00:07:43.519 INFO:tasks.workunit.client.0.smithi026.stdout:0/432: write f5 [806341,25086] 0 2024-05-09T00:07:43.519 INFO:tasks.workunit.client.0.smithi026.stdout:0/433: readlink d1d/d1e/d20/d4d/l8c 0 2024-05-09T00:07:43.521 INFO:tasks.workunit.client.0.smithi026.stdout:2/255: dwrite d14/d15/d1f/f28 [0,4194304] 0 2024-05-09T00:07:43.525 INFO:tasks.workunit.client.0.smithi026.stdout:7/466: creat d8/d2e/d55/fa5 x:0 0 0 2024-05-09T00:07:43.525 INFO:tasks.workunit.client.0.smithi026.stdout:7/467: fdatasync d8/d5c/f99 0 2024-05-09T00:07:43.526 INFO:tasks.workunit.client.1.smithi135.stdout:5/998: dwrite db/d84/d31/f3d [0,4194304] 0 2024-05-09T00:07:43.527 INFO:tasks.workunit.client.1.smithi135.stdout:5/999: write db/f7f [4634850,2465] 0 2024-05-09T00:07:43.534 INFO:tasks.workunit.client.0.smithi026.stdout:2/256: dwrite d14/d22/f33 [0,4194304] 0 2024-05-09T00:07:43.536 INFO:tasks.workunit.client.0.smithi026.stdout:2/257: write d14/d22/d55/f56 [3432142,93234] 0 2024-05-09T00:07:43.537 INFO:tasks.workunit.client.0.smithi026.stdout:9/360: mknod d7/c8a 0 2024-05-09T00:07:43.538 INFO:tasks.workunit.client.0.smithi026.stdout:1/353: symlink d5/dd/d1f/d39/l79 0 2024-05-09T00:07:43.542 INFO:tasks.workunit.client.0.smithi026.stdout:5/300: symlink d2/d8/d31/d2e/d4a/l66 0 2024-05-09T00:07:43.545 INFO:tasks.workunit.client.0.smithi026.stdout:1/354: dread d5/dd/fe [0,4194304] 0 2024-05-09T00:07:43.546 INFO:tasks.workunit.client.0.smithi026.stdout:4/300: rename d0/d12/d1b/l27 to d0/d19/d43/l6c 0 2024-05-09T00:07:43.546 INFO:tasks.workunit.client.0.smithi026.stdout:4/301: getdents d0/d12/d67 0 2024-05-09T00:07:43.550 INFO:tasks.workunit.client.0.smithi026.stdout:0/434: creat d1d/d1e/d20/d51/f90 x:0 0 0 2024-05-09T00:07:43.550 INFO:tasks.workunit.client.0.smithi026.stdout:0/435: getdents d1d/d1e/d20/d4d/d58/d62/d78/d80 0 2024-05-09T00:07:43.554 INFO:tasks.workunit.client.1.smithi135.stdout:0/936: mknod d3/dd/d3f/d3a/d46/c113 0 2024-05-09T00:07:43.554 INFO:tasks.workunit.client.1.smithi135.stdout:4/892: mkdir dc/d71/d125 0 2024-05-09T00:07:43.554 INFO:tasks.workunit.client.1.smithi135.stdout:4/893: chown dc/d71/d90/fde 8372501 1 2024-05-09T00:07:43.556 INFO:tasks.workunit.client.0.smithi026.stdout:9/361: getdents d7/d23/d29/d31/d40/d41 0 2024-05-09T00:07:43.556 INFO:tasks.workunit.client.0.smithi026.stdout:9/362: dread - d7/d23/d2f/f79 zero size 2024-05-09T00:07:43.558 INFO:tasks.workunit.client.0.smithi026.stdout:5/301: unlink d2/d8/c9 0 2024-05-09T00:07:43.559 INFO:tasks.workunit.client.1.smithi135.stdout:2/953: symlink d1/d12/d20/d3b/d105/l142 0 2024-05-09T00:07:43.560 INFO:tasks.workunit.client.0.smithi026.stdout:1/355: creat d5/dd/d17/d73/f7a x:0 0 0 2024-05-09T00:07:43.565 INFO:tasks.workunit.client.0.smithi026.stdout:6/285: rename d15/d1e/d30/f35 to d15/d1e/d23/d26/d58/d5c/f5d 0 2024-05-09T00:07:43.565 INFO:tasks.workunit.client.0.smithi026.stdout:6/286: fsync fa 0 2024-05-09T00:07:43.565 INFO:tasks.workunit.client.0.smithi026.stdout:6/287: write d15/d1e/d3d/d4c/f40 [1226374,125516] 0 2024-05-09T00:07:43.566 INFO:tasks.workunit.client.0.smithi026.stdout:8/362: truncate f9 82383 0 2024-05-09T00:07:43.567 INFO:tasks.workunit.client.0.smithi026.stdout:4/302: truncate d0/d12/d1b/f3c 870968 0 2024-05-09T00:07:43.567 INFO:tasks.workunit.client.0.smithi026.stdout:4/303: chown d0/d19/d43/l65 533439 1 2024-05-09T00:07:43.567 INFO:tasks.workunit.client.1.smithi135.stdout:4/894: dwrite dc/d26/d93/d124/d5f/f84 [0,4194304] 0 2024-05-09T00:07:43.571 INFO:tasks.workunit.client.1.smithi135.stdout:0/937: mkdir d3/dd/d2d/db5/df4/d103/d114 0 2024-05-09T00:07:43.574 INFO:tasks.workunit.client.1.smithi135.stdout:2/954: mknod d1/d12/d21/d41/d6d/d6e/c143 0 2024-05-09T00:07:43.575 INFO:tasks.workunit.client.0.smithi026.stdout:2/258: truncate f2 1020269 0 2024-05-09T00:07:43.576 INFO:tasks.workunit.client.0.smithi026.stdout:9/363: readlink d7/l18 0 2024-05-09T00:07:43.576 INFO:tasks.workunit.client.0.smithi026.stdout:9/364: readlink d7/d26/l2d 0 2024-05-09T00:07:43.576 INFO:tasks.workunit.client.0.smithi026.stdout:9/365: truncate d7/d23/d29/d31/d40/f48 397861 0 2024-05-09T00:07:43.579 INFO:tasks.workunit.client.1.smithi135.stdout:4/895: creat dc/d71/d90/d11e/f126 x:0 0 0 2024-05-09T00:07:43.583 INFO:tasks.workunit.client.0.smithi026.stdout:5/302: creat d2/d8/d31/d32/d5c/f67 x:0 0 0 2024-05-09T00:07:43.583 INFO:tasks.workunit.client.0.smithi026.stdout:1/356: mkdir d5/dd/d17/d7b 0 2024-05-09T00:07:43.586 INFO:tasks.workunit.client.1.smithi135.stdout:2/955: rename d1/d12/d21/d57/d10b/lbc to d1/d12/d20/d2b/d7c/l144 0 2024-05-09T00:07:43.587 INFO:tasks.workunit.client.1.smithi135.stdout:0/938: dwrite d3/dd/d2d/d4c/d84/ff0 [0,4194304] 0 2024-05-09T00:07:43.589 INFO:tasks.workunit.client.0.smithi026.stdout:7/468: rename d8/d2e/d55/d22/d29/f39 to d8/d1b/d89/fa6 0 2024-05-09T00:07:43.590 INFO:tasks.workunit.client.0.smithi026.stdout:7/469: read d8/d2e/d55/d1e/f32 [2436461,55655] 0 2024-05-09T00:07:43.591 INFO:tasks.workunit.client.0.smithi026.stdout:6/288: mkdir d15/d2b/d33/d55/d5e 0 2024-05-09T00:07:43.592 INFO:tasks.workunit.client.0.smithi026.stdout:9/366: dwrite d7/f19 [8388608,4194304] 0 2024-05-09T00:07:43.592 INFO:tasks.workunit.client.0.smithi026.stdout:9/367: read d7/f4e [29168,3370] 0 2024-05-09T00:07:43.593 INFO:tasks.workunit.client.0.smithi026.stdout:8/363: truncate de/d17/d21/d24/d3b/d3d/f40 509986 0 2024-05-09T00:07:43.596 INFO:tasks.workunit.client.0.smithi026.stdout:4/304: truncate d0/d12/d1b/f26 529372 0 2024-05-09T00:07:43.596 INFO:tasks.workunit.client.0.smithi026.stdout:4/305: truncate d0/d19/d43/d49/f54 609501 0 2024-05-09T00:07:43.599 INFO:tasks.workunit.client.1.smithi135.stdout:0/939: unlink d3/dd/l92 0 2024-05-09T00:07:43.600 INFO:tasks.workunit.client.1.smithi135.stdout:0/940: chown d3/dd/d3f/d29/f9c 1 1 2024-05-09T00:07:43.601 INFO:tasks.workunit.client.1.smithi135.stdout:0/941: read d3/fda [2260127,12622] 0 2024-05-09T00:07:43.601 INFO:tasks.workunit.client.1.smithi135.stdout:0/942: chown d3/f79 3 1 2024-05-09T00:07:43.601 INFO:tasks.workunit.client.0.smithi026.stdout:0/436: dread d1d/d25/d3c/d5f/f72 [0,4194304] 0 2024-05-09T00:07:43.603 INFO:tasks.workunit.client.0.smithi026.stdout:7/470: dread f5 [4194304,4194304] 0 2024-05-09T00:07:43.604 INFO:tasks.workunit.client.0.smithi026.stdout:7/471: chown d8/d5c/d9a/f9c 0 1 2024-05-09T00:07:43.604 INFO:tasks.workunit.client.0.smithi026.stdout:5/303: creat d2/d8/d31/d2e/d33/f68 x:0 0 0 2024-05-09T00:07:43.604 INFO:tasks.workunit.client.0.smithi026.stdout:5/304: stat d2/d8/d31/d2e/d35/c38 0 2024-05-09T00:07:43.605 INFO:tasks.workunit.client.1.smithi135.stdout:0/943: creat d3/dd/d3f/d58/f115 x:0 0 0 2024-05-09T00:07:43.607 INFO:tasks.workunit.client.0.smithi026.stdout:1/357: creat d5/dd/d1f/f7c x:0 0 0 2024-05-09T00:07:43.607 INFO:tasks.workunit.client.1.smithi135.stdout:2/956: dwrite d1/d12/d20/d2b/d56/ddd/f12e [0,4194304] 0 2024-05-09T00:07:43.607 INFO:tasks.workunit.client.1.smithi135.stdout:4/896: dwrite dc/d26/d31/f100 [0,4194304] 0 2024-05-09T00:07:43.610 INFO:tasks.workunit.client.1.smithi135.stdout:0/944: unlink d3/dd/d3f/d43/da3/fde 0 2024-05-09T00:07:43.616 INFO:tasks.workunit.client.0.smithi026.stdout:8/364: mkdir de/d6c/d31/d4f/d76 0 2024-05-09T00:07:43.621 INFO:tasks.workunit.client.0.smithi026.stdout:0/437: symlink d1d/d25/d47/d6e/l91 0 2024-05-09T00:07:43.622 INFO:tasks.workunit.client.1.smithi135.stdout:0/945: mkdir d3/dd/d3f/d29/d116 0 2024-05-09T00:07:43.623 INFO:tasks.workunit.client.0.smithi026.stdout:7/472: mknod d8/ca7 0 2024-05-09T00:07:43.624 INFO:tasks.workunit.client.0.smithi026.stdout:5/305: getdents d2/d8/d31/d32 0 2024-05-09T00:07:43.626 INFO:tasks.workunit.client.0.smithi026.stdout:0/438: dread d1d/d33/f3a [0,4194304] 0 2024-05-09T00:07:43.626 INFO:tasks.workunit.client.0.smithi026.stdout:0/439: chown d1d/d25/d3c 0 1 2024-05-09T00:07:43.626 INFO:tasks.workunit.client.1.smithi135.stdout:9/934: sync 2024-05-09T00:07:43.627 INFO:tasks.workunit.client.1.smithi135.stdout:0/946: mkdir d3/dd/d2d/db5/df4/d117 0 2024-05-09T00:07:43.629 INFO:tasks.workunit.client.0.smithi026.stdout:2/259: rename d14/d15/d30/c44 to d14/d15/d1f/c5e 0 2024-05-09T00:07:43.630 INFO:tasks.workunit.client.0.smithi026.stdout:8/365: creat de/d17/d6a/f77 x:0 0 0 2024-05-09T00:07:43.632 INFO:tasks.workunit.client.0.smithi026.stdout:1/358: dread d5/f7 [0,4194304] 0 2024-05-09T00:07:43.632 INFO:tasks.workunit.client.0.smithi026.stdout:6/289: dwrite d15/d1e/d23/d26/f27 [0,4194304] 0 2024-05-09T00:07:43.632 INFO:tasks.workunit.client.0.smithi026.stdout:1/359: readlink d5/db/l44 0 2024-05-09T00:07:43.632 INFO:tasks.workunit.client.1.smithi135.stdout:9/935: mknod d1/d24/d44/d54/c132 0 2024-05-09T00:07:43.632 INFO:tasks.workunit.client.1.smithi135.stdout:8/999: dwrite d4/d7/de/d45/fc8 [0,4194304] 0 2024-05-09T00:07:43.633 INFO:tasks.workunit.client.1.smithi135.stdout:4/897: dwrite dc/d26/df4/fc5 [0,4194304] 0 2024-05-09T00:07:43.633 INFO:tasks.workunit.client.0.smithi026.stdout:4/306: dwrite d0/f2 [4194304,4194304] 0 2024-05-09T00:07:43.633 INFO:tasks.workunit.client.0.smithi026.stdout:5/306: mknod d2/d8/d31/d24/c69 0 2024-05-09T00:07:43.634 INFO:tasks.workunit.client.0.smithi026.stdout:5/307: fdatasync d2/d8/d2a/f4f 0 2024-05-09T00:07:43.634 INFO:tasks.workunit.client.0.smithi026.stdout:5/308: readlink d2/d8/d31/d2e/d35/l3b 0 2024-05-09T00:07:43.634 INFO:tasks.workunit.client.0.smithi026.stdout:5/309: dread - d2/f60 zero size 2024-05-09T00:07:43.637 INFO:tasks.workunit.client.1.smithi135.stdout:1/954: sync 2024-05-09T00:07:43.637 INFO:tasks.workunit.client.1.smithi135.stdout:0/947: link d3/dd/d3f/d3a/da4/dc1/cd8 d3/dd/d3f/d58/dae/dd3/c118 0 2024-05-09T00:07:43.640 INFO:tasks.workunit.client.0.smithi026.stdout:9/368: rename d7/d23/d29/d31/d40/l80 to d7/d23/d76/l8b 0 2024-05-09T00:07:43.640 INFO:tasks.workunit.client.0.smithi026.stdout:9/369: chown d7/d23/d29/d31/d40/d41/d54/d5c/f7a 35 1 2024-05-09T00:07:43.640 INFO:tasks.workunit.client.0.smithi026.stdout:9/370: chown d7/d23/d29/d31/d40/l70 7446 1 2024-05-09T00:07:43.641 INFO:tasks.workunit.client.1.smithi135.stdout:9/936: mknod d1/d24/d44/dfe/c133 0 2024-05-09T00:07:43.641 INFO:tasks.workunit.client.1.smithi135.stdout:9/937: chown d1/d1a/d2c/d2d/de6/d6e 118646895 1 2024-05-09T00:07:43.642 INFO:tasks.workunit.client.0.smithi026.stdout:0/440: dwrite d1d/d1e/d20/f68 [0,4194304] 0 2024-05-09T00:07:43.642 INFO:tasks.workunit.client.0.smithi026.stdout:8/366: creat de/d6c/f78 x:0 0 0 2024-05-09T00:07:43.643 INFO:tasks.workunit.client.0.smithi026.stdout:8/367: write de/d17/d21/d24/d3b/d3d/f51 [1473808,109142] 0 2024-05-09T00:07:43.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:41.609629+0000 mgr.smithi135.kkrhgf (mgr.24419) 53 : audit [DBG] from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:43.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:43 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:41.907051+0000 mgr.smithi135.kkrhgf (mgr.24419) 54 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 115 MiB/s rd, 246 MiB/s wr, 370 op/s 2024-05-09T00:07:43.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:41.609629+0000 mgr.smithi135.kkrhgf (mgr.24419) 53 : audit [DBG] from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:07:43.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:41.907051+0000 mgr.smithi135.kkrhgf (mgr.24419) 54 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 115 MiB/s rd, 246 MiB/s wr, 370 op/s 2024-05-09T00:07:43.651 INFO:tasks.workunit.client.0.smithi026.stdout:1/360: rmdir d5/dd/d17 39 2024-05-09T00:07:43.651 INFO:tasks.workunit.client.0.smithi026.stdout:1/361: write d5/dd/d17/d73/f7a [880143,127014] 0 2024-05-09T00:07:43.654 INFO:tasks.workunit.client.0.smithi026.stdout:6/290: symlink d15/d1e/l5f 0 2024-05-09T00:07:43.654 INFO:tasks.workunit.client.0.smithi026.stdout:6/291: chown d15/d1e/d30/l57 28842529 1 2024-05-09T00:07:43.655 INFO:tasks.workunit.client.1.smithi135.stdout:4/898: mknod dc/d26/d93/d124/dc9/c127 0 2024-05-09T00:07:43.658 INFO:tasks.workunit.client.1.smithi135.stdout:0/948: symlink d3/dd/d2d/d4c/d84/l119 0 2024-05-09T00:07:43.659 INFO:tasks.workunit.client.1.smithi135.stdout:0/949: dread d3/d9e/ffc [4194304,4194304] 0 2024-05-09T00:07:43.660 INFO:tasks.workunit.client.1.smithi135.stdout:0/950: readlink d3/dd/d3f/d43/l101 0 2024-05-09T00:07:43.660 INFO:tasks.workunit.client.1.smithi135.stdout:4/899: read dc/d4a/d69/f51 [2664915,100654] 0 2024-05-09T00:07:43.660 INFO:tasks.workunit.client.0.smithi026.stdout:4/307: dread d0/d19/d43/d49/f5a [0,4194304] 0 2024-05-09T00:07:43.662 INFO:tasks.workunit.client.1.smithi135.stdout:9/938: symlink d1/d24/d44/d7f/da2/dca/l134 0 2024-05-09T00:07:43.662 INFO:tasks.workunit.client.1.smithi135.stdout:9/939: chown d1/d1a/d10/d3c/l9a 195616345 1 2024-05-09T00:07:43.662 INFO:tasks.workunit.client.1.smithi135.stdout:9/940: chown d1/d1a/d10 1006306 1 2024-05-09T00:07:43.662 INFO:tasks.workunit.client.1.smithi135.stdout:0/951: dread d3/dd/d2d/db5/df4/fa5 [0,4194304] 0 2024-05-09T00:07:43.665 INFO:tasks.workunit.client.0.smithi026.stdout:7/473: rename d8/d2e/d55/d1e/d3d/f51 to d8/d1b/d8f/fa8 0 2024-05-09T00:07:43.667 INFO:tasks.workunit.client.1.smithi135.stdout:9/941: dread d1/d1a/d2c/f11 [0,4194304] 0 2024-05-09T00:07:43.667 INFO:tasks.workunit.client.1.smithi135.stdout:4/900: rename dc/d4a/d8c/ce0 to dc/d26/d93/d124/d6d/c128 0 2024-05-09T00:07:43.667 INFO:tasks.workunit.client.1.smithi135.stdout:4/901: fsync dc/d4a/d69/f51 0 2024-05-09T00:07:43.669 INFO:tasks.workunit.client.1.smithi135.stdout:0/952: mknod d3/dd/d3f/d43/c11a 0 2024-05-09T00:07:43.670 INFO:tasks.workunit.client.0.smithi026.stdout:0/441: symlink d1d/d1e/d2d/l92 0 2024-05-09T00:07:43.672 INFO:tasks.workunit.client.1.smithi135.stdout:9/942: rename d1/d1a/d89/dad/de3/ffa to d1/d1a/d89/d99/f135 0 2024-05-09T00:07:43.673 INFO:tasks.workunit.client.1.smithi135.stdout:1/955: dwrite da/d24/d27/d33/d52/f56 [0,4194304] 0 2024-05-09T00:07:43.673 INFO:tasks.workunit.client.1.smithi135.stdout:1/956: fdatasync da/d14/d20/d38/d3a/db7/de9/dfd/f11e 0 2024-05-09T00:07:43.674 INFO:tasks.workunit.client.0.smithi026.stdout:4/308: dwrite d0/d12/d1b/d2b/f3f [0,4194304] 0 2024-05-09T00:07:43.676 INFO:tasks.workunit.client.0.smithi026.stdout:8/368: rmdir de/d6c/d31/d4f/d76 0 2024-05-09T00:07:43.677 INFO:tasks.workunit.client.1.smithi135.stdout:9/943: mkdir d1/d24/d44/daf/d136 0 2024-05-09T00:07:43.678 INFO:tasks.workunit.client.0.smithi026.stdout:1/362: symlink d5/dd/d17/d7b/l7d 0 2024-05-09T00:07:43.680 INFO:tasks.workunit.client.1.smithi135.stdout:4/902: dread dc/d26/d4e/f56 [4194304,4194304] 0 2024-05-09T00:07:43.680 INFO:tasks.workunit.client.1.smithi135.stdout:4/903: truncate dc/d71/d90/fea 241184 0 2024-05-09T00:07:43.683 INFO:tasks.workunit.client.1.smithi135.stdout:0/953: dread d3/dd/d2d/d4c/d84/fc7 [0,4194304] 0 2024-05-09T00:07:43.683 INFO:tasks.workunit.client.0.smithi026.stdout:5/310: dwrite d2/d8/d31/f30 [0,4194304] 0 2024-05-09T00:07:43.683 INFO:tasks.workunit.client.0.smithi026.stdout:6/292: dwrite d15/d1e/d23/d26/d58/d5c/f5d [0,4194304] 0 2024-05-09T00:07:43.684 INFO:tasks.workunit.client.1.smithi135.stdout:1/957: rename da/d14/d20/d38/d3a/db7/fe5 to da/d24/d27/d33/d52/d71/f14c 0 2024-05-09T00:07:43.684 INFO:tasks.workunit.client.0.smithi026.stdout:2/260: rename d14/d15/d17/d5a to d14/d15/d1f/d4f/d5f 0 2024-05-09T00:07:43.684 INFO:tasks.workunit.client.0.smithi026.stdout:2/261: fdatasync d14/d15/d1f/f28 0 2024-05-09T00:07:43.684 INFO:tasks.workunit.client.0.smithi026.stdout:2/262: readlink d14/d15/d1f/l54 0 2024-05-09T00:07:43.685 INFO:tasks.workunit.client.0.smithi026.stdout:9/371: dwrite d7/d23/d2f/f45 [0,4194304] 0 2024-05-09T00:07:43.685 INFO:tasks.workunit.client.0.smithi026.stdout:9/372: write d7/d23/d29/d31/d40/f48 [488924,77631] 0 2024-05-09T00:07:43.685 INFO:tasks.workunit.client.0.smithi026.stdout:9/373: fsync d7/f4a 0 2024-05-09T00:07:43.688 INFO:tasks.workunit.client.1.smithi135.stdout:9/944: mkdir d1/d1a/d89/dad/ded/d137 0 2024-05-09T00:07:43.688 INFO:tasks.workunit.client.1.smithi135.stdout:9/945: fsync d1/d1a/d10/d3c/d5c/fab 0 2024-05-09T00:07:43.690 INFO:tasks.workunit.client.1.smithi135.stdout:4/904: mknod dc/d71/d86/c129 0 2024-05-09T00:07:43.691 INFO:tasks.workunit.client.0.smithi026.stdout:5/311: dread d2/d8/d31/d4b/d51/f5e [0,4194304] 0 2024-05-09T00:07:43.691 INFO:tasks.workunit.client.0.smithi026.stdout:5/312: readlink d2/d8/d2a/l2b 0 2024-05-09T00:07:43.694 INFO:tasks.workunit.client.1.smithi135.stdout:0/954: getdents d3/d64 0 2024-05-09T00:07:43.695 INFO:tasks.workunit.client.0.smithi026.stdout:1/363: mknod d5/dd/d1f/d51/c7e 0 2024-05-09T00:07:43.695 INFO:tasks.workunit.client.0.smithi026.stdout:1/364: chown d5/db/d30/f4d 250205287 1 2024-05-09T00:07:43.696 INFO:tasks.workunit.client.0.smithi026.stdout:5/313: dread d2/d8/d31/d4b/d51/f5e [0,4194304] 0 2024-05-09T00:07:43.697 INFO:tasks.workunit.client.0.smithi026.stdout:5/314: dread d2/d8/d31/d2e/d4a/f3d [0,4194304] 0 2024-05-09T00:07:43.699 INFO:tasks.workunit.client.1.smithi135.stdout:1/958: getdents da/d14/d20/d38/d3a/db7/de9/dfd 0 2024-05-09T00:07:43.699 INFO:tasks.workunit.client.1.smithi135.stdout:1/959: chown da/d14/d5c/de0 295 1 2024-05-09T00:07:43.699 INFO:tasks.workunit.client.1.smithi135.stdout:4/905: readlink dc/dd/le9 0 2024-05-09T00:07:43.702 INFO:tasks.workunit.client.1.smithi135.stdout:0/955: creat d3/dd/d3f/d43/da3/dea/f11b x:0 0 0 2024-05-09T00:07:43.704 INFO:tasks.workunit.client.1.smithi135.stdout:1/960: link da/d14/d20/d38/d86/cdc da/d24/d27/c14d 0 2024-05-09T00:07:43.706 INFO:tasks.workunit.client.1.smithi135.stdout:4/906: mkdir dc/d71/de5/d12a 0 2024-05-09T00:07:43.706 INFO:tasks.workunit.client.1.smithi135.stdout:4/907: write dc/d26/d31/db8/dd1/feb [212159,903] 0 2024-05-09T00:07:43.707 INFO:tasks.workunit.client.0.smithi026.stdout:6/293: mknod d15/d2b/c60 0 2024-05-09T00:07:43.707 INFO:tasks.workunit.client.0.smithi026.stdout:6/294: write d15/d2b/f3e [898808,24256] 0 2024-05-09T00:07:43.708 INFO:tasks.workunit.client.1.smithi135.stdout:0/956: mkdir d3/dd/d3f/d43/da3/d10b/d11c 0 2024-05-09T00:07:43.710 INFO:tasks.workunit.client.1.smithi135.stdout:1/961: unlink da/d14/d20/d38/l45 0 2024-05-09T00:07:43.710 INFO:tasks.workunit.client.1.smithi135.stdout:1/962: write da/d14/d20/d38/d86/ffb [26003,91082] 0 2024-05-09T00:07:43.711 INFO:tasks.workunit.client.1.smithi135.stdout:1/963: fdatasync da/d14/d20/d38/f46 0 2024-05-09T00:07:43.711 INFO:tasks.workunit.client.1.smithi135.stdout:1/964: fdatasync da/d14/d20/d38/f58 0 2024-05-09T00:07:43.711 INFO:tasks.workunit.client.0.smithi026.stdout:2/263: link fc d14/d22/d55/f60 0 2024-05-09T00:07:43.712 INFO:tasks.workunit.client.0.smithi026.stdout:0/442: dwrite d1d/d25/d47/d6e/f8e [0,4194304] 0 2024-05-09T00:07:43.712 INFO:tasks.workunit.client.1.smithi135.stdout:0/957: rmdir d3/d9e 39 2024-05-09T00:07:43.713 INFO:tasks.workunit.client.0.smithi026.stdout:3/302: sync 2024-05-09T00:07:43.714 INFO:tasks.workunit.client.1.smithi135.stdout:1/965: getdents da/d24 0 2024-05-09T00:07:43.714 INFO:tasks.workunit.client.1.smithi135.stdout:1/966: readlink da/d14/d20/d38/d3a/d40/l145 0 2024-05-09T00:07:43.714 INFO:tasks.workunit.client.1.smithi135.stdout:1/967: truncate da/db/d107/f127 443330 0 2024-05-09T00:07:43.715 INFO:tasks.workunit.client.1.smithi135.stdout:0/958: mknod d3/dd/d2d/db5/df4/daa/c11d 0 2024-05-09T00:07:43.716 INFO:tasks.workunit.client.0.smithi026.stdout:9/374: creat d7/d23/d76/f8c x:0 0 0 2024-05-09T00:07:43.716 INFO:tasks.workunit.client.0.smithi026.stdout:3/303: dread d5/d9/dc/d28/f2e [0,4194304] 0 2024-05-09T00:07:43.716 INFO:tasks.workunit.client.0.smithi026.stdout:3/304: chown d5/la 113 1 2024-05-09T00:07:43.716 INFO:tasks.workunit.client.0.smithi026.stdout:9/375: stat d7/d23/d29/d31/d40/f48 0 2024-05-09T00:07:43.717 INFO:tasks.workunit.client.0.smithi026.stdout:7/474: dwrite d8/d2e/d55/d1e/d3d/f63 [0,4194304] 0 2024-05-09T00:07:43.717 INFO:tasks.workunit.client.0.smithi026.stdout:0/443: write d1d/d1e/d20/d4d/f82 [1299691,15385] 0 2024-05-09T00:07:43.717 INFO:tasks.workunit.client.1.smithi135.stdout:1/968: creat da/d24/d27/d33/d7d/f14e x:0 0 0 2024-05-09T00:07:43.717 INFO:tasks.workunit.client.1.smithi135.stdout:1/969: truncate da/d14/d20/d38/d3a/ff6 688277 0 2024-05-09T00:07:43.717 INFO:tasks.workunit.client.1.smithi135.stdout:1/970: getdents da/d14/d20/d38/d3a/d40/d96/d133 0 2024-05-09T00:07:43.719 INFO:tasks.workunit.client.1.smithi135.stdout:1/971: creat da/d24/dd0/f14f x:0 0 0 2024-05-09T00:07:43.719 INFO:tasks.workunit.client.0.smithi026.stdout:8/369: dwrite de/d17/f43 [0,4194304] 0 2024-05-09T00:07:43.719 INFO:tasks.workunit.client.0.smithi026.stdout:8/370: write de/d6c/d31/f74 [742797,67571] 0 2024-05-09T00:07:43.720 INFO:tasks.workunit.client.0.smithi026.stdout:7/475: write d8/d1b/d89/d8d/f98 [2293742,14441] 0 2024-05-09T00:07:43.720 INFO:tasks.workunit.client.0.smithi026.stdout:7/476: write d8/d5c/f7d [4412762,56162] 0 2024-05-09T00:07:43.721 INFO:tasks.workunit.client.0.smithi026.stdout:7/477: write d8/d2e/f5d [675270,5908] 0 2024-05-09T00:07:43.721 INFO:tasks.workunit.client.0.smithi026.stdout:5/315: rename d2/d8/d31/d4b/c54 to d2/d8/d31/d4b/c6a 0 2024-05-09T00:07:43.723 INFO:tasks.workunit.client.0.smithi026.stdout:2/264: mkdir d14/d15/d1f/d4f/d5f/d61 0 2024-05-09T00:07:43.723 INFO:tasks.workunit.client.1.smithi135.stdout:9/946: dwrite d1/d24/d44/d7f/da2/dca/dea/f127 [0,4194304] 0 2024-05-09T00:07:43.723 INFO:tasks.workunit.client.1.smithi135.stdout:9/947: truncate d1/d1a/d89/d99/f135 854373 0 2024-05-09T00:07:43.724 INFO:tasks.workunit.client.1.smithi135.stdout:4/908: dwrite dc/d26/df4/fc2 [0,4194304] 0 2024-05-09T00:07:43.724 INFO:tasks.workunit.client.1.smithi135.stdout:4/909: chown dc/d26/d93/d124/dc9 43 1 2024-05-09T00:07:43.724 INFO:tasks.workunit.client.1.smithi135.stdout:1/972: link da/d14/d20/d2c/f13e da/d14/d20/d2c/f150 0 2024-05-09T00:07:43.728 INFO:tasks.workunit.client.0.smithi026.stdout:3/305: symlink d5/d9/d49/l64 0 2024-05-09T00:07:43.729 INFO:tasks.workunit.client.0.smithi026.stdout:7/478: dread d8/d1b/f5b [0,4194304] 0 2024-05-09T00:07:43.729 INFO:tasks.workunit.client.1.smithi135.stdout:9/948: creat d1/d24/d86/f138 x:0 0 0 2024-05-09T00:07:43.731 INFO:tasks.workunit.client.0.smithi026.stdout:9/376: symlink d7/d23/d29/l8d 0 2024-05-09T00:07:43.731 INFO:tasks.workunit.client.0.smithi026.stdout:9/377: write d7/d26/f71 [938851,10440] 0 2024-05-09T00:07:43.738 INFO:tasks.workunit.client.0.smithi026.stdout:0/444: truncate d1d/d25/f2b 2274550 0 2024-05-09T00:07:43.739 INFO:tasks.workunit.client.0.smithi026.stdout:0/445: write d1d/d33/f36 [2388173,30369] 0 2024-05-09T00:07:43.739 INFO:tasks.workunit.client.0.smithi026.stdout:0/446: readlink d1d/d25/l60 0 2024-05-09T00:07:43.739 INFO:tasks.workunit.client.0.smithi026.stdout:0/447: fsync d1d/d25/d3c/f40 0 2024-05-09T00:07:43.740 INFO:tasks.workunit.client.0.smithi026.stdout:1/365: getdents d5/dd/d17/d7b 0 2024-05-09T00:07:43.751 INFO:tasks.workunit.client.0.smithi026.stdout:2/265: link d14/d22/l4c d14/d15/d1f/d4f/l62 0 2024-05-09T00:07:43.753 INFO:tasks.workunit.client.1.smithi135.stdout:4/910: symlink dc/d26/d93/d9d/de7/l12b 0 2024-05-09T00:07:43.756 INFO:tasks.workunit.client.1.smithi135.stdout:1/973: mknod da/d24/d27/d33/d52/dfc/c151 0 2024-05-09T00:07:43.756 INFO:tasks.workunit.client.0.smithi026.stdout:7/479: dwrite d8/d2e/d55/f7f [4194304,4194304] 0 2024-05-09T00:07:43.757 INFO:tasks.workunit.client.0.smithi026.stdout:9/378: dwrite d7/d23/d76/f8c [0,4194304] 0 2024-05-09T00:07:43.757 INFO:tasks.workunit.client.0.smithi026.stdout:9/379: dread - d7/d23/f7c zero size 2024-05-09T00:07:43.759 INFO:tasks.workunit.client.1.smithi135.stdout:9/949: truncate d1/d24/d44/d7f/f9f 555058 0 2024-05-09T00:07:43.759 INFO:tasks.workunit.client.0.smithi026.stdout:2/266: dread d14/d15/d1f/f28 [0,4194304] 0 2024-05-09T00:07:43.761 INFO:tasks.workunit.client.1.smithi135.stdout:1/974: write da/d14/d20/d2c/f7e [263321,31930] 0 2024-05-09T00:07:43.763 INFO:tasks.workunit.client.0.smithi026.stdout:3/306: mknod d5/d41/c65 0 2024-05-09T00:07:43.766 INFO:tasks.workunit.client.1.smithi135.stdout:4/911: dread dc/d4a/fa4 [0,4194304] 0 2024-05-09T00:07:43.767 INFO:tasks.workunit.client.0.smithi026.stdout:0/448: dread d1d/d25/d3c/d5f/f72 [0,4194304] 0 2024-05-09T00:07:43.771 INFO:tasks.workunit.client.0.smithi026.stdout:1/366: rename d5/dd/d17/d73/l42 to d5/dd/d17/l7f 0 2024-05-09T00:07:43.771 INFO:tasks.workunit.client.0.smithi026.stdout:1/367: write d5/db/d30/f4d [989489,49440] 0 2024-05-09T00:07:43.773 INFO:tasks.workunit.client.1.smithi135.stdout:4/912: creat dc/d4a/d69/dac/f12c x:0 0 0 2024-05-09T00:07:43.773 INFO:tasks.workunit.client.1.smithi135.stdout:4/913: chown dc/d26/d93/d124/d6d/c128 0 1 2024-05-09T00:07:43.779 INFO:tasks.workunit.client.0.smithi026.stdout:9/380: dwrite d7/f19 [4194304,4194304] 0 2024-05-09T00:07:43.779 INFO:tasks.workunit.client.0.smithi026.stdout:1/368: dread d5/dd/d1f/f21 [4194304,4194304] 0 2024-05-09T00:07:43.779 INFO:tasks.workunit.client.0.smithi026.stdout:9/381: dread - d7/d23/f84 zero size 2024-05-09T00:07:43.781 INFO:tasks.workunit.client.0.smithi026.stdout:7/480: rmdir d8/d1b/d89/d8d 39 2024-05-09T00:07:43.788 INFO:tasks.workunit.client.0.smithi026.stdout:2/267: unlink d14/d15/d3b/d40/f59 0 2024-05-09T00:07:43.790 INFO:tasks.workunit.client.0.smithi026.stdout:3/307: creat d5/d9/dc/d28/d63/f66 x:0 0 0 2024-05-09T00:07:43.791 INFO:tasks.workunit.client.0.smithi026.stdout:3/308: chown d5/d9/dc/d28 32285 1 2024-05-09T00:07:43.791 INFO:tasks.workunit.client.0.smithi026.stdout:3/309: fdatasync d5/d41/f43 0 2024-05-09T00:07:43.791 INFO:tasks.workunit.client.0.smithi026.stdout:3/310: chown d5/d1e/f20 248432863 1 2024-05-09T00:07:43.791 INFO:tasks.workunit.client.0.smithi026.stdout:0/449: dwrite d1d/d1e/d20/d51/f5c [4194304,4194304] 0 2024-05-09T00:07:43.794 INFO:tasks.workunit.client.1.smithi135.stdout:9/950: dwrite d1/d24/d44/d7f/da2/dca/dea/f127 [0,4194304] 0 2024-05-09T00:07:43.794 INFO:tasks.workunit.client.1.smithi135.stdout:9/951: fdatasync d1/d24/d44/d7f/da2/dca/f116 0 2024-05-09T00:07:43.794 INFO:tasks.workunit.client.1.smithi135.stdout:4/914: dwrite dc/d26/d93/d124/d6d/f94 [0,4194304] 0 2024-05-09T00:07:43.797 INFO:tasks.workunit.client.0.smithi026.stdout:1/369: creat d5/dd/f80 x:0 0 0 2024-05-09T00:07:43.797 INFO:tasks.workunit.client.0.smithi026.stdout:1/370: write d5/dd/f49 [1075117,11992] 0 2024-05-09T00:07:43.798 INFO:tasks.workunit.client.1.smithi135.stdout:9/952: mknod d1/d24/d44/d54/c139 0 2024-05-09T00:07:43.798 INFO:tasks.workunit.client.0.smithi026.stdout:9/382: mknod d7/d23/d29/c8e 0 2024-05-09T00:07:43.800 INFO:tasks.workunit.client.0.smithi026.stdout:7/481: symlink d8/d2e/d55/d22/d29/la9 0 2024-05-09T00:07:43.800 INFO:tasks.workunit.client.0.smithi026.stdout:7/482: readlink d8/d2e/l7e 0 2024-05-09T00:07:43.800 INFO:tasks.workunit.client.0.smithi026.stdout:7/483: write d8/d5c/d9a/f9c [574412,97450] 0 2024-05-09T00:07:43.801 INFO:tasks.workunit.client.1.smithi135.stdout:0/959: dwrite d3/dd/d3f/d43/f69 [0,4194304] 0 2024-05-09T00:07:43.801 INFO:tasks.workunit.client.1.smithi135.stdout:9/953: mknod d1/da4/c13a 0 2024-05-09T00:07:43.802 INFO:tasks.workunit.client.0.smithi026.stdout:2/268: creat d14/d15/d1f/d4f/f63 x:0 0 0 2024-05-09T00:07:43.804 INFO:tasks.workunit.client.0.smithi026.stdout:3/311: link d5/d9/dc/d28/d2c/f58 d5/d9/dc/d28/d63/f67 0 2024-05-09T00:07:43.811 INFO:tasks.workunit.client.1.smithi135.stdout:4/915: dwrite dc/d26/d93/d9d/d101/f115 [0,4194304] 0 2024-05-09T00:07:43.811 INFO:tasks.workunit.client.0.smithi026.stdout:3/312: dread d5/f12 [0,4194304] 0 2024-05-09T00:07:43.812 INFO:tasks.workunit.client.0.smithi026.stdout:0/450: unlink d1d/d1e/d20/d4d/f82 0 2024-05-09T00:07:43.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/960: link d3/dd/d3f/d58/l74 d3/dd/d2d/db5/l11e 0 2024-05-09T00:07:43.814 INFO:tasks.workunit.client.0.smithi026.stdout:1/371: creat d5/db/f81 x:0 0 0 2024-05-09T00:07:43.815 INFO:tasks.workunit.client.1.smithi135.stdout:9/954: mknod d1/d24/d44/d7f/da2/dca/dea/c13b 0 2024-05-09T00:07:43.816 INFO:tasks.workunit.client.0.smithi026.stdout:7/484: dwrite d8/d2e/d55/d1e/f41 [0,4194304] 0 2024-05-09T00:07:43.817 INFO:tasks.workunit.client.1.smithi135.stdout:2/957: sync 2024-05-09T00:07:43.817 INFO:tasks.workunit.client.1.smithi135.stdout:2/958: stat d1/d12/d20/d2b/dbb 0 2024-05-09T00:07:43.818 INFO:tasks.workunit.client.0.smithi026.stdout:9/383: unlink d7/c21 0 2024-05-09T00:07:43.818 INFO:tasks.workunit.client.0.smithi026.stdout:6/295: truncate d15/d2b/f3e 831414 0 2024-05-09T00:07:43.821 INFO:tasks.workunit.client.0.smithi026.stdout:2/269: creat d14/d15/d1f/d4f/d5b/f64 x:0 0 0 2024-05-09T00:07:43.825 INFO:tasks.workunit.client.0.smithi026.stdout:3/313: creat d5/d1e/d3e/f68 x:0 0 0 2024-05-09T00:07:43.828 INFO:tasks.workunit.client.1.smithi135.stdout:4/916: creat dc/d26/d31/d82/f12d x:0 0 0 2024-05-09T00:07:43.828 INFO:tasks.workunit.client.1.smithi135.stdout:2/959: dread d1/d12/d21/d57/d10b/fbe [4194304,4194304] 0 2024-05-09T00:07:43.829 INFO:tasks.workunit.client.1.smithi135.stdout:4/917: fsync dc/d4a/f58 0 2024-05-09T00:07:43.829 INFO:tasks.workunit.client.1.smithi135.stdout:4/918: fdatasync dc/d26/d31/db8/dd1/f118 0 2024-05-09T00:07:43.830 INFO:tasks.workunit.client.1.smithi135.stdout:0/961: mkdir d3/dd/d3f/d43/da3/d11f 0 2024-05-09T00:07:43.832 INFO:tasks.workunit.client.1.smithi135.stdout:9/955: mkdir d1/d1a/d89/dad/ded/d137/d13c 0 2024-05-09T00:07:43.832 INFO:tasks.workunit.client.1.smithi135.stdout:9/956: readlink d1/d1a/l5b 0 2024-05-09T00:07:43.832 INFO:tasks.workunit.client.1.smithi135.stdout:9/957: truncate d1/d24/d86/d10d/f129 475828 0 2024-05-09T00:07:43.833 INFO:tasks.workunit.client.1.smithi135.stdout:2/960: write d1/d12/d20/d2b/d56/d72/fae [982583,6021] 0 2024-05-09T00:07:43.834 INFO:tasks.workunit.client.1.smithi135.stdout:0/962: read d3/dd/d3f/d29/f2e [2640548,112966] 0 2024-05-09T00:07:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:0/451: dwrite d1d/d1e/d20/f8d [4194304,4194304] 0 2024-05-09T00:07:43.835 INFO:tasks.workunit.client.1.smithi135.stdout:4/919: mkdir dc/d26/d93/d124/d5f/d5a/d9e/d113/d12e 0 2024-05-09T00:07:43.836 INFO:tasks.workunit.client.1.smithi135.stdout:9/958: creat d1/d24/d44/d7f/da2/dca/d113/d12c/f13d x:0 0 0 2024-05-09T00:07:43.840 INFO:tasks.workunit.client.0.smithi026.stdout:7/485: rename d8/d2e/d55/d22/d29/f94 to d8/d2e/d55/d1e/d3d/d6b/faa 0 2024-05-09T00:07:43.842 INFO:tasks.workunit.client.1.smithi135.stdout:2/961: mkdir d1/d12/d20/d3b/d105/d145 0 2024-05-09T00:07:43.842 INFO:tasks.workunit.client.1.smithi135.stdout:2/962: stat d1/d12/d21/d57/d10b/d119 0 2024-05-09T00:07:43.843 INFO:tasks.workunit.client.0.smithi026.stdout:9/384: creat d7/d23/d29/d31/d40/d41/d54/d5c/f8f x:0 0 0 2024-05-09T00:07:43.844 INFO:tasks.workunit.client.0.smithi026.stdout:1/372: dwrite d5/dd/f80 [0,4194304] 0 2024-05-09T00:07:43.844 INFO:tasks.workunit.client.0.smithi026.stdout:1/373: stat d5/db/d30/d75 0 2024-05-09T00:07:43.844 INFO:tasks.workunit.client.0.smithi026.stdout:1/374: chown f4 2524213 1 2024-05-09T00:07:43.844 INFO:tasks.workunit.client.0.smithi026.stdout:2/270: dwrite d14/d15/f25 [0,4194304] 0 2024-05-09T00:07:43.845 INFO:tasks.workunit.client.1.smithi135.stdout:0/963: creat d3/dd/d2d/db5/df4/daa/f120 x:0 0 0 2024-05-09T00:07:43.845 INFO:tasks.workunit.client.1.smithi135.stdout:0/964: readlink d3/lad 0 2024-05-09T00:07:43.848 INFO:tasks.workunit.client.1.smithi135.stdout:9/959: rmdir d1/d1a/d10/d3c/d102 39 2024-05-09T00:07:43.852 INFO:tasks.workunit.client.1.smithi135.stdout:2/963: getdents d1/d12/d20/d2b/d7c/db5/dfd 0 2024-05-09T00:07:43.854 INFO:tasks.workunit.client.0.smithi026.stdout:6/296: rename d15/d41/f4b to d15/d1e/d23/d26/d58/f61 0 2024-05-09T00:07:43.855 INFO:tasks.workunit.client.0.smithi026.stdout:6/297: chown d15/d1e/d23/d26/d58/d5c 135772384 1 2024-05-09T00:07:43.856 INFO:tasks.workunit.client.1.smithi135.stdout:0/965: creat d3/f121 x:0 0 0 2024-05-09T00:07:43.857 INFO:tasks.workunit.client.0.smithi026.stdout:1/375: dwrite d5/d16/d60/f74 [0,4194304] 0 2024-05-09T00:07:43.857 INFO:tasks.workunit.client.0.smithi026.stdout:7/486: creat d8/d2e/d84/fab x:0 0 0 2024-05-09T00:07:43.857 INFO:tasks.workunit.client.0.smithi026.stdout:6/298: write d15/f1d [1376558,116851] 0 2024-05-09T00:07:43.858 INFO:tasks.workunit.client.1.smithi135.stdout:4/920: mknod dc/dd/c12f 0 2024-05-09T00:07:43.860 INFO:tasks.workunit.client.0.smithi026.stdout:9/385: creat d7/d23/d76/f90 x:0 0 0 2024-05-09T00:07:43.867 INFO:tasks.workunit.client.1.smithi135.stdout:2/964: truncate d1/d12/d20/d2b/f90 2202635 0 2024-05-09T00:07:43.869 INFO:tasks.workunit.client.1.smithi135.stdout:0/966: creat d3/dd/d3f/d3a/da4/dc1/de6/f122 x:0 0 0 2024-05-09T00:07:43.870 INFO:tasks.workunit.client.1.smithi135.stdout:0/967: chown d3/dd/d2d/f40 1 1 2024-05-09T00:07:43.872 INFO:tasks.workunit.client.1.smithi135.stdout:4/921: creat dc/d26/d93/d9d/dd2/f130 x:0 0 0 2024-05-09T00:07:43.872 INFO:tasks.workunit.client.1.smithi135.stdout:4/922: stat dc/d26/df4/fc5 0 2024-05-09T00:07:43.872 INFO:tasks.workunit.client.1.smithi135.stdout:4/923: truncate dc/d71/de5/fe6 100045 0 2024-05-09T00:07:43.872 INFO:tasks.workunit.client.1.smithi135.stdout:4/924: dread - dc/d4a/d69/f11d zero size 2024-05-09T00:07:43.872 INFO:tasks.workunit.client.1.smithi135.stdout:4/925: write dc/d71/d90/d11e/f126 [974046,25666] 0 2024-05-09T00:07:43.872 INFO:tasks.workunit.client.1.smithi135.stdout:4/926: readlink dc/d26/d31/db8/dd1/l123 0 2024-05-09T00:07:43.872 INFO:tasks.workunit.client.1.smithi135.stdout:4/927: fsync dc/d4a/d8c/da5/fd5 0 2024-05-09T00:07:43.873 INFO:tasks.workunit.client.0.smithi026.stdout:0/452: rmdir d1d/d1e/d20/d4d 39 2024-05-09T00:07:43.873 INFO:tasks.workunit.client.0.smithi026.stdout:9/386: dwrite d7/d23/f39 [0,4194304] 0 2024-05-09T00:07:43.875 INFO:tasks.workunit.client.0.smithi026.stdout:2/271: rename d14/d15/d1f/l29 to d14/d15/d17/l65 0 2024-05-09T00:07:43.875 INFO:tasks.workunit.client.0.smithi026.stdout:2/272: chown d14/d15/d20/d41 899516 1 2024-05-09T00:07:43.875 INFO:tasks.workunit.client.0.smithi026.stdout:2/273: chown f8 498914913 1 2024-05-09T00:07:43.878 INFO:tasks.workunit.client.1.smithi135.stdout:2/965: creat d1/d12/d12d/f146 x:0 0 0 2024-05-09T00:07:43.878 INFO:tasks.workunit.client.1.smithi135.stdout:1/975: sync 2024-05-09T00:07:43.878 INFO:tasks.workunit.client.1.smithi135.stdout:1/976: write da/d24/d27/d33/d36/f13d [422114,14895] 0 2024-05-09T00:07:43.879 INFO:tasks.workunit.client.1.smithi135.stdout:0/968: symlink d3/dd/d2d/d4c/l123 0 2024-05-09T00:07:43.880 INFO:tasks.workunit.client.1.smithi135.stdout:1/977: write da/d24/d27/d33/f60 [2195816,60683] 0 2024-05-09T00:07:43.880 INFO:tasks.workunit.client.0.smithi026.stdout:7/487: mknod d8/d2e/d55/d22/d29/cac 0 2024-05-09T00:07:43.881 INFO:tasks.workunit.client.1.smithi135.stdout:4/928: mknod dc/d26/d31/d96/c131 0 2024-05-09T00:07:43.882 INFO:tasks.workunit.client.1.smithi135.stdout:4/929: fdatasync dc/d26/d31/db8/dd1/f118 0 2024-05-09T00:07:43.882 INFO:tasks.workunit.client.0.smithi026.stdout:3/314: fsync d5/d1e/d3e/f68 0 2024-05-09T00:07:43.883 INFO:tasks.workunit.client.0.smithi026.stdout:3/315: write d5/d1e/f3d [1640370,91029] 0 2024-05-09T00:07:43.883 INFO:tasks.workunit.client.0.smithi026.stdout:3/316: fsync d5/d41/f2d 0 2024-05-09T00:07:43.887 INFO:tasks.workunit.client.1.smithi135.stdout:0/969: rename d3/dd/fd5 to d3/dd/d2d/db5/df4/daa/df2/f124 0 2024-05-09T00:07:43.888 INFO:tasks.workunit.client.0.smithi026.stdout:0/453: symlink d1d/d1e/d20/d4d/d83/l93 0 2024-05-09T00:07:43.888 INFO:tasks.workunit.client.0.smithi026.stdout:0/454: fsync d1d/d25/f55 0 2024-05-09T00:07:43.892 INFO:tasks.workunit.client.1.smithi135.stdout:1/978: creat da/d24/d27/d33/d52/dfc/d10f/f152 x:0 0 0 2024-05-09T00:07:43.894 INFO:tasks.workunit.client.1.smithi135.stdout:4/930: unlink dc/d26/d93/d124/d5f/d5a/dbd/lbe 0 2024-05-09T00:07:43.895 INFO:tasks.workunit.client.1.smithi135.stdout:2/966: dwrite d1/d12/d20/d3b/f7e [0,4194304] 0 2024-05-09T00:07:43.897 INFO:tasks.workunit.client.0.smithi026.stdout:9/387: unlink d7/d23/d2f/f79 0 2024-05-09T00:07:43.899 INFO:tasks.workunit.client.0.smithi026.stdout:2/274: creat d14/d15/d3b/d40/f66 x:0 0 0 2024-05-09T00:07:43.900 INFO:tasks.workunit.client.1.smithi135.stdout:0/970: symlink d3/dd/d3f/d43/da3/d10b/d11c/l125 0 2024-05-09T00:07:43.902 INFO:tasks.workunit.client.1.smithi135.stdout:9/960: rmdir d1/d24 39 2024-05-09T00:07:43.902 INFO:tasks.workunit.client.1.smithi135.stdout:9/961: read - d1/d24/d44/d7f/da2/dca/dea/f121 zero size 2024-05-09T00:07:43.902 INFO:tasks.workunit.client.1.smithi135.stdout:9/962: dread - d1/d24/d44/d7f/da2/dca/d113/d12c/f12d zero size 2024-05-09T00:07:43.903 INFO:tasks.workunit.client.1.smithi135.stdout:1/979: dread da/d14/d5c/f6b [0,4194304] 0 2024-05-09T00:07:43.903 INFO:tasks.workunit.client.1.smithi135.stdout:4/931: rmdir dc/d26/d31/d96 39 2024-05-09T00:07:43.904 INFO:tasks.workunit.client.1.smithi135.stdout:0/971: dread d3/dd/d3f/f33 [0,4194304] 0 2024-05-09T00:07:43.904 INFO:tasks.workunit.client.0.smithi026.stdout:7/488: dwrite d8/d5c/d9a/f9c [0,4194304] 0 2024-05-09T00:07:43.905 INFO:tasks.workunit.client.0.smithi026.stdout:0/455: mknod d1d/d25/d3c/d5f/c94 0 2024-05-09T00:07:43.906 INFO:tasks.workunit.client.1.smithi135.stdout:0/972: read d3/dd/d3f/f76 [476122,59628] 0 2024-05-09T00:07:43.906 INFO:tasks.workunit.client.1.smithi135.stdout:0/973: chown d3/dd/d3f/lbf 0 1 2024-05-09T00:07:43.906 INFO:tasks.workunit.client.0.smithi026.stdout:3/317: dwrite d5/d41/f43 [0,4194304] 0 2024-05-09T00:07:43.909 INFO:tasks.workunit.client.0.smithi026.stdout:9/388: stat d7/c20 0 2024-05-09T00:07:43.909 INFO:tasks.workunit.client.0.smithi026.stdout:9/389: chown d7/d23/d29/d2e/f6f 248891 1 2024-05-09T00:07:43.909 INFO:tasks.workunit.client.0.smithi026.stdout:9/390: fdatasync d7/d23/d29/d31/d40/d41/d54/f77 0 2024-05-09T00:07:43.911 INFO:tasks.workunit.client.0.smithi026.stdout:3/318: write d5/d1e/f3d [207806,105355] 0 2024-05-09T00:07:43.912 INFO:tasks.workunit.client.0.smithi026.stdout:2/275: rename d14/d15/d17/f1c to d14/d22/d55/f67 0 2024-05-09T00:07:43.916 INFO:tasks.workunit.client.1.smithi135.stdout:2/967: mkdir d1/d12/d21/d41/d147 0 2024-05-09T00:07:43.919 INFO:tasks.workunit.client.0.smithi026.stdout:7/489: dwrite d8/d2e/d84/fab [0,4194304] 0 2024-05-09T00:07:43.920 INFO:tasks.workunit.client.1.smithi135.stdout:9/963: mknod d1/d1a/c13e 0 2024-05-09T00:07:43.920 INFO:tasks.workunit.client.0.smithi026.stdout:7/490: write d8/f1f [3704226,127265] 0 2024-05-09T00:07:43.922 INFO:tasks.workunit.client.1.smithi135.stdout:4/932: symlink dc/d71/de5/d12a/l132 0 2024-05-09T00:07:43.922 INFO:tasks.workunit.client.1.smithi135.stdout:4/933: write dc/d26/d31/d82/f105 [381566,15482] 0 2024-05-09T00:07:43.922 INFO:tasks.workunit.client.0.smithi026.stdout:0/456: chown cd 669310606 1 2024-05-09T00:07:43.926 INFO:tasks.workunit.client.1.smithi135.stdout:0/974: dread d3/dd/d3f/d3a/f4a [0,4194304] 0 2024-05-09T00:07:43.928 INFO:tasks.workunit.client.0.smithi026.stdout:9/391: mkdir d7/d23/d29/d59/d91 0 2024-05-09T00:07:43.928 INFO:tasks.workunit.client.0.smithi026.stdout:9/392: getdents d7/d23/d2f/d50 0 2024-05-09T00:07:43.928 INFO:tasks.workunit.client.0.smithi026.stdout:9/393: truncate d7/d26/f6b 435637 0 2024-05-09T00:07:43.929 INFO:tasks.workunit.client.0.smithi026.stdout:9/394: write d7/f9 [874626,43424] 0 2024-05-09T00:07:43.929 INFO:tasks.workunit.client.0.smithi026.stdout:9/395: fsync d7/d23/f39 0 2024-05-09T00:07:43.931 INFO:tasks.workunit.client.1.smithi135.stdout:9/964: dread d1/d24/f35 [0,4194304] 0 2024-05-09T00:07:43.931 INFO:tasks.workunit.client.1.smithi135.stdout:4/934: creat dc/d71/de5/f133 x:0 0 0 2024-05-09T00:07:43.932 INFO:tasks.workunit.client.0.smithi026.stdout:7/491: dread d8/f1f [0,4194304] 0 2024-05-09T00:07:43.933 INFO:tasks.workunit.client.0.smithi026.stdout:2/276: unlink f2 0 2024-05-09T00:07:43.936 INFO:tasks.workunit.client.1.smithi135.stdout:0/975: mknod d3/dd/d3f/d29/d116/c126 0 2024-05-09T00:07:43.936 INFO:tasks.workunit.client.1.smithi135.stdout:0/976: stat d3/dd/d3f/d3a/da4/de2 0 2024-05-09T00:07:43.940 INFO:tasks.workunit.client.1.smithi135.stdout:9/965: mkdir d1/d1a/d10/d3c/d102/d13f 0 2024-05-09T00:07:43.941 INFO:tasks.workunit.client.0.smithi026.stdout:0/457: creat d1d/d25/d3c/f95 x:0 0 0 2024-05-09T00:07:43.944 INFO:tasks.workunit.client.1.smithi135.stdout:0/977: truncate d3/dd/f32 4238575 0 2024-05-09T00:07:43.944 INFO:tasks.workunit.client.1.smithi135.stdout:2/968: dwrite d1/d12/d21/f136 [0,4194304] 0 2024-05-09T00:07:43.944 INFO:tasks.workunit.client.0.smithi026.stdout:3/319: dwrite d5/f12 [0,4194304] 0 2024-05-09T00:07:43.944 INFO:tasks.workunit.client.0.smithi026.stdout:3/320: getdents d5/d9/d4a/d5f 0 2024-05-09T00:07:43.945 INFO:tasks.workunit.client.0.smithi026.stdout:9/396: creat d7/d23/d29/d59/d91/f92 x:0 0 0 2024-05-09T00:07:43.946 INFO:tasks.workunit.client.1.smithi135.stdout:9/966: mknod d1/d24/d44/dfe/c140 0 2024-05-09T00:07:43.948 INFO:tasks.workunit.client.0.smithi026.stdout:7/492: mknod d8/d2e/d55/d22/da1/cad 0 2024-05-09T00:07:43.949 INFO:tasks.workunit.client.0.smithi026.stdout:7/493: fsync d8/d2e/d55/d22/f42 0 2024-05-09T00:07:43.949 INFO:tasks.workunit.client.0.smithi026.stdout:7/494: fsync d8/ff 0 2024-05-09T00:07:43.952 INFO:tasks.workunit.client.0.smithi026.stdout:2/277: unlink fc 0 2024-05-09T00:07:43.955 INFO:tasks.workunit.client.0.smithi026.stdout:0/458: mkdir d1d/d1e/d20/d4d/d58/d62/d96 0 2024-05-09T00:07:43.955 INFO:tasks.workunit.client.0.smithi026.stdout:0/459: readlink l13 0 2024-05-09T00:07:43.958 INFO:tasks.workunit.client.1.smithi135.stdout:2/969: creat d1/d12/d20/d3b/d4f/f148 x:0 0 0 2024-05-09T00:07:43.959 INFO:tasks.workunit.client.0.smithi026.stdout:3/321: mknod d5/d9/dc/d28/d63/c69 0 2024-05-09T00:07:43.961 INFO:tasks.workunit.client.0.smithi026.stdout:7/495: mkdir d8/d2e/d55/d22/da1/dae 0 2024-05-09T00:07:43.963 INFO:tasks.workunit.client.0.smithi026.stdout:2/278: mkdir d14/d15/d3b/d40/d68 0 2024-05-09T00:07:43.964 INFO:tasks.workunit.client.0.smithi026.stdout:0/460: symlink d1d/d1e/d20/l97 0 2024-05-09T00:07:43.966 INFO:tasks.workunit.client.0.smithi026.stdout:2/279: write d14/d22/d55/f67 [2037031,21174] 0 2024-05-09T00:07:43.966 INFO:tasks.workunit.client.0.smithi026.stdout:2/280: readlink d14/d15/d3b/d40/l4e 0 2024-05-09T00:07:43.966 INFO:tasks.workunit.client.0.smithi026.stdout:3/322: creat d5/d9/dc/d28/d2c/f6a x:0 0 0 2024-05-09T00:07:43.968 INFO:tasks.workunit.client.0.smithi026.stdout:0/461: creat d1d/d1e/d2d/f98 x:0 0 0 2024-05-09T00:07:43.968 INFO:tasks.workunit.client.0.smithi026.stdout:0/462: write d1d/f3f [5118146,99640] 0 2024-05-09T00:07:43.970 INFO:tasks.workunit.client.0.smithi026.stdout:2/281: creat d14/d15/d20/f69 x:0 0 0 2024-05-09T00:07:43.971 INFO:tasks.workunit.client.0.smithi026.stdout:2/282: write fd [3628290,18518] 0 2024-05-09T00:07:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:2/283: rename d14/d15/d1f/d4f to d14/d15/d30/d6a 0 2024-05-09T00:07:43.975 INFO:tasks.workunit.client.1.smithi135.stdout:4/935: dwrite dc/dd/f17 [0,4194304] 0 2024-05-09T00:07:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:2/284: mkdir d14/d22/d55/d6b 0 2024-05-09T00:07:43.980 INFO:tasks.workunit.client.1.smithi135.stdout:4/936: truncate dc/d26/df4/fc5 1707416 0 2024-05-09T00:07:43.980 INFO:tasks.workunit.client.1.smithi135.stdout:4/937: fdatasync dc/d4a/f10b 0 2024-05-09T00:07:43.981 INFO:tasks.workunit.client.0.smithi026.stdout:0/463: write d1d/d1e/d2d/f3b [2010879,105202] 0 2024-05-09T00:07:43.981 INFO:tasks.workunit.client.0.smithi026.stdout:0/464: readlink d1d/d25/l7f 0 2024-05-09T00:07:43.983 INFO:tasks.workunit.client.1.smithi135.stdout:4/938: creat dc/d26/d93/d124/d5f/d5a/d9e/f134 x:0 0 0 2024-05-09T00:07:43.983 INFO:tasks.workunit.client.1.smithi135.stdout:4/939: stat dc/d110 0 2024-05-09T00:07:43.983 INFO:tasks.workunit.client.1.smithi135.stdout:4/940: chown dc/d26/caa 4847 1 2024-05-09T00:07:43.983 INFO:tasks.workunit.client.1.smithi135.stdout:4/941: stat dc/d26/d93/d124/d5f/d5a/f5b 0 2024-05-09T00:07:43.984 INFO:tasks.workunit.client.1.smithi135.stdout:4/942: creat dc/d26/d93/d124/dc9/dd7/f135 x:0 0 0 2024-05-09T00:07:43.986 INFO:tasks.workunit.client.1.smithi135.stdout:4/943: creat dc/dd/f136 x:0 0 0 2024-05-09T00:07:43.987 INFO:tasks.workunit.client.1.smithi135.stdout:4/944: rmdir dc/d71/d125 0 2024-05-09T00:07:43.989 INFO:tasks.workunit.client.1.smithi135.stdout:4/945: truncate dc/d26/d93/d124/d5f/f84 3228864 0 2024-05-09T00:07:43.990 INFO:tasks.workunit.client.0.smithi026.stdout:9/397: dwrite d7/d23/d29/d59/f60 [4194304,4194304] 0 2024-05-09T00:07:43.990 INFO:tasks.workunit.client.0.smithi026.stdout:9/398: fdatasync d7/d23/d29/d59/f5f 0 2024-05-09T00:07:43.991 INFO:tasks.workunit.client.1.smithi135.stdout:4/946: mkdir dc/d71/d90/d137 0 2024-05-09T00:07:43.993 INFO:tasks.workunit.client.1.smithi135.stdout:9/967: dwrite d1/d1a/d2c/d2d/fef [0,4194304] 0 2024-05-09T00:07:43.993 INFO:tasks.workunit.client.1.smithi135.stdout:9/968: chown d1/d24/d44/d7f/da2/dca/dea/c13b 13475 1 2024-05-09T00:07:43.994 INFO:tasks.workunit.client.1.smithi135.stdout:9/969: truncate d1/d1a/f10a 437165 0 2024-05-09T00:07:43.994 INFO:tasks.workunit.client.1.smithi135.stdout:0/978: dwrite d3/dd/d3f/d3a/da4/faf [0,4194304] 0 2024-05-09T00:07:43.994 INFO:tasks.workunit.client.0.smithi026.stdout:9/399: mknod d7/d23/d29/d31/c93 0 2024-05-09T00:07:43.994 INFO:tasks.workunit.client.0.smithi026.stdout:9/400: readlink d7/d23/l68 0 2024-05-09T00:07:43.996 INFO:tasks.workunit.client.0.smithi026.stdout:7/496: dwrite d8/d1b/f2d [4194304,4194304] 0 2024-05-09T00:07:43.996 INFO:tasks.workunit.client.1.smithi135.stdout:4/947: creat dc/d26/d93/d124/d6d/dec/f138 x:0 0 0 2024-05-09T00:07:43.997 INFO:tasks.workunit.client.0.smithi026.stdout:3/323: dwrite d5/d41/f47 [0,4194304] 0 2024-05-09T00:07:43.999 INFO:tasks.workunit.client.0.smithi026.stdout:9/401: dread d7/f16 [0,4194304] 0 2024-05-09T00:07:44.000 INFO:tasks.workunit.client.0.smithi026.stdout:9/402: write d7/f9 [196078,90107] 0 2024-05-09T00:07:44.000 INFO:tasks.workunit.client.0.smithi026.stdout:7/497: link d8/d2e/d55/f50 d8/d2e/d55/d22/d29/faf 0 2024-05-09T00:07:44.002 INFO:tasks.workunit.client.0.smithi026.stdout:0/465: dwrite d1d/d1e/d20/f8d [4194304,4194304] 0 2024-05-09T00:07:44.002 INFO:tasks.workunit.client.0.smithi026.stdout:3/324: dread d5/d9/dc/f31 [0,4194304] 0 2024-05-09T00:07:44.002 INFO:tasks.workunit.client.0.smithi026.stdout:0/466: fsync d1d/d25/d47/f5a 0 2024-05-09T00:07:44.003 INFO:tasks.workunit.client.1.smithi135.stdout:9/970: link d1/d1a/d89/dad/ld4 d1/d24/d44/daf/d136/l141 0 2024-05-09T00:07:44.003 INFO:tasks.workunit.client.1.smithi135.stdout:9/971: chown d1/d1a/d2c/f28 14980233 1 2024-05-09T00:07:44.003 INFO:tasks.workunit.client.1.smithi135.stdout:9/972: write d1/d1a/d2c/d2d/de6/d6e/fbc [214154,31669] 0 2024-05-09T00:07:44.005 INFO:tasks.workunit.client.0.smithi026.stdout:2/285: dread f5 [0,4194304] 0 2024-05-09T00:07:44.005 INFO:tasks.workunit.client.0.smithi026.stdout:2/286: truncate d14/d15/f25 4331461 0 2024-05-09T00:07:44.005 INFO:tasks.workunit.client.0.smithi026.stdout:2/287: write d14/d15/d30/d6a/f63 [40038,83524] 0 2024-05-09T00:07:44.014 INFO:tasks.workunit.client.0.smithi026.stdout:9/403: mknod d7/d26/c94 0 2024-05-09T00:07:44.016 INFO:tasks.workunit.client.0.smithi026.stdout:7/498: mkdir d8/d2e/d55/d95/db0 0 2024-05-09T00:07:44.016 INFO:tasks.workunit.client.0.smithi026.stdout:7/499: truncate d8/d2e/d55/d1e/d3d/d6b/f88 191985 0 2024-05-09T00:07:44.016 INFO:tasks.workunit.client.0.smithi026.stdout:7/500: chown d8/d2e/d55/d1e/d3d/d6b/f88 2847635 1 2024-05-09T00:07:44.020 INFO:tasks.workunit.client.1.smithi135.stdout:0/979: mkdir d3/dd/d2d/db5/df4/d127 0 2024-05-09T00:07:44.021 INFO:tasks.workunit.client.0.smithi026.stdout:3/325: getdents d5/d9/dc/d28 0 2024-05-09T00:07:44.022 INFO:tasks.workunit.client.1.smithi135.stdout:9/973: dwrite d1/d24/d44/d7f/da2/dca/d113/d12c/f12d [0,4194304] 0 2024-05-09T00:07:44.024 INFO:tasks.workunit.client.1.smithi135.stdout:4/948: rename dc/dd/l1c to dc/d71/d86/d10a/l139 0 2024-05-09T00:07:44.024 INFO:tasks.workunit.client.0.smithi026.stdout:0/467: getdents d1d/d33 0 2024-05-09T00:07:44.032 INFO:tasks.workunit.client.1.smithi135.stdout:0/980: mknod d3/d112/c128 0 2024-05-09T00:07:44.032 INFO:tasks.workunit.client.1.smithi135.stdout:0/981: write d3/dd/d3f/d43/f53 [879562,94810] 0 2024-05-09T00:07:44.032 INFO:tasks.workunit.client.1.smithi135.stdout:0/982: truncate d3/dd/d3f/d58/dae/fb9 985601 0 2024-05-09T00:07:44.032 INFO:tasks.workunit.client.1.smithi135.stdout:0/983: write d3/dd/d3f/d43/da3/dea/f11b [946906,48011] 0 2024-05-09T00:07:44.033 INFO:tasks.workunit.client.0.smithi026.stdout:2/288: truncate d14/d15/d20/f23 2361115 0 2024-05-09T00:07:44.042 INFO:tasks.workunit.client.0.smithi026.stdout:7/501: truncate d8/f1f 1023971 0 2024-05-09T00:07:44.042 INFO:tasks.workunit.client.0.smithi026.stdout:9/404: dwrite d7/d23/d29/f30 [0,4194304] 0 2024-05-09T00:07:44.044 INFO:tasks.workunit.client.1.smithi135.stdout:4/949: rename dc/d26/df4/f48 to dc/d26/d4e/f13a 0 2024-05-09T00:07:44.045 INFO:tasks.workunit.client.1.smithi135.stdout:9/974: dwrite d1/d1a/d10/db3/f123 [0,4194304] 0 2024-05-09T00:07:44.045 INFO:tasks.workunit.client.1.smithi135.stdout:9/975: fsync d1/d1a/d10/f90 0 2024-05-09T00:07:44.045 INFO:tasks.workunit.client.0.smithi026.stdout:0/468: dwrite d1d/d1e/d20/d51/f86 [0,4194304] 0 2024-05-09T00:07:44.049 INFO:tasks.workunit.client.1.smithi135.stdout:0/984: creat d3/dd/d2d/d4c/dee/f129 x:0 0 0 2024-05-09T00:07:44.052 INFO:tasks.workunit.client.0.smithi026.stdout:3/326: rename d5/d41/c65 to d5/d9/d49/c6b 0 2024-05-09T00:07:44.052 INFO:tasks.workunit.client.1.smithi135.stdout:1/980: sync 2024-05-09T00:07:44.056 INFO:tasks.workunit.client.1.smithi135.stdout:9/976: mkdir d1/d24/d44/d7f/da2/d142 0 2024-05-09T00:07:44.061 INFO:tasks.workunit.client.1.smithi135.stdout:0/985: dread d3/dd/d3f/d43/f69 [0,4194304] 0 2024-05-09T00:07:44.062 INFO:tasks.workunit.client.0.smithi026.stdout:9/405: dwrite d7/d23/d29/d2e/f47 [0,4194304] 0 2024-05-09T00:07:44.065 INFO:tasks.workunit.client.1.smithi135.stdout:1/981: creat da/db/d16/f153 x:0 0 0 2024-05-09T00:07:44.068 INFO:tasks.workunit.client.1.smithi135.stdout:9/977: mkdir d1/d24/d44/d7f/da2/dca/d113/d12c/d143 0 2024-05-09T00:07:44.068 INFO:tasks.workunit.client.1.smithi135.stdout:2/970: sync 2024-05-09T00:07:44.069 INFO:tasks.workunit.client.1.smithi135.stdout:2/971: fsync d1/d12/d21/f38 0 2024-05-09T00:07:44.070 INFO:tasks.workunit.client.0.smithi026.stdout:3/327: dwrite d5/d9/dc/f1b [0,4194304] 0 2024-05-09T00:07:44.071 INFO:tasks.workunit.client.1.smithi135.stdout:0/986: symlink d3/d112/l12a 0 2024-05-09T00:07:44.072 INFO:tasks.workunit.client.0.smithi026.stdout:2/289: mkdir d14/d15/d30/d6a/d5f/d61/d6c 0 2024-05-09T00:07:44.073 INFO:tasks.workunit.client.1.smithi135.stdout:2/972: read d1/d12/d21/f38 [147086,67487] 0 2024-05-09T00:07:44.074 INFO:tasks.workunit.client.1.smithi135.stdout:0/987: write d3/dd/fc0 [2040688,123228] 0 2024-05-09T00:07:44.074 INFO:tasks.workunit.client.1.smithi135.stdout:0/988: fsync d3/d9e/fa2 0 2024-05-09T00:07:44.074 INFO:tasks.workunit.client.1.smithi135.stdout:1/982: truncate da/d14/d20/d38/d86/fd1 406332 0 2024-05-09T00:07:44.075 INFO:tasks.workunit.client.1.smithi135.stdout:2/973: read d1/d12/d27/f62 [1588642,81523] 0 2024-05-09T00:07:44.079 INFO:tasks.workunit.client.1.smithi135.stdout:9/978: symlink d1/l144 0 2024-05-09T00:07:44.084 INFO:tasks.workunit.client.1.smithi135.stdout:2/974: rmdir d1/d22/d63 39 2024-05-09T00:07:44.085 INFO:tasks.workunit.client.1.smithi135.stdout:2/975: write d1/d12/d21/d57/fa2 [1743336,67364] 0 2024-05-09T00:07:44.086 INFO:tasks.workunit.client.0.smithi026.stdout:9/406: dwrite d7/f19 [0,4194304] 0 2024-05-09T00:07:44.086 INFO:tasks.workunit.client.0.smithi026.stdout:9/407: chown d7/d23/d2f/d3a/c51 27234 1 2024-05-09T00:07:44.089 INFO:tasks.workunit.client.0.smithi026.stdout:0/469: rename d1d/d25/d3c/f70 to d1d/d1e/d20/d4d/d58/d62/d78/f99 0 2024-05-09T00:07:44.090 INFO:tasks.workunit.client.1.smithi135.stdout:9/979: dread d1/d1a/f67 [0,4194304] 0 2024-05-09T00:07:44.090 INFO:tasks.workunit.client.1.smithi135.stdout:9/980: fdatasync d1/d1a/f29 0 2024-05-09T00:07:44.091 INFO:tasks.workunit.client.1.smithi135.stdout:9/981: write d1/d1a/d89/d99/f11a [756073,16673] 0 2024-05-09T00:07:44.094 INFO:tasks.workunit.client.0.smithi026.stdout:3/328: link f0 d5/d9/dc/d5d/f6c 0 2024-05-09T00:07:44.095 INFO:tasks.workunit.client.0.smithi026.stdout:2/290: mknod d14/d15/d30/d6a/d5f/d61/c6d 0 2024-05-09T00:07:44.097 INFO:tasks.workunit.client.0.smithi026.stdout:3/329: dread d5/d9/dc/f31 [0,4194304] 0 2024-05-09T00:07:44.097 INFO:tasks.workunit.client.0.smithi026.stdout:3/330: chown d5/d9/f42 1200350 1 2024-05-09T00:07:44.097 INFO:tasks.workunit.client.0.smithi026.stdout:9/408: truncate d7/d23/d29/d31/f3d 2976443 0 2024-05-09T00:07:44.097 INFO:tasks.workunit.client.0.smithi026.stdout:9/409: chown d7/d23/f61 124648881 1 2024-05-09T00:07:44.097 INFO:tasks.workunit.client.1.smithi135.stdout:1/983: dwrite da/d24/d27/d33/d7d/ffe [0,4194304] 0 2024-05-09T00:07:44.097 INFO:tasks.workunit.client.1.smithi135.stdout:0/989: dwrite d3/dd/d3f/d43/f69 [0,4194304] 0 2024-05-09T00:07:44.097 INFO:tasks.workunit.client.1.smithi135.stdout:1/984: truncate da/db/d16/df2/f10a 869700 0 2024-05-09T00:07:44.097 INFO:tasks.workunit.client.1.smithi135.stdout:1/985: dread - da/db/feb zero size 2024-05-09T00:07:44.098 INFO:tasks.workunit.client.1.smithi135.stdout:2/976: dread d1/d12/d20/d3b/d40/f8a [0,4194304] 0 2024-05-09T00:07:44.098 INFO:tasks.workunit.client.0.smithi026.stdout:0/470: mknod d1d/d25/d47/c9a 0 2024-05-09T00:07:44.098 INFO:tasks.workunit.client.0.smithi026.stdout:0/471: fsync d1d/d1e/f69 0 2024-05-09T00:07:44.101 INFO:tasks.workunit.client.1.smithi135.stdout:9/982: dread d1/d24/d44/d54/f69 [0,4194304] 0 2024-05-09T00:07:44.101 INFO:tasks.workunit.client.1.smithi135.stdout:9/983: write d1/fc9 [4213,88798] 0 2024-05-09T00:07:44.101 INFO:tasks.workunit.client.0.smithi026.stdout:2/291: symlink d14/d15/d17/l6e 0 2024-05-09T00:07:44.101 INFO:tasks.workunit.client.0.smithi026.stdout:2/292: readlink d14/d15/d3b/l46 0 2024-05-09T00:07:44.101 INFO:tasks.workunit.client.0.smithi026.stdout:2/293: dread - d14/d15/d20/f2a zero size 2024-05-09T00:07:44.103 INFO:tasks.workunit.client.1.smithi135.stdout:0/990: truncate d3/dd/d3f/d29/f2e 4821086 0 2024-05-09T00:07:44.104 INFO:tasks.workunit.client.1.smithi135.stdout:0/991: read d3/dd/d3f/f27 [3978549,82863] 0 2024-05-09T00:07:44.104 INFO:tasks.workunit.client.1.smithi135.stdout:0/992: stat d3/dd/d2d/db5/df4/c9f 0 2024-05-09T00:07:44.104 INFO:tasks.workunit.client.1.smithi135.stdout:0/993: truncate d3/dd/d3f/d43/da3/fa6 712731 0 2024-05-09T00:07:44.104 INFO:tasks.workunit.client.1.smithi135.stdout:0/994: fsync d3/dd/d2d/db5/df4/fa8 0 2024-05-09T00:07:44.105 INFO:tasks.workunit.client.1.smithi135.stdout:1/986: symlink da/d24/d27/d33/d52/d71/d8d/d104/l154 0 2024-05-09T00:07:44.109 INFO:tasks.workunit.client.1.smithi135.stdout:2/977: symlink d1/d22/l149 0 2024-05-09T00:07:44.110 INFO:tasks.workunit.client.0.smithi026.stdout:3/331: unlink d5/d9/dc/f18 0 2024-05-09T00:07:44.110 INFO:tasks.workunit.client.0.smithi026.stdout:3/332: readlink d5/d1e/l3a 0 2024-05-09T00:07:44.113 INFO:tasks.workunit.client.0.smithi026.stdout:9/410: creat d7/d26/f95 x:0 0 0 2024-05-09T00:07:44.113 INFO:tasks.workunit.client.1.smithi135.stdout:9/984: creat d1/d24/d44/d7f/da2/dca/d113/d12c/d143/f145 x:0 0 0 2024-05-09T00:07:44.119 INFO:tasks.workunit.client.0.smithi026.stdout:0/472: rename d1d/d1e/d20/d4d/d83/c89 to d1d/d25/c9b 0 2024-05-09T00:07:44.121 INFO:tasks.workunit.client.1.smithi135.stdout:1/987: dwrite da/db/d16/f6c [0,4194304] 0 2024-05-09T00:07:44.122 INFO:tasks.workunit.client.1.smithi135.stdout:0/995: symlink d3/dd/d3f/d43/da3/d10b/d11c/l12b 0 2024-05-09T00:07:44.122 INFO:tasks.workunit.client.1.smithi135.stdout:0/996: fdatasync d3/dd/d3f/d3a/da4/de2/ff9 0 2024-05-09T00:07:44.122 INFO:tasks.workunit.client.0.smithi026.stdout:2/294: symlink d14/d15/d30/d6a/l6f 0 2024-05-09T00:07:44.122 INFO:tasks.workunit.client.0.smithi026.stdout:2/295: fsync d14/d15/f25 0 2024-05-09T00:07:44.123 INFO:tasks.workunit.client.0.smithi026.stdout:2/296: chown d14/d15/f39 3 1 2024-05-09T00:07:44.124 INFO:tasks.workunit.client.0.smithi026.stdout:3/333: creat d5/d9/f6d x:0 0 0 2024-05-09T00:07:44.124 INFO:tasks.workunit.client.0.smithi026.stdout:3/334: chown d5/d9/dc/d28/d2c/f58 154 1 2024-05-09T00:07:44.125 INFO:tasks.workunit.client.1.smithi135.stdout:2/978: unlink d1/d12/d20/d2b/d56/d86/fad 0 2024-05-09T00:07:44.126 INFO:tasks.workunit.client.1.smithi135.stdout:0/997: read d3/fff [467007,111822] 0 2024-05-09T00:07:44.127 INFO:tasks.workunit.client.0.smithi026.stdout:0/473: mknod d1d/d1e/c9c 0 2024-05-09T00:07:44.128 INFO:tasks.workunit.client.1.smithi135.stdout:1/988: mknod da/d14/d20/d38/d3a/d40/d75/c155 0 2024-05-09T00:07:44.129 INFO:tasks.workunit.client.1.smithi135.stdout:1/989: chown da/d24/d27/d33/d52/d71/f87 30699 1 2024-05-09T00:07:44.130 INFO:tasks.workunit.client.0.smithi026.stdout:0/474: read f11 [122379,121914] 0 2024-05-09T00:07:44.133 INFO:tasks.workunit.client.1.smithi135.stdout:9/985: dwrite d1/da4/ff8 [0,4194304] 0 2024-05-09T00:07:44.133 INFO:tasks.workunit.client.1.smithi135.stdout:9/986: fdatasync d1/fe1 0 2024-05-09T00:07:44.134 INFO:tasks.workunit.client.0.smithi026.stdout:9/411: dwrite d7/d23/d29/d31/d40/d41/d54/d5c/f7a [0,4194304] 0 2024-05-09T00:07:44.134 INFO:tasks.workunit.client.0.smithi026.stdout:9/412: chown d7/d26/f71 10 1 2024-05-09T00:07:44.135 INFO:tasks.workunit.client.0.smithi026.stdout:2/297: dread d14/d22/d55/f67 [0,4194304] 0 2024-05-09T00:07:44.135 INFO:tasks.workunit.client.0.smithi026.stdout:2/298: truncate d14/d15/d3b/d40/f66 38062 0 2024-05-09T00:07:44.136 INFO:tasks.workunit.client.0.smithi026.stdout:0/475: mknod d1d/d25/d3c/d5f/c9d 0 2024-05-09T00:07:44.136 INFO:tasks.workunit.client.0.smithi026.stdout:3/335: dread f2 [0,4194304] 0 2024-05-09T00:07:44.141 INFO:tasks.workunit.client.1.smithi135.stdout:2/979: rmdir d1/d12/d20/d2b/d56/d86/d130 0 2024-05-09T00:07:44.144 INFO:tasks.workunit.client.0.smithi026.stdout:9/413: symlink d7/d23/d2f/d3a/l96 0 2024-05-09T00:07:44.148 INFO:tasks.workunit.client.0.smithi026.stdout:0/476: mkdir d1d/d1e/d20/d4d/d83/d9e 0 2024-05-09T00:07:44.148 INFO:tasks.workunit.client.0.smithi026.stdout:0/477: fdatasync d1d/d25/f2b 0 2024-05-09T00:07:44.150 INFO:tasks.workunit.client.0.smithi026.stdout:9/414: creat d7/d23/d29/d59/f97 x:0 0 0 2024-05-09T00:07:44.150 INFO:tasks.workunit.client.0.smithi026.stdout:9/415: chown f2 86 1 2024-05-09T00:07:44.152 INFO:tasks.workunit.client.1.smithi135.stdout:0/998: dwrite d3/dd/d3f/d58/f63 [0,4194304] 0 2024-05-09T00:07:44.153 INFO:tasks.workunit.client.0.smithi026.stdout:2/299: mkdir d14/d15/d1f/d70 0 2024-05-09T00:07:44.153 INFO:tasks.workunit.client.0.smithi026.stdout:2/300: chown d14/d15/d20/f23 1 1 2024-05-09T00:07:44.154 INFO:tasks.workunit.client.1.smithi135.stdout:1/990: dwrite da/d14/d20/d38/d3a/db7/de9/dfd/f11e [0,4194304] 0 2024-05-09T00:07:44.155 INFO:tasks.workunit.client.1.smithi135.stdout:1/991: chown da/d24/ff9 8481 1 2024-05-09T00:07:44.155 INFO:tasks.workunit.client.1.smithi135.stdout:1/992: read - da/d14/d20/d2c/f150 zero size 2024-05-09T00:07:44.155 INFO:tasks.workunit.client.0.smithi026.stdout:0/478: rename d1d/d25/d47/c9a to d1d/d25/d3c/c9f 0 2024-05-09T00:07:44.155 INFO:tasks.workunit.client.0.smithi026.stdout:0/479: write d1d/d25/f55 [129990,109252] 0 2024-05-09T00:07:44.156 INFO:tasks.workunit.client.0.smithi026.stdout:3/336: dwrite d5/d9/f2a [0,4194304] 0 2024-05-09T00:07:44.156 INFO:tasks.workunit.client.0.smithi026.stdout:3/337: write d5/d9/dc/f23 [60999,70262] 0 2024-05-09T00:07:44.157 INFO:tasks.workunit.client.0.smithi026.stdout:2/301: write d14/f18 [319403,125972] 0 2024-05-09T00:07:44.157 INFO:tasks.workunit.client.0.smithi026.stdout:7/502: truncate d8/f1f 562722 0 2024-05-09T00:07:44.161 INFO:tasks.workunit.client.0.smithi026.stdout:9/416: rename d7/d23/d76/f7e to d7/d23/d2f/f98 0 2024-05-09T00:07:44.162 INFO:tasks.workunit.client.0.smithi026.stdout:2/302: dread f5 [0,4194304] 0 2024-05-09T00:07:44.167 INFO:tasks.workunit.client.1.smithi135.stdout:9/987: unlink d1/d1a/l2b 0 2024-05-09T00:07:44.167 INFO:tasks.workunit.client.0.smithi026.stdout:0/480: mkdir d1d/d1e/d20/d4d/d83/da0 0 2024-05-09T00:07:44.170 INFO:tasks.workunit.client.1.smithi135.stdout:0/999: dwrite d3/dd/f7b [4194304,4194304] 0 2024-05-09T00:07:44.174 INFO:tasks.workunit.client.1.smithi135.stdout:2/980: link d1/d12/d20/f99 d1/d12/d20/d3b/f14a 0 2024-05-09T00:07:44.175 INFO:tasks.workunit.client.0.smithi026.stdout:3/338: rmdir d5 39 2024-05-09T00:07:44.175 INFO:tasks.workunit.client.0.smithi026.stdout:3/339: readlink d5/d9/dc/d28/d45/l62 0 2024-05-09T00:07:44.176 INFO:tasks.workunit.client.0.smithi026.stdout:3/340: read d5/d9/dc/d28/f35 [593750,68046] 0 2024-05-09T00:07:44.178 INFO:tasks.workunit.client.0.smithi026.stdout:7/503: rename d8/d2e/c83 to d8/d2e/d55/d1e/d80/da2/cb1 0 2024-05-09T00:07:44.179 INFO:tasks.workunit.client.0.smithi026.stdout:7/504: write f7 [203100,128296] 0 2024-05-09T00:07:44.180 INFO:tasks.workunit.client.1.smithi135.stdout:9/988: dwrite d1/d24/d44/d7f/da2/dca/dea/f121 [0,4194304] 0 2024-05-09T00:07:44.181 INFO:tasks.workunit.client.0.smithi026.stdout:9/417: mkdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99 0 2024-05-09T00:07:44.183 INFO:tasks.workunit.client.0.smithi026.stdout:2/303: creat d14/d15/d20/d41/d51/f71 x:0 0 0 2024-05-09T00:07:44.186 INFO:tasks.workunit.client.0.smithi026.stdout:0/481: link d1d/d25/l73 d1d/d1e/la1 0 2024-05-09T00:07:44.187 INFO:tasks.workunit.client.1.smithi135.stdout:2/981: creat d1/d12/d21/dc7/f14b x:0 0 0 2024-05-09T00:07:44.187 INFO:tasks.workunit.client.0.smithi026.stdout:3/341: truncate d5/d9/dc/d28/f5e 2047903 0 2024-05-09T00:07:44.188 INFO:tasks.workunit.client.0.smithi026.stdout:0/482: write d1d/d25/d47/d6e/f8e [1759266,69083] 0 2024-05-09T00:07:44.195 INFO:tasks.workunit.client.1.smithi135.stdout:9/989: mknod d1/d24/d44/d7f/c146 0 2024-05-09T00:07:44.195 INFO:tasks.workunit.client.1.smithi135.stdout:9/990: truncate d1/d1a/d89/d99/fc4 4800516 0 2024-05-09T00:07:44.197 INFO:tasks.workunit.client.1.smithi135.stdout:2/982: link d1/d12/d21/d57/d10b/d119/c131 d1/d12/d21/de6/c14c 0 2024-05-09T00:07:44.197 INFO:tasks.workunit.client.1.smithi135.stdout:4/950: sync 2024-05-09T00:07:44.197 INFO:tasks.workunit.client.1.smithi135.stdout:4/951: stat dc/ld9 0 2024-05-09T00:07:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:4/309: sync 2024-05-09T00:07:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:8/371: sync 2024-05-09T00:07:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:6/299: sync 2024-05-09T00:07:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:5/316: sync 2024-05-09T00:07:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:4/310: dread - d0/d19/d43/d58/f69 zero size 2024-05-09T00:07:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:5/317: write d2/f44 [724867,5903] 0 2024-05-09T00:07:44.199 INFO:tasks.workunit.client.0.smithi026.stdout:1/376: sync 2024-05-09T00:07:44.199 INFO:tasks.workunit.client.0.smithi026.stdout:1/377: read d5/db/d1d/f48 [53706,85354] 0 2024-05-09T00:07:44.200 INFO:tasks.workunit.client.1.smithi135.stdout:9/991: mkdir d1/d1a/d89/dad/de3/d147 0 2024-05-09T00:07:44.201 INFO:tasks.workunit.client.1.smithi135.stdout:4/952: write dc/d26/d93/d9d/d101/f115 [2971945,24899] 0 2024-05-09T00:07:44.201 INFO:tasks.workunit.client.1.smithi135.stdout:4/953: stat dc/d26/d93/d124/d5f/f84 0 2024-05-09T00:07:44.203 INFO:tasks.workunit.client.0.smithi026.stdout:7/505: dwrite d8/d1b/d89/fa6 [0,4194304] 0 2024-05-09T00:07:44.203 INFO:tasks.workunit.client.0.smithi026.stdout:3/342: dwrite d5/d9/f6d [0,4194304] 0 2024-05-09T00:07:44.205 INFO:tasks.workunit.client.0.smithi026.stdout:6/300: dread d15/d1e/d3d/d4c/f40 [0,4194304] 0 2024-05-09T00:07:44.208 INFO:tasks.workunit.client.1.smithi135.stdout:9/992: symlink d1/d24/d44/d7f/da2/dca/l148 0 2024-05-09T00:07:44.210 INFO:tasks.workunit.client.0.smithi026.stdout:0/483: creat d1d/d1e/d20/d4d/d83/fa2 x:0 0 0 2024-05-09T00:07:44.210 INFO:tasks.workunit.client.0.smithi026.stdout:0/484: fsync d1d/d1e/f69 0 2024-05-09T00:07:44.211 INFO:tasks.workunit.client.0.smithi026.stdout:9/418: mkdir d7/d23/d29/d31/d40/d41/d54/d9a 0 2024-05-09T00:07:44.212 INFO:tasks.workunit.client.1.smithi135.stdout:9/993: truncate d1/d1a/d2c/d20/f9c 2003178 0 2024-05-09T00:07:44.213 INFO:tasks.workunit.client.0.smithi026.stdout:4/311: mknod d0/d19/d43/d58/c6d 0 2024-05-09T00:07:44.217 INFO:tasks.workunit.client.1.smithi135.stdout:2/983: dwrite d1/d12/d20/d3b/d40/f5e [0,4194304] 0 2024-05-09T00:07:44.217 INFO:tasks.workunit.client.0.smithi026.stdout:0/485: dread d1d/d1e/d20/d51/f57 [0,4194304] 0 2024-05-09T00:07:44.220 INFO:tasks.workunit.client.0.smithi026.stdout:7/506: rename d8/d1b/d8f to d8/d2e/d55/d1e/d3d/d6b/db2 0 2024-05-09T00:07:44.224 INFO:tasks.workunit.client.1.smithi135.stdout:9/994: dread d1/d24/d86/d97/ff5 [0,4194304] 0 2024-05-09T00:07:44.227 INFO:tasks.workunit.client.0.smithi026.stdout:1/378: dread d5/d16/f18 [0,4194304] 0 2024-05-09T00:07:44.227 INFO:tasks.workunit.client.0.smithi026.stdout:1/379: stat d5/db/d1d 0 2024-05-09T00:07:44.228 INFO:tasks.workunit.client.1.smithi135.stdout:2/984: link d1/d12/d20/d2b/d56/f103 d1/d12/d20/d2b/dbb/f14d 0 2024-05-09T00:07:44.228 INFO:tasks.workunit.client.0.smithi026.stdout:2/304: dread f4 [0,4194304] 0 2024-05-09T00:07:44.230 INFO:tasks.workunit.client.0.smithi026.stdout:6/301: mkdir d15/d62 0 2024-05-09T00:07:44.233 INFO:tasks.workunit.client.1.smithi135.stdout:9/995: rename d1/d24/d86/d97/ff5 to d1/d24/f149 0 2024-05-09T00:07:44.235 INFO:tasks.workunit.client.0.smithi026.stdout:9/419: unlink d7/d23/d29/d59/f60 0 2024-05-09T00:07:44.236 INFO:tasks.workunit.client.0.smithi026.stdout:9/420: write d7/d26/f6b [732837,40013] 0 2024-05-09T00:07:44.237 INFO:tasks.workunit.client.1.smithi135.stdout:4/954: dwrite dc/d26/d93/d124/d5f/f6b [0,4194304] 0 2024-05-09T00:07:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:5/318: dwrite d2/d8/d31/d24/f62 [4194304,4194304] 0 2024-05-09T00:07:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:5/319: dread - d2/d8/d31/d2e/d33/f68 zero size 2024-05-09T00:07:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:5/320: truncate d2/d8/d31/d24/f52 977654 0 2024-05-09T00:07:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:5/321: read - d2/d8/d2a/f58 zero size 2024-05-09T00:07:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:8/372: dwrite de/f1e [0,4194304] 0 2024-05-09T00:07:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:4/312: truncate d0/fc 6977094 0 2024-05-09T00:07:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:4/313: chown d0/f4c 14 1 2024-05-09T00:07:44.239 INFO:tasks.workunit.client.1.smithi135.stdout:2/985: symlink d1/d12/d20/d2b/d56/d115/l14e 0 2024-05-09T00:07:44.241 INFO:tasks.workunit.client.0.smithi026.stdout:0/486: unlink f4 0 2024-05-09T00:07:44.243 INFO:tasks.workunit.client.1.smithi135.stdout:9/996: truncate d1/d1a/d2c/d2d/de6/f11e 3963509 0 2024-05-09T00:07:44.243 INFO:tasks.workunit.client.1.smithi135.stdout:2/986: write d1/d12/d20/f54 [3736736,79681] 0 2024-05-09T00:07:44.244 INFO:tasks.workunit.client.1.smithi135.stdout:2/987: stat d1/l9b 0 2024-05-09T00:07:44.245 INFO:tasks.workunit.client.0.smithi026.stdout:7/507: unlink d8/d1b/d89/f8e 0 2024-05-09T00:07:44.245 INFO:tasks.workunit.client.0.smithi026.stdout:7/508: write d8/d2e/d55/d1e/d3d/f48 [1989830,48052] 0 2024-05-09T00:07:44.247 INFO:tasks.workunit.client.0.smithi026.stdout:4/314: dread d0/d19/f2f [0,4194304] 0 2024-05-09T00:07:44.248 INFO:tasks.workunit.client.0.smithi026.stdout:1/380: dwrite f3 [0,4194304] 0 2024-05-09T00:07:44.256 INFO:tasks.workunit.client.0.smithi026.stdout:6/302: mknod d15/d1e/d30/c63 0 2024-05-09T00:07:44.257 INFO:tasks.workunit.client.1.smithi135.stdout:4/955: mknod dc/d26/d93/d9d/c13b 0 2024-05-09T00:07:44.257 INFO:tasks.workunit.client.1.smithi135.stdout:4/956: write dc/d26/d31/f99 [6204740,34003] 0 2024-05-09T00:07:44.259 INFO:tasks.workunit.client.1.smithi135.stdout:9/997: mknod d1/d24/d86/d10d/c14a 0 2024-05-09T00:07:44.260 INFO:tasks.workunit.client.1.smithi135.stdout:9/998: read d1/d24/d44/d54/fa8 [243867,47764] 0 2024-05-09T00:07:44.262 INFO:tasks.workunit.client.1.smithi135.stdout:2/988: creat d1/d12/da3/f14f x:0 0 0 2024-05-09T00:07:44.263 INFO:tasks.workunit.client.0.smithi026.stdout:5/322: rmdir d2/d8/d31/d24 39 2024-05-09T00:07:44.263 INFO:tasks.workunit.client.0.smithi026.stdout:5/323: chown d2/d8/d31/d24/c3a 37882 1 2024-05-09T00:07:44.267 INFO:tasks.workunit.client.1.smithi135.stdout:4/957: creat dc/d26/d31/db8/dd1/ddd/f13c x:0 0 0 2024-05-09T00:07:44.270 INFO:tasks.workunit.client.1.smithi135.stdout:4/958: read dc/d4a/f120 [169742,56253] 0 2024-05-09T00:07:44.272 INFO:tasks.workunit.client.1.smithi135.stdout:9/999: creat d1/d1a/d89/f14b x:0 0 0 2024-05-09T00:07:44.274 INFO:tasks.workunit.client.0.smithi026.stdout:1/381: dwrite d5/d16/f72 [0,4194304] 0 2024-05-09T00:07:44.275 INFO:tasks.workunit.client.1.smithi135.stdout:4/959: symlink dc/d71/d90/dce/l13d 0 2024-05-09T00:07:44.280 INFO:tasks.workunit.client.0.smithi026.stdout:8/373: fsync de/d17/d21/d24/d3b/d3d/f5f 0 2024-05-09T00:07:44.282 INFO:tasks.workunit.client.0.smithi026.stdout:0/487: mknod d1d/d1e/ca3 0 2024-05-09T00:07:44.282 INFO:tasks.workunit.client.0.smithi026.stdout:0/488: read - d1d/d1e/d2d/f77 zero size 2024-05-09T00:07:44.282 INFO:tasks.workunit.client.0.smithi026.stdout:0/489: fsync d1d/d25/f54 0 2024-05-09T00:07:44.284 INFO:tasks.workunit.client.0.smithi026.stdout:6/303: dwrite d15/f18 [0,4194304] 0 2024-05-09T00:07:44.284 INFO:tasks.workunit.client.0.smithi026.stdout:0/490: write d1d/d1e/d20/d51/f86 [2813628,91451] 0 2024-05-09T00:07:44.285 INFO:tasks.workunit.client.1.smithi135.stdout:1/993: sync 2024-05-09T00:07:44.285 INFO:tasks.workunit.client.1.smithi135.stdout:1/994: chown da/d24/d27/d33/d52/d71/d8d/d104/l154 132563627 1 2024-05-09T00:07:44.285 INFO:tasks.workunit.client.0.smithi026.stdout:2/305: mknod d14/c72 0 2024-05-09T00:07:44.286 INFO:tasks.workunit.client.1.smithi135.stdout:4/960: dread dc/d4a/f120 [0,4194304] 0 2024-05-09T00:07:44.287 INFO:tasks.workunit.client.0.smithi026.stdout:9/421: link d7/d23/c43 d7/d23/d29/d31/d40/d41/d54/c9b 0 2024-05-09T00:07:44.287 INFO:tasks.workunit.client.1.smithi135.stdout:2/989: dwrite d1/d12/d21/d41/d6d/f106 [0,4194304] 0 2024-05-09T00:07:44.289 INFO:tasks.workunit.client.1.smithi135.stdout:1/995: unlink da/d14/d20/d2c/l50 0 2024-05-09T00:07:44.290 INFO:tasks.workunit.client.0.smithi026.stdout:1/382: dread d5/db/f1e [0,4194304] 0 2024-05-09T00:07:44.290 INFO:tasks.workunit.client.1.smithi135.stdout:4/961: write fa [2069481,18027] 0 2024-05-09T00:07:44.291 INFO:tasks.workunit.client.0.smithi026.stdout:5/324: creat d2/d8/d2a/d4e/f6b x:0 0 0 2024-05-09T00:07:44.296 INFO:tasks.workunit.client.1.smithi135.stdout:2/990: mknod d1/d12/d21/d41/d6d/d6e/dc6/c150 0 2024-05-09T00:07:44.296 INFO:tasks.workunit.client.1.smithi135.stdout:2/991: chown d1/d12/d21/l39 12 1 2024-05-09T00:07:44.299 INFO:tasks.workunit.client.1.smithi135.stdout:1/996: mkdir da/d14/d20/d38/d3a/db7/de9/dfd/d156 0 2024-05-09T00:07:44.299 INFO:tasks.workunit.client.1.smithi135.stdout:1/997: stat da/d14/d20/d38/d3a/f147 0 2024-05-09T00:07:44.300 INFO:tasks.workunit.client.0.smithi026.stdout:8/374: creat de/d48/d3e/d54/f79 x:0 0 0 2024-05-09T00:07:44.302 INFO:tasks.workunit.client.1.smithi135.stdout:4/962: symlink dc/d71/d86/l13e 0 2024-05-09T00:07:44.303 INFO:tasks.workunit.client.1.smithi135.stdout:4/963: dread dc/d26/d93/d124/fab [0,4194304] 0 2024-05-09T00:07:44.303 INFO:tasks.workunit.client.1.smithi135.stdout:4/964: truncate dc/d4a/d8c/da5/fd5 753532 0 2024-05-09T00:07:44.305 INFO:tasks.workunit.client.1.smithi135.stdout:2/992: creat d1/d12/d20/d2b/d7c/db5/f151 x:0 0 0 2024-05-09T00:07:44.305 INFO:tasks.workunit.client.1.smithi135.stdout:2/993: write d1/d12/d21/d57/f6c [4699203,52492] 0 2024-05-09T00:07:44.307 INFO:tasks.workunit.client.0.smithi026.stdout:6/304: rename fa to d15/d62/f64 0 2024-05-09T00:07:44.307 INFO:tasks.workunit.client.0.smithi026.stdout:6/305: chown d15/d1e/c44 0 1 2024-05-09T00:07:44.309 INFO:tasks.workunit.client.1.smithi135.stdout:1/998: symlink da/dce/l157 0 2024-05-09T00:07:44.309 INFO:tasks.workunit.client.1.smithi135.stdout:1/999: chown da/d24/d27/d33/d52/l11d 1868 1 2024-05-09T00:07:44.310 INFO:tasks.workunit.client.0.smithi026.stdout:0/491: mkdir d1d/da4 0 2024-05-09T00:07:44.310 INFO:tasks.workunit.client.0.smithi026.stdout:0/492: dread - d1d/d1e/d2d/f77 zero size 2024-05-09T00:07:44.311 INFO:tasks.workunit.client.1.smithi135.stdout:4/965: rmdir dc/d71/d86 39 2024-05-09T00:07:44.311 INFO:tasks.workunit.client.1.smithi135.stdout:4/966: fdatasync dc/d71/f91 0 2024-05-09T00:07:44.313 INFO:tasks.workunit.client.0.smithi026.stdout:9/422: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/f9c x:0 0 0 2024-05-09T00:07:44.315 INFO:tasks.workunit.client.1.smithi135.stdout:4/967: read dc/d26/d31/f100 [3960002,85318] 0 2024-05-09T00:07:44.316 INFO:tasks.workunit.client.0.smithi026.stdout:8/375: dwrite de/d17/f1a [4194304,4194304] 0 2024-05-09T00:07:44.316 INFO:tasks.workunit.client.0.smithi026.stdout:1/383: unlink d5/l5c 0 2024-05-09T00:07:44.317 INFO:tasks.workunit.client.1.smithi135.stdout:2/994: mknod d1/d12/d20/c152 0 2024-05-09T00:07:44.317 INFO:tasks.workunit.client.1.smithi135.stdout:2/995: chown d1/l14 356 1 2024-05-09T00:07:44.318 INFO:tasks.workunit.client.0.smithi026.stdout:5/325: getdents d2/d5a 0 2024-05-09T00:07:44.321 INFO:tasks.workunit.client.1.smithi135.stdout:4/968: creat dc/d26/d93/d9d/f13f x:0 0 0 2024-05-09T00:07:44.322 INFO:tasks.workunit.client.1.smithi135.stdout:2/996: creat d1/d12/d20/d3b/d105/d145/f153 x:0 0 0 2024-05-09T00:07:44.322 INFO:tasks.workunit.client.0.smithi026.stdout:6/306: dwrite d15/d34/f53 [0,4194304] 0 2024-05-09T00:07:44.325 INFO:tasks.workunit.client.0.smithi026.stdout:2/306: rename d14/d15/d17/l2c to d14/d15/d3b/d40/l73 0 2024-05-09T00:07:44.326 INFO:tasks.workunit.client.1.smithi135.stdout:4/969: mkdir dc/d26/d31/d140 0 2024-05-09T00:07:44.326 INFO:tasks.workunit.client.1.smithi135.stdout:4/970: readlink dc/lf 0 2024-05-09T00:07:44.327 INFO:tasks.workunit.client.1.smithi135.stdout:4/971: dread - dc/d4a/d8c/da5/fed zero size 2024-05-09T00:07:44.327 INFO:tasks.workunit.client.0.smithi026.stdout:0/493: rmdir d1d/d25/d3c/d5f 39 2024-05-09T00:07:44.327 INFO:tasks.workunit.client.0.smithi026.stdout:0/494: chown d1d/d33/f38 59 1 2024-05-09T00:07:44.330 INFO:tasks.workunit.client.0.smithi026.stdout:9/423: mknod d7/d23/c9d 0 2024-05-09T00:07:44.332 INFO:tasks.workunit.client.1.smithi135.stdout:4/972: mkdir dc/d26/d31/d141 0 2024-05-09T00:07:44.336 INFO:tasks.workunit.client.1.smithi135.stdout:2/997: link d1/d12/f11d d1/d12/d21/d57/d10b/f154 0 2024-05-09T00:07:44.337 INFO:tasks.workunit.client.0.smithi026.stdout:8/376: creat de/d17/d21/d24/d3b/f7a x:0 0 0 2024-05-09T00:07:44.339 INFO:tasks.workunit.client.0.smithi026.stdout:1/384: symlink d5/db/d1d/l82 0 2024-05-09T00:07:44.341 INFO:tasks.workunit.client.1.smithi135.stdout:2/998: mknod d1/d12/d20/d2b/c155 0 2024-05-09T00:07:44.341 INFO:tasks.workunit.client.1.smithi135.stdout:2/999: write d1/d12/d20/f60 [736205,36398] 0 2024-05-09T00:07:44.344 INFO:tasks.workunit.client.0.smithi026.stdout:2/307: chown d14/d22/d55/f56 83 1 2024-05-09T00:07:44.346 INFO:tasks.workunit.client.0.smithi026.stdout:0/495: mkdir d1d/d25/d47/da5 0 2024-05-09T00:07:44.346 INFO:tasks.workunit.client.0.smithi026.stdout:0/496: dread - d1d/d1e/d2d/f4a zero size 2024-05-09T00:07:44.347 INFO:tasks.workunit.client.0.smithi026.stdout:0/497: chown d1d/d25/d3c/f46 568743369 1 2024-05-09T00:07:44.347 INFO:tasks.workunit.client.0.smithi026.stdout:0/498: dread - d1d/d1e/d20/d51/f90 zero size 2024-05-09T00:07:44.347 INFO:tasks.workunit.client.0.smithi026.stdout:1/385: symlink d5/dd/l83 0 2024-05-09T00:07:44.349 INFO:tasks.workunit.client.0.smithi026.stdout:5/326: mknod d2/c6c 0 2024-05-09T00:07:44.350 INFO:tasks.workunit.client.0.smithi026.stdout:0/499: creat d1d/d33/d64/fa6 x:0 0 0 2024-05-09T00:07:44.353 INFO:tasks.workunit.client.0.smithi026.stdout:1/386: unlink d5/dd/d1f/d39/c46 0 2024-05-09T00:07:44.354 INFO:tasks.workunit.client.0.smithi026.stdout:5/327: mkdir d2/d8/d6d 0 2024-05-09T00:07:44.354 INFO:tasks.workunit.client.0.smithi026.stdout:5/328: dread - d2/d8/d2a/f50 zero size 2024-05-09T00:07:44.355 INFO:tasks.workunit.client.0.smithi026.stdout:5/329: chown d2/d8/c13 238 1 2024-05-09T00:07:44.356 INFO:tasks.workunit.client.0.smithi026.stdout:0/500: mkdir d1d/d1e/d20/d4d/d83/d9e/da7 0 2024-05-09T00:07:44.356 INFO:tasks.workunit.client.0.smithi026.stdout:0/501: write d1d/f5b [1150500,65242] 0 2024-05-09T00:07:44.357 INFO:tasks.workunit.client.0.smithi026.stdout:5/330: mknod d2/d5a/c6e 0 2024-05-09T00:07:44.360 INFO:tasks.workunit.client.0.smithi026.stdout:0/502: link d1d/d33/f61 d1d/d25/d47/d6e/fa8 0 2024-05-09T00:07:44.361 INFO:tasks.workunit.client.0.smithi026.stdout:5/331: symlink d2/d8/d2a/l6f 0 2024-05-09T00:07:44.363 INFO:tasks.workunit.client.0.smithi026.stdout:0/503: mknod d1d/d33/d64/ca9 0 2024-05-09T00:07:44.364 INFO:tasks.workunit.client.0.smithi026.stdout:6/307: dwrite d15/d1e/d23/d26/f28 [0,4194304] 0 2024-05-09T00:07:44.364 INFO:tasks.workunit.client.0.smithi026.stdout:6/308: write d15/d1e/d30/f3f [489477,100683] 0 2024-05-09T00:07:44.364 INFO:tasks.workunit.client.0.smithi026.stdout:6/309: fdatasync d15/d1e/d30/f46 0 2024-05-09T00:07:44.364 INFO:tasks.workunit.client.0.smithi026.stdout:0/504: dread f1b [0,4194304] 0 2024-05-09T00:07:44.364 INFO:tasks.workunit.client.0.smithi026.stdout:0/505: chown d1d/d1e/d20/d4d/d58/d62/d78 18100 1 2024-05-09T00:07:44.367 INFO:tasks.workunit.client.0.smithi026.stdout:6/310: mknod d15/d34/c65 0 2024-05-09T00:07:44.369 INFO:tasks.workunit.client.0.smithi026.stdout:0/506: truncate f11 36588 0 2024-05-09T00:07:44.374 INFO:tasks.workunit.client.0.smithi026.stdout:0/507: symlink d1d/d1e/d20/d4d/d58/d62/d78/d80/laa 0 2024-05-09T00:07:44.375 INFO:tasks.workunit.client.0.smithi026.stdout:8/377: dwrite de/f23 [0,4194304] 0 2024-05-09T00:07:44.375 INFO:tasks.workunit.client.0.smithi026.stdout:9/424: dwrite d7/d23/d76/f8c [4194304,4194304] 0 2024-05-09T00:07:44.375 INFO:tasks.workunit.client.0.smithi026.stdout:9/425: readlink d7/d23/d29/d31/d40/l70 0 2024-05-09T00:07:44.375 INFO:tasks.workunit.client.0.smithi026.stdout:8/378: readlink de/d17/d21/d24/l35 0 2024-05-09T00:07:44.375 INFO:tasks.workunit.client.0.smithi026.stdout:9/426: dread - d7/d23/d29/d59/d91/f92 zero size 2024-05-09T00:07:44.379 INFO:tasks.workunit.client.0.smithi026.stdout:0/508: rename d1d/d1e/d2d/f4a to d1d/d1e/d20/d4d/d58/fab 0 2024-05-09T00:07:44.379 INFO:tasks.workunit.client.0.smithi026.stdout:0/509: dread - d1d/d1e/d20/d51/f6c zero size 2024-05-09T00:07:44.381 INFO:tasks.workunit.client.1.smithi135.stdout:4/973: dwrite dc/d26/d4e/f6e [0,4194304] 0 2024-05-09T00:07:44.382 INFO:tasks.workunit.client.0.smithi026.stdout:8/379: creat de/d6c/d31/d4f/f7b x:0 0 0 2024-05-09T00:07:44.382 INFO:tasks.workunit.client.0.smithi026.stdout:1/387: dwrite d5/dd/f58 [0,4194304] 0 2024-05-09T00:07:44.383 INFO:tasks.workunit.client.0.smithi026.stdout:2/308: dwrite d14/d15/f1b [0,4194304] 0 2024-05-09T00:07:44.383 INFO:tasks.workunit.client.0.smithi026.stdout:2/309: dread - d14/d15/d30/d6a/d5b/f64 zero size 2024-05-09T00:07:44.383 INFO:tasks.workunit.client.0.smithi026.stdout:2/310: read f9 [4203248,40443] 0 2024-05-09T00:07:44.383 INFO:tasks.workunit.client.0.smithi026.stdout:9/427: rmdir d7/d23/d29/d31/d40 39 2024-05-09T00:07:44.384 INFO:tasks.workunit.client.0.smithi026.stdout:5/332: dwrite d2/d8/d31/d4b/d51/f53 [0,4194304] 0 2024-05-09T00:07:44.384 INFO:tasks.workunit.client.0.smithi026.stdout:0/510: read d1d/d25/d3c/d5f/f72 [2215948,128217] 0 2024-05-09T00:07:44.384 INFO:tasks.workunit.client.0.smithi026.stdout:0/511: chown d1d/d25/c9b 11 1 2024-05-09T00:07:44.385 INFO:tasks.workunit.client.1.smithi135.stdout:4/974: truncate dc/d4a/d69/f4c 826492 0 2024-05-09T00:07:44.385 INFO:tasks.workunit.client.0.smithi026.stdout:8/380: dread de/f13 [0,4194304] 0 2024-05-09T00:07:44.386 INFO:tasks.workunit.client.0.smithi026.stdout:9/428: dread d7/f9 [0,4194304] 0 2024-05-09T00:07:44.386 INFO:tasks.workunit.client.0.smithi026.stdout:9/429: readlink d7/d26/l2d 0 2024-05-09T00:07:44.389 INFO:tasks.workunit.client.1.smithi135.stdout:4/975: symlink dc/d110/l142 0 2024-05-09T00:07:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:1/388: dread f4 [0,4194304] 0 2024-05-09T00:07:44.393 INFO:tasks.workunit.client.0.smithi026.stdout:6/311: dwrite d15/d1e/d23/f4a [0,4194304] 0 2024-05-09T00:07:44.393 INFO:tasks.workunit.client.0.smithi026.stdout:6/312: read f11 [707217,119780] 0 2024-05-09T00:07:44.394 INFO:tasks.workunit.client.0.smithi026.stdout:6/313: read f4 [2810295,65574] 0 2024-05-09T00:07:44.394 INFO:tasks.workunit.client.0.smithi026.stdout:6/314: chown d15/d1e/d23 11585 1 2024-05-09T00:07:44.410 INFO:tasks.workunit.client.1.smithi135.stdout:4/976: dread dc/d26/f2a [4194304,4194304] 0 2024-05-09T00:07:44.414 INFO:tasks.workunit.client.0.smithi026.stdout:2/311: dwrite d14/d15/d1f/f38 [0,4194304] 0 2024-05-09T00:07:44.415 INFO:tasks.workunit.client.0.smithi026.stdout:2/312: write f5 [2862352,18419] 0 2024-05-09T00:07:44.446 INFO:tasks.workunit.client.0.smithi026.stdout:5/333: symlink d2/d8/d2a/l70 0 2024-05-09T00:07:44.447 INFO:tasks.workunit.client.0.smithi026.stdout:0/512: unlink d1d/d25/d3c/f79 0 2024-05-09T00:07:44.449 INFO:tasks.workunit.client.1.smithi135.stdout:4/977: link dc/f27 dc/d26/d93/d124/dc9/f143 0 2024-05-09T00:07:44.451 INFO:tasks.workunit.client.1.smithi135.stdout:4/978: write dc/d26/d93/d124/d6d/f94 [3296455,71843] 0 2024-05-09T00:07:44.451 INFO:tasks.workunit.client.0.smithi026.stdout:8/381: creat de/d48/f7c x:0 0 0 2024-05-09T00:07:44.451 INFO:tasks.workunit.client.0.smithi026.stdout:8/382: chown f9 967589979 1 2024-05-09T00:07:44.451 INFO:tasks.workunit.client.0.smithi026.stdout:8/383: chown de/d17/d21/d24/l58 32 1 2024-05-09T00:07:44.454 INFO:tasks.workunit.client.0.smithi026.stdout:9/430: rename d7/f4a to d7/d23/d29/f9e 0 2024-05-09T00:07:44.455 INFO:tasks.workunit.client.1.smithi135.stdout:4/979: mknod dc/d71/de5/c144 0 2024-05-09T00:07:44.455 INFO:tasks.workunit.client.1.smithi135.stdout:4/980: stat dc/d26/d93/d124/d5f/cb2 0 2024-05-09T00:07:44.460 INFO:tasks.workunit.client.0.smithi026.stdout:1/389: symlink d5/dd/l84 0 2024-05-09T00:07:44.460 INFO:tasks.workunit.client.0.smithi026.stdout:1/390: truncate d5/db/f69 937899 0 2024-05-09T00:07:44.460 INFO:tasks.workunit.client.0.smithi026.stdout:1/391: write d5/dd/d1f/f7c [438590,80809] 0 2024-05-09T00:07:44.462 INFO:tasks.workunit.client.1.smithi135.stdout:4/981: truncate dc/d26/d4e/f13a 908478 0 2024-05-09T00:07:44.462 INFO:tasks.workunit.client.1.smithi135.stdout:4/982: write dc/d71/de5/f133 [456228,87686] 0 2024-05-09T00:07:44.465 INFO:tasks.workunit.client.0.smithi026.stdout:0/513: dwrite f1b [0,4194304] 0 2024-05-09T00:07:44.465 INFO:tasks.workunit.client.0.smithi026.stdout:0/514: write d1d/d25/f55 [687338,15553] 0 2024-05-09T00:07:44.465 INFO:tasks.workunit.client.0.smithi026.stdout:0/515: write fa [825655,115395] 0 2024-05-09T00:07:44.465 INFO:tasks.workunit.client.0.smithi026.stdout:0/516: readlink d1d/d1e/d20/d4d/l8c 0 2024-05-09T00:07:44.475 INFO:tasks.workunit.client.1.smithi135.stdout:4/983: dread dc/d4a/d69/f70 [0,4194304] 0 2024-05-09T00:07:44.477 INFO:tasks.workunit.client.0.smithi026.stdout:2/313: creat d14/d22/f74 x:0 0 0 2024-05-09T00:07:44.478 INFO:tasks.workunit.client.0.smithi026.stdout:5/334: mknod d2/d8/d31/d32/c71 0 2024-05-09T00:07:44.480 INFO:tasks.workunit.client.0.smithi026.stdout:0/517: dwrite d1d/d1e/d2d/f8f [0,4194304] 0 2024-05-09T00:07:44.480 INFO:tasks.workunit.client.0.smithi026.stdout:0/518: write d1d/d1e/d20/d4d/d58/fab [21073,47840] 0 2024-05-09T00:07:44.480 INFO:tasks.workunit.client.1.smithi135.stdout:4/984: symlink dc/d26/d93/d124/d6d/dec/dee/l145 0 2024-05-09T00:07:44.481 INFO:tasks.workunit.client.0.smithi026.stdout:8/384: mkdir de/d17/d7d 0 2024-05-09T00:07:44.481 INFO:tasks.workunit.client.0.smithi026.stdout:8/385: chown de/d17/d21/d24/d3b/d3d/c68 1909495 1 2024-05-09T00:07:44.482 INFO:tasks.workunit.client.0.smithi026.stdout:8/386: write de/d17/d21/d24/d3b/f47 [279314,110975] 0 2024-05-09T00:07:44.498 INFO:tasks.workunit.client.0.smithi026.stdout:2/314: dwrite d14/d15/f26 [0,4194304] 0 2024-05-09T00:07:44.499 INFO:tasks.workunit.client.0.smithi026.stdout:2/315: write d14/d15/d3b/f3f [593900,31253] 0 2024-05-09T00:07:44.499 INFO:tasks.workunit.client.0.smithi026.stdout:8/387: dwrite de/d17/d21/d24/f26 [0,4194304] 0 2024-05-09T00:07:44.563 INFO:tasks.workunit.client.0.smithi026.stdout:9/431: symlink d7/d26/l9f 0 2024-05-09T00:07:44.563 INFO:tasks.workunit.client.0.smithi026.stdout:9/432: write d7/d23/f61 [1620551,96905] 0 2024-05-09T00:07:44.564 INFO:tasks.workunit.client.0.smithi026.stdout:9/433: write d7/d23/f7c [224107,114096] 0 2024-05-09T00:07:44.564 INFO:tasks.workunit.client.0.smithi026.stdout:9/434: dread - d7/d23/d29/d31/d40/d41/d54/d5c/f8f zero size 2024-05-09T00:07:44.564 INFO:tasks.workunit.client.1.smithi135.stdout:4/985: creat dc/d71/d86/d10a/f146 x:0 0 0 2024-05-09T00:07:44.564 INFO:tasks.workunit.client.1.smithi135.stdout:4/986: truncate dc/d26/d93/d124/d6d/dec/ff2 1657186 0 2024-05-09T00:07:44.565 INFO:tasks.workunit.client.0.smithi026.stdout:9/435: write d7/f1f [1772078,130312] 0 2024-05-09T00:07:44.565 INFO:tasks.workunit.client.0.smithi026.stdout:1/392: truncate d5/dd/d17/d73/f7a 237527 0 2024-05-09T00:07:44.568 INFO:tasks.workunit.client.1.smithi135.stdout:4/987: mknod dc/d26/d93/d124/dc9/dd7/dfa/c147 0 2024-05-09T00:07:44.569 INFO:tasks.workunit.client.0.smithi026.stdout:1/393: dread f4 [0,4194304] 0 2024-05-09T00:07:44.570 INFO:tasks.workunit.client.1.smithi135.stdout:4/988: mknod dc/d26/d93/d9d/de7/c148 0 2024-05-09T00:07:44.571 INFO:tasks.workunit.client.1.smithi135.stdout:4/989: getdents dc/d26/d93/d124/d5f 0 2024-05-09T00:07:44.572 INFO:tasks.workunit.client.0.smithi026.stdout:0/519: mknod d1d/d25/d47/cac 0 2024-05-09T00:07:44.573 INFO:tasks.workunit.client.0.smithi026.stdout:0/520: readlink d1d/d1e/l21 0 2024-05-09T00:07:44.575 INFO:tasks.workunit.client.1.smithi135.stdout:4/990: mkdir dc/d71/d90/d149 0 2024-05-09T00:07:44.581 INFO:tasks.workunit.client.1.smithi135.stdout:4/991: link dc/d4a/f10b dc/d71/d86/f14a 0 2024-05-09T00:07:44.581 INFO:tasks.workunit.client.1.smithi135.stdout:4/992: write dc/d26/d93/d124/d5f/faf [1253467,112406] 0 2024-05-09T00:07:44.582 INFO:tasks.workunit.client.1.smithi135.stdout:4/993: chown dc/d4a/f10b 4234846 1 2024-05-09T00:07:44.582 INFO:tasks.workunit.client.1.smithi135.stdout:4/994: chown dc/d26/d93/d9d/de7/c148 61992708 1 2024-05-09T00:07:44.584 INFO:tasks.workunit.client.1.smithi135.stdout:4/995: mknod dc/d26/d31/c14b 0 2024-05-09T00:07:44.586 INFO:tasks.workunit.client.0.smithi026.stdout:2/316: symlink d14/d22/l75 0 2024-05-09T00:07:44.587 INFO:tasks.workunit.client.1.smithi135.stdout:4/996: chown dc/dd/l72 3615487 1 2024-05-09T00:07:44.590 INFO:tasks.workunit.client.1.smithi135.stdout:4/997: mknod dc/c14c 0 2024-05-09T00:07:44.592 INFO:tasks.workunit.client.0.smithi026.stdout:8/388: truncate de/d17/f4a 3954304 0 2024-05-09T00:07:44.592 INFO:tasks.workunit.client.0.smithi026.stdout:8/389: write de/d6c/d31/d4f/f7b [802947,16456] 0 2024-05-09T00:07:44.592 INFO:tasks.workunit.client.0.smithi026.stdout:8/390: stat de/d48/d3e/f72 0 2024-05-09T00:07:44.593 INFO:tasks.workunit.client.1.smithi135.stdout:4/998: getdents dc/d71/de5 0 2024-05-09T00:07:44.593 INFO:tasks.workunit.client.0.smithi026.stdout:0/521: dwrite d1d/d25/d3c/f7a [0,4194304] 0 2024-05-09T00:07:44.593 INFO:tasks.workunit.client.0.smithi026.stdout:0/522: truncate d1d/d1e/d20/d51/f90 886768 0 2024-05-09T00:07:44.593 INFO:tasks.workunit.client.0.smithi026.stdout:0/523: chown d1d/d25/c9b 545955 1 2024-05-09T00:07:44.594 INFO:tasks.workunit.client.0.smithi026.stdout:8/391: dread de/d48/f52 [0,4194304] 0 2024-05-09T00:07:44.595 INFO:tasks.workunit.client.1.smithi135.stdout:4/999: mkdir dc/d110/d14d 0 2024-05-09T00:07:44.599 INFO:tasks.workunit.client.1.smithi135.stderr:+ rm -rf -- ./tmp.FmsGTl995D 2024-05-09T00:07:44.611 INFO:tasks.workunit.client.0.smithi026.stdout:1/394: mknod d5/dd/d1f/d39/d47/c85 0 2024-05-09T00:07:44.611 INFO:tasks.workunit.client.0.smithi026.stdout:1/395: truncate d5/dd/f67 1097688 0 2024-05-09T00:07:44.611 INFO:tasks.workunit.client.0.smithi026.stdout:1/396: truncate d5/dd/f49 1143633 0 2024-05-09T00:07:44.612 INFO:tasks.workunit.client.0.smithi026.stdout:2/317: truncate fd 224763 0 2024-05-09T00:07:44.612 INFO:tasks.workunit.client.0.smithi026.stdout:2/318: write d14/d15/d20/d41/d51/f71 [570469,8180] 0 2024-05-09T00:07:44.617 INFO:tasks.workunit.client.0.smithi026.stdout:9/436: dread d7/d23/d2f/d50/f6e [4194304,4194304] 0 2024-05-09T00:07:44.619 INFO:tasks.workunit.client.0.smithi026.stdout:0/524: symlink d1d/d1e/d20/d4d/d83/da0/lad 0 2024-05-09T00:07:44.621 INFO:tasks.workunit.client.0.smithi026.stdout:8/392: unlink de/d48/c37 0 2024-05-09T00:07:44.628 INFO:tasks.workunit.client.0.smithi026.stdout:9/437: symlink d7/d23/d29/d31/d40/d41/d54/d5c/la0 0 2024-05-09T00:07:44.630 INFO:tasks.workunit.client.0.smithi026.stdout:0/525: creat d1d/d1e/fae x:0 0 0 2024-05-09T00:07:44.632 INFO:tasks.workunit.client.0.smithi026.stdout:8/393: rename de/d48/d3e/f72 to de/d17/d21/d24/f7e 0 2024-05-09T00:07:44.632 INFO:tasks.workunit.client.0.smithi026.stdout:8/394: read de/d6c/d31/f74 [414743,17436] 0 2024-05-09T00:07:44.633 INFO:tasks.workunit.client.0.smithi026.stdout:1/397: mkdir d5/d16/d60/d66/d86 0 2024-05-09T00:07:44.635 INFO:tasks.workunit.client.0.smithi026.stdout:2/319: mknod d14/d22/d55/d6b/c76 0 2024-05-09T00:07:44.636 INFO:tasks.workunit.client.0.smithi026.stdout:2/320: chown d14/l2f 2 1 2024-05-09T00:07:44.636 INFO:tasks.workunit.client.0.smithi026.stdout:2/321: chown d14/d15/d3b/l46 7949353 1 2024-05-09T00:07:44.637 INFO:tasks.workunit.client.0.smithi026.stdout:9/438: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa1 x:0 0 0 2024-05-09T00:07:44.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:43.907511+0000 mgr.smithi135.kkrhgf (mgr.24419) 55 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 115 MiB/s rd, 246 MiB/s wr, 370 op/s 2024-05-09T00:07:44.646 INFO:tasks.workunit.client.0.smithi026.stdout:9/439: dread d7/f1f [0,4194304] 0 2024-05-09T00:07:44.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:43.907511+0000 mgr.smithi135.kkrhgf (mgr.24419) 55 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 115 MiB/s rd, 246 MiB/s wr, 370 op/s 2024-05-09T00:07:44.653 INFO:tasks.workunit.client.0.smithi026.stdout:0/526: truncate d1d/d25/d47/d6e/f8e 574651 0 2024-05-09T00:07:44.656 INFO:tasks.workunit.client.0.smithi026.stdout:8/395: getdents de 0 2024-05-09T00:07:44.658 INFO:tasks.workunit.client.0.smithi026.stdout:1/398: mkdir d5/dd/d87 0 2024-05-09T00:07:44.661 INFO:tasks.workunit.client.0.smithi026.stdout:9/440: dwrite d7/d23/d29/d31/d40/d41/d54/d5c/f8f [0,4194304] 0 2024-05-09T00:07:44.661 INFO:tasks.workunit.client.0.smithi026.stdout:9/441: truncate d7/d23/f84 256804 0 2024-05-09T00:07:44.662 INFO:tasks.workunit.client.0.smithi026.stdout:8/396: creat de/f7f x:0 0 0 2024-05-09T00:07:44.663 INFO:tasks.workunit.client.0.smithi026.stdout:1/399: getdents d5/db 0 2024-05-09T00:07:44.666 INFO:tasks.workunit.client.0.smithi026.stdout:2/322: mknod d14/c77 0 2024-05-09T00:07:44.674 INFO:tasks.workunit.client.0.smithi026.stdout:8/397: write de/d48/f52 [1060171,63751] 0 2024-05-09T00:07:44.674 INFO:tasks.workunit.client.0.smithi026.stdout:2/323: dread d14/d15/d17/f34 [4194304,4194304] 0 2024-05-09T00:07:44.674 INFO:tasks.workunit.client.0.smithi026.stdout:2/324: fsync d14/d15/d30/d6a/f57 0 2024-05-09T00:07:44.675 INFO:tasks.workunit.client.0.smithi026.stdout:1/400: creat d5/d16/d60/d66/d86/f88 x:0 0 0 2024-05-09T00:07:44.677 INFO:tasks.workunit.client.0.smithi026.stdout:9/442: link d7/d26/l2d d7/d23/d2f/d50/la2 0 2024-05-09T00:07:44.677 INFO:tasks.workunit.client.0.smithi026.stdout:9/443: chown d7/d23/f61 68823 1 2024-05-09T00:07:44.680 INFO:tasks.workunit.client.0.smithi026.stdout:8/398: rmdir de/d48/d70 0 2024-05-09T00:07:44.681 INFO:tasks.workunit.client.0.smithi026.stdout:1/401: rename d5/dd/l83 to d5/dd/l89 0 2024-05-09T00:07:44.682 INFO:tasks.workunit.client.0.smithi026.stdout:1/402: read d5/f2d [440585,108540] 0 2024-05-09T00:07:44.685 INFO:tasks.workunit.client.0.smithi026.stdout:8/399: creat de/d17/d21/d24/d3b/f80 x:0 0 0 2024-05-09T00:07:44.693 INFO:tasks.workunit.client.0.smithi026.stdout:8/400: rename de/f1e to de/d6c/d31/f81 0 2024-05-09T00:07:44.695 INFO:tasks.workunit.client.0.smithi026.stdout:8/401: mknod de/d17/d21/d24/d5b/c82 0 2024-05-09T00:07:44.695 INFO:tasks.workunit.client.0.smithi026.stdout:1/403: dwrite d5/db/f62 [4194304,4194304] 0 2024-05-09T00:07:44.696 INFO:tasks.workunit.client.0.smithi026.stdout:8/402: fsync de/ff 0 2024-05-09T00:07:44.699 INFO:tasks.workunit.client.0.smithi026.stdout:1/404: rmdir d5/d16 39 2024-05-09T00:07:44.699 INFO:tasks.workunit.client.0.smithi026.stdout:1/405: truncate d5/dd/d1f/d39/d47/f59 513261 0 2024-05-09T00:07:44.700 INFO:tasks.workunit.client.0.smithi026.stdout:8/403: mknod de/d48/d3e/c83 0 2024-05-09T00:07:44.701 INFO:tasks.workunit.client.0.smithi026.stdout:8/404: dread f9 [0,4194304] 0 2024-05-09T00:07:44.701 INFO:tasks.workunit.client.0.smithi026.stdout:8/405: fdatasync de/d17/d21/d24/f26 0 2024-05-09T00:07:44.702 INFO:tasks.workunit.client.0.smithi026.stdout:1/406: mknod d5/d16/c8a 0 2024-05-09T00:07:44.702 INFO:tasks.workunit.client.0.smithi026.stdout:1/407: write d5/db/f69 [779389,17853] 0 2024-05-09T00:07:44.703 INFO:tasks.workunit.client.0.smithi026.stdout:8/406: symlink de/d17/d6a/d62/l84 0 2024-05-09T00:07:44.703 INFO:tasks.workunit.client.0.smithi026.stdout:8/407: write de/d17/d6a/f6d [227211,125296] 0 2024-05-09T00:07:44.703 INFO:tasks.workunit.client.0.smithi026.stdout:1/408: dread d5/dd/ff [0,4194304] 0 2024-05-09T00:07:44.704 INFO:tasks.workunit.client.0.smithi026.stdout:1/409: readlink d5/dd/d17/d73/l32 0 2024-05-09T00:07:44.705 INFO:tasks.workunit.client.0.smithi026.stdout:1/410: creat d5/dd/d17/f8b x:0 0 0 2024-05-09T00:07:44.705 INFO:tasks.workunit.client.0.smithi026.stdout:1/411: chown d5/db/d30/d75 226189 1 2024-05-09T00:07:44.718 INFO:tasks.workunit.client.0.smithi026.stdout:8/408: write de/d6c/d31/f74 [616882,52245] 0 2024-05-09T00:07:44.722 INFO:tasks.workunit.client.0.smithi026.stdout:1/412: dwrite d5/db/d30/f55 [0,4194304] 0 2024-05-09T00:07:44.722 INFO:tasks.workunit.client.0.smithi026.stdout:2/325: dwrite d14/d15/d30/d6a/d5b/f64 [0,4194304] 0 2024-05-09T00:07:44.734 INFO:tasks.workunit.client.0.smithi026.stdout:8/409: dwrite f3 [0,4194304] 0 2024-05-09T00:07:44.756 INFO:tasks.workunit.client.0.smithi026.stdout:8/410: dwrite de/d17/f43 [0,4194304] 0 2024-05-09T00:07:44.786 INFO:tasks.workunit.client.0.smithi026.stdout:1/413: dread d5/dd/f52 [0,4194304] 0 2024-05-09T00:07:44.799 INFO:tasks.workunit.client.0.smithi026.stdout:2/326: mknod d14/c78 0 2024-05-09T00:07:44.799 INFO:tasks.workunit.client.0.smithi026.stdout:2/327: chown d14/d15/d1f/d70 1627 1 2024-05-09T00:07:44.799 INFO:tasks.workunit.client.0.smithi026.stdout:2/328: readlink d14/d15/d17/l58 0 2024-05-09T00:07:44.800 INFO:tasks.workunit.client.0.smithi026.stdout:8/411: symlink de/d60/l85 0 2024-05-09T00:07:44.801 INFO:tasks.workunit.client.0.smithi026.stdout:2/329: truncate f11 3323200 0 2024-05-09T00:07:44.801 INFO:tasks.workunit.client.0.smithi026.stdout:2/330: fdatasync d14/d15/d30/d6a/f57 0 2024-05-09T00:07:44.802 INFO:tasks.workunit.client.0.smithi026.stdout:2/331: chown d14/d15/d17/l6e 107568829 1 2024-05-09T00:07:44.802 INFO:tasks.workunit.client.0.smithi026.stdout:2/332: write d14/d15/d20/d41/d51/f71 [1236597,110110] 0 2024-05-09T00:07:44.808 INFO:tasks.workunit.client.0.smithi026.stdout:8/412: dread f3 [0,4194304] 0 2024-05-09T00:07:44.808 INFO:tasks.workunit.client.0.smithi026.stdout:8/413: fdatasync de/d60/f63 0 2024-05-09T00:07:44.813 INFO:tasks.workunit.client.0.smithi026.stdout:8/414: link de/d48/f7c de/d6c/d31/d4f/f86 0 2024-05-09T00:07:44.829 INFO:tasks.workunit.client.0.smithi026.stdout:2/333: dwrite d14/d15/f1b [0,4194304] 0 2024-05-09T00:07:44.833 INFO:tasks.workunit.client.0.smithi026.stdout:8/415: rmdir de/d6c/d31/d4f 39 2024-05-09T00:07:44.833 INFO:tasks.workunit.client.0.smithi026.stdout:2/334: fsync d14/d22/d55/f60 0 2024-05-09T00:07:44.838 INFO:tasks.workunit.client.0.smithi026.stdout:8/416: rename de/d17/d6a to de/d6c/d31/d4f/d87 0 2024-05-09T00:07:44.838 INFO:tasks.workunit.client.0.smithi026.stdout:8/417: read de/d6c/d31/f81 [4178434,106911] 0 2024-05-09T00:07:44.842 INFO:tasks.workunit.client.0.smithi026.stdout:8/418: creat de/d6c/d31/d4f/f88 x:0 0 0 2024-05-09T00:07:44.844 INFO:tasks.workunit.client.0.smithi026.stdout:8/419: creat de/d60/f89 x:0 0 0 2024-05-09T00:07:44.847 INFO:tasks.workunit.client.0.smithi026.stdout:8/420: rename de/d17/d21/d24/f2e to de/d48/d3e/d54/f8a 0 2024-05-09T00:07:44.849 INFO:tasks.workunit.client.0.smithi026.stdout:8/421: chown de/l19 583 1 2024-05-09T00:07:44.849 INFO:tasks.workunit.client.0.smithi026.stdout:8/422: read - de/d17/d21/d24/d3b/f7a zero size 2024-05-09T00:07:44.850 INFO:tasks.workunit.client.0.smithi026.stdout:8/423: mknod de/d17/d21/d6f/c8b 0 2024-05-09T00:07:44.851 INFO:tasks.workunit.client.0.smithi026.stdout:8/424: creat de/d48/f8c x:0 0 0 2024-05-09T00:07:44.853 INFO:tasks.workunit.client.0.smithi026.stdout:8/425: unlink de/d48/d3e/f4c 0 2024-05-09T00:07:44.853 INFO:tasks.workunit.client.0.smithi026.stdout:8/426: write de/f7f [748071,93057] 0 2024-05-09T00:07:44.866 INFO:tasks.workunit.client.0.smithi026.stdout:3/343: sync 2024-05-09T00:07:44.868 INFO:tasks.workunit.client.0.smithi026.stdout:3/344: dread d5/d9/dc/d28/d2c/f58 [0,4194304] 0 2024-05-09T00:07:44.868 INFO:tasks.workunit.client.0.smithi026.stdout:8/427: dwrite de/d17/d21/d24/d3b/f47 [0,4194304] 0 2024-05-09T00:07:44.869 INFO:tasks.workunit.client.0.smithi026.stdout:3/345: creat d5/d41/f6e x:0 0 0 2024-05-09T00:07:44.869 INFO:tasks.workunit.client.0.smithi026.stdout:3/346: truncate d5/d9/f5a 787970 0 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi026.stdout:8/428: creat de/d17/f8d x:0 0 0 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi026.stdout:3/347: mkdir d5/d9/d4a/d5f/d6f 0 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi026.stdout:3/348: chown d5/d9/dc/f11 4 1 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi026.stdout:4/315: sync 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi026.stdout:6/315: sync 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi026.stdout:7/509: sync 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi026.stdout:4/316: chown d0/d12/c32 2900333 1 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi026.stdout:4/317: dread - d0/d12/f68 zero size 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi026.stdout:4/318: chown d0/d12/d34 370 1 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi026.stdout:4/319: write d0/d12/d1b/d2b/f3f [4164574,108273] 0 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi026.stdout:7/510: write d8/d2e/d55/d22/d29/f2f [122585,41374] 0 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi026.stdout:6/316: write f1 [4865649,75527] 0 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi026.stdout:6/317: stat d15/f18 0 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi026.stdout:4/320: write d0/f22 [1992886,44429] 0 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi026.stdout:7/511: write d8/ff [10651301,48177] 0 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi026.stdout:7/512: dread d8/d2e/d55/d1e/f6e [0,4194304] 0 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi026.stdout:4/321: dread d0/d19/d43/d49/f54 [0,4194304] 0 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi026.stdout:7/513: dread d8/d2e/d55/d22/f65 [0,4194304] 0 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi026.stdout:7/514: write d8/d2e/d55/d1e/f64 [209232,125915] 0 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi026.stdout:7/515: write d8/d2e/f54 [2698523,43686] 0 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi026.stdout:7/516: truncate d8/d2e/d55/d1e/d3d/f5f 2973087 0 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi026.stdout:4/322: unlink d0/d12/d34/f38 0 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi026.stdout:4/323: truncate d0/d12/d1b/f3c 1280023 0 2024-05-09T00:07:44.894 INFO:tasks.workunit.client.0.smithi026.stdout:3/349: dwrite d5/f39 [0,4194304] 0 2024-05-09T00:07:44.894 INFO:tasks.workunit.client.0.smithi026.stdout:3/350: fsync d5/d9/f56 0 2024-05-09T00:07:44.897 INFO:tasks.workunit.client.0.smithi026.stdout:7/517: mknod d8/d2e/d55/d1e/d3d/cb3 0 2024-05-09T00:07:44.897 INFO:tasks.workunit.client.0.smithi026.stdout:7/518: fdatasync d8/d5c/f75 0 2024-05-09T00:07:44.902 INFO:tasks.workunit.client.0.smithi026.stdout:3/351: rename d5/d9/dc/d28/f4f to d5/d9/dc/f70 0 2024-05-09T00:07:44.903 INFO:tasks.workunit.client.0.smithi026.stdout:3/352: write d5/d9/dc/d28/f4c [1701315,67028] 0 2024-05-09T00:07:44.905 INFO:tasks.workunit.client.0.smithi026.stdout:3/353: mkdir d5/d9/d71 0 2024-05-09T00:07:44.916 INFO:tasks.workunit.client.0.smithi026.stdout:7/519: dwrite d8/d2e/d55/f52 [0,4194304] 0 2024-05-09T00:07:44.918 INFO:tasks.workunit.client.0.smithi026.stdout:7/520: write d8/d2e/f6f [88749,56263] 0 2024-05-09T00:07:44.920 INFO:tasks.workunit.client.0.smithi026.stdout:7/521: write d8/d1b/d89/fa6 [994044,104411] 0 2024-05-09T00:07:44.923 INFO:tasks.workunit.client.0.smithi026.stdout:7/522: mkdir d8/d2e/d84/db4 0 2024-05-09T00:07:44.923 INFO:tasks.workunit.client.0.smithi026.stdout:7/523: chown d8/d1b/d89/d8d/f98 818573 1 2024-05-09T00:07:44.924 INFO:tasks.workunit.client.0.smithi026.stdout:3/354: dwrite d5/d9/dc/f70 [0,4194304] 0 2024-05-09T00:07:44.952 INFO:tasks.workunit.client.0.smithi026.stdout:7/524: dwrite d8/d2e/f5d [0,4194304] 0 2024-05-09T00:07:44.953 INFO:tasks.workunit.client.0.smithi026.stdout:7/525: dread - d8/d2e/d55/d1e/d3d/d6b/db2/f97 zero size 2024-05-09T00:07:44.953 INFO:tasks.workunit.client.0.smithi026.stdout:7/526: write d8/d2e/d55/f50 [1131872,123594] 0 2024-05-09T00:07:44.953 INFO:tasks.workunit.client.0.smithi026.stdout:3/355: dwrite d5/d9/dc/d28/d2c/f6a [0,4194304] 0 2024-05-09T00:07:44.963 INFO:tasks.workunit.client.0.smithi026.stdout:7/527: creat d8/d2e/d55/d22/fb5 x:0 0 0 2024-05-09T00:07:44.967 INFO:tasks.workunit.client.0.smithi026.stdout:3/356: symlink d5/d9/dc/d28/d45/l72 0 2024-05-09T00:07:44.969 INFO:tasks.workunit.client.0.smithi026.stdout:3/357: dread d5/d9/dc/d28/d45/f57 [4194304,4194304] 0 2024-05-09T00:07:44.969 INFO:tasks.workunit.client.0.smithi026.stdout:3/358: chown d5/d9/d4a/d5f/d6f 1202166 1 2024-05-09T00:07:44.976 INFO:tasks.workunit.client.0.smithi026.stdout:7/528: unlink d8/d2e/d55/l21 0 2024-05-09T00:07:44.977 INFO:tasks.workunit.client.0.smithi026.stdout:3/359: mknod d5/d9/d4a/c73 0 2024-05-09T00:07:44.981 INFO:tasks.workunit.client.0.smithi026.stdout:7/529: getdents d8/d2e/d84 0 2024-05-09T00:07:44.981 INFO:tasks.workunit.client.0.smithi026.stdout:7/530: stat d8/d2e/d55/d1e/d3d/c96 0 2024-05-09T00:07:44.985 INFO:tasks.workunit.client.0.smithi026.stdout:7/531: getdents d8/d2e/d55/d22 0 2024-05-09T00:07:44.986 INFO:tasks.workunit.client.0.smithi026.stdout:7/532: write d8/d2e/f4a [1584219,43953] 0 2024-05-09T00:07:44.991 INFO:tasks.workunit.client.0.smithi026.stdout:7/533: link d8/d2e/d55/l24 d8/d1b/d89/lb6 0 2024-05-09T00:07:44.993 INFO:tasks.workunit.client.0.smithi026.stdout:7/534: rename d8/d2e/d55/d1e/f6e to d8/d2e/d84/db4/fb7 0 2024-05-09T00:07:44.997 INFO:tasks.workunit.client.0.smithi026.stdout:3/360: dwrite d5/d9/f5a [0,4194304] 0 2024-05-09T00:07:45.001 INFO:tasks.workunit.client.0.smithi026.stdout:3/361: mknod d5/d9/d49/c74 0 2024-05-09T00:07:45.002 INFO:tasks.workunit.client.0.smithi026.stdout:3/362: readlink d5/d9/d4a/l59 0 2024-05-09T00:07:45.002 INFO:tasks.workunit.client.0.smithi026.stdout:3/363: mkdir d5/d9/d4a/d5f/d6f/d75 0 2024-05-09T00:07:45.004 INFO:tasks.workunit.client.0.smithi026.stdout:3/364: creat d5/d9/dc/d5d/f76 x:0 0 0 2024-05-09T00:07:45.004 INFO:tasks.workunit.client.0.smithi026.stdout:3/365: chown d5/d9/dc/d28/l14 0 1 2024-05-09T00:07:45.005 INFO:tasks.workunit.client.0.smithi026.stdout:3/366: mkdir d5/d9/d4a/d77 0 2024-05-09T00:07:45.006 INFO:tasks.workunit.client.0.smithi026.stdout:3/367: symlink d5/d44/l78 0 2024-05-09T00:07:45.008 INFO:tasks.workunit.client.0.smithi026.stdout:3/368: creat d5/d44/f79 x:0 0 0 2024-05-09T00:07:45.009 INFO:tasks.workunit.client.0.smithi026.stdout:3/369: symlink d5/d9/d4a/d77/l7a 0 2024-05-09T00:07:45.010 INFO:tasks.workunit.client.0.smithi026.stdout:3/370: dread d5/d9/dc/d28/d2c/f58 [0,4194304] 0 2024-05-09T00:07:45.011 INFO:tasks.workunit.client.0.smithi026.stdout:3/371: truncate d5/d41/f2d 7100471 0 2024-05-09T00:07:45.011 INFO:tasks.workunit.client.0.smithi026.stdout:3/372: chown d5/d9/dc/d28/d63/f67 532566 1 2024-05-09T00:07:45.011 INFO:tasks.workunit.client.0.smithi026.stdout:3/373: readlink d5/d9/dc/l53 0 2024-05-09T00:07:45.015 INFO:tasks.workunit.client.0.smithi026.stdout:5/335: sync 2024-05-09T00:07:45.016 INFO:tasks.workunit.client.0.smithi026.stdout:5/336: chown d2/d8/d31/d2e/d33/f68 2047814185 1 2024-05-09T00:07:45.016 INFO:tasks.workunit.client.0.smithi026.stdout:5/337: chown d2/d8/d31/f17 108405 1 2024-05-09T00:07:45.016 INFO:tasks.workunit.client.0.smithi026.stdout:5/338: dread - d2/d8/d31/d32/d5c/f67 zero size 2024-05-09T00:07:45.016 INFO:tasks.workunit.client.0.smithi026.stdout:5/339: chown d2/c14 840220 1 2024-05-09T00:07:45.016 INFO:tasks.workunit.client.0.smithi026.stdout:5/340: write d2/d8/d2a/d4e/f6b [390938,21037] 0 2024-05-09T00:07:45.016 INFO:tasks.workunit.client.0.smithi026.stdout:0/527: sync 2024-05-09T00:07:45.021 INFO:tasks.workunit.client.0.smithi026.stdout:5/341: link d2/fc d2/f72 0 2024-05-09T00:07:45.021 INFO:tasks.workunit.client.0.smithi026.stdout:5/342: chown d2/d5a/f5f 52 1 2024-05-09T00:07:45.022 INFO:tasks.workunit.client.0.smithi026.stdout:5/343: chown d2/fc 217 1 2024-05-09T00:07:45.022 INFO:tasks.workunit.client.0.smithi026.stdout:5/344: write d2/d8/d31/d2e/d4a/f64 [573399,124598] 0 2024-05-09T00:07:45.022 INFO:tasks.workunit.client.0.smithi026.stdout:5/345: chown d2/d8/c13 2 1 2024-05-09T00:07:45.022 INFO:tasks.workunit.client.0.smithi026.stdout:5/346: write d2/d8/d31/d2e/d33/f68 [536816,122230] 0 2024-05-09T00:07:45.023 INFO:tasks.workunit.client.0.smithi026.stdout:0/528: dread f5 [0,4194304] 0 2024-05-09T00:07:45.023 INFO:tasks.workunit.client.0.smithi026.stdout:0/529: chown d1d/d25/c9b 548596 1 2024-05-09T00:07:45.026 INFO:tasks.workunit.client.0.smithi026.stdout:5/347: rmdir d2/d8/d31/d2e/d5d 0 2024-05-09T00:07:45.026 INFO:tasks.workunit.client.0.smithi026.stdout:0/530: dread d1d/d33/f61 [0,4194304] 0 2024-05-09T00:07:45.026 INFO:tasks.workunit.client.0.smithi026.stdout:0/531: truncate d1d/d25/d47/f5a 2437741 0 2024-05-09T00:07:45.029 INFO:tasks.workunit.client.0.smithi026.stdout:5/348: getdents d2/d8/d31/d32/d5c 0 2024-05-09T00:07:45.029 INFO:tasks.workunit.client.0.smithi026.stdout:5/349: dread - d2/f60 zero size 2024-05-09T00:07:45.029 INFO:tasks.workunit.client.0.smithi026.stdout:5/350: chown d2/f60 220307353 1 2024-05-09T00:07:45.030 INFO:tasks.workunit.client.0.smithi026.stdout:0/532: symlink d1d/d1e/laf 0 2024-05-09T00:07:45.034 INFO:tasks.workunit.client.0.smithi026.stdout:0/533: creat d1d/d1e/d20/d51/fb0 x:0 0 0 2024-05-09T00:07:45.034 INFO:tasks.workunit.client.0.smithi026.stdout:0/534: fdatasync f19 0 2024-05-09T00:07:45.034 INFO:tasks.workunit.client.0.smithi026.stdout:0/535: write d1d/d25/d3c/f95 [769038,18445] 0 2024-05-09T00:07:45.036 INFO:tasks.workunit.client.0.smithi026.stdout:3/374: dwrite d5/d9/dc/d28/d63/f67 [0,4194304] 0 2024-05-09T00:07:45.037 INFO:tasks.workunit.client.0.smithi026.stdout:3/375: dread - d5/d44/f79 zero size 2024-05-09T00:07:45.037 INFO:tasks.workunit.client.0.smithi026.stdout:7/535: dwrite d8/d2e/d55/d1e/f41 [0,4194304] 0 2024-05-09T00:07:45.040 INFO:tasks.workunit.client.0.smithi026.stdout:0/536: dread f5 [0,4194304] 0 2024-05-09T00:07:45.042 INFO:tasks.workunit.client.0.smithi026.stdout:3/376: mkdir d5/d1e/d7b 0 2024-05-09T00:07:45.042 INFO:tasks.workunit.client.0.smithi026.stdout:3/377: truncate d5/d41/f6e 769303 0 2024-05-09T00:07:45.042 INFO:tasks.workunit.client.0.smithi026.stdout:3/378: fsync d5/d9/dc/d28/f35 0 2024-05-09T00:07:45.046 INFO:tasks.workunit.client.0.smithi026.stdout:5/351: dwrite d2/f60 [0,4194304] 0 2024-05-09T00:07:45.051 INFO:tasks.workunit.client.0.smithi026.stdout:0/537: rename d1d/d1e/d20/f8d to d1d/d33/fb1 0 2024-05-09T00:07:45.054 INFO:tasks.workunit.client.0.smithi026.stdout:5/352: getdents d2/d8/d31/d4b/d51 0 2024-05-09T00:07:45.056 INFO:tasks.workunit.client.0.smithi026.stdout:0/538: creat d1d/d33/d64/fb2 x:0 0 0 2024-05-09T00:07:45.060 INFO:tasks.workunit.client.0.smithi026.stdout:5/353: rename d2/d8/d2a/f50 to d2/d8/d31/d2e/d4a/f73 0 2024-05-09T00:07:45.060 INFO:tasks.workunit.client.0.smithi026.stdout:5/354: fdatasync d2/d8/d31/d24/f43 0 2024-05-09T00:07:45.060 INFO:tasks.workunit.client.0.smithi026.stdout:5/355: read - d2/d8/f59 zero size 2024-05-09T00:07:45.060 INFO:tasks.workunit.client.0.smithi026.stdout:0/539: mknod d1d/d25/cb3 0 2024-05-09T00:07:45.063 INFO:tasks.workunit.client.0.smithi026.stdout:0/540: dread d1d/f5b [0,4194304] 0 2024-05-09T00:07:45.063 INFO:tasks.workunit.client.0.smithi026.stdout:0/541: chown d1d/c6d 13831 1 2024-05-09T00:07:45.063 INFO:tasks.workunit.client.0.smithi026.stdout:0/542: chown d1d/d25/d3c/c9f 104428188 1 2024-05-09T00:07:45.063 INFO:tasks.workunit.client.0.smithi026.stdout:0/543: readlink l9 0 2024-05-09T00:07:45.066 INFO:tasks.workunit.client.0.smithi026.stdout:0/544: rmdir d1d/d25/d3c/d5f 39 2024-05-09T00:07:45.069 INFO:tasks.workunit.client.0.smithi026.stdout:0/545: truncate d1d/d1e/d2d/f3e 164057 0 2024-05-09T00:07:45.069 INFO:tasks.workunit.client.0.smithi026.stdout:0/546: chown c17 212 1 2024-05-09T00:07:45.070 INFO:tasks.workunit.client.0.smithi026.stdout:7/536: dwrite d8/d2e/d84/fab [4194304,4194304] 0 2024-05-09T00:07:45.074 INFO:tasks.workunit.client.0.smithi026.stdout:0/547: rename d1d/d1e/l67 to d1d/d1e/d20/d4d/d58/d62/d84/lb4 0 2024-05-09T00:07:45.074 INFO:tasks.workunit.client.0.smithi026.stdout:0/548: readlink d1d/d25/d47/l48 0 2024-05-09T00:07:45.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/356: dwrite d2/d8/d31/d2e/d4a/f3d [0,4194304] 0 2024-05-09T00:07:45.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/357: write d2/d5a/f5f [719376,110070] 0 2024-05-09T00:07:45.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/358: read d2/d8/d31/d4b/d51/f53 [292259,20201] 0 2024-05-09T00:07:45.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/359: chown d2/d8/d31/d4b/c6a 13507199 1 2024-05-09T00:07:45.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/360: fdatasync d2/d8/d31/f30 0 2024-05-09T00:07:45.075 INFO:tasks.workunit.client.0.smithi026.stdout:0/549: symlink d1d/d1e/d20/d4d/d83/lb5 0 2024-05-09T00:07:45.078 INFO:tasks.workunit.client.0.smithi026.stdout:5/361: rmdir d2/d5a 39 2024-05-09T00:07:45.079 INFO:tasks.workunit.client.0.smithi026.stdout:0/550: symlink d1d/da4/lb6 0 2024-05-09T00:07:45.081 INFO:tasks.workunit.client.0.smithi026.stdout:5/362: creat d2/d8/d31/d24/f74 x:0 0 0 2024-05-09T00:07:45.083 INFO:tasks.workunit.client.0.smithi026.stdout:0/551: mkdir d1d/d1e/db7 0 2024-05-09T00:07:45.087 INFO:tasks.workunit.client.0.smithi026.stdout:7/537: dwrite d8/d2e/d55/d22/f31 [0,4194304] 0 2024-05-09T00:07:45.099 INFO:tasks.workunit.client.0.smithi026.stdout:5/363: dwrite d2/d8/d2a/f4f [4194304,4194304] 0 2024-05-09T00:07:45.116 INFO:tasks.workunit.client.0.smithi026.stdout:9/444: sync 2024-05-09T00:07:45.116 INFO:tasks.workunit.client.0.smithi026.stdout:1/414: sync 2024-05-09T00:07:45.116 INFO:tasks.workunit.client.0.smithi026.stdout:1/415: chown d5/db/d1d/l5a 104875 1 2024-05-09T00:07:45.117 INFO:tasks.workunit.client.0.smithi026.stdout:9/445: getdents d7/d23/d29/d31/d40/d41/d54/d9a 0 2024-05-09T00:07:45.118 INFO:tasks.workunit.client.0.smithi026.stdout:1/416: mknod d5/db/c8c 0 2024-05-09T00:07:45.120 INFO:tasks.workunit.client.0.smithi026.stdout:9/446: mkdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/da3 0 2024-05-09T00:07:45.121 INFO:tasks.workunit.client.0.smithi026.stdout:1/417: creat d5/f8d x:0 0 0 2024-05-09T00:07:45.122 INFO:tasks.workunit.client.0.smithi026.stdout:9/447: mkdir d7/d23/d29/d31/d40/d41/d54/d9a/da4 0 2024-05-09T00:07:45.122 INFO:tasks.workunit.client.0.smithi026.stdout:9/448: chown d7/d23/d29/d2e/f47 231 1 2024-05-09T00:07:45.123 INFO:tasks.workunit.client.0.smithi026.stdout:9/449: write d7/d23/d29/d2e/f6f [756181,74329] 0 2024-05-09T00:07:45.125 INFO:tasks.workunit.client.0.smithi026.stdout:1/418: rmdir d5/dd/d1f/d39/d47 39 2024-05-09T00:07:45.126 INFO:tasks.workunit.client.0.smithi026.stdout:5/364: dwrite d2/d8/d31/d32/d5c/f67 [0,4194304] 0 2024-05-09T00:07:45.127 INFO:tasks.workunit.client.0.smithi026.stdout:1/419: creat d5/dd/d1f/d39/f8e x:0 0 0 2024-05-09T00:07:45.131 INFO:tasks.workunit.client.0.smithi026.stdout:1/420: creat d5/dd/d1f/f8f x:0 0 0 2024-05-09T00:07:45.131 INFO:tasks.workunit.client.0.smithi026.stdout:7/538: dwrite d8/d1b/d89/d8d/f98 [0,4194304] 0 2024-05-09T00:07:45.133 INFO:tasks.workunit.client.0.smithi026.stdout:7/539: symlink d8/d2e/d55/d22/da1/dae/lb8 0 2024-05-09T00:07:45.138 INFO:tasks.workunit.client.0.smithi026.stdout:5/365: dread d2/d8/d31/d24/f62 [4194304,4194304] 0 2024-05-09T00:07:45.138 INFO:tasks.workunit.client.0.smithi026.stdout:1/421: dread d5/d16/d60/f74 [0,4194304] 0 2024-05-09T00:07:45.138 INFO:tasks.workunit.client.0.smithi026.stdout:5/366: chown d2/d8/d31/f12 9657268 1 2024-05-09T00:07:45.139 INFO:tasks.workunit.client.0.smithi026.stdout:7/540: write d8/d2e/d55/d22/d29/f90 [682152,96164] 0 2024-05-09T00:07:45.140 INFO:tasks.workunit.client.0.smithi026.stdout:7/541: write d8/d2e/d55/d1e/d80/f81 [651176,53211] 0 2024-05-09T00:07:45.140 INFO:tasks.workunit.client.0.smithi026.stdout:5/367: rename d2/d8/d31/d24/l2d to d2/d8/d2a/l75 0 2024-05-09T00:07:45.141 INFO:tasks.workunit.client.0.smithi026.stdout:9/450: dwrite d7/f7f [0,4194304] 0 2024-05-09T00:07:45.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/451: write d7/d23/f33 [946207,44518] 0 2024-05-09T00:07:45.143 INFO:tasks.workunit.client.0.smithi026.stdout:7/542: creat d8/d2e/d55/d1e/d3d/d6b/fb9 x:0 0 0 2024-05-09T00:07:45.143 INFO:tasks.workunit.client.0.smithi026.stdout:7/543: read - d8/d5c/f99 zero size 2024-05-09T00:07:45.143 INFO:tasks.workunit.client.0.smithi026.stdout:7/544: fdatasync d8/d2e/f4a 0 2024-05-09T00:07:45.143 INFO:tasks.workunit.client.0.smithi026.stdout:7/545: getdents d8/d2e/d55/d1e/d8a 0 2024-05-09T00:07:45.147 INFO:tasks.workunit.client.0.smithi026.stdout:5/368: unlink d2/d8/d2a/l70 0 2024-05-09T00:07:45.149 INFO:tasks.workunit.client.0.smithi026.stdout:7/546: creat d8/d5c/d9a/d9f/fba x:0 0 0 2024-05-09T00:07:45.150 INFO:tasks.workunit.client.0.smithi026.stdout:9/452: dread d7/d23/d29/d31/f32 [0,4194304] 0 2024-05-09T00:07:45.150 INFO:tasks.workunit.client.0.smithi026.stdout:9/453: write d7/d23/f61 [2529026,60374] 0 2024-05-09T00:07:45.151 INFO:tasks.workunit.client.0.smithi026.stdout:5/369: symlink d2/d8/l76 0 2024-05-09T00:07:45.151 INFO:tasks.workunit.client.0.smithi026.stdout:7/547: mknod d8/d2e/d55/d1e/d8a/cbb 0 2024-05-09T00:07:45.152 INFO:tasks.workunit.client.0.smithi026.stdout:9/454: symlink d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/la5 0 2024-05-09T00:07:45.154 INFO:tasks.workunit.client.0.smithi026.stdout:5/370: getdents d2/d8/d2a/d4e 0 2024-05-09T00:07:45.155 INFO:tasks.workunit.client.0.smithi026.stdout:9/455: read f3 [188401,22865] 0 2024-05-09T00:07:45.155 INFO:tasks.workunit.client.0.smithi026.stdout:9/456: fdatasync d7/d23/d29/d59/f97 0 2024-05-09T00:07:45.156 INFO:tasks.workunit.client.0.smithi026.stdout:1/422: dwrite d5/dd/f34 [0,4194304] 0 2024-05-09T00:07:45.157 INFO:tasks.workunit.client.0.smithi026.stdout:9/457: creat d7/d26/fa6 x:0 0 0 2024-05-09T00:07:45.160 INFO:tasks.workunit.client.0.smithi026.stdout:1/423: dread - d5/d16/f3b zero size 2024-05-09T00:07:45.163 INFO:tasks.workunit.client.0.smithi026.stdout:1/424: creat d5/dd/d1f/f90 x:0 0 0 2024-05-09T00:07:45.166 INFO:tasks.workunit.client.0.smithi026.stdout:1/425: mknod d5/db/d30/d75/c91 0 2024-05-09T00:07:45.171 INFO:tasks.workunit.client.0.smithi026.stdout:1/426: unlink d5/d16/f3b 0 2024-05-09T00:07:45.171 INFO:tasks.workunit.client.0.smithi026.stdout:1/427: fdatasync d5/dd/ff 0 2024-05-09T00:07:45.173 INFO:tasks.workunit.client.0.smithi026.stdout:1/428: mkdir d5/db/d30/d92 0 2024-05-09T00:07:45.173 INFO:tasks.workunit.client.0.smithi026.stdout:1/429: stat d5/db/d30/l33 0 2024-05-09T00:07:45.175 INFO:tasks.workunit.client.0.smithi026.stdout:7/548: rename d8/d2e/d55 to d8/d2e/d84/db4/dbc 0 2024-05-09T00:07:45.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/371: dwrite d2/f44 [0,4194304] 0 2024-05-09T00:07:45.176 INFO:tasks.workunit.client.0.smithi026.stdout:9/458: dwrite d7/d26/f71 [0,4194304] 0 2024-05-09T00:07:45.178 INFO:tasks.workunit.client.0.smithi026.stdout:7/549: creat d8/d5c/fbd x:0 0 0 2024-05-09T00:07:45.189 INFO:tasks.workunit.client.0.smithi026.stdout:9/459: truncate d7/d23/d29/f30 1440994 0 2024-05-09T00:07:45.189 INFO:tasks.workunit.client.0.smithi026.stdout:1/430: getdents d5/db/d30 0 2024-05-09T00:07:45.197 INFO:tasks.workunit.client.0.smithi026.stdout:5/372: rename d2/d8/d31/d24/c3a to d2/d8/d31/c77 0 2024-05-09T00:07:45.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/460: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa7 x:0 0 0 2024-05-09T00:07:45.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/461: write d7/d23/d29/d31/f3d [344556,123080] 0 2024-05-09T00:07:45.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/462: stat d7/d26/f6b 0 2024-05-09T00:07:45.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/463: chown d7/f19 4 1 2024-05-09T00:07:45.203 INFO:tasks.workunit.client.0.smithi026.stdout:1/431: creat d5/dd/d1f/d39/d47/f93 x:0 0 0 2024-05-09T00:07:45.208 INFO:tasks.workunit.client.0.smithi026.stdout:5/373: mknod d2/d8/d6d/c78 0 2024-05-09T00:07:45.210 INFO:tasks.workunit.client.0.smithi026.stdout:1/432: getdents d5 0 2024-05-09T00:07:45.214 INFO:tasks.workunit.client.0.smithi026.stdout:1/433: mkdir d5/db/d30/d94 0 2024-05-09T00:07:45.215 INFO:tasks.workunit.client.0.smithi026.stdout:1/434: symlink d5/db/l95 0 2024-05-09T00:07:45.215 INFO:tasks.workunit.client.0.smithi026.stdout:1/435: chown d5/dd/d17/d73 156944 1 2024-05-09T00:07:45.215 INFO:tasks.workunit.client.0.smithi026.stdout:1/436: chown d5/dd/d1f/f21 2286 1 2024-05-09T00:07:45.216 INFO:tasks.workunit.client.0.smithi026.stdout:1/437: chown d5/dd/d1f/d39/d47 26 1 2024-05-09T00:07:45.216 INFO:tasks.workunit.client.0.smithi026.stdout:5/374: dread d2/d8/d31/d4b/d51/f53 [0,4194304] 0 2024-05-09T00:07:45.221 INFO:tasks.workunit.client.0.smithi026.stdout:5/375: rename d2/d8/d2a/d4e to d2/d8/d31/d2e/d79 0 2024-05-09T00:07:45.221 INFO:tasks.workunit.client.0.smithi026.stdout:5/376: write d2/d5a/f5f [1826982,128255] 0 2024-05-09T00:07:45.224 INFO:tasks.workunit.client.0.smithi026.stdout:5/377: write d2/fc [305750,119865] 0 2024-05-09T00:07:45.232 INFO:tasks.workunit.client.0.smithi026.stdout:1/438: dwrite d5/db/f69 [0,4194304] 0 2024-05-09T00:07:45.240 INFO:tasks.workunit.client.0.smithi026.stdout:1/439: getdents d5/db 0 2024-05-09T00:07:45.241 INFO:tasks.workunit.client.0.smithi026.stdout:1/440: rmdir d5/dd/d17/d7b 39 2024-05-09T00:07:45.243 INFO:tasks.workunit.client.0.smithi026.stdout:1/441: link d5/db/l5e d5/dd/d17/d7b/l96 0 2024-05-09T00:07:45.244 INFO:tasks.workunit.client.0.smithi026.stdout:1/442: write d5/dd/d1f/f7c [39456,99283] 0 2024-05-09T00:07:45.244 INFO:tasks.workunit.client.0.smithi026.stdout:1/443: readlink d5/db/d1d/l4c 0 2024-05-09T00:07:45.244 INFO:tasks.workunit.client.0.smithi026.stdout:1/444: write d5/dd/f58 [1077569,97325] 0 2024-05-09T00:07:45.247 INFO:tasks.workunit.client.0.smithi026.stdout:1/445: dread d5/dd/f49 [0,4194304] 0 2024-05-09T00:07:45.247 INFO:tasks.workunit.client.0.smithi026.stdout:5/378: dwrite d2/d8/d31/f30 [0,4194304] 0 2024-05-09T00:07:45.256 INFO:tasks.workunit.client.0.smithi026.stdout:5/379: mknod d2/d8/c7a 0 2024-05-09T00:07:45.256 INFO:tasks.workunit.client.0.smithi026.stdout:5/380: fdatasync d2/d8/d31/d24/f52 0 2024-05-09T00:07:45.258 INFO:tasks.workunit.client.0.smithi026.stdout:5/381: rename d2/d8/d31/f17 to d2/d8/d31/d24/f7b 0 2024-05-09T00:07:45.258 INFO:tasks.workunit.client.0.smithi026.stdout:5/382: fsync d2/f60 0 2024-05-09T00:07:45.258 INFO:tasks.workunit.client.0.smithi026.stdout:5/383: chown d2/d8/d31/d32/d48/c49 97829 1 2024-05-09T00:07:45.259 INFO:tasks.workunit.client.0.smithi026.stdout:2/335: sync 2024-05-09T00:07:45.259 INFO:tasks.workunit.client.0.smithi026.stdout:4/324: sync 2024-05-09T00:07:45.260 INFO:tasks.workunit.client.0.smithi026.stdout:8/429: sync 2024-05-09T00:07:45.260 INFO:tasks.workunit.client.0.smithi026.stdout:6/318: sync 2024-05-09T00:07:45.260 INFO:tasks.workunit.client.0.smithi026.stdout:8/430: chown de/d17/f64 35746990 1 2024-05-09T00:07:45.261 INFO:tasks.workunit.client.0.smithi026.stdout:4/325: truncate d0/fe 3767888 0 2024-05-09T00:07:45.261 INFO:tasks.workunit.client.0.smithi026.stdout:4/326: write d0/d12/d1b/f51 [568996,121185] 0 2024-05-09T00:07:45.262 INFO:tasks.workunit.client.0.smithi026.stdout:4/327: dread - d0/d19/d43/d58/f6b zero size 2024-05-09T00:07:45.262 INFO:tasks.workunit.client.0.smithi026.stdout:4/328: fdatasync d0/d12/d1b/f3c 0 2024-05-09T00:07:45.262 INFO:tasks.workunit.client.0.smithi026.stdout:8/431: write de/d17/d21/d24/d3b/f47 [2572844,65359] 0 2024-05-09T00:07:45.263 INFO:tasks.workunit.client.0.smithi026.stdout:2/336: mknod d14/d15/d30/d6a/d5f/c79 0 2024-05-09T00:07:45.268 INFO:tasks.workunit.client.0.smithi026.stdout:5/384: dread d2/d8/d31/d24/f65 [0,4194304] 0 2024-05-09T00:07:45.268 INFO:tasks.workunit.client.0.smithi026.stdout:6/319: dread d15/d34/f53 [0,4194304] 0 2024-05-09T00:07:45.268 INFO:tasks.workunit.client.0.smithi026.stdout:6/320: write d15/f29 [1720659,122350] 0 2024-05-09T00:07:45.268 INFO:tasks.workunit.client.0.smithi026.stdout:1/446: dwrite d5/db/f81 [0,4194304] 0 2024-05-09T00:07:45.268 INFO:tasks.workunit.client.0.smithi026.stdout:4/329: rename d0/d12/d1b/d2b/f48 to d0/d12/d64/f6e 0 2024-05-09T00:07:45.280 INFO:tasks.workunit.client.0.smithi026.stdout:2/337: mknod d14/d15/d3b/c7a 0 2024-05-09T00:07:45.282 INFO:tasks.workunit.client.0.smithi026.stdout:8/432: dwrite de/d6c/d31/d4f/d87/f4d [0,4194304] 0 2024-05-09T00:07:45.285 INFO:tasks.workunit.client.0.smithi026.stdout:2/338: write d14/d15/f1b [356715,116392] 0 2024-05-09T00:07:45.411 INFO:tasks.workunit.client.0.smithi026.stdout:4/330: fsync d0/d19/f1e 0 2024-05-09T00:07:45.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/331: read - d0/d19/f57 zero size 2024-05-09T00:07:45.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/332: dread - d0/d19/f57 zero size 2024-05-09T00:07:45.415 INFO:tasks.workunit.client.0.smithi026.stdout:6/321: symlink d15/d2b/d33/d55/l66 0 2024-05-09T00:07:45.430 INFO:tasks.workunit.client.0.smithi026.stdout:8/433: creat de/d17/d21/d6f/f8e x:0 0 0 2024-05-09T00:07:45.430 INFO:tasks.workunit.client.0.smithi026.stdout:8/434: stat de/d17/d21/d24/f26 0 2024-05-09T00:07:45.432 INFO:tasks.workunit.client.0.smithi026.stdout:2/339: symlink d14/d22/d55/d6b/l7b 0 2024-05-09T00:07:45.433 INFO:tasks.workunit.client.0.smithi026.stdout:2/340: read fb [2783952,8277] 0 2024-05-09T00:07:45.433 INFO:tasks.workunit.client.0.smithi026.stdout:2/341: chown d14/c77 41220211 1 2024-05-09T00:07:45.434 INFO:tasks.workunit.client.0.smithi026.stdout:4/333: creat d0/d12/d1b/d2b/f6f x:0 0 0 2024-05-09T00:07:45.436 INFO:tasks.workunit.client.0.smithi026.stdout:5/385: link d2/d8/d31/l23 d2/d5a/l7c 0 2024-05-09T00:07:45.437 INFO:tasks.workunit.client.0.smithi026.stdout:6/322: mkdir d15/d2b/d33/d55/d67 0 2024-05-09T00:07:45.439 INFO:tasks.workunit.client.0.smithi026.stdout:8/435: creat de/d6c/d31/d4f/d87/f8f x:0 0 0 2024-05-09T00:07:45.441 INFO:tasks.workunit.client.0.smithi026.stdout:2/342: mknod d14/d15/d3b/d40/d47/c7c 0 2024-05-09T00:07:45.442 INFO:tasks.workunit.client.0.smithi026.stdout:4/334: truncate d0/f2 7357991 0 2024-05-09T00:07:45.442 INFO:tasks.workunit.client.0.smithi026.stdout:4/335: dread - d0/d12/d1b/d2b/f5e zero size 2024-05-09T00:07:45.445 INFO:tasks.workunit.client.0.smithi026.stdout:5/386: creat d2/d8/d6d/f7d x:0 0 0 2024-05-09T00:07:45.448 INFO:tasks.workunit.client.0.smithi026.stdout:4/336: getdents d0/d12/d1b 0 2024-05-09T00:07:45.450 INFO:tasks.workunit.client.0.smithi026.stdout:5/387: creat d2/d5a/f7e x:0 0 0 2024-05-09T00:07:45.459 INFO:tasks.workunit.client.0.smithi026.stdout:5/388: dread d2/d8/d31/d4b/d51/f53 [0,4194304] 0 2024-05-09T00:07:45.462 INFO:tasks.workunit.client.0.smithi026.stdout:5/389: chown d2/d8/d31/l1e 424420759 1 2024-05-09T00:07:45.462 INFO:tasks.workunit.client.0.smithi026.stdout:5/390: chown d2/d8 2853026 1 2024-05-09T00:07:45.472 INFO:tasks.workunit.client.0.smithi026.stdout:8/436: dwrite de/d17/d21/d24/f26 [4194304,4194304] 0 2024-05-09T00:07:45.473 INFO:tasks.workunit.client.0.smithi026.stdout:8/437: truncate f9 95593 0 2024-05-09T00:07:45.473 INFO:tasks.workunit.client.0.smithi026.stdout:2/343: dwrite d14/f18 [0,4194304] 0 2024-05-09T00:07:45.474 INFO:tasks.workunit.client.0.smithi026.stdout:2/344: readlink d14/d15/d3b/l49 0 2024-05-09T00:07:45.475 INFO:tasks.workunit.client.0.smithi026.stdout:2/345: read f8 [170277,58416] 0 2024-05-09T00:07:45.479 INFO:tasks.workunit.client.0.smithi026.stdout:5/391: dread d2/d8/d31/d2e/d4a/f3c [0,4194304] 0 2024-05-09T00:07:45.479 INFO:tasks.workunit.client.0.smithi026.stdout:4/337: dwrite d0/d12/d34/f36 [0,4194304] 0 2024-05-09T00:07:45.479 INFO:tasks.workunit.client.0.smithi026.stdout:4/338: read - d0/d12/d64/f6e zero size 2024-05-09T00:07:45.479 INFO:tasks.workunit.client.0.smithi026.stdout:2/346: creat d14/d22/f7d x:0 0 0 2024-05-09T00:07:45.488 INFO:tasks.workunit.client.0.smithi026.stdout:4/339: creat d0/d19/d43/d49/f70 x:0 0 0 2024-05-09T00:07:45.489 INFO:tasks.workunit.client.0.smithi026.stdout:8/438: dwrite de/d6c/d31/d4f/d87/f6d [0,4194304] 0 2024-05-09T00:07:45.490 INFO:tasks.workunit.client.0.smithi026.stdout:4/340: unlink d0/d19/d43/d49/f5a 0 2024-05-09T00:07:45.495 INFO:tasks.workunit.client.0.smithi026.stdout:4/341: mknod d0/d12/d1b/d4e/c71 0 2024-05-09T00:07:45.495 INFO:tasks.workunit.client.0.smithi026.stdout:4/342: chown d0/d12 32909 1 2024-05-09T00:07:45.497 INFO:tasks.workunit.client.0.smithi026.stdout:8/439: dread de/d6c/f3c [0,4194304] 0 2024-05-09T00:07:45.497 INFO:tasks.workunit.client.0.smithi026.stdout:4/343: link d0/d12/d1b/c2a d0/d12/d1b/d2b/c72 0 2024-05-09T00:07:45.497 INFO:tasks.workunit.client.0.smithi026.stdout:4/344: truncate d0/d19/d43/d49/f60 22154 0 2024-05-09T00:07:45.499 INFO:tasks.workunit.client.0.smithi026.stdout:8/440: creat de/d17/d7d/f90 x:0 0 0 2024-05-09T00:07:45.502 INFO:tasks.workunit.client.0.smithi026.stdout:4/345: link d0/d12/d34/c4a d0/d12/d67/c73 0 2024-05-09T00:07:45.504 INFO:tasks.workunit.client.0.smithi026.stdout:8/441: getdents de/d60 0 2024-05-09T00:07:45.519 INFO:tasks.workunit.client.0.smithi026.stdout:8/442: dwrite de/ff [0,4194304] 0 2024-05-09T00:07:45.519 INFO:tasks.workunit.client.0.smithi026.stdout:8/443: chown de/d17/f43 2 1 2024-05-09T00:07:45.524 INFO:tasks.workunit.client.0.smithi026.stdout:8/444: dread de/d6c/f3c [0,4194304] 0 2024-05-09T00:07:45.527 INFO:tasks.workunit.client.0.smithi026.stdout:8/445: mkdir de/d48/d73/d91 0 2024-05-09T00:07:45.528 INFO:tasks.workunit.client.0.smithi026.stdout:8/446: truncate de/d17/f43 1540134 0 2024-05-09T00:07:45.529 INFO:tasks.workunit.client.0.smithi026.stdout:8/447: truncate de/d48/f7c 674532 0 2024-05-09T00:07:45.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/448: rmdir de/d6c/d31/d4f/d87 39 2024-05-09T00:07:45.628 INFO:tasks.workunit.client.0.smithi026.stdout:1/447: rename d5/db/d30 to d5/d16/d60/d66/d97 0 2024-05-09T00:07:45.628 INFO:tasks.workunit.client.0.smithi026.stdout:1/448: write d5/f27 [4577772,127186] 0 2024-05-09T00:07:45.629 INFO:tasks.workunit.client.0.smithi026.stdout:5/392: rename d2/d8/d31/d2e/d4a/f73 to d2/d8/d31/d2e/d33/f7f 0 2024-05-09T00:07:45.631 INFO:tasks.workunit.client.0.smithi026.stdout:5/393: mknod d2/d8/d31/d32/c80 0 2024-05-09T00:07:45.644 INFO:tasks.workunit.client.0.smithi026.stdout:5/394: unlink d2/c4 0 2024-05-09T00:07:45.645 INFO:tasks.workunit.client.0.smithi026.stdout:5/395: write d2/f41 [267317,126179] 0 2024-05-09T00:07:45.645 INFO:tasks.workunit.client.0.smithi026.stdout:5/396: fsync d2/d8/d31/f30 0 2024-05-09T00:07:45.648 INFO:tasks.workunit.client.0.smithi026.stdout:5/397: read d2/d8/d31/d24/f65 [1298385,51464] 0 2024-05-09T00:07:45.648 INFO:tasks.workunit.client.0.smithi026.stdout:5/398: mknod d2/d8/d31/d32/c81 0 2024-05-09T00:07:45.648 INFO:tasks.workunit.client.0.smithi026.stdout:5/399: chown d2/d5a/f5f 112 1 2024-05-09T00:07:45.650 INFO:tasks.workunit.client.0.smithi026.stdout:1/449: dwrite d5/d16/d60/d66/d97/f55 [0,4194304] 0 2024-05-09T00:07:45.653 INFO:tasks.workunit.client.0.smithi026.stdout:1/450: mkdir d5/dd/d17/d98 0 2024-05-09T00:07:45.654 INFO:tasks.workunit.client.0.smithi026.stdout:1/451: dread d5/dd/d17/d73/f7a [0,4194304] 0 2024-05-09T00:07:45.657 INFO:tasks.workunit.client.0.smithi026.stdout:2/347: rename d14/d15/f25 to d14/d15/d1f/d70/f7e 0 2024-05-09T00:07:45.658 INFO:tasks.workunit.client.0.smithi026.stdout:4/346: rename d0/d12/f2c to d0/d12/d1b/f74 0 2024-05-09T00:07:45.661 INFO:tasks.workunit.client.0.smithi026.stdout:4/347: link d0/d12/d1b/d4e/f5b d0/f75 0 2024-05-09T00:07:45.661 INFO:tasks.workunit.client.0.smithi026.stdout:4/348: fsync d0/d12/f13 0 2024-05-09T00:07:45.661 INFO:tasks.workunit.client.0.smithi026.stdout:4/349: dread - d0/d12/d1b/d2b/f5e zero size 2024-05-09T00:07:45.662 INFO:tasks.workunit.client.0.smithi026.stdout:8/449: rename de/d17/d21/d24/l35 to de/d6c/d31/l92 0 2024-05-09T00:07:45.663 INFO:tasks.workunit.client.0.smithi026.stdout:4/350: creat d0/d12/d67/f76 x:0 0 0 2024-05-09T00:07:45.663 INFO:tasks.workunit.client.0.smithi026.stdout:4/351: dread - d0/d12/f30 zero size 2024-05-09T00:07:45.665 INFO:tasks.workunit.client.0.smithi026.stdout:1/452: rename d5/db/d1d/l63 to d5/dd/l99 0 2024-05-09T00:07:45.666 INFO:tasks.workunit.client.0.smithi026.stdout:1/453: write d5/dd/d17/f2a [1855704,10233] 0 2024-05-09T00:07:45.668 INFO:tasks.workunit.client.0.smithi026.stdout:8/450: creat de/d17/d21/d6f/f93 x:0 0 0 2024-05-09T00:07:45.668 INFO:tasks.workunit.client.0.smithi026.stdout:8/451: write f3 [5216426,40833] 0 2024-05-09T00:07:45.668 INFO:tasks.workunit.client.0.smithi026.stdout:8/452: truncate de/d6c/d31/d4f/d87/f8f 801134 0 2024-05-09T00:07:45.669 INFO:tasks.workunit.client.0.smithi026.stdout:4/352: creat d0/d19/d43/d49/f77 x:0 0 0 2024-05-09T00:07:45.669 INFO:tasks.workunit.client.0.smithi026.stdout:1/454: dread f2 [8388608,4194304] 0 2024-05-09T00:07:45.670 INFO:tasks.workunit.client.0.smithi026.stdout:5/400: dwrite d2/f72 [0,4194304] 0 2024-05-09T00:07:45.671 INFO:tasks.workunit.client.0.smithi026.stdout:2/348: dread d14/f18 [0,4194304] 0 2024-05-09T00:07:45.672 INFO:tasks.workunit.client.0.smithi026.stdout:8/453: creat de/d48/f94 x:0 0 0 2024-05-09T00:07:45.675 INFO:tasks.workunit.client.0.smithi026.stdout:4/353: mkdir d0/d12/d1b/d4e/d78 0 2024-05-09T00:07:45.679 INFO:tasks.workunit.client.0.smithi026.stdout:1/455: link d5/dd/d1f/f7c d5/dd/d87/f9a 0 2024-05-09T00:07:45.681 INFO:tasks.workunit.client.0.smithi026.stdout:2/349: link d14/d15/d30/d6a/f63 d14/d22/d55/d6b/f7f 0 2024-05-09T00:07:45.685 INFO:tasks.workunit.client.0.smithi026.stdout:4/354: creat d0/d12/f79 x:0 0 0 2024-05-09T00:07:45.687 INFO:tasks.workunit.client.0.smithi026.stdout:8/454: dread de/d48/f52 [0,4194304] 0 2024-05-09T00:07:45.689 INFO:tasks.workunit.client.0.smithi026.stdout:2/350: dread d14/d15/d20/f36 [0,4194304] 0 2024-05-09T00:07:45.689 INFO:tasks.workunit.client.0.smithi026.stdout:2/351: stat d14/d15/d3b/d40/d47/c48 0 2024-05-09T00:07:45.690 INFO:tasks.workunit.client.0.smithi026.stdout:1/456: write d5/d16/f18 [3042323,127496] 0 2024-05-09T00:07:45.692 INFO:tasks.workunit.client.0.smithi026.stdout:4/355: link d0/f22 d0/d12/d1b/d2b/f7a 0 2024-05-09T00:07:45.692 INFO:tasks.workunit.client.0.smithi026.stdout:4/356: write d0/f4c [357747,18003] 0 2024-05-09T00:07:45.692 INFO:tasks.workunit.client.0.smithi026.stdout:4/357: dread - d0/d19/f57 zero size 2024-05-09T00:07:45.694 INFO:tasks.workunit.client.0.smithi026.stdout:5/401: dwrite d2/f60 [0,4194304] 0 2024-05-09T00:07:45.695 INFO:tasks.workunit.client.0.smithi026.stdout:8/455: creat de/d6c/d31/d4f/d87/d62/f95 x:0 0 0 2024-05-09T00:07:45.697 INFO:tasks.workunit.client.0.smithi026.stdout:2/352: symlink d14/d15/d20/l80 0 2024-05-09T00:07:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:1/457: unlink d5/db/l44 0 2024-05-09T00:07:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:1/458: fsync d5/dd/d17/f8b 0 2024-05-09T00:07:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:1/459: write d5/dd/d17/f8b [619824,19844] 0 2024-05-09T00:07:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:4/358: dread d0/fe [0,4194304] 0 2024-05-09T00:07:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:5/402: symlink d2/d8/d31/d2e/d4a/l82 0 2024-05-09T00:07:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:5/403: stat d2/d8/d31/d63 0 2024-05-09T00:07:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:2/353: creat d14/d15/d30/d6a/f81 x:0 0 0 2024-05-09T00:07:45.714 INFO:tasks.workunit.client.0.smithi026.stdout:8/456: dwrite de/d17/d21/d24/d3b/f7a [0,4194304] 0 2024-05-09T00:07:45.714 INFO:tasks.workunit.client.0.smithi026.stdout:8/457: write de/d48/f7c [1495731,49449] 0 2024-05-09T00:07:45.716 INFO:tasks.workunit.client.0.smithi026.stdout:1/460: mkdir d5/dd/d17/d7b/d9b 0 2024-05-09T00:07:45.721 INFO:tasks.workunit.client.0.smithi026.stdout:4/359: rename d0/d12/f68 to d0/f7b 0 2024-05-09T00:07:45.726 INFO:tasks.workunit.client.0.smithi026.stdout:2/354: mkdir d14/d15/d20/d41/d51/d82 0 2024-05-09T00:07:45.731 INFO:tasks.workunit.client.0.smithi026.stdout:8/458: dwrite de/d48/f7c [0,4194304] 0 2024-05-09T00:07:45.733 INFO:tasks.workunit.client.0.smithi026.stdout:1/461: rmdir d5/d16/d60/d66/d97/d75 39 2024-05-09T00:07:45.733 INFO:tasks.workunit.client.0.smithi026.stdout:1/462: stat d5/d16/d60 0 2024-05-09T00:07:45.734 INFO:tasks.workunit.client.0.smithi026.stdout:1/463: write d5/db/f1e [388025,45646] 0 2024-05-09T00:07:45.738 INFO:tasks.workunit.client.0.smithi026.stdout:5/404: unlink d2/c11 0 2024-05-09T00:07:45.742 INFO:tasks.workunit.client.0.smithi026.stdout:8/459: creat de/d6c/d31/d4f/f96 x:0 0 0 2024-05-09T00:07:45.744 INFO:tasks.workunit.client.0.smithi026.stdout:2/355: dwrite d14/d15/d30/d6a/f81 [0,4194304] 0 2024-05-09T00:07:45.744 INFO:tasks.workunit.client.0.smithi026.stdout:2/356: chown fd 54964483 1 2024-05-09T00:07:45.744 INFO:tasks.workunit.client.0.smithi026.stdout:2/357: read d14/d15/d30/d6a/f81 [982547,10324] 0 2024-05-09T00:07:45.748 INFO:tasks.workunit.client.0.smithi026.stdout:4/360: rename d0/f7b to d0/d19/d43/d49/f7c 0 2024-05-09T00:07:45.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/361: stat d0/f1f 0 2024-05-09T00:07:45.750 INFO:tasks.workunit.client.0.smithi026.stdout:5/405: truncate d2/d8/d31/d2e/d4a/f3c 2547983 0 2024-05-09T00:07:45.752 INFO:tasks.workunit.client.0.smithi026.stdout:4/362: dread d0/d12/f13 [0,4194304] 0 2024-05-09T00:07:45.752 INFO:tasks.workunit.client.0.smithi026.stdout:1/464: dwrite d5/dd/d17/f8b [0,4194304] 0 2024-05-09T00:07:45.753 INFO:tasks.workunit.client.0.smithi026.stdout:8/460: creat de/d6c/d31/f97 x:0 0 0 2024-05-09T00:07:45.760 INFO:tasks.workunit.client.0.smithi026.stdout:2/358: truncate d14/d15/f39 1179771 0 2024-05-09T00:07:45.763 INFO:tasks.workunit.client.0.smithi026.stdout:3/379: sync 2024-05-09T00:07:45.763 INFO:tasks.workunit.client.0.smithi026.stdout:0/552: sync 2024-05-09T00:07:45.763 INFO:tasks.workunit.client.0.smithi026.stdout:5/406: creat d2/d8/d31/d63/f83 x:0 0 0 2024-05-09T00:07:45.766 INFO:tasks.workunit.client.0.smithi026.stdout:4/363: dwrite d0/d19/d43/d49/f7c [0,4194304] 0 2024-05-09T00:07:45.771 INFO:tasks.workunit.client.0.smithi026.stdout:1/465: creat d5/dd/d17/d7b/f9c x:0 0 0 2024-05-09T00:07:45.773 INFO:tasks.workunit.client.0.smithi026.stdout:8/461: creat de/d17/d21/d24/d5b/f98 x:0 0 0 2024-05-09T00:07:45.777 INFO:tasks.workunit.client.0.smithi026.stdout:0/553: creat d1d/da4/fb8 x:0 0 0 2024-05-09T00:07:45.792 INFO:tasks.workunit.client.0.smithi026.stdout:3/380: dwrite d5/d9/f2a [0,4194304] 0 2024-05-09T00:07:45.792 INFO:tasks.workunit.client.0.smithi026.stdout:3/381: chown d5/d9/dc/d28/f2e 1174210 1 2024-05-09T00:07:45.792 INFO:tasks.workunit.client.0.smithi026.stdout:3/382: write d5/d9/dc/f23 [985850,80747] 0 2024-05-09T00:07:45.793 INFO:tasks.workunit.client.0.smithi026.stdout:2/359: write d14/d15/d1f/f2d [628388,103417] 0 2024-05-09T00:07:45.793 INFO:tasks.workunit.client.0.smithi026.stdout:2/360: chown d14/d22 464 1 2024-05-09T00:07:45.796 INFO:tasks.workunit.client.0.smithi026.stdout:4/364: symlink d0/d12/d1b/d2b/d66/l7d 0 2024-05-09T00:07:45.796 INFO:tasks.workunit.client.0.smithi026.stdout:4/365: truncate d0/d12/f79 173042 0 2024-05-09T00:07:45.796 INFO:tasks.workunit.client.0.smithi026.stdout:3/383: dread d5/d9/dc/d28/f5e [0,4194304] 0 2024-05-09T00:07:45.797 INFO:tasks.workunit.client.0.smithi026.stdout:1/466: truncate d5/f7 4111451 0 2024-05-09T00:07:45.797 INFO:tasks.workunit.client.0.smithi026.stdout:8/462: write de/f5d [4923431,12697] 0 2024-05-09T00:07:45.798 INFO:tasks.workunit.client.0.smithi026.stdout:5/407: dwrite d2/f41 [0,4194304] 0 2024-05-09T00:07:45.800 INFO:tasks.workunit.client.0.smithi026.stdout:0/554: creat d1d/d25/d47/fb9 x:0 0 0 2024-05-09T00:07:45.802 INFO:tasks.workunit.client.0.smithi026.stdout:5/408: dread d2/d8/d31/d2e/d33/f68 [0,4194304] 0 2024-05-09T00:07:45.806 INFO:tasks.workunit.client.0.smithi026.stdout:2/361: symlink d14/d15/d30/d6a/d5f/d61/d6c/l83 0 2024-05-09T00:07:45.809 INFO:tasks.workunit.client.0.smithi026.stdout:4/366: creat d0/d19/d43/d58/f7e x:0 0 0 2024-05-09T00:07:45.809 INFO:tasks.workunit.client.0.smithi026.stdout:7/550: sync 2024-05-09T00:07:45.810 INFO:tasks.workunit.client.0.smithi026.stdout:9/464: sync 2024-05-09T00:07:45.810 INFO:tasks.workunit.client.0.smithi026.stdout:7/551: chown d8/d2e/d84/db4/dbc/d22/d29/faf 27461 1 2024-05-09T00:07:45.810 INFO:tasks.workunit.client.0.smithi026.stdout:3/384: unlink d5/d9/d49/l64 0 2024-05-09T00:07:45.810 INFO:tasks.workunit.client.0.smithi026.stdout:7/552: write d8/d2e/d84/db4/dbc/d1e/d3d/d6b/faa [1010080,48982] 0 2024-05-09T00:07:45.811 INFO:tasks.workunit.client.0.smithi026.stdout:1/467: dwrite d5/d16/d60/d66/d97/f4d [0,4194304] 0 2024-05-09T00:07:45.811 INFO:tasks.workunit.client.0.smithi026.stdout:1/468: dread - d5/dd/d1f/f8f zero size 2024-05-09T00:07:45.813 INFO:tasks.workunit.client.0.smithi026.stdout:8/463: creat de/d17/d21/d24/f99 x:0 0 0 2024-05-09T00:07:45.814 INFO:tasks.workunit.client.0.smithi026.stdout:0/555: mknod d1d/cba 0 2024-05-09T00:07:45.815 INFO:tasks.workunit.client.0.smithi026.stdout:0/556: write d1d/d25/d47/d6e/f8e [542733,40359] 0 2024-05-09T00:07:45.817 INFO:tasks.workunit.client.0.smithi026.stdout:5/409: symlink d2/d8/d31/d32/d5c/l84 0 2024-05-09T00:07:45.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/362: creat d14/d15/d30/d6a/d5b/f84 x:0 0 0 2024-05-09T00:07:45.822 INFO:tasks.workunit.client.0.smithi026.stdout:2/363: write d14/d15/d1f/d70/f7e [309092,21907] 0 2024-05-09T00:07:45.823 INFO:tasks.workunit.client.0.smithi026.stdout:4/367: rename d0/f1f to d0/d19/d43/d49/f7f 0 2024-05-09T00:07:45.825 INFO:tasks.workunit.client.0.smithi026.stdout:7/553: mknod d8/d2e/d84/db4/dbc/d95/cbe 0 2024-05-09T00:07:45.827 INFO:tasks.workunit.client.0.smithi026.stdout:3/385: creat d5/d9/d4a/d5f/d6f/d75/f7c x:0 0 0 2024-05-09T00:07:45.827 INFO:tasks.workunit.client.0.smithi026.stdout:3/386: write d5/d9/dc/d28/f2e [2525286,52231] 0 2024-05-09T00:07:45.829 INFO:tasks.workunit.client.0.smithi026.stdout:8/464: symlink de/d17/d21/d6f/l9a 0 2024-05-09T00:07:45.829 INFO:tasks.workunit.client.0.smithi026.stdout:8/465: chown de/d17/d21/d6f/f93 18 1 2024-05-09T00:07:45.832 INFO:tasks.workunit.client.0.smithi026.stdout:5/410: creat d2/d8/d31/f85 x:0 0 0 2024-05-09T00:07:45.832 INFO:tasks.workunit.client.0.smithi026.stdout:9/465: dwrite d7/d23/f7b [0,4194304] 0 2024-05-09T00:07:45.833 INFO:tasks.workunit.client.0.smithi026.stdout:2/364: mkdir d14/d15/d30/d6a/d5f/d61/d6c/d85 0 2024-05-09T00:07:45.834 INFO:tasks.workunit.client.0.smithi026.stdout:4/368: symlink d0/d12/d1b/d4e/d78/l80 0 2024-05-09T00:07:45.834 INFO:tasks.workunit.client.0.smithi026.stdout:4/369: chown d0/d12/d1b/c3a 26484535 1 2024-05-09T00:07:45.834 INFO:tasks.workunit.client.0.smithi026.stdout:4/370: write d0/d19/d43/d49/f7f [1540794,73627] 0 2024-05-09T00:07:45.834 INFO:tasks.workunit.client.0.smithi026.stdout:4/371: fdatasync d0/d12/d1b/f74 0 2024-05-09T00:07:45.835 INFO:tasks.workunit.client.0.smithi026.stdout:4/372: truncate d0/d12/d1b/f53 244580 0 2024-05-09T00:07:45.836 INFO:tasks.workunit.client.0.smithi026.stdout:1/469: rename d5/db/c11 to d5/db/d1d/c9d 0 2024-05-09T00:07:45.836 INFO:tasks.workunit.client.0.smithi026.stdout:4/373: dread d0/d12/d1b/f51 [0,4194304] 0 2024-05-09T00:07:45.837 INFO:tasks.workunit.client.0.smithi026.stdout:3/387: truncate d5/d9/dc/f11 3205431 0 2024-05-09T00:07:45.838 INFO:tasks.workunit.client.0.smithi026.stdout:8/466: read de/d6c/d31/f81 [24439,105836] 0 2024-05-09T00:07:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:5/411: creat d2/d8/d31/d2e/d79/f86 x:0 0 0 2024-05-09T00:07:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:9/466: creat d7/d23/d29/d31/d40/d41/fa8 x:0 0 0 2024-05-09T00:07:45.846 INFO:tasks.workunit.client.0.smithi026.stdout:2/365: creat d14/f86 x:0 0 0 2024-05-09T00:07:45.849 INFO:tasks.workunit.client.0.smithi026.stdout:2/366: write d14/d15/d20/f23 [577957,57164] 0 2024-05-09T00:07:45.850 INFO:tasks.workunit.client.0.smithi026.stdout:0/557: rename d1d/d25/d3c/d5f to d1d/d33/dbb 0 2024-05-09T00:07:45.850 INFO:tasks.workunit.client.0.smithi026.stdout:0/558: chown d1d/d1e/f4b 1 1 2024-05-09T00:07:45.851 INFO:tasks.workunit.client.0.smithi026.stdout:1/470: creat d5/d16/f9e x:0 0 0 2024-05-09T00:07:45.853 INFO:tasks.workunit.client.0.smithi026.stdout:4/374: symlink d0/d12/l81 0 2024-05-09T00:07:45.856 INFO:tasks.workunit.client.0.smithi026.stdout:3/388: creat d5/d9/dc/d5d/f7d x:0 0 0 2024-05-09T00:07:45.856 INFO:tasks.workunit.client.0.smithi026.stdout:3/389: stat d5/d9/dc/d28/f2e 0 2024-05-09T00:07:45.857 INFO:tasks.workunit.client.0.smithi026.stdout:8/467: symlink de/d6c/d31/d4f/d87/d62/l9b 0 2024-05-09T00:07:45.860 INFO:tasks.workunit.client.0.smithi026.stdout:5/412: rmdir d2/d8/d31/d2e/d35 39 2024-05-09T00:07:45.864 INFO:tasks.workunit.client.0.smithi026.stdout:3/390: dread d5/d9/dc/d28/d63/f67 [0,4194304] 0 2024-05-09T00:07:45.870 INFO:tasks.workunit.client.0.smithi026.stdout:2/367: truncate d14/d15/d17/f34 633134 0 2024-05-09T00:07:45.870 INFO:tasks.workunit.client.0.smithi026.stdout:2/368: fdatasync d14/d15/f1b 0 2024-05-09T00:07:45.870 INFO:tasks.workunit.client.0.smithi026.stdout:2/369: write d14/d22/d55/f56 [5009700,44376] 0 2024-05-09T00:07:45.870 INFO:tasks.workunit.client.0.smithi026.stdout:2/370: truncate d14/d15/d3b/f3f 1183206 0 2024-05-09T00:07:45.870 INFO:tasks.workunit.client.0.smithi026.stdout:5/413: dread d2/d8/d31/d32/d5c/f67 [0,4194304] 0 2024-05-09T00:07:45.874 INFO:tasks.workunit.client.0.smithi026.stdout:7/554: rename d8/d2e/f6f to d8/d2e/d84/db4/dbc/d1e/d3d/fbf 0 2024-05-09T00:07:45.874 INFO:tasks.workunit.client.0.smithi026.stdout:7/555: write d8/d2e/d84/db4/dbc/fa5 [344352,74675] 0 2024-05-09T00:07:45.874 INFO:tasks.workunit.client.0.smithi026.stdout:7/556: chown d8/d2e/d84/db4/dbc/d1e/d3d/c74 1396 1 2024-05-09T00:07:45.874 INFO:tasks.workunit.client.0.smithi026.stdout:1/471: getdents d5/dd/d17 0 2024-05-09T00:07:45.875 INFO:tasks.workunit.client.0.smithi026.stdout:1/472: chown d5/d16/d60/f74 15542126 1 2024-05-09T00:07:45.875 INFO:tasks.workunit.client.0.smithi026.stdout:1/473: write d5/db/f62 [8479441,45512] 0 2024-05-09T00:07:45.877 INFO:tasks.workunit.client.0.smithi026.stdout:4/375: unlink d0/d12/d1b/c3a 0 2024-05-09T00:07:45.877 INFO:tasks.workunit.client.0.smithi026.stdout:4/376: readlink d0/lf 0 2024-05-09T00:07:45.877 INFO:tasks.workunit.client.0.smithi026.stdout:4/377: fdatasync d0/d19/d43/f44 0 2024-05-09T00:07:45.878 INFO:tasks.workunit.client.0.smithi026.stdout:8/468: creat de/d48/d73/d91/f9c x:0 0 0 2024-05-09T00:07:45.878 INFO:tasks.workunit.client.0.smithi026.stdout:8/469: stat de/d17/d21/d24/d3b/f47 0 2024-05-09T00:07:45.880 INFO:tasks.workunit.client.0.smithi026.stdout:3/391: creat d5/d9/dc/d28/d63/f7e x:0 0 0 2024-05-09T00:07:45.880 INFO:tasks.workunit.client.0.smithi026.stdout:3/392: dread - d5/d9/f56 zero size 2024-05-09T00:07:45.880 INFO:tasks.workunit.client.0.smithi026.stdout:3/393: truncate d5/d9/dc/f23 1115693 0 2024-05-09T00:07:45.880 INFO:tasks.workunit.client.0.smithi026.stdout:2/371: creat d14/d22/d55/f87 x:0 0 0 2024-05-09T00:07:45.884 INFO:tasks.workunit.client.0.smithi026.stdout:7/557: link d8/d2e/d84/db4/dbc/d1e/d3d/l46 d8/d2e/d84/db4/dbc/d1e/d80/lc0 0 2024-05-09T00:07:45.884 INFO:tasks.workunit.client.0.smithi026.stdout:7/558: readlink d8/d2e/d84/db4/dbc/l24 0 2024-05-09T00:07:45.887 INFO:tasks.workunit.client.0.smithi026.stdout:1/474: mkdir d5/dd/d17/d9f 0 2024-05-09T00:07:45.891 INFO:tasks.workunit.client.0.smithi026.stdout:8/470: creat de/d17/d7d/f9d x:0 0 0 2024-05-09T00:07:45.892 INFO:tasks.workunit.client.0.smithi026.stdout:3/394: mknod d5/d41/c7f 0 2024-05-09T00:07:45.894 INFO:tasks.workunit.client.0.smithi026.stdout:2/372: symlink d14/d15/d20/d41/d51/d82/l88 0 2024-05-09T00:07:45.900 INFO:tasks.workunit.client.0.smithi026.stdout:2/373: dread f11 [0,4194304] 0 2024-05-09T00:07:45.901 INFO:tasks.workunit.client.0.smithi026.stdout:1/475: unlink d5/dd/d1f/d39/d47/f50 0 2024-05-09T00:07:45.905 INFO:tasks.workunit.client.0.smithi026.stdout:4/378: dread d0/d19/d43/d49/f60 [0,4194304] 0 2024-05-09T00:07:45.905 INFO:tasks.workunit.client.0.smithi026.stdout:4/379: truncate d0/d12/d1b/f26 896874 0 2024-05-09T00:07:45.906 INFO:tasks.workunit.client.0.smithi026.stdout:8/471: chown de/f16 927 1 2024-05-09T00:07:45.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/395: symlink d5/d1e/d7b/l80 0 2024-05-09T00:07:45.909 INFO:tasks.workunit.client.0.smithi026.stdout:2/374: symlink d14/d15/d30/d6a/d5b/l89 0 2024-05-09T00:07:45.911 INFO:tasks.workunit.client.0.smithi026.stdout:4/380: creat d0/d12/d64/f82 x:0 0 0 2024-05-09T00:07:45.911 INFO:tasks.workunit.client.0.smithi026.stdout:4/381: write d0/d12/f30 [390568,47332] 0 2024-05-09T00:07:45.911 INFO:tasks.workunit.client.0.smithi026.stdout:4/382: fsync d0/d19/d43/d58/f6b 0 2024-05-09T00:07:45.911 INFO:tasks.workunit.client.0.smithi026.stdout:8/472: dread de/d17/d21/d24/d3b/d3d/f51 [0,4194304] 0 2024-05-09T00:07:45.912 INFO:tasks.workunit.client.0.smithi026.stdout:8/473: write de/d17/f1a [5818001,107265] 0 2024-05-09T00:07:45.912 INFO:tasks.workunit.client.0.smithi026.stdout:8/474: fdatasync de/d17/f8d 0 2024-05-09T00:07:45.913 INFO:tasks.workunit.client.0.smithi026.stdout:8/475: dread - de/d6c/d31/d4f/f88 zero size 2024-05-09T00:07:45.913 INFO:tasks.workunit.client.0.smithi026.stdout:8/476: stat de/d17/l18 0 2024-05-09T00:07:45.913 INFO:tasks.workunit.client.0.smithi026.stdout:3/396: mkdir d5/d9/dc/d28/d63/d81 0 2024-05-09T00:07:45.915 INFO:tasks.workunit.client.0.smithi026.stdout:2/375: rename d14/d15/d1f/f28 to d14/d15/d3b/d40/f8a 0 2024-05-09T00:07:45.917 INFO:tasks.workunit.client.0.smithi026.stdout:8/477: write de/f25 [1026451,130471] 0 2024-05-09T00:07:45.917 INFO:tasks.workunit.client.0.smithi026.stdout:8/478: dread - de/d17/d7d/f90 zero size 2024-05-09T00:07:45.917 INFO:tasks.workunit.client.0.smithi026.stdout:8/479: write de/d17/f43 [1624607,96597] 0 2024-05-09T00:07:45.917 INFO:tasks.workunit.client.0.smithi026.stdout:8/480: fdatasync de/d17/d7d/f90 0 2024-05-09T00:07:45.917 INFO:tasks.workunit.client.0.smithi026.stdout:8/481: write de/f16 [607237,82420] 0 2024-05-09T00:07:45.917 INFO:tasks.workunit.client.0.smithi026.stdout:8/482: dread - de/d60/f89 zero size 2024-05-09T00:07:45.918 INFO:tasks.workunit.client.0.smithi026.stdout:1/476: dwrite d5/dd/d1f/f57 [0,4194304] 0 2024-05-09T00:07:45.918 INFO:tasks.workunit.client.0.smithi026.stdout:1/477: readlink d5/d16/d60/d66/d97/l33 0 2024-05-09T00:07:45.920 INFO:tasks.workunit.client.0.smithi026.stdout:4/383: rename d0/d12/d67 to d0/d83 0 2024-05-09T00:07:45.923 INFO:tasks.workunit.client.0.smithi026.stdout:2/376: dread d14/d15/d20/d41/d51/f71 [0,4194304] 0 2024-05-09T00:07:45.923 INFO:tasks.workunit.client.0.smithi026.stdout:2/377: write d14/d15/d3b/d40/f8a [4567041,54934] 0 2024-05-09T00:07:45.924 INFO:tasks.workunit.client.0.smithi026.stdout:8/483: creat de/d17/d21/d6f/f9e x:0 0 0 2024-05-09T00:07:45.924 INFO:tasks.workunit.client.0.smithi026.stdout:8/484: chown de/d6c/d31/d4f 1516474 1 2024-05-09T00:07:45.927 INFO:tasks.workunit.client.0.smithi026.stdout:4/384: mknod d0/d19/d43/c84 0 2024-05-09T00:07:45.927 INFO:tasks.workunit.client.0.smithi026.stdout:4/385: read d0/d12/d1b/d2b/f3f [2477301,75784] 0 2024-05-09T00:07:45.927 INFO:tasks.workunit.client.0.smithi026.stdout:8/485: symlink de/d17/d21/d24/d3b/l9f 0 2024-05-09T00:07:45.927 INFO:tasks.workunit.client.0.smithi026.stdout:8/486: chown de/d17/d21 4878 1 2024-05-09T00:07:45.928 INFO:tasks.workunit.client.0.smithi026.stdout:8/487: write de/ff [3024917,18763] 0 2024-05-09T00:07:45.930 INFO:tasks.workunit.client.0.smithi026.stdout:1/478: rename d5/dd/d1f/d39/d47/c85 to d5/dd/d17/ca0 0 2024-05-09T00:07:45.932 INFO:tasks.workunit.client.0.smithi026.stdout:4/386: creat d0/d12/d1b/d4e/d78/f85 x:0 0 0 2024-05-09T00:07:45.932 INFO:tasks.workunit.client.0.smithi026.stdout:4/387: dread - d0/d12/d1b/d2b/f6f zero size 2024-05-09T00:07:45.933 INFO:tasks.workunit.client.0.smithi026.stdout:3/397: dwrite d5/d9/dc/d28/d2c/f58 [0,4194304] 0 2024-05-09T00:07:45.934 INFO:tasks.workunit.client.0.smithi026.stdout:8/488: unlink de/d60/f63 0 2024-05-09T00:07:45.934 INFO:tasks.workunit.client.0.smithi026.stdout:8/489: stat l5 0 2024-05-09T00:07:45.935 INFO:tasks.workunit.client.0.smithi026.stdout:2/378: rename d14/d15/d20/d41/d51/f71 to d14/d15/d17/f8b 0 2024-05-09T00:07:45.937 INFO:tasks.workunit.client.0.smithi026.stdout:1/479: write d5/dd/d17/f2a [4173444,91709] 0 2024-05-09T00:07:45.937 INFO:tasks.workunit.client.0.smithi026.stdout:4/388: mkdir d0/d12/d1b/d2b/d86 0 2024-05-09T00:07:45.941 INFO:tasks.workunit.client.0.smithi026.stdout:4/389: write d0/d19/f1e [2183381,45539] 0 2024-05-09T00:07:45.941 INFO:tasks.workunit.client.0.smithi026.stdout:4/390: getdents d0/d12/d1b/d2b/d86 0 2024-05-09T00:07:45.943 INFO:tasks.workunit.client.0.smithi026.stdout:3/398: symlink d5/d9/dc/d28/l82 0 2024-05-09T00:07:45.944 INFO:tasks.workunit.client.0.smithi026.stdout:3/399: write d5/d41/f37 [1013622,127358] 0 2024-05-09T00:07:45.944 INFO:tasks.workunit.client.0.smithi026.stdout:3/400: truncate d5/f1f 5052229 0 2024-05-09T00:07:45.944 INFO:tasks.workunit.client.0.smithi026.stdout:3/401: fsync d5/d1e/f3d 0 2024-05-09T00:07:45.945 INFO:tasks.workunit.client.0.smithi026.stdout:8/490: symlink de/d17/d21/d24/d3b/la0 0 2024-05-09T00:07:45.949 INFO:tasks.workunit.client.0.smithi026.stdout:2/379: unlink d14/d15/f1b 0 2024-05-09T00:07:45.949 INFO:tasks.workunit.client.0.smithi026.stdout:2/380: chown d14/d15/d20/d41/d51/d82/l88 105301 1 2024-05-09T00:07:45.951 INFO:tasks.workunit.client.0.smithi026.stdout:1/480: creat d5/dd/d1f/d39/fa1 x:0 0 0 2024-05-09T00:07:45.951 INFO:tasks.workunit.client.0.smithi026.stdout:1/481: write d5/dd/d1f/f7c [905479,45451] 0 2024-05-09T00:07:45.956 INFO:tasks.workunit.client.0.smithi026.stdout:4/391: dwrite d0/d12/d1b/f5f [0,4194304] 0 2024-05-09T00:07:45.956 INFO:tasks.workunit.client.0.smithi026.stdout:3/402: creat d5/d9/dc/f83 x:0 0 0 2024-05-09T00:07:45.960 INFO:tasks.workunit.client.0.smithi026.stdout:1/482: dread d5/dd/f58 [0,4194304] 0 2024-05-09T00:07:45.960 INFO:tasks.workunit.client.0.smithi026.stdout:1/483: truncate d5/d16/f9e 252817 0 2024-05-09T00:07:45.966 INFO:tasks.workunit.client.0.smithi026.stdout:2/381: dwrite d14/d15/d1f/f38 [0,4194304] 0 2024-05-09T00:07:45.966 INFO:tasks.workunit.client.0.smithi026.stdout:2/382: stat d14/d15/d20/f36 0 2024-05-09T00:07:45.970 INFO:tasks.workunit.client.0.smithi026.stdout:4/392: mkdir d0/d12/d87 0 2024-05-09T00:07:45.970 INFO:tasks.workunit.client.0.smithi026.stdout:4/393: chown d0/d12/d1b/d2b/f3f 190 1 2024-05-09T00:07:45.971 INFO:tasks.workunit.client.0.smithi026.stdout:1/484: mknod d5/db/d1d/ca2 0 2024-05-09T00:07:45.976 INFO:tasks.workunit.client.0.smithi026.stdout:3/403: dwrite d5/d9/dc/d28/d2c/f6a [0,4194304] 0 2024-05-09T00:07:45.976 INFO:tasks.workunit.client.0.smithi026.stdout:3/404: fdatasync d5/d9/dc/d28/f2e 0 2024-05-09T00:07:45.976 INFO:tasks.workunit.client.0.smithi026.stdout:2/383: creat d14/d15/d20/f8c x:0 0 0 2024-05-09T00:07:45.979 INFO:tasks.workunit.client.0.smithi026.stdout:4/394: link d0/d12/c42 d0/d12/d34/c88 0 2024-05-09T00:07:45.979 INFO:tasks.workunit.client.0.smithi026.stdout:4/395: write d0/d19/d43/d49/f54 [453841,69172] 0 2024-05-09T00:07:45.979 INFO:tasks.workunit.client.0.smithi026.stdout:4/396: fsync d0/f2 0 2024-05-09T00:07:45.983 INFO:tasks.workunit.client.0.smithi026.stdout:4/397: link d0/d12/d1b/d4e/l4f d0/d19/d43/d49/l89 0 2024-05-09T00:07:45.986 INFO:tasks.workunit.client.0.smithi026.stdout:1/485: unlink d5/dd/d17/f5b 0 2024-05-09T00:07:45.986 INFO:tasks.workunit.client.0.smithi026.stdout:1/486: write d5/dd/d1f/d39/f8e [451211,44530] 0 2024-05-09T00:07:45.988 INFO:tasks.workunit.client.0.smithi026.stdout:4/398: creat d0/d19/f8a x:0 0 0 2024-05-09T00:07:45.988 INFO:tasks.workunit.client.0.smithi026.stdout:4/399: chown d0/d12/d1b/l3b 37497444 1 2024-05-09T00:07:45.991 INFO:tasks.workunit.client.0.smithi026.stdout:4/400: unlink d0/d19/c2e 0 2024-05-09T00:07:45.993 INFO:tasks.workunit.client.0.smithi026.stdout:1/487: rename d5/d16/d60/d66/d97/c6a to d5/dd/d17/ca3 0 2024-05-09T00:07:45.994 INFO:tasks.workunit.client.0.smithi026.stdout:3/405: dwrite d5/d41/f2d [0,4194304] 0 2024-05-09T00:07:45.995 INFO:tasks.workunit.client.0.smithi026.stdout:3/406: write d5/d9/dc/f70 [3491683,54856] 0 2024-05-09T00:07:45.997 INFO:tasks.workunit.client.0.smithi026.stdout:3/407: creat d5/d9/dc/d28/d2c/f84 x:0 0 0 2024-05-09T00:07:46.013 INFO:tasks.workunit.client.0.smithi026.stdout:3/408: dwrite d5/d9/dc/d28/d63/f7e [0,4194304] 0 2024-05-09T00:07:46.017 INFO:tasks.workunit.client.0.smithi026.stdout:3/409: creat d5/d9/dc/d5b/f85 x:0 0 0 2024-05-09T00:07:46.025 INFO:tasks.workunit.client.0.smithi026.stdout:1/488: dwrite f4 [4194304,4194304] 0 2024-05-09T00:07:46.026 INFO:tasks.workunit.client.0.smithi026.stdout:1/489: symlink d5/d16/d60/d66/d97/d75/la4 0 2024-05-09T00:07:46.027 INFO:tasks.workunit.client.0.smithi026.stdout:1/490: write d5/d16/d60/d66/f76 [383404,91939] 0 2024-05-09T00:07:46.027 INFO:tasks.workunit.client.0.smithi026.stdout:1/491: chown d5/d16/d60/d66/d97/d75/c91 35 1 2024-05-09T00:07:46.040 INFO:tasks.workunit.client.0.smithi026.stdout:1/492: dread d5/dd/f34 [0,4194304] 0 2024-05-09T00:07:46.040 INFO:tasks.workunit.client.0.smithi026.stdout:1/493: mkdir d5/dd/d17/d9f/da5 0 2024-05-09T00:07:46.041 INFO:tasks.workunit.client.0.smithi026.stdout:1/494: truncate d5/db/f5d 719193 0 2024-05-09T00:07:46.108 INFO:tasks.workunit.client.0.smithi026.stdout:1/495: dwrite d5/dd/f34 [0,4194304] 0 2024-05-09T00:07:46.108 INFO:tasks.workunit.client.0.smithi026.stdout:1/496: stat d5/dd/d1f/d39/f3d 0 2024-05-09T00:07:46.124 INFO:tasks.workunit.client.0.smithi026.stdout:1/497: dwrite d5/dd/f68 [0,4194304] 0 2024-05-09T00:07:46.124 INFO:tasks.workunit.client.0.smithi026.stdout:1/498: readlink d5/db/d1d/l82 0 2024-05-09T00:07:46.125 INFO:tasks.workunit.client.0.smithi026.stdout:1/499: fsync d5/dd/f52 0 2024-05-09T00:07:46.139 INFO:tasks.workunit.client.0.smithi026.stdout:1/500: dwrite f2 [4194304,4194304] 0 2024-05-09T00:07:46.153 INFO:tasks.workunit.client.0.smithi026.stdout:1/501: dwrite d5/dd/f58 [0,4194304] 0 2024-05-09T00:07:46.175 INFO:tasks.workunit.client.0.smithi026.stdout:1/502: dwrite d5/dd/d17/f2a [0,4194304] 0 2024-05-09T00:07:46.294 INFO:tasks.workunit.client.0.smithi026.stdout:6/323: sync 2024-05-09T00:07:46.294 INFO:tasks.workunit.client.0.smithi026.stdout:6/324: chown d15/d1e/d23/d26/d58/d5c/f5d 243746 1 2024-05-09T00:07:46.295 INFO:tasks.workunit.client.0.smithi026.stdout:6/325: readlink d15/l50 0 2024-05-09T00:07:46.295 INFO:tasks.workunit.client.0.smithi026.stdout:6/326: chown d15/d2b/f42 12735223 1 2024-05-09T00:07:46.295 INFO:tasks.workunit.client.0.smithi026.stdout:6/327: chown d15/d1e 1801179 1 2024-05-09T00:07:46.395 INFO:tasks.workunit.client.0.smithi026.stdout:9/467: sync 2024-05-09T00:07:46.395 INFO:tasks.workunit.client.0.smithi026.stdout:0/559: sync 2024-05-09T00:07:46.395 INFO:tasks.workunit.client.0.smithi026.stdout:0/560: write d1d/d33/d64/fb2 [332656,98965] 0 2024-05-09T00:07:46.395 INFO:tasks.workunit.client.0.smithi026.stdout:0/561: dread - d1d/d1e/d20/d51/fb0 zero size 2024-05-09T00:07:46.396 INFO:tasks.workunit.client.0.smithi026.stdout:9/468: write d7/d23/d29/f6a [2942908,110619] 0 2024-05-09T00:07:46.396 INFO:tasks.workunit.client.0.smithi026.stdout:0/562: mkdir d1d/d1e/d20/d4d/d58/dbc 0 2024-05-09T00:07:46.397 INFO:tasks.workunit.client.0.smithi026.stdout:0/563: write d1d/d1e/d2d/f8f [3558480,49231] 0 2024-05-09T00:07:46.399 INFO:tasks.workunit.client.0.smithi026.stdout:0/564: mknod d1d/d1e/d20/d4d/d58/d62/d78/d80/cbd 0 2024-05-09T00:07:46.401 INFO:tasks.workunit.client.0.smithi026.stdout:9/469: rename d7/d23/d29/l8d to d7/la9 0 2024-05-09T00:07:46.403 INFO:tasks.workunit.client.0.smithi026.stdout:0/565: creat d1d/fbe x:0 0 0 2024-05-09T00:07:46.403 INFO:tasks.workunit.client.0.smithi026.stdout:9/470: rmdir d7/d23/d29/d31/d40/d41/d54/d9a 39 2024-05-09T00:07:46.404 INFO:tasks.workunit.client.0.smithi026.stdout:0/566: write d1d/d25/d3c/f88 [3527196,18602] 0 2024-05-09T00:07:46.429 INFO:tasks.workunit.client.0.smithi026.stdout:9/471: dwrite d7/d23/d2f/d3a/f44 [0,4194304] 0 2024-05-09T00:07:46.429 INFO:tasks.workunit.client.0.smithi026.stdout:9/472: fdatasync d7/f28 0 2024-05-09T00:07:46.430 INFO:tasks.workunit.client.0.smithi026.stdout:9/473: creat d7/d23/d29/d31/d40/d41/d54/d5c/faa x:0 0 0 2024-05-09T00:07:46.430 INFO:tasks.workunit.client.0.smithi026.stdout:0/567: dwrite fa [0,4194304] 0 2024-05-09T00:07:46.430 INFO:tasks.workunit.client.0.smithi026.stdout:0/568: fdatasync d1d/d1e/d20/d4d/f6f 0 2024-05-09T00:07:46.433 INFO:tasks.workunit.client.0.smithi026.stdout:0/569: rmdir d1d/d1e/d20/d4d/d58/dbc 0 2024-05-09T00:07:46.433 INFO:tasks.workunit.client.0.smithi026.stdout:9/474: mknod d7/d23/d2f/d50/cab 0 2024-05-09T00:07:46.438 INFO:tasks.workunit.client.0.smithi026.stdout:0/570: rename c6 to d1d/d25/d47/cbf 0 2024-05-09T00:07:46.440 INFO:tasks.workunit.client.0.smithi026.stdout:0/571: rmdir d1d/d1e/db7 0 2024-05-09T00:07:46.442 INFO:tasks.workunit.client.0.smithi026.stdout:0/572: mknod d1d/d1e/d20/d4d/d83/d9e/cc0 0 2024-05-09T00:07:46.444 INFO:tasks.workunit.client.0.smithi026.stdout:0/573: mknod d1d/cc1 0 2024-05-09T00:07:46.451 INFO:tasks.workunit.client.0.smithi026.stdout:0/574: dread d1d/d25/d3c/f46 [0,4194304] 0 2024-05-09T00:07:46.452 INFO:tasks.workunit.client.0.smithi026.stdout:0/575: getdents d1d/d1e/d20/d4d/d58/d62 0 2024-05-09T00:07:46.452 INFO:tasks.workunit.client.0.smithi026.stdout:0/576: fsync d1d/d33/f3a 0 2024-05-09T00:07:46.454 INFO:tasks.workunit.client.0.smithi026.stdout:0/577: mkdir d1d/d25/d47/d6e/dc2 0 2024-05-09T00:07:46.454 INFO:tasks.workunit.client.0.smithi026.stdout:0/578: stat d1d/d25/d47 0 2024-05-09T00:07:46.455 INFO:tasks.workunit.client.0.smithi026.stdout:9/475: dwrite d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa1 [0,4194304] 0 2024-05-09T00:07:46.461 INFO:tasks.workunit.client.0.smithi026.stdout:9/476: symlink d7/d23/d2f/d3a/lac 0 2024-05-09T00:07:46.469 INFO:tasks.workunit.client.0.smithi026.stdout:9/477: mknod d7/d23/d29/d31/d40/d41/d54/d9a/cad 0 2024-05-09T00:07:46.470 INFO:tasks.workunit.client.0.smithi026.stdout:9/478: link d7/c1a d7/d23/d2f/d7d/cae 0 2024-05-09T00:07:46.472 INFO:tasks.workunit.client.0.smithi026.stdout:9/479: write d7/d23/d2f/d3a/f44 [4806768,68053] 0 2024-05-09T00:07:46.473 INFO:tasks.workunit.client.0.smithi026.stdout:9/480: write d7/d23/f84 [856389,12822] 0 2024-05-09T00:07:46.473 INFO:tasks.workunit.client.0.smithi026.stdout:9/481: readlink d7/d23/d2f/d50/la2 0 2024-05-09T00:07:46.473 INFO:tasks.workunit.client.0.smithi026.stdout:9/482: creat d7/d23/d2f/d7d/d87/faf x:0 0 0 2024-05-09T00:07:46.476 INFO:tasks.workunit.client.0.smithi026.stdout:9/483: unlink d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/la5 0 2024-05-09T00:07:46.478 INFO:tasks.workunit.client.0.smithi026.stdout:9/484: rename d7/c8a to d7/d23/d29/d31/cb0 0 2024-05-09T00:07:46.479 INFO:tasks.workunit.client.0.smithi026.stdout:9/485: mknod d7/d23/cb1 0 2024-05-09T00:07:46.495 INFO:tasks.workunit.client.0.smithi026.stdout:9/486: dwrite d7/d23/d76/f8c [0,4194304] 0 2024-05-09T00:07:46.504 INFO:tasks.workunit.client.0.smithi026.stdout:9/487: mkdir d7/d23/d2f/d7d/db2 0 2024-05-09T00:07:46.516 INFO:tasks.workunit.client.0.smithi026.stdout:7/559: sync 2024-05-09T00:07:46.516 INFO:tasks.workunit.client.0.smithi026.stdout:8/491: sync 2024-05-09T00:07:46.517 INFO:tasks.workunit.client.0.smithi026.stdout:9/488: dwrite d7/d23/d29/d31/d40/f48 [0,4194304] 0 2024-05-09T00:07:46.517 INFO:tasks.workunit.client.0.smithi026.stdout:7/560: truncate d8/d2e/d84/db4/dbc/d1e/d3d/d6b/f88 964944 0 2024-05-09T00:07:46.517 INFO:tasks.workunit.client.0.smithi026.stdout:9/489: truncate d7/d23/d2f/d7d/d87/faf 978957 0 2024-05-09T00:07:46.518 INFO:tasks.workunit.client.0.smithi026.stdout:5/414: sync 2024-05-09T00:07:46.518 INFO:tasks.workunit.client.0.smithi026.stdout:5/415: readlink d2/d8/l76 0 2024-05-09T00:07:46.524 INFO:tasks.workunit.client.0.smithi026.stdout:7/561: rename d8/d2e/d84/db4/dbc/d95 to d8/d1b/d89/dc1 0 2024-05-09T00:07:46.524 INFO:tasks.workunit.client.0.smithi026.stdout:7/562: fdatasync d8/d1b/f7b 0 2024-05-09T00:07:46.524 INFO:tasks.workunit.client.0.smithi026.stdout:7/563: truncate d8/d2e/d84/db4/dbc/d22/f31 4298041 0 2024-05-09T00:07:46.524 INFO:tasks.workunit.client.0.smithi026.stdout:7/564: fsync d8/d2e/d84/db4/dbc/d22/d29/faf 0 2024-05-09T00:07:46.525 INFO:tasks.workunit.client.0.smithi026.stdout:7/565: write d8/d2e/f54 [3255556,64043] 0 2024-05-09T00:07:46.525 INFO:tasks.workunit.client.0.smithi026.stdout:7/566: fdatasync d8/d1b/f34 0 2024-05-09T00:07:46.525 INFO:tasks.workunit.client.0.smithi026.stdout:9/490: creat d7/d23/d29/d31/d40/d41/fb3 x:0 0 0 2024-05-09T00:07:46.528 INFO:tasks.workunit.client.0.smithi026.stdout:5/416: getdents d2 0 2024-05-09T00:07:46.532 INFO:tasks.workunit.client.0.smithi026.stdout:7/567: creat d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/fc2 x:0 0 0 2024-05-09T00:07:46.533 INFO:tasks.workunit.client.0.smithi026.stdout:9/491: rmdir d7/d23/d29/d31/d40/d41/d54/d5c/d66 39 2024-05-09T00:07:46.534 INFO:tasks.workunit.client.0.smithi026.stdout:5/417: symlink d2/d8/d31/d32/d5c/l87 0 2024-05-09T00:07:46.535 INFO:tasks.workunit.client.0.smithi026.stdout:9/492: mknod d7/d23/d2f/cb4 0 2024-05-09T00:07:46.537 INFO:tasks.workunit.client.0.smithi026.stdout:5/418: read d2/d8/d31/d24/f62 [2941815,74086] 0 2024-05-09T00:07:46.537 INFO:tasks.workunit.client.0.smithi026.stdout:5/419: fsync d2/d8/f59 0 2024-05-09T00:07:46.537 INFO:tasks.workunit.client.0.smithi026.stdout:8/492: dwrite de/d6c/d31/d4f/d87/f8f [0,4194304] 0 2024-05-09T00:07:46.537 INFO:tasks.workunit.client.0.smithi026.stdout:8/493: chown de/d6c/d31/d4f 691 1 2024-05-09T00:07:46.538 INFO:tasks.workunit.client.0.smithi026.stdout:5/420: rmdir d2/d8/d31/d2e/d45 0 2024-05-09T00:07:46.539 INFO:tasks.workunit.client.0.smithi026.stdout:7/568: dread d8/d2e/d84/db4/dbc/d1e/d3d/f48 [0,4194304] 0 2024-05-09T00:07:46.539 INFO:tasks.workunit.client.0.smithi026.stdout:7/569: stat d8/d2e/d84/db4/dbc/d1e/f64 0 2024-05-09T00:07:46.539 INFO:tasks.workunit.client.0.smithi026.stdout:7/570: write d8/d5c/fbd [743778,55862] 0 2024-05-09T00:07:46.545 INFO:tasks.workunit.client.0.smithi026.stdout:8/494: write de/f13 [710421,41517] 0 2024-05-09T00:07:46.546 INFO:tasks.workunit.client.0.smithi026.stdout:5/421: creat d2/d8/d2a/f88 x:0 0 0 2024-05-09T00:07:46.548 INFO:tasks.workunit.client.0.smithi026.stdout:7/571: unlink d8/d1b/d89/c9d 0 2024-05-09T00:07:46.548 INFO:tasks.workunit.client.0.smithi026.stdout:7/572: chown d8/d1b/l27 0 1 2024-05-09T00:07:46.548 INFO:tasks.workunit.client.0.smithi026.stdout:7/573: write d8/d2e/f87 [1511465,42815] 0 2024-05-09T00:07:46.550 INFO:tasks.workunit.client.0.smithi026.stdout:8/495: link de/d6c/d31/d4f/d87/f8f de/d17/d21/fa1 0 2024-05-09T00:07:46.552 INFO:tasks.workunit.client.0.smithi026.stdout:9/493: dwrite d7/d23/d2f/f98 [0,4194304] 0 2024-05-09T00:07:46.552 INFO:tasks.workunit.client.0.smithi026.stdout:7/574: creat d8/d2e/d84/db4/dbc/d22/d29/fc3 x:0 0 0 2024-05-09T00:07:46.553 INFO:tasks.workunit.client.0.smithi026.stdout:7/575: chown d8/d2e/d84/db4/dbc/d1e/f7c 0 1 2024-05-09T00:07:46.553 INFO:tasks.workunit.client.0.smithi026.stdout:7/576: write d8/d5c/d9a/d9f/fba [739240,49495] 0 2024-05-09T00:07:46.554 INFO:tasks.workunit.client.0.smithi026.stdout:8/496: creat de/d6c/d31/fa2 x:0 0 0 2024-05-09T00:07:46.554 INFO:tasks.workunit.client.0.smithi026.stdout:8/497: dread - de/d17/d21/d6f/f9e zero size 2024-05-09T00:07:46.554 INFO:tasks.workunit.client.0.smithi026.stdout:5/422: symlink d2/d8/d31/l89 0 2024-05-09T00:07:46.565 INFO:tasks.workunit.client.0.smithi026.stdout:7/577: creat d8/d5c/d9a/fc4 x:0 0 0 2024-05-09T00:07:46.566 INFO:tasks.workunit.client.0.smithi026.stdout:8/498: readlink de/d17/d21/d24/d3b/d3d/l61 0 2024-05-09T00:07:46.572 INFO:tasks.workunit.client.0.smithi026.stdout:5/423: dwrite d2/d8/d31/f85 [0,4194304] 0 2024-05-09T00:07:46.572 INFO:tasks.workunit.client.0.smithi026.stdout:5/424: chown d2/fc 8936967 1 2024-05-09T00:07:46.575 INFO:tasks.workunit.client.0.smithi026.stdout:7/578: truncate d8/d2e/f4a 7832819 0 2024-05-09T00:07:46.575 INFO:tasks.workunit.client.0.smithi026.stdout:5/425: write d2/d8/d31/d2e/d4a/f3c [1115922,114585] 0 2024-05-09T00:07:46.575 INFO:tasks.workunit.client.0.smithi026.stdout:5/426: write d2/fc [4807856,18372] 0 2024-05-09T00:07:46.575 INFO:tasks.workunit.client.0.smithi026.stdout:8/499: creat de/d48/d3e/d54/fa3 x:0 0 0 2024-05-09T00:07:46.575 INFO:tasks.workunit.client.0.smithi026.stdout:8/500: write de/d6c/d31/d4f/d87/d62/f95 [381285,88706] 0 2024-05-09T00:07:46.575 INFO:tasks.workunit.client.0.smithi026.stdout:8/501: truncate de/d17/d21/d24/d3b/f80 206716 0 2024-05-09T00:07:46.583 INFO:tasks.workunit.client.0.smithi026.stdout:5/427: symlink d2/d8/d31/d2e/d4a/l8a 0 2024-05-09T00:07:46.584 INFO:tasks.workunit.client.0.smithi026.stdout:8/502: creat de/d17/d21/fa4 x:0 0 0 2024-05-09T00:07:46.587 INFO:tasks.workunit.client.0.smithi026.stdout:8/503: dread de/d6c/d31/d4f/f7b [0,4194304] 0 2024-05-09T00:07:46.592 INFO:tasks.workunit.client.0.smithi026.stdout:5/428: dread d2/d8/d31/d32/d5c/f67 [0,4194304] 0 2024-05-09T00:07:46.596 INFO:tasks.workunit.client.0.smithi026.stdout:8/504: dread de/d6c/f3c [0,4194304] 0 2024-05-09T00:07:46.596 INFO:tasks.workunit.client.0.smithi026.stdout:8/505: chown de/d17/d7d 19677 1 2024-05-09T00:07:46.597 INFO:tasks.workunit.client.0.smithi026.stdout:9/494: truncate d7/d23/d2f/f98 4005881 0 2024-05-09T00:07:46.598 INFO:tasks.workunit.client.0.smithi026.stdout:7/579: dwrite f5 [0,4194304] 0 2024-05-09T00:07:46.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/506: symlink de/d48/d73/d91/la5 0 2024-05-09T00:07:46.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/507: read de/d6c/d31/d4f/f86 [2145197,100684] 0 2024-05-09T00:07:46.600 INFO:tasks.workunit.client.0.smithi026.stdout:9/495: rmdir d7/d23/d29/d31 39 2024-05-09T00:07:46.603 INFO:tasks.workunit.client.0.smithi026.stdout:5/429: dread d2/d8/d31/d2e/d4a/f3c [0,4194304] 0 2024-05-09T00:07:46.604 INFO:tasks.workunit.client.0.smithi026.stdout:7/580: link d8/d2e/d84/db4/dbc/d1e/d3d/d6b/faa d8/d1b/d89/d8d/fc5 0 2024-05-09T00:07:46.606 INFO:tasks.workunit.client.0.smithi026.stdout:9/496: mkdir d7/d23/d2f/d3a/db5 0 2024-05-09T00:07:46.606 INFO:tasks.workunit.client.0.smithi026.stdout:9/497: chown d7/d26 3 1 2024-05-09T00:07:46.609 INFO:tasks.workunit.client.0.smithi026.stdout:7/581: creat d8/d2e/d84/db4/dbc/d22/fc6 x:0 0 0 2024-05-09T00:07:46.609 INFO:tasks.workunit.client.0.smithi026.stdout:7/582: fsync d8/d2e/f4a 0 2024-05-09T00:07:46.611 INFO:tasks.workunit.client.0.smithi026.stdout:8/508: rename de/d6c/l46 to de/d6c/d31/la6 0 2024-05-09T00:07:46.611 INFO:tasks.workunit.client.0.smithi026.stdout:8/509: dread - de/d17/d7d/f90 zero size 2024-05-09T00:07:46.611 INFO:tasks.workunit.client.0.smithi026.stdout:8/510: fdatasync de/d6c/d31/d4f/d87/f6d 0 2024-05-09T00:07:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:7/583: creat d8/d5c/fc7 x:0 0 0 2024-05-09T00:07:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:7/584: creat d8/fc8 x:0 0 0 2024-05-09T00:07:46.624 INFO:tasks.workunit.client.0.smithi026.stdout:5/430: dwrite d2/d8/d2a/f4f [4194304,4194304] 0 2024-05-09T00:07:46.624 INFO:tasks.workunit.client.0.smithi026.stdout:5/431: fsync d2/d8/d31/d32/d5c/f67 0 2024-05-09T00:07:46.624 INFO:tasks.workunit.client.0.smithi026.stdout:5/432: write d2/d8/d31/d63/f83 [547608,16326] 0 2024-05-09T00:07:46.627 INFO:tasks.workunit.client.0.smithi026.stdout:9/498: dwrite d7/d23/d29/d59/f97 [0,4194304] 0 2024-05-09T00:07:46.627 INFO:tasks.workunit.client.0.smithi026.stdout:5/433: creat d2/d8/f8b x:0 0 0 2024-05-09T00:07:46.632 INFO:tasks.workunit.client.0.smithi026.stdout:8/511: dwrite de/f23 [4194304,4194304] 0 2024-05-09T00:07:46.654 INFO:tasks.workunit.client.0.smithi026.stdout:9/499: unlink d7/d23/d29/d31/d40/d41/d54/d5c/la0 0 2024-05-09T00:07:46.654 INFO:tasks.workunit.client.0.smithi026.stdout:9/500: chown d7/l15 25462 1 2024-05-09T00:07:46.656 INFO:tasks.workunit.client.0.smithi026.stdout:5/434: symlink d2/d8/d31/d2e/d4a/l8c 0 2024-05-09T00:07:46.656 INFO:tasks.workunit.client.0.smithi026.stdout:5/435: write d2/d8/d31/d32/d5c/f67 [4810952,9932] 0 2024-05-09T00:07:46.660 INFO:tasks.workunit.client.0.smithi026.stdout:8/512: creat de/d17/d7d/fa7 x:0 0 0 2024-05-09T00:07:46.661 INFO:tasks.workunit.client.0.smithi026.stdout:9/501: dread d7/d23/d29/d31/d40/d41/d54/d5c/f7a [0,4194304] 0 2024-05-09T00:07:46.661 INFO:tasks.workunit.client.0.smithi026.stdout:2/384: sync 2024-05-09T00:07:46.662 INFO:tasks.workunit.client.0.smithi026.stdout:4/401: sync 2024-05-09T00:07:46.662 INFO:tasks.workunit.client.0.smithi026.stdout:2/385: dread - d14/f86 zero size 2024-05-09T00:07:46.662 INFO:tasks.workunit.client.0.smithi026.stdout:4/402: rename d0/d12/d1b/d2b to d0/d12/d1b/d2b/d66/d8b 22 2024-05-09T00:07:46.662 INFO:tasks.workunit.client.0.smithi026.stdout:2/386: fsync d14/d15/d30/d6a/f57 0 2024-05-09T00:07:46.662 INFO:tasks.workunit.client.0.smithi026.stdout:4/403: dread - d0/d19/d43/d58/f69 zero size 2024-05-09T00:07:46.665 INFO:tasks.workunit.client.0.smithi026.stdout:2/387: rename d14/d22/f74 to d14/d15/d30/d6a/d5f/d61/d6c/f8d 0 2024-05-09T00:07:46.665 INFO:tasks.workunit.client.0.smithi026.stdout:2/388: write d14/d22/d55/f60 [999726,3935] 0 2024-05-09T00:07:46.669 INFO:tasks.workunit.client.0.smithi026.stdout:4/404: mkdir d0/d19/d8c 0 2024-05-09T00:07:46.669 INFO:tasks.workunit.client.0.smithi026.stdout:9/502: dread d7/d23/d2f/d7d/d87/faf [0,4194304] 0 2024-05-09T00:07:46.672 INFO:tasks.workunit.client.0.smithi026.stdout:2/389: rename d14/d15/c53 to d14/d15/d3b/d40/c8e 0 2024-05-09T00:07:46.672 INFO:tasks.workunit.client.0.smithi026.stdout:9/503: dread d7/d23/d2f/d3a/f55 [0,4194304] 0 2024-05-09T00:07:46.673 INFO:tasks.workunit.client.0.smithi026.stdout:8/513: dwrite de/d17/d7d/f9d [0,4194304] 0 2024-05-09T00:07:46.673 INFO:tasks.workunit.client.0.smithi026.stdout:8/514: write de/d6c/f78 [13503,52109] 0 2024-05-09T00:07:46.684 INFO:tasks.workunit.client.0.smithi026.stdout:4/405: dwrite d0/f4c [0,4194304] 0 2024-05-09T00:07:46.728 INFO:tasks.workunit.client.0.smithi026.stdout:2/390: mknod d14/d15/d3b/d40/d68/c8f 0 2024-05-09T00:07:46.728 INFO:tasks.workunit.client.0.smithi026.stdout:2/391: readlink d14/d15/d17/l65 0 2024-05-09T00:07:46.728 INFO:tasks.workunit.client.0.smithi026.stdout:9/504: mknod d7/d23/d2f/d3a/cb6 0 2024-05-09T00:07:46.735 INFO:tasks.workunit.client.0.smithi026.stdout:8/515: link de/d6c/d31/d4f/d87/f4d de/d17/fa8 0 2024-05-09T00:07:46.735 INFO:tasks.workunit.client.0.smithi026.stdout:8/516: chown de/d17/d21/fa4 6 1 2024-05-09T00:07:46.735 INFO:tasks.workunit.client.0.smithi026.stdout:8/517: fsync de/d60/f89 0 2024-05-09T00:07:46.740 INFO:tasks.workunit.client.0.smithi026.stdout:4/406: symlink d0/d19/d8c/l8d 0 2024-05-09T00:07:46.741 INFO:tasks.workunit.client.0.smithi026.stdout:9/505: dwrite d7/d23/d29/d31/d40/d41/d54/d5c/f7a [0,4194304] 0 2024-05-09T00:07:46.747 INFO:tasks.workunit.client.0.smithi026.stdout:2/392: creat d14/d15/d3b/d40/f90 x:0 0 0 2024-05-09T00:07:46.747 INFO:tasks.workunit.client.0.smithi026.stdout:2/393: chown d14/d15/d3b/d40/d47/c7c 9 1 2024-05-09T00:07:46.747 INFO:tasks.workunit.client.0.smithi026.stdout:2/394: write d14/d15/d30/d6a/f81 [4237388,109817] 0 2024-05-09T00:07:46.747 INFO:tasks.workunit.client.0.smithi026.stdout:2/395: write d14/d22/d55/f60 [1265256,30021] 0 2024-05-09T00:07:46.747 INFO:tasks.workunit.client.0.smithi026.stdout:2/396: readlink d14/d15/d17/l6e 0 2024-05-09T00:07:46.747 INFO:tasks.workunit.client.0.smithi026.stdout:8/518: write de/d6c/d31/f71 [105409,113934] 0 2024-05-09T00:07:46.747 INFO:tasks.workunit.client.0.smithi026.stdout:4/407: symlink d0/d12/l8e 0 2024-05-09T00:07:46.748 INFO:tasks.workunit.client.0.smithi026.stdout:9/506: symlink d7/d23/d29/lb7 0 2024-05-09T00:07:46.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/408: write d0/d19/f39 [2274910,50798] 0 2024-05-09T00:07:46.751 INFO:tasks.workunit.client.0.smithi026.stdout:4/409: dread d0/d12/d1b/f3c [0,4194304] 0 2024-05-09T00:07:46.753 INFO:tasks.workunit.client.0.smithi026.stdout:2/397: unlink d14/d15/d20/d41/c5c 0 2024-05-09T00:07:46.754 INFO:tasks.workunit.client.0.smithi026.stdout:8/519: link de/d6c/d31/la6 de/d48/la9 0 2024-05-09T00:07:46.754 INFO:tasks.workunit.client.0.smithi026.stdout:8/520: truncate de/d48/d73/d91/f9c 928094 0 2024-05-09T00:07:46.756 INFO:tasks.workunit.client.0.smithi026.stdout:9/507: rename d7/f4e to d7/d23/d76/fb8 0 2024-05-09T00:07:46.757 INFO:tasks.workunit.client.0.smithi026.stdout:9/508: fdatasync d7/d23/f39 0 2024-05-09T00:07:46.757 INFO:tasks.workunit.client.0.smithi026.stdout:9/509: truncate d7/d23/d2f/d3a/f55 639161 0 2024-05-09T00:07:46.757 INFO:tasks.workunit.client.0.smithi026.stdout:9/510: write d7/d26/f71 [2498702,127933] 0 2024-05-09T00:07:46.759 INFO:tasks.workunit.client.0.smithi026.stdout:4/410: mkdir d0/d19/d43/d49/d8f 0 2024-05-09T00:07:46.759 INFO:tasks.workunit.client.0.smithi026.stdout:2/398: creat d14/d15/d30/d6a/d5b/f91 x:0 0 0 2024-05-09T00:07:46.761 INFO:tasks.workunit.client.0.smithi026.stdout:8/521: mkdir de/d6c/d31/d4f/d87/d62/daa 0 2024-05-09T00:07:46.761 INFO:tasks.workunit.client.0.smithi026.stdout:8/522: write f9 [865699,128171] 0 2024-05-09T00:07:46.761 INFO:tasks.workunit.client.0.smithi026.stdout:8/523: chown de/d17/f64 24428598 1 2024-05-09T00:07:46.763 INFO:tasks.workunit.client.0.smithi026.stdout:9/511: chown d7/c10 489594840 1 2024-05-09T00:07:46.763 INFO:tasks.workunit.client.0.smithi026.stdout:9/512: readlink d7/d23/d29/d31/d40/d41/l75 0 2024-05-09T00:07:46.767 INFO:tasks.workunit.client.0.smithi026.stdout:8/524: getdents de/d48/d3e 0 2024-05-09T00:07:46.768 INFO:tasks.workunit.client.0.smithi026.stdout:9/513: rmdir d7/d26 39 2024-05-09T00:07:46.768 INFO:tasks.workunit.client.0.smithi026.stdout:9/514: fdatasync d7/d23/f61 0 2024-05-09T00:07:46.771 INFO:tasks.workunit.client.0.smithi026.stdout:8/525: dread de/d6c/d31/d4f/d87/d62/f95 [0,4194304] 0 2024-05-09T00:07:46.771 INFO:tasks.workunit.client.0.smithi026.stdout:8/526: write de/d48/f8c [738050,3238] 0 2024-05-09T00:07:46.771 INFO:tasks.workunit.client.0.smithi026.stdout:6/328: sync 2024-05-09T00:07:46.771 INFO:tasks.workunit.client.0.smithi026.stdout:6/329: stat d15/d1e/d23/d26/f3c 0 2024-05-09T00:07:46.773 INFO:tasks.workunit.client.0.smithi026.stdout:0/579: sync 2024-05-09T00:07:46.773 INFO:tasks.workunit.client.0.smithi026.stdout:1/503: sync 2024-05-09T00:07:46.773 INFO:tasks.workunit.client.0.smithi026.stdout:3/410: sync 2024-05-09T00:07:46.773 INFO:tasks.workunit.client.0.smithi026.stdout:0/580: read - d1d/d1e/d20/d4d/d83/fa2 zero size 2024-05-09T00:07:46.773 INFO:tasks.workunit.client.0.smithi026.stdout:1/504: write d5/db/d1d/f48 [777967,13536] 0 2024-05-09T00:07:46.774 INFO:tasks.workunit.client.0.smithi026.stdout:8/527: creat de/d48/d73/d91/fab x:0 0 0 2024-05-09T00:07:46.776 INFO:tasks.workunit.client.0.smithi026.stdout:6/330: getdents d15 0 2024-05-09T00:07:46.777 INFO:tasks.workunit.client.0.smithi026.stdout:4/411: dwrite d0/d19/d43/d49/f54 [0,4194304] 0 2024-05-09T00:07:46.779 INFO:tasks.workunit.client.0.smithi026.stdout:3/411: link d5/d9/dc/f1b d5/d1e/d3e/f86 0 2024-05-09T00:07:46.779 INFO:tasks.workunit.client.0.smithi026.stdout:4/412: dread d0/d12/d1b/f3c [0,4194304] 0 2024-05-09T00:07:46.779 INFO:tasks.workunit.client.0.smithi026.stdout:4/413: fsync d0/d19/d43/d58/f6a 0 2024-05-09T00:07:46.780 INFO:tasks.workunit.client.0.smithi026.stdout:8/528: write de/d17/d21/d24/d3b/f7a [838424,59516] 0 2024-05-09T00:07:46.780 INFO:tasks.workunit.client.0.smithi026.stdout:8/529: write de/d17/d21/d24/f26 [5070373,7061] 0 2024-05-09T00:07:46.780 INFO:tasks.workunit.client.0.smithi026.stdout:8/530: write de/d17/d21/d24/f7e [1465487,96730] 0 2024-05-09T00:07:46.780 INFO:tasks.workunit.client.0.smithi026.stdout:8/531: truncate de/d17/d21/d24/d5b/f98 939340 0 2024-05-09T00:07:46.784 INFO:tasks.workunit.client.0.smithi026.stdout:2/399: dwrite d14/f18 [0,4194304] 0 2024-05-09T00:07:46.784 INFO:tasks.workunit.client.0.smithi026.stdout:6/331: symlink d15/d34/d52/l68 0 2024-05-09T00:07:46.785 INFO:tasks.workunit.client.0.smithi026.stdout:6/332: write d15/d1e/d23/d26/d58/d5c/f5d [3522762,66438] 0 2024-05-09T00:07:46.786 INFO:tasks.workunit.client.0.smithi026.stdout:6/333: chown d15/d1e/l5f 697 1 2024-05-09T00:07:46.796 INFO:tasks.workunit.client.0.smithi026.stdout:3/412: symlink d5/d1e/d7b/l87 0 2024-05-09T00:07:46.798 INFO:tasks.workunit.client.0.smithi026.stdout:4/414: link d0/d12/d1b/f53 d0/d12/d1b/d4e/f90 0 2024-05-09T00:07:46.798 INFO:tasks.workunit.client.0.smithi026.stdout:4/415: read - d0/d12/d64/f82 zero size 2024-05-09T00:07:46.799 INFO:tasks.workunit.client.0.smithi026.stdout:2/400: creat d14/d15/f92 x:0 0 0 2024-05-09T00:07:46.800 INFO:tasks.workunit.client.0.smithi026.stdout:8/532: dwrite de/d6c/d31/d4f/d87/d62/f95 [0,4194304] 0 2024-05-09T00:07:46.800 INFO:tasks.workunit.client.0.smithi026.stdout:8/533: write de/d6c/d31/f71 [773521,2748] 0 2024-05-09T00:07:46.804 INFO:tasks.workunit.client.0.smithi026.stdout:4/416: link d0/d12/d1b/f53 d0/d19/d43/d58/f91 0 2024-05-09T00:07:46.806 INFO:tasks.workunit.client.0.smithi026.stdout:4/417: mkdir d0/d12/d1b/d4e/d92 0 2024-05-09T00:07:46.808 INFO:tasks.workunit.client.0.smithi026.stdout:4/418: creat d0/d83/f93 x:0 0 0 2024-05-09T00:07:46.810 INFO:tasks.workunit.client.0.smithi026.stdout:4/419: creat d0/f94 x:0 0 0 2024-05-09T00:07:46.825 INFO:tasks.workunit.client.0.smithi026.stdout:8/534: dwrite de/d17/d21/d24/f7e [0,4194304] 0 2024-05-09T00:07:46.825 INFO:tasks.workunit.client.0.smithi026.stdout:4/420: dwrite d0/d19/f45 [0,4194304] 0 2024-05-09T00:07:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:4/421: unlink d0/d12/d1b/d4e/f90 0 2024-05-09T00:07:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:4/422: write d0/f94 [395551,56164] 0 2024-05-09T00:07:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:8/535: symlink de/d17/d21/d24/d3b/d3d/lac 0 2024-05-09T00:07:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:8/536: fdatasync de/d6c/d31/d4f/f88 0 2024-05-09T00:07:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:8/537: write de/d17/d7d/fa7 [879866,37838] 0 2024-05-09T00:07:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:8/538: chown de/d17/l32 484418 1 2024-05-09T00:07:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:4/423: creat d0/d19/d8c/f95 x:0 0 0 2024-05-09T00:07:46.836 INFO:tasks.workunit.client.0.smithi026.stdout:4/424: link d0/d12/d1b/d2b/l4b d0/d12/d34/l96 0 2024-05-09T00:07:46.838 INFO:tasks.workunit.client.0.smithi026.stdout:1/505: dwrite d5/dd/d1f/f8f [0,4194304] 0 2024-05-09T00:07:46.840 INFO:tasks.workunit.client.0.smithi026.stdout:3/413: dwrite d5/d1e/d3e/f68 [0,4194304] 0 2024-05-09T00:07:46.842 INFO:tasks.workunit.client.0.smithi026.stdout:2/401: dwrite d14/d15/d20/f8c [0,4194304] 0 2024-05-09T00:07:46.842 INFO:tasks.workunit.client.0.smithi026.stdout:2/402: write f4 [4210565,56642] 0 2024-05-09T00:07:46.852 INFO:tasks.workunit.client.0.smithi026.stdout:3/414: dread d5/f22 [0,4194304] 0 2024-05-09T00:07:46.854 INFO:tasks.workunit.client.0.smithi026.stdout:6/334: dwrite d15/d1e/d30/f46 [0,4194304] 0 2024-05-09T00:07:46.856 INFO:tasks.workunit.client.0.smithi026.stdout:3/415: mknod d5/d41/c88 0 2024-05-09T00:07:46.856 INFO:tasks.workunit.client.0.smithi026.stdout:3/416: stat d5/d1e/l3a 0 2024-05-09T00:07:46.856 INFO:tasks.workunit.client.0.smithi026.stdout:3/417: fdatasync d5/d41/f37 0 2024-05-09T00:07:46.860 INFO:tasks.workunit.client.0.smithi026.stdout:8/539: dwrite de/d6c/d31/d4f/d87/d62/f95 [0,4194304] 0 2024-05-09T00:07:46.860 INFO:tasks.workunit.client.0.smithi026.stdout:8/540: chown f3 7831803 1 2024-05-09T00:07:46.862 INFO:tasks.workunit.client.0.smithi026.stdout:2/403: dwrite d14/d22/d55/f67 [4194304,4194304] 0 2024-05-09T00:07:46.863 INFO:tasks.workunit.client.0.smithi026.stdout:6/335: mknod d15/d2b/d33/d55/c69 0 2024-05-09T00:07:46.863 INFO:tasks.workunit.client.0.smithi026.stdout:6/336: chown d15/d1e/d30/d32 15400 1 2024-05-09T00:07:46.863 INFO:tasks.workunit.client.0.smithi026.stdout:6/337: read f4 [822466,103226] 0 2024-05-09T00:07:46.866 INFO:tasks.workunit.client.0.smithi026.stdout:3/418: symlink d5/d9/dc/d28/d63/l89 0 2024-05-09T00:07:46.867 INFO:tasks.workunit.client.0.smithi026.stdout:2/404: dread d14/d22/d55/f60 [0,4194304] 0 2024-05-09T00:07:46.867 INFO:tasks.workunit.client.0.smithi026.stdout:2/405: read - d14/d15/d30/d6a/f57 zero size 2024-05-09T00:07:46.871 INFO:tasks.workunit.client.0.smithi026.stdout:8/541: link de/d17/d21/d24/d3b/d3d/l61 de/d17/d7d/lad 0 2024-05-09T00:07:46.877 INFO:tasks.workunit.client.0.smithi026.stdout:3/419: mkdir d5/d9/dc/d8a 0 2024-05-09T00:07:46.879 INFO:tasks.workunit.client.0.smithi026.stdout:8/542: link de/d17/l18 de/d48/d3e/d54/lae 0 2024-05-09T00:07:46.879 INFO:tasks.workunit.client.0.smithi026.stdout:8/543: fdatasync de/d6c/f3c 0 2024-05-09T00:07:46.879 INFO:tasks.workunit.client.0.smithi026.stdout:8/544: truncate de/d17/d21/d6f/f8e 89746 0 2024-05-09T00:07:46.880 INFO:tasks.workunit.client.0.smithi026.stdout:4/425: rename d0/d19 to d0/d12/d1b/d4e/d78/d97 0 2024-05-09T00:07:46.881 INFO:tasks.workunit.client.0.smithi026.stdout:4/426: dread - d0/d83/f93 zero size 2024-05-09T00:07:46.882 INFO:tasks.workunit.client.0.smithi026.stdout:2/406: dread d14/d15/d3b/d40/f66 [0,4194304] 0 2024-05-09T00:07:46.884 INFO:tasks.workunit.client.0.smithi026.stdout:8/545: mknod de/d6c/d31/d4f/d87/caf 0 2024-05-09T00:07:46.886 INFO:tasks.workunit.client.0.smithi026.stdout:1/506: rename d5/dd/d1f/d51/c6b to d5/d16/d60/d66/d97/ca6 0 2024-05-09T00:07:46.889 INFO:tasks.workunit.client.0.smithi026.stdout:4/427: creat d0/d12/d34/f98 x:0 0 0 2024-05-09T00:07:46.891 INFO:tasks.workunit.client.0.smithi026.stdout:4/428: mkdir d0/d12/d1b/d2b/d66/d99 0 2024-05-09T00:07:46.894 INFO:tasks.workunit.client.0.smithi026.stdout:4/429: read d0/d12/d1b/d2b/f63 [315534,88000] 0 2024-05-09T00:07:46.894 INFO:tasks.workunit.client.0.smithi026.stdout:2/407: dread d14/d15/d20/f8c [0,4194304] 0 2024-05-09T00:07:46.895 INFO:tasks.workunit.client.0.smithi026.stdout:2/408: chown d14/d15/d20/l80 80050 1 2024-05-09T00:07:46.895 INFO:tasks.workunit.client.0.smithi026.stdout:2/409: truncate d14/d15/d1f/f2d 4908366 0 2024-05-09T00:07:46.899 INFO:tasks.workunit.client.0.smithi026.stdout:2/410: stat d14/d22/l4c 0 2024-05-09T00:07:46.902 INFO:tasks.workunit.client.0.smithi026.stdout:2/411: mkdir d14/d22/d55/d6b/d93 0 2024-05-09T00:07:46.905 INFO:tasks.workunit.client.0.smithi026.stdout:2/412: link d14/d15/d3b/d40/f90 d14/d15/d20/d41/d51/f94 0 2024-05-09T00:07:46.917 INFO:tasks.workunit.client.0.smithi026.stdout:6/338: dwrite d15/d1e/d23/d26/f28 [0,4194304] 0 2024-05-09T00:07:46.917 INFO:tasks.workunit.client.0.smithi026.stdout:3/420: dwrite d5/d41/f37 [0,4194304] 0 2024-05-09T00:07:46.917 INFO:tasks.workunit.client.0.smithi026.stdout:8/546: dwrite de/d17/d21/d24/d5b/f98 [0,4194304] 0 2024-05-09T00:07:46.917 INFO:tasks.workunit.client.0.smithi026.stdout:1/507: dwrite d5/dd/f80 [0,4194304] 0 2024-05-09T00:07:46.921 INFO:tasks.workunit.client.0.smithi026.stdout:6/339: link d15/d1e/d3d/f47 d15/d1e/d23/d26/f6a 0 2024-05-09T00:07:46.923 INFO:tasks.workunit.client.0.smithi026.stdout:1/508: dread d5/dd/d1f/f21 [4194304,4194304] 0 2024-05-09T00:07:46.924 INFO:tasks.workunit.client.0.smithi026.stdout:1/509: read d5/d16/d60/d66/f76 [132648,113015] 0 2024-05-09T00:07:46.925 INFO:tasks.workunit.client.0.smithi026.stdout:3/421: symlink d5/d9/d4a/d5f/d6f/l8b 0 2024-05-09T00:07:46.931 INFO:tasks.workunit.client.0.smithi026.stdout:8/547: truncate de/d17/f64 817204 0 2024-05-09T00:07:46.936 INFO:tasks.workunit.client.0.smithi026.stdout:6/340: link d15/d34/d52/l68 d15/d2b/d33/l6b 0 2024-05-09T00:07:46.938 INFO:tasks.workunit.client.0.smithi026.stdout:1/510: mknod d5/dd/d17/d9f/da5/ca7 0 2024-05-09T00:07:46.938 INFO:tasks.workunit.client.0.smithi026.stdout:6/341: dread d15/d2b/f3e [0,4194304] 0 2024-05-09T00:07:46.940 INFO:tasks.workunit.client.0.smithi026.stdout:8/548: truncate de/f25 748545 0 2024-05-09T00:07:46.940 INFO:tasks.workunit.client.0.smithi026.stdout:8/549: readlink de/d17/l1b 0 2024-05-09T00:07:46.942 INFO:tasks.workunit.client.0.smithi026.stdout:1/511: rmdir d5/dd/d1f/d51 39 2024-05-09T00:07:46.943 INFO:tasks.workunit.client.0.smithi026.stdout:6/342: mknod d15/d1e/d23/d3a/c6c 0 2024-05-09T00:07:46.944 INFO:tasks.workunit.client.0.smithi026.stdout:3/422: dread d5/d41/f6e [0,4194304] 0 2024-05-09T00:07:46.945 INFO:tasks.workunit.client.0.smithi026.stdout:8/550: symlink de/d48/lb0 0 2024-05-09T00:07:46.947 INFO:tasks.workunit.client.0.smithi026.stdout:6/343: creat d15/d1e/d23/d26/d58/f6d x:0 0 0 2024-05-09T00:07:46.949 INFO:tasks.workunit.client.0.smithi026.stdout:3/423: rename d5/d41/l32 to d5/d1e/d7b/l8c 0 2024-05-09T00:07:46.949 INFO:tasks.workunit.client.0.smithi026.stdout:5/436: sync 2024-05-09T00:07:46.949 INFO:tasks.workunit.client.0.smithi026.stdout:7/585: sync 2024-05-09T00:07:46.950 INFO:tasks.workunit.client.0.smithi026.stdout:8/551: truncate de/d48/d3e/d54/f8a 4104333 0 2024-05-09T00:07:46.952 INFO:tasks.workunit.client.0.smithi026.stdout:1/512: link d5/db/l95 d5/d16/la8 0 2024-05-09T00:07:46.955 INFO:tasks.workunit.client.0.smithi026.stdout:3/424: symlink d5/d9/d49/l8d 0 2024-05-09T00:07:46.955 INFO:tasks.workunit.client.0.smithi026.stdout:3/425: truncate d5/d9/dc/d5d/f7d 550404 0 2024-05-09T00:07:46.955 INFO:tasks.workunit.client.0.smithi026.stdout:7/586: stat d8/d2e/d84/db4/dbc/d1e/d80/lc0 0 2024-05-09T00:07:46.958 INFO:tasks.workunit.client.0.smithi026.stdout:5/437: dread d2/d8/d31/d24/f7b [0,4194304] 0 2024-05-09T00:07:46.959 INFO:tasks.workunit.client.0.smithi026.stdout:1/513: mknod d5/dd/d1f/ca9 0 2024-05-09T00:07:46.960 INFO:tasks.workunit.client.0.smithi026.stdout:3/426: creat d5/d9/d4a/d5f/f8e x:0 0 0 2024-05-09T00:07:46.960 INFO:tasks.workunit.client.0.smithi026.stdout:3/427: fdatasync d5/d1e/f3d 0 2024-05-09T00:07:46.965 INFO:tasks.workunit.client.0.smithi026.stdout:7/587: rmdir d8/d1b/d89/dc1 39 2024-05-09T00:07:46.966 INFO:tasks.workunit.client.0.smithi026.stdout:1/514: mkdir d5/dd/daa 0 2024-05-09T00:07:46.970 INFO:tasks.workunit.client.0.smithi026.stdout:3/428: symlink d5/d9/d4a/d5f/d6f/l8f 0 2024-05-09T00:07:46.971 INFO:tasks.workunit.client.0.smithi026.stdout:1/515: dread f4 [8388608,4194304] 0 2024-05-09T00:07:46.971 INFO:tasks.workunit.client.0.smithi026.stdout:7/588: write d8/d1b/d89/fa6 [353806,50674] 0 2024-05-09T00:07:46.973 INFO:tasks.workunit.client.0.smithi026.stdout:3/429: truncate d5/f1f 1203139 0 2024-05-09T00:07:46.974 INFO:tasks.workunit.client.0.smithi026.stdout:1/516: mknod d5/d16/d60/d66/cab 0 2024-05-09T00:07:46.976 INFO:tasks.workunit.client.0.smithi026.stdout:7/589: unlink d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/f97 0 2024-05-09T00:07:46.978 INFO:tasks.workunit.client.0.smithi026.stdout:3/430: rename d5/d1e/d7b/l87 to d5/d9/l90 0 2024-05-09T00:07:46.979 INFO:tasks.workunit.client.0.smithi026.stdout:8/552: dwrite de/f16 [0,4194304] 0 2024-05-09T00:07:46.979 INFO:tasks.workunit.client.0.smithi026.stdout:1/517: mkdir d5/db/d1d/dac 0 2024-05-09T00:07:46.981 INFO:tasks.workunit.client.0.smithi026.stdout:5/438: dwrite d2/d8/d31/d32/d5c/f67 [0,4194304] 0 2024-05-09T00:07:46.982 INFO:tasks.workunit.client.0.smithi026.stdout:7/590: creat d8/d5c/d9a/d9f/fc9 x:0 0 0 2024-05-09T00:07:46.982 INFO:tasks.workunit.client.0.smithi026.stdout:7/591: write d8/d5c/d9a/fc4 [261102,82146] 0 2024-05-09T00:07:46.983 INFO:tasks.workunit.client.0.smithi026.stdout:3/431: creat d5/d9/dc/d5b/f91 x:0 0 0 2024-05-09T00:07:46.983 INFO:tasks.workunit.client.0.smithi026.stdout:3/432: fsync d5/d9/dc/d5b/f85 0 2024-05-09T00:07:46.983 INFO:tasks.workunit.client.0.smithi026.stdout:3/433: truncate d5/d9/dc/f31 2393098 0 2024-05-09T00:07:46.987 INFO:tasks.workunit.client.0.smithi026.stdout:8/553: unlink de/d48/d3e/d54/f8a 0 2024-05-09T00:07:46.988 INFO:tasks.workunit.client.0.smithi026.stdout:1/518: creat d5/d16/fad x:0 0 0 2024-05-09T00:07:46.988 INFO:tasks.workunit.client.0.smithi026.stdout:1/519: stat d5/dd/d17/d9f/da5 0 2024-05-09T00:07:46.990 INFO:tasks.workunit.client.0.smithi026.stdout:5/439: mkdir d2/d8/d2a/d8d 0 2024-05-09T00:07:46.992 INFO:tasks.workunit.client.0.smithi026.stdout:7/592: rename d8/d2e/d84/db4/dbc/d22/da1/dae to d8/d2e/d84/db4/dbc/d1e/d3d/dca 0 2024-05-09T00:07:46.995 INFO:tasks.workunit.client.0.smithi026.stdout:3/434: creat d5/d1e/d7b/f92 x:0 0 0 2024-05-09T00:07:46.995 INFO:tasks.workunit.client.0.smithi026.stdout:3/435: chown d5/d1e/f20 293103 1 2024-05-09T00:07:46.997 INFO:tasks.workunit.client.0.smithi026.stdout:1/520: getdents d5/dd/d17/d9f/da5 0 2024-05-09T00:07:47.000 INFO:tasks.workunit.client.0.smithi026.stdout:5/440: creat d2/d8/d31/d4b/d51/f8e x:0 0 0 2024-05-09T00:07:47.002 INFO:tasks.workunit.client.0.smithi026.stdout:8/554: rename de/d17/c42 to de/d6c/d31/d4f/d87/d62/daa/cb1 0 2024-05-09T00:07:47.016 INFO:tasks.workunit.client.0.smithi026.stdout:1/521: mkdir d5/db/d1d/dae 0 2024-05-09T00:07:47.016 INFO:tasks.workunit.client.0.smithi026.stdout:1/522: stat d5/dd/f3f 0 2024-05-09T00:07:47.021 INFO:tasks.workunit.client.0.smithi026.stdout:3/436: rename d5/c17 to d5/d1e/d3e/c93 0 2024-05-09T00:07:47.022 INFO:tasks.workunit.client.0.smithi026.stdout:1/523: dread d5/d16/f18 [0,4194304] 0 2024-05-09T00:07:47.025 INFO:tasks.workunit.client.0.smithi026.stdout:1/524: creat d5/dd/d1f/faf x:0 0 0 2024-05-09T00:07:47.028 INFO:tasks.workunit.client.0.smithi026.stdout:1/525: truncate d5/dd/d1f/f8f 1055052 0 2024-05-09T00:07:47.028 INFO:tasks.workunit.client.0.smithi026.stdout:1/526: chown d5/dd/d1f/d39/fa1 173141 1 2024-05-09T00:07:47.032 INFO:tasks.workunit.client.0.smithi026.stdout:1/527: unlink d5/dd/d17/d9f/da5/ca7 0 2024-05-09T00:07:47.033 INFO:tasks.workunit.client.0.smithi026.stdout:8/555: dwrite de/d17/d21/d24/d3b/d3d/f56 [0,4194304] 0 2024-05-09T00:07:47.034 INFO:tasks.workunit.client.0.smithi026.stdout:1/528: mkdir d5/dd/d1f/d39/d47/db0 0 2024-05-09T00:07:47.041 INFO:tasks.workunit.client.0.smithi026.stdout:1/529: mkdir d5/d16/d60/d66/d97/d94/db1 0 2024-05-09T00:07:47.041 INFO:tasks.workunit.client.0.smithi026.stdout:1/530: dread - d5/d16/d60/f6d zero size 2024-05-09T00:07:47.043 INFO:tasks.workunit.client.0.smithi026.stdout:1/531: creat d5/db/d1d/dae/fb2 x:0 0 0 2024-05-09T00:07:47.043 INFO:tasks.workunit.client.0.smithi026.stdout:1/532: fsync d5/f7 0 2024-05-09T00:07:47.045 INFO:tasks.workunit.client.0.smithi026.stdout:1/533: rmdir d5/dd 39 2024-05-09T00:07:47.051 INFO:tasks.workunit.client.0.smithi026.stdout:9/515: sync 2024-05-09T00:07:47.052 INFO:tasks.workunit.client.0.smithi026.stdout:0/581: sync 2024-05-09T00:07:47.053 INFO:tasks.workunit.client.0.smithi026.stdout:9/516: creat d7/d23/d2f/d50/fb9 x:0 0 0 2024-05-09T00:07:47.054 INFO:tasks.workunit.client.0.smithi026.stdout:8/556: dwrite de/d6c/f3c [0,4194304] 0 2024-05-09T00:07:47.055 INFO:tasks.workunit.client.0.smithi026.stdout:0/582: symlink d1d/d1e/d20/d51/lc3 0 2024-05-09T00:07:47.056 INFO:tasks.workunit.client.0.smithi026.stdout:9/517: rmdir d7/d23/d29/d31/d40 39 2024-05-09T00:07:47.060 INFO:tasks.workunit.client.0.smithi026.stdout:8/557: symlink de/d48/d73/lb2 0 2024-05-09T00:07:47.062 INFO:tasks.workunit.client.0.smithi026.stdout:0/583: link d1d/d25/l60 d1d/d25/d47/lc4 0 2024-05-09T00:07:47.065 INFO:tasks.workunit.client.0.smithi026.stdout:9/518: rename d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/f9c to d7/d23/d2f/d3a/fba 0 2024-05-09T00:07:47.066 INFO:tasks.workunit.client.0.smithi026.stdout:9/519: chown d7/d23/d29/d31/d40/d41/d54/d9a/da4 1961535608 1 2024-05-09T00:07:47.069 INFO:tasks.workunit.client.0.smithi026.stdout:0/584: unlink d1d/d25/f54 0 2024-05-09T00:07:47.071 INFO:tasks.workunit.client.0.smithi026.stdout:9/520: mknod d7/d23/d29/d31/cbb 0 2024-05-09T00:07:47.071 INFO:tasks.workunit.client.0.smithi026.stdout:9/521: read - d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa7 zero size 2024-05-09T00:07:47.073 INFO:tasks.workunit.client.0.smithi026.stdout:8/558: mknod de/cb3 0 2024-05-09T00:07:47.075 INFO:tasks.workunit.client.0.smithi026.stdout:0/585: link d1d/d25/d3c/f88 d1d/d33/fc5 0 2024-05-09T00:07:47.076 INFO:tasks.workunit.client.0.smithi026.stdout:8/559: mkdir de/d6c/d31/d4f/d87/d62/db4 0 2024-05-09T00:07:47.077 INFO:tasks.workunit.client.0.smithi026.stdout:8/560: chown de/d48/d73/lb2 802960689 1 2024-05-09T00:07:47.079 INFO:tasks.workunit.client.0.smithi026.stdout:0/586: rename d1d/d33/f38 to d1d/d1e/d20/d4d/d58/d62/d78/fc6 0 2024-05-09T00:07:47.080 INFO:tasks.workunit.client.0.smithi026.stdout:8/561: mkdir de/d6c/db5 0 2024-05-09T00:07:47.082 INFO:tasks.workunit.client.0.smithi026.stdout:0/587: rename d1d/d1e/d20/c4f to d1d/d1e/d20/d4d/d83/d9e/da7/cc7 0 2024-05-09T00:07:47.082 INFO:tasks.workunit.client.0.smithi026.stdout:8/562: getdents de/d60 0 2024-05-09T00:07:47.083 INFO:tasks.workunit.client.0.smithi026.stdout:0/588: truncate ff 1623195 0 2024-05-09T00:07:47.089 INFO:tasks.workunit.client.0.smithi026.stdout:9/522: dwrite d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa7 [0,4194304] 0 2024-05-09T00:07:47.105 INFO:tasks.workunit.client.0.smithi026.stdout:0/589: dwrite d1d/d1e/d20/d4d/f6f [0,4194304] 0 2024-05-09T00:07:47.105 INFO:tasks.workunit.client.0.smithi026.stdout:0/590: read - d1d/d25/f7e zero size 2024-05-09T00:07:47.105 INFO:tasks.workunit.client.0.smithi026.stdout:0/591: stat d1d/d25/d47/d6e 0 2024-05-09T00:07:47.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:46 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:45.907975+0000 mgr.smithi135.kkrhgf (mgr.24419) 56 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 175 MiB/s rd, 375 MiB/s wr, 572 op/s 2024-05-09T00:07:47.148 INFO:tasks.workunit.client.0.smithi026.stdout:8/563: mknod de/d6c/d31/d4f/d87/d62/db4/cb6 0 2024-05-09T00:07:47.152 INFO:tasks.workunit.client.0.smithi026.stdout:9/523: mkdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc 0 2024-05-09T00:07:47.155 INFO:tasks.workunit.client.0.smithi026.stdout:0/592: mkdir d1d/d25/d47/dc8 0 2024-05-09T00:07:47.155 INFO:tasks.workunit.client.0.smithi026.stdout:0/593: chown d1d/d1e/d20/d4d/d58/d62/d78/d80 222353925 1 2024-05-09T00:07:47.155 INFO:tasks.workunit.client.0.smithi026.stdout:0/594: fdatasync d1d/d33/fc5 0 2024-05-09T00:07:47.157 INFO:tasks.workunit.client.0.smithi026.stdout:8/564: rename de/d6c/d31/la6 to de/d6c/d31/d4f/d87/d62/daa/lb7 0 2024-05-09T00:07:47.158 INFO:tasks.workunit.client.0.smithi026.stdout:9/524: getdents d7/d23/d29/d2e 0 2024-05-09T00:07:47.160 INFO:tasks.workunit.client.0.smithi026.stdout:0/595: rename d1d/d25/cb3 to d1d/d1e/cc9 0 2024-05-09T00:07:47.161 INFO:tasks.workunit.client.0.smithi026.stdout:8/565: mknod de/d17/cb8 0 2024-05-09T00:07:47.164 INFO:tasks.workunit.client.0.smithi026.stdout:9/525: creat d7/d23/d29/d31/fbd x:0 0 0 2024-05-09T00:07:47.164 INFO:tasks.workunit.client.0.smithi026.stdout:9/526: chown d7/d23/d29/d31/d40/d41/l75 3894033 1 2024-05-09T00:07:47.164 INFO:tasks.workunit.client.0.smithi026.stdout:9/527: fsync d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa1 0 2024-05-09T00:07:47.167 INFO:tasks.workunit.client.0.smithi026.stdout:9/528: creat d7/d23/d2f/d7d/d87/fbe x:0 0 0 2024-05-09T00:07:47.167 INFO:tasks.workunit.client.0.smithi026.stdout:9/529: write d7/d23/d29/d31/d40/d41/d54/d5c/f7a [4306679,105274] 0 2024-05-09T00:07:47.167 INFO:tasks.workunit.client.0.smithi026.stdout:9/530: fsync f3 0 2024-05-09T00:07:47.168 INFO:tasks.workunit.client.0.smithi026.stdout:9/531: creat d7/d23/d29/d59/fbf x:0 0 0 2024-05-09T00:07:47.171 INFO:tasks.workunit.client.0.smithi026.stdout:9/532: link d7/d23/d29/d31/d40/d41/l6c d7/d23/d29/d31/d40/d41/lc0 0 2024-05-09T00:07:47.173 INFO:tasks.workunit.client.0.smithi026.stdout:9/533: mkdir d7/d26/dc1 0 2024-05-09T00:07:47.175 INFO:tasks.workunit.client.0.smithi026.stdout:9/534: symlink d7/d23/d29/d31/d40/lc2 0 2024-05-09T00:07:47.175 INFO:tasks.workunit.client.0.smithi026.stdout:9/535: write d7/d23/d2f/d3a/fba [340985,96252] 0 2024-05-09T00:07:47.189 INFO:tasks.workunit.client.0.smithi026.stdout:9/536: dwrite d7/d23/d29/d31/d40/f48 [0,4194304] 0 2024-05-09T00:07:47.191 INFO:tasks.workunit.client.0.smithi026.stdout:9/537: creat d7/d23/d29/fc3 x:0 0 0 2024-05-09T00:07:47.194 INFO:tasks.workunit.client.0.smithi026.stdout:9/538: creat d7/d23/d29/d31/d40/d41/d54/d5c/fc4 x:0 0 0 2024-05-09T00:07:47.194 INFO:tasks.workunit.client.0.smithi026.stdout:9/539: readlink d7/l4d 0 2024-05-09T00:07:47.194 INFO:tasks.workunit.client.0.smithi026.stdout:9/540: fdatasync d7/d23/d2f/f45 0 2024-05-09T00:07:47.198 INFO:tasks.workunit.client.0.smithi026.stdout:9/541: unlink d7/d23/c4b 0 2024-05-09T00:07:47.198 INFO:tasks.workunit.client.0.smithi026.stdout:9/542: fsync d7/d23/d29/f9e 0 2024-05-09T00:07:47.202 INFO:tasks.workunit.client.0.smithi026.stdout:9/543: mkdir d7/d23/d29/d31/d40/d41/d54/dc5 0 2024-05-09T00:07:47.202 INFO:tasks.workunit.client.0.smithi026.stdout:4/430: sync 2024-05-09T00:07:47.202 INFO:tasks.workunit.client.0.smithi026.stdout:2/413: sync 2024-05-09T00:07:47.204 INFO:tasks.workunit.client.0.smithi026.stdout:9/544: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc/fc6 x:0 0 0 2024-05-09T00:07:47.204 INFO:tasks.workunit.client.0.smithi026.stdout:9/545: fsync d7/d23/d29/d31/d40/d41/fa8 0 2024-05-09T00:07:47.205 INFO:tasks.workunit.client.0.smithi026.stdout:2/414: rename d14/d22/d55/d6b/l7b to d14/d15/d3b/l95 0 2024-05-09T00:07:47.205 INFO:tasks.workunit.client.0.smithi026.stdout:2/415: stat d14/d15/f39 0 2024-05-09T00:07:47.207 INFO:tasks.workunit.client.0.smithi026.stdout:4/431: creat d0/d12/d1b/d4e/f9a x:0 0 0 2024-05-09T00:07:47.207 INFO:tasks.workunit.client.0.smithi026.stdout:4/432: truncate d0/d12/d1b/d4e/d78/d97/d8c/f95 165517 0 2024-05-09T00:07:47.207 INFO:tasks.workunit.client.0.smithi026.stdout:2/416: write fb [3242755,21743] 0 2024-05-09T00:07:47.211 INFO:tasks.workunit.client.0.smithi026.stdout:9/546: dread d7/d23/d29/d31/d40/d41/d54/d5c/f7a [0,4194304] 0 2024-05-09T00:07:47.211 INFO:tasks.workunit.client.0.smithi026.stdout:9/547: truncate d7/d23/d2f/f35 993621 0 2024-05-09T00:07:47.292 INFO:tasks.workunit.client.0.smithi026.stdout:4/433: creat d0/d12/d1b/d4e/d78/d97/d43/f9b x:0 0 0 2024-05-09T00:07:47.293 INFO:tasks.workunit.client.0.smithi026.stdout:2/417: mkdir d14/d15/d30/d6a/d5f/d61/d6c/d85/d96 0 2024-05-09T00:07:47.300 INFO:tasks.workunit.client.0.smithi026.stdout:2/418: rename d14/d15/d3b/d40/l73 to d14/d15/d30/d6a/d5f/l97 0 2024-05-09T00:07:47.301 INFO:tasks.workunit.client.0.smithi026.stdout:9/548: link d7/d23/d29/d2e/c4f d7/cc7 0 2024-05-09T00:07:47.304 INFO:tasks.workunit.client.0.smithi026.stdout:2/419: mknod d14/d15/d3b/d40/d47/c98 0 2024-05-09T00:07:47.305 INFO:tasks.workunit.client.0.smithi026.stdout:9/549: symlink d7/d23/d29/d31/d40/d41/d54/d9a/da4/lc8 0 2024-05-09T00:07:47.306 INFO:tasks.workunit.client.0.smithi026.stdout:9/550: readlink d7/d23/d29/lb7 0 2024-05-09T00:07:47.306 INFO:tasks.workunit.client.0.smithi026.stdout:9/551: write f2 [1014543,108045] 0 2024-05-09T00:07:47.308 INFO:tasks.workunit.client.0.smithi026.stdout:2/420: mknod d14/d15/d3b/d40/c99 0 2024-05-09T00:07:47.308 INFO:tasks.workunit.client.0.smithi026.stdout:4/434: dwrite d0/d12/f30 [0,4194304] 0 2024-05-09T00:07:47.308 INFO:tasks.workunit.client.0.smithi026.stdout:4/435: write d0/d12/d1b/d2b/f35 [1197775,18177] 0 2024-05-09T00:07:47.313 INFO:tasks.workunit.client.0.smithi026.stdout:2/421: truncate d14/d15/d1f/d70/f7e 2491402 0 2024-05-09T00:07:47.313 INFO:tasks.workunit.client.0.smithi026.stdout:2/422: truncate d14/d22/f7d 781545 0 2024-05-09T00:07:47.317 INFO:tasks.workunit.client.0.smithi026.stdout:4/436: rename d0/d12/d34/f36 to d0/d12/d1b/d4e/d78/d97/d43/d58/f9c 0 2024-05-09T00:07:47.324 INFO:tasks.workunit.client.0.smithi026.stdout:2/423: mknod d14/c9a 0 2024-05-09T00:07:47.324 INFO:tasks.workunit.client.0.smithi026.stdout:2/424: truncate d14/d15/d20/f36 4317024 0 2024-05-09T00:07:47.327 INFO:tasks.workunit.client.0.smithi026.stdout:2/425: creat d14/d15/d3b/f9b x:0 0 0 2024-05-09T00:07:47.333 INFO:tasks.workunit.client.0.smithi026.stdout:4/437: dwrite d0/d12/d1b/d4e/d78/d97/d43/d49/f7c [0,4194304] 0 2024-05-09T00:07:47.337 INFO:tasks.workunit.client.0.smithi026.stdout:4/438: creat d0/d12/d1b/d4e/d78/d97/d8c/f9d x:0 0 0 2024-05-09T00:07:47.339 INFO:tasks.workunit.client.0.smithi026.stdout:4/439: creat d0/d83/f9e x:0 0 0 2024-05-09T00:07:47.339 INFO:tasks.workunit.client.0.smithi026.stdout:4/440: readlink d0/d12/d1b/d4e/d78/d97/l47 0 2024-05-09T00:07:47.339 INFO:tasks.workunit.client.0.smithi026.stdout:4/441: chown d0/d12/d1b/f74 38 1 2024-05-09T00:07:47.339 INFO:tasks.workunit.client.0.smithi026.stdout:4/442: fdatasync d0/d12/d1b/d4e/d78/d97/f2f 0 2024-05-09T00:07:47.339 INFO:tasks.workunit.client.0.smithi026.stdout:4/443: write d0/d12/d1b/d4e/d78/d97/d43/f9b [497608,5714] 0 2024-05-09T00:07:47.339 INFO:tasks.workunit.client.0.smithi026.stdout:4/444: dread - d0/d12/d1b/d4e/d78/f85 zero size 2024-05-09T00:07:47.340 INFO:tasks.workunit.client.0.smithi026.stdout:4/445: creat d0/d12/d1b/d4e/d78/f9f x:0 0 0 2024-05-09T00:07:47.342 INFO:tasks.workunit.client.0.smithi026.stdout:4/446: creat d0/d12/d1b/d4e/d78/d97/d43/d49/fa0 x:0 0 0 2024-05-09T00:07:47.342 INFO:tasks.workunit.client.0.smithi026.stdout:4/447: chown d0/d12/d1b/c3e 12 1 2024-05-09T00:07:47.343 INFO:tasks.workunit.client.0.smithi026.stdout:2/426: dwrite f8 [0,4194304] 0 2024-05-09T00:07:47.344 INFO:tasks.workunit.client.0.smithi026.stdout:4/448: symlink d0/d12/d1b/d2b/la1 0 2024-05-09T00:07:47.347 INFO:tasks.workunit.client.0.smithi026.stdout:2/427: unlink d14/d22/d55/f87 0 2024-05-09T00:07:47.348 INFO:tasks.workunit.client.0.smithi026.stdout:2/428: mknod d14/d15/d3b/d40/c9c 0 2024-05-09T00:07:47.348 INFO:tasks.workunit.client.0.smithi026.stdout:2/429: readlink d14/d15/d30/d6a/l62 0 2024-05-09T00:07:47.349 INFO:tasks.workunit.client.0.smithi026.stdout:2/430: truncate d14/d22/f33 403746 0 2024-05-09T00:07:47.352 INFO:tasks.workunit.client.0.smithi026.stdout:3/437: sync 2024-05-09T00:07:47.352 INFO:tasks.workunit.client.0.smithi026.stdout:7/593: sync 2024-05-09T00:07:47.352 INFO:tasks.workunit.client.0.smithi026.stdout:5/441: sync 2024-05-09T00:07:47.352 INFO:tasks.workunit.client.0.smithi026.stdout:6/344: sync 2024-05-09T00:07:47.352 INFO:tasks.workunit.client.0.smithi026.stdout:5/442: chown d2/d8/d31/d32 1147280 1 2024-05-09T00:07:47.352 INFO:tasks.workunit.client.0.smithi026.stdout:7/594: readlink d8/d2e/d84/db4/dbc/l24 0 2024-05-09T00:07:47.357 INFO:tasks.workunit.client.0.smithi026.stdout:6/345: rename d15/c1b to d15/d1e/c6e 0 2024-05-09T00:07:47.358 INFO:tasks.workunit.client.0.smithi026.stdout:6/346: write d15/d1e/d23/d26/d58/f61 [488260,69738] 0 2024-05-09T00:07:47.358 INFO:tasks.workunit.client.0.smithi026.stdout:5/443: creat d2/d8/d6d/f8f x:0 0 0 2024-05-09T00:07:47.361 INFO:tasks.workunit.client.0.smithi026.stdout:3/438: dread d5/d41/f6e [0,4194304] 0 2024-05-09T00:07:47.361 INFO:tasks.workunit.client.0.smithi026.stdout:6/347: dread d15/d34/f53 [0,4194304] 0 2024-05-09T00:07:47.362 INFO:tasks.workunit.client.0.smithi026.stdout:5/444: mknod d2/d8/d6d/c90 0 2024-05-09T00:07:47.364 INFO:tasks.workunit.client.0.smithi026.stdout:6/348: truncate d15/d1e/d3d/d4c/f40 1335462 0 2024-05-09T00:07:47.369 INFO:tasks.workunit.client.0.smithi026.stdout:6/349: mkdir d15/d1e/d23/d6f 0 2024-05-09T00:07:47.369 INFO:tasks.workunit.client.0.smithi026.stdout:6/350: chown d15/d1e/d23/d26/d58/d5c 150068433 1 2024-05-09T00:07:47.369 INFO:tasks.workunit.client.0.smithi026.stdout:6/351: write d15/d1e/d30/f3f [1097001,129634] 0 2024-05-09T00:07:47.370 INFO:tasks.workunit.client.0.smithi026.stdout:5/445: dread d2/d5a/f5f [0,4194304] 0 2024-05-09T00:07:47.370 INFO:tasks.workunit.client.0.smithi026.stdout:6/352: creat d15/d1e/d3d/f70 x:0 0 0 2024-05-09T00:07:47.373 INFO:tasks.workunit.client.0.smithi026.stdout:5/446: rename d2/c14 to d2/d8/d31/d63/c91 0 2024-05-09T00:07:47.373 INFO:tasks.workunit.client.0.smithi026.stdout:6/353: rmdir d15/d1e/d23/d26/d58/d5c 39 2024-05-09T00:07:47.375 INFO:tasks.workunit.client.0.smithi026.stdout:5/447: mknod d2/d8/d31/d2e/d4a/c92 0 2024-05-09T00:07:47.377 INFO:tasks.workunit.client.0.smithi026.stdout:6/354: unlink d15/d1e/d23/c59 0 2024-05-09T00:07:47.377 INFO:tasks.workunit.client.0.smithi026.stdout:5/448: creat d2/d8/d31/d4b/d51/f93 x:0 0 0 2024-05-09T00:07:47.379 INFO:tasks.workunit.client.0.smithi026.stdout:6/355: mknod d15/d34/c71 0 2024-05-09T00:07:47.383 INFO:tasks.workunit.client.0.smithi026.stdout:4/449: dwrite d0/d12/d1b/d4e/d78/d97/f5c [0,4194304] 0 2024-05-09T00:07:47.383 INFO:tasks.workunit.client.0.smithi026.stdout:4/450: dread - d0/d12/d1b/d4e/d78/d97/f8a zero size 2024-05-09T00:07:47.384 INFO:tasks.workunit.client.0.smithi026.stdout:7/595: dwrite d8/d2e/d84/db4/dbc/d1e/d3d/f5f [0,4194304] 0 2024-05-09T00:07:47.384 INFO:tasks.workunit.client.0.smithi026.stdout:7/596: stat d8/d2e/f4a 0 2024-05-09T00:07:47.385 INFO:tasks.workunit.client.0.smithi026.stdout:2/431: dwrite d14/d15/d20/f8c [4194304,4194304] 0 2024-05-09T00:07:47.386 INFO:tasks.workunit.client.0.smithi026.stdout:2/432: fdatasync d14/d15/d30/d6a/d5b/f64 0 2024-05-09T00:07:47.389 INFO:tasks.workunit.client.0.smithi026.stdout:4/451: rename d0/d12/d1b/d4e/d78 to d0/d12/da2 0 2024-05-09T00:07:47.392 INFO:tasks.workunit.client.0.smithi026.stdout:6/356: dwrite f11 [0,4194304] 0 2024-05-09T00:07:47.393 INFO:tasks.workunit.client.0.smithi026.stdout:6/357: read d15/f29 [603417,112826] 0 2024-05-09T00:07:47.394 INFO:tasks.workunit.client.0.smithi026.stdout:7/597: creat d8/d5c/fcb x:0 0 0 2024-05-09T00:07:47.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:46 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:45.907975+0000 mgr.smithi135.kkrhgf (mgr.24419) 56 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 175 MiB/s rd, 375 MiB/s wr, 572 op/s 2024-05-09T00:07:47.396 INFO:tasks.workunit.client.0.smithi026.stdout:5/449: dwrite d2/d8/d6d/f8f [0,4194304] 0 2024-05-09T00:07:47.406 INFO:tasks.workunit.client.0.smithi026.stdout:2/433: symlink d14/d15/d3b/d40/d68/l9d 0 2024-05-09T00:07:47.407 INFO:tasks.workunit.client.0.smithi026.stdout:4/452: rename d0/d12/d1b/d2b to d0/d12/da2/d97/d43/d49/d8f/da3 0 2024-05-09T00:07:47.412 INFO:tasks.workunit.client.0.smithi026.stdout:6/358: creat d15/d1e/d30/f72 x:0 0 0 2024-05-09T00:07:47.417 INFO:tasks.workunit.client.0.smithi026.stdout:2/434: dwrite fb [0,4194304] 0 2024-05-09T00:07:47.419 INFO:tasks.workunit.client.0.smithi026.stdout:5/450: mknod d2/d8/d2a/c94 0 2024-05-09T00:07:47.420 INFO:tasks.workunit.client.0.smithi026.stdout:5/451: read d2/d8/d31/d24/f7b [2918262,117756] 0 2024-05-09T00:07:47.422 INFO:tasks.workunit.client.0.smithi026.stdout:7/598: rename d8/d2e/d84/db4/dbc/l71 to d8/lcc 0 2024-05-09T00:07:47.422 INFO:tasks.workunit.client.0.smithi026.stdout:7/599: fsync d8/d1b/f2d 0 2024-05-09T00:07:47.422 INFO:tasks.workunit.client.0.smithi026.stdout:4/453: mknod d0/d12/da2/d97/d43/ca4 0 2024-05-09T00:07:47.432 INFO:tasks.workunit.client.0.smithi026.stdout:7/600: rename d8/d2e/d84/fab to d8/fcd 0 2024-05-09T00:07:47.432 INFO:tasks.workunit.client.0.smithi026.stdout:2/435: dread d14/d15/d1f/f2d [0,4194304] 0 2024-05-09T00:07:47.433 INFO:tasks.workunit.client.0.smithi026.stdout:2/436: stat d14/d15/f26 0 2024-05-09T00:07:47.434 INFO:tasks.workunit.client.0.smithi026.stdout:4/454: truncate d0/d12/da2/d97/d43/d58/f91 621684 0 2024-05-09T00:07:47.434 INFO:tasks.workunit.client.0.smithi026.stdout:4/455: write d0/d12/d64/f82 [360478,15898] 0 2024-05-09T00:07:47.434 INFO:tasks.workunit.client.0.smithi026.stdout:4/456: dread - d0/d12/da2/d97/f57 zero size 2024-05-09T00:07:47.434 INFO:tasks.workunit.client.0.smithi026.stdout:4/457: read - d0/d12/da2/f9f zero size 2024-05-09T00:07:47.436 INFO:tasks.workunit.client.0.smithi026.stdout:7/601: symlink d8/lce 0 2024-05-09T00:07:47.438 INFO:tasks.workunit.client.0.smithi026.stdout:7/602: mknod d8/d2e/d84/db4/dbc/d1e/ccf 0 2024-05-09T00:07:47.438 INFO:tasks.workunit.client.0.smithi026.stdout:7/603: fdatasync d8/d2e/d84/db4/dbc/f52 0 2024-05-09T00:07:47.438 INFO:tasks.workunit.client.0.smithi026.stdout:7/604: mkdir d8/d1b/d89/dc1/dd0 0 2024-05-09T00:07:47.439 INFO:tasks.workunit.client.0.smithi026.stdout:5/452: dwrite d2/f55 [0,4194304] 0 2024-05-09T00:07:47.439 INFO:tasks.workunit.client.0.smithi026.stdout:5/453: truncate d2/f60 5230879 0 2024-05-09T00:07:47.439 INFO:tasks.workunit.client.0.smithi026.stdout:5/454: fdatasync d2/d8/d31/d4b/d51/f93 0 2024-05-09T00:07:47.440 INFO:tasks.workunit.client.0.smithi026.stdout:7/605: mknod d8/d2e/d84/db4/dbc/d1e/d3d/d6b/cd1 0 2024-05-09T00:07:47.442 INFO:tasks.workunit.client.0.smithi026.stdout:5/455: rmdir d2/d8/d6d 39 2024-05-09T00:07:47.445 INFO:tasks.workunit.client.0.smithi026.stdout:7/606: rename d8/d2e/d84/db4/dbc/d1e/d3d/fbf to d8/d2e/d84/db4/dbc/fd2 0 2024-05-09T00:07:47.446 INFO:tasks.workunit.client.0.smithi026.stdout:4/458: dread d0/f2 [0,4194304] 0 2024-05-09T00:07:47.446 INFO:tasks.workunit.client.0.smithi026.stdout:4/459: fsync d0/d12/d1b/f51 0 2024-05-09T00:07:47.447 INFO:tasks.workunit.client.0.smithi026.stdout:4/460: write d0/d12/d1b/f3c [837497,70065] 0 2024-05-09T00:07:47.449 INFO:tasks.workunit.client.0.smithi026.stdout:4/461: getdents d0/d12/d1b/d4e/d92 0 2024-05-09T00:07:47.450 INFO:tasks.workunit.client.0.smithi026.stdout:7/607: symlink d8/d2e/d84/db4/dbc/d1e/d3d/dca/ld3 0 2024-05-09T00:07:47.452 INFO:tasks.workunit.client.0.smithi026.stdout:7/608: symlink d8/d1b/d89/dc1/db0/ld4 0 2024-05-09T00:07:47.456 INFO:tasks.workunit.client.0.smithi026.stdout:7/609: mknod d8/d1b/d89/cd5 0 2024-05-09T00:07:47.456 INFO:tasks.workunit.client.0.smithi026.stdout:7/610: truncate d8/d5c/d9a/f9c 5229835 0 2024-05-09T00:07:47.456 INFO:tasks.workunit.client.0.smithi026.stdout:7/611: readlink d8/lcc 0 2024-05-09T00:07:47.456 INFO:tasks.workunit.client.0.smithi026.stdout:7/612: truncate d8/d2e/d84/db4/dbc/d22/f9b 127642 0 2024-05-09T00:07:47.456 INFO:tasks.workunit.client.0.smithi026.stdout:7/613: chown d8/d1b/l6a 1002383635 1 2024-05-09T00:07:47.457 INFO:tasks.workunit.client.0.smithi026.stdout:7/614: creat d8/d1b/d89/fd6 x:0 0 0 2024-05-09T00:07:47.458 INFO:tasks.workunit.client.0.smithi026.stdout:7/615: creat d8/d5c/fd7 x:0 0 0 2024-05-09T00:07:47.459 INFO:tasks.workunit.client.0.smithi026.stdout:7/616: symlink d8/d2e/d84/db4/dbc/d1e/ld8 0 2024-05-09T00:07:47.460 INFO:tasks.workunit.client.0.smithi026.stdout:7/617: rename d8/d2e/d84/db4/dbc/d1e/d3d/c74 to d8/d2e/d84/db4/dbc/d1e/d3d/cd9 0 2024-05-09T00:07:47.461 INFO:tasks.workunit.client.0.smithi026.stdout:7/618: write d8/d2e/d84/db4/dbc/d22/f42 [52421,12701] 0 2024-05-09T00:07:47.463 INFO:tasks.workunit.client.0.smithi026.stdout:5/456: truncate d2/f55 3455543 0 2024-05-09T00:07:47.464 INFO:tasks.workunit.client.0.smithi026.stdout:7/619: link d8/d2e/d84/db4/fb7 d8/d2e/d84/db4/dbc/d1e/d3d/dca/fda 0 2024-05-09T00:07:47.467 INFO:tasks.workunit.client.0.smithi026.stdout:5/457: mknod d2/d8/d31/d32/d48/c95 0 2024-05-09T00:07:47.467 INFO:tasks.workunit.client.0.smithi026.stdout:4/462: dwrite d0/f9 [4194304,4194304] 0 2024-05-09T00:07:47.468 INFO:tasks.workunit.client.0.smithi026.stdout:4/463: dread d0/f94 [0,4194304] 0 2024-05-09T00:07:47.469 INFO:tasks.workunit.client.0.smithi026.stdout:7/620: rename d8/d1b/l27 to d8/d2e/d84/db4/ldb 0 2024-05-09T00:07:47.469 INFO:tasks.workunit.client.0.smithi026.stdout:7/621: chown d8/d5c/d9a/fc4 7854 1 2024-05-09T00:07:47.469 INFO:tasks.workunit.client.0.smithi026.stdout:4/464: write d0/d12/da2/d97/d43/d58/f6a [24370,66525] 0 2024-05-09T00:07:47.470 INFO:tasks.workunit.client.0.smithi026.stdout:4/465: chown d0/d83/f93 6 1 2024-05-09T00:07:47.471 INFO:tasks.workunit.client.0.smithi026.stdout:7/622: truncate d8/d2e/d84/db4/dbc/d22/d29/f18 673940 0 2024-05-09T00:07:47.471 INFO:tasks.workunit.client.0.smithi026.stdout:7/623: chown d8/d2e/d84/db4/dbc/d1e/f7c 240 1 2024-05-09T00:07:47.475 INFO:tasks.workunit.client.0.smithi026.stdout:4/466: symlink d0/d12/da2/d97/d43/d49/d8f/la5 0 2024-05-09T00:07:47.476 INFO:tasks.workunit.client.0.smithi026.stdout:1/534: sync 2024-05-09T00:07:47.476 INFO:tasks.workunit.client.0.smithi026.stdout:0/596: sync 2024-05-09T00:07:47.480 INFO:tasks.workunit.client.0.smithi026.stdout:7/624: creat d8/d1b/d89/dc1/db0/fdc x:0 0 0 2024-05-09T00:07:47.484 INFO:tasks.workunit.client.0.smithi026.stdout:4/467: creat d0/d12/da2/d97/d43/d49/d8f/fa6 x:0 0 0 2024-05-09T00:07:47.486 INFO:tasks.workunit.client.0.smithi026.stdout:0/597: creat d1d/d25/d47/d6e/dc2/fca x:0 0 0 2024-05-09T00:07:47.487 INFO:tasks.workunit.client.0.smithi026.stdout:0/598: read d1d/d1e/d20/d51/f86 [1238579,100249] 0 2024-05-09T00:07:47.488 INFO:tasks.workunit.client.0.smithi026.stdout:1/535: mkdir d5/dd/d87/db3 0 2024-05-09T00:07:47.489 INFO:tasks.workunit.client.0.smithi026.stdout:7/625: symlink d8/d1b/d89/dc1/dd0/ldd 0 2024-05-09T00:07:47.490 INFO:tasks.workunit.client.0.smithi026.stdout:4/468: symlink d0/d12/d87/la7 0 2024-05-09T00:07:47.490 INFO:tasks.workunit.client.0.smithi026.stdout:4/469: fdatasync d0/d12/da2/d97/d43/d49/d8f/da3/f63 0 2024-05-09T00:07:47.491 INFO:tasks.workunit.client.0.smithi026.stdout:5/458: truncate d2/f60 4952518 0 2024-05-09T00:07:47.491 INFO:tasks.workunit.client.0.smithi026.stdout:5/459: write d2/d8/d31/d24/f52 [1361415,52063] 0 2024-05-09T00:07:47.504 INFO:tasks.workunit.client.0.smithi026.stdout:0/599: rename d1d/d1e/d2d/f3e to d1d/d1e/d20/fcb 0 2024-05-09T00:07:47.504 INFO:tasks.workunit.client.0.smithi026.stdout:0/600: dread - d1d/d25/f7e zero size 2024-05-09T00:07:47.509 INFO:tasks.workunit.client.0.smithi026.stdout:4/470: dwrite d0/d12/da2/d97/f39 [4194304,4194304] 0 2024-05-09T00:07:47.510 INFO:tasks.workunit.client.0.smithi026.stdout:4/471: truncate d0/d12/d1b/f74 1822294 0 2024-05-09T00:07:47.517 INFO:tasks.workunit.client.0.smithi026.stdout:7/626: link d8/d2e/d84/db4/dbc/d1e/d3d/dca/fda d8/d2e/d84/db4/dbc/d22/fde 0 2024-05-09T00:07:47.517 INFO:tasks.workunit.client.0.smithi026.stdout:7/627: fsync d8/d2e/f87 0 2024-05-09T00:07:47.519 INFO:tasks.workunit.client.0.smithi026.stdout:1/536: rename d5/dd/f80 to d5/d16/d60/d66/d97/d94/db1/fb4 0 2024-05-09T00:07:47.520 INFO:tasks.workunit.client.0.smithi026.stdout:0/601: unlink d1d/d25/d3c/f4c 0 2024-05-09T00:07:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:7/628: creat d8/d2e/d84/db4/dbc/d1e/d80/da2/fdf x:0 0 0 2024-05-09T00:07:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:5/460: rename d2/d8/d31/d4b/d51 to d2/d5a/d96 0 2024-05-09T00:07:47.530 INFO:tasks.workunit.client.0.smithi026.stdout:5/461: write d2/f44 [3159471,68980] 0 2024-05-09T00:07:47.532 INFO:tasks.workunit.client.0.smithi026.stdout:0/602: getdents d1d/d1e/d20/d4d/d83/d9e/da7 0 2024-05-09T00:07:47.535 INFO:tasks.workunit.client.0.smithi026.stdout:4/472: rename d0/d12/da2/d97/d43/d49/d8f/da3/f35 to d0/d12/d1b/d4e/d92/fa8 0 2024-05-09T00:07:47.540 INFO:tasks.workunit.client.0.smithi026.stdout:1/537: link f2 d5/dd/d17/d73/fb5 0 2024-05-09T00:07:47.542 INFO:tasks.workunit.client.0.smithi026.stdout:0/603: rmdir d1d/d33/dbb 39 2024-05-09T00:07:47.542 INFO:tasks.workunit.client.0.smithi026.stdout:0/604: dread - d1d/da4/fb8 zero size 2024-05-09T00:07:47.543 INFO:tasks.workunit.client.0.smithi026.stdout:7/629: dwrite f5 [0,4194304] 0 2024-05-09T00:07:47.550 INFO:tasks.workunit.client.0.smithi026.stdout:1/538: unlink d5/dd/f68 0 2024-05-09T00:07:47.550 INFO:tasks.workunit.client.0.smithi026.stdout:4/473: dwrite d0/f4c [0,4194304] 0 2024-05-09T00:07:47.559 INFO:tasks.workunit.client.0.smithi026.stdout:5/462: rename d2/d8/d31/d4b/c6a to d2/d8/d31/c97 0 2024-05-09T00:07:47.561 INFO:tasks.workunit.client.0.smithi026.stdout:4/474: dread d0/d12/da2/d97/d43/f44 [0,4194304] 0 2024-05-09T00:07:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:0/605: dwrite d1d/d25/d47/fb9 [0,4194304] 0 2024-05-09T00:07:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:7/630: rename d8/d2e/d84/db4/dbc/d1e/d3d/l6c to d8/d2e/d84/le0 0 2024-05-09T00:07:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:0/606: dread d1d/d25/f55 [0,4194304] 0 2024-05-09T00:07:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:0/607: chown d1d/d33/d64/fa6 128 1 2024-05-09T00:07:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:4/475: creat d0/d83/fa9 x:0 0 0 2024-05-09T00:07:47.566 INFO:tasks.workunit.client.0.smithi026.stdout:5/463: dread d2/d8/d31/f30 [0,4194304] 0 2024-05-09T00:07:47.569 INFO:tasks.workunit.client.0.smithi026.stdout:5/464: dread d2/d8/d31/f12 [0,4194304] 0 2024-05-09T00:07:47.570 INFO:tasks.workunit.client.0.smithi026.stdout:5/465: write d2/d8/d31/d24/f65 [734016,88346] 0 2024-05-09T00:07:47.571 INFO:tasks.workunit.client.0.smithi026.stdout:5/466: readlink d2/d8/d31/d2e/d35/l3b 0 2024-05-09T00:07:47.571 INFO:tasks.workunit.client.0.smithi026.stdout:5/467: fdatasync d2/d8/f8b 0 2024-05-09T00:07:47.571 INFO:tasks.workunit.client.0.smithi026.stdout:5/468: write d2/fc [3702442,46057] 0 2024-05-09T00:07:47.575 INFO:tasks.workunit.client.0.smithi026.stdout:1/539: rename d5/dd/l26 to d5/dd/d17/d73/lb6 0 2024-05-09T00:07:47.576 INFO:tasks.workunit.client.0.smithi026.stdout:1/540: stat d5/db/f77 0 2024-05-09T00:07:47.578 INFO:tasks.workunit.client.0.smithi026.stdout:0/608: mkdir d1d/d1e/d20/d4d/d83/d9e/da7/dcc 0 2024-05-09T00:07:47.578 INFO:tasks.workunit.client.0.smithi026.stdout:5/469: truncate d2/d8/d6d/f8f 1334102 0 2024-05-09T00:07:47.582 INFO:tasks.workunit.client.0.smithi026.stdout:4/476: rename d0/d12/da2/d97/f2f to d0/d12/da2/d97/d43/d49/d8f/da3/d86/faa 0 2024-05-09T00:07:47.587 INFO:tasks.workunit.client.0.smithi026.stdout:0/609: mkdir d1d/d25/d3c/dcd 0 2024-05-09T00:07:47.589 INFO:tasks.workunit.client.0.smithi026.stdout:5/470: rename d2/d8/d31/d24/f52 to d2/d8/d31/d2e/f98 0 2024-05-09T00:07:47.590 INFO:tasks.workunit.client.0.smithi026.stdout:4/477: creat d0/d12/d64/fab x:0 0 0 2024-05-09T00:07:47.592 INFO:tasks.workunit.client.0.smithi026.stdout:5/471: write d2/d8/d31/d24/f62 [3604339,129055] 0 2024-05-09T00:07:47.592 INFO:tasks.workunit.client.0.smithi026.stdout:5/472: stat d2/d8/d2a/l56 0 2024-05-09T00:07:47.593 INFO:tasks.workunit.client.0.smithi026.stdout:7/631: dwrite d8/d2e/d84/db4/dbc/d1e/f93 [0,4194304] 0 2024-05-09T00:07:47.594 INFO:tasks.workunit.client.0.smithi026.stdout:1/541: link d5/d16/d60/d66/c78 d5/dd/d17/d7b/cb7 0 2024-05-09T00:07:47.595 INFO:tasks.workunit.client.0.smithi026.stdout:0/610: creat d1d/d33/dbb/fce x:0 0 0 2024-05-09T00:07:47.597 INFO:tasks.workunit.client.0.smithi026.stdout:0/611: dread d1d/d1e/f32 [0,4194304] 0 2024-05-09T00:07:47.597 INFO:tasks.workunit.client.0.smithi026.stdout:0/612: readlink d1d/da4/lb6 0 2024-05-09T00:07:47.597 INFO:tasks.workunit.client.0.smithi026.stdout:0/613: chown d1d/d1e/d20 78032 1 2024-05-09T00:07:47.603 INFO:tasks.workunit.client.0.smithi026.stdout:7/632: rmdir d8/d2e/d84/db4/dbc/d1e/d3d/d6b 39 2024-05-09T00:07:47.606 INFO:tasks.workunit.client.0.smithi026.stdout:0/614: dread f1b [0,4194304] 0 2024-05-09T00:07:47.606 INFO:tasks.workunit.client.0.smithi026.stdout:5/473: mknod d2/d8/d31/c99 0 2024-05-09T00:07:47.608 INFO:tasks.workunit.client.0.smithi026.stdout:7/633: link d8/d1b/d89/dc1/db0/ld4 d8/d2e/d84/db4/dbc/d1e/d8a/le1 0 2024-05-09T00:07:47.609 INFO:tasks.workunit.client.0.smithi026.stdout:1/542: mknod d5/d16/cb8 0 2024-05-09T00:07:47.613 INFO:tasks.workunit.client.0.smithi026.stdout:0/615: mkdir d1d/d25/d47/dc8/dcf 0 2024-05-09T00:07:47.614 INFO:tasks.workunit.client.0.smithi026.stdout:0/616: write d1d/d1e/d20/d4d/d58/d62/d78/f99 [483962,17136] 0 2024-05-09T00:07:47.614 INFO:tasks.workunit.client.0.smithi026.stdout:5/474: symlink d2/d8/d31/d2e/d35/l9a 0 2024-05-09T00:07:47.615 INFO:tasks.workunit.client.0.smithi026.stdout:5/475: fsync d2/d8/d31/d2e/d4a/f3d 0 2024-05-09T00:07:47.616 INFO:tasks.workunit.client.0.smithi026.stdout:7/634: link d8/d5c/d9a/fc4 d8/d2e/d84/db4/dbc/d22/fe2 0 2024-05-09T00:07:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:1/543: creat d5/dd/d17/d73/fb9 x:0 0 0 2024-05-09T00:07:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:1/544: dread - d5/dd/d1f/d39/d47/f93 zero size 2024-05-09T00:07:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:1/545: symlink d5/db/d1d/dac/lba 0 2024-05-09T00:07:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:1/546: creat d5/dd/d1f/fbb x:0 0 0 2024-05-09T00:07:47.626 INFO:tasks.workunit.client.0.smithi026.stdout:1/547: mknod d5/dd/d17/d9f/cbc 0 2024-05-09T00:07:47.626 INFO:tasks.workunit.client.0.smithi026.stdout:1/548: getdents d5 0 2024-05-09T00:07:47.626 INFO:tasks.workunit.client.0.smithi026.stdout:8/566: sync 2024-05-09T00:07:47.626 INFO:tasks.workunit.client.0.smithi026.stdout:7/635: dread d8/d2e/d84/db4/dbc/f50 [0,4194304] 0 2024-05-09T00:07:47.628 INFO:tasks.workunit.client.0.smithi026.stdout:0/617: dwrite d1d/d1e/d20/d4d/d58/d62/d78/fc6 [0,4194304] 0 2024-05-09T00:07:47.628 INFO:tasks.workunit.client.0.smithi026.stdout:0/618: truncate d1d/d33/dbb/f75 454122 0 2024-05-09T00:07:47.628 INFO:tasks.workunit.client.0.smithi026.stdout:0/619: chown d1d/d25/d47/c7b 201 1 2024-05-09T00:07:47.628 INFO:tasks.workunit.client.0.smithi026.stdout:8/567: rmdir de/d48/d73 39 2024-05-09T00:07:47.629 INFO:tasks.workunit.client.0.smithi026.stdout:8/568: write de/d6c/d31/d4f/f86 [89928,21354] 0 2024-05-09T00:07:47.630 INFO:tasks.workunit.client.0.smithi026.stdout:7/636: link d8/d2e/d84/db4/dbc/d1e/d3d/f63 d8/d2e/d84/fe3 0 2024-05-09T00:07:47.631 INFO:tasks.workunit.client.0.smithi026.stdout:1/549: dread d5/dd/d1f/d39/d47/f59 [0,4194304] 0 2024-05-09T00:07:47.631 INFO:tasks.workunit.client.0.smithi026.stdout:1/550: fdatasync d5/d16/d60/d66/d97/f55 0 2024-05-09T00:07:47.631 INFO:tasks.workunit.client.0.smithi026.stdout:5/476: dread d2/fc [0,4194304] 0 2024-05-09T00:07:47.631 INFO:tasks.workunit.client.0.smithi026.stdout:7/637: read d8/d2e/d84/db4/dbc/d22/fe2 [126562,67489] 0 2024-05-09T00:07:47.631 INFO:tasks.workunit.client.0.smithi026.stdout:7/638: fdatasync d8/d5c/d9a/fc4 0 2024-05-09T00:07:47.632 INFO:tasks.workunit.client.0.smithi026.stdout:7/639: write d8/d2e/d84/db4/dbc/d1e/d3d/d6b/fa3 [47767,75849] 0 2024-05-09T00:07:47.633 INFO:tasks.workunit.client.0.smithi026.stdout:0/620: symlink d1d/d1e/d20/d4d/d58/ld0 0 2024-05-09T00:07:47.635 INFO:tasks.workunit.client.0.smithi026.stdout:8/569: mknod de/d6c/d31/d4f/d87/d62/cb9 0 2024-05-09T00:07:47.637 INFO:tasks.workunit.client.0.smithi026.stdout:5/477: rmdir d2/d8/d6d 39 2024-05-09T00:07:47.639 INFO:tasks.workunit.client.0.smithi026.stdout:8/570: truncate de/d17/d21/d24/f26 3705200 0 2024-05-09T00:07:47.645 INFO:tasks.workunit.client.0.smithi026.stdout:7/640: dread d8/d1b/f34 [0,4194304] 0 2024-05-09T00:07:47.646 INFO:tasks.workunit.client.0.smithi026.stdout:5/478: dread d2/d8/d31/f85 [0,4194304] 0 2024-05-09T00:07:47.646 INFO:tasks.workunit.client.0.smithi026.stdout:5/479: dread - d2/d5a/d96/f93 zero size 2024-05-09T00:07:47.646 INFO:tasks.workunit.client.0.smithi026.stdout:7/641: creat d8/d5c/d9a/fe4 x:0 0 0 2024-05-09T00:07:47.648 INFO:tasks.workunit.client.0.smithi026.stdout:5/480: creat d2/d8/d31/d2e/f9b x:0 0 0 2024-05-09T00:07:47.648 INFO:tasks.workunit.client.0.smithi026.stdout:5/481: fsync d2/d8/d31/d2e/d4a/f3c 0 2024-05-09T00:07:47.650 INFO:tasks.workunit.client.0.smithi026.stdout:7/642: mkdir d8/d2e/d84/db4/de5 0 2024-05-09T00:07:47.655 INFO:tasks.workunit.client.0.smithi026.stdout:7/643: getdents d8/d1b/d89 0 2024-05-09T00:07:47.657 INFO:tasks.workunit.client.0.smithi026.stdout:7/644: mknod d8/d2e/d84/ce6 0 2024-05-09T00:07:47.660 INFO:tasks.workunit.client.0.smithi026.stdout:0/621: dwrite d1d/d33/dbb/f75 [0,4194304] 0 2024-05-09T00:07:47.661 INFO:tasks.workunit.client.0.smithi026.stdout:8/571: dwrite de/f16 [0,4194304] 0 2024-05-09T00:07:47.663 INFO:tasks.workunit.client.0.smithi026.stdout:7/645: write d8/d1b/d89/fa6 [3599766,28615] 0 2024-05-09T00:07:47.663 INFO:tasks.workunit.client.0.smithi026.stdout:7/646: fsync d8/d1b/d89/d8d/fc5 0 2024-05-09T00:07:47.665 INFO:tasks.workunit.client.0.smithi026.stdout:0/622: symlink d1d/d1e/d20/d4d/d58/d62/d84/ld1 0 2024-05-09T00:07:47.665 INFO:tasks.workunit.client.0.smithi026.stdout:0/623: write d1d/d33/d64/fb2 [1205907,58106] 0 2024-05-09T00:07:47.666 INFO:tasks.workunit.client.0.smithi026.stdout:8/572: creat de/d17/d21/d24/d3b/fba x:0 0 0 2024-05-09T00:07:47.668 INFO:tasks.workunit.client.0.smithi026.stdout:7/647: stat d8/d2e/c5e 0 2024-05-09T00:07:47.668 INFO:tasks.workunit.client.0.smithi026.stdout:7/648: readlink d8/d2e/d84/db4/dbc/d1e/l76 0 2024-05-09T00:07:47.668 INFO:tasks.workunit.client.0.smithi026.stdout:7/649: write d8/fc8 [710164,59878] 0 2024-05-09T00:07:47.669 INFO:tasks.workunit.client.0.smithi026.stdout:8/573: mkdir de/d6c/d31/d4f/dbb 0 2024-05-09T00:07:47.669 INFO:tasks.workunit.client.0.smithi026.stdout:8/574: chown de/d17/l2a 29558 1 2024-05-09T00:07:47.670 INFO:tasks.workunit.client.0.smithi026.stdout:8/575: link de/d17/d21/d24/c67 de/d6c/db5/cbc 0 2024-05-09T00:07:47.671 INFO:tasks.workunit.client.0.smithi026.stdout:8/576: write de/d17/d21/d24/d3b/f7a [1565067,65797] 0 2024-05-09T00:07:47.672 INFO:tasks.workunit.client.0.smithi026.stdout:7/650: dread d8/d2e/d84/db4/dbc/fa5 [0,4194304] 0 2024-05-09T00:07:47.673 INFO:tasks.workunit.client.0.smithi026.stdout:5/482: dwrite d2/d5a/f7e [0,4194304] 0 2024-05-09T00:07:47.677 INFO:tasks.workunit.client.0.smithi026.stdout:7/651: mknod d8/d2e/d84/db4/dbc/d1e/d3d/ce7 0 2024-05-09T00:07:47.679 INFO:tasks.workunit.client.0.smithi026.stdout:5/483: mkdir d2/d8/d31/d63/d9c 0 2024-05-09T00:07:47.680 INFO:tasks.workunit.client.0.smithi026.stdout:8/577: dread de/d17/d21/d24/d3b/f7a [0,4194304] 0 2024-05-09T00:07:47.680 INFO:tasks.workunit.client.0.smithi026.stdout:4/478: write d0/d12/d1b/f53 [471975,7001] 0 2024-05-09T00:07:47.682 INFO:tasks.workunit.client.0.smithi026.stdout:7/652: mknod d8/d2e/d84/db4/dbc/d22/da1/ce8 0 2024-05-09T00:07:47.684 INFO:tasks.workunit.client.0.smithi026.stdout:5/484: creat d2/d8/d31/d63/f9d x:0 0 0 2024-05-09T00:07:47.684 INFO:tasks.workunit.client.0.smithi026.stdout:5/485: fsync d2/d5a/d96/f5e 0 2024-05-09T00:07:47.685 INFO:tasks.workunit.client.0.smithi026.stdout:5/486: fsync d2/fc 0 2024-05-09T00:07:47.685 INFO:tasks.workunit.client.0.smithi026.stdout:4/479: mkdir d0/d12/d64/dac 0 2024-05-09T00:07:47.686 INFO:tasks.workunit.client.0.smithi026.stdout:4/480: write d0/f2 [3192442,49352] 0 2024-05-09T00:07:47.687 INFO:tasks.workunit.client.0.smithi026.stdout:5/487: creat d2/d8/d31/d32/d48/f9e x:0 0 0 2024-05-09T00:07:47.690 INFO:tasks.workunit.client.0.smithi026.stdout:4/481: write d0/f22 [5904673,35741] 0 2024-05-09T00:07:47.690 INFO:tasks.workunit.client.0.smithi026.stdout:4/482: stat d0/d12/da2/f85 0 2024-05-09T00:07:47.690 INFO:tasks.workunit.client.0.smithi026.stdout:7/653: dread d8/d2e/d84/db4/dbc/d1e/d3d/f61 [0,4194304] 0 2024-05-09T00:07:47.690 INFO:tasks.workunit.client.0.smithi026.stdout:7/654: readlink d8/d2e/d84/le0 0 2024-05-09T00:07:47.690 INFO:tasks.workunit.client.0.smithi026.stdout:5/488: getdents d2/d8/d2a 0 2024-05-09T00:07:47.690 INFO:tasks.workunit.client.0.smithi026.stdout:5/489: truncate d2/d8/d31/f85 4860726 0 2024-05-09T00:07:47.692 INFO:tasks.workunit.client.0.smithi026.stdout:4/483: mknod d0/d12/da2/d97/d43/d49/d8f/da3/d66/cad 0 2024-05-09T00:07:47.692 INFO:tasks.workunit.client.0.smithi026.stdout:4/484: write d0/d12/d1b/d4e/f9a [155697,36733] 0 2024-05-09T00:07:47.694 INFO:tasks.workunit.client.0.smithi026.stdout:7/655: creat d8/d2e/d84/db4/dbc/d1e/d3d/fe9 x:0 0 0 2024-05-09T00:07:47.695 INFO:tasks.workunit.client.0.smithi026.stdout:4/485: getdents d0/d12/d1b 0 2024-05-09T00:07:47.697 INFO:tasks.workunit.client.0.smithi026.stdout:4/486: mknod d0/d12/da2/d97/d43/d58/cae 0 2024-05-09T00:07:47.703 INFO:tasks.workunit.client.0.smithi026.stdout:1/551: rename d5/db/d1d/dac to d5/d16/dbd 0 2024-05-09T00:07:47.705 INFO:tasks.workunit.client.0.smithi026.stdout:5/490: rename d2/d5a/f7e to d2/d8/d2a/d8d/f9f 0 2024-05-09T00:07:47.705 INFO:tasks.workunit.client.0.smithi026.stdout:5/491: dread - d2/d8/f8b zero size 2024-05-09T00:07:47.706 INFO:tasks.workunit.client.0.smithi026.stdout:8/578: dwrite de/d17/d21/d24/d3b/f7a [0,4194304] 0 2024-05-09T00:07:47.710 INFO:tasks.workunit.client.0.smithi026.stdout:1/552: dread d5/db/f5d [0,4194304] 0 2024-05-09T00:07:47.711 INFO:tasks.workunit.client.0.smithi026.stdout:5/492: creat d2/d8/d31/d32/d48/fa0 x:0 0 0 2024-05-09T00:07:47.711 INFO:tasks.workunit.client.0.smithi026.stdout:5/493: stat d2/d8/d2a/f58 0 2024-05-09T00:07:47.712 INFO:tasks.workunit.client.0.smithi026.stdout:8/579: mkdir de/d17/d21/d24/d5b/dbd 0 2024-05-09T00:07:47.714 INFO:tasks.workunit.client.0.smithi026.stdout:7/656: rename d8/d5c/d9a/d9f/fc9 to d8/d2e/fea 0 2024-05-09T00:07:47.716 INFO:tasks.workunit.client.0.smithi026.stdout:5/494: truncate d2/d8/d31/d32/d5c/f67 1967409 0 2024-05-09T00:07:47.717 INFO:tasks.workunit.client.0.smithi026.stdout:5/495: fsync d2/d8/d31/d2e/d33/f68 0 2024-05-09T00:07:47.719 INFO:tasks.workunit.client.0.smithi026.stdout:8/580: creat de/d17/d21/d24/d5b/fbe x:0 0 0 2024-05-09T00:07:47.720 INFO:tasks.workunit.client.0.smithi026.stdout:7/657: creat d8/d2e/d84/db4/dbc/d1e/feb x:0 0 0 2024-05-09T00:07:47.723 INFO:tasks.workunit.client.0.smithi026.stdout:5/496: creat d2/d8/d31/d2e/d35/fa1 x:0 0 0 2024-05-09T00:07:47.726 INFO:tasks.workunit.client.0.smithi026.stdout:1/553: rename d5/d16/d60/d66/d97/d94/db1/fb4 to d5/dd/d17/fbe 0 2024-05-09T00:07:47.728 INFO:tasks.workunit.client.0.smithi026.stdout:5/497: unlink d2/d8/d31/d24/c69 0 2024-05-09T00:07:47.731 INFO:tasks.workunit.client.0.smithi026.stdout:7/658: rename d8/d2e/d84/db4/dbc/d22/f31 to d8/d2e/d84/db4/dbc/d1e/fec 0 2024-05-09T00:07:47.732 INFO:tasks.workunit.client.0.smithi026.stdout:1/554: mknod d5/dd/d17/d9f/cbf 0 2024-05-09T00:07:47.738 INFO:tasks.workunit.client.0.smithi026.stdout:4/487: dwrite d0/d12/da2/d97/d43/d49/d8f/da3/f7a [0,4194304] 0 2024-05-09T00:07:47.739 INFO:tasks.workunit.client.0.smithi026.stdout:5/498: mkdir d2/d8/d31/d32/da2 0 2024-05-09T00:07:47.739 INFO:tasks.workunit.client.0.smithi026.stdout:7/659: mknod d8/d2e/d84/db4/dbc/d1e/d3d/dca/ced 0 2024-05-09T00:07:47.742 INFO:tasks.workunit.client.0.smithi026.stdout:1/555: rename d5/dd/d17/ca0 to d5/dd/d87/db3/cc0 0 2024-05-09T00:07:47.746 INFO:tasks.workunit.client.0.smithi026.stdout:4/488: truncate d0/d12/d1b/f5f 1882778 0 2024-05-09T00:07:47.747 INFO:tasks.workunit.client.0.smithi026.stdout:5/499: mknod d2/d8/ca3 0 2024-05-09T00:07:47.748 INFO:tasks.workunit.client.0.smithi026.stdout:5/500: write d2/d8/d31/f85 [1455075,106190] 0 2024-05-09T00:07:47.750 INFO:tasks.workunit.client.0.smithi026.stdout:7/660: link d8/d5c/c68 d8/d2e/d84/db4/dbc/cee 0 2024-05-09T00:07:47.750 INFO:tasks.workunit.client.0.smithi026.stdout:7/661: fdatasync d8/d2e/d84/db4/dbc/d1e/d3d/f61 0 2024-05-09T00:07:47.752 INFO:tasks.workunit.client.0.smithi026.stdout:4/489: creat d0/d12/da2/d97/d43/d49/d8f/da3/d66/faf x:0 0 0 2024-05-09T00:07:47.753 INFO:tasks.workunit.client.0.smithi026.stdout:4/490: dread - d0/d12/d64/fab zero size 2024-05-09T00:07:47.753 INFO:tasks.workunit.client.0.smithi026.stdout:4/491: write d0/d12/da2/d97/d43/d49/d8f/da3/f7a [8831869,74486] 0 2024-05-09T00:07:47.753 INFO:tasks.workunit.client.0.smithi026.stdout:4/492: dread - d0/d12/da2/d97/d43/d49/fa0 zero size 2024-05-09T00:07:47.756 INFO:tasks.workunit.client.0.smithi026.stdout:5/501: unlink d2/d8/d31/d24/f62 0 2024-05-09T00:07:47.757 INFO:tasks.workunit.client.0.smithi026.stdout:7/662: creat d8/d1b/d89/fef x:0 0 0 2024-05-09T00:07:47.759 INFO:tasks.workunit.client.0.smithi026.stdout:4/493: creat d0/d12/da2/fb0 x:0 0 0 2024-05-09T00:07:47.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/663: mkdir d8/d2e/d84/db4/dbc/d1e/d8a/df0 0 2024-05-09T00:07:47.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/664: fsync d8/d1b/f34 0 2024-05-09T00:07:47.763 INFO:tasks.workunit.client.0.smithi026.stdout:4/494: creat d0/d12/da2/d97/fb1 x:0 0 0 2024-05-09T00:07:47.763 INFO:tasks.workunit.client.0.smithi026.stdout:4/495: dread - d0/d83/f93 zero size 2024-05-09T00:07:47.767 INFO:tasks.workunit.client.0.smithi026.stdout:7/665: dread d8/d2e/d84/db4/dbc/d1e/f64 [0,4194304] 0 2024-05-09T00:07:47.769 INFO:tasks.workunit.client.0.smithi026.stdout:7/666: creat d8/d2e/d84/db4/ff1 x:0 0 0 2024-05-09T00:07:47.775 INFO:tasks.workunit.client.0.smithi026.stdout:3/439: sync 2024-05-09T00:07:47.775 INFO:tasks.workunit.client.0.smithi026.stdout:3/440: readlink d5/d9/dc/d28/d63/l89 0 2024-05-09T00:07:47.780 INFO:tasks.workunit.client.0.smithi026.stdout:5/502: dwrite d2/d8/d31/d2e/d33/f68 [0,4194304] 0 2024-05-09T00:07:47.781 INFO:tasks.workunit.client.0.smithi026.stdout:5/503: write d2/d8/d6d/f7d [547762,34666] 0 2024-05-09T00:07:47.781 INFO:tasks.workunit.client.0.smithi026.stdout:5/504: fdatasync d2/d8/d31/d2e/f9b 0 2024-05-09T00:07:47.782 INFO:tasks.workunit.client.0.smithi026.stdout:3/441: dread d5/d9/dc/d28/f5e [0,4194304] 0 2024-05-09T00:07:47.783 INFO:tasks.workunit.client.0.smithi026.stdout:9/552: sync 2024-05-09T00:07:47.783 INFO:tasks.workunit.client.0.smithi026.stdout:9/553: truncate d7/d23/d29/d31/d40/d41/d54/d5c/faa 853081 0 2024-05-09T00:07:47.785 INFO:tasks.workunit.client.0.smithi026.stdout:6/359: sync 2024-05-09T00:07:47.785 INFO:tasks.workunit.client.0.smithi026.stdout:6/360: dread - d15/d1e/d30/f72 zero size 2024-05-09T00:07:47.785 INFO:tasks.workunit.client.0.smithi026.stdout:6/361: chown d15/d1e/d23/c2f 277062310 1 2024-05-09T00:07:47.785 INFO:tasks.workunit.client.0.smithi026.stdout:2/437: sync 2024-05-09T00:07:47.787 INFO:tasks.workunit.client.0.smithi026.stdout:5/505: creat d2/d8/d31/fa4 x:0 0 0 2024-05-09T00:07:47.787 INFO:tasks.workunit.client.0.smithi026.stdout:5/506: dread - d2/d8/d31/d32/d48/f9e zero size 2024-05-09T00:07:47.788 INFO:tasks.workunit.client.0.smithi026.stdout:3/442: symlink d5/d9/dc/d28/l94 0 2024-05-09T00:07:47.788 INFO:tasks.workunit.client.0.smithi026.stdout:3/443: chown d5/d9/dc/d28/d2c/f84 29653002 1 2024-05-09T00:07:47.795 INFO:tasks.workunit.client.0.smithi026.stdout:7/667: dwrite d8/d2e/d84/db4/dbc/f50 [0,4194304] 0 2024-05-09T00:07:47.795 INFO:tasks.workunit.client.0.smithi026.stdout:1/556: dwrite d5/dd/d1f/fbb [0,4194304] 0 2024-05-09T00:07:47.799 INFO:tasks.workunit.client.0.smithi026.stdout:9/554: symlink d7/d23/d29/d31/d40/d41/d54/d5c/d66/lc9 0 2024-05-09T00:07:47.799 INFO:tasks.workunit.client.0.smithi026.stdout:6/362: write f1 [6930484,119960] 0 2024-05-09T00:07:47.802 INFO:tasks.workunit.client.0.smithi026.stdout:2/438: creat d14/d15/d30/d6a/d5f/f9e x:0 0 0 2024-05-09T00:07:47.805 INFO:tasks.workunit.client.0.smithi026.stdout:5/507: link d2/d8/d31/d24/f7b d2/d5a/d96/fa5 0 2024-05-09T00:07:47.810 INFO:tasks.workunit.client.0.smithi026.stdout:3/444: mkdir d5/d9/d4a/d95 0 2024-05-09T00:07:47.813 INFO:tasks.workunit.client.0.smithi026.stdout:4/496: dwrite d0/fe [0,4194304] 0 2024-05-09T00:07:47.820 INFO:tasks.workunit.client.0.smithi026.stdout:4/497: dread d0/d12/d1b/f74 [0,4194304] 0 2024-05-09T00:07:47.821 INFO:tasks.workunit.client.0.smithi026.stdout:7/668: creat d8/d5c/ff2 x:0 0 0 2024-05-09T00:07:47.821 INFO:tasks.workunit.client.0.smithi026.stdout:7/669: chown d8/d2e/d84/db4/dbc/d1e 109183 1 2024-05-09T00:07:47.823 INFO:tasks.workunit.client.0.smithi026.stdout:9/555: rmdir d7/d26/dc1 0 2024-05-09T00:07:47.826 INFO:tasks.workunit.client.0.smithi026.stdout:6/363: rename d15/d1e/d23/d26 to d15/d1e/d23/d73 0 2024-05-09T00:07:47.829 INFO:tasks.workunit.client.0.smithi026.stdout:3/445: creat d5/d9/d4a/d77/f96 x:0 0 0 2024-05-09T00:07:47.830 INFO:tasks.workunit.client.0.smithi026.stdout:6/364: dread d15/d34/f53 [0,4194304] 0 2024-05-09T00:07:47.833 INFO:tasks.workunit.client.0.smithi026.stdout:2/439: dwrite d14/d22/f33 [0,4194304] 0 2024-05-09T00:07:47.833 INFO:tasks.workunit.client.0.smithi026.stdout:2/440: write f9 [4786341,74357] 0 2024-05-09T00:07:47.835 INFO:tasks.workunit.client.0.smithi026.stdout:4/498: link d0/d12/da2/d97/f57 d0/d83/fb2 0 2024-05-09T00:07:47.836 INFO:tasks.workunit.client.0.smithi026.stdout:4/499: write d0/f22 [606461,45175] 0 2024-05-09T00:07:47.836 INFO:tasks.workunit.client.0.smithi026.stdout:7/670: creat d8/d2e/d84/ff3 x:0 0 0 2024-05-09T00:07:47.838 INFO:tasks.workunit.client.0.smithi026.stdout:5/508: dwrite d2/d8/d31/d63/f9d [0,4194304] 0 2024-05-09T00:07:47.840 INFO:tasks.workunit.client.0.smithi026.stdout:9/556: creat d7/d26/fca x:0 0 0 2024-05-09T00:07:47.844 INFO:tasks.workunit.client.0.smithi026.stdout:6/365: truncate d15/d1e/d23/f24 3664844 0 2024-05-09T00:07:47.849 INFO:tasks.workunit.client.0.smithi026.stdout:7/671: rename d8/d2e/d84/db4/de5 to d8/d5c/d9a/df4 0 2024-05-09T00:07:47.849 INFO:tasks.workunit.client.0.smithi026.stdout:7/672: chown d8/d5c/fbd 21913 1 2024-05-09T00:07:47.853 INFO:tasks.workunit.client.0.smithi026.stdout:5/509: creat d2/d8/d31/d63/fa6 x:0 0 0 2024-05-09T00:07:47.861 INFO:tasks.workunit.client.0.smithi026.stdout:5/510: dread d2/d8/d31/d2e/f98 [0,4194304] 0 2024-05-09T00:07:47.869 INFO:tasks.workunit.client.0.smithi026.stdout:3/446: symlink d5/l97 0 2024-05-09T00:07:47.871 INFO:tasks.workunit.client.0.smithi026.stdout:6/366: mkdir d15/d34/d52/d74 0 2024-05-09T00:07:47.875 INFO:tasks.workunit.client.0.smithi026.stdout:7/673: mkdir d8/d2e/d84/db4/dbc/d1e/d8a/df5 0 2024-05-09T00:07:47.876 INFO:tasks.workunit.client.0.smithi026.stdout:3/447: unlink d5/l15 0 2024-05-09T00:07:47.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/441: dwrite f9 [4194304,4194304] 0 2024-05-09T00:07:47.878 INFO:tasks.workunit.client.0.smithi026.stdout:7/674: mknod d8/d2e/d84/db4/dbc/d1e/d8a/df5/cf6 0 2024-05-09T00:07:47.879 INFO:tasks.workunit.client.0.smithi026.stdout:3/448: read d5/d9/dc/d5d/f7d [140089,8425] 0 2024-05-09T00:07:47.884 INFO:tasks.workunit.client.0.smithi026.stdout:2/442: stat d14/d15/d30/d6a/d5f/l97 0 2024-05-09T00:07:47.884 INFO:tasks.workunit.client.0.smithi026.stdout:2/443: chown d14/d15/d30/d6a/f81 3319 1 2024-05-09T00:07:47.885 INFO:tasks.workunit.client.0.smithi026.stdout:7/675: creat d8/d1b/ff7 x:0 0 0 2024-05-09T00:07:47.885 INFO:tasks.workunit.client.0.smithi026.stdout:7/676: chown d8/d2e/d84/db4/dbc/d1e/d3d 13 1 2024-05-09T00:07:47.885 INFO:tasks.workunit.client.0.smithi026.stdout:7/677: truncate d8/d2e/d84/db4/dbc/d1e/f43 4766478 0 2024-05-09T00:07:47.885 INFO:tasks.workunit.client.0.smithi026.stdout:7/678: chown d8/d2e/d84/db4/dbc/d22/l33 30 1 2024-05-09T00:07:47.885 INFO:tasks.workunit.client.0.smithi026.stdout:7/679: write d8/d2e/d84/db4/dbc/d22/fe2 [786761,118774] 0 2024-05-09T00:07:47.887 INFO:tasks.workunit.client.0.smithi026.stdout:3/449: mknod d5/d9/dc/d5b/c98 0 2024-05-09T00:07:47.888 INFO:tasks.workunit.client.0.smithi026.stdout:2/444: creat d14/d22/d55/f9f x:0 0 0 2024-05-09T00:07:47.888 INFO:tasks.workunit.client.0.smithi026.stdout:2/445: write d14/d15/d3b/f9b [944632,60457] 0 2024-05-09T00:07:47.890 INFO:tasks.workunit.client.0.smithi026.stdout:7/680: getdents d8/d2e/d84/db4/dbc/d1e/d3d 0 2024-05-09T00:07:47.892 INFO:tasks.workunit.client.0.smithi026.stdout:3/450: creat d5/d9/dc/d28/d63/d81/f99 x:0 0 0 2024-05-09T00:07:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/451: chown d5/d9/dc/d5d 59181824 1 2024-05-09T00:07:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/452: truncate d5/d9/dc/f70 5985935 0 2024-05-09T00:07:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/453: truncate d5/d9/dc/d28/d63/f66 57232 0 2024-05-09T00:07:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/454: getdents d5/d9/d71 0 2024-05-09T00:07:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/455: chown d5/d41/f47 775533 1 2024-05-09T00:07:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/456: stat d5/d9/d4a/d5f/d6f/d75/f7c 0 2024-05-09T00:07:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/457: fsync f0 0 2024-05-09T00:07:47.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/458: write d5/d9/f42 [557798,89169] 0 2024-05-09T00:07:47.895 INFO:tasks.workunit.client.0.smithi026.stdout:2/446: symlink d14/d15/d30/d6a/d5f/la0 0 2024-05-09T00:07:47.896 INFO:tasks.workunit.client.0.smithi026.stdout:7/681: creat d8/d2e/d84/db4/dbc/d1e/d3d/ff8 x:0 0 0 2024-05-09T00:07:47.898 INFO:tasks.workunit.client.0.smithi026.stdout:3/459: getdents d5/d1e 0 2024-05-09T00:07:47.904 INFO:tasks.workunit.client.0.smithi026.stdout:6/367: dwrite d15/d1e/d30/f46 [0,4194304] 0 2024-05-09T00:07:47.937 INFO:tasks.workunit.client.0.smithi026.stdout:6/368: dwrite f4 [0,4194304] 0 2024-05-09T00:07:47.937 INFO:tasks.workunit.client.0.smithi026.stdout:6/369: chown d15/d1e/d30/l38 18987390 1 2024-05-09T00:07:48.027 INFO:tasks.workunit.client.0.smithi026.stdout:2/447: symlink d14/d22/la1 0 2024-05-09T00:07:48.032 INFO:tasks.workunit.client.0.smithi026.stdout:3/460: rmdir d5/d9/d49 39 2024-05-09T00:07:48.032 INFO:tasks.workunit.client.0.smithi026.stdout:3/461: chown d5/d9/d4a/d77 76114 1 2024-05-09T00:07:48.036 INFO:tasks.workunit.client.0.smithi026.stdout:6/370: getdents d15 0 2024-05-09T00:07:48.046 INFO:tasks.workunit.client.0.smithi026.stdout:2/448: dwrite d14/d22/f7d [0,4194304] 0 2024-05-09T00:07:48.049 INFO:tasks.workunit.client.0.smithi026.stdout:7/682: rename d8/d2e/d84/db4/dbc/d1e/d3d/l3f to d8/d5c/d9a/df4/lf9 0 2024-05-09T00:07:48.050 INFO:tasks.workunit.client.0.smithi026.stdout:3/462: mknod d5/d9/d4a/d5f/c9a 0 2024-05-09T00:07:48.052 INFO:tasks.workunit.client.0.smithi026.stdout:6/371: mkdir d15/d1e/d30/d75 0 2024-05-09T00:07:48.056 INFO:tasks.workunit.client.0.smithi026.stdout:2/449: creat d14/d15/d20/fa2 x:0 0 0 2024-05-09T00:07:48.056 INFO:tasks.workunit.client.0.smithi026.stdout:2/450: dread - d14/d15/f92 zero size 2024-05-09T00:07:48.056 INFO:tasks.workunit.client.0.smithi026.stdout:2/451: read - d14/d15/d30/d6a/d5f/f9e zero size 2024-05-09T00:07:48.057 INFO:tasks.workunit.client.0.smithi026.stdout:7/683: truncate d8/d1b/f37 3719224 0 2024-05-09T00:07:48.060 INFO:tasks.workunit.client.0.smithi026.stdout:3/463: unlink d5/d9/f56 0 2024-05-09T00:07:48.060 INFO:tasks.workunit.client.0.smithi026.stdout:3/464: write d5/d9/dc/d28/f4c [4406541,98572] 0 2024-05-09T00:07:48.061 INFO:tasks.workunit.client.0.smithi026.stdout:6/372: mkdir d15/d1e/d23/d73/d76 0 2024-05-09T00:07:48.065 INFO:tasks.workunit.client.0.smithi026.stdout:9/557: rmdir d7/d23/d29 39 2024-05-09T00:07:48.067 INFO:tasks.workunit.client.0.smithi026.stdout:3/465: truncate d5/d9/dc/f31 2198097 0 2024-05-09T00:07:48.067 INFO:tasks.workunit.client.0.smithi026.stdout:3/466: chown d5/l97 28 1 2024-05-09T00:07:48.068 INFO:tasks.workunit.client.0.smithi026.stdout:6/373: creat d15/f77 x:0 0 0 2024-05-09T00:07:48.069 INFO:tasks.workunit.client.0.smithi026.stdout:6/374: dread - d15/f77 zero size 2024-05-09T00:07:48.072 INFO:tasks.workunit.client.0.smithi026.stdout:7/684: dwrite d8/d2e/d84/fe3 [0,4194304] 0 2024-05-09T00:07:48.074 INFO:tasks.workunit.client.0.smithi026.stdout:9/558: mknod d7/d23/d29/d31/d40/d41/d54/d5c/d66/ccb 0 2024-05-09T00:07:48.075 INFO:tasks.workunit.client.0.smithi026.stdout:9/559: readlink d7/d23/d2f/l69 0 2024-05-09T00:07:48.077 INFO:tasks.workunit.client.0.smithi026.stdout:3/467: symlink d5/d9/l9b 0 2024-05-09T00:07:48.078 INFO:tasks.workunit.client.0.smithi026.stdout:6/375: symlink d15/d62/l78 0 2024-05-09T00:07:48.081 INFO:tasks.workunit.client.0.smithi026.stdout:9/560: creat d7/d23/d29/d59/d91/fcc x:0 0 0 2024-05-09T00:07:48.081 INFO:tasks.workunit.client.0.smithi026.stdout:9/561: dread - d7/d23/d29/d59/fbf zero size 2024-05-09T00:07:48.083 INFO:tasks.workunit.client.0.smithi026.stdout:6/376: symlink d15/d1e/d23/d73/d76/l79 0 2024-05-09T00:07:48.083 INFO:tasks.workunit.client.0.smithi026.stdout:6/377: fsync d15/d1e/d23/d73/f27 0 2024-05-09T00:07:48.085 INFO:tasks.workunit.client.0.smithi026.stdout:9/562: creat d7/d23/d29/d31/d40/d41/d54/d9a/fcd x:0 0 0 2024-05-09T00:07:48.086 INFO:tasks.workunit.client.0.smithi026.stdout:7/685: dwrite d8/d1b/d89/fef [0,4194304] 0 2024-05-09T00:07:48.086 INFO:tasks.workunit.client.0.smithi026.stdout:6/378: mknod d15/d34/d52/c7a 0 2024-05-09T00:07:48.086 INFO:tasks.workunit.client.0.smithi026.stdout:6/379: truncate d15/d1e/d3d/f70 694173 0 2024-05-09T00:07:48.090 INFO:tasks.workunit.client.0.smithi026.stdout:7/686: mknod d8/d1b/d89/dc1/db0/cfa 0 2024-05-09T00:07:48.090 INFO:tasks.workunit.client.0.smithi026.stdout:7/687: dread - d8/d5c/fd7 zero size 2024-05-09T00:07:48.090 INFO:tasks.workunit.client.0.smithi026.stdout:7/688: fdatasync d8/d2e/d84/fe3 0 2024-05-09T00:07:48.090 INFO:tasks.workunit.client.0.smithi026.stdout:7/689: creat d8/d1b/d89/dc1/dd0/ffb x:0 0 0 2024-05-09T00:07:48.091 INFO:tasks.workunit.client.0.smithi026.stdout:7/690: write d8/d2e/d84/db4/dbc/d1e/f93 [3389808,44944] 0 2024-05-09T00:07:48.096 INFO:tasks.workunit.client.0.smithi026.stdout:7/691: unlink d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/c91 0 2024-05-09T00:07:48.097 INFO:tasks.workunit.client.0.smithi026.stdout:7/692: fdatasync d8/d2e/d84/db4/dbc/d1e/d3d/dca/fda 0 2024-05-09T00:07:48.097 INFO:tasks.workunit.client.0.smithi026.stdout:7/693: stat d8/d5c/fcb 0 2024-05-09T00:07:48.098 INFO:tasks.workunit.client.0.smithi026.stdout:6/380: dread f1 [0,4194304] 0 2024-05-09T00:07:48.099 INFO:tasks.workunit.client.0.smithi026.stdout:7/694: mknod d8/d2e/d84/db4/dbc/d1e/d8a/df0/cfc 0 2024-05-09T00:07:48.102 INFO:tasks.workunit.client.0.smithi026.stdout:6/381: creat d15/d2b/d33/d55/d67/f7b x:0 0 0 2024-05-09T00:07:48.103 INFO:tasks.workunit.client.0.smithi026.stdout:7/695: creat d8/d2e/d84/db4/dbc/ffd x:0 0 0 2024-05-09T00:07:48.105 INFO:tasks.workunit.client.0.smithi026.stdout:7/696: mkdir d8/d1b/dfe 0 2024-05-09T00:07:48.107 INFO:tasks.workunit.client.0.smithi026.stdout:6/382: dread d15/d1e/d3d/f70 [0,4194304] 0 2024-05-09T00:07:48.109 INFO:tasks.workunit.client.0.smithi026.stdout:7/697: unlink d8/d2e/d84/db4/dbc/d1e/d3d/d6b/fb9 0 2024-05-09T00:07:48.112 INFO:tasks.workunit.client.0.smithi026.stdout:7/698: getdents d8/d1b/d89/d8d 0 2024-05-09T00:07:48.114 INFO:tasks.workunit.client.0.smithi026.stdout:7/699: chown d8/d2e/d84/db4/dbc/d1e/d3d/ca4 1541956 1 2024-05-09T00:07:48.114 INFO:tasks.workunit.client.0.smithi026.stdout:7/700: fsync d8/d2e/d84/db4/dbc/f52 0 2024-05-09T00:07:48.114 INFO:tasks.workunit.client.0.smithi026.stdout:7/701: read - d8/d5c/f99 zero size 2024-05-09T00:07:48.114 INFO:tasks.workunit.client.0.smithi026.stdout:7/702: write d8/d2e/d84/db4/dbc/f52 [2721586,40989] 0 2024-05-09T00:07:48.116 INFO:tasks.workunit.client.0.smithi026.stdout:7/703: write d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/fa8 [1155919,123814] 0 2024-05-09T00:07:48.116 INFO:tasks.workunit.client.0.smithi026.stdout:7/704: write d8/d2e/f3c [8573848,1650] 0 2024-05-09T00:07:48.116 INFO:tasks.workunit.client.0.smithi026.stdout:7/705: readlink d8/d2e/d84/db4/dbc/d22/l33 0 2024-05-09T00:07:48.116 INFO:tasks.workunit.client.0.smithi026.stdout:7/706: readlink d8/d2e/d84/le0 0 2024-05-09T00:07:48.134 INFO:tasks.workunit.client.0.smithi026.stdout:2/452: rename d14/d15 to d14/d22/d55/da3 0 2024-05-09T00:07:48.135 INFO:tasks.workunit.client.0.smithi026.stdout:2/453: fsync d14/f18 0 2024-05-09T00:07:48.135 INFO:tasks.workunit.client.0.smithi026.stdout:2/454: write d14/d22/d55/da3/d30/d6a/f63 [548599,84803] 0 2024-05-09T00:07:48.137 INFO:tasks.workunit.client.0.smithi026.stdout:3/468: rename d5/d41/f47 to d5/d9/d71/f9c 0 2024-05-09T00:07:48.139 INFO:tasks.workunit.client.0.smithi026.stdout:2/455: rmdir d14/d22/d55/da3/d30/d6a 39 2024-05-09T00:07:48.139 INFO:tasks.workunit.client.0.smithi026.stdout:2/456: readlink d14/d22/d55/da3/d3b/l49 0 2024-05-09T00:07:48.142 INFO:tasks.workunit.client.0.smithi026.stdout:2/457: dread d14/d22/d55/d6b/f7f [0,4194304] 0 2024-05-09T00:07:48.144 INFO:tasks.workunit.client.0.smithi026.stdout:3/469: truncate d5/d1e/f20 291294 0 2024-05-09T00:07:48.144 INFO:tasks.workunit.client.0.smithi026.stdout:3/470: chown d5/d1e/d7b/l8c 15084 1 2024-05-09T00:07:48.147 INFO:tasks.workunit.client.0.smithi026.stdout:9/563: rename d7/d23/cb1 to d7/d23/d2f/d50/cce 0 2024-05-09T00:07:48.147 INFO:tasks.workunit.client.0.smithi026.stdout:9/564: readlink d7/d23/d29/d31/d40/l46 0 2024-05-09T00:07:48.147 INFO:tasks.workunit.client.0.smithi026.stdout:9/565: fdatasync d7/d23/d76/fb8 0 2024-05-09T00:07:48.147 INFO:tasks.workunit.client.0.smithi026.stdout:9/566: chown d7/l15 3114405 1 2024-05-09T00:07:48.150 INFO:tasks.workunit.client.0.smithi026.stdout:9/567: rename d7/d23/d29/d31/d40/lc2 to d7/d23/lcf 0 2024-05-09T00:07:48.151 INFO:tasks.workunit.client.0.smithi026.stdout:3/471: dread d5/d1e/d3e/f86 [0,4194304] 0 2024-05-09T00:07:48.151 INFO:tasks.workunit.client.0.smithi026.stdout:3/472: truncate d5/d9/dc/d5d/f76 833128 0 2024-05-09T00:07:48.161 INFO:tasks.workunit.client.0.smithi026.stdout:3/473: dread d5/d9/f5a [0,4194304] 0 2024-05-09T00:07:48.165 INFO:tasks.workunit.client.0.smithi026.stdout:3/474: creat d5/d1e/d7b/f9d x:0 0 0 2024-05-09T00:07:48.169 INFO:tasks.workunit.client.0.smithi026.stdout:3/475: rmdir d5/d9/dc/d28/d63/d81 39 2024-05-09T00:07:48.169 INFO:tasks.workunit.client.0.smithi026.stdout:3/476: chown d5/d9/dc/d28/d45 9 1 2024-05-09T00:07:48.171 INFO:tasks.workunit.client.0.smithi026.stdout:9/568: dread d7/f9 [0,4194304] 0 2024-05-09T00:07:48.172 INFO:tasks.workunit.client.0.smithi026.stdout:9/569: truncate d7/d23/d2f/d3a/f55 1259922 0 2024-05-09T00:07:48.173 INFO:tasks.workunit.client.0.smithi026.stdout:9/570: creat d7/d23/d29/d31/fd0 x:0 0 0 2024-05-09T00:07:48.174 INFO:tasks.workunit.client.0.smithi026.stdout:2/458: dwrite d14/d22/d55/da3/d30/d6a/f63 [0,4194304] 0 2024-05-09T00:07:48.174 INFO:tasks.workunit.client.0.smithi026.stdout:2/459: chown d14/d22/d55/da3/d20/f23 8 1 2024-05-09T00:07:48.176 INFO:tasks.workunit.client.0.smithi026.stdout:2/460: write d14/f18 [3905519,12937] 0 2024-05-09T00:07:48.176 INFO:tasks.workunit.client.0.smithi026.stdout:2/461: chown d14/d22/d55/da3/d3b/d40/d47 1771 1 2024-05-09T00:07:48.177 INFO:tasks.workunit.client.0.smithi026.stdout:9/571: mknod d7/d23/d2f/d50/cd1 0 2024-05-09T00:07:48.177 INFO:tasks.workunit.client.0.smithi026.stdout:9/572: write d7/d23/d29/d59/d91/f92 [692050,16089] 0 2024-05-09T00:07:48.177 INFO:tasks.workunit.client.0.smithi026.stdout:2/462: creat d14/d22/d55/da3/d20/d41/d51/fa4 x:0 0 0 2024-05-09T00:07:48.191 INFO:tasks.workunit.client.0.smithi026.stdout:3/477: dwrite d5/d9/dc/d28/d2c/f6a [0,4194304] 0 2024-05-09T00:07:48.192 INFO:tasks.workunit.client.0.smithi026.stdout:3/478: write d5/d9/ff [5641216,53816] 0 2024-05-09T00:07:48.192 INFO:tasks.workunit.client.0.smithi026.stdout:3/479: chown d5/la 60382825 1 2024-05-09T00:07:48.192 INFO:tasks.workunit.client.0.smithi026.stdout:3/480: write d5/d41/f43 [4451604,41974] 0 2024-05-09T00:07:48.192 INFO:tasks.workunit.client.0.smithi026.stdout:2/463: rmdir d14 39 2024-05-09T00:07:48.193 INFO:tasks.workunit.client.0.smithi026.stdout:9/573: dwrite d7/d23/d2f/d50/fb9 [0,4194304] 0 2024-05-09T00:07:48.193 INFO:tasks.workunit.client.0.smithi026.stdout:2/464: mkdir d14/d22/d55/d6b/da5 0 2024-05-09T00:07:48.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/574: getdents d7/d23/d29/d31/d40 0 2024-05-09T00:07:48.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/575: readlink d7/d23/d76/l88 0 2024-05-09T00:07:48.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/576: fdatasync d7/d23/d2f/f35 0 2024-05-09T00:07:48.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/577: write d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc/fc6 [547691,38840] 0 2024-05-09T00:07:48.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/578: write d7/d23/d2f/d7d/d87/faf [285336,53180] 0 2024-05-09T00:07:48.200 INFO:tasks.workunit.client.0.smithi026.stdout:2/465: truncate fb 4793246 0 2024-05-09T00:07:48.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/579: dread d7/d23/d29/d59/f5f [0,4194304] 0 2024-05-09T00:07:48.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/580: chown d7/d23/d29/d59/fbf 26432 1 2024-05-09T00:07:48.203 INFO:tasks.workunit.client.0.smithi026.stdout:9/581: symlink d7/d23/d2f/d3a/ld2 0 2024-05-09T00:07:48.207 INFO:tasks.workunit.client.0.smithi026.stdout:2/466: dread d14/d22/d55/da3/d20/f23 [0,4194304] 0 2024-05-09T00:07:48.222 INFO:tasks.workunit.client.0.smithi026.stdout:2/467: dwrite d14/d22/d55/f9f [0,4194304] 0 2024-05-09T00:07:48.222 INFO:tasks.workunit.client.0.smithi026.stdout:2/468: chown d14/d22/d55/da3/d17/c45 5 1 2024-05-09T00:07:48.226 INFO:tasks.workunit.client.0.smithi026.stdout:2/469: dread d14/d22/d55/da3/f39 [0,4194304] 0 2024-05-09T00:07:48.228 INFO:tasks.workunit.client.0.smithi026.stdout:2/470: write d14/d22/d55/da3/f26 [1722520,47828] 0 2024-05-09T00:07:48.228 INFO:tasks.workunit.client.0.smithi026.stdout:2/471: dread - d14/d22/d55/da3/d30/d6a/d5f/f9e zero size 2024-05-09T00:07:48.238 INFO:tasks.workunit.client.0.smithi026.stdout:2/472: dread d14/d22/d55/da3/f26 [0,4194304] 0 2024-05-09T00:07:48.239 INFO:tasks.workunit.client.0.smithi026.stdout:2/473: symlink d14/d22/d55/da3/d1f/la6 0 2024-05-09T00:07:48.240 INFO:tasks.workunit.client.0.smithi026.stdout:2/474: write d14/d22/d55/f67 [1469851,21329] 0 2024-05-09T00:07:48.240 INFO:tasks.workunit.client.0.smithi026.stdout:2/475: read d14/d22/f33 [1691183,363] 0 2024-05-09T00:07:48.240 INFO:tasks.workunit.client.0.smithi026.stdout:2/476: fdatasync d14/d22/d55/da3/d20/d41/d51/f94 0 2024-05-09T00:07:48.248 INFO:tasks.workunit.client.0.smithi026.stdout:2/477: dread d14/d22/d55/f67 [0,4194304] 0 2024-05-09T00:07:48.249 INFO:tasks.workunit.client.0.smithi026.stdout:2/478: fsync d14/d22/d55/d6b/f7f 0 2024-05-09T00:07:48.250 INFO:tasks.workunit.client.0.smithi026.stdout:2/479: dread d14/d22/d55/da3/f39 [0,4194304] 0 2024-05-09T00:07:48.253 INFO:tasks.workunit.client.0.smithi026.stdout:2/480: link d14/d22/d55/da3/d3b/c3c d14/d22/d55/d6b/da5/ca7 0 2024-05-09T00:07:48.282 INFO:tasks.workunit.client.0.smithi026.stdout:0/624: sync 2024-05-09T00:07:48.282 INFO:tasks.workunit.client.0.smithi026.stdout:5/511: sync 2024-05-09T00:07:48.282 INFO:tasks.workunit.client.0.smithi026.stdout:1/557: sync 2024-05-09T00:07:48.282 INFO:tasks.workunit.client.0.smithi026.stdout:8/581: sync 2024-05-09T00:07:48.282 INFO:tasks.workunit.client.0.smithi026.stdout:4/500: sync 2024-05-09T00:07:48.282 INFO:tasks.workunit.client.0.smithi026.stdout:0/625: chown d1d/d1e/d20/d4d/d58/d62/d78 263129982 1 2024-05-09T00:07:48.283 INFO:tasks.workunit.client.0.smithi026.stdout:8/582: readlink de/d17/d21/d24/d3b/la0 0 2024-05-09T00:07:48.283 INFO:tasks.workunit.client.0.smithi026.stdout:4/501: dread - d0/d12/da2/d97/d43/d49/d8f/da3/f5e zero size 2024-05-09T00:07:48.285 INFO:tasks.workunit.client.0.smithi026.stdout:5/512: getdents d2/d8/d31/d2e/d4a 0 2024-05-09T00:07:48.285 INFO:tasks.workunit.client.0.smithi026.stdout:5/513: truncate d2/d5a/d96/f93 284830 0 2024-05-09T00:07:48.288 INFO:tasks.workunit.client.0.smithi026.stdout:4/502: mkdir d0/d12/da2/d97/d43/d58/db3 0 2024-05-09T00:07:48.289 INFO:tasks.workunit.client.0.smithi026.stdout:8/583: creat de/d17/d21/d24/d5b/fbf x:0 0 0 2024-05-09T00:07:48.292 INFO:tasks.workunit.client.0.smithi026.stdout:5/514: symlink d2/d8/d6d/la7 0 2024-05-09T00:07:48.292 INFO:tasks.workunit.client.0.smithi026.stdout:5/515: readlink d2/d8/d31/d2e/d4a/l82 0 2024-05-09T00:07:48.292 INFO:tasks.workunit.client.0.smithi026.stdout:5/516: truncate d2/d8/d31/d2e/d33/f7f 997771 0 2024-05-09T00:07:48.294 INFO:tasks.workunit.client.0.smithi026.stdout:4/503: creat d0/d12/d1b/d4e/d92/fb4 x:0 0 0 2024-05-09T00:07:48.295 INFO:tasks.workunit.client.0.smithi026.stdout:4/504: stat d0/c55 0 2024-05-09T00:07:48.296 INFO:tasks.workunit.client.0.smithi026.stdout:4/505: readlink d0/d12/da2/d97/d8c/l8d 0 2024-05-09T00:07:48.297 INFO:tasks.workunit.client.0.smithi026.stdout:4/506: rename d0/d12/da2/d97/d43/d49/f7c to d0/d12/d64/dac/fb5 0 2024-05-09T00:07:48.299 INFO:tasks.workunit.client.0.smithi026.stdout:4/507: mknod d0/d12/da2/d97/d43/cb6 0 2024-05-09T00:07:48.299 INFO:tasks.workunit.client.0.smithi026.stdout:4/508: write d0/d12/d1b/f51 [724221,36690] 0 2024-05-09T00:07:48.299 INFO:tasks.workunit.client.0.smithi026.stdout:4/509: write d0/d12/f13 [1667349,81247] 0 2024-05-09T00:07:48.300 INFO:tasks.workunit.client.0.smithi026.stdout:4/510: truncate d0/d12/da2/d97/d43/f44 1996156 0 2024-05-09T00:07:48.301 INFO:tasks.workunit.client.0.smithi026.stdout:4/511: unlink d0/d12/da2/d97/d43/d49/d8f/da3/la1 0 2024-05-09T00:07:48.307 INFO:tasks.workunit.client.0.smithi026.stdout:4/512: read d0/f9 [6357103,98426] 0 2024-05-09T00:07:48.308 INFO:tasks.workunit.client.0.smithi026.stdout:5/517: dread d2/d8/d31/d2e/d33/f68 [0,4194304] 0 2024-05-09T00:07:48.309 INFO:tasks.workunit.client.0.smithi026.stdout:8/584: dwrite de/d48/f52 [0,4194304] 0 2024-05-09T00:07:48.309 INFO:tasks.workunit.client.0.smithi026.stdout:8/585: chown de/d17/d21/l5c 1 1 2024-05-09T00:07:48.309 INFO:tasks.workunit.client.0.smithi026.stdout:4/513: creat d0/d12/da2/d97/d43/d49/fb7 x:0 0 0 2024-05-09T00:07:48.310 INFO:tasks.workunit.client.0.smithi026.stdout:0/626: dwrite d1d/d33/f61 [0,4194304] 0 2024-05-09T00:07:48.311 INFO:tasks.workunit.client.0.smithi026.stdout:4/514: dread d0/d12/d1b/d4e/f9a [0,4194304] 0 2024-05-09T00:07:48.318 INFO:tasks.workunit.client.0.smithi026.stdout:0/627: dread d1d/d25/d47/fb9 [0,4194304] 0 2024-05-09T00:07:48.319 INFO:tasks.workunit.client.0.smithi026.stdout:1/558: dwrite d5/dd/f49 [0,4194304] 0 2024-05-09T00:07:48.319 INFO:tasks.workunit.client.0.smithi026.stdout:1/559: write d5/dd/d17/d7b/f9c [863576,17090] 0 2024-05-09T00:07:48.319 INFO:tasks.workunit.client.0.smithi026.stdout:1/560: readlink d5/dd/d17/d7b/l96 0 2024-05-09T00:07:48.319 INFO:tasks.workunit.client.0.smithi026.stdout:1/561: chown d5/dd/d17/d7b/d9b 79548904 1 2024-05-09T00:07:48.325 INFO:tasks.workunit.client.0.smithi026.stdout:1/562: dread d5/db/f62 [0,4194304] 0 2024-05-09T00:07:48.338 INFO:tasks.workunit.client.0.smithi026.stdout:1/563: dwrite d5/dd/d1f/f7c [0,4194304] 0 2024-05-09T00:07:48.338 INFO:tasks.workunit.client.0.smithi026.stdout:1/564: write d5/d16/f18 [4207896,53339] 0 2024-05-09T00:07:48.388 INFO:tasks.workunit.client.0.smithi026.stdout:5/518: unlink d2/d8/d2a/l6f 0 2024-05-09T00:07:48.389 INFO:tasks.workunit.client.0.smithi026.stdout:8/586: creat de/d6c/d31/fc0 x:0 0 0 2024-05-09T00:07:48.396 INFO:tasks.workunit.client.0.smithi026.stdout:4/515: mkdir d0/d12/da2/db8 0 2024-05-09T00:07:48.398 INFO:tasks.workunit.client.0.smithi026.stdout:0/628: rename d1d/d1e/d20/d4d/d83/d9e to d1d/d1e/d20/d4d/d83/da0/dd2 0 2024-05-09T00:07:48.398 INFO:tasks.workunit.client.0.smithi026.stdout:0/629: dread - d1d/fbe zero size 2024-05-09T00:07:48.405 INFO:tasks.workunit.client.0.smithi026.stdout:0/630: dread d1d/d25/d47/f85 [0,4194304] 0 2024-05-09T00:07:48.409 INFO:tasks.workunit.client.0.smithi026.stdout:5/519: creat d2/d8/d31/d2e/d35/fa8 x:0 0 0 2024-05-09T00:07:48.410 INFO:tasks.workunit.client.0.smithi026.stdout:5/520: write d2/d8/d6d/f7d [146791,59312] 0 2024-05-09T00:07:48.412 INFO:tasks.workunit.client.0.smithi026.stdout:1/565: rename d5/dd/d1f/f8f to d5/dd/d17/d9f/da5/fc1 0 2024-05-09T00:07:48.412 INFO:tasks.workunit.client.0.smithi026.stdout:5/521: write d2/d8/d31/d24/f7b [1902924,116614] 0 2024-05-09T00:07:48.412 INFO:tasks.workunit.client.0.smithi026.stdout:5/522: write d2/d5a/d96/fa5 [5103754,13871] 0 2024-05-09T00:07:48.412 INFO:tasks.workunit.client.0.smithi026.stdout:5/523: read d2/d8/d31/d32/d5c/f67 [1405051,125507] 0 2024-05-09T00:07:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:0/631: rmdir d1d/d1e/d20/d4d/d58/d62/d84 39 2024-05-09T00:07:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:8/587: rename de/d17/d21/d24/d3b/d3d/f40 to de/d6c/d31/d4f/fc1 0 2024-05-09T00:07:48.421 INFO:tasks.workunit.client.0.smithi026.stdout:1/566: mkdir d5/d16/d60/d66/d97/d94/db1/dc2 0 2024-05-09T00:07:48.422 INFO:tasks.workunit.client.0.smithi026.stdout:0/632: dread d1d/d1e/d20/d4d/f6f [0,4194304] 0 2024-05-09T00:07:48.423 INFO:tasks.workunit.client.0.smithi026.stdout:1/567: dread d5/dd/d1f/d39/f8e [0,4194304] 0 2024-05-09T00:07:48.426 INFO:tasks.workunit.client.0.smithi026.stdout:5/524: creat d2/d8/d31/d2e/d35/fa9 x:0 0 0 2024-05-09T00:07:48.426 INFO:tasks.workunit.client.0.smithi026.stdout:5/525: truncate d2/d8/d31/d24/f7b 5895298 0 2024-05-09T00:07:48.430 INFO:tasks.workunit.client.0.smithi026.stdout:4/516: rename d0/d12/d1b/f26 to d0/d12/da2/d97/d43/d49/d8f/da3/d66/fb9 0 2024-05-09T00:07:48.431 INFO:tasks.workunit.client.0.smithi026.stdout:0/633: creat d1d/d33/d64/fd3 x:0 0 0 2024-05-09T00:07:48.434 INFO:tasks.workunit.client.0.smithi026.stdout:1/568: creat d5/db/d1d/dae/fc3 x:0 0 0 2024-05-09T00:07:48.435 INFO:tasks.workunit.client.0.smithi026.stdout:8/588: dwrite de/d48/d3e/d54/f79 [0,4194304] 0 2024-05-09T00:07:48.436 INFO:tasks.workunit.client.0.smithi026.stdout:8/589: read - de/d17/d21/d6f/f93 zero size 2024-05-09T00:07:48.436 INFO:tasks.workunit.client.0.smithi026.stdout:8/590: chown de/d48/d73/d91/fab 4407 1 2024-05-09T00:07:48.438 INFO:tasks.workunit.client.0.smithi026.stdout:0/634: dread f19 [0,4194304] 0 2024-05-09T00:07:48.438 INFO:tasks.workunit.client.0.smithi026.stdout:0/635: readlink d1d/d1e/d20/l42 0 2024-05-09T00:07:48.440 INFO:tasks.workunit.client.0.smithi026.stdout:0/636: dread d1d/d1e/f32 [0,4194304] 0 2024-05-09T00:07:48.442 INFO:tasks.workunit.client.0.smithi026.stdout:4/517: creat d0/d12/da2/fba x:0 0 0 2024-05-09T00:07:48.443 INFO:tasks.workunit.client.0.smithi026.stdout:4/518: dread d0/f94 [0,4194304] 0 2024-05-09T00:07:48.446 INFO:tasks.workunit.client.0.smithi026.stdout:1/569: link d5/f2d d5/d16/d60/d66/d97/d94/fc4 0 2024-05-09T00:07:48.450 INFO:tasks.workunit.client.0.smithi026.stdout:8/591: mknod de/d6c/d31/d4f/d87/cc2 0 2024-05-09T00:07:48.450 INFO:tasks.workunit.client.0.smithi026.stdout:0/637: rmdir d1d/d1e/d20/d4d/d83/da0/dd2 39 2024-05-09T00:07:48.453 INFO:tasks.workunit.client.0.smithi026.stdout:4/519: getdents d0/d12/da2/d97/d43/d49/d8f/da3 0 2024-05-09T00:07:48.453 INFO:tasks.workunit.client.0.smithi026.stdout:4/520: chown d0/d12/da2/d97/d8c/f95 729139 1 2024-05-09T00:07:48.454 INFO:tasks.workunit.client.0.smithi026.stdout:4/521: write d0/d12/d64/dac/fb5 [621760,111511] 0 2024-05-09T00:07:48.454 INFO:tasks.workunit.client.0.smithi026.stdout:4/522: chown d0/f75 361203 1 2024-05-09T00:07:48.454 INFO:tasks.workunit.client.0.smithi026.stdout:4/523: read - d0/d12/da2/f9f zero size 2024-05-09T00:07:48.455 INFO:tasks.workunit.client.0.smithi026.stdout:1/570: rmdir d5/dd/d17/d9f 39 2024-05-09T00:07:48.455 INFO:tasks.workunit.client.0.smithi026.stdout:1/571: fdatasync f3 0 2024-05-09T00:07:48.457 INFO:tasks.workunit.client.0.smithi026.stdout:1/572: dread f4 [8388608,4194304] 0 2024-05-09T00:07:48.457 INFO:tasks.workunit.client.0.smithi026.stdout:0/638: rename d1d/c1f to d1d/d1e/d20/d4d/d58/d62/d96/cd4 0 2024-05-09T00:07:48.458 INFO:tasks.workunit.client.0.smithi026.stdout:8/592: mkdir de/d6c/d31/dc3 0 2024-05-09T00:07:48.458 INFO:tasks.workunit.client.0.smithi026.stdout:0/639: write d1d/d25/d47/d6e/f8e [161356,46660] 0 2024-05-09T00:07:48.460 INFO:tasks.workunit.client.0.smithi026.stdout:1/573: link d5/dd/l99 d5/dd/lc5 0 2024-05-09T00:07:48.461 INFO:tasks.workunit.client.0.smithi026.stdout:4/524: rename d0/d12/d34/f98 to d0/d12/da2/d97/d43/d58/fbb 0 2024-05-09T00:07:48.463 INFO:tasks.workunit.client.0.smithi026.stdout:4/525: write d0/f22 [547353,89160] 0 2024-05-09T00:07:48.463 INFO:tasks.workunit.client.0.smithi026.stdout:4/526: fsync d0/d12/da2/d97/d8c/f95 0 2024-05-09T00:07:48.463 INFO:tasks.workunit.client.0.smithi026.stdout:8/593: mkdir de/d48/d3e/dc4 0 2024-05-09T00:07:48.466 INFO:tasks.workunit.client.0.smithi026.stdout:0/640: symlink d1d/d33/ld5 0 2024-05-09T00:07:48.469 INFO:tasks.workunit.client.0.smithi026.stdout:1/574: mkdir d5/dd/d17/d9f/dc6 0 2024-05-09T00:07:48.469 INFO:tasks.workunit.client.0.smithi026.stdout:1/575: dread - d5/dd/d17/d73/fb9 zero size 2024-05-09T00:07:48.473 INFO:tasks.workunit.client.0.smithi026.stdout:4/527: creat d0/d12/da2/d97/d43/d58/fbc x:0 0 0 2024-05-09T00:07:48.473 INFO:tasks.workunit.client.0.smithi026.stdout:4/528: write d0/d12/da2/d97/f45 [5114531,20302] 0 2024-05-09T00:07:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:8/594: rename de/d17/d21/l36 to de/d48/d3e/dc4/lc5 0 2024-05-09T00:07:48.482 INFO:tasks.workunit.client.0.smithi026.stdout:1/576: truncate d5/dd/d1f/fbb 2958600 0 2024-05-09T00:07:48.484 INFO:tasks.workunit.client.0.smithi026.stdout:0/641: rename d1d/d25/d3c/f7a to d1d/d33/d64/fd6 0 2024-05-09T00:07:48.485 INFO:tasks.workunit.client.0.smithi026.stdout:8/595: creat de/d17/d21/d24/fc6 x:0 0 0 2024-05-09T00:07:48.487 INFO:tasks.workunit.client.0.smithi026.stdout:4/529: dwrite d0/d12/da2/d97/f45 [0,4194304] 0 2024-05-09T00:07:48.487 INFO:tasks.workunit.client.0.smithi026.stdout:1/577: rmdir d5/dd/d17/d7b/d9b 0 2024-05-09T00:07:48.487 INFO:tasks.workunit.client.0.smithi026.stdout:1/578: truncate d5/dd/d1f/d39/d47/f59 739152 0 2024-05-09T00:07:48.488 INFO:tasks.workunit.client.0.smithi026.stdout:8/596: stat de/d48/d3e/d54/l65 0 2024-05-09T00:07:48.489 INFO:tasks.workunit.client.0.smithi026.stdout:0/642: read d1d/d25/d3c/f40 [1734907,82865] 0 2024-05-09T00:07:48.492 INFO:tasks.workunit.client.0.smithi026.stdout:4/530: mkdir d0/d83/dbd 0 2024-05-09T00:07:48.494 INFO:tasks.workunit.client.0.smithi026.stdout:1/579: rmdir d5/d16/d60/d66 39 2024-05-09T00:07:48.496 INFO:tasks.workunit.client.0.smithi026.stdout:8/597: truncate de/d17/d21/d24/d3b/d3d/f56 1190040 0 2024-05-09T00:07:48.498 INFO:tasks.workunit.client.0.smithi026.stdout:0/643: creat d1d/d33/dbb/fd7 x:0 0 0 2024-05-09T00:07:48.498 INFO:tasks.workunit.client.0.smithi026.stdout:0/644: write d1d/d1e/d20/d4d/d58/d62/d78/fc6 [237449,92848] 0 2024-05-09T00:07:48.499 INFO:tasks.workunit.client.0.smithi026.stdout:7/707: sync 2024-05-09T00:07:48.499 INFO:tasks.workunit.client.0.smithi026.stdout:6/383: sync 2024-05-09T00:07:48.499 INFO:tasks.workunit.client.0.smithi026.stdout:6/384: write d15/d1e/d30/f46 [5013353,128483] 0 2024-05-09T00:07:48.500 INFO:tasks.workunit.client.0.smithi026.stdout:7/708: write d8/d1b/d89/fef [2192796,10402] 0 2024-05-09T00:07:48.500 INFO:tasks.workunit.client.0.smithi026.stdout:4/531: creat d0/d12/da2/d97/d43/d49/d8f/fbe x:0 0 0 2024-05-09T00:07:48.502 INFO:tasks.workunit.client.0.smithi026.stdout:1/580: symlink d5/lc7 0 2024-05-09T00:07:48.505 INFO:tasks.workunit.client.0.smithi026.stdout:8/598: mkdir de/d48/d3e/dc4/dc7 0 2024-05-09T00:07:48.505 INFO:tasks.workunit.client.0.smithi026.stdout:8/599: fdatasync de/f5d 0 2024-05-09T00:07:48.505 INFO:tasks.workunit.client.0.smithi026.stdout:8/600: truncate de/d6c/d31/d4f/fc1 1241497 0 2024-05-09T00:07:48.505 INFO:tasks.workunit.client.0.smithi026.stdout:8/601: dread - de/d6c/d31/d4f/f88 zero size 2024-05-09T00:07:48.507 INFO:tasks.workunit.client.0.smithi026.stdout:0/645: mknod d1d/d25/d47/d6e/cd8 0 2024-05-09T00:07:48.507 INFO:tasks.workunit.client.0.smithi026.stdout:0/646: dread - d1d/d1e/d2d/f77 zero size 2024-05-09T00:07:48.511 INFO:tasks.workunit.client.0.smithi026.stdout:6/385: creat d15/d1e/d23/d3a/f7c x:0 0 0 2024-05-09T00:07:48.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/647: dread f1b [0,4194304] 0 2024-05-09T00:07:48.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/648: write d1d/d33/fb1 [9082560,57609] 0 2024-05-09T00:07:48.513 INFO:tasks.workunit.client.0.smithi026.stdout:6/386: write f12 [6066687,25398] 0 2024-05-09T00:07:48.514 INFO:tasks.workunit.client.0.smithi026.stdout:7/709: getdents d8/d1b/d89/dc1/db0 0 2024-05-09T00:07:48.516 INFO:tasks.workunit.client.0.smithi026.stdout:1/581: creat d5/dd/d17/d9f/fc8 x:0 0 0 2024-05-09T00:07:48.516 INFO:tasks.workunit.client.0.smithi026.stdout:1/582: fsync d5/db/d1d/f48 0 2024-05-09T00:07:48.517 INFO:tasks.workunit.client.0.smithi026.stdout:8/602: creat de/d6c/d31/d4f/fc8 x:0 0 0 2024-05-09T00:07:48.519 INFO:tasks.workunit.client.0.smithi026.stdout:0/649: truncate d1d/d33/f61 3361930 0 2024-05-09T00:07:48.519 INFO:tasks.workunit.client.0.smithi026.stdout:0/650: readlink d1d/d33/l6a 0 2024-05-09T00:07:48.520 INFO:tasks.workunit.client.0.smithi026.stdout:6/387: mkdir d15/d2b/d33/d7d 0 2024-05-09T00:07:48.524 INFO:tasks.workunit.client.0.smithi026.stdout:6/388: link d15/d1e/d23/f24 d15/d2b/f7e 0 2024-05-09T00:07:48.524 INFO:tasks.workunit.client.0.smithi026.stdout:6/389: stat d15/d2b 0 2024-05-09T00:07:48.524 INFO:tasks.workunit.client.0.smithi026.stdout:1/583: symlink d5/d16/lc9 0 2024-05-09T00:07:48.524 INFO:tasks.workunit.client.0.smithi026.stdout:6/390: write d15/d1e/d23/d73/f28 [1103307,117555] 0 2024-05-09T00:07:48.525 INFO:tasks.workunit.client.0.smithi026.stdout:1/584: write d5/d16/d60/f74 [246036,114677] 0 2024-05-09T00:07:48.525 INFO:tasks.workunit.client.0.smithi026.stdout:1/585: chown d5/db/f1e 62815391 1 2024-05-09T00:07:48.545 INFO:tasks.workunit.client.0.smithi026.stdout:1/586: dwrite d5/dd/d1f/f7c [0,4194304] 0 2024-05-09T00:07:48.552 INFO:tasks.workunit.client.0.smithi026.stdout:1/587: rename d5/d16/c4b to d5/d16/d60/d66/d97/cca 0 2024-05-09T00:07:48.552 INFO:tasks.workunit.client.0.smithi026.stdout:1/588: chown d5/d16/d60/f74 79 1 2024-05-09T00:07:48.553 INFO:tasks.workunit.client.0.smithi026.stdout:6/391: dwrite d15/d34/f49 [0,4194304] 0 2024-05-09T00:07:48.553 INFO:tasks.workunit.client.0.smithi026.stdout:6/392: chown d15/d1e/d23/d73/c2e 178829 1 2024-05-09T00:07:48.553 INFO:tasks.workunit.client.0.smithi026.stdout:8/603: dwrite de/d48/d73/d91/fab [0,4194304] 0 2024-05-09T00:07:48.554 INFO:tasks.workunit.client.0.smithi026.stdout:1/589: rename f2 to d5/d16/d60/d66/d97/d75/fcb 0 2024-05-09T00:07:48.556 INFO:tasks.workunit.client.0.smithi026.stdout:6/393: mknod d15/d1e/d23/c7f 0 2024-05-09T00:07:48.556 INFO:tasks.workunit.client.0.smithi026.stdout:6/394: stat d15/l50 0 2024-05-09T00:07:48.560 INFO:tasks.workunit.client.0.smithi026.stdout:8/604: unlink de/d17/d7d/f90 0 2024-05-09T00:07:48.561 INFO:tasks.workunit.client.0.smithi026.stdout:1/590: mknod d5/dd/d17/d9f/da5/ccc 0 2024-05-09T00:07:48.563 INFO:tasks.workunit.client.0.smithi026.stdout:6/395: dread d15/d62/f64 [4194304,4194304] 0 2024-05-09T00:07:48.563 INFO:tasks.workunit.client.0.smithi026.stdout:8/605: getdents de/d17/d21/d24/d5b 0 2024-05-09T00:07:48.566 INFO:tasks.workunit.client.0.smithi026.stdout:1/591: mkdir d5/dd/d17/d7b/dcd 0 2024-05-09T00:07:48.566 INFO:tasks.workunit.client.0.smithi026.stdout:1/592: chown d5/dd/d17 0 1 2024-05-09T00:07:48.566 INFO:tasks.workunit.client.0.smithi026.stdout:6/396: getdents d15/d2b/d33/d55 0 2024-05-09T00:07:48.566 INFO:tasks.workunit.client.0.smithi026.stdout:6/397: chown d15/d41 241 1 2024-05-09T00:07:48.566 INFO:tasks.workunit.client.0.smithi026.stdout:6/398: chown d15/d1e/d23/d73/d76 14847 1 2024-05-09T00:07:48.567 INFO:tasks.workunit.client.0.smithi026.stdout:1/593: creat d5/d16/d60/d66/d97/d94/fce x:0 0 0 2024-05-09T00:07:48.571 INFO:tasks.workunit.client.0.smithi026.stdout:1/594: symlink d5/dd/d1f/d39/d47/lcf 0 2024-05-09T00:07:48.572 INFO:tasks.workunit.client.0.smithi026.stdout:1/595: write d5/d16/d60/d66/d97/d94/fc4 [497115,126295] 0 2024-05-09T00:07:48.576 INFO:tasks.workunit.client.0.smithi026.stdout:6/399: rmdir d15/d1e/d23 39 2024-05-09T00:07:48.580 INFO:tasks.workunit.client.0.smithi026.stdout:1/596: rename d5/dd/f3f to d5/d16/fd0 0 2024-05-09T00:07:48.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/400: truncate d15/f1d 3931701 0 2024-05-09T00:07:48.584 INFO:tasks.workunit.client.0.smithi026.stdout:8/606: dwrite de/f13 [4194304,4194304] 0 2024-05-09T00:07:48.587 INFO:tasks.workunit.client.0.smithi026.stdout:8/607: write de/d17/f69 [1990564,7786] 0 2024-05-09T00:07:48.587 INFO:tasks.workunit.client.0.smithi026.stdout:6/401: creat d15/d34/d52/d74/f80 x:0 0 0 2024-05-09T00:07:48.593 INFO:tasks.workunit.client.0.smithi026.stdout:6/402: truncate f11 263996 0 2024-05-09T00:07:48.595 INFO:tasks.workunit.client.0.smithi026.stdout:8/608: dread de/d6c/f3c [0,4194304] 0 2024-05-09T00:07:48.597 INFO:tasks.workunit.client.0.smithi026.stdout:8/609: creat de/d48/d73/d91/fc9 x:0 0 0 2024-05-09T00:07:48.597 INFO:tasks.workunit.client.0.smithi026.stdout:8/610: fsync de/d6c/d31/d4f/d87/f8f 0 2024-05-09T00:07:48.597 INFO:tasks.workunit.client.0.smithi026.stdout:1/597: dwrite d5/dd/d17/d73/fb9 [0,4194304] 0 2024-05-09T00:07:48.597 INFO:tasks.workunit.client.0.smithi026.stdout:1/598: write d5/dd/d17/d9f/fc8 [513797,3139] 0 2024-05-09T00:07:48.597 INFO:tasks.workunit.client.0.smithi026.stdout:1/599: write d5/dd/d1f/f7c [4019769,80365] 0 2024-05-09T00:07:48.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/611: mkdir de/d17/d21/dca 0 2024-05-09T00:07:48.605 INFO:tasks.workunit.client.0.smithi026.stdout:1/600: mkdir d5/db/d1d/dd1 0 2024-05-09T00:07:48.607 INFO:tasks.workunit.client.0.smithi026.stdout:1/601: mkdir d5/dd/d17/d9f/da5/dd2 0 2024-05-09T00:07:48.628 INFO:tasks.workunit.client.0.smithi026.stdout:6/403: dwrite d15/d1e/d30/f72 [0,4194304] 0 2024-05-09T00:07:48.628 INFO:tasks.workunit.client.0.smithi026.stdout:6/404: stat ce 0 2024-05-09T00:07:48.633 INFO:tasks.workunit.client.0.smithi026.stdout:6/405: creat d15/d1e/d23/d3a/f81 x:0 0 0 2024-05-09T00:07:48.633 INFO:tasks.workunit.client.0.smithi026.stdout:6/406: read - d15/d2b/d33/d55/d67/f7b zero size 2024-05-09T00:07:48.634 INFO:tasks.workunit.client.0.smithi026.stdout:8/612: dwrite de/f13 [0,4194304] 0 2024-05-09T00:07:48.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/602: dwrite d5/db/f62 [4194304,4194304] 0 2024-05-09T00:07:48.637 INFO:tasks.workunit.client.0.smithi026.stdout:1/603: write d5/db/f69 [2160971,62820] 0 2024-05-09T00:07:48.642 INFO:tasks.workunit.client.0.smithi026.stdout:8/613: unlink de/d6c/d31/d4f/d87/caf 0 2024-05-09T00:07:48.647 INFO:tasks.workunit.client.0.smithi026.stdout:6/407: dwrite d15/d1e/d23/d3a/f7c [0,4194304] 0 2024-05-09T00:07:48.650 INFO:tasks.workunit.client.0.smithi026.stdout:1/604: creat d5/dd/d17/fd3 x:0 0 0 2024-05-09T00:07:48.651 INFO:tasks.workunit.client.0.smithi026.stdout:8/614: creat de/d17/d21/fcb x:0 0 0 2024-05-09T00:07:48.651 INFO:tasks.workunit.client.0.smithi026.stdout:8/615: chown de/d6c/d31/f71 65066427 1 2024-05-09T00:07:48.660 INFO:tasks.workunit.client.0.smithi026.stdout:8/616: dread de/d17/f69 [0,4194304] 0 2024-05-09T00:07:48.661 INFO:tasks.workunit.client.0.smithi026.stdout:8/617: write f9 [275077,72029] 0 2024-05-09T00:07:48.663 INFO:tasks.workunit.client.0.smithi026.stdout:6/408: creat d15/d34/d52/f82 x:0 0 0 2024-05-09T00:07:48.669 INFO:tasks.workunit.client.0.smithi026.stdout:1/605: dwrite d5/d16/d60/d66/d97/f4d [0,4194304] 0 2024-05-09T00:07:48.669 INFO:tasks.workunit.client.0.smithi026.stdout:8/618: dread de/d17/f4a [0,4194304] 0 2024-05-09T00:07:48.669 INFO:tasks.workunit.client.0.smithi026.stdout:8/619: fsync de/d17/d21/d6f/f8e 0 2024-05-09T00:07:48.669 INFO:tasks.workunit.client.0.smithi026.stdout:6/409: symlink d15/d1e/d23/d73/l83 0 2024-05-09T00:07:48.673 INFO:tasks.workunit.client.0.smithi026.stdout:8/620: creat de/d17/d21/dca/fcc x:0 0 0 2024-05-09T00:07:48.673 INFO:tasks.workunit.client.0.smithi026.stdout:8/621: fdatasync de/d17/d21/d24/d3b/fba 0 2024-05-09T00:07:48.687 INFO:tasks.workunit.client.0.smithi026.stdout:6/410: dwrite d15/d1e/d23/d73/d58/d5c/f5d [0,4194304] 0 2024-05-09T00:07:48.691 INFO:tasks.workunit.client.0.smithi026.stdout:6/411: rename d15/d1e/d23/c2f to d15/d41/c84 0 2024-05-09T00:07:48.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/412: write d15/d1e/d30/f72 [1441929,88108] 0 2024-05-09T00:07:48.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/413: rmdir d15/d1e/d3d/d4c 39 2024-05-09T00:07:48.698 INFO:tasks.workunit.client.0.smithi026.stdout:8/622: dwrite de/d17/d21/d24/d3b/d3d/f51 [0,4194304] 0 2024-05-09T00:07:48.698 INFO:tasks.workunit.client.0.smithi026.stdout:8/623: chown de/d17/d21/d24/f99 7249645 1 2024-05-09T00:07:48.698 INFO:tasks.workunit.client.0.smithi026.stdout:1/606: dwrite d5/dd/f58 [0,4194304] 0 2024-05-09T00:07:48.699 INFO:tasks.workunit.client.0.smithi026.stdout:6/414: creat d15/d1e/d30/d32/f85 x:0 0 0 2024-05-09T00:07:48.703 INFO:tasks.workunit.client.0.smithi026.stdout:8/624: rename de/d17/f43 to de/d48/d73/fcd 0 2024-05-09T00:07:48.704 INFO:tasks.workunit.client.0.smithi026.stdout:6/415: creat d15/d1e/d30/f86 x:0 0 0 2024-05-09T00:07:48.707 INFO:tasks.workunit.client.0.smithi026.stdout:8/625: link de/d17/d7d/lad de/d17/d21/lce 0 2024-05-09T00:07:48.709 INFO:tasks.workunit.client.0.smithi026.stdout:6/416: link d15/d2b/f7e d15/d2b/d33/d55/d5e/f87 0 2024-05-09T00:07:48.709 INFO:tasks.workunit.client.0.smithi026.stdout:6/417: fsync d15/d1e/d3d/d4c/f40 0 2024-05-09T00:07:48.709 INFO:tasks.workunit.client.0.smithi026.stdout:8/626: creat de/d6c/d31/d4f/fcf x:0 0 0 2024-05-09T00:07:48.711 INFO:tasks.workunit.client.0.smithi026.stdout:6/418: rename d15/d2b/d33/l6b to d15/d34/l88 0 2024-05-09T00:07:48.712 INFO:tasks.workunit.client.0.smithi026.stdout:8/627: truncate de/f23 7397204 0 2024-05-09T00:07:48.712 INFO:tasks.workunit.client.0.smithi026.stdout:8/628: write de/d17/d21/d24/d5b/fbf [824448,102891] 0 2024-05-09T00:07:48.712 INFO:tasks.workunit.client.0.smithi026.stdout:8/629: readlink de/d6c/d31/l92 0 2024-05-09T00:07:48.720 INFO:tasks.workunit.client.0.smithi026.stdout:8/630: dread de/d17/d7d/f9d [0,4194304] 0 2024-05-09T00:07:48.725 INFO:tasks.workunit.client.0.smithi026.stdout:8/631: mknod de/d17/d21/d24/d3b/d3d/cd0 0 2024-05-09T00:07:48.725 INFO:tasks.workunit.client.0.smithi026.stdout:8/632: fdatasync de/d17/f64 0 2024-05-09T00:07:48.725 INFO:tasks.workunit.client.0.smithi026.stdout:8/633: fsync de/d17/d21/d24/d3b/fba 0 2024-05-09T00:07:48.725 INFO:tasks.workunit.client.0.smithi026.stdout:8/634: chown de/d6c/d31/d4f/d87/d62 160128 1 2024-05-09T00:07:48.730 INFO:tasks.workunit.client.0.smithi026.stdout:8/635: dread de/d6c/d31/f71 [0,4194304] 0 2024-05-09T00:07:48.730 INFO:tasks.workunit.client.0.smithi026.stdout:8/636: fsync de/d48/d73/d91/fc9 0 2024-05-09T00:07:48.734 INFO:tasks.workunit.client.0.smithi026.stdout:6/419: dwrite d15/f18 [0,4194304] 0 2024-05-09T00:07:48.736 INFO:tasks.workunit.client.0.smithi026.stdout:6/420: creat d15/d1e/d30/d75/f89 x:0 0 0 2024-05-09T00:07:48.737 INFO:tasks.workunit.client.0.smithi026.stdout:6/421: rmdir d15/d41 39 2024-05-09T00:07:48.737 INFO:tasks.workunit.client.0.smithi026.stdout:6/422: dread - d15/d34/d52/d74/f80 zero size 2024-05-09T00:07:48.737 INFO:tasks.workunit.client.0.smithi026.stdout:6/423: chown d15/d34/c71 22966897 1 2024-05-09T00:07:48.746 INFO:tasks.workunit.client.0.smithi026.stdout:8/637: dwrite de/f16 [0,4194304] 0 2024-05-09T00:07:48.747 INFO:tasks.workunit.client.0.smithi026.stdout:8/638: write de/f23 [4879461,64110] 0 2024-05-09T00:07:48.750 INFO:tasks.workunit.client.0.smithi026.stdout:8/639: rename de/d48/d3e/c83 to de/d48/d3e/cd1 0 2024-05-09T00:07:48.754 INFO:tasks.workunit.client.0.smithi026.stdout:8/640: mkdir de/d17/d7d/dd2 0 2024-05-09T00:07:48.755 INFO:tasks.workunit.client.0.smithi026.stdout:8/641: creat de/d17/d21/d24/d5b/dbd/fd3 x:0 0 0 2024-05-09T00:07:48.757 INFO:tasks.workunit.client.0.smithi026.stdout:8/642: creat de/d6c/d31/d4f/dbb/fd4 x:0 0 0 2024-05-09T00:07:48.759 INFO:tasks.workunit.client.0.smithi026.stdout:8/643: mknod de/d17/d21/dca/cd5 0 2024-05-09T00:07:48.760 INFO:tasks.workunit.client.0.smithi026.stdout:6/424: dwrite d15/d1e/d23/d73/d58/f61 [0,4194304] 0 2024-05-09T00:07:48.771 INFO:tasks.workunit.client.0.smithi026.stdout:6/425: dread d15/d34/f49 [0,4194304] 0 2024-05-09T00:07:48.771 INFO:tasks.workunit.client.0.smithi026.stdout:6/426: chown ce 308630 1 2024-05-09T00:07:48.786 INFO:tasks.workunit.client.0.smithi026.stdout:8/644: dwrite de/f13 [4194304,4194304] 0 2024-05-09T00:07:48.786 INFO:tasks.workunit.client.0.smithi026.stdout:6/427: dread d15/d1e/d23/d73/f28 [0,4194304] 0 2024-05-09T00:07:48.786 INFO:tasks.workunit.client.0.smithi026.stdout:8/645: dread - de/d17/d21/d24/f99 zero size 2024-05-09T00:07:48.790 INFO:tasks.workunit.client.0.smithi026.stdout:6/428: rename d15/d2b/d33/d55/d67/f7b to d15/d1e/d23/f8a 0 2024-05-09T00:07:48.791 INFO:tasks.workunit.client.0.smithi026.stdout:8/646: symlink de/d48/d3e/dc4/dc7/ld6 0 2024-05-09T00:07:48.791 INFO:tasks.workunit.client.0.smithi026.stdout:8/647: truncate de/d6c/d31/fc0 675090 0 2024-05-09T00:07:48.791 INFO:tasks.workunit.client.0.smithi026.stdout:6/429: write d15/d1e/d30/f46 [1606740,101340] 0 2024-05-09T00:07:48.792 INFO:tasks.workunit.client.0.smithi026.stdout:8/648: mknod de/d6c/cd7 0 2024-05-09T00:07:48.793 INFO:tasks.workunit.client.0.smithi026.stdout:8/649: write de/d17/d21/d6f/f9e [652307,119309] 0 2024-05-09T00:07:48.793 INFO:tasks.workunit.client.0.smithi026.stdout:8/650: fdatasync de/d6c/d31/d4f/f7b 0 2024-05-09T00:07:48.798 INFO:tasks.workunit.client.0.smithi026.stdout:6/430: rename d15/d1e/d3d/d4c to d15/d34/d52/d8b 0 2024-05-09T00:07:48.798 INFO:tasks.workunit.client.0.smithi026.stdout:6/431: readlink d15/d1e/l2a 0 2024-05-09T00:07:48.798 INFO:tasks.workunit.client.0.smithi026.stdout:6/432: read - d15/f77 zero size 2024-05-09T00:07:48.801 INFO:tasks.workunit.client.0.smithi026.stdout:3/481: sync 2024-05-09T00:07:48.802 INFO:tasks.workunit.client.0.smithi026.stdout:2/481: sync 2024-05-09T00:07:48.802 INFO:tasks.workunit.client.0.smithi026.stdout:9/582: sync 2024-05-09T00:07:48.803 INFO:tasks.workunit.client.0.smithi026.stdout:9/583: dread d7/d23/d29/d59/f5f [0,4194304] 0 2024-05-09T00:07:48.803 INFO:tasks.workunit.client.0.smithi026.stdout:9/584: dread - d7/d23/d29/d31/d40/d41/d54/d9a/fcd zero size 2024-05-09T00:07:48.804 INFO:tasks.workunit.client.0.smithi026.stdout:6/433: creat d15/f8c x:0 0 0 2024-05-09T00:07:48.808 INFO:tasks.workunit.client.0.smithi026.stdout:2/482: creat d14/fa8 x:0 0 0 2024-05-09T00:07:48.810 INFO:tasks.workunit.client.0.smithi026.stdout:9/585: mknod d7/d23/d29/d31/cd3 0 2024-05-09T00:07:48.831 INFO:tasks.workunit.client.0.smithi026.stdout:2/483: dread d14/d22/d55/da3/f26 [0,4194304] 0 2024-05-09T00:07:48.835 INFO:tasks.workunit.client.0.smithi026.stdout:2/484: dread d14/d22/d55/da3/d3b/f3f [0,4194304] 0 2024-05-09T00:07:48.837 INFO:tasks.workunit.client.0.smithi026.stdout:2/485: write d14/d22/d55/da3/d1f/f38 [1286437,26081] 0 2024-05-09T00:07:48.840 INFO:tasks.workunit.client.0.smithi026.stdout:2/486: rename d14/d22/d55/da3/d30/d6a/d5f/c79 to d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/d96/ca9 0 2024-05-09T00:07:48.841 INFO:tasks.workunit.client.0.smithi026.stdout:2/487: mkdir d14/d22/d55/da3/d20/d41/d51/d82/daa 0 2024-05-09T00:07:48.841 INFO:tasks.workunit.client.0.smithi026.stdout:2/488: truncate d14/d22/d55/f60 752388 0 2024-05-09T00:07:48.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/482: dwrite d5/d9/f5a [0,4194304] 0 2024-05-09T00:07:48.843 INFO:tasks.workunit.client.0.smithi026.stdout:6/434: dwrite d15/d2b/d33/f51 [0,4194304] 0 2024-05-09T00:07:48.843 INFO:tasks.workunit.client.0.smithi026.stdout:9/586: dwrite d7/d23/d2f/f98 [4194304,4194304] 0 2024-05-09T00:07:48.843 INFO:tasks.workunit.client.0.smithi026.stdout:2/489: creat d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fab x:0 0 0 2024-05-09T00:07:48.846 INFO:tasks.workunit.client.0.smithi026.stdout:3/483: mkdir d5/d9/d4a/d5f/d6f/d9e 0 2024-05-09T00:07:48.849 INFO:tasks.workunit.client.0.smithi026.stdout:6/435: unlink d15/d1e/d23/d3a/f81 0 2024-05-09T00:07:48.852 INFO:tasks.workunit.client.0.smithi026.stdout:9/587: creat d7/d23/d29/d59/d91/fd4 x:0 0 0 2024-05-09T00:07:48.853 INFO:tasks.workunit.client.0.smithi026.stdout:2/490: creat d14/d22/d55/da3/d20/fac x:0 0 0 2024-05-09T00:07:48.914 INFO:tasks.workunit.client.0.smithi026.stdout:3/484: mkdir d5/d44/d9f 0 2024-05-09T00:07:48.914 INFO:tasks.workunit.client.0.smithi026.stdout:3/485: fsync d5/d1e/d7b/f9d 0 2024-05-09T00:07:48.915 INFO:tasks.workunit.client.0.smithi026.stdout:3/486: read d5/d41/f37 [3313612,7772] 0 2024-05-09T00:07:48.915 INFO:tasks.workunit.client.0.smithi026.stdout:3/487: write d5/d41/f43 [4927764,74335] 0 2024-05-09T00:07:48.915 INFO:tasks.workunit.client.0.smithi026.stdout:3/488: fdatasync d5/d9/d4a/f52 0 2024-05-09T00:07:48.915 INFO:tasks.workunit.client.0.smithi026.stdout:6/436: creat d15/d1e/d23/d73/d76/f8d x:0 0 0 2024-05-09T00:07:48.915 INFO:tasks.workunit.client.0.smithi026.stdout:6/437: truncate d15/d1e/d23/f8a 1006734 0 2024-05-09T00:07:48.916 INFO:tasks.workunit.client.0.smithi026.stdout:6/438: write f1 [7527673,63517] 0 2024-05-09T00:07:48.924 INFO:tasks.workunit.client.0.smithi026.stdout:3/489: mknod d5/d9/dc/d5d/ca0 0 2024-05-09T00:07:48.926 INFO:tasks.workunit.client.0.smithi026.stdout:2/491: truncate d14/d22/d55/da3/d1f/f38 2930161 0 2024-05-09T00:07:48.929 INFO:tasks.workunit.client.0.smithi026.stdout:3/490: creat d5/d41/fa1 x:0 0 0 2024-05-09T00:07:48.930 INFO:tasks.workunit.client.0.smithi026.stdout:2/492: unlink d14/d22/d55/d6b/c76 0 2024-05-09T00:07:48.932 INFO:tasks.workunit.client.0.smithi026.stdout:3/491: creat d5/d9/d4a/d5f/d6f/d75/fa2 x:0 0 0 2024-05-09T00:07:48.935 INFO:tasks.workunit.client.0.smithi026.stdout:2/493: rename d14/d22/d55/da3/d17/f34 to d14/d22/d55/da3/d17/fad 0 2024-05-09T00:07:48.937 INFO:tasks.workunit.client.0.smithi026.stdout:2/494: write d14/d22/d55/da3/d1f/f2d [1405912,68613] 0 2024-05-09T00:07:48.937 INFO:tasks.workunit.client.0.smithi026.stdout:2/495: dread - d14/d22/d55/da3/d30/d6a/d5b/f84 zero size 2024-05-09T00:07:48.937 INFO:tasks.workunit.client.0.smithi026.stdout:2/496: chown d14/c9a 0 1 2024-05-09T00:07:48.938 INFO:tasks.workunit.client.0.smithi026.stdout:6/439: dwrite d15/d1e/d23/d73/d58/d5c/f5d [0,4194304] 0 2024-05-09T00:07:48.938 INFO:tasks.workunit.client.0.smithi026.stdout:2/497: write d14/d22/d55/f60 [546562,79191] 0 2024-05-09T00:07:48.938 INFO:tasks.workunit.client.0.smithi026.stdout:2/498: chown d14/d22/d55/da3/f26 716 1 2024-05-09T00:07:48.945 INFO:tasks.workunit.client.0.smithi026.stdout:6/440: unlink lf 0 2024-05-09T00:07:48.945 INFO:tasks.workunit.client.0.smithi026.stdout:6/441: write f11 [100210,26694] 0 2024-05-09T00:07:48.953 INFO:tasks.workunit.client.0.smithi026.stdout:3/492: rmdir d5 39 2024-05-09T00:07:48.962 INFO:tasks.workunit.client.0.smithi026.stdout:6/442: rmdir d15/d1e/d3d 39 2024-05-09T00:07:48.963 INFO:tasks.workunit.client.0.smithi026.stdout:3/493: creat d5/d9/dc/fa3 x:0 0 0 2024-05-09T00:07:48.965 INFO:tasks.workunit.client.0.smithi026.stdout:6/443: mkdir d15/d1e/d23/d73/d8e 0 2024-05-09T00:07:48.966 INFO:tasks.workunit.client.0.smithi026.stdout:6/444: chown d15/d2b/d33/d55/c69 768 1 2024-05-09T00:07:48.966 INFO:tasks.workunit.client.0.smithi026.stdout:6/445: chown d15/d34/d52/f82 56253 1 2024-05-09T00:07:48.966 INFO:tasks.workunit.client.0.smithi026.stdout:6/446: write d15/d34/d52/f82 [603105,13471] 0 2024-05-09T00:07:48.966 INFO:tasks.workunit.client.0.smithi026.stdout:6/447: stat d15/d2b/l37 0 2024-05-09T00:07:48.969 INFO:tasks.workunit.client.0.smithi026.stdout:6/448: getdents d15/d2b 0 2024-05-09T00:07:48.969 INFO:tasks.workunit.client.0.smithi026.stdout:6/449: dread - d15/d1e/d30/d32/f85 zero size 2024-05-09T00:07:48.974 INFO:tasks.workunit.client.0.smithi026.stdout:6/450: creat d15/d62/f8f x:0 0 0 2024-05-09T00:07:48.976 INFO:tasks.workunit.client.0.smithi026.stdout:7/710: sync 2024-05-09T00:07:48.977 INFO:tasks.workunit.client.0.smithi026.stdout:4/532: sync 2024-05-09T00:07:48.977 INFO:tasks.workunit.client.0.smithi026.stdout:5/526: sync 2024-05-09T00:07:48.977 INFO:tasks.workunit.client.0.smithi026.stdout:4/533: chown d0/d83/dbd 28 1 2024-05-09T00:07:48.977 INFO:tasks.workunit.client.0.smithi026.stdout:5/527: chown d2/d8/d31/d63/d9c 2156 1 2024-05-09T00:07:48.977 INFO:tasks.workunit.client.0.smithi026.stdout:4/534: truncate d0/d12/f13 2629969 0 2024-05-09T00:07:48.977 INFO:tasks.workunit.client.0.smithi026.stdout:3/494: dwrite d5/d1e/d3e/f68 [0,4194304] 0 2024-05-09T00:07:48.979 INFO:tasks.workunit.client.0.smithi026.stdout:6/451: mkdir d15/d2b/d33/d55/d67/d90 0 2024-05-09T00:07:48.979 INFO:tasks.workunit.client.0.smithi026.stdout:6/452: dread - d15/d1e/d23/d73/f6a zero size 2024-05-09T00:07:48.980 INFO:tasks.workunit.client.0.smithi026.stdout:7/711: creat d8/d1b/d89/dc1/db0/fff x:0 0 0 2024-05-09T00:07:48.983 INFO:tasks.workunit.client.0.smithi026.stdout:5/528: mkdir d2/d8/d31/d32/d48/daa 0 2024-05-09T00:07:48.985 INFO:tasks.workunit.client.0.smithi026.stdout:4/535: mkdir d0/d12/da2/d97/dbf 0 2024-05-09T00:07:48.985 INFO:tasks.workunit.client.0.smithi026.stdout:4/536: read - d0/d12/da2/d97/fb1 zero size 2024-05-09T00:07:48.988 INFO:tasks.workunit.client.0.smithi026.stdout:3/495: rename d5/d1e/d3e/l61 to d5/d9/dc/d28/d2c/la4 0 2024-05-09T00:07:48.989 INFO:tasks.workunit.client.0.smithi026.stdout:6/453: creat d15/d34/d52/d8b/f91 x:0 0 0 2024-05-09T00:07:48.990 INFO:tasks.workunit.client.0.smithi026.stdout:4/537: unlink d0/d12/da2/d97/d43/d49/f60 0 2024-05-09T00:07:48.993 INFO:tasks.workunit.client.0.smithi026.stdout:5/529: rename d2/d8/d31/d2e/d4a/f64 to d2/d8/d6d/fab 0 2024-05-09T00:07:48.994 INFO:tasks.workunit.client.0.smithi026.stdout:7/712: dwrite d8/d1b/d89/fef [0,4194304] 0 2024-05-09T00:07:48.994 INFO:tasks.workunit.client.0.smithi026.stdout:3/496: mkdir d5/d9/dc/d5b/da5 0 2024-05-09T00:07:48.995 INFO:tasks.workunit.client.0.smithi026.stdout:6/454: mknod d15/d1e/d23/c92 0 2024-05-09T00:07:48.996 INFO:tasks.workunit.client.0.smithi026.stdout:4/538: mknod d0/d83/cc0 0 2024-05-09T00:07:48.997 INFO:tasks.workunit.client.0.smithi026.stdout:5/530: mkdir d2/d8/d31/d32/da2/dac 0 2024-05-09T00:07:48.998 INFO:tasks.workunit.client.0.smithi026.stdout:5/531: fdatasync d2/d8/f8b 0 2024-05-09T00:07:48.998 INFO:tasks.workunit.client.0.smithi026.stdout:5/532: chown d2/d8/d31/d2e/d79/f6b 54374 1 2024-05-09T00:07:49.000 INFO:tasks.workunit.client.0.smithi026.stdout:7/713: rmdir d8/d2e/d84/db4/dbc/d22/d29 39 2024-05-09T00:07:49.002 INFO:tasks.workunit.client.0.smithi026.stdout:3/497: truncate d5/d9/dc/d28/d45/f57 3841679 0 2024-05-09T00:07:49.005 INFO:tasks.workunit.client.0.smithi026.stdout:6/455: symlink d15/d1e/d23/d73/d76/l93 0 2024-05-09T00:07:49.008 INFO:tasks.workunit.client.0.smithi026.stdout:6/456: write f12 [1480659,114248] 0 2024-05-09T00:07:49.011 INFO:tasks.workunit.client.0.smithi026.stdout:4/539: unlink d0/d12/d1b/d4e/d92/fa8 0 2024-05-09T00:07:49.013 INFO:tasks.workunit.client.0.smithi026.stdout:5/533: rename d2/d8/d31/d32/d48/f9e to d2/d8/d31/d2e/fad 0 2024-05-09T00:07:49.015 INFO:tasks.workunit.client.0.smithi026.stdout:7/714: chown d8/d2e/d84/db4/dbc/d1e/d3d/f63 14736 1 2024-05-09T00:07:49.017 INFO:tasks.workunit.client.0.smithi026.stdout:3/498: dwrite d5/d9/dc/f1b [4194304,4194304] 0 2024-05-09T00:07:49.017 INFO:tasks.workunit.client.0.smithi026.stdout:3/499: write d5/d9/dc/d5d/f76 [795271,50158] 0 2024-05-09T00:07:49.017 INFO:tasks.workunit.client.0.smithi026.stdout:3/500: dread - d5/d9/dc/d28/d2c/f84 zero size 2024-05-09T00:07:49.017 INFO:tasks.workunit.client.0.smithi026.stdout:3/501: stat d5/f39 0 2024-05-09T00:07:49.018 INFO:tasks.workunit.client.0.smithi026.stdout:6/457: mkdir d15/d2b/d33/d94 0 2024-05-09T00:07:49.018 INFO:tasks.workunit.client.0.smithi026.stdout:6/458: truncate f11 643094 0 2024-05-09T00:07:49.022 INFO:tasks.workunit.client.0.smithi026.stdout:4/540: mkdir d0/d12/da2/d97/d43/d49/d8f/dc1 0 2024-05-09T00:07:49.030 INFO:tasks.workunit.client.0.smithi026.stdout:3/502: creat d5/d9/dc/d28/d2c/fa6 x:0 0 0 2024-05-09T00:07:49.031 INFO:tasks.workunit.client.0.smithi026.stdout:7/715: dwrite d8/d2e/d84/db4/dbc/d1e/d3d/ff8 [0,4194304] 0 2024-05-09T00:07:49.031 INFO:tasks.workunit.client.0.smithi026.stdout:7/716: chown d8/d2e/d84/db4/dbc/d1e/f43 240 1 2024-05-09T00:07:49.032 INFO:tasks.workunit.client.0.smithi026.stdout:6/459: link d15/d34/d52/d74/f80 d15/d2b/d33/d55/f95 0 2024-05-09T00:07:49.032 INFO:tasks.workunit.client.0.smithi026.stdout:6/460: readlink d15/d1e/l5f 0 2024-05-09T00:07:49.035 INFO:tasks.workunit.client.0.smithi026.stdout:3/503: read d5/d9/dc/f31 [795976,76951] 0 2024-05-09T00:07:49.038 INFO:tasks.workunit.client.0.smithi026.stdout:3/504: unlink d5/d9/d4a/d77/f96 0 2024-05-09T00:07:49.043 INFO:tasks.workunit.client.0.smithi026.stdout:3/505: unlink d5/d9/dc/d5d/f76 0 2024-05-09T00:07:49.043 INFO:tasks.workunit.client.0.smithi026.stdout:3/506: fdatasync d5/f1f 0 2024-05-09T00:07:49.043 INFO:tasks.workunit.client.0.smithi026.stdout:3/507: write d5/d41/f37 [4865167,120395] 0 2024-05-09T00:07:49.044 INFO:tasks.workunit.client.0.smithi026.stdout:7/717: dread d8/d2e/d84/db4/dbc/d22/d29/f90 [0,4194304] 0 2024-05-09T00:07:49.044 INFO:tasks.workunit.client.0.smithi026.stdout:7/718: chown d8/d5c/d9a/df4 12 1 2024-05-09T00:07:49.046 INFO:tasks.workunit.client.0.smithi026.stdout:7/719: creat d8/d2e/d84/db4/dbc/d1e/d8a/df0/f100 x:0 0 0 2024-05-09T00:07:49.048 INFO:tasks.workunit.client.0.smithi026.stdout:6/461: dwrite d15/f1d [0,4194304] 0 2024-05-09T00:07:49.048 INFO:tasks.workunit.client.0.smithi026.stdout:6/462: write d15/f1f [4506733,108713] 0 2024-05-09T00:07:49.054 INFO:tasks.workunit.client.0.smithi026.stdout:4/541: dwrite d0/d12/da2/d97/d43/d58/f6a [0,4194304] 0 2024-05-09T00:07:49.054 INFO:tasks.workunit.client.0.smithi026.stdout:4/542: chown d0/d12/da2/d97/d43/f44 173 1 2024-05-09T00:07:49.058 INFO:tasks.workunit.client.0.smithi026.stdout:7/720: dread d8/d1b/d89/d8d/f98 [0,4194304] 0 2024-05-09T00:07:49.064 INFO:tasks.workunit.client.0.smithi026.stdout:3/508: dwrite d5/d9/dc/d28/d2c/f84 [0,4194304] 0 2024-05-09T00:07:49.064 INFO:tasks.workunit.client.0.smithi026.stdout:3/509: chown d5/d9/dc/d5d/f6c 211617662 1 2024-05-09T00:07:49.070 INFO:tasks.workunit.client.0.smithi026.stdout:4/543: creat d0/d12/d64/dac/fc2 x:0 0 0 2024-05-09T00:07:49.071 INFO:tasks.workunit.client.0.smithi026.stdout:4/544: chown d0/c18 121412 1 2024-05-09T00:07:49.071 INFO:tasks.workunit.client.0.smithi026.stdout:4/545: chown d0/d12/da2/d97/d43/d49/fb7 41322045 1 2024-05-09T00:07:49.072 INFO:tasks.workunit.client.0.smithi026.stdout:7/721: creat d8/d2e/d84/db4/dbc/d22/da1/f101 x:0 0 0 2024-05-09T00:07:49.072 INFO:tasks.workunit.client.0.smithi026.stdout:3/510: dread f2 [0,4194304] 0 2024-05-09T00:07:49.073 INFO:tasks.workunit.client.0.smithi026.stdout:7/722: write d8/d1b/d89/fa6 [3364281,49119] 0 2024-05-09T00:07:49.075 INFO:tasks.workunit.client.0.smithi026.stdout:7/723: write d8/d2e/d84/db4/dbc/d22/d29/f90 [1051667,92464] 0 2024-05-09T00:07:49.075 INFO:tasks.workunit.client.0.smithi026.stdout:7/724: write d8/d5c/f75 [691428,53074] 0 2024-05-09T00:07:49.080 INFO:tasks.workunit.client.0.smithi026.stdout:4/546: creat d0/d12/d1b/fc3 x:0 0 0 2024-05-09T00:07:49.081 INFO:tasks.workunit.client.0.smithi026.stdout:4/547: truncate d0/d12/da2/fba 512737 0 2024-05-09T00:07:49.083 INFO:tasks.workunit.client.0.smithi026.stdout:7/725: truncate d8/d1b/d89/fef 534736 0 2024-05-09T00:07:49.086 INFO:tasks.workunit.client.0.smithi026.stdout:4/548: creat d0/d12/da2/db8/fc4 x:0 0 0 2024-05-09T00:07:49.086 INFO:tasks.workunit.client.0.smithi026.stdout:1/607: sync 2024-05-09T00:07:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:8/651: sync 2024-05-09T00:07:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:0/651: sync 2024-05-09T00:07:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:2/499: sync 2024-05-09T00:07:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:0/652: stat d1d/d1e/d2d/l5d 0 2024-05-09T00:07:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:2/500: truncate d14/d22/d55/da3/d20/fa2 636503 0 2024-05-09T00:07:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:8/652: write f7 [1835006,40030] 0 2024-05-09T00:07:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:0/653: write d1d/d1e/f4b [419004,5681] 0 2024-05-09T00:07:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:9/588: sync 2024-05-09T00:07:49.088 INFO:tasks.workunit.client.0.smithi026.stdout:2/501: read d14/d22/d55/da3/d3b/d40/f8a [1917330,37623] 0 2024-05-09T00:07:49.088 INFO:tasks.workunit.client.0.smithi026.stdout:9/589: write d7/d26/f71 [2113010,60665] 0 2024-05-09T00:07:49.088 INFO:tasks.workunit.client.0.smithi026.stdout:9/590: stat d7/d23/d76/f90 0 2024-05-09T00:07:49.089 INFO:tasks.workunit.client.0.smithi026.stdout:2/502: read d14/d22/d55/f67 [2621484,80614] 0 2024-05-09T00:07:49.090 INFO:tasks.workunit.client.0.smithi026.stdout:7/726: symlink d8/d2e/d84/db4/dbc/d1e/d80/da2/l102 0 2024-05-09T00:07:49.093 INFO:tasks.workunit.client.0.smithi026.stdout:4/549: mkdir d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5 0 2024-05-09T00:07:49.093 INFO:tasks.workunit.client.0.smithi026.stdout:7/727: write d8/d2e/d84/db4/dbc/d1e/f41 [1795616,78982] 0 2024-05-09T00:07:49.094 INFO:tasks.workunit.client.0.smithi026.stdout:3/511: dwrite d5/d41/fa1 [0,4194304] 0 2024-05-09T00:07:49.094 INFO:tasks.workunit.client.0.smithi026.stdout:0/654: creat d1d/d33/fd9 x:0 0 0 2024-05-09T00:07:49.095 INFO:tasks.workunit.client.0.smithi026.stdout:8/653: mknod de/d17/d21/dca/cd8 0 2024-05-09T00:07:49.095 INFO:tasks.workunit.client.0.smithi026.stdout:8/654: dread - de/d17/d21/fcb zero size 2024-05-09T00:07:49.098 INFO:tasks.workunit.client.0.smithi026.stdout:9/591: mkdir d7/d23/d29/d31/d40/dd5 0 2024-05-09T00:07:49.107 INFO:tasks.workunit.client.0.smithi026.stdout:4/550: creat d0/d12/d87/fc6 x:0 0 0 2024-05-09T00:07:49.107 INFO:tasks.workunit.client.0.smithi026.stdout:4/551: chown d0/d12/da2/d97/d43/d49/d8f/da3/f40 13 1 2024-05-09T00:07:49.109 INFO:tasks.workunit.client.0.smithi026.stdout:7/728: mkdir d8/d5c/d9a/df4/d103 0 2024-05-09T00:07:49.109 INFO:tasks.workunit.client.0.smithi026.stdout:7/729: chown d8 368692223 1 2024-05-09T00:07:49.111 INFO:tasks.workunit.client.0.smithi026.stdout:9/592: dread d7/d23/d2f/f98 [0,4194304] 0 2024-05-09T00:07:49.112 INFO:tasks.workunit.client.0.smithi026.stdout:0/655: getdents d1d 0 2024-05-09T00:07:49.112 INFO:tasks.workunit.client.0.smithi026.stdout:0/656: truncate d1d/f5b 1659407 0 2024-05-09T00:07:49.112 INFO:tasks.workunit.client.0.smithi026.stdout:1/608: dwrite d5/db/f77 [0,4194304] 0 2024-05-09T00:07:49.113 INFO:tasks.workunit.client.0.smithi026.stdout:3/512: getdents d5/d9/dc/d28/d63 0 2024-05-09T00:07:49.114 INFO:tasks.workunit.client.0.smithi026.stdout:2/503: dwrite d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fab [0,4194304] 0 2024-05-09T00:07:49.114 INFO:tasks.workunit.client.0.smithi026.stdout:2/504: chown d14/d22/d55/da3/d3b/d40/d68/l9d 29384 1 2024-05-09T00:07:49.115 INFO:tasks.workunit.client.0.smithi026.stdout:4/552: rename d0/d12/da2/d97/d43/d49/d8f/fbe to d0/d12/da2/d97/d43/d49/fc7 0 2024-05-09T00:07:49.117 INFO:tasks.workunit.client.0.smithi026.stdout:7/730: mkdir d8/d5c/d9a/d9f/d104 0 2024-05-09T00:07:49.120 INFO:tasks.workunit.client.0.smithi026.stdout:1/609: dread d5/dd/f49 [0,4194304] 0 2024-05-09T00:07:49.121 INFO:tasks.workunit.client.0.smithi026.stdout:8/655: mkdir de/dd9 0 2024-05-09T00:07:49.127 INFO:tasks.workunit.client.0.smithi026.stdout:2/505: rmdir d14/d22/d55/da3/d20 39 2024-05-09T00:07:49.127 INFO:tasks.workunit.client.0.smithi026.stdout:2/506: write d14/d22/d55/da3/d20/d41/d51/f94 [39949,45022] 0 2024-05-09T00:07:49.128 INFO:tasks.workunit.client.0.smithi026.stdout:4/553: rmdir d0/d83 39 2024-05-09T00:07:49.128 INFO:tasks.workunit.client.0.smithi026.stdout:4/554: fsync d0/d12/da2/db8/fc4 0 2024-05-09T00:07:49.128 INFO:tasks.workunit.client.0.smithi026.stdout:4/555: dread - d0/d12/da2/d97/d43/d58/f6b zero size 2024-05-09T00:07:49.131 INFO:tasks.workunit.client.0.smithi026.stdout:1/610: symlink d5/dd/d1f/ld4 0 2024-05-09T00:07:49.134 INFO:tasks.workunit.client.0.smithi026.stdout:4/556: write d0/d12/d64/dac/fb5 [4136859,4467] 0 2024-05-09T00:07:49.134 INFO:tasks.workunit.client.0.smithi026.stdout:4/557: fdatasync d0/d12/d1b/f3c 0 2024-05-09T00:07:49.134 INFO:tasks.workunit.client.0.smithi026.stdout:4/558: write d0/d83/f76 [1003744,109102] 0 2024-05-09T00:07:49.134 INFO:tasks.workunit.client.0.smithi026.stdout:4/559: dread - d0/d12/da2/d97/d43/d58/f69 zero size 2024-05-09T00:07:49.135 INFO:tasks.workunit.client.0.smithi026.stdout:8/656: mknod de/d48/d73/d91/cda 0 2024-05-09T00:07:49.137 INFO:tasks.workunit.client.0.smithi026.stdout:3/513: mkdir d5/da7 0 2024-05-09T00:07:49.139 INFO:tasks.workunit.client.0.smithi026.stdout:2/507: dread d14/d22/f33 [0,4194304] 0 2024-05-09T00:07:49.139 INFO:tasks.workunit.client.0.smithi026.stdout:9/593: dwrite d7/d26/fa6 [0,4194304] 0 2024-05-09T00:07:49.142 INFO:tasks.workunit.client.0.smithi026.stdout:0/657: dwrite d1d/d33/dbb/f72 [0,4194304] 0 2024-05-09T00:07:49.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/594: write d7/d23/d2f/d3a/f55 [376232,117048] 0 2024-05-09T00:07:49.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/595: chown d7/d23/d29/d31/l49 0 1 2024-05-09T00:07:49.146 INFO:tasks.workunit.client.0.smithi026.stdout:2/508: dread d14/d22/f33 [0,4194304] 0 2024-05-09T00:07:49.146 INFO:tasks.workunit.client.0.smithi026.stdout:4/560: symlink d0/d12/da2/d97/d43/d58/lc8 0 2024-05-09T00:07:49.150 INFO:tasks.workunit.client.0.smithi026.stdout:3/514: dread d5/d9/dc/f1b [4194304,4194304] 0 2024-05-09T00:07:49.151 INFO:tasks.workunit.client.0.smithi026.stdout:7/731: dwrite d8/d2e/d84/db4/dbc/d1e/d3d/f61 [0,4194304] 0 2024-05-09T00:07:49.153 INFO:tasks.workunit.client.0.smithi026.stdout:1/611: dwrite d5/db/f69 [0,4194304] 0 2024-05-09T00:07:49.155 INFO:tasks.workunit.client.0.smithi026.stdout:7/732: dread d8/d2e/d84/db4/dbc/d1e/d3d/d6b/fa3 [0,4194304] 0 2024-05-09T00:07:49.156 INFO:tasks.workunit.client.0.smithi026.stdout:7/733: write d8/f1f [3283213,61043] 0 2024-05-09T00:07:49.157 INFO:tasks.workunit.client.0.smithi026.stdout:7/734: write d8/d2e/d84/db4/dbc/ffd [1011153,54955] 0 2024-05-09T00:07:49.157 INFO:tasks.workunit.client.0.smithi026.stdout:7/735: read - d8/d1b/d89/dc1/f86 zero size 2024-05-09T00:07:49.157 INFO:tasks.workunit.client.0.smithi026.stdout:7/736: fdatasync d8/d5c/fbd 0 2024-05-09T00:07:49.159 INFO:tasks.workunit.client.0.smithi026.stdout:0/658: rmdir d1d/d1e/d2d 39 2024-05-09T00:07:49.160 INFO:tasks.workunit.client.0.smithi026.stdout:0/659: readlink d1d/d1e/d2d/l50 0 2024-05-09T00:07:49.161 INFO:tasks.workunit.client.0.smithi026.stdout:0/660: dread d1d/d1e/d20/d51/f57 [0,4194304] 0 2024-05-09T00:07:49.162 INFO:tasks.workunit.client.0.smithi026.stdout:9/596: symlink d7/d23/d2f/ld6 0 2024-05-09T00:07:49.164 INFO:tasks.workunit.client.0.smithi026.stdout:2/509: rmdir d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85 39 2024-05-09T00:07:49.167 INFO:tasks.workunit.client.0.smithi026.stdout:4/561: rmdir d0/d12/da2/d97/d8c 39 2024-05-09T00:07:49.168 INFO:tasks.workunit.client.0.smithi026.stdout:3/515: symlink d5/d1e/la8 0 2024-05-09T00:07:49.174 INFO:tasks.workunit.client.0.smithi026.stdout:8/657: rename de/d48/d73 to de/d6c/d31/d4f/d87/d62/daa/ddb 0 2024-05-09T00:07:49.174 INFO:tasks.workunit.client.0.smithi026.stdout:8/658: dread - de/d17/d21/fa4 zero size 2024-05-09T00:07:49.174 INFO:tasks.workunit.client.0.smithi026.stdout:8/659: truncate de/d48/f7c 4620584 0 2024-05-09T00:07:49.176 INFO:tasks.workunit.client.0.smithi026.stdout:8/660: dread de/d6c/f78 [0,4194304] 0 2024-05-09T00:07:49.182 INFO:tasks.workunit.client.0.smithi026.stdout:7/737: rmdir d8/d2e/d84 39 2024-05-09T00:07:49.184 INFO:tasks.workunit.client.0.smithi026.stdout:0/661: mkdir d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda 0 2024-05-09T00:07:49.184 INFO:tasks.workunit.client.0.smithi026.stdout:0/662: dread - d1d/d1e/d2d/f49 zero size 2024-05-09T00:07:49.185 INFO:tasks.workunit.client.0.smithi026.stdout:2/510: mknod d14/d22/d55/da3/d3b/d40/d47/cae 0 2024-05-09T00:07:49.186 INFO:tasks.workunit.client.0.smithi026.stdout:4/562: mknod d0/d12/da2/db8/cc9 0 2024-05-09T00:07:49.186 INFO:tasks.workunit.client.0.smithi026.stdout:4/563: chown d0/d12/d64/fab 5354 1 2024-05-09T00:07:49.193 INFO:tasks.workunit.client.0.smithi026.stdout:9/597: rename d7/d23/d2f/ld6 to d7/d23/d29/d31/d40/d41/d54/dc5/ld7 0 2024-05-09T00:07:49.194 INFO:tasks.workunit.client.0.smithi026.stdout:8/661: symlink de/d17/d7d/dd2/ldc 0 2024-05-09T00:07:49.195 INFO:tasks.workunit.client.0.smithi026.stdout:1/612: mkdir d5/d16/dd5 0 2024-05-09T00:07:49.196 INFO:tasks.workunit.client.0.smithi026.stdout:7/738: mkdir d8/d2e/d84/db4/dbc/d22/d105 0 2024-05-09T00:07:49.196 INFO:tasks.workunit.client.0.smithi026.stdout:7/739: chown d8/d2e/d84/db4/dbc/d22/fc6 117600 1 2024-05-09T00:07:49.198 INFO:tasks.workunit.client.0.smithi026.stdout:2/511: getdents d14/d22/d55/da3/d3b/d40/d68 0 2024-05-09T00:07:49.202 INFO:tasks.workunit.client.0.smithi026.stdout:9/598: creat d7/d23/d29/d2e/fd8 x:0 0 0 2024-05-09T00:07:49.203 INFO:tasks.workunit.client.0.smithi026.stdout:9/599: write d7/d26/f71 [805031,56940] 0 2024-05-09T00:07:49.203 INFO:tasks.workunit.client.0.smithi026.stdout:9/600: readlink d7/l18 0 2024-05-09T00:07:49.203 INFO:tasks.workunit.client.0.smithi026.stdout:0/663: dwrite f5 [0,4194304] 0 2024-05-09T00:07:49.205 INFO:tasks.workunit.client.0.smithi026.stdout:8/662: rmdir de/d6c/d31/d4f/d87/d62 39 2024-05-09T00:07:49.209 INFO:tasks.workunit.client.0.smithi026.stdout:1/613: symlink d5/dd/d17/d7b/dcd/ld6 0 2024-05-09T00:07:49.212 INFO:tasks.workunit.client.0.smithi026.stdout:7/740: unlink d8/d2e/d84/db4/dbc/d1e/feb 0 2024-05-09T00:07:49.212 INFO:tasks.workunit.client.0.smithi026.stdout:7/741: truncate d8/d5c/fd7 564654 0 2024-05-09T00:07:49.212 INFO:tasks.workunit.client.0.smithi026.stdout:7/742: write d8/d1b/ff7 [1240,53433] 0 2024-05-09T00:07:49.212 INFO:tasks.workunit.client.0.smithi026.stdout:7/743: truncate d8/d1b/d89/dc1/db0/fdc 1011200 0 2024-05-09T00:07:49.212 INFO:tasks.workunit.client.0.smithi026.stdout:9/601: unlink d7/l18 0 2024-05-09T00:07:49.215 INFO:tasks.workunit.client.0.smithi026.stdout:0/664: creat d1d/d25/d47/d6e/dc2/fdb x:0 0 0 2024-05-09T00:07:49.216 INFO:tasks.workunit.client.0.smithi026.stdout:8/663: creat de/d6c/d31/d4f/d87/d62/daa/ddb/d91/fdd x:0 0 0 2024-05-09T00:07:49.217 INFO:tasks.workunit.client.0.smithi026.stdout:4/564: dwrite d0/d12/da2/d97/d43/d58/f6a [0,4194304] 0 2024-05-09T00:07:49.219 INFO:tasks.workunit.client.0.smithi026.stdout:1/614: mknod d5/d16/d60/d66/d97/d94/db1/dc2/cd7 0 2024-05-09T00:07:49.222 INFO:tasks.workunit.client.0.smithi026.stdout:9/602: dread d7/d23/d2f/d50/fb9 [0,4194304] 0 2024-05-09T00:07:49.222 INFO:tasks.workunit.client.0.smithi026.stdout:9/603: chown d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc 177391083 1 2024-05-09T00:07:49.222 INFO:tasks.workunit.client.0.smithi026.stdout:2/512: dwrite d14/d22/d55/da3/d17/f8b [0,4194304] 0 2024-05-09T00:07:49.222 INFO:tasks.workunit.client.0.smithi026.stdout:2/513: fdatasync d14/d22/d55/da3/d20/d41/d51/f94 0 2024-05-09T00:07:49.223 INFO:tasks.workunit.client.0.smithi026.stdout:0/665: creat d1d/d1e/d20/d4d/d58/d62/d96/fdc x:0 0 0 2024-05-09T00:07:49.225 INFO:tasks.workunit.client.0.smithi026.stdout:8/664: unlink de/d6c/d31/d4f/d87/c75 0 2024-05-09T00:07:49.225 INFO:tasks.workunit.client.0.smithi026.stdout:8/665: fdatasync de/d17/d21/d24/d3b/d3d/f5f 0 2024-05-09T00:07:49.227 INFO:tasks.workunit.client.0.smithi026.stdout:4/565: creat d0/d12/da2/d97/dbf/fca x:0 0 0 2024-05-09T00:07:49.228 INFO:tasks.workunit.client.0.smithi026.stdout:1/615: creat d5/dd/d17/d9f/da5/dd2/fd8 x:0 0 0 2024-05-09T00:07:49.228 INFO:tasks.workunit.client.0.smithi026.stdout:9/604: dread d7/d23/d29/d31/f32 [0,4194304] 0 2024-05-09T00:07:49.232 INFO:tasks.workunit.client.0.smithi026.stdout:2/514: creat d14/d22/d55/da3/d20/d41/faf x:0 0 0 2024-05-09T00:07:49.234 INFO:tasks.workunit.client.0.smithi026.stdout:0/666: link d1d/d25/d47/d6e/f8e d1d/d1e/d2d/fdd 0 2024-05-09T00:07:49.234 INFO:tasks.workunit.client.0.smithi026.stdout:0/667: write d1d/d33/d64/fb2 [1754425,35207] 0 2024-05-09T00:07:49.234 INFO:tasks.workunit.client.0.smithi026.stdout:9/605: dread d7/f1f [0,4194304] 0 2024-05-09T00:07:49.234 INFO:tasks.workunit.client.0.smithi026.stdout:9/606: fdatasync d7/d23/d2f/f35 0 2024-05-09T00:07:49.234 INFO:tasks.workunit.client.0.smithi026.stdout:9/607: fsync d7/d23/d29/d31/fbd 0 2024-05-09T00:07:49.236 INFO:tasks.workunit.client.0.smithi026.stdout:8/666: creat de/d17/d21/d24/d5b/fde x:0 0 0 2024-05-09T00:07:49.237 INFO:tasks.workunit.client.0.smithi026.stdout:4/566: truncate d0/d12/d64/dac/fb5 1976271 0 2024-05-09T00:07:49.240 INFO:tasks.workunit.client.0.smithi026.stdout:2/515: mknod d14/d22/d55/da3/d20/cb0 0 2024-05-09T00:07:49.242 INFO:tasks.workunit.client.0.smithi026.stdout:0/668: truncate f11 535710 0 2024-05-09T00:07:49.249 INFO:tasks.workunit.client.0.smithi026.stdout:1/616: rename d5/d16/fad to d5/dd/d17/fd9 0 2024-05-09T00:07:49.249 INFO:tasks.workunit.client.0.smithi026.stdout:1/617: truncate d5/d16/d60/d66/d97/f4d 4262617 0 2024-05-09T00:07:49.249 INFO:tasks.workunit.client.0.smithi026.stdout:8/667: dwrite de/d6c/d31/f97 [0,4194304] 0 2024-05-09T00:07:49.249 INFO:tasks.workunit.client.0.smithi026.stdout:8/668: dread - de/d17/d21/dca/fcc zero size 2024-05-09T00:07:49.251 INFO:tasks.workunit.client.0.smithi026.stdout:2/516: getdents d14/d22/d55/da3/d3b/d40/d47 0 2024-05-09T00:07:49.253 INFO:tasks.workunit.client.0.smithi026.stdout:4/567: rename d0/lf to d0/d83/lcb 0 2024-05-09T00:07:49.261 INFO:tasks.workunit.client.0.smithi026.stdout:1/618: dread d5/dd/d1f/d39/d47/f59 [0,4194304] 0 2024-05-09T00:07:49.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/744: dwrite d8/d1b/f37 [0,4194304] 0 2024-05-09T00:07:49.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/745: write d8/d1b/d89/dc1/db0/fff [298347,5873] 0 2024-05-09T00:07:49.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/746: write d8/d5c/fcb [394605,66165] 0 2024-05-09T00:07:49.263 INFO:tasks.workunit.client.0.smithi026.stdout:2/517: symlink d14/d22/d55/da3/d30/lb1 0 2024-05-09T00:07:49.264 INFO:tasks.workunit.client.0.smithi026.stdout:0/669: write f11 [840834,16820] 0 2024-05-09T00:07:49.266 INFO:tasks.workunit.client.0.smithi026.stdout:8/669: rename de/d6c/d31/d4f/d87/d62/cb9 to de/d17/d21/cdf 0 2024-05-09T00:07:49.269 INFO:tasks.workunit.client.0.smithi026.stdout:8/670: write de/f13 [4480283,70827] 0 2024-05-09T00:07:49.270 INFO:tasks.workunit.client.0.smithi026.stdout:4/568: mknod d0/d12/d87/ccc 0 2024-05-09T00:07:49.271 INFO:tasks.workunit.client.0.smithi026.stdout:1/619: unlink d5/d16/la8 0 2024-05-09T00:07:49.271 INFO:tasks.workunit.client.0.smithi026.stdout:1/620: dread - d5/d16/d60/f6d zero size 2024-05-09T00:07:49.275 INFO:tasks.workunit.client.0.smithi026.stdout:7/747: truncate d8/d5c/d9a/f9c 971980 0 2024-05-09T00:07:49.276 INFO:tasks.workunit.client.0.smithi026.stdout:7/748: stat d8/d2e/d84/db4/dbc/d1e/d8a/cbb 0 2024-05-09T00:07:49.280 INFO:tasks.workunit.client.0.smithi026.stdout:0/670: creat d1d/d1e/fde x:0 0 0 2024-05-09T00:07:49.281 INFO:tasks.workunit.client.0.smithi026.stdout:8/671: mknod de/d6c/db5/ce0 0 2024-05-09T00:07:49.281 INFO:tasks.workunit.client.0.smithi026.stdout:2/518: dwrite d14/d22/d55/da3/d17/fad [0,4194304] 0 2024-05-09T00:07:49.282 INFO:tasks.workunit.client.0.smithi026.stdout:1/621: mkdir d5/d16/d60/dda 0 2024-05-09T00:07:49.284 INFO:tasks.workunit.client.0.smithi026.stdout:7/749: symlink d8/d2e/d84/db4/dbc/d1e/d8a/df5/l106 0 2024-05-09T00:07:49.286 INFO:tasks.workunit.client.0.smithi026.stdout:0/671: mknod d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/cdf 0 2024-05-09T00:07:49.287 INFO:tasks.workunit.client.0.smithi026.stdout:4/569: dwrite d0/d12/da2/d97/d43/d49/fc7 [0,4194304] 0 2024-05-09T00:07:49.287 INFO:tasks.workunit.client.0.smithi026.stdout:8/672: rename de/d6c/d31/f97 to de/d6c/d31/d4f/d87/fe1 0 2024-05-09T00:07:49.288 INFO:tasks.workunit.client.0.smithi026.stdout:8/673: fsync de/d17/fa8 0 2024-05-09T00:07:49.289 INFO:tasks.workunit.client.0.smithi026.stdout:1/622: mknod d5/d16/d60/dda/cdb 0 2024-05-09T00:07:49.289 INFO:tasks.workunit.client.0.smithi026.stdout:1/623: fsync d5/db/f69 0 2024-05-09T00:07:49.290 INFO:tasks.workunit.client.0.smithi026.stdout:7/750: dread d8/d5c/d9a/fc4 [0,4194304] 0 2024-05-09T00:07:49.290 INFO:tasks.workunit.client.0.smithi026.stdout:7/751: write d8/d1b/d89/fef [1300286,77422] 0 2024-05-09T00:07:49.290 INFO:tasks.workunit.client.0.smithi026.stdout:7/752: chown d8/d5c/fd7 2022959 1 2024-05-09T00:07:49.291 INFO:tasks.workunit.client.0.smithi026.stdout:7/753: dread d8/d1b/ff7 [0,4194304] 0 2024-05-09T00:07:49.313 INFO:tasks.workunit.client.0.smithi026.stdout:4/570: creat d0/d12/da2/d97/d43/d49/d8f/dc1/fcd x:0 0 0 2024-05-09T00:07:49.317 INFO:tasks.workunit.client.0.smithi026.stdout:2/519: rename d14/d22/d55/da3/d1f to d14/d22/d55/da3/d20/db2 0 2024-05-09T00:07:49.317 INFO:tasks.workunit.client.0.smithi026.stdout:2/520: truncate d14/d22/d55/da3/d20/f2a 645677 0 2024-05-09T00:07:49.318 INFO:tasks.workunit.client.0.smithi026.stdout:1/624: creat d5/d16/d60/d66/fdc x:0 0 0 2024-05-09T00:07:49.320 INFO:tasks.workunit.client.0.smithi026.stdout:1/625: dread d5/dd/d1f/d39/f8e [0,4194304] 0 2024-05-09T00:07:49.322 INFO:tasks.workunit.client.0.smithi026.stdout:7/754: creat d8/f107 x:0 0 0 2024-05-09T00:07:49.324 INFO:tasks.workunit.client.0.smithi026.stdout:0/672: truncate f5 1490078 0 2024-05-09T00:07:49.326 INFO:tasks.workunit.client.0.smithi026.stdout:4/571: rmdir d0/d12/da2/d97/d43/d58 39 2024-05-09T00:07:49.326 INFO:tasks.workunit.client.0.smithi026.stdout:4/572: write d0/d12/f79 [913850,33558] 0 2024-05-09T00:07:49.329 INFO:tasks.workunit.client.0.smithi026.stdout:8/674: rename de/d6c/d31/fa2 to de/d6c/d31/d4f/d87/fe2 0 2024-05-09T00:07:49.334 INFO:tasks.workunit.client.0.smithi026.stdout:4/573: write d0/d12/d1b/f74 [1262992,55610] 0 2024-05-09T00:07:49.334 INFO:tasks.workunit.client.0.smithi026.stdout:4/574: fdatasync d0/d12/da2/d97/d43/d58/f6b 0 2024-05-09T00:07:49.335 INFO:tasks.workunit.client.0.smithi026.stdout:8/675: mkdir de/d6c/de3 0 2024-05-09T00:07:49.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/676: write de/d48/f52 [2881520,35673] 0 2024-05-09T00:07:49.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/677: write de/d6c/d31/d4f/d87/fe2 [762674,57297] 0 2024-05-09T00:07:49.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/678: chown de/d6c/d31/d4f/d87/d62/daa/ddb/d91/cda 21546 1 2024-05-09T00:07:49.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/679: fsync de/d17/d21/d24/d5b/fbf 0 2024-05-09T00:07:49.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/680: fdatasync de/d6c/f3c 0 2024-05-09T00:07:49.340 INFO:tasks.workunit.client.0.smithi026.stdout:4/575: mknod d0/d12/da2/cce 0 2024-05-09T00:07:49.342 INFO:tasks.workunit.client.0.smithi026.stdout:8/681: mknod de/d17/d7d/ce4 0 2024-05-09T00:07:49.344 INFO:tasks.workunit.client.0.smithi026.stdout:4/576: getdents d0/d12/da2/d97 0 2024-05-09T00:07:49.346 INFO:tasks.workunit.client.0.smithi026.stdout:0/673: dwrite d1d/f29 [0,4194304] 0 2024-05-09T00:07:49.346 INFO:tasks.workunit.client.0.smithi026.stdout:2/521: dwrite d14/d22/d55/da3/d20/fac [0,4194304] 0 2024-05-09T00:07:49.346 INFO:tasks.workunit.client.0.smithi026.stdout:2/522: dread - d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/f8d zero size 2024-05-09T00:07:49.348 INFO:tasks.workunit.client.0.smithi026.stdout:5/534: sync 2024-05-09T00:07:49.356 INFO:tasks.workunit.client.0.smithi026.stdout:2/523: dread d14/d22/d55/da3/d20/f8c [0,4194304] 0 2024-05-09T00:07:49.357 INFO:tasks.workunit.client.0.smithi026.stdout:0/674: creat d1d/d1e/d20/d4d/d58/d62/d78/fe0 x:0 0 0 2024-05-09T00:07:49.360 INFO:tasks.workunit.client.0.smithi026.stdout:5/535: symlink d2/d8/lae 0 2024-05-09T00:07:49.363 INFO:tasks.workunit.client.0.smithi026.stdout:2/524: creat d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fb3 x:0 0 0 2024-05-09T00:07:49.364 INFO:tasks.workunit.client.0.smithi026.stdout:0/675: symlink d1d/d25/d47/dc8/le1 0 2024-05-09T00:07:49.366 INFO:tasks.workunit.client.0.smithi026.stdout:2/525: truncate d14/d22/d55/da3/d30/d6a/f81 4318834 0 2024-05-09T00:07:49.367 INFO:tasks.workunit.client.0.smithi026.stdout:4/577: dwrite d0/f75 [0,4194304] 0 2024-05-09T00:07:49.374 INFO:tasks.workunit.client.0.smithi026.stdout:4/578: symlink d0/d12/d34/lcf 0 2024-05-09T00:07:49.374 INFO:tasks.workunit.client.0.smithi026.stdout:4/579: truncate d0/d12/da2/d97/d43/d49/d8f/da3/d66/fb9 1662672 0 2024-05-09T00:07:49.375 INFO:tasks.workunit.client.0.smithi026.stdout:2/526: dread d14/d22/d55/f67 [0,4194304] 0 2024-05-09T00:07:49.377 INFO:tasks.workunit.client.0.smithi026.stdout:4/580: creat d0/d12/da2/d97/d43/d49/d8f/da3/d66/fd0 x:0 0 0 2024-05-09T00:07:49.382 INFO:tasks.workunit.client.0.smithi026.stdout:0/676: dwrite d1d/d25/d3c/f88 [0,4194304] 0 2024-05-09T00:07:49.383 INFO:tasks.workunit.client.0.smithi026.stdout:4/581: mkdir d0/d12/da2/d97/dbf/dd1 0 2024-05-09T00:07:49.383 INFO:tasks.workunit.client.0.smithi026.stdout:0/677: write d1d/d1e/d20/d51/f57 [1433324,27574] 0 2024-05-09T00:07:49.384 INFO:tasks.workunit.client.0.smithi026.stdout:5/536: dwrite d2/d8/d31/d2e/f9b [0,4194304] 0 2024-05-09T00:07:49.386 INFO:tasks.workunit.client.0.smithi026.stdout:4/582: dread d0/d83/f76 [0,4194304] 0 2024-05-09T00:07:49.387 INFO:tasks.workunit.client.0.smithi026.stdout:4/583: write d0/d12/d1b/d4e/f50 [696910,1141] 0 2024-05-09T00:07:49.387 INFO:tasks.workunit.client.0.smithi026.stdout:0/678: truncate f1b 1995158 0 2024-05-09T00:07:49.389 INFO:tasks.workunit.client.0.smithi026.stdout:4/584: dread d0/d12/da2/d97/d43/d49/f7f [0,4194304] 0 2024-05-09T00:07:49.389 INFO:tasks.workunit.client.0.smithi026.stdout:4/585: truncate d0/d12/da2/d97/d8c/f9d 98334 0 2024-05-09T00:07:49.392 INFO:tasks.workunit.client.0.smithi026.stdout:5/537: symlink d2/d8/laf 0 2024-05-09T00:07:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:47.908472+0000 mgr.smithi135.kkrhgf (mgr.24419) 57 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 121 MiB/s rd, 264 MiB/s wr, 417 op/s 2024-05-09T00:07:49.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:07:48.111478+0000 mon.smithi135 (mon.1) 61 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:07:49.395 INFO:tasks.workunit.client.0.smithi026.stdout:4/586: mknod d0/d12/d34/cd2 0 2024-05-09T00:07:49.395 INFO:tasks.workunit.client.0.smithi026.stdout:4/587: fdatasync d0/d12/d64/f82 0 2024-05-09T00:07:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:47.908472+0000 mgr.smithi135.kkrhgf (mgr.24419) 57 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 121 MiB/s rd, 264 MiB/s wr, 417 op/s 2024-05-09T00:07:49.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:07:48.111478+0000 mon.smithi135 (mon.1) 61 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:07:49.398 INFO:tasks.workunit.client.0.smithi026.stdout:5/538: write d2/d8/d31/d24/f7b [389059,72606] 0 2024-05-09T00:07:49.398 INFO:tasks.workunit.client.0.smithi026.stdout:2/527: dwrite d14/d22/d55/f67 [0,4194304] 0 2024-05-09T00:07:49.398 INFO:tasks.workunit.client.0.smithi026.stdout:2/528: chown d14/d22/d55/da3/d20/f8c 11569548 1 2024-05-09T00:07:49.401 INFO:tasks.workunit.client.0.smithi026.stdout:5/539: rename d2/d5a/d96/f5e to d2/d8/d31/d32/fb0 0 2024-05-09T00:07:49.402 INFO:tasks.workunit.client.0.smithi026.stdout:0/679: dwrite d1d/d1e/d20/d51/f6c [0,4194304] 0 2024-05-09T00:07:49.402 INFO:tasks.workunit.client.0.smithi026.stdout:0/680: fdatasync d1d/d33/fb1 0 2024-05-09T00:07:49.402 INFO:tasks.workunit.client.0.smithi026.stdout:0/681: chown d1d/d25/d47/dc8/le1 7593 1 2024-05-09T00:07:49.403 INFO:tasks.workunit.client.0.smithi026.stdout:2/529: creat d14/d22/d55/da3/d30/d6a/d5f/d61/fb4 x:0 0 0 2024-05-09T00:07:49.405 INFO:tasks.workunit.client.0.smithi026.stdout:0/682: read f11 [494705,78007] 0 2024-05-09T00:07:49.405 INFO:tasks.workunit.client.0.smithi026.stdout:0/683: fsync d1d/d33/d64/fd6 0 2024-05-09T00:07:49.405 INFO:tasks.workunit.client.0.smithi026.stdout:0/684: write d1d/d25/f65 [665388,46969] 0 2024-05-09T00:07:49.406 INFO:tasks.workunit.client.0.smithi026.stdout:5/540: symlink d2/d8/d31/d2e/d79/lb1 0 2024-05-09T00:07:49.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/588: dwrite d0/fc [0,4194304] 0 2024-05-09T00:07:49.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/589: write d0/d12/da2/d97/f1e [4539890,129471] 0 2024-05-09T00:07:49.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/590: chown d0/d12/da2/d97/d43/d49/d8f/da3/d66 46648 1 2024-05-09T00:07:49.413 INFO:tasks.workunit.client.0.smithi026.stdout:4/591: write d0/f75 [2814610,49077] 0 2024-05-09T00:07:49.422 INFO:tasks.workunit.client.0.smithi026.stdout:2/530: symlink d14/d22/d55/da3/d3b/d40/d47/lb5 0 2024-05-09T00:07:49.426 INFO:tasks.workunit.client.0.smithi026.stdout:0/685: mkdir d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc/de2 0 2024-05-09T00:07:49.428 INFO:tasks.workunit.client.0.smithi026.stdout:5/541: link d2/d8/d2a/c94 d2/d8/d31/d2e/d4a/cb2 0 2024-05-09T00:07:49.429 INFO:tasks.workunit.client.0.smithi026.stdout:5/542: read d2/d8/d31/d2e/f9b [1439909,99472] 0 2024-05-09T00:07:49.429 INFO:tasks.workunit.client.0.smithi026.stdout:2/531: dread d14/d22/d55/f67 [4194304,4194304] 0 2024-05-09T00:07:49.429 INFO:tasks.workunit.client.0.smithi026.stdout:2/532: write d14/d22/d55/da3/f39 [1323280,121777] 0 2024-05-09T00:07:49.430 INFO:tasks.workunit.client.0.smithi026.stdout:5/543: write d2/d8/d31/d2e/d4a/f3d [562799,128942] 0 2024-05-09T00:07:49.432 INFO:tasks.workunit.client.0.smithi026.stdout:4/592: mkdir d0/d12/d64/dac/dd3 0 2024-05-09T00:07:49.434 INFO:tasks.workunit.client.0.smithi026.stdout:0/686: rmdir d1d/d25/d47/da5 0 2024-05-09T00:07:49.437 INFO:tasks.workunit.client.0.smithi026.stdout:2/533: link d14/d22/d55/da3/d30/d6a/l62 d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/lb6 0 2024-05-09T00:07:49.437 INFO:tasks.workunit.client.0.smithi026.stdout:2/534: truncate d14/d22/d55/da3/d20/fa2 1502841 0 2024-05-09T00:07:49.437 INFO:tasks.workunit.client.0.smithi026.stdout:2/535: write d14/d22/d55/d6b/f7f [3271661,94372] 0 2024-05-09T00:07:49.438 INFO:tasks.workunit.client.0.smithi026.stdout:2/536: stat d14/d22/d55/da3/d20/f2a 0 2024-05-09T00:07:49.439 INFO:tasks.workunit.client.0.smithi026.stdout:2/537: write d14/d22/d55/f9f [3873144,98442] 0 2024-05-09T00:07:49.441 INFO:tasks.workunit.client.0.smithi026.stdout:5/544: mkdir d2/d8/d31/d32/d48/db3 0 2024-05-09T00:07:49.444 INFO:tasks.workunit.client.0.smithi026.stdout:4/593: rmdir d0/d83/dbd 0 2024-05-09T00:07:49.444 INFO:tasks.workunit.client.0.smithi026.stdout:4/594: stat d0/d12/da2/d97/d43/d49/c59 0 2024-05-09T00:07:49.445 INFO:tasks.workunit.client.0.smithi026.stdout:0/687: creat d1d/d1e/d20/d4d/d58/fe3 x:0 0 0 2024-05-09T00:07:49.445 INFO:tasks.workunit.client.0.smithi026.stdout:0/688: truncate d1d/d1e/d20/d4d/d58/fe3 160404 0 2024-05-09T00:07:49.446 INFO:tasks.workunit.client.0.smithi026.stdout:4/595: dread d0/d12/d1b/d4e/f50 [0,4194304] 0 2024-05-09T00:07:49.457 INFO:tasks.workunit.client.0.smithi026.stdout:2/538: dread d14/d22/d55/da3/d20/fa2 [0,4194304] 0 2024-05-09T00:07:49.457 INFO:tasks.workunit.client.0.smithi026.stdout:2/539: write d14/f86 [757388,126948] 0 2024-05-09T00:07:49.483 INFO:tasks.workunit.client.0.smithi026.stdout:5/545: dwrite d2/d5a/f5f [0,4194304] 0 2024-05-09T00:07:49.486 INFO:tasks.workunit.client.0.smithi026.stdout:5/546: rmdir d2/d8/d31/d2e/d79 39 2024-05-09T00:07:49.488 INFO:tasks.workunit.client.0.smithi026.stdout:2/540: dwrite f11 [0,4194304] 0 2024-05-09T00:07:49.488 INFO:tasks.workunit.client.0.smithi026.stdout:0/689: dwrite f1b [0,4194304] 0 2024-05-09T00:07:49.488 INFO:tasks.workunit.client.0.smithi026.stdout:4/596: dwrite d0/f9 [4194304,4194304] 0 2024-05-09T00:07:49.488 INFO:tasks.workunit.client.0.smithi026.stdout:4/597: dread - d0/d12/da2/db8/fc4 zero size 2024-05-09T00:07:49.488 INFO:tasks.workunit.client.0.smithi026.stdout:4/598: chown d0/fe 226622 1 2024-05-09T00:07:49.494 INFO:tasks.workunit.client.0.smithi026.stdout:4/599: unlink d0/d12/da2/d97/d43/d58/cae 0 2024-05-09T00:07:49.494 INFO:tasks.workunit.client.0.smithi026.stdout:4/600: stat d0/d12/d1b/c41 0 2024-05-09T00:07:49.494 INFO:tasks.workunit.client.0.smithi026.stdout:4/601: write d0/d83/f9e [953913,23151] 0 2024-05-09T00:07:49.495 INFO:tasks.workunit.client.0.smithi026.stdout:2/541: dread d14/d22/d55/da3/d30/d6a/f63 [0,4194304] 0 2024-05-09T00:07:49.495 INFO:tasks.workunit.client.0.smithi026.stdout:6/463: sync 2024-05-09T00:07:49.496 INFO:tasks.workunit.client.0.smithi026.stdout:6/464: fsync d15/d1e/d23/f4a 0 2024-05-09T00:07:49.498 INFO:tasks.workunit.client.0.smithi026.stdout:2/542: symlink d14/d22/d55/da3/d30/lb7 0 2024-05-09T00:07:49.498 INFO:tasks.workunit.client.0.smithi026.stdout:0/690: dread d1d/d1e/d2d/f8f [0,4194304] 0 2024-05-09T00:07:49.502 INFO:tasks.workunit.client.0.smithi026.stdout:0/691: write d1d/d1e/d20/d4d/d58/d62/d78/f99 [458942,72030] 0 2024-05-09T00:07:49.502 INFO:tasks.workunit.client.0.smithi026.stdout:5/547: dread d2/d5a/f5f [0,4194304] 0 2024-05-09T00:07:49.502 INFO:tasks.workunit.client.0.smithi026.stdout:5/548: write d2/d8/d2a/f88 [146680,24420] 0 2024-05-09T00:07:49.502 INFO:tasks.workunit.client.0.smithi026.stdout:6/465: write d15/f29 [1273652,35879] 0 2024-05-09T00:07:49.502 INFO:tasks.workunit.client.0.smithi026.stdout:2/543: mkdir d14/d22/d55/da3/d30/d6a/d5b/db8 0 2024-05-09T00:07:49.502 INFO:tasks.workunit.client.0.smithi026.stdout:6/466: write d15/d34/d52/f82 [293738,8229] 0 2024-05-09T00:07:49.503 INFO:tasks.workunit.client.0.smithi026.stdout:6/467: readlink d15/d1e/d30/d32/l4e 0 2024-05-09T00:07:49.511 INFO:tasks.workunit.client.0.smithi026.stdout:4/602: dwrite d0/d12/f30 [0,4194304] 0 2024-05-09T00:07:49.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/692: rename d1d/d1e/d20/d51/f90 to d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/fe4 0 2024-05-09T00:07:49.515 INFO:tasks.workunit.client.0.smithi026.stdout:0/693: write d1d/d1e/d20/d51/f5c [3051312,108233] 0 2024-05-09T00:07:49.515 INFO:tasks.workunit.client.0.smithi026.stdout:5/549: mkdir d2/d8/d31/d32/d48/daa/db4 0 2024-05-09T00:07:49.515 INFO:tasks.workunit.client.0.smithi026.stdout:5/550: fdatasync d2/fc 0 2024-05-09T00:07:49.517 INFO:tasks.workunit.client.0.smithi026.stdout:2/544: getdents d14/d22/d55/da3/d20/d41/d51 0 2024-05-09T00:07:49.518 INFO:tasks.workunit.client.0.smithi026.stdout:6/468: mknod d15/d2b/d33/d55/c96 0 2024-05-09T00:07:49.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/694: mkdir d1d/d1e/d20/de5 0 2024-05-09T00:07:49.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/695: fsync d1d/d1e/d20/f7c 0 2024-05-09T00:07:49.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/696: chown d1d/d1e/d20/d51/fb0 5376053 1 2024-05-09T00:07:49.623 INFO:tasks.workunit.client.0.smithi026.stdout:2/545: creat d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fb9 x:0 0 0 2024-05-09T00:07:49.629 INFO:tasks.workunit.client.0.smithi026.stdout:6/469: link f11 d15/d1e/d23/d6f/f97 0 2024-05-09T00:07:49.633 INFO:tasks.workunit.client.0.smithi026.stdout:6/470: symlink d15/l98 0 2024-05-09T00:07:49.636 INFO:tasks.workunit.client.0.smithi026.stdout:6/471: mknod d15/d34/d52/d8b/c99 0 2024-05-09T00:07:49.640 INFO:tasks.workunit.client.0.smithi026.stdout:2/546: dwrite d14/d22/d55/da3/d30/d6a/f63 [0,4194304] 0 2024-05-09T00:07:49.642 INFO:tasks.workunit.client.0.smithi026.stdout:0/697: dwrite fa [0,4194304] 0 2024-05-09T00:07:49.647 INFO:tasks.workunit.client.0.smithi026.stdout:0/698: unlink d1d/d33/ld5 0 2024-05-09T00:07:49.647 INFO:tasks.workunit.client.0.smithi026.stdout:0/699: write d1d/d25/d3c/f87 [167617,102761] 0 2024-05-09T00:07:49.648 INFO:tasks.workunit.client.0.smithi026.stdout:2/547: rename d14/d22/d55/f60 to d14/d22/d55/da3/d20/db2/fba 0 2024-05-09T00:07:49.648 INFO:tasks.workunit.client.0.smithi026.stdout:6/472: dread d15/d1e/d23/d73/f3c [0,4194304] 0 2024-05-09T00:07:49.650 INFO:tasks.workunit.client.0.smithi026.stdout:0/700: symlink d1d/d33/d64/le6 0 2024-05-09T00:07:49.651 INFO:tasks.workunit.client.0.smithi026.stdout:2/548: getdents d14/d22/d55/da3/d30/d6a/d5b 0 2024-05-09T00:07:49.655 INFO:tasks.workunit.client.0.smithi026.stdout:0/701: creat d1d/d33/d64/fe7 x:0 0 0 2024-05-09T00:07:49.655 INFO:tasks.workunit.client.0.smithi026.stdout:0/702: chown d1d/d1e/d20/d4d/d58/fab 770 1 2024-05-09T00:07:49.658 INFO:tasks.workunit.client.0.smithi026.stdout:2/549: rename d14/d22/d55/da3/d3b/d40/c9c to d14/d22/d55/da3/d30/cbb 0 2024-05-09T00:07:49.660 INFO:tasks.workunit.client.0.smithi026.stdout:2/550: mkdir d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc 0 2024-05-09T00:07:49.661 INFO:tasks.workunit.client.0.smithi026.stdout:2/551: creat d14/d22/d55/fbd x:0 0 0 2024-05-09T00:07:49.662 INFO:tasks.workunit.client.0.smithi026.stdout:2/552: truncate d14/d22/d55/da3/d20/f2a 693372 0 2024-05-09T00:07:49.665 INFO:tasks.workunit.client.0.smithi026.stdout:9/608: sync 2024-05-09T00:07:49.665 INFO:tasks.workunit.client.0.smithi026.stdout:3/516: sync 2024-05-09T00:07:49.666 INFO:tasks.workunit.client.0.smithi026.stdout:9/609: write d7/d23/d29/d31/d40/d41/fb3 [900973,113418] 0 2024-05-09T00:07:49.667 INFO:tasks.workunit.client.0.smithi026.stdout:3/517: symlink d5/d9/d4a/d95/la9 0 2024-05-09T00:07:49.669 INFO:tasks.workunit.client.0.smithi026.stdout:3/518: mkdir d5/d9/d4a/d95/daa 0 2024-05-09T00:07:49.673 INFO:tasks.workunit.client.0.smithi026.stdout:6/473: rmdir d15/d34 39 2024-05-09T00:07:49.675 INFO:tasks.workunit.client.0.smithi026.stdout:6/474: symlink d15/d1e/d23/d73/d8e/l9a 0 2024-05-09T00:07:49.679 INFO:tasks.workunit.client.0.smithi026.stdout:9/610: dread d7/d23/d76/f8c [0,4194304] 0 2024-05-09T00:07:49.680 INFO:tasks.workunit.client.0.smithi026.stdout:0/703: dwrite d1d/d1e/d20/d51/f5c [0,4194304] 0 2024-05-09T00:07:49.681 INFO:tasks.workunit.client.0.smithi026.stdout:2/553: dwrite f9 [0,4194304] 0 2024-05-09T00:07:49.681 INFO:tasks.workunit.client.0.smithi026.stdout:2/554: write d14/d22/d55/da3/d30/d6a/d5f/f9e [130991,43116] 0 2024-05-09T00:07:49.681 INFO:tasks.workunit.client.0.smithi026.stdout:0/704: rmdir d1d/d1e/d20/d4d/d58/d62 39 2024-05-09T00:07:49.682 INFO:tasks.workunit.client.0.smithi026.stdout:2/555: symlink d14/d22/d55/da3/d20/d41/d51/d82/lbe 0 2024-05-09T00:07:49.682 INFO:tasks.workunit.client.0.smithi026.stdout:2/556: dread - d14/d22/d55/da3/d20/d41/faf zero size 2024-05-09T00:07:49.682 INFO:tasks.workunit.client.0.smithi026.stdout:9/611: write d7/d23/d2f/f45 [2495286,72921] 0 2024-05-09T00:07:49.683 INFO:tasks.workunit.client.0.smithi026.stdout:2/557: rename d14/f86 to d14/d22/d55/d6b/fbf 0 2024-05-09T00:07:49.684 INFO:tasks.workunit.client.0.smithi026.stdout:2/558: truncate d14/d22/d55/da3/d20/d41/d51/f94 1109354 0 2024-05-09T00:07:49.684 INFO:tasks.workunit.client.0.smithi026.stdout:0/705: dread d1d/d25/d47/f85 [0,4194304] 0 2024-05-09T00:07:49.685 INFO:tasks.workunit.client.0.smithi026.stdout:0/706: write d1d/d25/d47/d6e/dc2/fdb [49143,49709] 0 2024-05-09T00:07:49.686 INFO:tasks.workunit.client.0.smithi026.stdout:2/559: mknod d14/d22/d55/da3/d30/cc0 0 2024-05-09T00:07:49.688 INFO:tasks.workunit.client.0.smithi026.stdout:0/707: rename d1d/d25/d3c/f87 to d1d/d25/d47/d6e/dc2/fe8 0 2024-05-09T00:07:49.688 INFO:tasks.workunit.client.0.smithi026.stdout:0/708: dread - d1d/d33/dbb/fce zero size 2024-05-09T00:07:49.689 INFO:tasks.workunit.client.0.smithi026.stdout:9/612: symlink d7/d23/d29/d31/d40/d41/d54/ld9 0 2024-05-09T00:07:49.689 INFO:tasks.workunit.client.0.smithi026.stdout:9/613: dread - d7/d23/d76/f90 zero size 2024-05-09T00:07:49.690 INFO:tasks.workunit.client.0.smithi026.stdout:9/614: chown d7/d23/d29/d31/d40/d41/d54/d5c/faa 390947 1 2024-05-09T00:07:49.690 INFO:tasks.workunit.client.0.smithi026.stdout:2/560: mknod d14/d22/d55/da3/d3b/d40/cc1 0 2024-05-09T00:07:49.691 INFO:tasks.workunit.client.0.smithi026.stdout:0/709: symlink d1d/d25/d47/dc8/dcf/le9 0 2024-05-09T00:07:49.694 INFO:tasks.workunit.client.0.smithi026.stdout:2/561: rename d14/d22/d55/da3/d20/d41/d51/f94 to d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fc2 0 2024-05-09T00:07:49.694 INFO:tasks.workunit.client.0.smithi026.stdout:2/562: write d14/d22/d55/da3/d3b/f3f [1880497,48393] 0 2024-05-09T00:07:49.694 INFO:tasks.workunit.client.0.smithi026.stdout:2/563: chown d14/c78 501619057 1 2024-05-09T00:07:49.695 INFO:tasks.workunit.client.0.smithi026.stdout:0/710: unlink d1d/d1e/d20/d51/lc3 0 2024-05-09T00:07:49.695 INFO:tasks.workunit.client.0.smithi026.stdout:9/615: mknod d7/d23/d29/d31/d40/d41/d54/cda 0 2024-05-09T00:07:49.696 INFO:tasks.workunit.client.0.smithi026.stdout:2/564: mkdir d14/d22/d55/da3/d30/dc3 0 2024-05-09T00:07:49.699 INFO:tasks.workunit.client.0.smithi026.stdout:9/616: getdents d7/d23/d29/d31/d40/d41/d54/d5c 0 2024-05-09T00:07:49.699 INFO:tasks.workunit.client.0.smithi026.stdout:9/617: write d7/d23/d29/d59/d91/fd4 [63961,10241] 0 2024-05-09T00:07:49.709 INFO:tasks.workunit.client.0.smithi026.stdout:0/711: dwrite d1d/f5b [0,4194304] 0 2024-05-09T00:07:49.709 INFO:tasks.workunit.client.0.smithi026.stdout:0/712: fsync d1d/d1e/d2d/fdd 0 2024-05-09T00:07:49.713 INFO:tasks.workunit.client.0.smithi026.stdout:0/713: link d1d/d1e/f69 d1d/d1e/d20/fea 0 2024-05-09T00:07:49.713 INFO:tasks.workunit.client.0.smithi026.stdout:0/714: write d1d/d33/dbb/fce [977618,109724] 0 2024-05-09T00:07:49.714 INFO:tasks.workunit.client.0.smithi026.stdout:0/715: link c8 d1d/d1e/d20/d4d/d58/d62/d84/ceb 0 2024-05-09T00:07:49.715 INFO:tasks.workunit.client.0.smithi026.stdout:9/618: dwrite d7/d23/f84 [0,4194304] 0 2024-05-09T00:07:49.717 INFO:tasks.workunit.client.0.smithi026.stdout:0/716: creat d1d/d1e/d20/d4d/fec x:0 0 0 2024-05-09T00:07:49.717 INFO:tasks.workunit.client.0.smithi026.stdout:0/717: readlink d1d/d25/d47/lc4 0 2024-05-09T00:07:49.720 INFO:tasks.workunit.client.0.smithi026.stdout:9/619: getdents d7/d23/d29 0 2024-05-09T00:07:49.720 INFO:tasks.workunit.client.0.smithi026.stdout:9/620: write d7/d23/d29/d31/f32 [4231249,129932] 0 2024-05-09T00:07:49.721 INFO:tasks.workunit.client.0.smithi026.stdout:9/621: read d7/f28 [669864,64466] 0 2024-05-09T00:07:49.727 INFO:tasks.workunit.client.0.smithi026.stdout:9/622: dread d7/d23/d29/d31/f3d [0,4194304] 0 2024-05-09T00:07:49.727 INFO:tasks.workunit.client.0.smithi026.stdout:9/623: chown d7/d23/d2f/d3a/f55 3 1 2024-05-09T00:07:49.730 INFO:tasks.workunit.client.0.smithi026.stdout:9/624: mkdir d7/d23/d29/d31/d40/d41/d54/d9a/da4/ddb 0 2024-05-09T00:07:49.730 INFO:tasks.workunit.client.0.smithi026.stdout:9/625: stat d7/d23/d2f/d50/c53 0 2024-05-09T00:07:49.731 INFO:tasks.workunit.client.0.smithi026.stdout:9/626: symlink d7/d26/ldc 0 2024-05-09T00:07:49.733 INFO:tasks.workunit.client.0.smithi026.stdout:9/627: mkdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd 0 2024-05-09T00:07:49.735 INFO:tasks.workunit.client.0.smithi026.stdout:9/628: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fde x:0 0 0 2024-05-09T00:07:49.735 INFO:tasks.workunit.client.0.smithi026.stdout:9/629: dread - d7/d26/fca zero size 2024-05-09T00:07:49.735 INFO:tasks.workunit.client.0.smithi026.stdout:9/630: chown d7/d23/f84 49803958 1 2024-05-09T00:07:49.737 INFO:tasks.workunit.client.0.smithi026.stdout:0/718: dwrite d1d/d1e/d20/d4d/d58/fe3 [0,4194304] 0 2024-05-09T00:07:49.737 INFO:tasks.workunit.client.0.smithi026.stdout:9/631: symlink d7/d23/d2f/d7d/db2/ldf 0 2024-05-09T00:07:49.743 INFO:tasks.workunit.client.0.smithi026.stdout:2/565: fsync d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fc2 0 2024-05-09T00:07:49.750 INFO:tasks.workunit.client.0.smithi026.stdout:0/719: creat d1d/d25/d47/dc8/fed x:0 0 0 2024-05-09T00:07:49.750 INFO:tasks.workunit.client.0.smithi026.stdout:0/720: chown cd 6403 1 2024-05-09T00:07:49.750 INFO:tasks.workunit.client.0.smithi026.stdout:0/721: write d1d/d25/f7e [28211,74381] 0 2024-05-09T00:07:49.752 INFO:tasks.workunit.client.0.smithi026.stdout:9/632: unlink d7/d23/d29/d31/d40/d41/fa8 0 2024-05-09T00:07:49.756 INFO:tasks.workunit.client.0.smithi026.stdout:0/722: unlink d1d/d1e/d20/l42 0 2024-05-09T00:07:49.759 INFO:tasks.workunit.client.0.smithi026.stdout:2/566: dwrite d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fc2 [0,4194304] 0 2024-05-09T00:07:49.759 INFO:tasks.workunit.client.0.smithi026.stdout:9/633: rename d7/d23/d29/d31/d40/d41/d54/d5c/f7a to d7/d23/d29/d31/d40/d41/d54/d9a/da4/fe0 0 2024-05-09T00:07:49.764 INFO:tasks.workunit.client.0.smithi026.stdout:9/634: rmdir d7/d23/d29/d59/d91 39 2024-05-09T00:07:49.767 INFO:tasks.workunit.client.0.smithi026.stdout:0/723: rename d1d/d25/d47/dc8/dcf to d1d/d1e/d2d/dee 0 2024-05-09T00:07:49.772 INFO:tasks.workunit.client.0.smithi026.stdout:9/635: creat d7/d23/d2f/fe1 x:0 0 0 2024-05-09T00:07:49.772 INFO:tasks.workunit.client.0.smithi026.stdout:9/636: fsync f3 0 2024-05-09T00:07:49.772 INFO:tasks.workunit.client.0.smithi026.stdout:2/567: dread d14/d22/d55/f56 [0,4194304] 0 2024-05-09T00:07:49.777 INFO:tasks.workunit.client.0.smithi026.stdout:0/724: rmdir d1d/d25/d3c 39 2024-05-09T00:07:49.777 INFO:tasks.workunit.client.0.smithi026.stdout:0/725: chown d1d/f3f 4183 1 2024-05-09T00:07:49.780 INFO:tasks.workunit.client.0.smithi026.stdout:2/568: symlink d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/lc4 0 2024-05-09T00:07:49.783 INFO:tasks.workunit.client.0.smithi026.stdout:2/569: chown d14/d22/d55/da3/d20/db2/c27 1 1 2024-05-09T00:07:49.786 INFO:tasks.workunit.client.0.smithi026.stdout:2/570: mkdir d14/d22/d55/da3/d20/d41/d51/dc5 0 2024-05-09T00:07:49.801 INFO:tasks.workunit.client.0.smithi026.stdout:2/571: write d14/d22/d55/da3/f26 [98436,107111] 0 2024-05-09T00:07:49.801 INFO:tasks.workunit.client.0.smithi026.stdout:2/572: fsync d14/d22/d55/da3/f39 0 2024-05-09T00:07:49.803 INFO:tasks.workunit.client.0.smithi026.stdout:0/726: dwrite d1d/d1e/f69 [4194304,4194304] 0 2024-05-09T00:07:49.806 INFO:tasks.workunit.client.0.smithi026.stdout:0/727: creat d1d/fef x:0 0 0 2024-05-09T00:07:49.808 INFO:tasks.workunit.client.0.smithi026.stdout:2/573: mkdir d14/d22/d55/da3/d20/db2/dc6 0 2024-05-09T00:07:49.808 INFO:tasks.workunit.client.0.smithi026.stdout:2/574: truncate fb 4848641 0 2024-05-09T00:07:49.808 INFO:tasks.workunit.client.0.smithi026.stdout:2/575: chown d14/d22/d55/da3/d3b/d40/f8a 628117 1 2024-05-09T00:07:49.808 INFO:tasks.workunit.client.0.smithi026.stdout:2/576: fsync d14/d22/d55/da3/d20/fac 0 2024-05-09T00:07:49.808 INFO:tasks.workunit.client.0.smithi026.stdout:2/577: fsync d14/d22/d55/da3/d17/f8b 0 2024-05-09T00:07:49.809 INFO:tasks.workunit.client.0.smithi026.stdout:0/728: creat d1d/d1e/d20/d4d/d58/ff0 x:0 0 0 2024-05-09T00:07:49.811 INFO:tasks.workunit.client.0.smithi026.stdout:2/578: symlink d14/d22/d55/da3/d3b/d40/d47/lc7 0 2024-05-09T00:07:49.811 INFO:tasks.workunit.client.0.smithi026.stdout:2/579: write d14/d22/d55/da3/d20/d41/d51/fa4 [201954,50355] 0 2024-05-09T00:07:49.813 INFO:tasks.workunit.client.0.smithi026.stdout:0/729: creat d1d/d1e/d20/d4d/d58/d62/d78/d80/ff1 x:0 0 0 2024-05-09T00:07:49.814 INFO:tasks.workunit.client.0.smithi026.stdout:2/580: rmdir d14/d22/d55/da3/d30/d6a/d5b/db8 0 2024-05-09T00:07:49.816 INFO:tasks.workunit.client.0.smithi026.stdout:2/581: rmdir d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc 39 2024-05-09T00:07:49.819 INFO:tasks.workunit.client.0.smithi026.stdout:2/582: creat d14/d22/d55/da3/d20/d41/d51/d82/daa/fc8 x:0 0 0 2024-05-09T00:07:49.819 INFO:tasks.workunit.client.0.smithi026.stdout:2/583: chown d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85 130720425 1 2024-05-09T00:07:49.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/584: dread - d14/d22/d55/da3/d20/f69 zero size 2024-05-09T00:07:49.821 INFO:tasks.workunit.client.0.smithi026.stdout:0/730: dread d1d/d33/fc5 [0,4194304] 0 2024-05-09T00:07:49.825 INFO:tasks.workunit.client.0.smithi026.stdout:0/731: link d1d/d1e/d20/d4d/d58/d62/d78/fe0 d1d/d1e/d20/d4d/d83/da0/dd2/da7/ff2 0 2024-05-09T00:07:49.827 INFO:tasks.workunit.client.0.smithi026.stdout:0/732: getdents d1d/d25/d47/d6e/dc2 0 2024-05-09T00:07:49.828 INFO:tasks.workunit.client.0.smithi026.stdout:2/585: dread d14/d22/d55/da3/d3b/d40/f8a [0,4194304] 0 2024-05-09T00:07:49.830 INFO:tasks.workunit.client.0.smithi026.stdout:0/733: symlink d1d/d33/lf3 0 2024-05-09T00:07:49.830 INFO:tasks.workunit.client.0.smithi026.stdout:0/734: write d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/fe4 [1137579,50125] 0 2024-05-09T00:07:49.834 INFO:tasks.workunit.client.0.smithi026.stdout:2/586: rename d14/d22/d55/da3/d3b/d40/d47/lb5 to d14/d22/d55/da3/d17/lc9 0 2024-05-09T00:07:49.839 INFO:tasks.workunit.client.0.smithi026.stdout:2/587: dread d14/d22/d55/da3/d30/d6a/d5f/f9e [0,4194304] 0 2024-05-09T00:07:49.849 INFO:tasks.workunit.client.0.smithi026.stdout:2/588: dread f11 [0,4194304] 0 2024-05-09T00:07:49.851 INFO:tasks.workunit.client.0.smithi026.stdout:0/735: dwrite d1d/d1e/d2d/f49 [0,4194304] 0 2024-05-09T00:07:49.874 INFO:tasks.workunit.client.0.smithi026.stdout:2/589: dwrite f4 [0,4194304] 0 2024-05-09T00:07:49.874 INFO:tasks.workunit.client.0.smithi026.stdout:2/590: fdatasync d14/d22/d55/da3/d3b/d40/f66 0 2024-05-09T00:07:49.874 INFO:tasks.workunit.client.0.smithi026.stdout:2/591: write f8 [4622460,111374] 0 2024-05-09T00:07:49.874 INFO:tasks.workunit.client.0.smithi026.stdout:2/592: creat d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fca x:0 0 0 2024-05-09T00:07:49.874 INFO:tasks.workunit.client.0.smithi026.stdout:2/593: stat f5 0 2024-05-09T00:07:49.875 INFO:tasks.workunit.client.0.smithi026.stdout:2/594: dread - d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fb9 zero size 2024-05-09T00:07:49.875 INFO:tasks.workunit.client.0.smithi026.stdout:2/595: fdatasync f9 0 2024-05-09T00:07:49.875 INFO:tasks.workunit.client.0.smithi026.stdout:0/736: dwrite fa [4194304,4194304] 0 2024-05-09T00:07:49.877 INFO:tasks.workunit.client.0.smithi026.stdout:1/626: sync 2024-05-09T00:07:49.877 INFO:tasks.workunit.client.0.smithi026.stdout:7/755: sync 2024-05-09T00:07:49.877 INFO:tasks.workunit.client.0.smithi026.stdout:1/627: chown d5/dd/c28 2242398 1 2024-05-09T00:07:49.877 INFO:tasks.workunit.client.0.smithi026.stdout:7/756: readlink d8/d2e/d84/db4/dbc/d1e/d8a/le1 0 2024-05-09T00:07:49.877 INFO:tasks.workunit.client.0.smithi026.stdout:2/596: mknod d14/d22/d55/da3/d20/d41/ccb 0 2024-05-09T00:07:49.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/597: truncate d14/fa8 425484 0 2024-05-09T00:07:49.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/598: chown d14/d22/d55/da3/d3b/d40/d68/c8f 23959266 1 2024-05-09T00:07:49.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/599: write d14/d22/d55/da3/f26 [3657600,55844] 0 2024-05-09T00:07:49.879 INFO:tasks.workunit.client.0.smithi026.stdout:0/737: creat d1d/d1e/d20/d4d/d58/d62/d84/ff4 x:0 0 0 2024-05-09T00:07:49.880 INFO:tasks.workunit.client.0.smithi026.stdout:1/628: mkdir d5/dd/ddd 0 2024-05-09T00:07:49.880 INFO:tasks.workunit.client.0.smithi026.stdout:1/629: fdatasync d5/dd/d17/fd9 0 2024-05-09T00:07:49.880 INFO:tasks.workunit.client.0.smithi026.stdout:1/630: stat d5/d16/d60/d66/d86 0 2024-05-09T00:07:49.883 INFO:tasks.workunit.client.0.smithi026.stdout:7/757: creat d8/d2e/d84/db4/dbc/d22/da1/f108 x:0 0 0 2024-05-09T00:07:49.883 INFO:tasks.workunit.client.0.smithi026.stdout:7/758: write d8/d2e/fea [457770,43218] 0 2024-05-09T00:07:49.886 INFO:tasks.workunit.client.0.smithi026.stdout:2/600: creat d14/d22/fcc x:0 0 0 2024-05-09T00:07:49.889 INFO:tasks.workunit.client.0.smithi026.stdout:0/738: mknod d1d/d1e/d20/d51/cf5 0 2024-05-09T00:07:49.892 INFO:tasks.workunit.client.0.smithi026.stdout:2/601: creat d14/d22/d55/da3/d17/fcd x:0 0 0 2024-05-09T00:07:49.893 INFO:tasks.workunit.client.0.smithi026.stdout:2/602: write fb [3718418,114810] 0 2024-05-09T00:07:49.895 INFO:tasks.workunit.client.0.smithi026.stdout:0/739: unlink d1d/d1e/d20/d4d/d58/d62/c8b 0 2024-05-09T00:07:49.900 INFO:tasks.workunit.client.0.smithi026.stdout:1/631: dwrite d5/dd/d87/f9a [4194304,4194304] 0 2024-05-09T00:07:49.900 INFO:tasks.workunit.client.0.smithi026.stdout:1/632: chown d5/dd/d17/d9f/da5/dd2/fd8 45 1 2024-05-09T00:07:49.900 INFO:tasks.workunit.client.0.smithi026.stdout:1/633: chown d5/db/d1d/f48 1871 1 2024-05-09T00:07:49.902 INFO:tasks.workunit.client.0.smithi026.stdout:0/740: creat d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc/de2/ff6 x:0 0 0 2024-05-09T00:07:49.902 INFO:tasks.workunit.client.0.smithi026.stdout:0/741: dread - d1d/d1e/d20/d4d/d58/d62/d78/fe0 zero size 2024-05-09T00:07:49.903 INFO:tasks.workunit.client.0.smithi026.stdout:1/634: creat d5/dd/d1f/d51/fde x:0 0 0 2024-05-09T00:07:49.904 INFO:tasks.workunit.client.0.smithi026.stdout:0/742: mknod d1d/d1e/d20/d4d/d58/d62/d78/cf7 0 2024-05-09T00:07:49.904 INFO:tasks.workunit.client.0.smithi026.stdout:0/743: fsync d1d/d1e/f32 0 2024-05-09T00:07:49.905 INFO:tasks.workunit.client.0.smithi026.stdout:1/635: mknod d5/dd/cdf 0 2024-05-09T00:07:49.907 INFO:tasks.workunit.client.0.smithi026.stdout:2/603: dread d14/d22/f7d [0,4194304] 0 2024-05-09T00:07:49.907 INFO:tasks.workunit.client.0.smithi026.stdout:0/744: getdents d1d/d33/dbb 0 2024-05-09T00:07:49.907 INFO:tasks.workunit.client.0.smithi026.stdout:0/745: chown d1d/d1e/d20/d4d/d58/d62/c74 1607559903 1 2024-05-09T00:07:49.907 INFO:tasks.workunit.client.0.smithi026.stdout:0/746: read - d1d/d1e/d20/f7c zero size 2024-05-09T00:07:49.909 INFO:tasks.workunit.client.0.smithi026.stdout:1/636: unlink d5/db/d1d/c9d 0 2024-05-09T00:07:49.910 INFO:tasks.workunit.client.0.smithi026.stdout:2/604: truncate d14/d22/d55/f9f 3273721 0 2024-05-09T00:07:49.914 INFO:tasks.workunit.client.0.smithi026.stdout:1/637: rename d5/dd/d17/d9f/da5/dd2 to d5/d16/d60/d66/d97/d94/de0 0 2024-05-09T00:07:49.919 INFO:tasks.workunit.client.0.smithi026.stdout:1/638: mkdir d5/dd/d17/d7b/de1 0 2024-05-09T00:07:49.919 INFO:tasks.workunit.client.0.smithi026.stdout:1/639: mkdir d5/dd/d17/d9f/dc6/de2 0 2024-05-09T00:07:49.919 INFO:tasks.workunit.client.0.smithi026.stdout:1/640: fsync d5/dd/f49 0 2024-05-09T00:07:49.919 INFO:tasks.workunit.client.0.smithi026.stdout:1/641: creat d5/dd/ddd/fe3 x:0 0 0 2024-05-09T00:07:49.920 INFO:tasks.workunit.client.0.smithi026.stdout:1/642: write d5/dd/d17/fd3 [473025,97581] 0 2024-05-09T00:07:49.921 INFO:tasks.workunit.client.0.smithi026.stdout:1/643: write d5/d16/fd0 [2948400,123638] 0 2024-05-09T00:07:49.921 INFO:tasks.workunit.client.0.smithi026.stdout:1/644: truncate d5/d16/d60/d66/fdc 41905 0 2024-05-09T00:07:49.922 INFO:tasks.workunit.client.0.smithi026.stdout:1/645: mkdir d5/d16/dd5/de4 0 2024-05-09T00:07:49.924 INFO:tasks.workunit.client.0.smithi026.stdout:1/646: dread d5/dd/f67 [0,4194304] 0 2024-05-09T00:07:49.924 INFO:tasks.workunit.client.0.smithi026.stdout:1/647: chown d5/dd/f49 4190 1 2024-05-09T00:07:49.930 INFO:tasks.workunit.client.0.smithi026.stdout:0/747: dwrite d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/fe4 [0,4194304] 0 2024-05-09T00:07:49.931 INFO:tasks.workunit.client.0.smithi026.stdout:0/748: write d1d/d25/f55 [647817,8986] 0 2024-05-09T00:07:49.934 INFO:tasks.workunit.client.0.smithi026.stdout:1/648: dread d5/dd/d17/d73/fb9 [0,4194304] 0 2024-05-09T00:07:49.939 INFO:tasks.workunit.client.0.smithi026.stdout:0/749: creat d1d/d1e/d20/d4d/d58/d62/ff8 x:0 0 0 2024-05-09T00:07:49.939 INFO:tasks.workunit.client.0.smithi026.stdout:0/750: write d1d/d1e/d20/d4d/d58/d62/ff8 [794965,85594] 0 2024-05-09T00:07:49.940 INFO:tasks.workunit.client.0.smithi026.stdout:0/751: creat d1d/d25/d47/dc8/ff9 x:0 0 0 2024-05-09T00:07:49.941 INFO:tasks.workunit.client.0.smithi026.stdout:0/752: mkdir d1d/dfa 0 2024-05-09T00:07:49.942 INFO:tasks.workunit.client.0.smithi026.stdout:1/649: dread d5/dd/d17/f2a [0,4194304] 0 2024-05-09T00:07:49.942 INFO:tasks.workunit.client.0.smithi026.stdout:1/650: chown d5/dd/d1f/ld4 107977 1 2024-05-09T00:07:49.942 INFO:tasks.workunit.client.0.smithi026.stdout:0/753: creat d1d/ffb x:0 0 0 2024-05-09T00:07:49.955 INFO:tasks.workunit.client.0.smithi026.stdout:0/754: write d1d/d1e/d20/fcb [417328,40868] 0 2024-05-09T00:07:49.970 INFO:tasks.workunit.client.0.smithi026.stdout:1/651: dwrite d5/dd/d17/f2a [0,4194304] 0 2024-05-09T00:07:49.971 INFO:tasks.workunit.client.0.smithi026.stdout:1/652: fsync d5/d16/d60/d66/d97/d94/de0/fd8 0 2024-05-09T00:07:49.971 INFO:tasks.workunit.client.0.smithi026.stdout:1/653: chown d5/dd/d1f/d51/fde 999712311 1 2024-05-09T00:07:49.973 INFO:tasks.workunit.client.0.smithi026.stdout:1/654: mknod d5/dd/d17/d7b/de1/ce5 0 2024-05-09T00:07:49.974 INFO:tasks.workunit.client.0.smithi026.stdout:0/755: dwrite d1d/f3f [0,4194304] 0 2024-05-09T00:07:49.986 INFO:tasks.workunit.client.0.smithi026.stdout:1/655: dread d5/d16/d60/d66/d97/f55 [0,4194304] 0 2024-05-09T00:07:49.988 INFO:tasks.workunit.client.0.smithi026.stdout:1/656: dread d5/dd/ff [0,4194304] 0 2024-05-09T00:07:49.993 INFO:tasks.workunit.client.0.smithi026.stdout:0/756: dwrite d1d/d25/d47/d6e/dc2/fdb [0,4194304] 0 2024-05-09T00:07:50.001 INFO:tasks.workunit.client.0.smithi026.stdout:0/757: symlink d1d/d25/d3c/dcd/lfc 0 2024-05-09T00:07:50.004 INFO:tasks.workunit.client.0.smithi026.stdout:1/657: dwrite d5/db/d1d/f48 [0,4194304] 0 2024-05-09T00:07:50.004 INFO:tasks.workunit.client.0.smithi026.stdout:1/658: fdatasync d5/dd/d17/d7b/f9c 0 2024-05-09T00:07:50.004 INFO:tasks.workunit.client.0.smithi026.stdout:0/758: unlink d1d/d1e/d20/d4d/d58/d62/d78/f99 0 2024-05-09T00:07:50.005 INFO:tasks.workunit.client.0.smithi026.stdout:0/759: chown d1d/d1e/d20/d4d/d58 5 1 2024-05-09T00:07:50.009 INFO:tasks.workunit.client.0.smithi026.stdout:1/659: link d5/db/l6c d5/dd/ddd/le6 0 2024-05-09T00:07:50.012 INFO:tasks.workunit.client.0.smithi026.stdout:0/760: mkdir d1d/d25/dfd 0 2024-05-09T00:07:50.014 INFO:tasks.workunit.client.0.smithi026.stdout:1/660: unlink d5/dd/cdf 0 2024-05-09T00:07:50.018 INFO:tasks.workunit.client.0.smithi026.stdout:0/761: mkdir d1d/d1e/d20/d4d/d58/dfe 0 2024-05-09T00:07:50.018 INFO:tasks.workunit.client.0.smithi026.stdout:0/762: stat d1d/d33/d64/fb2 0 2024-05-09T00:07:50.019 INFO:tasks.workunit.client.0.smithi026.stdout:1/661: dread d5/d16/d60/d66/d97/f55 [0,4194304] 0 2024-05-09T00:07:50.020 INFO:tasks.workunit.client.0.smithi026.stdout:0/763: mknod d1d/d1e/d20/d4d/cff 0 2024-05-09T00:07:50.023 INFO:tasks.workunit.client.0.smithi026.stdout:1/662: write d5/d16/f24 [926837,116617] 0 2024-05-09T00:07:50.025 INFO:tasks.workunit.client.0.smithi026.stdout:1/663: symlink d5/dd/d87/db3/le7 0 2024-05-09T00:07:50.038 INFO:tasks.workunit.client.0.smithi026.stdout:0/764: dwrite d1d/d1e/d20/d4d/d83/da0/dd2/da7/ff2 [0,4194304] 0 2024-05-09T00:07:50.045 INFO:tasks.workunit.client.0.smithi026.stdout:1/664: dwrite d5/dd/d87/f9a [0,4194304] 0 2024-05-09T00:07:50.045 INFO:tasks.workunit.client.0.smithi026.stdout:1/665: truncate d5/db/d1d/f48 4394426 0 2024-05-09T00:07:50.054 INFO:tasks.workunit.client.0.smithi026.stdout:1/666: rename d5/d16/d60/d66/d97/d94/db1/dc2/cd7 to d5/dd/d17/d9f/dc6/ce8 0 2024-05-09T00:07:50.054 INFO:tasks.workunit.client.0.smithi026.stdout:1/667: stat d5/dd/d87 0 2024-05-09T00:07:50.056 INFO:tasks.workunit.client.0.smithi026.stdout:1/668: mkdir d5/dd/d17/d9f/de9 0 2024-05-09T00:07:50.058 INFO:tasks.workunit.client.0.smithi026.stdout:1/669: symlink d5/d16/d60/d66/d86/lea 0 2024-05-09T00:07:50.060 INFO:tasks.workunit.client.0.smithi026.stdout:0/765: truncate d1d/d1e/d20/fcb 308497 0 2024-05-09T00:07:50.062 INFO:tasks.workunit.client.0.smithi026.stdout:1/670: mkdir d5/dd/d17/d7b/deb 0 2024-05-09T00:07:50.062 INFO:tasks.workunit.client.0.smithi026.stdout:1/671: write d5/db/f5d [1657079,93348] 0 2024-05-09T00:07:50.064 INFO:tasks.workunit.client.0.smithi026.stdout:1/672: dread d5/dd/d17/d7b/f9c [0,4194304] 0 2024-05-09T00:07:50.064 INFO:tasks.workunit.client.0.smithi026.stdout:1/673: write d5/d16/d60/d66/d97/d94/fce [980269,125268] 0 2024-05-09T00:07:50.066 INFO:tasks.workunit.client.0.smithi026.stdout:0/766: rename d1d/d1e/d20/d4d/d58/d62/d78 to d1d/d1e/d20/d100 0 2024-05-09T00:07:50.070 INFO:tasks.workunit.client.0.smithi026.stdout:0/767: rename d1d/d1e/d20/d4d/d58/d62/d84/ff4 to d1d/d1e/d20/d51/f101 0 2024-05-09T00:07:50.077 INFO:tasks.workunit.client.0.smithi026.stdout:0/768: dread d1d/d25/d3c/f88 [0,4194304] 0 2024-05-09T00:07:50.077 INFO:tasks.workunit.client.0.smithi026.stdout:0/769: truncate d1d/d33/fd9 753204 0 2024-05-09T00:07:50.077 INFO:tasks.workunit.client.0.smithi026.stdout:0/770: chown d1d/d1e/d20/f68 111208376 1 2024-05-09T00:07:50.078 INFO:tasks.workunit.client.0.smithi026.stdout:4/603: sync 2024-05-09T00:07:50.078 INFO:tasks.workunit.client.0.smithi026.stdout:8/682: sync 2024-05-09T00:07:50.078 INFO:tasks.workunit.client.0.smithi026.stdout:5/551: sync 2024-05-09T00:07:50.079 INFO:tasks.workunit.client.0.smithi026.stdout:8/683: stat de/d48/d3e/dc4/dc7 0 2024-05-09T00:07:50.079 INFO:tasks.workunit.client.0.smithi026.stdout:4/604: fdatasync d0/d12/da2/d97/d43/d49/d8f/dc1/fcd 0 2024-05-09T00:07:50.081 INFO:tasks.workunit.client.0.smithi026.stdout:0/771: truncate d1d/d33/dbb/f72 3399803 0 2024-05-09T00:07:50.081 INFO:tasks.workunit.client.0.smithi026.stdout:0/772: fdatasync d1d/d33/d64/fd3 0 2024-05-09T00:07:50.081 INFO:tasks.workunit.client.0.smithi026.stdout:0/773: readlink d1d/d25/d3c/dcd/lfc 0 2024-05-09T00:07:50.084 INFO:tasks.workunit.client.0.smithi026.stdout:4/605: unlink d0/d83/f93 0 2024-05-09T00:07:50.084 INFO:tasks.workunit.client.0.smithi026.stdout:4/606: chown d0/d12/d1b/fc3 50536 1 2024-05-09T00:07:50.087 INFO:tasks.workunit.client.0.smithi026.stdout:5/552: symlink d2/d8/d31/d32/d48/db3/lb5 0 2024-05-09T00:07:50.089 INFO:tasks.workunit.client.0.smithi026.stdout:5/553: write d2/d8/d31/f30 [3426461,18801] 0 2024-05-09T00:07:50.091 INFO:tasks.workunit.client.0.smithi026.stdout:0/774: rename d1d/d1e/d20/d4d/d58 to d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102 0 2024-05-09T00:07:50.094 INFO:tasks.workunit.client.0.smithi026.stdout:8/684: dwrite de/d17/d21/d24/d3b/f80 [0,4194304] 0 2024-05-09T00:07:50.095 INFO:tasks.workunit.client.0.smithi026.stdout:4/607: mkdir d0/d12/d64/dac/dd4 0 2024-05-09T00:07:50.095 INFO:tasks.workunit.client.0.smithi026.stdout:4/608: read - d0/d12/da2/d97/d43/d58/f6b zero size 2024-05-09T00:07:50.097 INFO:tasks.workunit.client.0.smithi026.stdout:5/554: creat d2/d8/d31/d63/d9c/fb6 x:0 0 0 2024-05-09T00:07:50.098 INFO:tasks.workunit.client.0.smithi026.stdout:0/775: symlink d1d/d1e/d20/l103 0 2024-05-09T00:07:50.106 INFO:tasks.workunit.client.0.smithi026.stdout:8/685: rename de/d6c/f3c to de/d17/d21/d24/d5b/fe5 0 2024-05-09T00:07:50.106 INFO:tasks.workunit.client.0.smithi026.stdout:8/686: chown de/d6c/db5 126 1 2024-05-09T00:07:50.107 INFO:tasks.workunit.client.0.smithi026.stdout:4/609: creat d0/d12/da2/fd5 x:0 0 0 2024-05-09T00:07:50.108 INFO:tasks.workunit.client.0.smithi026.stdout:4/610: write d0/d12/da2/d97/d43/d49/f54 [2416660,67617] 0 2024-05-09T00:07:50.109 INFO:tasks.workunit.client.0.smithi026.stdout:4/611: write d0/d12/da2/d97/d43/d49/d8f/da3/f5e [94153,54590] 0 2024-05-09T00:07:50.109 INFO:tasks.workunit.client.0.smithi026.stdout:4/612: truncate d0/d12/d64/f6e 661265 0 2024-05-09T00:07:50.110 INFO:tasks.workunit.client.0.smithi026.stdout:5/555: creat d2/d8/d31/d32/d48/db3/fb7 x:0 0 0 2024-05-09T00:07:50.114 INFO:tasks.workunit.client.0.smithi026.stdout:0/776: rename d1d/d25/d3c/dcd to d1d/d1e/d20/d4d/d83/da0/d104 0 2024-05-09T00:07:50.114 INFO:tasks.workunit.client.0.smithi026.stdout:0/777: chown d1d/d33/d64/le6 597 1 2024-05-09T00:07:50.114 INFO:tasks.workunit.client.0.smithi026.stdout:8/687: symlink de/d6c/de3/le6 0 2024-05-09T00:07:50.114 INFO:tasks.workunit.client.0.smithi026.stdout:8/688: write de/d17/d21/d24/d3b/f47 [4367789,97754] 0 2024-05-09T00:07:50.115 INFO:tasks.workunit.client.0.smithi026.stdout:8/689: write de/d17/d21/d24/d5b/fe5 [1482122,92621] 0 2024-05-09T00:07:50.116 INFO:tasks.workunit.client.0.smithi026.stdout:8/690: read de/d17/d21/d24/d3b/d3d/f51 [3131180,40045] 0 2024-05-09T00:07:50.119 INFO:tasks.workunit.client.0.smithi026.stdout:4/613: rmdir d0/d12/da2/d97/d43/d49/d8f/da3/d66/d99 0 2024-05-09T00:07:50.119 INFO:tasks.workunit.client.0.smithi026.stdout:4/614: write d0/d12/da2/d97/d43/d58/fbb [630696,56995] 0 2024-05-09T00:07:50.122 INFO:tasks.workunit.client.0.smithi026.stdout:5/556: rmdir d2/d8/d31/d63 39 2024-05-09T00:07:50.122 INFO:tasks.workunit.client.0.smithi026.stdout:5/557: fsync d2/d8/d6d/f8f 0 2024-05-09T00:07:50.124 INFO:tasks.workunit.client.0.smithi026.stdout:0/778: rename d1d/d25/d47/f85 to d1d/d1e/d20/d4d/d83/da0/f105 0 2024-05-09T00:07:50.126 INFO:tasks.workunit.client.0.smithi026.stdout:8/691: mknod de/d6c/d31/d4f/d87/d62/ce7 0 2024-05-09T00:07:50.127 INFO:tasks.workunit.client.0.smithi026.stdout:8/692: write de/f13 [7167075,36354] 0 2024-05-09T00:07:50.130 INFO:tasks.workunit.client.0.smithi026.stdout:4/615: mknod d0/d12/da2/d97/dbf/cd6 0 2024-05-09T00:07:50.131 INFO:tasks.workunit.client.0.smithi026.stdout:5/558: creat d2/d8/d31/d32/d48/daa/fb8 x:0 0 0 2024-05-09T00:07:50.132 INFO:tasks.workunit.client.0.smithi026.stdout:0/779: mkdir d1d/d1e/d20/d4d/d83/d106 0 2024-05-09T00:07:50.132 INFO:tasks.workunit.client.0.smithi026.stdout:5/559: dread d2/d8/d2a/f88 [0,4194304] 0 2024-05-09T00:07:50.133 INFO:tasks.workunit.client.0.smithi026.stdout:5/560: write d2/d8/d2a/d8d/f9f [1936144,20588] 0 2024-05-09T00:07:50.135 INFO:tasks.workunit.client.0.smithi026.stdout:4/616: creat d0/d12/da2/d97/dbf/fd7 x:0 0 0 2024-05-09T00:07:50.135 INFO:tasks.workunit.client.0.smithi026.stdout:4/617: chown d0/d12/d64/dac/dd3 20 1 2024-05-09T00:07:50.135 INFO:tasks.workunit.client.0.smithi026.stdout:4/618: chown d0/d12/da2/d97/d43/d49/d8f 314638067 1 2024-05-09T00:07:50.136 INFO:tasks.workunit.client.0.smithi026.stdout:4/619: write d0/f4c [3310570,22999] 0 2024-05-09T00:07:50.142 INFO:tasks.workunit.client.0.smithi026.stdout:0/780: unlink f5 0 2024-05-09T00:07:50.146 INFO:tasks.workunit.client.0.smithi026.stdout:4/620: mknod d0/d12/da2/d97/dbf/dd1/cd8 0 2024-05-09T00:07:50.165 INFO:tasks.workunit.client.0.smithi026.stdout:4/621: dwrite d0/d12/da2/d97/d8c/f9d [0,4194304] 0 2024-05-09T00:07:50.169 INFO:tasks.workunit.client.0.smithi026.stdout:4/622: truncate d0/d12/da2/d97/d43/d58/fbb 60754 0 2024-05-09T00:07:50.182 INFO:tasks.workunit.client.0.smithi026.stdout:4/623: dwrite d0/d12/da2/d97/d43/d49/f54 [0,4194304] 0 2024-05-09T00:07:50.189 INFO:tasks.workunit.client.0.smithi026.stdout:4/624: creat d0/d12/da2/d97/d8c/fd9 x:0 0 0 2024-05-09T00:07:50.189 INFO:tasks.workunit.client.0.smithi026.stdout:4/625: read d0/d12/da2/d97/d43/d49/d8f/da3/f3f [1994677,11390] 0 2024-05-09T00:07:50.203 INFO:tasks.workunit.client.0.smithi026.stdout:9/637: sync 2024-05-09T00:07:50.203 INFO:tasks.workunit.client.0.smithi026.stdout:3/519: sync 2024-05-09T00:07:50.203 INFO:tasks.workunit.client.0.smithi026.stdout:6/475: sync 2024-05-09T00:07:50.203 INFO:tasks.workunit.client.0.smithi026.stdout:9/638: readlink d7/d26/l6d 0 2024-05-09T00:07:50.203 INFO:tasks.workunit.client.0.smithi026.stdout:6/476: readlink d15/d1e/d23/d73/l83 0 2024-05-09T00:07:50.204 INFO:tasks.workunit.client.0.smithi026.stdout:3/520: creat d5/d41/fab x:0 0 0 2024-05-09T00:07:50.205 INFO:tasks.workunit.client.0.smithi026.stdout:6/477: getdents d15/d1e/d23 0 2024-05-09T00:07:50.205 INFO:tasks.workunit.client.0.smithi026.stdout:6/478: truncate d15/f77 501278 0 2024-05-09T00:07:50.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/639: mknod d7/d23/d29/d31/d40/d41/d54/dc5/ce2 0 2024-05-09T00:07:50.210 INFO:tasks.workunit.client.0.smithi026.stdout:3/521: creat d5/d9/dc/d28/fac x:0 0 0 2024-05-09T00:07:50.210 INFO:tasks.workunit.client.0.smithi026.stdout:3/522: readlink d5/d9/dc/d28/l82 0 2024-05-09T00:07:50.210 INFO:tasks.workunit.client.0.smithi026.stdout:4/626: dwrite d0/d12/f30 [0,4194304] 0 2024-05-09T00:07:50.211 INFO:tasks.workunit.client.0.smithi026.stdout:4/627: creat d0/d12/da2/d97/d43/d49/d8f/fda x:0 0 0 2024-05-09T00:07:50.211 INFO:tasks.workunit.client.0.smithi026.stdout:4/628: chown d0/d12/da2/d97/d43/d58/lc8 65793540 1 2024-05-09T00:07:50.211 INFO:tasks.workunit.client.0.smithi026.stdout:9/640: dread d7/d23/d29/d59/d91/fd4 [0,4194304] 0 2024-05-09T00:07:50.212 INFO:tasks.workunit.client.0.smithi026.stdout:4/629: link d0/d12/d64/f6e d0/d12/da2/d97/d43/d49/d8f/da3/d86/fdb 0 2024-05-09T00:07:50.214 INFO:tasks.workunit.client.0.smithi026.stdout:4/630: creat d0/d12/da2/d97/dbf/dd1/fdc x:0 0 0 2024-05-09T00:07:50.214 INFO:tasks.workunit.client.0.smithi026.stdout:4/631: dread - d0/d12/da2/d97/d43/d49/d8f/fda zero size 2024-05-09T00:07:50.215 INFO:tasks.workunit.client.0.smithi026.stdout:4/632: write d0/d12/d64/dac/fb5 [2405249,111066] 0 2024-05-09T00:07:50.218 INFO:tasks.workunit.client.0.smithi026.stdout:3/523: dread d5/d1e/d3e/f86 [4194304,4194304] 0 2024-05-09T00:07:50.221 INFO:tasks.workunit.client.0.smithi026.stdout:3/524: creat d5/d9/dc/d28/d63/d81/fad x:0 0 0 2024-05-09T00:07:50.221 INFO:tasks.workunit.client.0.smithi026.stdout:6/479: dwrite d15/d34/d52/d8b/f40 [0,4194304] 0 2024-05-09T00:07:50.222 INFO:tasks.workunit.client.0.smithi026.stdout:3/525: symlink d5/d9/lae 0 2024-05-09T00:07:50.222 INFO:tasks.workunit.client.0.smithi026.stdout:3/526: fdatasync f2 0 2024-05-09T00:07:50.228 INFO:tasks.workunit.client.0.smithi026.stdout:6/480: mknod d15/d1e/d23/d73/c9b 0 2024-05-09T00:07:50.230 INFO:tasks.workunit.client.0.smithi026.stdout:3/527: creat d5/d9/d71/faf x:0 0 0 2024-05-09T00:07:50.230 INFO:tasks.workunit.client.0.smithi026.stdout:3/528: truncate d5/d44/f79 301576 0 2024-05-09T00:07:50.231 INFO:tasks.workunit.client.0.smithi026.stdout:6/481: symlink d15/d1e/d23/d73/l9c 0 2024-05-09T00:07:50.233 INFO:tasks.workunit.client.0.smithi026.stdout:9/641: dwrite d7/d23/d2f/f98 [0,4194304] 0 2024-05-09T00:07:50.234 INFO:tasks.workunit.client.0.smithi026.stdout:3/529: getdents d5/d9/dc/d28 0 2024-05-09T00:07:50.238 INFO:tasks.workunit.client.0.smithi026.stdout:6/482: creat d15/d34/d52/f9d x:0 0 0 2024-05-09T00:07:50.241 INFO:tasks.workunit.client.0.smithi026.stdout:4/633: dwrite d0/f2 [4194304,4194304] 0 2024-05-09T00:07:50.241 INFO:tasks.workunit.client.0.smithi026.stdout:4/634: truncate d0/d12/da2/d97/d43/d49/d8f/da3/d86/fdb 1525372 0 2024-05-09T00:07:50.241 INFO:tasks.workunit.client.0.smithi026.stdout:9/642: unlink d7/d23/d76/l88 0 2024-05-09T00:07:50.241 INFO:tasks.workunit.client.0.smithi026.stdout:9/643: chown d7/d23/d2f/d50/la2 5269084 1 2024-05-09T00:07:50.242 INFO:tasks.workunit.client.0.smithi026.stdout:3/530: creat d5/d9/d4a/d5f/fb0 x:0 0 0 2024-05-09T00:07:50.242 INFO:tasks.workunit.client.0.smithi026.stdout:3/531: fdatasync d5/d9/dc/fa3 0 2024-05-09T00:07:50.242 INFO:tasks.workunit.client.0.smithi026.stdout:3/532: fsync d5/d9/f42 0 2024-05-09T00:07:50.246 INFO:tasks.workunit.client.0.smithi026.stdout:6/483: link f12 d15/d62/f9e 0 2024-05-09T00:07:50.253 INFO:tasks.workunit.client.0.smithi026.stdout:6/484: mkdir d15/d41/d9f 0 2024-05-09T00:07:50.253 INFO:tasks.workunit.client.0.smithi026.stdout:6/485: fsync d15/d1e/d23/d73/f27 0 2024-05-09T00:07:50.254 INFO:tasks.workunit.client.0.smithi026.stdout:4/635: dwrite d0/f4c [0,4194304] 0 2024-05-09T00:07:50.258 INFO:tasks.workunit.client.0.smithi026.stdout:9/644: rmdir d7 39 2024-05-09T00:07:50.258 INFO:tasks.workunit.client.0.smithi026.stdout:6/486: dread d15/d1e/d23/f8a [0,4194304] 0 2024-05-09T00:07:50.261 INFO:tasks.workunit.client.0.smithi026.stdout:9/645: getdents d7/d23/d29/d31/d40/d41/d54/d9a/da4 0 2024-05-09T00:07:50.263 INFO:tasks.workunit.client.0.smithi026.stdout:6/487: mknod d15/d2b/d33/d7d/ca0 0 2024-05-09T00:07:50.263 INFO:tasks.workunit.client.0.smithi026.stdout:6/488: write d15/d1e/d3d/f70 [1263505,26739] 0 2024-05-09T00:07:50.272 INFO:tasks.workunit.client.0.smithi026.stdout:4/636: dread d0/d12/da2/d97/d43/d58/f9c [0,4194304] 0 2024-05-09T00:07:50.296 INFO:tasks.workunit.client.0.smithi026.stdout:6/489: dwrite d15/d1e/d3d/f47 [0,4194304] 0 2024-05-09T00:07:50.297 INFO:tasks.workunit.client.0.smithi026.stdout:9/646: dwrite d7/f1d [0,4194304] 0 2024-05-09T00:07:50.297 INFO:tasks.workunit.client.0.smithi026.stdout:9/647: write d7/d23/d29/d31/d40/d41/d54/f77 [4528417,37966] 0 2024-05-09T00:07:50.308 INFO:tasks.workunit.client.0.smithi026.stdout:9/648: dread d7/d23/d29/d31/d40/d41/d54/f77 [0,4194304] 0 2024-05-09T00:07:50.308 INFO:tasks.workunit.client.0.smithi026.stdout:9/649: read - d7/d23/d29/fc3 zero size 2024-05-09T00:07:50.308 INFO:tasks.workunit.client.0.smithi026.stdout:9/650: write d7/d23/d76/f90 [731322,67126] 0 2024-05-09T00:07:50.313 INFO:tasks.workunit.client.0.smithi026.stdout:9/651: dread d7/d23/f61 [0,4194304] 0 2024-05-09T00:07:50.479 INFO:tasks.workunit.client.0.smithi026.stdout:6/490: rmdir d15/d1e/d23/d3a 39 2024-05-09T00:07:50.479 INFO:tasks.workunit.client.0.smithi026.stdout:6/491: chown d15/d1e/d23/d73 7 1 2024-05-09T00:07:50.486 INFO:tasks.workunit.client.0.smithi026.stdout:9/652: creat d7/fe3 x:0 0 0 2024-05-09T00:07:50.502 INFO:tasks.workunit.client.0.smithi026.stdout:9/653: symlink d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc/le4 0 2024-05-09T00:07:50.502 INFO:tasks.workunit.client.0.smithi026.stdout:9/654: chown d7/l15 8 1 2024-05-09T00:07:50.502 INFO:tasks.workunit.client.0.smithi026.stdout:9/655: chown d7/d23/d29/d31/d40/d41/l65 96 1 2024-05-09T00:07:50.503 INFO:tasks.workunit.client.0.smithi026.stdout:9/656: write d7/d23/f39 [3129984,60675] 0 2024-05-09T00:07:50.503 INFO:tasks.workunit.client.0.smithi026.stdout:9/657: fdatasync d7/d23/d29/fc3 0 2024-05-09T00:07:50.503 INFO:tasks.workunit.client.0.smithi026.stdout:9/658: truncate d7/d23/f7c 423437 0 2024-05-09T00:07:50.511 INFO:tasks.workunit.client.0.smithi026.stdout:9/659: dread d7/d23/d29/d31/d40/f48 [0,4194304] 0 2024-05-09T00:07:50.533 INFO:tasks.workunit.client.0.smithi026.stdout:9/660: dwrite d7/d23/d29/d31/d40/d41/d54/f77 [4194304,4194304] 0 2024-05-09T00:07:50.535 INFO:tasks.workunit.client.0.smithi026.stdout:9/661: dread d7/d23/d76/fb8 [0,4194304] 0 2024-05-09T00:07:50.548 INFO:tasks.workunit.client.0.smithi026.stdout:6/492: creat d15/d1e/d23/d73/d58/fa1 x:0 0 0 2024-05-09T00:07:50.557 INFO:tasks.workunit.client.0.smithi026.stdout:6/493: dread d15/d1e/d23/f24 [0,4194304] 0 2024-05-09T00:07:50.558 INFO:tasks.workunit.client.0.smithi026.stdout:9/662: dwrite d7/d23/d29/d31/f3d [0,4194304] 0 2024-05-09T00:07:50.560 INFO:tasks.workunit.client.0.smithi026.stdout:6/494: link d15/d1e/d23/d73/l83 d15/d41/d9f/la2 0 2024-05-09T00:07:50.560 INFO:tasks.workunit.client.0.smithi026.stdout:9/663: rmdir d7/d23/d76 39 2024-05-09T00:07:50.568 INFO:tasks.workunit.client.0.smithi026.stdout:6/495: dread d15/d62/f9e [4194304,4194304] 0 2024-05-09T00:07:50.605 INFO:tasks.workunit.client.0.smithi026.stdout:9/664: rename d7/d23/d29/d31/d40/d41/d54/f77 to d7/d23/d2f/fe5 0 2024-05-09T00:07:50.605 INFO:tasks.workunit.client.0.smithi026.stdout:9/665: chown d7/d23/d29/d31/d40/l46 1739 1 2024-05-09T00:07:50.606 INFO:tasks.workunit.client.0.smithi026.stdout:9/666: symlink d7/d23/d29/d31/d40/d41/d54/d9a/da4/le6 0 2024-05-09T00:07:50.608 INFO:tasks.workunit.client.0.smithi026.stdout:9/667: creat d7/d23/d29/d59/fe7 x:0 0 0 2024-05-09T00:07:50.611 INFO:tasks.workunit.client.0.smithi026.stdout:9/668: dread d7/d26/f6b [0,4194304] 0 2024-05-09T00:07:50.611 INFO:tasks.workunit.client.0.smithi026.stdout:6/496: creat d15/d1e/d23/d73/fa3 x:0 0 0 2024-05-09T00:07:50.613 INFO:tasks.workunit.client.0.smithi026.stdout:6/497: dread d15/d1e/d3d/f70 [0,4194304] 0 2024-05-09T00:07:50.613 INFO:tasks.workunit.client.0.smithi026.stdout:6/498: write d15/d34/d52/d74/f80 [208556,100201] 0 2024-05-09T00:07:50.622 INFO:tasks.workunit.client.0.smithi026.stdout:6/499: dread f4 [0,4194304] 0 2024-05-09T00:07:50.623 INFO:tasks.workunit.client.0.smithi026.stdout:6/500: creat d15/d34/d52/d8b/fa4 x:0 0 0 2024-05-09T00:07:50.623 INFO:tasks.workunit.client.0.smithi026.stdout:6/501: write d15/f8c [849716,19348] 0 2024-05-09T00:07:50.624 INFO:tasks.workunit.client.0.smithi026.stdout:6/502: truncate d15/d1e/d23/d73/f27 3646844 0 2024-05-09T00:07:50.626 INFO:tasks.workunit.client.0.smithi026.stdout:6/503: creat d15/d2b/d33/d55/d67/d90/fa5 x:0 0 0 2024-05-09T00:07:50.631 INFO:tasks.workunit.client.0.smithi026.stdout:2/605: sync 2024-05-09T00:07:50.631 INFO:tasks.workunit.client.0.smithi026.stdout:7/759: sync 2024-05-09T00:07:50.634 INFO:tasks.workunit.client.0.smithi026.stdout:2/606: rmdir d14/d22/d55/da3/d30/d6a/d5f/d61 39 2024-05-09T00:07:50.636 INFO:tasks.workunit.client.0.smithi026.stdout:6/504: dread d15/d2b/f7e [0,4194304] 0 2024-05-09T00:07:50.646 INFO:tasks.workunit.client.0.smithi026.stdout:6/505: mkdir d15/d1e/d23/d3a/da6 0 2024-05-09T00:07:50.650 INFO:tasks.workunit.client.0.smithi026.stdout:6/506: dread d15/f29 [0,4194304] 0 2024-05-09T00:07:50.650 INFO:tasks.workunit.client.0.smithi026.stdout:6/507: dread - d15/d2b/d33/d55/d67/d90/fa5 zero size 2024-05-09T00:07:50.651 INFO:tasks.workunit.client.0.smithi026.stdout:6/508: truncate d15/d2b/d33/d55/f95 685900 0 2024-05-09T00:07:50.653 INFO:tasks.workunit.client.0.smithi026.stdout:6/509: dread d15/d2b/f42 [0,4194304] 0 2024-05-09T00:07:50.653 INFO:tasks.workunit.client.0.smithi026.stdout:2/607: creat d14/d22/d55/da3/d30/fce x:0 0 0 2024-05-09T00:07:50.653 INFO:tasks.workunit.client.0.smithi026.stdout:2/608: read d14/d22/d55/da3/d3b/f3f [1460939,2524] 0 2024-05-09T00:07:50.653 INFO:tasks.workunit.client.0.smithi026.stdout:2/609: fsync d14/d22/d55/da3/d30/d6a/d5f/f9e 0 2024-05-09T00:07:50.662 INFO:tasks.workunit.client.0.smithi026.stdout:6/510: dread d15/d34/f49 [0,4194304] 0 2024-05-09T00:07:50.664 INFO:tasks.workunit.client.0.smithi026.stdout:8/693: sync 2024-05-09T00:07:50.664 INFO:tasks.workunit.client.0.smithi026.stdout:1/674: sync 2024-05-09T00:07:50.664 INFO:tasks.workunit.client.0.smithi026.stdout:1/675: readlink d5/dd/l89 0 2024-05-09T00:07:50.664 INFO:tasks.workunit.client.0.smithi026.stdout:1/676: write d5/dd/f67 [1620907,3507] 0 2024-05-09T00:07:50.665 INFO:tasks.workunit.client.0.smithi026.stdout:6/511: creat d15/d1e/d23/d73/fa7 x:0 0 0 2024-05-09T00:07:50.665 INFO:tasks.workunit.client.0.smithi026.stdout:6/512: write d15/d2b/d33/d55/f95 [867813,51296] 0 2024-05-09T00:07:50.666 INFO:tasks.workunit.client.0.smithi026.stdout:8/694: creat de/fe8 x:0 0 0 2024-05-09T00:07:50.667 INFO:tasks.workunit.client.0.smithi026.stdout:8/695: truncate de/d17/d21/d6f/f93 441166 0 2024-05-09T00:07:50.668 INFO:tasks.workunit.client.0.smithi026.stdout:1/677: rename d5/dd/d17/d9f/cbf to d5/d16/d60/d66/d97/d75/cec 0 2024-05-09T00:07:50.669 INFO:tasks.workunit.client.0.smithi026.stdout:8/696: dread de/d6c/d31/d4f/f7b [0,4194304] 0 2024-05-09T00:07:50.670 INFO:tasks.workunit.client.0.smithi026.stdout:2/610: dwrite d14/d22/d55/da3/d20/d41/faf [0,4194304] 0 2024-05-09T00:07:50.671 INFO:tasks.workunit.client.0.smithi026.stdout:6/513: mknod d15/d2b/d33/d55/d67/ca8 0 2024-05-09T00:07:50.671 INFO:tasks.workunit.client.0.smithi026.stdout:1/678: creat d5/dd/d17/d9f/dc6/fed x:0 0 0 2024-05-09T00:07:50.672 INFO:tasks.workunit.client.0.smithi026.stdout:1/679: write d5/dd/d1f/f21 [2292841,56280] 0 2024-05-09T00:07:50.676 INFO:tasks.workunit.client.0.smithi026.stdout:6/514: mkdir d15/d2b/d33/d7d/da9 0 2024-05-09T00:07:50.676 INFO:tasks.workunit.client.0.smithi026.stdout:6/515: chown d15/d2b/c60 238773726 1 2024-05-09T00:07:50.676 INFO:tasks.workunit.client.0.smithi026.stdout:6/516: chown d15/d1e/d30/f46 1654245686 1 2024-05-09T00:07:50.676 INFO:tasks.workunit.client.0.smithi026.stdout:6/517: write d15/d1e/d3d/f70 [1719409,21783] 0 2024-05-09T00:07:50.676 INFO:tasks.workunit.client.0.smithi026.stdout:1/680: creat d5/dd/d17/d7b/de1/fee x:0 0 0 2024-05-09T00:07:50.677 INFO:tasks.workunit.client.0.smithi026.stdout:8/697: dread de/ff [0,4194304] 0 2024-05-09T00:07:50.679 INFO:tasks.workunit.client.0.smithi026.stdout:1/681: dread d5/dd/d1f/d39/f8e [0,4194304] 0 2024-05-09T00:07:50.679 INFO:tasks.workunit.client.0.smithi026.stdout:1/682: chown d5/db/d1d/l4c 515960 1 2024-05-09T00:07:50.679 INFO:tasks.workunit.client.0.smithi026.stdout:1/683: chown d5/f27 49505 1 2024-05-09T00:07:50.680 INFO:tasks.workunit.client.0.smithi026.stdout:1/684: readlink d5/dd/l99 0 2024-05-09T00:07:50.680 INFO:tasks.workunit.client.0.smithi026.stdout:1/685: stat f3 0 2024-05-09T00:07:50.680 INFO:tasks.workunit.client.0.smithi026.stdout:1/686: write d5/f8d [707531,106543] 0 2024-05-09T00:07:50.682 INFO:tasks.workunit.client.0.smithi026.stdout:1/687: dread d5/dd/d17/d7b/f9c [0,4194304] 0 2024-05-09T00:07:50.682 INFO:tasks.workunit.client.0.smithi026.stdout:1/688: dread - d5/dd/d1f/d39/d47/f93 zero size 2024-05-09T00:07:50.683 INFO:tasks.workunit.client.0.smithi026.stdout:1/689: dread d5/dd/d17/d7b/f9c [0,4194304] 0 2024-05-09T00:07:50.685 INFO:tasks.workunit.client.0.smithi026.stdout:6/518: mknod d15/d1e/d23/d3a/caa 0 2024-05-09T00:07:50.686 INFO:tasks.workunit.client.0.smithi026.stdout:6/519: write d15/d1e/d23/d73/d58/d5c/f5d [2622877,59578] 0 2024-05-09T00:07:50.688 INFO:tasks.workunit.client.0.smithi026.stdout:8/698: unlink de/d48/d3e/d54/f79 0 2024-05-09T00:07:50.688 INFO:tasks.workunit.client.0.smithi026.stdout:8/699: chown de/d17/d7d/dd2/ldc 471820 1 2024-05-09T00:07:50.689 INFO:tasks.workunit.client.0.smithi026.stdout:1/690: rename d5/db/d1d/dae/fb2 to d5/dd/ddd/fef 0 2024-05-09T00:07:50.690 INFO:tasks.workunit.client.0.smithi026.stdout:8/700: dread de/d17/d21/d24/d3b/d3d/f56 [0,4194304] 0 2024-05-09T00:07:50.690 INFO:tasks.workunit.client.0.smithi026.stdout:8/701: stat de/d6c/d31/d4f/d87/d62/l84 0 2024-05-09T00:07:50.696 INFO:tasks.workunit.client.0.smithi026.stdout:6/520: symlink d15/d41/d9f/lab 0 2024-05-09T00:07:50.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/521: truncate d15/d1e/d3d/f47 4422820 0 2024-05-09T00:07:50.697 INFO:tasks.workunit.client.0.smithi026.stdout:8/702: mknod de/d48/d3e/ce9 0 2024-05-09T00:07:50.698 INFO:tasks.workunit.client.0.smithi026.stdout:8/703: chown de/d17/d21/d6f/c8b 120 1 2024-05-09T00:07:50.701 INFO:tasks.workunit.client.0.smithi026.stdout:1/691: dread d5/f8d [0,4194304] 0 2024-05-09T00:07:50.701 INFO:tasks.workunit.client.0.smithi026.stdout:1/692: chown d5/d16/d60/d66/d97/f4d 763 1 2024-05-09T00:07:50.701 INFO:tasks.workunit.client.0.smithi026.stdout:8/704: mkdir de/d17/d21/d24/d3b/dea 0 2024-05-09T00:07:50.703 INFO:tasks.workunit.client.0.smithi026.stdout:1/693: creat d5/d16/dd5/de4/ff0 x:0 0 0 2024-05-09T00:07:50.703 INFO:tasks.workunit.client.0.smithi026.stdout:1/694: dread - d5/dd/d1f/faf zero size 2024-05-09T00:07:50.703 INFO:tasks.workunit.client.0.smithi026.stdout:8/705: mkdir de/d6c/d31/d4f/deb 0 2024-05-09T00:07:50.704 INFO:tasks.workunit.client.0.smithi026.stdout:2/611: dwrite d14/d22/d55/da3/d20/f36 [0,4194304] 0 2024-05-09T00:07:50.708 INFO:tasks.workunit.client.0.smithi026.stdout:1/695: rename d5/dd/d1f/d39/f3d to d5/d16/dbd/ff1 0 2024-05-09T00:07:50.710 INFO:tasks.workunit.client.0.smithi026.stdout:2/612: getdents d14/d22/d55/d6b 0 2024-05-09T00:07:50.712 INFO:tasks.workunit.client.0.smithi026.stdout:1/696: write d5/dd/d17/f8b [2719631,72735] 0 2024-05-09T00:07:50.713 INFO:tasks.workunit.client.0.smithi026.stdout:2/613: getdents d14/d22/d55/da3/d3b/d40 0 2024-05-09T00:07:50.715 INFO:tasks.workunit.client.0.smithi026.stdout:1/697: mknod d5/dd/d17/d9f/da5/cf2 0 2024-05-09T00:07:50.718 INFO:tasks.workunit.client.0.smithi026.stdout:1/698: write d5/dd/d87/f9a [2020355,15574] 0 2024-05-09T00:07:50.722 INFO:tasks.workunit.client.0.smithi026.stdout:8/706: dwrite de/d6c/d31/d4f/d87/fe2 [0,4194304] 0 2024-05-09T00:07:50.722 INFO:tasks.workunit.client.0.smithi026.stdout:8/707: write de/d17/f8d [585959,103] 0 2024-05-09T00:07:50.722 INFO:tasks.workunit.client.0.smithi026.stdout:1/699: mknod d5/dd/d87/db3/cf3 0 2024-05-09T00:07:50.728 INFO:tasks.workunit.client.0.smithi026.stdout:1/700: creat d5/dd/d17/d7b/de1/ff4 x:0 0 0 2024-05-09T00:07:50.728 INFO:tasks.workunit.client.0.smithi026.stdout:2/614: dwrite f8 [0,4194304] 0 2024-05-09T00:07:50.753 INFO:tasks.workunit.client.0.smithi026.stdout:2/615: dwrite d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fb9 [0,4194304] 0 2024-05-09T00:07:50.753 INFO:tasks.workunit.client.0.smithi026.stdout:2/616: write d14/d22/d55/da3/d20/d41/d51/d82/daa/fc8 [145149,26064] 0 2024-05-09T00:07:50.753 INFO:tasks.workunit.client.0.smithi026.stdout:2/617: fsync f4 0 2024-05-09T00:07:50.758 INFO:tasks.workunit.client.0.smithi026.stdout:1/701: dwrite d5/dd/d1f/f2e [0,4194304] 0 2024-05-09T00:07:50.761 INFO:tasks.workunit.client.0.smithi026.stdout:1/702: creat d5/dd/d17/d9f/dc6/ff5 x:0 0 0 2024-05-09T00:07:50.764 INFO:tasks.workunit.client.0.smithi026.stdout:1/703: rmdir d5/d16/d60/d66/d97/d92 0 2024-05-09T00:07:50.766 INFO:tasks.workunit.client.0.smithi026.stdout:1/704: creat d5/d16/d60/d66/d97/d94/de0/ff6 x:0 0 0 2024-05-09T00:07:50.767 INFO:tasks.workunit.client.0.smithi026.stdout:1/705: rmdir d5 39 2024-05-09T00:07:50.769 INFO:tasks.workunit.client.0.smithi026.stdout:2/618: dwrite fd [4194304,4194304] 0 2024-05-09T00:07:50.769 INFO:tasks.workunit.client.0.smithi026.stdout:1/706: symlink d5/dd/d17/d7b/lf7 0 2024-05-09T00:07:50.773 INFO:tasks.workunit.client.0.smithi026.stdout:1/707: dread d5/dd/d17/d7b/f9c [0,4194304] 0 2024-05-09T00:07:50.779 INFO:tasks.workunit.client.0.smithi026.stdout:2/619: getdents d14/d22/d55/da3/d20 0 2024-05-09T00:07:50.780 INFO:tasks.workunit.client.0.smithi026.stdout:1/708: readlink d5/dd/d17/l65 0 2024-05-09T00:07:50.783 INFO:tasks.workunit.client.0.smithi026.stdout:2/620: mknod d14/d22/d55/da3/d20/db2/ccf 0 2024-05-09T00:07:50.786 INFO:tasks.workunit.client.0.smithi026.stdout:1/709: rename d5/d16/c71 to d5/dd/d17/d7b/de1/cf8 0 2024-05-09T00:07:50.787 INFO:tasks.workunit.client.0.smithi026.stdout:2/621: mknod d14/d22/cd0 0 2024-05-09T00:07:50.787 INFO:tasks.workunit.client.0.smithi026.stdout:2/622: write d14/d22/d55/da3/d20/d41/d51/d82/daa/fc8 [263254,122207] 0 2024-05-09T00:07:50.790 INFO:tasks.workunit.client.0.smithi026.stdout:1/710: mknod d5/d16/d60/d66/d97/d94/db1/dc2/cf9 0 2024-05-09T00:07:50.790 INFO:tasks.workunit.client.0.smithi026.stdout:1/711: write d5/d16/d60/d66/d97/d94/de0/fd8 [79156,102169] 0 2024-05-09T00:07:50.790 INFO:tasks.workunit.client.0.smithi026.stdout:1/712: chown d5/d16/f18 127 1 2024-05-09T00:07:50.790 INFO:tasks.workunit.client.0.smithi026.stdout:1/713: chown d5/d16/d60/d66/c78 26 1 2024-05-09T00:07:50.791 INFO:tasks.workunit.client.0.smithi026.stdout:1/714: chown d5/d16/d60/d66/d97/d94/db1 1694186 1 2024-05-09T00:07:50.791 INFO:tasks.workunit.client.0.smithi026.stdout:1/715: truncate d5/db/d1d/dae/fc3 401471 0 2024-05-09T00:07:50.791 INFO:tasks.workunit.client.0.smithi026.stdout:1/716: fsync f4 0 2024-05-09T00:07:50.791 INFO:tasks.workunit.client.0.smithi026.stdout:1/717: dread - d5/d16/d60/f6d zero size 2024-05-09T00:07:50.791 INFO:tasks.workunit.client.0.smithi026.stdout:1/718: fsync d5/dd/ddd/fef 0 2024-05-09T00:07:50.791 INFO:tasks.workunit.client.0.smithi026.stdout:2/623: creat d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/d96/fd1 x:0 0 0 2024-05-09T00:07:50.795 INFO:tasks.workunit.client.0.smithi026.stdout:1/719: mkdir d5/dd/daa/dfa 0 2024-05-09T00:07:50.795 INFO:tasks.workunit.client.0.smithi026.stdout:1/720: write d5/dd/f49 [4099761,124948] 0 2024-05-09T00:07:50.803 INFO:tasks.workunit.client.0.smithi026.stdout:1/721: rename d5/dd/d17/l4e to d5/dd/d17/lfb 0 2024-05-09T00:07:50.804 INFO:tasks.workunit.client.0.smithi026.stdout:2/624: dwrite d14/d22/d55/da3/d30/d6a/f63 [0,4194304] 0 2024-05-09T00:07:50.805 INFO:tasks.workunit.client.0.smithi026.stdout:1/722: creat d5/db/ffc x:0 0 0 2024-05-09T00:07:50.806 INFO:tasks.workunit.client.0.smithi026.stdout:2/625: truncate fd 7588734 0 2024-05-09T00:07:50.807 INFO:tasks.workunit.client.0.smithi026.stdout:1/723: mknod d5/d16/d60/cfd 0 2024-05-09T00:07:50.807 INFO:tasks.workunit.client.0.smithi026.stdout:1/724: stat d5/dd/d17/l65 0 2024-05-09T00:07:50.811 INFO:tasks.workunit.client.0.smithi026.stdout:2/626: mkdir d14/d22/d55/da3/d20/d41/d51/d82/dd2 0 2024-05-09T00:07:50.811 INFO:tasks.workunit.client.0.smithi026.stdout:2/627: dread - d14/d22/d55/fbd zero size 2024-05-09T00:07:50.813 INFO:tasks.workunit.client.0.smithi026.stdout:1/725: getdents d5/d16/d60/d66/d97 0 2024-05-09T00:07:50.817 INFO:tasks.workunit.client.0.smithi026.stdout:2/628: creat d14/d22/d55/d6b/d93/fd3 x:0 0 0 2024-05-09T00:07:50.822 INFO:tasks.workunit.client.0.smithi026.stdout:1/726: rmdir d5/dd/d17/d9f/de9 0 2024-05-09T00:07:50.823 INFO:tasks.workunit.client.0.smithi026.stdout:1/727: write d5/db/f5d [940735,123529] 0 2024-05-09T00:07:50.823 INFO:tasks.workunit.client.0.smithi026.stdout:1/728: chown d5/dd/d1f/f57 54 1 2024-05-09T00:07:50.826 INFO:tasks.workunit.client.0.smithi026.stdout:1/729: link d5/d16/d60/d66/d97/d75/cec d5/dd/d17/d7b/cfe 0 2024-05-09T00:07:50.835 INFO:tasks.workunit.client.0.smithi026.stdout:2/629: dwrite d14/d22/d55/da3/d20/f23 [0,4194304] 0 2024-05-09T00:07:50.835 INFO:tasks.workunit.client.0.smithi026.stdout:2/630: chown d14/d22/d55/da3/d20/db2/l54 16777 1 2024-05-09T00:07:50.835 INFO:tasks.workunit.client.0.smithi026.stdout:2/631: fsync d14/d22/d55/da3/d20/fac 0 2024-05-09T00:07:50.840 INFO:tasks.workunit.client.0.smithi026.stdout:2/632: rename d14/d22/d55/da3/d20/db2/d70/f7e to d14/d22/d55/da3/d20/db2/fd4 0 2024-05-09T00:07:50.840 INFO:tasks.workunit.client.0.smithi026.stdout:2/633: truncate d14/d22/d55/da3/d3b/d40/f66 1073878 0 2024-05-09T00:07:50.841 INFO:tasks.workunit.client.0.smithi026.stdout:2/634: write d14/d22/d55/da3/d3b/d40/f8a [5389662,45397] 0 2024-05-09T00:07:50.841 INFO:tasks.workunit.client.0.smithi026.stdout:2/635: dread - d14/d22/d55/da3/d20/f69 zero size 2024-05-09T00:07:50.841 INFO:tasks.workunit.client.0.smithi026.stdout:2/636: read d14/d22/d55/da3/d20/d41/d51/fa4 [3716,49155] 0 2024-05-09T00:07:50.841 INFO:tasks.workunit.client.0.smithi026.stdout:1/730: dwrite d5/dd/f52 [0,4194304] 0 2024-05-09T00:07:50.845 INFO:tasks.workunit.client.0.smithi026.stdout:2/637: write d14/d22/d55/da3/d20/db2/fd4 [665675,93880] 0 2024-05-09T00:07:50.846 INFO:tasks.workunit.client.0.smithi026.stdout:1/731: unlink d5/d16/d60/d66/d97/d94/db1/dc2/cf9 0 2024-05-09T00:07:50.849 INFO:tasks.workunit.client.0.smithi026.stdout:2/638: link d14/d22/d55/d6b/d93/fd3 d14/d22/d55/da3/d30/d6a/d5b/fd5 0 2024-05-09T00:07:50.849 INFO:tasks.workunit.client.0.smithi026.stdout:2/639: chown d14/l2f 14 1 2024-05-09T00:07:50.850 INFO:tasks.workunit.client.0.smithi026.stdout:2/640: dread d14/d22/d55/da3/d20/d41/d51/fa4 [0,4194304] 0 2024-05-09T00:07:50.851 INFO:tasks.workunit.client.0.smithi026.stdout:1/732: mknod d5/d16/d60/cff 0 2024-05-09T00:07:50.851 INFO:tasks.workunit.client.0.smithi026.stdout:1/733: fsync d5/db/f77 0 2024-05-09T00:07:50.853 INFO:tasks.workunit.client.0.smithi026.stdout:2/641: mkdir d14/d22/d55/da3/d30/d6a/dd6 0 2024-05-09T00:07:50.855 INFO:tasks.workunit.client.0.smithi026.stdout:2/642: creat d14/d22/d55/da3/d20/d41/d51/dc5/fd7 x:0 0 0 2024-05-09T00:07:50.855 INFO:tasks.workunit.client.0.smithi026.stdout:2/643: chown d14/d22/d55/da3/d20/d41/d51/d82 143824783 1 2024-05-09T00:07:50.855 INFO:tasks.workunit.client.0.smithi026.stdout:2/644: chown d14/d22/d55/da3/d30/d6a/d5f/d61/c6d 7172477 1 2024-05-09T00:07:50.855 INFO:tasks.workunit.client.0.smithi026.stdout:2/645: chown d14/d22/d55/da3/f26 21577451 1 2024-05-09T00:07:50.874 INFO:tasks.workunit.client.0.smithi026.stdout:2/646: dwrite d14/d22/d55/da3/d30/fce [0,4194304] 0 2024-05-09T00:07:50.903 INFO:tasks.workunit.client.0.smithi026.stdout:5/561: sync 2024-05-09T00:07:50.903 INFO:tasks.workunit.client.0.smithi026.stdout:5/562: stat d2/d8/d31/d63/f83 0 2024-05-09T00:07:50.908 INFO:tasks.workunit.client.0.smithi026.stdout:5/563: dread d2/f3 [0,4194304] 0 2024-05-09T00:07:50.923 INFO:tasks.workunit.client.0.smithi026.stdout:5/564: dwrite d2/d8/d31/d2e/d33/f7f [0,4194304] 0 2024-05-09T00:07:50.947 INFO:tasks.workunit.client.0.smithi026.stdout:5/565: dwrite d2/d8/d2a/f4f [0,4194304] 0 2024-05-09T00:07:50.950 INFO:tasks.workunit.client.0.smithi026.stdout:5/566: read d2/f72 [1616686,121742] 0 2024-05-09T00:07:50.950 INFO:tasks.workunit.client.0.smithi026.stdout:5/567: truncate d2/d8/d31/d2e/d35/fa1 786415 0 2024-05-09T00:07:50.957 INFO:tasks.workunit.client.0.smithi026.stdout:5/568: dread d2/d8/d31/f30 [0,4194304] 0 2024-05-09T00:07:50.959 INFO:tasks.workunit.client.0.smithi026.stdout:5/569: dread d2/d8/d6d/f7d [0,4194304] 0 2024-05-09T00:07:50.959 INFO:tasks.workunit.client.0.smithi026.stdout:5/570: fdatasync d2/d8/d31/d24/f43 0 2024-05-09T00:07:50.959 INFO:tasks.workunit.client.0.smithi026.stdout:5/571: read - d2/d8/d31/d2e/d35/fa8 zero size 2024-05-09T00:07:50.961 INFO:tasks.workunit.client.0.smithi026.stdout:5/572: creat d2/d8/d2a/d8d/fb9 x:0 0 0 2024-05-09T00:07:50.963 INFO:tasks.workunit.client.0.smithi026.stdout:5/573: creat d2/d8/d31/d32/da2/fba x:0 0 0 2024-05-09T00:07:50.963 INFO:tasks.workunit.client.0.smithi026.stdout:5/574: readlink d2/d8/d2a/l47 0 2024-05-09T00:07:50.972 INFO:tasks.workunit.client.0.smithi026.stdout:5/575: dread d2/d8/d2a/f4f [4194304,4194304] 0 2024-05-09T00:07:50.972 INFO:tasks.workunit.client.0.smithi026.stdout:5/576: readlink d2/d8/d2a/l47 0 2024-05-09T00:07:51.078 INFO:tasks.workunit.client.0.smithi026.stdout:4/637: sync 2024-05-09T00:07:51.078 INFO:tasks.workunit.client.0.smithi026.stdout:0/781: sync 2024-05-09T00:07:51.079 INFO:tasks.workunit.client.0.smithi026.stdout:3/533: sync 2024-05-09T00:07:51.079 INFO:tasks.workunit.client.0.smithi026.stdout:3/534: chown d5/d9/dc/d28/d63/l89 5 1 2024-05-09T00:07:51.080 INFO:tasks.workunit.client.0.smithi026.stdout:4/638: read d0/d12/da2/d97/d43/f44 [4114253,112526] 0 2024-05-09T00:07:51.080 INFO:tasks.workunit.client.0.smithi026.stdout:4/639: chown d0/d12/d34/lcf 1135924983 1 2024-05-09T00:07:51.081 INFO:tasks.workunit.client.0.smithi026.stdout:4/640: readlink d0/d12/d87/la7 0 2024-05-09T00:07:51.081 INFO:tasks.workunit.client.0.smithi026.stdout:0/782: creat d1d/d1e/d20/d4d/d83/da0/d104/f107 x:0 0 0 2024-05-09T00:07:51.081 INFO:tasks.workunit.client.0.smithi026.stdout:0/783: write d1d/d1e/d2d/f98 [619313,33819] 0 2024-05-09T00:07:51.081 INFO:tasks.workunit.client.0.smithi026.stdout:3/535: getdents d5 0 2024-05-09T00:07:51.082 INFO:tasks.workunit.client.0.smithi026.stdout:4/641: truncate d0/d12/da2/d97/d43/d58/f91 431063 0 2024-05-09T00:07:51.083 INFO:tasks.workunit.client.0.smithi026.stdout:0/784: creat d1d/d25/d47/d6e/f108 x:0 0 0 2024-05-09T00:07:51.083 INFO:tasks.workunit.client.0.smithi026.stdout:0/785: write d1d/d1e/fae [456106,96545] 0 2024-05-09T00:07:51.086 INFO:tasks.workunit.client.0.smithi026.stdout:4/642: mknod d0/cdd 0 2024-05-09T00:07:51.086 INFO:tasks.workunit.client.0.smithi026.stdout:4/643: fdatasync d0/d12/da2/d97/f45 0 2024-05-09T00:07:51.087 INFO:tasks.workunit.client.0.smithi026.stdout:4/644: dread d0/d12/d1b/d4e/f9a [0,4194304] 0 2024-05-09T00:07:51.091 INFO:tasks.workunit.client.0.smithi026.stdout:0/786: truncate f1b 3423521 0 2024-05-09T00:07:51.091 INFO:tasks.workunit.client.0.smithi026.stdout:0/787: chown d1d/d33/d64/fa6 24438 1 2024-05-09T00:07:51.095 INFO:tasks.workunit.client.0.smithi026.stdout:4/645: unlink d0/d12/da2/db8/cc9 0 2024-05-09T00:07:51.097 INFO:tasks.workunit.client.0.smithi026.stdout:0/788: creat d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d96/f109 x:0 0 0 2024-05-09T00:07:51.097 INFO:tasks.workunit.client.0.smithi026.stdout:0/789: read - d1d/d33/d64/fa6 zero size 2024-05-09T00:07:51.098 INFO:tasks.workunit.client.0.smithi026.stdout:0/790: write d1d/d1e/f32 [1081936,87746] 0 2024-05-09T00:07:51.102 INFO:tasks.workunit.client.0.smithi026.stdout:4/646: truncate d0/f94 322655 0 2024-05-09T00:07:51.104 INFO:tasks.workunit.client.0.smithi026.stdout:4/647: dread d0/d12/da2/d97/d43/d49/f7f [0,4194304] 0 2024-05-09T00:07:51.106 INFO:tasks.workunit.client.0.smithi026.stdout:0/791: getdents d1d/d1e/d20/d4d 0 2024-05-09T00:07:51.110 INFO:tasks.workunit.client.0.smithi026.stdout:4/648: unlink d0/d12/da2/d97/d43/d58/f91 0 2024-05-09T00:07:51.113 INFO:tasks.workunit.client.0.smithi026.stdout:4/649: creat d0/d12/da2/d97/d43/d58/db3/fde x:0 0 0 2024-05-09T00:07:51.113 INFO:tasks.workunit.client.0.smithi026.stdout:4/650: chown d0/d12/da2/d97/d43/d49/d8f/da3/d66/cad 7765449 1 2024-05-09T00:07:51.114 INFO:tasks.workunit.client.0.smithi026.stdout:4/651: dread - d0/d12/da2/d97/d43/d49/f77 zero size 2024-05-09T00:07:51.114 INFO:tasks.workunit.client.0.smithi026.stdout:4/652: unlink d0/d12/d1b/c3e 0 2024-05-09T00:07:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:4/653: rename d0/d12/da2/d97/d43/d58/f69 to d0/d12/da2/d97/d43/d49/fdf 0 2024-05-09T00:07:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:4/654: mknod d0/d12/d64/dac/dd3/ce0 0 2024-05-09T00:07:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:4/655: write d0/d12/da2/d97/d43/d49/d8f/da3/d66/faf [460808,63084] 0 2024-05-09T00:07:51.120 INFO:tasks.workunit.client.0.smithi026.stdout:4/656: dread - d0/d12/d64/dac/fc2 zero size 2024-05-09T00:07:51.121 INFO:tasks.workunit.client.0.smithi026.stdout:4/657: creat d0/d12/d34/fe1 x:0 0 0 2024-05-09T00:07:51.125 INFO:tasks.workunit.client.0.smithi026.stdout:4/658: rename d0/d12/da2/d97/f45 to d0/d12/da2/d97/d43/d49/d8f/fe2 0 2024-05-09T00:07:51.125 INFO:tasks.workunit.client.0.smithi026.stdout:4/659: write d0/d12/d1b/f74 [1989866,111501] 0 2024-05-09T00:07:51.225 INFO:tasks.workunit.client.0.smithi026.stdout:9/669: sync 2024-05-09T00:07:51.239 INFO:tasks.workunit.client.0.smithi026.stdout:9/670: dwrite d7/d26/f71 [0,4194304] 0 2024-05-09T00:07:51.240 INFO:tasks.workunit.client.0.smithi026.stdout:9/671: mknod d7/d23/d29/ce8 0 2024-05-09T00:07:51.245 INFO:tasks.workunit.client.0.smithi026.stdout:9/672: dread d7/d23/d2f/fe5 [0,4194304] 0 2024-05-09T00:07:51.245 INFO:tasks.workunit.client.0.smithi026.stdout:9/673: dread - d7/d26/f95 zero size 2024-05-09T00:07:51.377 INFO:tasks.workunit.client.0.smithi026.stdout:7/760: sync 2024-05-09T00:07:51.377 INFO:tasks.workunit.client.0.smithi026.stdout:6/522: sync 2024-05-09T00:07:51.377 INFO:tasks.workunit.client.0.smithi026.stdout:1/734: sync 2024-05-09T00:07:51.377 INFO:tasks.workunit.client.0.smithi026.stdout:8/708: sync 2024-05-09T00:07:51.377 INFO:tasks.workunit.client.0.smithi026.stdout:2/647: sync 2024-05-09T00:07:51.378 INFO:tasks.workunit.client.0.smithi026.stdout:8/709: read de/d48/f7c [2177968,111982] 0 2024-05-09T00:07:51.378 INFO:tasks.workunit.client.0.smithi026.stdout:1/735: rename d5/dd/daa to d5/d16/d60/d66/d97/d75/d100 0 2024-05-09T00:07:51.380 INFO:tasks.workunit.client.0.smithi026.stdout:6/523: creat d15/d34/d52/d8b/fac x:0 0 0 2024-05-09T00:07:51.381 INFO:tasks.workunit.client.0.smithi026.stdout:2/648: creat d14/d22/d55/da3/d20/d41/d51/fd8 x:0 0 0 2024-05-09T00:07:51.381 INFO:tasks.workunit.client.0.smithi026.stdout:2/649: fsync f11 0 2024-05-09T00:07:51.382 INFO:tasks.workunit.client.0.smithi026.stdout:8/710: symlink de/d6c/d31/d4f/d87/d62/lec 0 2024-05-09T00:07:51.383 INFO:tasks.workunit.client.0.smithi026.stdout:8/711: stat de/d17/d21/d24/d3b/l9f 0 2024-05-09T00:07:51.383 INFO:tasks.workunit.client.0.smithi026.stdout:8/712: truncate de/d17/d21/d24/d3b/f47 4955965 0 2024-05-09T00:07:51.383 INFO:tasks.workunit.client.0.smithi026.stdout:8/713: chown de/d17/f4a 12059855 1 2024-05-09T00:07:51.383 INFO:tasks.workunit.client.0.smithi026.stdout:1/736: creat d5/dd/d17/d9f/dc6/f101 x:0 0 0 2024-05-09T00:07:51.383 INFO:tasks.workunit.client.0.smithi026.stdout:8/714: write de/d17/d7d/f9d [4072607,14641] 0 2024-05-09T00:07:51.384 INFO:tasks.workunit.client.0.smithi026.stdout:6/524: getdents d15/d2b/d33/d7d 0 2024-05-09T00:07:51.385 INFO:tasks.workunit.client.0.smithi026.stdout:1/737: write d5/dd/f34 [3192476,44675] 0 2024-05-09T00:07:51.386 INFO:tasks.workunit.client.0.smithi026.stdout:2/650: mknod d14/d22/d55/da3/d20/d41/d51/cd9 0 2024-05-09T00:07:51.389 INFO:tasks.workunit.client.0.smithi026.stdout:8/715: getdents de/d48/d3e/dc4 0 2024-05-09T00:07:51.389 INFO:tasks.workunit.client.0.smithi026.stdout:8/716: stat f9 0 2024-05-09T00:07:51.393 INFO:tasks.workunit.client.0.smithi026.stdout:6/525: creat d15/d1e/d23/d73/d58/d5c/fad x:0 0 0 2024-05-09T00:07:51.393 INFO:tasks.workunit.client.0.smithi026.stdout:2/651: dread d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fab [0,4194304] 0 2024-05-09T00:07:51.393 INFO:tasks.workunit.client.0.smithi026.stdout:2/652: chown d14/d22/d55/da3/d20/d41/d51/d82 13500600 1 2024-05-09T00:07:51.393 INFO:tasks.workunit.client.0.smithi026.stdout:2/653: stat d14/d22/d55/da3/d30/d6a/d5b 0 2024-05-09T00:07:51.394 INFO:tasks.workunit.client.0.smithi026.stdout:1/738: creat d5/d16/d60/f102 x:0 0 0 2024-05-09T00:07:51.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:49.908971+0000 mgr.smithi135.kkrhgf (mgr.24419) 58 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 153 MiB/s rd, 335 MiB/s wr, 565 op/s 2024-05-09T00:07:51.395 INFO:tasks.workunit.client.0.smithi026.stdout:8/717: mknod de/d6c/d31/d4f/d87/d62/db4/ced 0 2024-05-09T00:07:51.397 INFO:tasks.workunit.client.0.smithi026.stdout:6/526: rename d15/d1e/d23/d73/l83 to d15/d1e/d30/d32/lae 0 2024-05-09T00:07:51.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:49.908971+0000 mgr.smithi135.kkrhgf (mgr.24419) 58 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 153 MiB/s rd, 335 MiB/s wr, 565 op/s 2024-05-09T00:07:51.398 INFO:tasks.workunit.client.0.smithi026.stdout:8/718: rmdir de/d6c/d31/d4f/d87/d62/daa 39 2024-05-09T00:07:51.399 INFO:tasks.workunit.client.0.smithi026.stdout:6/527: rmdir d15/d1e/d23 39 2024-05-09T00:07:51.400 INFO:tasks.workunit.client.0.smithi026.stdout:2/654: dread d14/d22/d55/da3/d17/fad [0,4194304] 0 2024-05-09T00:07:51.403 INFO:tasks.workunit.client.0.smithi026.stdout:8/719: mkdir de/d17/d7d/dd2/dee 0 2024-05-09T00:07:51.403 INFO:tasks.workunit.client.0.smithi026.stdout:8/720: read - de/d6c/d31/d4f/f88 zero size 2024-05-09T00:07:51.403 INFO:tasks.workunit.client.0.smithi026.stdout:8/721: write de/d6c/d31/d4f/f88 [993616,18687] 0 2024-05-09T00:07:51.408 INFO:tasks.workunit.client.0.smithi026.stdout:8/722: creat de/d17/d21/d24/d3b/d3d/fef x:0 0 0 2024-05-09T00:07:51.409 INFO:tasks.workunit.client.0.smithi026.stdout:6/528: dread d15/d34/d52/d8b/f40 [0,4194304] 0 2024-05-09T00:07:51.409 INFO:tasks.workunit.client.0.smithi026.stdout:6/529: fsync d15/f77 0 2024-05-09T00:07:51.411 INFO:tasks.workunit.client.0.smithi026.stdout:6/530: creat d15/d2b/d33/d7d/da9/faf x:0 0 0 2024-05-09T00:07:51.414 INFO:tasks.workunit.client.0.smithi026.stdout:6/531: mknod d15/d34/d52/cb0 0 2024-05-09T00:07:51.418 INFO:tasks.workunit.client.0.smithi026.stdout:8/723: dread de/d6c/d31/d4f/f86 [0,4194304] 0 2024-05-09T00:07:51.418 INFO:tasks.workunit.client.0.smithi026.stdout:8/724: dread - de/d17/d21/d24/f99 zero size 2024-05-09T00:07:51.418 INFO:tasks.workunit.client.0.smithi026.stdout:8/725: getdents de/d60 0 2024-05-09T00:07:51.418 INFO:tasks.workunit.client.0.smithi026.stdout:1/739: dwrite d5/d16/d60/f6d [0,4194304] 0 2024-05-09T00:07:51.420 INFO:tasks.workunit.client.0.smithi026.stdout:8/726: rename de/d17/d21/dca/fcc to de/d6c/d31/d4f/d87/d62/ff0 0 2024-05-09T00:07:51.423 INFO:tasks.workunit.client.0.smithi026.stdout:2/655: dwrite d14/d22/d55/da3/d20/db2/f38 [0,4194304] 0 2024-05-09T00:07:51.425 INFO:tasks.workunit.client.0.smithi026.stdout:1/740: rename d5/d16/d60/d66/d97/d94 to d5/d16/d60/d66/d86/d103 0 2024-05-09T00:07:51.425 INFO:tasks.workunit.client.0.smithi026.stdout:1/741: write d5/d16/d60/d66/d86/d103/fc4 [896146,65448] 0 2024-05-09T00:07:51.433 INFO:tasks.workunit.client.0.smithi026.stdout:2/656: dread d14/d22/d55/da3/d20/d41/faf [0,4194304] 0 2024-05-09T00:07:51.434 INFO:tasks.workunit.client.0.smithi026.stdout:2/657: fdatasync d14/d22/fcc 0 2024-05-09T00:07:51.435 INFO:tasks.workunit.client.0.smithi026.stdout:2/658: creat d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/fda x:0 0 0 2024-05-09T00:07:51.459 INFO:tasks.workunit.client.0.smithi026.stdout:2/659: dwrite d14/d22/d55/da3/d3b/d40/f90 [0,4194304] 0 2024-05-09T00:07:51.459 INFO:tasks.workunit.client.0.smithi026.stdout:2/660: readlink d14/d22/d55/da3/d30/d6a/d5b/l89 0 2024-05-09T00:07:51.459 INFO:tasks.workunit.client.0.smithi026.stdout:1/742: dwrite d5/d16/d60/d66/d86/d103/fce [0,4194304] 0 2024-05-09T00:07:51.460 INFO:tasks.workunit.client.0.smithi026.stdout:2/661: write d14/d22/f33 [1164174,118581] 0 2024-05-09T00:07:51.462 INFO:tasks.workunit.client.0.smithi026.stdout:1/743: unlink d5/dd/d17/d73/c43 0 2024-05-09T00:07:51.462 INFO:tasks.workunit.client.0.smithi026.stdout:1/744: truncate d5/db/ffc 756822 0 2024-05-09T00:07:51.462 INFO:tasks.workunit.client.0.smithi026.stdout:1/745: dread - d5/dd/d1f/d51/f6f zero size 2024-05-09T00:07:51.464 INFO:tasks.workunit.client.0.smithi026.stdout:2/662: mkdir d14/d22/d55/da3/d20/ddb 0 2024-05-09T00:07:51.465 INFO:tasks.workunit.client.0.smithi026.stdout:2/663: write f5 [5202464,53538] 0 2024-05-09T00:07:51.466 INFO:tasks.workunit.client.0.smithi026.stdout:2/664: read d14/d22/d55/da3/d20/d41/faf [3396760,40874] 0 2024-05-09T00:07:51.466 INFO:tasks.workunit.client.0.smithi026.stdout:1/746: symlink d5/d16/d60/dda/l104 0 2024-05-09T00:07:51.466 INFO:tasks.workunit.client.0.smithi026.stdout:1/747: write d5/dd/d17/f2a [4124681,108178] 0 2024-05-09T00:07:51.469 INFO:tasks.workunit.client.0.smithi026.stdout:2/665: rename d14/d22/d55/da3/d20/fa2 to d14/d22/d55/da3/d20/fdc 0 2024-05-09T00:07:51.470 INFO:tasks.workunit.client.0.smithi026.stdout:2/666: creat d14/d22/d55/da3/d20/d41/d51/d82/daa/fdd x:0 0 0 2024-05-09T00:07:51.484 INFO:tasks.workunit.client.0.smithi026.stdout:1/748: dwrite d5/dd/d1f/d39/f8e [0,4194304] 0 2024-05-09T00:07:51.488 INFO:tasks.workunit.client.0.smithi026.stdout:1/749: mkdir d5/db/d1d/dd1/d105 0 2024-05-09T00:07:51.499 INFO:tasks.workunit.client.0.smithi026.stdout:2/667: dwrite d14/d22/d55/da3/d3b/d40/f8a [4194304,4194304] 0 2024-05-09T00:07:51.506 INFO:tasks.workunit.client.0.smithi026.stdout:1/750: dwrite d5/dd/ff [0,4194304] 0 2024-05-09T00:07:51.510 INFO:tasks.workunit.client.0.smithi026.stdout:1/751: read d5/d16/d60/d66/fdc [17510,124208] 0 2024-05-09T00:07:51.512 INFO:tasks.workunit.client.0.smithi026.stdout:1/752: read d5/db/f5d [808499,20975] 0 2024-05-09T00:07:51.520 INFO:tasks.workunit.client.0.smithi026.stdout:2/668: dwrite d14/d22/d55/d6b/d93/fd3 [0,4194304] 0 2024-05-09T00:07:51.545 INFO:tasks.workunit.client.0.smithi026.stdout:2/669: symlink d14/d22/d55/da3/d3b/d40/d68/lde 0 2024-05-09T00:07:51.545 INFO:tasks.workunit.client.0.smithi026.stdout:2/670: write d14/d22/d55/da3/d3b/d40/f8a [9398647,129935] 0 2024-05-09T00:07:51.546 INFO:tasks.workunit.client.0.smithi026.stdout:2/671: chown d14/d22/d55/da3/d3b 175 1 2024-05-09T00:07:51.564 INFO:tasks.workunit.client.0.smithi026.stdout:2/672: dwrite d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/fda [0,4194304] 0 2024-05-09T00:07:51.573 INFO:tasks.workunit.client.0.smithi026.stdout:2/673: mkdir d14/d22/d55/ddf 0 2024-05-09T00:07:51.573 INFO:tasks.workunit.client.0.smithi026.stdout:2/674: write f11 [211488,57153] 0 2024-05-09T00:07:51.582 INFO:tasks.workunit.client.0.smithi026.stdout:2/675: dread d14/d22/d55/da3/d17/fad [0,4194304] 0 2024-05-09T00:07:51.603 INFO:tasks.workunit.client.0.smithi026.stdout:2/676: dwrite d14/fa8 [0,4194304] 0 2024-05-09T00:07:51.611 INFO:tasks.workunit.client.0.smithi026.stdout:2/677: creat d14/d22/d55/da3/d3b/d40/fe0 x:0 0 0 2024-05-09T00:07:51.615 INFO:tasks.workunit.client.0.smithi026.stdout:2/678: mknod d14/d22/d55/da3/d20/db2/d70/ce1 0 2024-05-09T00:07:51.615 INFO:tasks.workunit.client.0.smithi026.stdout:2/679: chown d14/d22/d55/da3/d30/d6a/l6f 26 1 2024-05-09T00:07:51.615 INFO:tasks.workunit.client.0.smithi026.stdout:2/680: rename d14/d22/d55/da3/d30/d6a/d5b to d14/d22/d55/da3/d30/d6a/d5b/de2 22 2024-05-09T00:07:51.615 INFO:tasks.workunit.client.0.smithi026.stdout:2/681: read - d14/d22/d55/fbd zero size 2024-05-09T00:07:51.622 INFO:tasks.workunit.client.0.smithi026.stdout:2/682: dread d14/d22/d55/da3/d20/d41/faf [0,4194304] 0 2024-05-09T00:07:51.622 INFO:tasks.workunit.client.0.smithi026.stdout:2/683: mknod d14/d22/d55/d6b/d93/ce3 0 2024-05-09T00:07:51.624 INFO:tasks.workunit.client.0.smithi026.stdout:5/577: sync 2024-05-09T00:07:51.624 INFO:tasks.workunit.client.0.smithi026.stdout:5/578: dread - d2/d8/d31/d63/d9c/fb6 zero size 2024-05-09T00:07:51.628 INFO:tasks.workunit.client.0.smithi026.stdout:2/684: creat d14/d22/d55/d6b/da5/fe4 x:0 0 0 2024-05-09T00:07:51.632 INFO:tasks.workunit.client.0.smithi026.stdout:2/685: creat d14/d22/d55/d6b/d93/fe5 x:0 0 0 2024-05-09T00:07:51.636 INFO:tasks.workunit.client.0.smithi026.stdout:2/686: getdents d14 0 2024-05-09T00:07:51.642 INFO:tasks.workunit.client.0.smithi026.stdout:2/687: write d14/d22/d55/da3/d17/fad [4060687,33197] 0 2024-05-09T00:07:51.643 INFO:tasks.workunit.client.0.smithi026.stdout:2/688: creat d14/d22/fe6 x:0 0 0 2024-05-09T00:07:51.645 INFO:tasks.workunit.client.0.smithi026.stdout:2/689: rename fb to d14/d22/d55/da3/d3b/d40/fe7 0 2024-05-09T00:07:51.645 INFO:tasks.workunit.client.0.smithi026.stdout:2/690: write d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fb3 [439,21436] 0 2024-05-09T00:07:51.647 INFO:tasks.workunit.client.0.smithi026.stdout:2/691: creat d14/d22/d55/da3/d20/d41/fe8 x:0 0 0 2024-05-09T00:07:51.647 INFO:tasks.workunit.client.0.smithi026.stdout:2/692: dread - d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/d96/fd1 zero size 2024-05-09T00:07:51.649 INFO:tasks.workunit.client.0.smithi026.stdout:2/693: mkdir d14/d22/d55/da3/d30/d6a/d5f/de9 0 2024-05-09T00:07:51.650 INFO:tasks.workunit.client.0.smithi026.stdout:5/579: dwrite d2/d8/d6d/f8f [0,4194304] 0 2024-05-09T00:07:51.654 INFO:tasks.workunit.client.0.smithi026.stdout:5/580: mknod d2/d8/d31/d24/cbb 0 2024-05-09T00:07:51.655 INFO:tasks.workunit.client.0.smithi026.stdout:5/581: mkdir d2/d8/d31/d63/d9c/dbc 0 2024-05-09T00:07:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:5/582: symlink d2/d8/d31/d32/d48/daa/db4/lbd 0 2024-05-09T00:07:51.665 INFO:tasks.workunit.client.0.smithi026.stdout:2/694: rmdir d14/d22/d55/da3/d30 39 2024-05-09T00:07:51.667 INFO:tasks.workunit.client.0.smithi026.stdout:2/695: mkdir d14/d22/dea 0 2024-05-09T00:07:51.670 INFO:tasks.workunit.client.0.smithi026.stdout:2/696: mkdir d14/d22/d55/deb 0 2024-05-09T00:07:51.673 INFO:tasks.workunit.client.0.smithi026.stdout:2/697: creat d14/d22/d55/fec x:0 0 0 2024-05-09T00:07:51.674 INFO:tasks.workunit.client.0.smithi026.stdout:2/698: getdents d14/d22/d55/da3/d30/d6a/d5b 0 2024-05-09T00:07:51.677 INFO:tasks.workunit.client.0.smithi026.stdout:2/699: write f8 [828052,108932] 0 2024-05-09T00:07:51.679 INFO:tasks.workunit.client.0.smithi026.stdout:5/583: dwrite d2/d8/d31/d2e/d33/f61 [0,4194304] 0 2024-05-09T00:07:51.679 INFO:tasks.workunit.client.0.smithi026.stdout:5/584: write d2/d8/d31/d63/f9d [4601737,2039] 0 2024-05-09T00:07:51.679 INFO:tasks.workunit.client.0.smithi026.stdout:5/585: truncate d2/d8/d31/d63/d9c/fb6 341041 0 2024-05-09T00:07:51.680 INFO:tasks.workunit.client.0.smithi026.stdout:2/700: dread d14/f18 [4194304,4194304] 0 2024-05-09T00:07:51.685 INFO:tasks.workunit.client.0.smithi026.stdout:2/701: link d14/d22/f33 d14/d22/d55/da3/d30/d6a/fed 0 2024-05-09T00:07:51.698 INFO:tasks.workunit.client.0.smithi026.stdout:5/586: dwrite d2/d8/d2a/d8d/fb9 [0,4194304] 0 2024-05-09T00:07:51.718 INFO:tasks.workunit.client.0.smithi026.stdout:5/587: dwrite d2/d8/d31/d32/fb0 [0,4194304] 0 2024-05-09T00:07:51.718 INFO:tasks.workunit.client.0.smithi026.stdout:5/588: chown d2/d8/d31/d32/d48/c49 5498681 1 2024-05-09T00:07:51.718 INFO:tasks.workunit.client.0.smithi026.stdout:5/589: chown d2/d8/d6d/c78 483305960 1 2024-05-09T00:07:51.749 INFO:tasks.workunit.client.0.smithi026.stdout:5/590: rmdir d2 39 2024-05-09T00:07:51.749 INFO:tasks.workunit.client.0.smithi026.stdout:5/591: chown d2/d8/d2a/l56 222 1 2024-05-09T00:07:51.749 INFO:tasks.workunit.client.0.smithi026.stdout:5/592: chown d2/d8/d31/d32/c80 960 1 2024-05-09T00:07:51.750 INFO:tasks.workunit.client.0.smithi026.stdout:5/593: read d2/d8/d6d/f8f [3475759,23284] 0 2024-05-09T00:07:51.750 INFO:tasks.workunit.client.0.smithi026.stdout:5/594: stat d2/d8/d31/f85 0 2024-05-09T00:07:51.752 INFO:tasks.workunit.client.0.smithi026.stdout:5/595: mkdir d2/d8/d2a/d8d/dbe 0 2024-05-09T00:07:51.792 INFO:tasks.workunit.client.0.smithi026.stdout:5/596: rename d2/d8/d31/d32/c81 to d2/d8/d31/d24/cbf 0 2024-05-09T00:07:51.792 INFO:tasks.workunit.client.0.smithi026.stdout:5/597: write d2/d8/f59 [8378,123889] 0 2024-05-09T00:07:51.794 INFO:tasks.workunit.client.0.smithi026.stdout:5/598: mknod d2/d8/d31/d32/d48/daa/db4/cc0 0 2024-05-09T00:07:51.797 INFO:tasks.workunit.client.0.smithi026.stdout:5/599: truncate d2/d5a/d96/f53 2701085 0 2024-05-09T00:07:51.797 INFO:tasks.workunit.client.0.smithi026.stdout:5/600: stat d2/d8/d31/d32/d5c/f67 0 2024-05-09T00:07:51.800 INFO:tasks.workunit.client.0.smithi026.stdout:5/601: creat d2/d8/d31/fc1 x:0 0 0 2024-05-09T00:07:51.801 INFO:tasks.workunit.client.0.smithi026.stdout:5/602: write d2/d8/d31/d2e/f9b [3249048,18359] 0 2024-05-09T00:07:51.803 INFO:tasks.workunit.client.0.smithi026.stdout:5/603: link d2/d8/d2a/l56 d2/d8/d31/d24/lc2 0 2024-05-09T00:07:51.804 INFO:tasks.workunit.client.0.smithi026.stdout:5/604: creat d2/d8/d31/d32/da2/fc3 x:0 0 0 2024-05-09T00:07:51.805 INFO:tasks.workunit.client.0.smithi026.stdout:5/605: truncate d2/d8/f8b 853700 0 2024-05-09T00:07:51.822 INFO:tasks.workunit.client.0.smithi026.stdout:5/606: dwrite d2/d8/d31/d32/da2/fc3 [0,4194304] 0 2024-05-09T00:07:51.822 INFO:tasks.workunit.client.0.smithi026.stdout:5/607: chown d2/d8/d31/d2e/d35/fa9 106499 1 2024-05-09T00:07:51.823 INFO:tasks.workunit.client.0.smithi026.stdout:5/608: write d2/d8/d31/d2e/d33/f68 [3269094,66161] 0 2024-05-09T00:07:51.825 INFO:tasks.workunit.client.0.smithi026.stdout:3/536: sync 2024-05-09T00:07:51.831 INFO:tasks.workunit.client.0.smithi026.stdout:5/609: link d2/d8/d31/c20 d2/d5a/d96/cc4 0 2024-05-09T00:07:51.831 INFO:tasks.workunit.client.0.smithi026.stdout:5/610: fdatasync d2/d8/d31/d2e/d35/fa8 0 2024-05-09T00:07:51.832 INFO:tasks.workunit.client.0.smithi026.stdout:5/611: symlink d2/d8/d31/d32/da2/dac/lc5 0 2024-05-09T00:07:51.832 INFO:tasks.workunit.client.0.smithi026.stdout:5/612: write d2/d8/d31/d24/f7b [5931353,26413] 0 2024-05-09T00:07:51.848 INFO:tasks.workunit.client.0.smithi026.stdout:3/537: dwrite d5/d9/dc/f11 [0,4194304] 0 2024-05-09T00:07:51.851 INFO:tasks.workunit.client.0.smithi026.stdout:3/538: mkdir d5/db1 0 2024-05-09T00:07:51.851 INFO:tasks.workunit.client.0.smithi026.stdout:5/613: dwrite d2/d8/d2a/f58 [0,4194304] 0 2024-05-09T00:07:51.853 INFO:tasks.workunit.client.0.smithi026.stdout:3/539: mkdir d5/d9/dc/d5b/da5/db2 0 2024-05-09T00:07:51.860 INFO:tasks.workunit.client.0.smithi026.stdout:3/540: truncate d5/d41/f43 193708 0 2024-05-09T00:07:51.860 INFO:tasks.workunit.client.0.smithi026.stdout:3/541: readlink d5/d9/dc/d28/l14 0 2024-05-09T00:07:51.863 INFO:tasks.workunit.client.0.smithi026.stdout:3/542: getdents d5/d1e/d7b 0 2024-05-09T00:07:51.863 INFO:tasks.workunit.client.0.smithi026.stdout:3/543: read d5/d9/f2a [369020,1380] 0 2024-05-09T00:07:51.871 INFO:tasks.workunit.client.0.smithi026.stdout:3/544: dread d5/f22 [0,4194304] 0 2024-05-09T00:07:51.880 INFO:tasks.workunit.client.0.smithi026.stdout:3/545: dread d5/d1e/f3d [0,4194304] 0 2024-05-09T00:07:51.880 INFO:tasks.workunit.client.0.smithi026.stdout:3/546: chown d5/f12 335 1 2024-05-09T00:07:51.881 INFO:tasks.workunit.client.0.smithi026.stdout:3/547: mkdir d5/d9/dc/d5b/da5/db3 0 2024-05-09T00:07:51.882 INFO:tasks.workunit.client.0.smithi026.stdout:3/548: unlink d5/d9/dc/d28/f2e 0 2024-05-09T00:07:51.882 INFO:tasks.workunit.client.0.smithi026.stdout:3/549: truncate d5/d9/dc/d28/d2c/fa6 558770 0 2024-05-09T00:07:51.884 INFO:tasks.workunit.client.0.smithi026.stdout:3/550: rename d5/l6 to d5/d9/d49/lb4 0 2024-05-09T00:07:51.887 INFO:tasks.workunit.client.0.smithi026.stdout:3/551: dread d5/d44/f79 [0,4194304] 0 2024-05-09T00:07:51.893 INFO:tasks.workunit.client.0.smithi026.stdout:4/660: sync 2024-05-09T00:07:51.893 INFO:tasks.workunit.client.0.smithi026.stdout:0/792: sync 2024-05-09T00:07:51.894 INFO:tasks.workunit.client.0.smithi026.stdout:9/674: sync 2024-05-09T00:07:51.894 INFO:tasks.workunit.client.0.smithi026.stdout:9/675: write d7/d23/d2f/f35 [556462,67394] 0 2024-05-09T00:07:51.894 INFO:tasks.workunit.client.0.smithi026.stdout:4/661: rmdir d0/d83 39 2024-05-09T00:07:51.896 INFO:tasks.workunit.client.0.smithi026.stdout:0/793: mknod d1d/d25/d47/c10a 0 2024-05-09T00:07:51.897 INFO:tasks.workunit.client.0.smithi026.stdout:4/662: unlink d0/d12/da2/d97/d43/d49/d8f/dc1/fcd 0 2024-05-09T00:07:51.897 INFO:tasks.workunit.client.0.smithi026.stdout:4/663: dread - d0/d12/d1b/d4e/d92/fb4 zero size 2024-05-09T00:07:51.904 INFO:tasks.workunit.client.0.smithi026.stdout:9/676: dread d7/f19 [4194304,4194304] 0 2024-05-09T00:07:51.906 INFO:tasks.workunit.client.0.smithi026.stdout:9/677: truncate d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa7 3456444 0 2024-05-09T00:07:51.908 INFO:tasks.workunit.client.0.smithi026.stdout:9/678: unlink f3 0 2024-05-09T00:07:51.909 INFO:tasks.workunit.client.0.smithi026.stdout:9/679: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/fe9 x:0 0 0 2024-05-09T00:07:51.912 INFO:tasks.workunit.client.0.smithi026.stdout:9/680: symlink d7/d23/d29/d31/lea 0 2024-05-09T00:07:51.914 INFO:tasks.workunit.client.0.smithi026.stdout:9/681: rmdir d7/d23/d2f/d7d/d87 39 2024-05-09T00:07:51.917 INFO:tasks.workunit.client.0.smithi026.stdout:0/794: dwrite d1d/d1e/f4b [0,4194304] 0 2024-05-09T00:07:51.917 INFO:tasks.workunit.client.0.smithi026.stdout:4/664: dwrite d0/d12/da2/d97/d43/d49/d8f/da3/d66/faf [0,4194304] 0 2024-05-09T00:07:51.924 INFO:tasks.workunit.client.0.smithi026.stdout:0/795: creat d1d/d1e/f10b x:0 0 0 2024-05-09T00:07:51.932 INFO:tasks.workunit.client.0.smithi026.stdout:4/665: rename d0/d12/da2/d97/c23 to d0/d12/da2/d97/d43/d58/db3/ce3 0 2024-05-09T00:07:51.934 INFO:tasks.workunit.client.0.smithi026.stdout:0/796: stat c8 0 2024-05-09T00:07:51.939 INFO:tasks.workunit.client.0.smithi026.stdout:4/666: creat d0/d12/fe4 x:0 0 0 2024-05-09T00:07:51.953 INFO:tasks.workunit.client.0.smithi026.stdout:9/682: dwrite d7/f28 [0,4194304] 0 2024-05-09T00:07:51.954 INFO:tasks.workunit.client.0.smithi026.stdout:9/683: stat d7/cc7 0 2024-05-09T00:07:51.957 INFO:tasks.workunit.client.0.smithi026.stdout:0/797: dwrite d1d/d1e/d2d/f49 [0,4194304] 0 2024-05-09T00:07:51.957 INFO:tasks.workunit.client.0.smithi026.stdout:0/798: write d1d/d1e/d20/d100/d80/ff1 [427979,3588] 0 2024-05-09T00:07:51.957 INFO:tasks.workunit.client.0.smithi026.stdout:4/667: dwrite d0/d12/d1b/f3c [0,4194304] 0 2024-05-09T00:07:51.965 INFO:tasks.workunit.client.0.smithi026.stdout:0/799: rename d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d96/cd4 to d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc/c10c 0 2024-05-09T00:07:51.965 INFO:tasks.workunit.client.0.smithi026.stdout:0/800: chown d1d/d25/l7f 210644 1 2024-05-09T00:07:51.965 INFO:tasks.workunit.client.0.smithi026.stdout:0/801: chown d1d/d1e/d2d/f98 6319 1 2024-05-09T00:07:51.969 INFO:tasks.workunit.client.0.smithi026.stdout:4/668: creat d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/fe5 x:0 0 0 2024-05-09T00:07:51.969 INFO:tasks.workunit.client.0.smithi026.stdout:4/669: read d0/d12/d64/f82 [31011,17159] 0 2024-05-09T00:07:51.971 INFO:tasks.workunit.client.0.smithi026.stdout:9/684: dwrite d7/d23/f61 [0,4194304] 0 2024-05-09T00:07:51.971 INFO:tasks.workunit.client.0.smithi026.stdout:0/802: rename d1d/d25/d3c/f46 to d1d/d1e/d20/d4d/d83/da0/dd2/da7/f10d 0 2024-05-09T00:07:51.971 INFO:tasks.workunit.client.0.smithi026.stdout:0/803: truncate d1d/da4/fb8 163778 0 2024-05-09T00:07:51.973 INFO:tasks.workunit.client.0.smithi026.stdout:4/670: truncate d0/d83/f9e 814359 0 2024-05-09T00:07:51.978 INFO:tasks.workunit.client.0.smithi026.stdout:9/685: mkdir d7/d26/deb 0 2024-05-09T00:07:51.978 INFO:tasks.workunit.client.0.smithi026.stdout:9/686: stat d7/d23/d29/d59/f5f 0 2024-05-09T00:07:51.980 INFO:tasks.workunit.client.0.smithi026.stdout:9/687: fsync d7/f7f 0 2024-05-09T00:07:51.982 INFO:tasks.workunit.client.0.smithi026.stdout:9/688: mkdir d7/d23/d29/d59/dec 0 2024-05-09T00:07:51.984 INFO:tasks.workunit.client.0.smithi026.stdout:7/761: sync 2024-05-09T00:07:51.985 INFO:tasks.workunit.client.0.smithi026.stdout:7/762: write d8/d2e/d84/db4/dbc/d1e/d3d/dca/fda [1405336,72890] 0 2024-05-09T00:07:51.985 INFO:tasks.workunit.client.0.smithi026.stdout:7/763: readlink d8/d2e/d84/db4/dbc/d1e/d3d/dca/ld3 0 2024-05-09T00:07:51.992 INFO:tasks.workunit.client.0.smithi026.stdout:7/764: symlink d8/d2e/d84/db4/dbc/d22/l109 0 2024-05-09T00:07:51.992 INFO:tasks.workunit.client.0.smithi026.stdout:7/765: fdatasync d8/d2e/d84/db4/dbc/d22/f42 0 2024-05-09T00:07:52.002 INFO:tasks.workunit.client.0.smithi026.stdout:0/804: dwrite d1d/d1e/d20/d100/fe0 [0,4194304] 0 2024-05-09T00:07:52.002 INFO:tasks.workunit.client.0.smithi026.stdout:4/671: dwrite d0/d12/da2/d97/d43/d49/d8f/da3/f5e [0,4194304] 0 2024-05-09T00:07:52.003 INFO:tasks.workunit.client.0.smithi026.stdout:4/672: write d0/f94 [909860,26096] 0 2024-05-09T00:07:52.003 INFO:tasks.workunit.client.0.smithi026.stdout:4/673: write d0/d12/da2/d97/dbf/fca [1029416,67487] 0 2024-05-09T00:07:52.003 INFO:tasks.workunit.client.0.smithi026.stdout:4/674: write d0/d12/d64/fab [120254,26187] 0 2024-05-09T00:07:52.003 INFO:tasks.workunit.client.0.smithi026.stdout:4/675: chown d0/d12/d1b/d4e/d92/fb4 1146 1 2024-05-09T00:07:52.003 INFO:tasks.workunit.client.0.smithi026.stdout:4/676: truncate d0/d12/d64/fab 333051 0 2024-05-09T00:07:52.004 INFO:tasks.workunit.client.0.smithi026.stdout:0/805: mknod d1d/d1e/d20/d4d/d83/da0/dd2/da7/c10e 0 2024-05-09T00:07:52.005 INFO:tasks.workunit.client.0.smithi026.stdout:7/766: dread d8/d2e/d84/db4/dbc/f7f [0,4194304] 0 2024-05-09T00:07:52.011 INFO:tasks.workunit.client.0.smithi026.stdout:4/677: mknod d0/d12/da2/d97/d43/d49/d8f/da3/d66/ce6 0 2024-05-09T00:07:52.011 INFO:tasks.workunit.client.0.smithi026.stdout:4/678: fdatasync d0/d12/da2/d97/d43/d49/fa0 0 2024-05-09T00:07:52.011 INFO:tasks.workunit.client.0.smithi026.stdout:4/679: write d0/d12/da2/d97/f8a [1028121,93472] 0 2024-05-09T00:07:52.018 INFO:tasks.workunit.client.0.smithi026.stdout:7/767: mknod d8/d2e/d84/db4/dbc/d1e/d3d/d6b/c10a 0 2024-05-09T00:07:52.018 INFO:tasks.workunit.client.0.smithi026.stdout:7/768: stat d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/fc2 0 2024-05-09T00:07:52.019 INFO:tasks.workunit.client.0.smithi026.stdout:4/680: mkdir d0/d12/da2/d97/d43/d49/de7 0 2024-05-09T00:07:52.019 INFO:tasks.workunit.client.0.smithi026.stdout:4/681: write d0/d12/da2/d97/f57 [408622,59252] 0 2024-05-09T00:07:52.026 INFO:tasks.workunit.client.0.smithi026.stdout:9/689: dwrite d7/d23/d2f/d3a/f55 [0,4194304] 0 2024-05-09T00:07:52.026 INFO:tasks.workunit.client.0.smithi026.stdout:0/806: dwrite d1d/f29 [4194304,4194304] 0 2024-05-09T00:07:52.027 INFO:tasks.workunit.client.0.smithi026.stdout:9/690: dread d7/d23/d29/d31/d40/f82 [0,4194304] 0 2024-05-09T00:07:52.031 INFO:tasks.workunit.client.0.smithi026.stdout:9/691: symlink d7/d23/d2f/d7d/db2/led 0 2024-05-09T00:07:52.032 INFO:tasks.workunit.client.0.smithi026.stdout:9/692: mknod d7/d23/d29/d31/d40/d41/d54/dc5/cee 0 2024-05-09T00:07:52.034 INFO:tasks.workunit.client.0.smithi026.stdout:9/693: rmdir d7/d23/d2f/d7d/db2 39 2024-05-09T00:07:52.037 INFO:tasks.workunit.client.0.smithi026.stdout:9/694: creat d7/d23/d29/d59/dec/fef x:0 0 0 2024-05-09T00:07:52.037 INFO:tasks.workunit.client.0.smithi026.stdout:7/769: dwrite d8/d2e/d84/db4/dbc/d1e/f7c [0,4194304] 0 2024-05-09T00:07:52.040 INFO:tasks.workunit.client.0.smithi026.stdout:9/695: stat d7/d23/d29/d31/d40/d41/d54/c9b 0 2024-05-09T00:07:52.044 INFO:tasks.workunit.client.0.smithi026.stdout:0/807: dwrite d1d/d1e/d2d/fdd [0,4194304] 0 2024-05-09T00:07:52.047 INFO:tasks.workunit.client.0.smithi026.stdout:0/808: mkdir d1d/d1e/d2d/d10f 0 2024-05-09T00:07:52.054 INFO:tasks.workunit.client.0.smithi026.stdout:4/682: dwrite d0/d12/f13 [0,4194304] 0 2024-05-09T00:07:52.054 INFO:tasks.workunit.client.0.smithi026.stdout:0/809: dread d1d/d1e/d20/d4d/d83/da0/dd2/da7/ff2 [0,4194304] 0 2024-05-09T00:07:52.055 INFO:tasks.workunit.client.0.smithi026.stdout:0/810: chown f11 159 1 2024-05-09T00:07:52.057 INFO:tasks.workunit.client.0.smithi026.stdout:4/683: link d0/d12/d1b/l3b d0/d12/da2/d97/d43/d49/d8f/le8 0 2024-05-09T00:07:52.058 INFO:tasks.workunit.client.0.smithi026.stdout:0/811: truncate d1d/d1e/f23 83916 0 2024-05-09T00:07:52.059 INFO:tasks.workunit.client.0.smithi026.stdout:4/684: getdents d0/d12/da2/d97 0 2024-05-09T00:07:52.059 INFO:tasks.workunit.client.0.smithi026.stdout:4/685: chown d0/d12/da2/d97/d43/d49/d8f/dc1 1094101 1 2024-05-09T00:07:52.062 INFO:tasks.workunit.client.0.smithi026.stdout:0/812: link d1d/d1e/d2d/fdd d1d/d1e/d20/d4d/d83/da0/d104/f110 0 2024-05-09T00:07:52.064 INFO:tasks.workunit.client.0.smithi026.stdout:4/686: creat d0/d12/d64/dac/dd3/fe9 x:0 0 0 2024-05-09T00:07:52.066 INFO:tasks.workunit.client.0.smithi026.stdout:4/687: rename d0/d12/da2/f9f to d0/d12/da2/d97/d43/fea 0 2024-05-09T00:07:52.068 INFO:tasks.workunit.client.0.smithi026.stdout:4/688: rename d0/d12/l81 to d0/d12/da2/d97/dbf/dd1/leb 0 2024-05-09T00:07:52.068 INFO:tasks.workunit.client.0.smithi026.stdout:4/689: dread - d0/d12/da2/d97/d43/d58/f7e zero size 2024-05-09T00:07:52.068 INFO:tasks.workunit.client.0.smithi026.stdout:4/690: readlink d0/d12/da2/d97/d43/d49/d8f/da3/d66/l7d 0 2024-05-09T00:07:52.069 INFO:tasks.workunit.client.0.smithi026.stdout:4/691: mknod d0/d12/da2/d97/d43/d58/cec 0 2024-05-09T00:07:52.086 INFO:tasks.workunit.client.0.smithi026.stdout:4/692: dwrite d0/d12/da2/d97/d43/d49/d8f/da3/f3f [0,4194304] 0 2024-05-09T00:07:52.087 INFO:tasks.workunit.client.0.smithi026.stdout:0/813: dwrite d1d/d1e/fde [0,4194304] 0 2024-05-09T00:07:52.092 INFO:tasks.workunit.client.0.smithi026.stdout:0/814: creat d1d/d1e/d20/d4d/d83/da0/dd2/da7/f111 x:0 0 0 2024-05-09T00:07:52.092 INFO:tasks.workunit.client.0.smithi026.stdout:7/770: dwrite d8/d2e/d84/db4/dbc/f7f [4194304,4194304] 0 2024-05-09T00:07:52.093 INFO:tasks.workunit.client.0.smithi026.stdout:7/771: read d8/d2e/d84/db4/dbc/fa5 [257115,55629] 0 2024-05-09T00:07:52.098 INFO:tasks.workunit.client.0.smithi026.stdout:0/815: unlink d1d/d25/d47/l52 0 2024-05-09T00:07:52.098 INFO:tasks.workunit.client.0.smithi026.stdout:0/816: write d1d/d1e/d20/d100/d80/ff1 [908816,106249] 0 2024-05-09T00:07:52.099 INFO:tasks.workunit.client.0.smithi026.stdout:9/696: dwrite d7/d23/d2f/f35 [0,4194304] 0 2024-05-09T00:07:52.102 INFO:tasks.workunit.client.0.smithi026.stdout:7/772: symlink d8/d2e/d84/db4/dbc/d1e/d8a/df0/l10b 0 2024-05-09T00:07:52.108 INFO:tasks.workunit.client.0.smithi026.stdout:0/817: link d1d/d25/d47/fb9 d1d/d25/d47/dc8/f112 0 2024-05-09T00:07:52.109 INFO:tasks.workunit.client.0.smithi026.stdout:0/818: read - d1d/ffb zero size 2024-05-09T00:07:52.111 INFO:tasks.workunit.client.0.smithi026.stdout:0/819: dread d1d/d33/dbb/fce [0,4194304] 0 2024-05-09T00:07:52.111 INFO:tasks.workunit.client.0.smithi026.stdout:0/820: chown d1d/d1e/d20/d51/f57 500985 1 2024-05-09T00:07:52.113 INFO:tasks.workunit.client.0.smithi026.stdout:0/821: write fa [6840651,10988] 0 2024-05-09T00:07:52.113 INFO:tasks.workunit.client.0.smithi026.stdout:4/693: dwrite d0/d12/da2/d97/f1e [0,4194304] 0 2024-05-09T00:07:52.113 INFO:tasks.workunit.client.0.smithi026.stdout:4/694: getdents d0/d12/da2/d97/d43/d49/de7 0 2024-05-09T00:07:52.113 INFO:tasks.workunit.client.0.smithi026.stdout:4/695: chown d0/d12/da2/d97/d43/d58/fbb 0 1 2024-05-09T00:07:52.120 INFO:tasks.workunit.client.0.smithi026.stdout:7/773: dwrite d8/d2e/d84/db4/dbc/d1e/fec [0,4194304] 0 2024-05-09T00:07:52.126 INFO:tasks.workunit.client.0.smithi026.stdout:9/697: unlink d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa1 0 2024-05-09T00:07:52.126 INFO:tasks.workunit.client.0.smithi026.stdout:9/698: chown d7/d23/d2f/l81 1 1 2024-05-09T00:07:52.130 INFO:tasks.workunit.client.0.smithi026.stdout:0/822: unlink d1d/c24 0 2024-05-09T00:07:52.130 INFO:tasks.workunit.client.0.smithi026.stdout:0/823: fsync d1d/d1e/f4b 0 2024-05-09T00:07:52.130 INFO:tasks.workunit.client.0.smithi026.stdout:0/824: fsync ff 0 2024-05-09T00:07:52.130 INFO:tasks.workunit.client.0.smithi026.stdout:0/825: chown d1d/d1e 223 1 2024-05-09T00:07:52.130 INFO:tasks.workunit.client.0.smithi026.stdout:0/826: chown d1d/d1e/d2d/fdd 2512253 1 2024-05-09T00:07:52.133 INFO:tasks.workunit.client.0.smithi026.stdout:4/696: symlink d0/d12/d87/led 0 2024-05-09T00:07:52.138 INFO:tasks.workunit.client.0.smithi026.stdout:9/699: rename d7/d23/d29/d31/d40/d41/d54/dc5/ld7 to d7/d23/lf0 0 2024-05-09T00:07:52.139 INFO:tasks.workunit.client.0.smithi026.stdout:0/827: rmdir d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d84 39 2024-05-09T00:07:52.140 INFO:tasks.workunit.client.0.smithi026.stdout:4/697: creat d0/d12/da2/d97/dbf/dd1/fee x:0 0 0 2024-05-09T00:07:52.140 INFO:tasks.workunit.client.0.smithi026.stdout:4/698: fsync d0/d12/da2/fb0 0 2024-05-09T00:07:52.140 INFO:tasks.workunit.client.0.smithi026.stdout:4/699: dread - d0/d12/da2/db8/fc4 zero size 2024-05-09T00:07:52.141 INFO:tasks.workunit.client.0.smithi026.stdout:7/774: mknod d8/d2e/d84/db4/dbc/d1e/d3d/c10c 0 2024-05-09T00:07:52.141 INFO:tasks.workunit.client.0.smithi026.stdout:7/775: chown d8/d5c/fcb 151043 1 2024-05-09T00:07:52.142 INFO:tasks.workunit.client.0.smithi026.stdout:9/700: creat d7/d23/d2f/d50/ff1 x:0 0 0 2024-05-09T00:07:52.144 INFO:tasks.workunit.client.0.smithi026.stdout:0/828: creat d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/f113 x:0 0 0 2024-05-09T00:07:52.146 INFO:tasks.workunit.client.0.smithi026.stdout:4/700: stat d0/d12/da2/d97/dbf/dd1/leb 0 2024-05-09T00:07:52.146 INFO:tasks.workunit.client.0.smithi026.stdout:4/701: read - d0/d12/d64/dac/dd3/fe9 zero size 2024-05-09T00:07:52.149 INFO:tasks.workunit.client.0.smithi026.stdout:9/701: unlink d7/d23/d29/d31/d40/d41/d54/ld9 0 2024-05-09T00:07:52.150 INFO:tasks.workunit.client.0.smithi026.stdout:0/829: symlink d1d/d25/dfd/l114 0 2024-05-09T00:07:52.150 INFO:tasks.workunit.client.0.smithi026.stdout:0/830: stat d1d/d1e/d20/d4d/fec 0 2024-05-09T00:07:52.150 INFO:tasks.workunit.client.0.smithi026.stdout:0/831: write d1d/d33/f61 [3764885,11256] 0 2024-05-09T00:07:52.150 INFO:tasks.workunit.client.0.smithi026.stdout:0/832: stat d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc 0 2024-05-09T00:07:52.151 INFO:tasks.workunit.client.0.smithi026.stdout:9/702: creat d7/d23/d29/d59/d91/ff2 x:0 0 0 2024-05-09T00:07:52.152 INFO:tasks.workunit.client.0.smithi026.stdout:0/833: link d1d/d33/d64/l6b d1d/d25/d3c/l115 0 2024-05-09T00:07:52.155 INFO:tasks.workunit.client.0.smithi026.stdout:0/834: unlink d1d/d1e/d20/d4d/d83/da0/dd2/da7/c10e 0 2024-05-09T00:07:52.156 INFO:tasks.workunit.client.0.smithi026.stdout:9/703: link d7/l1c d7/d23/d2f/d7d/d87/lf3 0 2024-05-09T00:07:52.156 INFO:tasks.workunit.client.0.smithi026.stdout:9/704: chown d7/d23/d29/d59/dec 21 1 2024-05-09T00:07:52.156 INFO:tasks.workunit.client.0.smithi026.stdout:9/705: stat d7/d23/d29/fc3 0 2024-05-09T00:07:52.158 INFO:tasks.workunit.client.0.smithi026.stdout:8/727: sync 2024-05-09T00:07:52.158 INFO:tasks.workunit.client.0.smithi026.stdout:2/702: sync 2024-05-09T00:07:52.158 INFO:tasks.workunit.client.0.smithi026.stdout:1/753: sync 2024-05-09T00:07:52.158 INFO:tasks.workunit.client.0.smithi026.stdout:6/532: sync 2024-05-09T00:07:52.158 INFO:tasks.workunit.client.0.smithi026.stdout:2/703: readlink d14/d22/d55/da3/d20/db2/la6 0 2024-05-09T00:07:52.158 INFO:tasks.workunit.client.0.smithi026.stdout:1/754: dread - d5/dd/d17/d9f/dc6/f101 zero size 2024-05-09T00:07:52.158 INFO:tasks.workunit.client.0.smithi026.stdout:2/704: write d14/d22/d55/f56 [5403808,128285] 0 2024-05-09T00:07:52.158 INFO:tasks.workunit.client.0.smithi026.stdout:2/705: write d14/d22/d55/da3/d30/d6a/f57 [811709,62238] 0 2024-05-09T00:07:52.159 INFO:tasks.workunit.client.0.smithi026.stdout:9/706: symlink d7/lf4 0 2024-05-09T00:07:52.159 INFO:tasks.workunit.client.0.smithi026.stdout:9/707: rename d7/d23/d29/d31/d40 to d7/d23/d29/d31/d40/d41/d54/d9a/da4/ddb/df5 22 2024-05-09T00:07:52.159 INFO:tasks.workunit.client.0.smithi026.stdout:9/708: chown d7/d23/d29/d31/d40/d41/fb3 0 1 2024-05-09T00:07:52.161 INFO:tasks.workunit.client.0.smithi026.stdout:8/728: mkdir de/d6c/d31/d4f/df1 0 2024-05-09T00:07:52.161 INFO:tasks.workunit.client.0.smithi026.stdout:8/729: chown de/d17/d21/d24/d3b/fba 0 1 2024-05-09T00:07:52.162 INFO:tasks.workunit.client.0.smithi026.stdout:6/533: symlink d15/d1e/d23/d73/d58/d5c/lb1 0 2024-05-09T00:07:52.162 INFO:tasks.workunit.client.0.smithi026.stdout:0/835: dread d1d/d1e/d20/f68 [0,4194304] 0 2024-05-09T00:07:52.164 INFO:tasks.workunit.client.0.smithi026.stdout:1/755: creat d5/dd/d17/d73/f106 x:0 0 0 2024-05-09T00:07:52.166 INFO:tasks.workunit.client.0.smithi026.stdout:8/730: rename de/d17/d21/fa4 to de/d6c/d31/d4f/dbb/ff2 0 2024-05-09T00:07:52.166 INFO:tasks.workunit.client.0.smithi026.stdout:8/731: write de/d17/d21/d24/d3b/d3d/fef [492025,76353] 0 2024-05-09T00:07:52.166 INFO:tasks.workunit.client.0.smithi026.stdout:8/732: read - de/d60/f89 zero size 2024-05-09T00:07:52.167 INFO:tasks.workunit.client.0.smithi026.stdout:5/614: sync 2024-05-09T00:07:52.169 INFO:tasks.workunit.client.0.smithi026.stdout:6/534: mknod d15/d1e/d23/d73/cb2 0 2024-05-09T00:07:52.171 INFO:tasks.workunit.client.0.smithi026.stdout:8/733: dread de/f7f [0,4194304] 0 2024-05-09T00:07:52.173 INFO:tasks.workunit.client.0.smithi026.stdout:7/776: dwrite d8/d2e/d84/db4/dbc/d1e/d3d/f63 [0,4194304] 0 2024-05-09T00:07:52.175 INFO:tasks.workunit.client.0.smithi026.stdout:5/615: creat d2/d8/d31/d32/d48/daa/db4/fc6 x:0 0 0 2024-05-09T00:07:52.177 INFO:tasks.workunit.client.0.smithi026.stdout:6/535: creat d15/d1e/fb3 x:0 0 0 2024-05-09T00:07:52.177 INFO:tasks.workunit.client.0.smithi026.stdout:6/536: chown f1 15830 1 2024-05-09T00:07:52.177 INFO:tasks.workunit.client.0.smithi026.stdout:1/756: write d5/dd/f34 [1315168,115710] 0 2024-05-09T00:07:52.177 INFO:tasks.workunit.client.0.smithi026.stdout:3/552: sync 2024-05-09T00:07:52.177 INFO:tasks.workunit.client.0.smithi026.stdout:3/553: chown d5/d9/dc/d5b/da5 66239 1 2024-05-09T00:07:52.188 INFO:tasks.workunit.client.0.smithi026.stdout:5/616: creat d2/d8/d31/fc7 x:0 0 0 2024-05-09T00:07:52.188 INFO:tasks.workunit.client.0.smithi026.stdout:4/702: dwrite d0/d12/da2/d97/f5c [0,4194304] 0 2024-05-09T00:07:52.188 INFO:tasks.workunit.client.0.smithi026.stdout:6/537: mkdir d15/d2b/d33/db4 0 2024-05-09T00:07:52.188 INFO:tasks.workunit.client.0.smithi026.stdout:6/538: readlink d15/d1e/l5f 0 2024-05-09T00:07:52.188 INFO:tasks.workunit.client.0.smithi026.stdout:1/757: mknod d5/c107 0 2024-05-09T00:07:52.188 INFO:tasks.workunit.client.0.smithi026.stdout:6/539: write d15/d62/f9e [6947858,115438] 0 2024-05-09T00:07:52.192 INFO:tasks.workunit.client.0.smithi026.stdout:2/706: dwrite d14/d22/d55/da3/d20/d41/fe8 [0,4194304] 0 2024-05-09T00:07:52.192 INFO:tasks.workunit.client.0.smithi026.stdout:2/707: chown d14/c1e 507 1 2024-05-09T00:07:52.193 INFO:tasks.workunit.client.0.smithi026.stdout:0/836: dwrite d1d/d33/d64/fd6 [0,4194304] 0 2024-05-09T00:07:52.193 INFO:tasks.workunit.client.0.smithi026.stdout:0/837: dread - d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc/de2/ff6 zero size 2024-05-09T00:07:52.193 INFO:tasks.workunit.client.0.smithi026.stdout:0/838: chown d1d/d1e/d20/d4d/d83/l93 14806457 1 2024-05-09T00:07:52.193 INFO:tasks.workunit.client.0.smithi026.stdout:0/839: dread - d1d/fef zero size 2024-05-09T00:07:52.193 INFO:tasks.workunit.client.0.smithi026.stdout:9/709: dwrite d7/d23/d29/d59/fe7 [0,4194304] 0 2024-05-09T00:07:52.193 INFO:tasks.workunit.client.0.smithi026.stdout:4/703: symlink d0/d12/d1b/d4e/d92/lef 0 2024-05-09T00:07:52.194 INFO:tasks.workunit.client.0.smithi026.stdout:4/704: write d0/d83/f76 [129465,19457] 0 2024-05-09T00:07:52.194 INFO:tasks.workunit.client.0.smithi026.stdout:4/705: stat d0/d12/da2/d97/d43/d49/d8f/da3/d86 0 2024-05-09T00:07:52.196 INFO:tasks.workunit.client.0.smithi026.stdout:4/706: dread d0/f9 [8388608,4194304] 0 2024-05-09T00:07:52.197 INFO:tasks.workunit.client.0.smithi026.stdout:1/758: unlink d5/dd/ff 0 2024-05-09T00:07:52.197 INFO:tasks.workunit.client.0.smithi026.stdout:1/759: write d5/dd/d17/fbe [4949935,50998] 0 2024-05-09T00:07:52.202 INFO:tasks.workunit.client.0.smithi026.stdout:6/540: mknod d15/d1e/d30/d32/cb5 0 2024-05-09T00:07:52.207 INFO:tasks.workunit.client.0.smithi026.stdout:5/617: dwrite d2/f41 [4194304,4194304] 0 2024-05-09T00:07:52.207 INFO:tasks.workunit.client.0.smithi026.stdout:5/618: chown d2/d8/c4d 2 1 2024-05-09T00:07:52.208 INFO:tasks.workunit.client.0.smithi026.stdout:8/734: getdents de/d6c/d31/d4f 0 2024-05-09T00:07:52.208 INFO:tasks.workunit.client.0.smithi026.stdout:8/735: stat de/d6c/d31/d4f/d87/d62/daa 0 2024-05-09T00:07:52.208 INFO:tasks.workunit.client.0.smithi026.stdout:8/736: chown de/d48/d3e/dc4/lc5 11 1 2024-05-09T00:07:52.210 INFO:tasks.workunit.client.0.smithi026.stdout:8/737: read de/d17/d21/d24/f7e [2295449,63722] 0 2024-05-09T00:07:52.212 INFO:tasks.workunit.client.0.smithi026.stdout:2/708: rmdir d14/d22/d55/ddf 0 2024-05-09T00:07:52.212 INFO:tasks.workunit.client.0.smithi026.stdout:2/709: fsync d14/d22/d55/da3/d20/f8c 0 2024-05-09T00:07:52.212 INFO:tasks.workunit.client.0.smithi026.stdout:2/710: chown d14/d22/d55/da3/d30/d6a/fed 9 1 2024-05-09T00:07:52.212 INFO:tasks.workunit.client.0.smithi026.stdout:1/760: dwrite d5/dd/f67 [0,4194304] 0 2024-05-09T00:07:52.214 INFO:tasks.workunit.client.0.smithi026.stdout:8/738: dread f7 [0,4194304] 0 2024-05-09T00:07:52.214 INFO:tasks.workunit.client.0.smithi026.stdout:8/739: chown de/d48/d3e/d54 375 1 2024-05-09T00:07:52.215 INFO:tasks.workunit.client.0.smithi026.stdout:8/740: write de/d6c/d31/d4f/dbb/ff2 [886364,24025] 0 2024-05-09T00:07:52.217 INFO:tasks.workunit.client.0.smithi026.stdout:0/840: mkdir d1d/d33/d116 0 2024-05-09T00:07:52.218 INFO:tasks.workunit.client.0.smithi026.stdout:0/841: read d1d/d1e/d2d/f3b [1631262,63274] 0 2024-05-09T00:07:52.218 INFO:tasks.workunit.client.0.smithi026.stdout:0/842: truncate d1d/d33/d64/fe7 855366 0 2024-05-09T00:07:52.222 INFO:tasks.workunit.client.0.smithi026.stdout:9/710: truncate d7/d23/d2f/d3a/f44 4791363 0 2024-05-09T00:07:52.226 INFO:tasks.workunit.client.0.smithi026.stdout:4/707: dread d0/d12/d1b/d4e/f50 [0,4194304] 0 2024-05-09T00:07:52.227 INFO:tasks.workunit.client.0.smithi026.stdout:6/541: mknod d15/d2b/d33/db4/cb6 0 2024-05-09T00:07:52.231 INFO:tasks.workunit.client.0.smithi026.stdout:2/711: creat d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fee x:0 0 0 2024-05-09T00:07:52.231 INFO:tasks.workunit.client.0.smithi026.stdout:2/712: truncate d14/d22/d55/da3/f26 4536493 0 2024-05-09T00:07:52.231 INFO:tasks.workunit.client.0.smithi026.stdout:2/713: dread - d14/d22/d55/da3/d20/d41/d51/d82/daa/fdd zero size 2024-05-09T00:07:52.234 INFO:tasks.workunit.client.0.smithi026.stdout:4/708: dread d0/d12/da2/d97/d8c/f9d [0,4194304] 0 2024-05-09T00:07:52.234 INFO:tasks.workunit.client.0.smithi026.stdout:4/709: dread - d0/d12/da2/d97/d43/d49/d8f/fda zero size 2024-05-09T00:07:52.235 INFO:tasks.workunit.client.0.smithi026.stdout:4/710: stat d0/d12/c32 0 2024-05-09T00:07:52.235 INFO:tasks.workunit.client.0.smithi026.stdout:8/741: symlink de/d17/d21/d24/d3b/lf3 0 2024-05-09T00:07:52.237 INFO:tasks.workunit.client.0.smithi026.stdout:1/761: dwrite d5/f2c [0,4194304] 0 2024-05-09T00:07:52.237 INFO:tasks.workunit.client.0.smithi026.stdout:5/619: dwrite d2/d8/d31/d32/d48/db3/fb7 [0,4194304] 0 2024-05-09T00:07:52.237 INFO:tasks.workunit.client.0.smithi026.stdout:5/620: chown d2/d8/d31/fc1 5 1 2024-05-09T00:07:52.237 INFO:tasks.workunit.client.0.smithi026.stdout:0/843: symlink d1d/d25/d47/dc8/l117 0 2024-05-09T00:07:52.242 INFO:tasks.workunit.client.0.smithi026.stdout:9/711: mknod d7/d26/deb/cf6 0 2024-05-09T00:07:52.244 INFO:tasks.workunit.client.0.smithi026.stdout:2/714: creat d14/d22/d55/da3/d20/d41/d51/d82/daa/fef x:0 0 0 2024-05-09T00:07:52.247 INFO:tasks.workunit.client.0.smithi026.stdout:4/711: creat d0/d12/da2/d97/d43/d49/de7/ff0 x:0 0 0 2024-05-09T00:07:52.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/742: dwrite de/f7f [0,4194304] 0 2024-05-09T00:07:52.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/743: read - de/d6c/d31/d4f/d87/d62/ff0 zero size 2024-05-09T00:07:52.254 INFO:tasks.workunit.client.0.smithi026.stdout:1/762: rename d5/d16/d60/d66/d86 to d5/db/d108 0 2024-05-09T00:07:52.254 INFO:tasks.workunit.client.0.smithi026.stdout:1/763: readlink d5/l6 0 2024-05-09T00:07:52.256 INFO:tasks.workunit.client.0.smithi026.stdout:1/764: write d5/dd/fe [821469,66683] 0 2024-05-09T00:07:52.265 INFO:tasks.workunit.client.0.smithi026.stdout:5/621: mknod d2/d8/d31/d4b/cc8 0 2024-05-09T00:07:52.270 INFO:tasks.workunit.client.0.smithi026.stdout:5/622: write d2/f44 [661673,68820] 0 2024-05-09T00:07:52.270 INFO:tasks.workunit.client.0.smithi026.stdout:9/712: creat d7/d26/ff7 x:0 0 0 2024-05-09T00:07:52.272 INFO:tasks.workunit.client.0.smithi026.stdout:2/715: creat d14/d22/d55/da3/d20/d41/d51/d82/dd2/ff0 x:0 0 0 2024-05-09T00:07:52.274 INFO:tasks.workunit.client.0.smithi026.stdout:0/844: dwrite d1d/d25/d47/d6e/dc2/fdb [0,4194304] 0 2024-05-09T00:07:52.274 INFO:tasks.workunit.client.0.smithi026.stdout:0/845: chown d1d/d1e/d2d/c3d 37 1 2024-05-09T00:07:52.274 INFO:tasks.workunit.client.0.smithi026.stdout:0/846: chown d1d/d1e/d20/d4d/d83/l93 46517143 1 2024-05-09T00:07:52.274 INFO:tasks.workunit.client.0.smithi026.stdout:0/847: dread - d1d/d25/d47/dc8/ff9 zero size 2024-05-09T00:07:52.274 INFO:tasks.workunit.client.0.smithi026.stdout:0/848: truncate f1b 3724730 0 2024-05-09T00:07:52.275 INFO:tasks.workunit.client.0.smithi026.stdout:0/849: stat d1d/d25/d3c/f40 0 2024-05-09T00:07:52.275 INFO:tasks.workunit.client.0.smithi026.stdout:4/712: dwrite d0/d12/d64/dac/fc2 [0,4194304] 0 2024-05-09T00:07:52.275 INFO:tasks.workunit.client.0.smithi026.stdout:4/713: chown d0/d12/da2/d97/d43/d58/f6b 3449 1 2024-05-09T00:07:52.275 INFO:tasks.workunit.client.0.smithi026.stdout:0/850: read d1d/d1e/f69 [1424729,117575] 0 2024-05-09T00:07:52.275 INFO:tasks.workunit.client.0.smithi026.stdout:0/851: chown d1d/d25/d47/d6e/dc2/fdb 1004 1 2024-05-09T00:07:52.276 INFO:tasks.workunit.client.0.smithi026.stdout:5/623: write d2/f60 [754612,95358] 0 2024-05-09T00:07:52.276 INFO:tasks.workunit.client.0.smithi026.stdout:8/744: dwrite de/d6c/d31/d4f/f86 [0,4194304] 0 2024-05-09T00:07:52.276 INFO:tasks.workunit.client.0.smithi026.stdout:8/745: fdatasync de/ff 0 2024-05-09T00:07:52.276 INFO:tasks.workunit.client.0.smithi026.stdout:8/746: fsync de/d6c/d31/d4f/d87/d62/daa/ddb/d91/fc9 0 2024-05-09T00:07:52.280 INFO:tasks.workunit.client.0.smithi026.stdout:1/765: rmdir d5 39 2024-05-09T00:07:52.280 INFO:tasks.workunit.client.0.smithi026.stdout:1/766: read - d5/dd/d17/d7b/de1/fee zero size 2024-05-09T00:07:52.283 INFO:tasks.workunit.client.0.smithi026.stdout:1/767: dread d5/dd/d17/d9f/fc8 [0,4194304] 0 2024-05-09T00:07:52.283 INFO:tasks.workunit.client.0.smithi026.stdout:1/768: fdatasync d5/dd/d1f/d39/d47/f93 0 2024-05-09T00:07:52.285 INFO:tasks.workunit.client.0.smithi026.stdout:9/713: chown d7/l4d 0 1 2024-05-09T00:07:52.286 INFO:tasks.workunit.client.0.smithi026.stdout:2/716: rename d14/l2f to d14/d22/d55/da3/d20/lf1 0 2024-05-09T00:07:52.288 INFO:tasks.workunit.client.0.smithi026.stdout:0/852: unlink d1d/d33/fd9 0 2024-05-09T00:07:52.290 INFO:tasks.workunit.client.0.smithi026.stdout:5/624: dwrite d2/d8/d2a/f88 [0,4194304] 0 2024-05-09T00:07:52.290 INFO:tasks.workunit.client.0.smithi026.stdout:2/717: write d14/d22/d55/f9f [602524,79584] 0 2024-05-09T00:07:52.329 INFO:tasks.workunit.client.0.smithi026.stdout:8/747: symlink de/d48/lf4 0 2024-05-09T00:07:52.330 INFO:tasks.workunit.client.0.smithi026.stdout:0/853: dwrite d1d/ffb [0,4194304] 0 2024-05-09T00:07:52.330 INFO:tasks.workunit.client.0.smithi026.stdout:0/854: readlink d1d/d1e/d2d/l30 0 2024-05-09T00:07:52.330 INFO:tasks.workunit.client.0.smithi026.stdout:1/769: mkdir d5/dd/d1f/d51/d109 0 2024-05-09T00:07:52.330 INFO:tasks.workunit.client.0.smithi026.stdout:1/770: fsync d5/dd/f58 0 2024-05-09T00:07:52.330 INFO:tasks.workunit.client.0.smithi026.stdout:1/771: chown d5/f2c 2042933 1 2024-05-09T00:07:52.331 INFO:tasks.workunit.client.0.smithi026.stdout:0/855: write d1d/d33/dbb/f75 [1987776,28699] 0 2024-05-09T00:07:52.332 INFO:tasks.workunit.client.0.smithi026.stdout:0/856: write d1d/d1e/d20/d51/f5c [6129960,57933] 0 2024-05-09T00:07:52.332 INFO:tasks.workunit.client.0.smithi026.stdout:0/857: chown l13 1531 1 2024-05-09T00:07:52.332 INFO:tasks.workunit.client.0.smithi026.stdout:0/858: dread - d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/ff0 zero size 2024-05-09T00:07:52.337 INFO:tasks.workunit.client.0.smithi026.stdout:5/625: mknod d2/d8/d31/d63/cc9 0 2024-05-09T00:07:52.339 INFO:tasks.workunit.client.0.smithi026.stdout:2/718: mkdir d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/df2 0 2024-05-09T00:07:52.341 INFO:tasks.workunit.client.0.smithi026.stdout:8/748: mknod de/d48/d3e/dc4/dc7/cf5 0 2024-05-09T00:07:52.341 INFO:tasks.workunit.client.0.smithi026.stdout:1/772: dread d5/db/d1d/f48 [0,4194304] 0 2024-05-09T00:07:52.343 INFO:tasks.workunit.client.0.smithi026.stdout:5/626: dread d2/d8/d31/d2e/f98 [0,4194304] 0 2024-05-09T00:07:52.344 INFO:tasks.workunit.client.0.smithi026.stdout:1/773: dread d5/d16/d60/d66/f76 [0,4194304] 0 2024-05-09T00:07:52.347 INFO:tasks.workunit.client.0.smithi026.stdout:0/859: symlink d1d/d25/dfd/l118 0 2024-05-09T00:07:52.348 INFO:tasks.workunit.client.0.smithi026.stdout:2/719: creat d14/d22/d55/da3/d3b/d40/ff3 x:0 0 0 2024-05-09T00:07:52.349 INFO:tasks.workunit.client.0.smithi026.stdout:5/627: truncate d2/d8/d31/d2e/d33/f68 819629 0 2024-05-09T00:07:52.351 INFO:tasks.workunit.client.0.smithi026.stdout:1/774: symlink d5/dd/d87/l10a 0 2024-05-09T00:07:52.353 INFO:tasks.workunit.client.0.smithi026.stdout:9/714: dwrite d7/f16 [0,4194304] 0 2024-05-09T00:07:52.353 INFO:tasks.workunit.client.0.smithi026.stdout:9/715: fsync d7/d23/d76/fb8 0 2024-05-09T00:07:52.353 INFO:tasks.workunit.client.0.smithi026.stdout:9/716: chown d7/d26/deb/cf6 4905040 1 2024-05-09T00:07:52.360 INFO:tasks.workunit.client.0.smithi026.stdout:9/717: dread d7/d23/d76/f8c [0,4194304] 0 2024-05-09T00:07:52.360 INFO:tasks.workunit.client.0.smithi026.stdout:9/718: fdatasync d7/d23/d29/d59/d91/f92 0 2024-05-09T00:07:52.362 INFO:tasks.workunit.client.0.smithi026.stdout:2/720: mkdir d14/d22/d55/da3/d17/df4 0 2024-05-09T00:07:52.363 INFO:tasks.workunit.client.0.smithi026.stdout:5/628: mknod d2/cca 0 2024-05-09T00:07:52.367 INFO:tasks.workunit.client.0.smithi026.stdout:1/775: truncate d5/dd/f58 939625 0 2024-05-09T00:07:52.368 INFO:tasks.workunit.client.0.smithi026.stdout:9/719: mknod d7/d26/deb/cf8 0 2024-05-09T00:07:52.371 INFO:tasks.workunit.client.0.smithi026.stdout:1/776: write d5/dd/f52 [3316849,118303] 0 2024-05-09T00:07:52.371 INFO:tasks.workunit.client.0.smithi026.stdout:1/777: write d5/dd/d17/d9f/dc6/ff5 [57048,47533] 0 2024-05-09T00:07:52.372 INFO:tasks.workunit.client.0.smithi026.stdout:2/721: symlink d14/d22/d55/da3/d20/db2/d70/lf5 0 2024-05-09T00:07:52.372 INFO:tasks.workunit.client.0.smithi026.stdout:2/722: dread - d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/f8d zero size 2024-05-09T00:07:52.372 INFO:tasks.workunit.client.0.smithi026.stdout:5/629: creat d2/d8/d31/fcb x:0 0 0 2024-05-09T00:07:52.376 INFO:tasks.workunit.client.0.smithi026.stdout:1/778: mknod d5/dd/d17/d7b/de1/c10b 0 2024-05-09T00:07:52.380 INFO:tasks.workunit.client.0.smithi026.stdout:2/723: rename d14/d22/d55/da3/d3b/l46 to d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/lf6 0 2024-05-09T00:07:52.380 INFO:tasks.workunit.client.0.smithi026.stdout:2/724: write d14/d22/d55/da3/d20/d41/d51/d82/daa/fef [1039232,72162] 0 2024-05-09T00:07:52.381 INFO:tasks.workunit.client.0.smithi026.stdout:0/860: dwrite d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc/de2/ff6 [0,4194304] 0 2024-05-09T00:07:52.382 INFO:tasks.workunit.client.0.smithi026.stdout:5/630: creat d2/d5a/fcc x:0 0 0 2024-05-09T00:07:52.382 INFO:tasks.workunit.client.0.smithi026.stdout:5/631: readlink d2/d8/d31/l23 0 2024-05-09T00:07:52.382 INFO:tasks.workunit.client.0.smithi026.stdout:9/720: dread d7/d23/d29/d31/f3d [0,4194304] 0 2024-05-09T00:07:52.382 INFO:tasks.workunit.client.0.smithi026.stdout:8/749: dwrite de/d6c/d31/d4f/f86 [4194304,4194304] 0 2024-05-09T00:07:52.394 INFO:tasks.workunit.client.0.smithi026.stdout:5/632: dread d2/d8/d31/d32/d48/db3/fb7 [0,4194304] 0 2024-05-09T00:07:52.394 INFO:tasks.workunit.client.0.smithi026.stdout:0/861: mkdir d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/d119 0 2024-05-09T00:07:52.396 INFO:tasks.workunit.client.0.smithi026.stdout:8/750: dwrite de/d17/f1a [4194304,4194304] 0 2024-05-09T00:07:52.402 INFO:tasks.workunit.client.0.smithi026.stdout:5/633: truncate d2/d8/d2a/f58 994519 0 2024-05-09T00:07:52.406 INFO:tasks.workunit.client.0.smithi026.stdout:8/751: creat de/d17/d21/d24/ff6 x:0 0 0 2024-05-09T00:07:52.406 INFO:tasks.workunit.client.0.smithi026.stdout:8/752: fdatasync de/d48/f52 0 2024-05-09T00:07:52.406 INFO:tasks.workunit.client.0.smithi026.stdout:8/753: fsync de/d6c/f78 0 2024-05-09T00:07:52.407 INFO:tasks.workunit.client.0.smithi026.stdout:0/862: dread d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/fe4 [0,4194304] 0 2024-05-09T00:07:52.407 INFO:tasks.workunit.client.0.smithi026.stdout:0/863: stat d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/d119 0 2024-05-09T00:07:52.407 INFO:tasks.workunit.client.0.smithi026.stdout:2/725: dwrite d14/d22/d55/da3/d3b/d40/f66 [0,4194304] 0 2024-05-09T00:07:52.408 INFO:tasks.workunit.client.0.smithi026.stdout:9/721: link d7/c1a d7/d23/d29/cf9 0 2024-05-09T00:07:52.409 INFO:tasks.workunit.client.0.smithi026.stdout:9/722: dread - d7/d26/f95 zero size 2024-05-09T00:07:52.412 INFO:tasks.workunit.client.0.smithi026.stdout:8/754: creat de/d6c/ff7 x:0 0 0 2024-05-09T00:07:52.415 INFO:tasks.workunit.client.0.smithi026.stdout:0/864: getdents d1d 0 2024-05-09T00:07:52.423 INFO:tasks.workunit.client.0.smithi026.stdout:2/726: truncate d14/d22/d55/da3/d30/d6a/fed 2696361 0 2024-05-09T00:07:52.423 INFO:tasks.workunit.client.0.smithi026.stdout:5/634: dwrite d2/d8/d31/d63/f9d [0,4194304] 0 2024-05-09T00:07:52.424 INFO:tasks.workunit.client.0.smithi026.stdout:9/723: creat d7/d23/d29/d31/d40/d41/d54/dc5/ffa x:0 0 0 2024-05-09T00:07:52.427 INFO:tasks.workunit.client.0.smithi026.stdout:8/755: creat de/d6c/de3/ff8 x:0 0 0 2024-05-09T00:07:52.434 INFO:tasks.workunit.client.0.smithi026.stdout:0/865: mknod d1d/d1e/d2d/c11a 0 2024-05-09T00:07:52.434 INFO:tasks.workunit.client.0.smithi026.stdout:0/866: stat d1d/d1e/d20/d51/f6c 0 2024-05-09T00:07:52.434 INFO:tasks.workunit.client.0.smithi026.stdout:0/867: write d1d/d1e/d20/d51/f5c [2502719,19628] 0 2024-05-09T00:07:52.434 INFO:tasks.workunit.client.0.smithi026.stdout:2/727: rmdir d14/d22/d55/da3/d17/df4 0 2024-05-09T00:07:52.434 INFO:tasks.workunit.client.0.smithi026.stdout:2/728: write d14/d22/d55/da3/d20/d41/d51/d82/dd2/ff0 [617779,51894] 0 2024-05-09T00:07:52.437 INFO:tasks.workunit.client.0.smithi026.stdout:5/635: rename d2/f55 to d2/d8/d2a/fcd 0 2024-05-09T00:07:52.439 INFO:tasks.workunit.client.0.smithi026.stdout:9/724: creat d7/d23/d76/ffb x:0 0 0 2024-05-09T00:07:52.439 INFO:tasks.workunit.client.0.smithi026.stdout:9/725: chown d7/d23/d29/d31/fd0 13210 1 2024-05-09T00:07:52.442 INFO:tasks.workunit.client.0.smithi026.stdout:8/756: rmdir de/d17/d21/d24/d5b 39 2024-05-09T00:07:52.442 INFO:tasks.workunit.client.0.smithi026.stdout:8/757: read de/d17/d21/d24/d5b/f98 [4047320,1819] 0 2024-05-09T00:07:52.445 INFO:tasks.workunit.client.0.smithi026.stdout:0/868: symlink d1d/d1e/d20/d4d/d83/da0/dd2/da7/l11b 0 2024-05-09T00:07:52.451 INFO:tasks.workunit.client.0.smithi026.stdout:5/636: rename d2/d8/d31/fa4 to d2/d8/fce 0 2024-05-09T00:07:52.454 INFO:tasks.workunit.client.0.smithi026.stdout:9/726: fsync d7/f1f 0 2024-05-09T00:07:52.455 INFO:tasks.workunit.client.0.smithi026.stdout:8/758: symlink de/d6c/d31/d4f/d87/d62/daa/ddb/lf9 0 2024-05-09T00:07:52.455 INFO:tasks.workunit.client.0.smithi026.stdout:8/759: write de/d17/d21/d24/d5b/fbf [1594711,123520] 0 2024-05-09T00:07:52.457 INFO:tasks.workunit.client.0.smithi026.stdout:0/869: mknod d1d/d1e/d2d/d10f/c11c 0 2024-05-09T00:07:52.459 INFO:tasks.workunit.client.0.smithi026.stdout:5/637: link d2/d8/d2a/fcd d2/d8/d31/d63/d9c/dbc/fcf 0 2024-05-09T00:07:52.461 INFO:tasks.workunit.client.0.smithi026.stdout:9/727: truncate d7/d23/f33 60521 0 2024-05-09T00:07:52.461 INFO:tasks.workunit.client.0.smithi026.stdout:9/728: write d7/d26/ff7 [28721,88053] 0 2024-05-09T00:07:52.463 INFO:tasks.workunit.client.0.smithi026.stdout:8/760: rename de/d60/l85 to de/d6c/d31/d4f/d87/d62/daa/lfa 0 2024-05-09T00:07:52.463 INFO:tasks.workunit.client.0.smithi026.stdout:8/761: getdents de/d48/d3e/dc4 0 2024-05-09T00:07:52.465 INFO:tasks.workunit.client.0.smithi026.stdout:0/870: creat d1d/d1e/d20/d4d/d83/da0/f11d x:0 0 0 2024-05-09T00:07:52.465 INFO:tasks.workunit.client.0.smithi026.stdout:0/871: fdatasync d1d/d25/d47/dc8/f112 0 2024-05-09T00:07:52.468 INFO:tasks.workunit.client.0.smithi026.stdout:5/638: symlink d2/d8/d31/d2e/ld0 0 2024-05-09T00:07:52.469 INFO:tasks.workunit.client.0.smithi026.stdout:5/639: read d2/d8/d2a/f88 [4172911,72851] 0 2024-05-09T00:07:52.469 INFO:tasks.workunit.client.0.smithi026.stdout:8/762: dread de/d17/d21/d24/f26 [0,4194304] 0 2024-05-09T00:07:52.547 INFO:tasks.workunit.client.0.smithi026.stdout:9/729: getdents d7/d23/d2f/d7d 0 2024-05-09T00:07:52.548 INFO:tasks.workunit.client.0.smithi026.stdout:0/872: rmdir d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda 39 2024-05-09T00:07:52.554 INFO:tasks.workunit.client.0.smithi026.stdout:5/640: creat d2/d8/d31/d4b/fd1 x:0 0 0 2024-05-09T00:07:52.562 INFO:tasks.workunit.client.0.smithi026.stdout:8/763: mkdir de/d6c/d31/d4f/deb/dfb 0 2024-05-09T00:07:52.562 INFO:tasks.workunit.client.0.smithi026.stdout:8/764: write de/d6c/d31/d4f/d87/d62/f95 [4560040,32022] 0 2024-05-09T00:07:52.563 INFO:tasks.workunit.client.0.smithi026.stdout:5/641: dread d2/d8/d31/d32/da2/fc3 [0,4194304] 0 2024-05-09T00:07:52.563 INFO:tasks.workunit.client.0.smithi026.stdout:5/642: chown d2/d8/d31/d32 3 1 2024-05-09T00:07:52.565 INFO:tasks.workunit.client.0.smithi026.stdout:9/730: symlink d7/d23/d29/d59/lfc 0 2024-05-09T00:07:52.568 INFO:tasks.workunit.client.0.smithi026.stdout:0/873: mkdir d1d/d25/d3c/d11e 0 2024-05-09T00:07:52.571 INFO:tasks.workunit.client.0.smithi026.stdout:8/765: mkdir de/d6c/d31/d4f/df1/dfc 0 2024-05-09T00:07:52.574 INFO:tasks.workunit.client.0.smithi026.stdout:9/731: mknod d7/d23/d29/d31/d40/d41/d54/d9a/da4/ddb/cfd 0 2024-05-09T00:07:52.575 INFO:tasks.workunit.client.0.smithi026.stdout:0/874: rmdir d1d/d1e/d2d/dee 39 2024-05-09T00:07:52.575 INFO:tasks.workunit.client.0.smithi026.stdout:0/875: write d1d/fbe [378520,2292] 0 2024-05-09T00:07:52.575 INFO:tasks.workunit.client.0.smithi026.stdout:0/876: getdents d1d/d1e/d20/de5 0 2024-05-09T00:07:52.577 INFO:tasks.workunit.client.0.smithi026.stdout:8/766: creat de/d17/d7d/ffd x:0 0 0 2024-05-09T00:07:52.578 INFO:tasks.workunit.client.0.smithi026.stdout:9/732: unlink d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc/le4 0 2024-05-09T00:07:52.578 INFO:tasks.workunit.client.0.smithi026.stdout:5/643: dwrite d2/d8/d2a/fcd [0,4194304] 0 2024-05-09T00:07:52.585 INFO:tasks.workunit.client.0.smithi026.stdout:8/767: dread de/d17/d21/d24/d5b/f98 [0,4194304] 0 2024-05-09T00:07:52.585 INFO:tasks.workunit.client.0.smithi026.stdout:8/768: fsync de/d6c/d31/d4f/f96 0 2024-05-09T00:07:52.588 INFO:tasks.workunit.client.0.smithi026.stdout:9/733: dread d7/d23/f61 [0,4194304] 0 2024-05-09T00:07:52.588 INFO:tasks.workunit.client.0.smithi026.stdout:5/644: rename d2/d5a/d96/f53 to d2/d8/d31/d32/d5c/fd2 0 2024-05-09T00:07:52.593 INFO:tasks.workunit.client.0.smithi026.stdout:9/734: unlink d7/f1f 0 2024-05-09T00:07:52.594 INFO:tasks.workunit.client.0.smithi026.stdout:0/877: dwrite d1d/d1e/f4b [4194304,4194304] 0 2024-05-09T00:07:52.594 INFO:tasks.workunit.client.0.smithi026.stdout:0/878: write d1d/ffb [4926091,49805] 0 2024-05-09T00:07:52.596 INFO:tasks.workunit.client.0.smithi026.stdout:8/769: rename de/d6c/d31/d4f/d87/cc2 to de/d17/d21/dca/cfe 0 2024-05-09T00:07:52.597 INFO:tasks.workunit.client.0.smithi026.stdout:5/645: dread d2/d8/d31/d32/fb0 [0,4194304] 0 2024-05-09T00:07:52.605 INFO:tasks.workunit.client.0.smithi026.stdout:9/735: dread d7/d23/f84 [0,4194304] 0 2024-05-09T00:07:52.607 INFO:tasks.workunit.client.0.smithi026.stdout:0/879: dread d1d/d1e/fde [0,4194304] 0 2024-05-09T00:07:52.607 INFO:tasks.workunit.client.0.smithi026.stdout:0/880: readlink d1d/d25/d3c/l53 0 2024-05-09T00:07:52.607 INFO:tasks.workunit.client.0.smithi026.stdout:0/881: truncate d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/fab 700841 0 2024-05-09T00:07:52.607 INFO:tasks.workunit.client.0.smithi026.stdout:0/882: write d1d/d1e/d20/f7c [301075,34483] 0 2024-05-09T00:07:52.607 INFO:tasks.workunit.client.0.smithi026.stdout:0/883: write d1d/d25/d3c/f88 [5053881,106872] 0 2024-05-09T00:07:52.607 INFO:tasks.workunit.client.0.smithi026.stdout:5/646: link d2/d8/d31/d63/fa6 d2/d8/d31/d24/fd3 0 2024-05-09T00:07:52.610 INFO:tasks.workunit.client.0.smithi026.stdout:9/736: symlink d7/d23/d29/d31/lfe 0 2024-05-09T00:07:52.611 INFO:tasks.workunit.client.0.smithi026.stdout:0/884: mkdir d1d/d25/d47/d11f 0 2024-05-09T00:07:52.611 INFO:tasks.workunit.client.0.smithi026.stdout:0/885: readlink d1d/d1e/laf 0 2024-05-09T00:07:52.611 INFO:tasks.workunit.client.0.smithi026.stdout:0/886: chown d1d/d25/dfd/l114 48513515 1 2024-05-09T00:07:52.612 INFO:tasks.workunit.client.0.smithi026.stdout:0/887: write d1d/d33/d64/fb2 [490779,34916] 0 2024-05-09T00:07:52.612 INFO:tasks.workunit.client.0.smithi026.stdout:8/770: dwrite de/d17/d21/d24/f26 [0,4194304] 0 2024-05-09T00:07:52.613 INFO:tasks.workunit.client.0.smithi026.stdout:5/647: creat d2/d8/d31/d32/d48/db3/fd4 x:0 0 0 2024-05-09T00:07:52.616 INFO:tasks.workunit.client.0.smithi026.stdout:9/737: write d7/f1b [3382752,91331] 0 2024-05-09T00:07:52.616 INFO:tasks.workunit.client.0.smithi026.stdout:9/738: readlink d7/d23/d29/d31/d40/l46 0 2024-05-09T00:07:52.617 INFO:tasks.workunit.client.0.smithi026.stdout:8/771: readlink de/l34 0 2024-05-09T00:07:52.621 INFO:tasks.workunit.client.0.smithi026.stdout:9/739: truncate d7/d23/d2f/fe5 224682 0 2024-05-09T00:07:52.623 INFO:tasks.workunit.client.0.smithi026.stdout:8/772: mknod de/d17/cff 0 2024-05-09T00:07:52.628 INFO:tasks.workunit.client.0.smithi026.stdout:8/773: mknod de/d17/d21/d6f/c100 0 2024-05-09T00:07:52.629 INFO:tasks.workunit.client.0.smithi026.stdout:8/774: write de/fe8 [1002704,109308] 0 2024-05-09T00:07:52.630 INFO:tasks.workunit.client.0.smithi026.stdout:8/775: creat de/d17/d21/dca/f101 x:0 0 0 2024-05-09T00:07:52.632 INFO:tasks.workunit.client.0.smithi026.stdout:0/888: dwrite d1d/d33/d64/fd3 [0,4194304] 0 2024-05-09T00:07:52.632 INFO:tasks.workunit.client.0.smithi026.stdout:8/776: creat de/d6c/d31/d4f/deb/dfb/f102 x:0 0 0 2024-05-09T00:07:52.636 INFO:tasks.workunit.client.0.smithi026.stdout:9/740: dwrite d7/d23/d2f/d50/fb9 [0,4194304] 0 2024-05-09T00:07:52.636 INFO:tasks.workunit.client.0.smithi026.stdout:9/741: chown d7/d23/d29/d2e/f6f 132 1 2024-05-09T00:07:52.638 INFO:tasks.workunit.client.0.smithi026.stdout:0/889: symlink d1d/d25/d3c/d11e/l120 0 2024-05-09T00:07:52.638 INFO:tasks.workunit.client.0.smithi026.stdout:0/890: fsync d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/fe3 0 2024-05-09T00:07:52.639 INFO:tasks.workunit.client.0.smithi026.stdout:0/891: fdatasync d1d/d1e/d20/d51/f57 0 2024-05-09T00:07:52.639 INFO:tasks.workunit.client.0.smithi026.stdout:0/892: write d1d/d25/d47/fb9 [1144511,109888] 0 2024-05-09T00:07:52.643 INFO:tasks.workunit.client.0.smithi026.stdout:0/893: dread d1d/d1e/d20/d100/d80/ff1 [0,4194304] 0 2024-05-09T00:07:52.645 INFO:tasks.workunit.client.0.smithi026.stdout:0/894: write f19 [1196541,54415] 0 2024-05-09T00:07:52.645 INFO:tasks.workunit.client.0.smithi026.stdout:0/895: chown d1d/d1e/d20/d51/f101 14861737 1 2024-05-09T00:07:52.646 INFO:tasks.workunit.client.0.smithi026.stdout:0/896: creat d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc/f121 x:0 0 0 2024-05-09T00:07:52.647 INFO:tasks.workunit.client.0.smithi026.stdout:8/777: dwrite de/d6c/d31/fc0 [0,4194304] 0 2024-05-09T00:07:52.648 INFO:tasks.workunit.client.0.smithi026.stdout:0/897: symlink d1d/d25/d47/d6e/dc2/l122 0 2024-05-09T00:07:52.648 INFO:tasks.workunit.client.0.smithi026.stdout:0/898: dread - d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/ff0 zero size 2024-05-09T00:07:52.648 INFO:tasks.workunit.client.0.smithi026.stdout:9/742: dread d7/f1b [0,4194304] 0 2024-05-09T00:07:52.648 INFO:tasks.workunit.client.0.smithi026.stdout:9/743: fdatasync d7/d23/d76/fb8 0 2024-05-09T00:07:52.652 INFO:tasks.workunit.client.0.smithi026.stdout:0/899: dread d1d/fbe [0,4194304] 0 2024-05-09T00:07:52.652 INFO:tasks.workunit.client.0.smithi026.stdout:9/744: creat d7/fff x:0 0 0 2024-05-09T00:07:52.652 INFO:tasks.workunit.client.0.smithi026.stdout:9/745: truncate d7/d26/f6b 1609678 0 2024-05-09T00:07:52.655 INFO:tasks.workunit.client.0.smithi026.stdout:0/900: truncate d1d/d1e/d20/d51/f6c 1300030 0 2024-05-09T00:07:52.655 INFO:tasks.workunit.client.0.smithi026.stdout:0/901: write d1d/d1e/d20/f68 [5026322,804] 0 2024-05-09T00:07:52.658 INFO:tasks.workunit.client.0.smithi026.stdout:9/746: rmdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc 39 2024-05-09T00:07:52.666 INFO:tasks.workunit.client.0.smithi026.stdout:7/777: sync 2024-05-09T00:07:52.668 INFO:tasks.workunit.client.0.smithi026.stdout:7/778: symlink d8/d2e/d84/db4/dbc/d1e/d8a/df5/l10d 0 2024-05-09T00:07:52.670 INFO:tasks.workunit.client.0.smithi026.stdout:7/779: mknod d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/c10e 0 2024-05-09T00:07:52.670 INFO:tasks.workunit.client.0.smithi026.stdout:7/780: dread - d8/d2e/d84/db4/dbc/d22/da1/f108 zero size 2024-05-09T00:07:52.670 INFO:tasks.workunit.client.0.smithi026.stdout:7/781: dread - d8/d1b/d89/dc1/dd0/ffb zero size 2024-05-09T00:07:52.671 INFO:tasks.workunit.client.0.smithi026.stdout:7/782: getdents d8/d2e/d84/db4/dbc/d22 0 2024-05-09T00:07:52.673 INFO:tasks.workunit.client.0.smithi026.stdout:7/783: getdents d8/d2e/d84/db4/dbc/d22/da1 0 2024-05-09T00:07:52.685 INFO:tasks.workunit.client.0.smithi026.stdout:0/902: dwrite fa [4194304,4194304] 0 2024-05-09T00:07:52.686 INFO:tasks.workunit.client.0.smithi026.stdout:9/747: dwrite d7/d23/d2f/fe1 [0,4194304] 0 2024-05-09T00:07:52.686 INFO:tasks.workunit.client.0.smithi026.stdout:7/784: dread d8/d2e/d84/db4/dbc/d1e/fec [0,4194304] 0 2024-05-09T00:07:52.687 INFO:tasks.workunit.client.0.smithi026.stdout:0/903: symlink d1d/d1e/l123 0 2024-05-09T00:07:52.687 INFO:tasks.workunit.client.0.smithi026.stdout:7/785: dread d8/d2e/d84/db4/dbc/ffd [0,4194304] 0 2024-05-09T00:07:52.692 INFO:tasks.workunit.client.0.smithi026.stdout:7/786: rmdir d8/d2e/d84/db4/dbc/d1e/d8a 39 2024-05-09T00:07:52.693 INFO:tasks.workunit.client.0.smithi026.stdout:9/748: write d7/d23/d2f/d3a/f55 [4046137,44625] 0 2024-05-09T00:07:52.696 INFO:tasks.workunit.client.0.smithi026.stdout:7/787: link d8/d2e/d84/db4/dbc/d1e/d3d/dca/ced d8/d2e/d84/db4/dbc/d1e/d3d/c10f 0 2024-05-09T00:07:52.700 INFO:tasks.workunit.client.0.smithi026.stdout:0/904: dread d1d/d1e/d20/d4d/f6f [0,4194304] 0 2024-05-09T00:07:52.700 INFO:tasks.workunit.client.0.smithi026.stdout:0/905: fdatasync d1d/d1e/d2d/f49 0 2024-05-09T00:07:52.703 INFO:tasks.workunit.client.0.smithi026.stdout:0/906: unlink d1d/d25/d47/l48 0 2024-05-09T00:07:52.705 INFO:tasks.workunit.client.0.smithi026.stdout:7/788: dread d8/d2e/d84/db4/dbc/d22/d29/faf [0,4194304] 0 2024-05-09T00:07:52.706 INFO:tasks.workunit.client.0.smithi026.stdout:0/907: rename d1d/d25/d47/dc8/l117 to d1d/d1e/d20/d4d/d83/da0/dd2/da7/l124 0 2024-05-09T00:07:52.707 INFO:tasks.workunit.client.0.smithi026.stdout:0/908: write d1d/d25/d47/dc8/f112 [3006253,63086] 0 2024-05-09T00:07:52.708 INFO:tasks.workunit.client.0.smithi026.stdout:7/789: truncate d8/ff 3967978 0 2024-05-09T00:07:52.710 INFO:tasks.workunit.client.0.smithi026.stdout:0/909: symlink d1d/d1e/d20/d4d/d83/da0/l125 0 2024-05-09T00:07:52.710 INFO:tasks.workunit.client.0.smithi026.stdout:0/910: chown c8 63 1 2024-05-09T00:07:52.711 INFO:tasks.workunit.client.0.smithi026.stdout:0/911: write d1d/d33/dbb/fce [1577894,98699] 0 2024-05-09T00:07:52.711 INFO:tasks.workunit.client.0.smithi026.stdout:0/912: readlink d1d/d25/l60 0 2024-05-09T00:07:52.711 INFO:tasks.workunit.client.0.smithi026.stdout:9/749: dwrite d7/f7f [4194304,4194304] 0 2024-05-09T00:07:52.713 INFO:tasks.workunit.client.0.smithi026.stdout:7/790: mknod d8/d1b/d89/d8d/c110 0 2024-05-09T00:07:52.716 INFO:tasks.workunit.client.0.smithi026.stdout:0/913: rename d1d/fef to d1d/d1e/d20/d4d/d83/da0/dd2/f126 0 2024-05-09T00:07:52.721 INFO:tasks.workunit.client.0.smithi026.stdout:0/914: rename d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/fe3 to d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d84/f127 0 2024-05-09T00:07:52.722 INFO:tasks.workunit.client.0.smithi026.stdout:0/915: creat d1d/d33/d64/f128 x:0 0 0 2024-05-09T00:07:52.723 INFO:tasks.workunit.client.0.smithi026.stdout:0/916: read d1d/d1e/d20/d51/f5c [695120,21819] 0 2024-05-09T00:07:52.724 INFO:tasks.workunit.client.0.smithi026.stdout:0/917: creat d1d/d33/f129 x:0 0 0 2024-05-09T00:07:52.725 INFO:tasks.workunit.client.0.smithi026.stdout:0/918: mknod d1d/d1e/d20/d100/c12a 0 2024-05-09T00:07:52.730 INFO:tasks.workunit.client.0.smithi026.stdout:9/750: dwrite d7/d26/fa6 [0,4194304] 0 2024-05-09T00:07:52.733 INFO:tasks.workunit.client.0.smithi026.stdout:7/791: dwrite d8/d1b/f7b [0,4194304] 0 2024-05-09T00:07:52.733 INFO:tasks.workunit.client.0.smithi026.stdout:7/792: write d8/d1b/d89/fd6 [204698,15267] 0 2024-05-09T00:07:52.734 INFO:tasks.workunit.client.0.smithi026.stdout:9/751: unlink d7/d23/d2f/d3a/f55 0 2024-05-09T00:07:52.743 INFO:tasks.workunit.client.0.smithi026.stdout:0/919: dwrite d1d/d1e/d20/d4d/d83/da0/dd2/f126 [0,4194304] 0 2024-05-09T00:07:52.743 INFO:tasks.workunit.client.0.smithi026.stdout:7/793: mkdir d8/d2e/d84/db4/dbc/d22/d29/d111 0 2024-05-09T00:07:52.745 INFO:tasks.workunit.client.0.smithi026.stdout:9/752: symlink d7/d23/d2f/d3a/db5/l100 0 2024-05-09T00:07:52.748 INFO:tasks.workunit.client.0.smithi026.stdout:0/920: rmdir d1d/d25/d3c 39 2024-05-09T00:07:52.749 INFO:tasks.workunit.client.0.smithi026.stdout:7/794: creat d8/d1b/d89/d8d/f112 x:0 0 0 2024-05-09T00:07:52.749 INFO:tasks.workunit.client.0.smithi026.stdout:7/795: chown d8/d2e/d84/db4/dbc/d22/f65 6510771 1 2024-05-09T00:07:52.750 INFO:tasks.workunit.client.0.smithi026.stdout:0/921: write f11 [2282045,113262] 0 2024-05-09T00:07:52.750 INFO:tasks.workunit.client.0.smithi026.stdout:9/753: read d7/d23/d29/d31/d40/d41/d54/d5c/faa [287707,104662] 0 2024-05-09T00:07:52.750 INFO:tasks.workunit.client.0.smithi026.stdout:0/922: write d1d/d1e/d20/d4d/d83/da0/dd2/da7/f10d [839142,75825] 0 2024-05-09T00:07:52.752 INFO:tasks.workunit.client.0.smithi026.stdout:9/754: symlink d7/d23/d29/d31/d40/d41/l101 0 2024-05-09T00:07:52.753 INFO:tasks.workunit.client.0.smithi026.stdout:9/755: creat d7/d23/d29/d31/d40/d41/f102 x:0 0 0 2024-05-09T00:07:52.753 INFO:tasks.workunit.client.0.smithi026.stdout:9/756: chown d7/d23/d76/f90 81555 1 2024-05-09T00:07:52.756 INFO:tasks.workunit.client.0.smithi026.stdout:9/757: rmdir d7/d23/d29 39 2024-05-09T00:07:52.756 INFO:tasks.workunit.client.0.smithi026.stdout:9/758: fdatasync d7/d23/d29/d31/d40/d41/d54/d5c/faa 0 2024-05-09T00:07:52.756 INFO:tasks.workunit.client.0.smithi026.stdout:9/759: read d7/d23/d76/fb8 [125365,15838] 0 2024-05-09T00:07:52.756 INFO:tasks.workunit.client.0.smithi026.stdout:7/796: dread f5 [4194304,4194304] 0 2024-05-09T00:07:52.756 INFO:tasks.workunit.client.0.smithi026.stdout:7/797: dread - d8/d2e/d84/db4/ff1 zero size 2024-05-09T00:07:52.759 INFO:tasks.workunit.client.0.smithi026.stdout:9/760: rmdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/da3 0 2024-05-09T00:07:52.759 INFO:tasks.workunit.client.0.smithi026.stdout:9/761: write d7/d26/f71 [546195,48705] 0 2024-05-09T00:07:52.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/798: truncate d8/fcd 7063201 0 2024-05-09T00:07:52.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/799: chown d8/d5c/d9a/fe4 9569313 1 2024-05-09T00:07:52.762 INFO:tasks.workunit.client.0.smithi026.stdout:9/762: mkdir d7/d23/d29/d31/d40/d41/d54/d5c/d103 0 2024-05-09T00:07:52.762 INFO:tasks.workunit.client.0.smithi026.stdout:9/763: readlink d7/d23/d2f/d3a/l64 0 2024-05-09T00:07:52.762 INFO:tasks.workunit.client.0.smithi026.stdout:9/764: rmdir d7/d23/d29/d31 39 2024-05-09T00:07:52.763 INFO:tasks.workunit.client.0.smithi026.stdout:9/765: creat d7/d23/d29/d31/d40/f104 x:0 0 0 2024-05-09T00:07:52.764 INFO:tasks.workunit.client.0.smithi026.stdout:9/766: chown d7/d23/d29/d31/lea 3665713 1 2024-05-09T00:07:52.765 INFO:tasks.workunit.client.0.smithi026.stdout:9/767: unlink d7/d23/d2f/d50/ff1 0 2024-05-09T00:07:52.765 INFO:tasks.workunit.client.0.smithi026.stdout:9/768: write d7/d23/d29/d31/d40/f82 [755600,84804] 0 2024-05-09T00:07:52.767 INFO:tasks.workunit.client.0.smithi026.stdout:9/769: rmdir d7/d23/d76 39 2024-05-09T00:07:52.767 INFO:tasks.workunit.client.0.smithi026.stdout:9/770: readlink d7/d23/d2f/d3a/lac 0 2024-05-09T00:07:52.768 INFO:tasks.workunit.client.0.smithi026.stdout:9/771: read d7/d23/d29/d31/d40/d41/d54/d9a/da4/fe0 [1753769,60303] 0 2024-05-09T00:07:52.776 INFO:tasks.workunit.client.0.smithi026.stdout:7/800: dwrite d8/d2e/d84/db4/fb7 [0,4194304] 0 2024-05-09T00:07:52.786 INFO:tasks.workunit.client.0.smithi026.stdout:9/772: dwrite d7/d23/d29/d31/d40/d41/d54/dc5/ffa [0,4194304] 0 2024-05-09T00:07:52.790 INFO:tasks.workunit.client.0.smithi026.stdout:9/773: write d7/f7f [2560326,8193] 0 2024-05-09T00:07:52.798 INFO:tasks.workunit.client.0.smithi026.stdout:9/774: symlink d7/l105 0 2024-05-09T00:07:52.802 INFO:tasks.workunit.client.0.smithi026.stdout:9/775: symlink d7/d23/d2f/d3a/db5/l106 0 2024-05-09T00:07:52.806 INFO:tasks.workunit.client.0.smithi026.stdout:9/776: mknod d7/d26/c107 0 2024-05-09T00:07:52.806 INFO:tasks.workunit.client.0.smithi026.stdout:9/777: write d7/d26/fca [509512,36726] 0 2024-05-09T00:07:52.812 INFO:tasks.workunit.client.0.smithi026.stdout:7/801: dwrite d8/d2e/d84/db4/dbc/d22/fc6 [0,4194304] 0 2024-05-09T00:07:52.816 INFO:tasks.workunit.client.0.smithi026.stdout:7/802: creat d8/f113 x:0 0 0 2024-05-09T00:07:52.820 INFO:tasks.workunit.client.0.smithi026.stdout:7/803: rename d8/d2e/d84/db4/dbc/d1e/l20 to d8/d2e/d84/db4/dbc/d22/l114 0 2024-05-09T00:07:52.825 INFO:tasks.workunit.client.0.smithi026.stdout:7/804: unlink d8/d2e/d84/db4/dbc/d22/d29/cac 0 2024-05-09T00:07:52.827 INFO:tasks.workunit.client.0.smithi026.stdout:9/778: dwrite d7/d23/d29/d2e/fd8 [0,4194304] 0 2024-05-09T00:07:52.837 INFO:tasks.workunit.client.0.smithi026.stdout:9/779: mknod d7/d23/d29/d59/dec/c108 0 2024-05-09T00:07:52.840 INFO:tasks.workunit.client.0.smithi026.stdout:9/780: creat d7/d23/d29/d2e/f109 x:0 0 0 2024-05-09T00:07:52.842 INFO:tasks.workunit.client.0.smithi026.stdout:9/781: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/f10a x:0 0 0 2024-05-09T00:07:52.853 INFO:tasks.workunit.client.0.smithi026.stdout:9/782: dread d7/d23/d29/d31/d40/f82 [0,4194304] 0 2024-05-09T00:07:52.855 INFO:tasks.workunit.client.0.smithi026.stdout:6/542: sync 2024-05-09T00:07:52.855 INFO:tasks.workunit.client.0.smithi026.stdout:3/554: sync 2024-05-09T00:07:52.855 INFO:tasks.workunit.client.0.smithi026.stdout:6/543: stat d15/d1e/d30/d75/f89 0 2024-05-09T00:07:52.859 INFO:tasks.workunit.client.0.smithi026.stdout:3/555: getdents d5/d9/dc/d28/d2c 0 2024-05-09T00:07:52.859 INFO:tasks.workunit.client.0.smithi026.stdout:3/556: chown d5/d9/dc/d28/f35 936 1 2024-05-09T00:07:52.861 INFO:tasks.workunit.client.0.smithi026.stdout:6/544: creat d15/d1e/d23/d73/d76/fb7 x:0 0 0 2024-05-09T00:07:52.862 INFO:tasks.workunit.client.0.smithi026.stdout:7/805: dwrite d8/d2e/d84/db4/dbc/d1e/d3d/fe9 [0,4194304] 0 2024-05-09T00:07:52.862 INFO:tasks.workunit.client.0.smithi026.stdout:7/806: readlink d8/d2e/d84/db4/dbc/d1e/d3d/dca/lb8 0 2024-05-09T00:07:52.862 INFO:tasks.workunit.client.0.smithi026.stdout:7/807: chown d8/d2e/d84/db4/dbc/d22/f65 488 1 2024-05-09T00:07:52.862 INFO:tasks.workunit.client.0.smithi026.stdout:7/808: fsync d8/d2e/d84/db4/dbc/d22/da1/f101 0 2024-05-09T00:07:52.862 INFO:tasks.workunit.client.0.smithi026.stdout:7/809: truncate d8/d1b/d89/dc1/dd0/ffb 969395 0 2024-05-09T00:07:52.864 INFO:tasks.workunit.client.0.smithi026.stdout:7/810: dread d8/d2e/d84/db4/dbc/d1e/d80/f81 [0,4194304] 0 2024-05-09T00:07:52.867 INFO:tasks.workunit.client.0.smithi026.stdout:3/557: mknod d5/d9/dc/cb5 0 2024-05-09T00:07:52.871 INFO:tasks.workunit.client.0.smithi026.stdout:6/545: dread d15/d1e/d23/d3a/f7c [0,4194304] 0 2024-05-09T00:07:52.871 INFO:tasks.workunit.client.0.smithi026.stdout:6/546: readlink d15/d2b/d33/d55/l66 0 2024-05-09T00:07:52.871 INFO:tasks.workunit.client.0.smithi026.stdout:6/547: truncate d15/d34/d52/f82 763793 0 2024-05-09T00:07:52.873 INFO:tasks.workunit.client.0.smithi026.stdout:7/811: rmdir d8/d2e/d84/db4/dbc/d1e/d3d/d6b 39 2024-05-09T00:07:52.876 INFO:tasks.workunit.client.0.smithi026.stdout:3/558: creat d5/d9/d4a/d5f/d6f/fb6 x:0 0 0 2024-05-09T00:07:52.876 INFO:tasks.workunit.client.0.smithi026.stdout:3/559: stat d5/d9/d4a/d5f/d6f/fb6 0 2024-05-09T00:07:52.881 INFO:tasks.workunit.client.0.smithi026.stdout:7/812: link d8/d2e/d84/db4/dbc/d22/fe2 d8/d5c/d9a/df4/d103/f115 0 2024-05-09T00:07:52.881 INFO:tasks.workunit.client.0.smithi026.stdout:7/813: chown d8/d2e/d84/db4/dbc/d1e/d80/da2/l102 229 1 2024-05-09T00:07:52.881 INFO:tasks.workunit.client.0.smithi026.stdout:7/814: dread - d8/d5c/d9a/fe4 zero size 2024-05-09T00:07:52.884 INFO:tasks.workunit.client.0.smithi026.stdout:3/560: mkdir d5/d9/dc/d28/d45/db7 0 2024-05-09T00:07:52.886 INFO:tasks.workunit.client.0.smithi026.stdout:7/815: rename d8/d1b/d89/d8d to d8/d5c/d9a/d9f/d104/d116 0 2024-05-09T00:07:52.886 INFO:tasks.workunit.client.0.smithi026.stdout:7/816: write d8/d2e/d84/db4/dbc/d1e/d8a/df0/f100 [1026962,82475] 0 2024-05-09T00:07:52.888 INFO:tasks.workunit.client.0.smithi026.stdout:6/548: dwrite d15/d1e/d23/d73/fa7 [0,4194304] 0 2024-05-09T00:07:52.890 INFO:tasks.workunit.client.0.smithi026.stdout:3/561: unlink d5/d1e/d7b/f9d 0 2024-05-09T00:07:52.899 INFO:tasks.workunit.client.0.smithi026.stdout:7/817: symlink d8/d5c/d9a/d9f/l117 0 2024-05-09T00:07:52.907 INFO:tasks.workunit.client.0.smithi026.stdout:6/549: mkdir d15/d34/d52/d74/db8 0 2024-05-09T00:07:52.907 INFO:tasks.workunit.client.0.smithi026.stdout:6/550: fsync d15/d34/f49 0 2024-05-09T00:07:52.907 INFO:tasks.workunit.client.0.smithi026.stdout:6/551: chown d15/d1e/d23/d73/d8e/l9a 310295717 1 2024-05-09T00:07:52.928 INFO:tasks.workunit.client.0.smithi026.stdout:3/562: dwrite d5/d9/f16 [0,4194304] 0 2024-05-09T00:07:52.928 INFO:tasks.workunit.client.0.smithi026.stdout:7/818: dwrite d8/d2e/d84/db4/dbc/d1e/f41 [0,4194304] 0 2024-05-09T00:07:52.929 INFO:tasks.workunit.client.0.smithi026.stdout:7/819: write d8/d2e/f4a [2286855,5456] 0 2024-05-09T00:07:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:6/552: dwrite d15/d1e/d23/f8a [0,4194304] 0 2024-05-09T00:07:52.932 INFO:tasks.workunit.client.0.smithi026.stdout:3/563: creat d5/d9/fb8 x:0 0 0 2024-05-09T00:07:52.937 INFO:tasks.workunit.client.0.smithi026.stdout:7/820: creat d8/d2e/d84/db4/dbc/f118 x:0 0 0 2024-05-09T00:07:52.945 INFO:tasks.workunit.client.0.smithi026.stdout:6/553: mknod d15/d34/d52/d8b/cb9 0 2024-05-09T00:07:52.950 INFO:tasks.workunit.client.0.smithi026.stdout:6/554: mkdir d15/d34/dba 0 2024-05-09T00:07:52.954 INFO:tasks.workunit.client.0.smithi026.stdout:6/555: rmdir d15/d41/d9f 39 2024-05-09T00:07:52.954 INFO:tasks.workunit.client.0.smithi026.stdout:6/556: chown d15/d1e/d30 1965 1 2024-05-09T00:07:52.955 INFO:tasks.workunit.client.0.smithi026.stdout:7/821: dwrite d8/d2e/d84/db4/dbc/d1e/d3d/f61 [0,4194304] 0 2024-05-09T00:07:52.960 INFO:tasks.workunit.client.0.smithi026.stdout:6/557: rmdir d15/d62 39 2024-05-09T00:07:52.963 INFO:tasks.workunit.client.0.smithi026.stdout:1/779: sync 2024-05-09T00:07:52.963 INFO:tasks.workunit.client.0.smithi026.stdout:4/714: sync 2024-05-09T00:07:52.964 INFO:tasks.workunit.client.0.smithi026.stdout:4/715: write d0/d12/d1b/f51 [596569,102919] 0 2024-05-09T00:07:52.964 INFO:tasks.workunit.client.0.smithi026.stdout:4/716: chown d0/d12/d34/cd2 4090 1 2024-05-09T00:07:52.964 INFO:tasks.workunit.client.0.smithi026.stdout:4/717: chown d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5 1614872723 1 2024-05-09T00:07:52.964 INFO:tasks.workunit.client.0.smithi026.stdout:4/718: readlink d0/d12/da2/l80 0 2024-05-09T00:07:52.964 INFO:tasks.workunit.client.0.smithi026.stdout:3/564: dwrite d5/d9/dc/f1b [4194304,4194304] 0 2024-05-09T00:07:52.964 INFO:tasks.workunit.client.0.smithi026.stdout:1/780: getdents d5/dd/d17/d73 0 2024-05-09T00:07:52.965 INFO:tasks.workunit.client.0.smithi026.stdout:1/781: chown d5/dd/d1f/f2e 15821 1 2024-05-09T00:07:52.965 INFO:tasks.workunit.client.0.smithi026.stdout:4/719: truncate d0/d12/d1b/f3c 194771 0 2024-05-09T00:07:52.966 INFO:tasks.workunit.client.0.smithi026.stdout:2/729: sync 2024-05-09T00:07:52.966 INFO:tasks.workunit.client.0.smithi026.stdout:2/730: write d14/d22/d55/da3/f26 [4945368,14319] 0 2024-05-09T00:07:52.966 INFO:tasks.workunit.client.0.smithi026.stdout:3/565: mknod d5/d44/cb9 0 2024-05-09T00:07:52.969 INFO:tasks.workunit.client.0.smithi026.stdout:1/782: mkdir d5/dd/d17/d73/d10c 0 2024-05-09T00:07:52.969 INFO:tasks.workunit.client.0.smithi026.stdout:4/720: mknod d0/d12/da2/d97/dbf/dd1/cf1 0 2024-05-09T00:07:52.971 INFO:tasks.workunit.client.0.smithi026.stdout:2/731: rename d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/d96 to d14/d22/d55/da3/d30/dc3/df7 0 2024-05-09T00:07:52.971 INFO:tasks.workunit.client.0.smithi026.stdout:2/732: read d14/d22/d55/da3/d20/d41/d51/fa4 [180140,43018] 0 2024-05-09T00:07:52.972 INFO:tasks.workunit.client.0.smithi026.stdout:2/733: write d14/d22/d55/da3/d3b/f9b [827751,78786] 0 2024-05-09T00:07:52.972 INFO:tasks.workunit.client.0.smithi026.stdout:2/734: write d14/d22/f7d [4198063,41038] 0 2024-05-09T00:07:52.973 INFO:tasks.workunit.client.0.smithi026.stdout:6/558: dread d15/f1f [0,4194304] 0 2024-05-09T00:07:52.973 INFO:tasks.workunit.client.0.smithi026.stdout:3/566: getdents d5/d9/d4a/d5f/d6f 0 2024-05-09T00:07:52.975 INFO:tasks.workunit.client.0.smithi026.stdout:1/783: creat d5/dd/d87/f10d x:0 0 0 2024-05-09T00:07:52.976 INFO:tasks.workunit.client.0.smithi026.stdout:4/721: creat d0/d12/d64/dac/ff2 x:0 0 0 2024-05-09T00:07:52.978 INFO:tasks.workunit.client.0.smithi026.stdout:3/567: truncate d5/d9/dc/d28/f4c 2636300 0 2024-05-09T00:07:52.979 INFO:tasks.workunit.client.0.smithi026.stdout:1/784: mkdir d5/dd/d17/d9f/dc6/de2/d10e 0 2024-05-09T00:07:52.984 INFO:tasks.workunit.client.0.smithi026.stdout:4/722: getdents d0/d12/da2/d97/d43/d49/de7 0 2024-05-09T00:07:52.986 INFO:tasks.workunit.client.0.smithi026.stdout:3/568: mkdir d5/d9/dc/d28/dba 0 2024-05-09T00:07:52.988 INFO:tasks.workunit.client.0.smithi026.stdout:4/723: write d0/d12/da2/d97/d43/d58/f9c [3953283,90978] 0 2024-05-09T00:07:52.990 INFO:tasks.workunit.client.0.smithi026.stdout:7/822: write d8/ff [1711286,104116] 0 2024-05-09T00:07:52.990 INFO:tasks.workunit.client.0.smithi026.stdout:7/823: fdatasync d8/d5c/d9a/d9f/d104/d116/f112 0 2024-05-09T00:07:52.990 INFO:tasks.workunit.client.0.smithi026.stdout:4/724: write d0/d12/da2/d97/d43/d49/d8f/da3/f63 [489418,13361] 0 2024-05-09T00:07:52.991 INFO:tasks.workunit.client.0.smithi026.stdout:4/725: read d0/d12/da2/d97/d43/d49/d8f/da3/f7a [8627062,129679] 0 2024-05-09T00:07:52.994 INFO:tasks.workunit.client.0.smithi026.stdout:7/824: creat d8/d2e/d84/db4/dbc/d22/f119 x:0 0 0 2024-05-09T00:07:52.996 INFO:tasks.workunit.client.0.smithi026.stdout:4/726: symlink d0/lf3 0 2024-05-09T00:07:53.003 INFO:tasks.workunit.client.0.smithi026.stdout:6/559: dwrite d15/d34/f49 [0,4194304] 0 2024-05-09T00:07:53.004 INFO:tasks.workunit.client.0.smithi026.stdout:7/825: rmdir d8/d5c/d9a/d9f/d104/d116 39 2024-05-09T00:07:53.011 INFO:tasks.workunit.client.0.smithi026.stdout:7/826: mknod d8/d2e/d84/db4/dbc/d1e/d3d/d6b/c11a 0 2024-05-09T00:07:53.016 INFO:tasks.workunit.client.0.smithi026.stdout:4/727: dwrite d0/d12/d64/fab [0,4194304] 0 2024-05-09T00:07:53.016 INFO:tasks.workunit.client.0.smithi026.stdout:4/728: stat d0/d12/da2/d97/d43/d49/d8f/da3/c46 0 2024-05-09T00:07:53.016 INFO:tasks.workunit.client.0.smithi026.stdout:4/729: write d0/d12/d64/f6e [115183,22356] 0 2024-05-09T00:07:53.016 INFO:tasks.workunit.client.0.smithi026.stdout:3/569: dwrite d5/d9/dc/d28/d2c/f84 [4194304,4194304] 0 2024-05-09T00:07:53.017 INFO:tasks.workunit.client.0.smithi026.stdout:7/827: dread d8/d5c/d9a/df4/d103/f115 [0,4194304] 0 2024-05-09T00:07:53.017 INFO:tasks.workunit.client.0.smithi026.stdout:4/730: write d0/f4c [1629619,122831] 0 2024-05-09T00:07:53.019 INFO:tasks.workunit.client.0.smithi026.stdout:1/785: dwrite d5/dd/d17/d73/f7a [0,4194304] 0 2024-05-09T00:07:53.019 INFO:tasks.workunit.client.0.smithi026.stdout:1/786: truncate d5/db/d1d/dae/fc3 566483 0 2024-05-09T00:07:53.021 INFO:tasks.workunit.client.0.smithi026.stdout:3/570: creat d5/d1e/d3e/fbb x:0 0 0 2024-05-09T00:07:53.023 INFO:tasks.workunit.client.0.smithi026.stdout:4/731: mknod d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/cf4 0 2024-05-09T00:07:53.026 INFO:tasks.workunit.client.0.smithi026.stdout:6/560: dwrite d15/d2b/f3e [0,4194304] 0 2024-05-09T00:07:53.026 INFO:tasks.workunit.client.0.smithi026.stdout:6/561: chown d15/l19 129396473 1 2024-05-09T00:07:53.026 INFO:tasks.workunit.client.0.smithi026.stdout:6/562: fdatasync d15/f8c 0 2024-05-09T00:07:53.026 INFO:tasks.workunit.client.0.smithi026.stdout:3/571: dread d5/d9/dc/f31 [0,4194304] 0 2024-05-09T00:07:53.037 INFO:tasks.workunit.client.0.smithi026.stdout:6/563: dwrite d15/f8c [0,4194304] 0 2024-05-09T00:07:53.040 INFO:tasks.workunit.client.0.smithi026.stdout:7/828: mknod d8/d2e/d84/db4/dbc/d1e/d3d/c11b 0 2024-05-09T00:07:53.042 INFO:tasks.workunit.client.0.smithi026.stdout:4/732: rmdir d0/d12/da2/d97/d43 39 2024-05-09T00:07:53.048 INFO:tasks.workunit.client.0.smithi026.stdout:3/572: rename d5/d9/dc/d28/d2c/f55 to d5/da7/fbc 0 2024-05-09T00:07:53.048 INFO:tasks.workunit.client.0.smithi026.stdout:3/573: truncate d5/d9/dc/d28/fac 542784 0 2024-05-09T00:07:53.051 INFO:tasks.workunit.client.0.smithi026.stdout:1/787: mknod d5/dd/d17/d73/c10f 0 2024-05-09T00:07:53.051 INFO:tasks.workunit.client.0.smithi026.stdout:1/788: truncate d5/d16/f9e 769255 0 2024-05-09T00:07:53.053 INFO:tasks.workunit.client.0.smithi026.stdout:7/829: symlink d8/d2e/d84/db4/dbc/d1e/d3d/dca/l11c 0 2024-05-09T00:07:53.054 INFO:tasks.workunit.client.0.smithi026.stdout:4/733: symlink d0/d12/da2/d97/d43/d49/d8f/da3/d86/lf5 0 2024-05-09T00:07:53.057 INFO:tasks.workunit.client.0.smithi026.stdout:1/789: rmdir d5/db/d1d/dae 39 2024-05-09T00:07:53.060 INFO:tasks.workunit.client.0.smithi026.stdout:7/830: mkdir d8/d5c/d9a/df4/d103/d11d 0 2024-05-09T00:07:53.063 INFO:tasks.workunit.client.0.smithi026.stdout:4/734: mknod d0/d12/da2/d97/d43/d58/db3/cf6 0 2024-05-09T00:07:53.063 INFO:tasks.workunit.client.0.smithi026.stdout:6/564: dwrite d15/d1e/d30/f72 [0,4194304] 0 2024-05-09T00:07:53.063 INFO:tasks.workunit.client.0.smithi026.stdout:4/735: truncate d0/d12/d1b/d4e/d92/fb4 234568 0 2024-05-09T00:07:53.063 INFO:tasks.workunit.client.0.smithi026.stdout:4/736: chown d0/d12/d1b/d4e/f5b 1112230882 1 2024-05-09T00:07:53.064 INFO:tasks.workunit.client.0.smithi026.stdout:1/790: mkdir d5/db/d108/d103/d110 0 2024-05-09T00:07:53.064 INFO:tasks.workunit.client.0.smithi026.stdout:1/791: write d5/dd/d1f/f90 [149899,30283] 0 2024-05-09T00:07:53.065 INFO:tasks.workunit.client.0.smithi026.stdout:3/574: dwrite d5/d9/d4a/f52 [0,4194304] 0 2024-05-09T00:07:53.067 INFO:tasks.workunit.client.0.smithi026.stdout:6/565: mkdir d15/d2b/d33/d55/d67/dbb 0 2024-05-09T00:07:53.068 INFO:tasks.workunit.client.0.smithi026.stdout:1/792: write d5/db/d1d/f48 [2472601,74314] 0 2024-05-09T00:07:53.068 INFO:tasks.workunit.client.0.smithi026.stdout:1/793: write d5/dd/f58 [546013,80052] 0 2024-05-09T00:07:53.069 INFO:tasks.workunit.client.0.smithi026.stdout:4/737: rename d0/d12/d87/la7 to d0/d12/d1b/lf7 0 2024-05-09T00:07:53.069 INFO:tasks.workunit.client.0.smithi026.stdout:4/738: dread - d0/d12/da2/d97/d43/d49/f70 zero size 2024-05-09T00:07:53.069 INFO:tasks.workunit.client.0.smithi026.stdout:4/739: stat d0/d12/da2/d97 0 2024-05-09T00:07:53.071 INFO:tasks.workunit.client.0.smithi026.stdout:3/575: creat d5/d9/d4a/d5f/d6f/d9e/fbd x:0 0 0 2024-05-09T00:07:53.075 INFO:tasks.workunit.client.0.smithi026.stdout:6/566: creat d15/d1e/d23/d73/d8e/fbc x:0 0 0 2024-05-09T00:07:53.076 INFO:tasks.workunit.client.0.smithi026.stdout:1/794: truncate d5/f2c 216579 0 2024-05-09T00:07:53.077 INFO:tasks.workunit.client.0.smithi026.stdout:7/831: dwrite d8/d2e/d84/db4/dbc/f7f [0,4194304] 0 2024-05-09T00:07:53.078 INFO:tasks.workunit.client.0.smithi026.stdout:3/576: symlink d5/d9/d4a/d5f/d6f/d75/lbe 0 2024-05-09T00:07:53.079 INFO:tasks.workunit.client.0.smithi026.stdout:3/577: write d5/d9/f16 [2815111,26271] 0 2024-05-09T00:07:53.079 INFO:tasks.workunit.client.0.smithi026.stdout:6/567: mknod d15/d34/d52/d8b/d4d/cbd 0 2024-05-09T00:07:53.079 INFO:tasks.workunit.client.0.smithi026.stdout:6/568: chown d15/l98 27 1 2024-05-09T00:07:53.080 INFO:tasks.workunit.client.0.smithi026.stdout:1/795: rmdir d5/d16/d60/d66/d97/d75/d100 39 2024-05-09T00:07:53.080 INFO:tasks.workunit.client.0.smithi026.stdout:1/796: fsync d5/db/f1e 0 2024-05-09T00:07:53.082 INFO:tasks.workunit.client.0.smithi026.stdout:7/832: mknod d8/d5c/d9a/df4/c11e 0 2024-05-09T00:07:53.091 INFO:tasks.workunit.client.0.smithi026.stdout:3/578: rename d5/d1e/f20 to d5/d9/d49/fbf 0 2024-05-09T00:07:53.095 INFO:tasks.workunit.client.0.smithi026.stdout:6/569: creat d15/d1e/d23/d73/d8e/fbe x:0 0 0 2024-05-09T00:07:53.096 INFO:tasks.workunit.client.0.smithi026.stdout:1/797: truncate d5/d16/d60/f74 274828 0 2024-05-09T00:07:53.098 INFO:tasks.workunit.client.0.smithi026.stdout:1/798: write f4 [8612985,60229] 0 2024-05-09T00:07:53.098 INFO:tasks.workunit.client.0.smithi026.stdout:7/833: rmdir d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2 39 2024-05-09T00:07:53.100 INFO:tasks.workunit.client.0.smithi026.stdout:3/579: symlink d5/d9/lc0 0 2024-05-09T00:07:53.100 INFO:tasks.workunit.client.0.smithi026.stdout:3/580: write d5/d9/dc/d5d/f7d [307829,28094] 0 2024-05-09T00:07:53.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/581: creat d5/d1e/d7b/fc1 x:0 0 0 2024-05-09T00:07:53.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/582: write d5/d9/dc/f83 [941677,79719] 0 2024-05-09T00:07:53.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/583: chown d5/d1e/d3e/l40 44177 1 2024-05-09T00:07:53.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/584: fdatasync d5/d9/dc/d28/d2c/f84 0 2024-05-09T00:07:53.103 INFO:tasks.workunit.client.0.smithi026.stdout:3/585: rename d5/d9/l9b to d5/d9/dc/d28/d63/d81/lc2 0 2024-05-09T00:07:53.103 INFO:tasks.workunit.client.0.smithi026.stdout:3/586: write d5/d9/dc/d28/d2c/fa6 [786018,12308] 0 2024-05-09T00:07:53.103 INFO:tasks.workunit.client.0.smithi026.stdout:3/587: write d5/d9/d71/faf [229756,23593] 0 2024-05-09T00:07:53.104 INFO:tasks.workunit.client.0.smithi026.stdout:8/778: sync 2024-05-09T00:07:53.104 INFO:tasks.workunit.client.0.smithi026.stdout:5/648: sync 2024-05-09T00:07:53.105 INFO:tasks.workunit.client.0.smithi026.stdout:6/570: dread d15/d1e/d30/f72 [0,4194304] 0 2024-05-09T00:07:53.105 INFO:tasks.workunit.client.0.smithi026.stdout:5/649: write d2/d8/d31/d63/f83 [405654,22124] 0 2024-05-09T00:07:53.107 INFO:tasks.workunit.client.0.smithi026.stdout:8/779: link de/f23 de/d17/d21/d24/d5b/f103 0 2024-05-09T00:07:53.110 INFO:tasks.workunit.client.0.smithi026.stdout:6/571: mkdir d15/d2b/d33/d55/d67/dbb/dbf 0 2024-05-09T00:07:53.117 INFO:tasks.workunit.client.0.smithi026.stdout:7/834: dread d8/d1b/f37 [0,4194304] 0 2024-05-09T00:07:53.118 INFO:tasks.workunit.client.0.smithi026.stdout:5/650: link d2/d8/d31/d2e/d4a/l8c d2/d8/d31/d32/d48/daa/ld5 0 2024-05-09T00:07:53.121 INFO:tasks.workunit.client.0.smithi026.stdout:1/799: dwrite d5/db/f1e [0,4194304] 0 2024-05-09T00:07:53.121 INFO:tasks.workunit.client.0.smithi026.stdout:1/800: truncate d5/db/d108/d103/de0/fd8 1179639 0 2024-05-09T00:07:53.123 INFO:tasks.workunit.client.0.smithi026.stdout:7/835: getdents d8/d1b/d89/dc1/dd0 0 2024-05-09T00:07:53.124 INFO:tasks.workunit.client.0.smithi026.stdout:3/588: dwrite d5/d9/f6d [0,4194304] 0 2024-05-09T00:07:53.124 INFO:tasks.workunit.client.0.smithi026.stdout:1/801: write d5/dd/d17/f2a [391879,118778] 0 2024-05-09T00:07:53.124 INFO:tasks.workunit.client.0.smithi026.stdout:7/836: write d8/d5c/d9a/d9f/d104/d116/f98 [413339,100426] 0 2024-05-09T00:07:53.125 INFO:tasks.workunit.client.0.smithi026.stdout:1/802: write d5/d16/dbd/ff1 [788705,124282] 0 2024-05-09T00:07:53.125 INFO:tasks.workunit.client.0.smithi026.stdout:5/651: creat d2/d8/d31/fd6 x:0 0 0 2024-05-09T00:07:53.127 INFO:tasks.workunit.client.0.smithi026.stdout:6/572: dwrite d15/d1e/d23/d3a/f7c [0,4194304] 0 2024-05-09T00:07:53.131 INFO:tasks.workunit.client.0.smithi026.stdout:8/780: fsync de/d17/d21/d24/d3b/d3d/f5f 0 2024-05-09T00:07:53.144 INFO:tasks.workunit.client.0.smithi026.stdout:3/589: unlink d5/d9/d4a/d5f/d6f/d9e/fbd 0 2024-05-09T00:07:53.146 INFO:tasks.workunit.client.0.smithi026.stdout:7/837: getdents d8/d2e/d84 0 2024-05-09T00:07:53.148 INFO:tasks.workunit.client.0.smithi026.stdout:1/803: getdents d5/dd/d17/d9f 0 2024-05-09T00:07:53.152 INFO:tasks.workunit.client.0.smithi026.stdout:5/652: mkdir d2/d8/d31/d32/d5c/dd7 0 2024-05-09T00:07:53.153 INFO:tasks.workunit.client.0.smithi026.stdout:6/573: creat d15/d2b/d33/fc0 x:0 0 0 2024-05-09T00:07:53.154 INFO:tasks.workunit.client.0.smithi026.stdout:7/838: dread d8/d1b/f7b [0,4194304] 0 2024-05-09T00:07:53.158 INFO:tasks.workunit.client.0.smithi026.stdout:8/781: mkdir de/d17/d21/dca/d104 0 2024-05-09T00:07:53.158 INFO:tasks.workunit.client.0.smithi026.stdout:1/804: fdatasync d5/dd/d17/d73/fb9 0 2024-05-09T00:07:53.158 INFO:tasks.workunit.client.0.smithi026.stdout:8/782: chown de/d6c/d31/d4f/d87/d62/daa/ddb/lf9 924935 1 2024-05-09T00:07:53.158 INFO:tasks.workunit.client.0.smithi026.stdout:8/783: dread - de/d6c/d31/d4f/d87/d62/daa/ddb/d91/fdd zero size 2024-05-09T00:07:53.161 INFO:tasks.workunit.client.0.smithi026.stdout:5/653: dread d2/d8/d31/f85 [0,4194304] 0 2024-05-09T00:07:53.161 INFO:tasks.workunit.client.0.smithi026.stdout:5/654: fsync d2/d8/d31/d2e/d4a/f3c 0 2024-05-09T00:07:53.165 INFO:tasks.workunit.client.0.smithi026.stdout:1/805: link d5/db/d1d/l82 d5/dd/d87/l111 0 2024-05-09T00:07:53.174 INFO:tasks.workunit.client.0.smithi026.stdout:1/806: creat d5/dd/d17/f112 x:0 0 0 2024-05-09T00:07:53.174 INFO:tasks.workunit.client.0.smithi026.stdout:1/807: write d5/db/d1d/dae/fc3 [1104482,53760] 0 2024-05-09T00:07:53.174 INFO:tasks.workunit.client.0.smithi026.stdout:1/808: fdatasync d5/db/f62 0 2024-05-09T00:07:53.174 INFO:tasks.workunit.client.0.smithi026.stdout:5/655: mkdir d2/d8/d31/dd8 0 2024-05-09T00:07:53.174 INFO:tasks.workunit.client.0.smithi026.stdout:3/590: dwrite d5/d9/dc/d28/f35 [0,4194304] 0 2024-05-09T00:07:53.175 INFO:tasks.workunit.client.0.smithi026.stdout:1/809: mknod d5/dd/d1f/d51/c113 0 2024-05-09T00:07:53.175 INFO:tasks.workunit.client.0.smithi026.stdout:5/656: rename d2/d8/d31/d2e/d79/f6b to d2/d8/d31/d32/d5c/dd7/fd9 0 2024-05-09T00:07:53.179 INFO:tasks.workunit.client.0.smithi026.stdout:6/574: dwrite d15/d34/d52/d8b/f40 [4194304,4194304] 0 2024-05-09T00:07:53.179 INFO:tasks.workunit.client.0.smithi026.stdout:8/784: dwrite de/d6c/d31/d4f/d87/fe1 [0,4194304] 0 2024-05-09T00:07:53.180 INFO:tasks.workunit.client.0.smithi026.stdout:3/591: mknod d5/cc3 0 2024-05-09T00:07:53.183 INFO:tasks.workunit.client.0.smithi026.stdout:1/810: unlink d5/dd/d17/d73/f7a 0 2024-05-09T00:07:53.184 INFO:tasks.workunit.client.0.smithi026.stdout:7/839: dwrite d8/d5c/fc7 [0,4194304] 0 2024-05-09T00:07:53.185 INFO:tasks.workunit.client.0.smithi026.stdout:5/657: truncate d2/d8/d31/d2e/d33/f61 836258 0 2024-05-09T00:07:53.188 INFO:tasks.workunit.client.0.smithi026.stdout:6/575: creat d15/d1e/d23/d3a/da6/fc1 x:0 0 0 2024-05-09T00:07:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:8/785: rename de/d6c/d31/d4f/d87/d62/db4/cb6 to de/d17/d21/dca/d104/c105 0 2024-05-09T00:07:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:8/786: chown de/d60 6 1 2024-05-09T00:07:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:8/787: fsync de/d17/d21/dca/f101 0 2024-05-09T00:07:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:8/788: readlink de/d48/lf4 0 2024-05-09T00:07:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:8/789: readlink de/d17/l32 0 2024-05-09T00:07:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:8/790: chown de/d17/d7d/ce4 39 1 2024-05-09T00:07:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:8/791: readlink de/d6c/d31/d4f/d87/d62/daa/ddb/d91/la5 0 2024-05-09T00:07:53.193 INFO:tasks.workunit.client.0.smithi026.stdout:1/811: creat d5/dd/d17/d9f/dc6/de2/f114 x:0 0 0 2024-05-09T00:07:53.199 INFO:tasks.workunit.client.0.smithi026.stdout:7/840: symlink d8/d2e/d84/db4/dbc/d1e/d3d/dca/l11f 0 2024-05-09T00:07:53.199 INFO:tasks.workunit.client.0.smithi026.stdout:7/841: chown d8/d2e/d84/db4/dbc/d1e/d3d 2640 1 2024-05-09T00:07:53.204 INFO:tasks.workunit.client.0.smithi026.stdout:3/592: rename d5/d9/dc/d28/d2c/c38 to d5/d9/dc/d5b/da5/db3/cc4 0 2024-05-09T00:07:53.207 INFO:tasks.workunit.client.0.smithi026.stdout:6/576: dwrite d15/d1e/d23/d73/d76/fb7 [0,4194304] 0 2024-05-09T00:07:53.208 INFO:tasks.workunit.client.0.smithi026.stdout:1/812: dread d5/d16/d60/d66/fdc [0,4194304] 0 2024-05-09T00:07:53.208 INFO:tasks.workunit.client.0.smithi026.stdout:1/813: chown d5/dd/d1f/d51/fde 3456 1 2024-05-09T00:07:53.209 INFO:tasks.workunit.client.0.smithi026.stdout:7/842: unlink d8/d2e/d84/db4/dbc/d1e/d8a/df5/cf6 0 2024-05-09T00:07:53.214 INFO:tasks.workunit.client.0.smithi026.stdout:5/658: rename d2/d8/d31/d2e/d35/l9a to d2/d8/d2a/d8d/lda 0 2024-05-09T00:07:53.214 INFO:tasks.workunit.client.0.smithi026.stdout:5/659: readlink d2/d8/d31/d2e/d79/lb1 0 2024-05-09T00:07:53.215 INFO:tasks.workunit.client.0.smithi026.stdout:3/593: mkdir d5/d44/d9f/dc5 0 2024-05-09T00:07:53.222 INFO:tasks.workunit.client.0.smithi026.stdout:6/577: mknod d15/d1e/d23/d73/d8e/cc2 0 2024-05-09T00:07:53.230 INFO:tasks.workunit.client.0.smithi026.stdout:6/578: dread d15/d34/f49 [0,4194304] 0 2024-05-09T00:07:53.233 INFO:tasks.workunit.client.0.smithi026.stdout:1/814: mknod d5/dd/d17/d7b/c115 0 2024-05-09T00:07:53.233 INFO:tasks.workunit.client.0.smithi026.stdout:1/815: write d5/dd/d17/f112 [632008,33214] 0 2024-05-09T00:07:53.236 INFO:tasks.workunit.client.0.smithi026.stdout:8/792: rename de/d6c/de3 to de/d17/d21/d6f/d106 0 2024-05-09T00:07:53.239 INFO:tasks.workunit.client.0.smithi026.stdout:5/660: creat d2/d8/d2a/d8d/fdb x:0 0 0 2024-05-09T00:07:53.241 INFO:tasks.workunit.client.0.smithi026.stdout:3/594: creat d5/d9/fc6 x:0 0 0 2024-05-09T00:07:53.241 INFO:tasks.workunit.client.0.smithi026.stdout:3/595: stat d5/d41/c7f 0 2024-05-09T00:07:53.241 INFO:tasks.workunit.client.0.smithi026.stdout:3/596: fsync d5/d9/d4a/f52 0 2024-05-09T00:07:53.244 INFO:tasks.workunit.client.0.smithi026.stdout:6/579: creat d15/d2b/d33/d55/d67/dbb/dbf/fc3 x:0 0 0 2024-05-09T00:07:53.248 INFO:tasks.workunit.client.0.smithi026.stdout:3/597: dread d5/d9/dc/d5d/f6c [0,4194304] 0 2024-05-09T00:07:53.249 INFO:tasks.workunit.client.0.smithi026.stdout:7/843: rename d8/d5c/d9a/df4/d103 to d8/d2e/d84/db4/dbc/d1e/d8a/d120 0 2024-05-09T00:07:53.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/793: mkdir de/d17/d21/d6f/d107 0 2024-05-09T00:07:53.254 INFO:tasks.workunit.client.0.smithi026.stdout:5/661: link d2/d8/d31/d63/d9c/fb6 d2/fdc 0 2024-05-09T00:07:53.254 INFO:tasks.workunit.client.0.smithi026.stdout:9/783: sync 2024-05-09T00:07:53.254 INFO:tasks.workunit.client.0.smithi026.stdout:2/735: sync 2024-05-09T00:07:53.254 INFO:tasks.workunit.client.0.smithi026.stdout:0/923: sync 2024-05-09T00:07:53.254 INFO:tasks.workunit.client.0.smithi026.stdout:0/924: stat d1d/d1e/d20/d4d/cff 0 2024-05-09T00:07:53.256 INFO:tasks.workunit.client.0.smithi026.stdout:9/784: dread d7/d23/d2f/d3a/fba [0,4194304] 0 2024-05-09T00:07:53.256 INFO:tasks.workunit.client.0.smithi026.stdout:6/580: symlink d15/d1e/d23/lc4 0 2024-05-09T00:07:53.256 INFO:tasks.workunit.client.0.smithi026.stdout:4/740: sync 2024-05-09T00:07:53.257 INFO:tasks.workunit.client.0.smithi026.stdout:4/741: read d0/d83/f76 [972664,119495] 0 2024-05-09T00:07:53.262 INFO:tasks.workunit.client.0.smithi026.stdout:1/816: mkdir d5/dd/d17/d116 0 2024-05-09T00:07:53.263 INFO:tasks.workunit.client.0.smithi026.stdout:3/598: creat d5/d9/d4a/fc7 x:0 0 0 2024-05-09T00:07:53.264 INFO:tasks.workunit.client.0.smithi026.stdout:3/599: dread - d5/d9/d4a/d5f/d6f/fb6 zero size 2024-05-09T00:07:53.264 INFO:tasks.workunit.client.0.smithi026.stdout:3/600: fsync d5/d9/dc/f23 0 2024-05-09T00:07:53.264 INFO:tasks.workunit.client.0.smithi026.stdout:3/601: fsync d5/d9/d49/fbf 0 2024-05-09T00:07:53.265 INFO:tasks.workunit.client.0.smithi026.stdout:7/844: creat d8/d2e/d84/db4/dbc/d1e/d80/f121 x:0 0 0 2024-05-09T00:07:53.266 INFO:tasks.workunit.client.0.smithi026.stdout:8/794: fdatasync de/d6c/d31/f74 0 2024-05-09T00:07:53.267 INFO:tasks.workunit.client.0.smithi026.stdout:5/662: mkdir d2/d8/d6d/ddd 0 2024-05-09T00:07:53.274 INFO:tasks.workunit.client.0.smithi026.stdout:2/736: dwrite d14/d22/fe6 [0,4194304] 0 2024-05-09T00:07:53.282 INFO:tasks.workunit.client.0.smithi026.stdout:2/737: dread f4 [0,4194304] 0 2024-05-09T00:07:53.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:51.909520+0000 mgr.smithi135.kkrhgf (mgr.24419) 59 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 92 MiB/s rd, 200 MiB/s wr, 349 op/s 2024-05-09T00:07:53.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:51.909520+0000 mgr.smithi135.kkrhgf (mgr.24419) 59 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 92 MiB/s rd, 200 MiB/s wr, 349 op/s 2024-05-09T00:07:53.409 INFO:tasks.workunit.client.0.smithi026.stdout:0/925: creat d1d/d25/f12b x:0 0 0 2024-05-09T00:07:53.410 INFO:tasks.workunit.client.0.smithi026.stdout:9/785: creat d7/d26/deb/f10b x:0 0 0 2024-05-09T00:07:53.411 INFO:tasks.workunit.client.0.smithi026.stdout:9/786: fsync d7/d26/f71 0 2024-05-09T00:07:53.411 INFO:tasks.workunit.client.0.smithi026.stdout:6/581: creat d15/d1e/d23/d3a/da6/fc5 x:0 0 0 2024-05-09T00:07:53.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/742: rename d0/fc to d0/d12/d1b/ff8 0 2024-05-09T00:07:53.413 INFO:tasks.workunit.client.0.smithi026.stdout:4/743: write d0/d12/da2/d97/fb1 [937101,22538] 0 2024-05-09T00:07:53.422 INFO:tasks.workunit.client.0.smithi026.stdout:6/582: dread d15/d2b/f3e [0,4194304] 0 2024-05-09T00:07:53.425 INFO:tasks.workunit.client.0.smithi026.stdout:6/583: dread d15/d1e/d30/f46 [4194304,4194304] 0 2024-05-09T00:07:53.425 INFO:tasks.workunit.client.0.smithi026.stdout:6/584: chown d15/d1e/d23/d73/d8e/fbe 492288 1 2024-05-09T00:07:53.425 INFO:tasks.workunit.client.0.smithi026.stdout:6/585: write d15/d34/d52/f9d [483366,3844] 0 2024-05-09T00:07:53.425 INFO:tasks.workunit.client.0.smithi026.stdout:6/586: write d15/d34/d52/d8b/fac [747159,20257] 0 2024-05-09T00:07:53.439 INFO:tasks.workunit.client.0.smithi026.stdout:3/602: mknod d5/d9/dc/d5b/cc8 0 2024-05-09T00:07:53.439 INFO:tasks.workunit.client.0.smithi026.stdout:3/603: fsync d5/d1e/f3d 0 2024-05-09T00:07:53.439 INFO:tasks.workunit.client.0.smithi026.stdout:3/604: dread - d5/d41/fab zero size 2024-05-09T00:07:53.442 INFO:tasks.workunit.client.0.smithi026.stdout:7/845: symlink d8/d2e/d84/db4/dbc/d1e/l122 0 2024-05-09T00:07:53.444 INFO:tasks.workunit.client.0.smithi026.stdout:8/795: link f3 de/d17/d7d/dd2/dee/f108 0 2024-05-09T00:07:53.444 INFO:tasks.workunit.client.0.smithi026.stdout:8/796: stat de/d60 0 2024-05-09T00:07:53.444 INFO:tasks.workunit.client.0.smithi026.stdout:8/797: write de/d17/d21/d24/f99 [439126,4634] 0 2024-05-09T00:07:53.444 INFO:tasks.workunit.client.0.smithi026.stdout:8/798: chown de/d17/d7d/f9d 11650 1 2024-05-09T00:07:53.445 INFO:tasks.workunit.client.0.smithi026.stdout:5/663: unlink d2/d8/d31/d2e/fad 0 2024-05-09T00:07:53.448 INFO:tasks.workunit.client.0.smithi026.stdout:2/738: creat d14/d22/d55/da3/d3b/ff8 x:0 0 0 2024-05-09T00:07:53.513 INFO:tasks.workunit.client.0.smithi026.stdout:0/926: mkdir d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d96/d12c 0 2024-05-09T00:07:53.516 INFO:tasks.workunit.client.0.smithi026.stdout:9/787: rename d7/d23/d2f/f98 to d7/d23/d29/d31/f10c 0 2024-05-09T00:07:53.516 INFO:tasks.workunit.client.0.smithi026.stdout:9/788: stat d7/d23/d29/d31/d40/d41/d54/d9a/da4 0 2024-05-09T00:07:53.517 INFO:tasks.workunit.client.0.smithi026.stdout:4/744: symlink d0/d83/lf9 0 2024-05-09T00:07:53.519 INFO:tasks.workunit.client.0.smithi026.stdout:6/587: creat d15/d34/d52/fc6 x:0 0 0 2024-05-09T00:07:53.530 INFO:tasks.workunit.client.0.smithi026.stdout:4/745: dwrite d0/d12/da2/d97/d43/d58/fbb [0,4194304] 0 2024-05-09T00:07:53.531 INFO:tasks.workunit.client.0.smithi026.stdout:3/605: rmdir d5/d9 39 2024-05-09T00:07:53.541 INFO:tasks.workunit.client.0.smithi026.stdout:5/664: mknod d2/d5a/cde 0 2024-05-09T00:07:53.541 INFO:tasks.workunit.client.0.smithi026.stdout:5/665: readlink d2/la 0 2024-05-09T00:07:53.546 INFO:tasks.workunit.client.0.smithi026.stdout:2/739: symlink d14/d22/d55/da3/d30/d6a/lf9 0 2024-05-09T00:07:53.551 INFO:tasks.workunit.client.0.smithi026.stdout:0/927: unlink d1d/d1e/d20/d4d/d83/da0/lad 0 2024-05-09T00:07:53.551 INFO:tasks.workunit.client.0.smithi026.stdout:0/928: readlink l1c 0 2024-05-09T00:07:53.554 INFO:tasks.workunit.client.0.smithi026.stdout:7/846: rename d8/d5c/fcb to d8/d2e/d84/db4/dbc/d1e/f123 0 2024-05-09T00:07:53.561 INFO:tasks.workunit.client.0.smithi026.stdout:4/746: link d0/d12/da2/d97/d43/d49/fb7 d0/d12/da2/db8/ffa 0 2024-05-09T00:07:53.561 INFO:tasks.workunit.client.0.smithi026.stdout:4/747: chown d0/d12/d1b/d4e/f50 1750843 1 2024-05-09T00:07:53.562 INFO:tasks.workunit.client.0.smithi026.stdout:3/606: creat d5/d9/d49/fc9 x:0 0 0 2024-05-09T00:07:53.566 INFO:tasks.workunit.client.0.smithi026.stdout:4/748: mkdir d0/d12/da2/d97/dbf/dd1/dfb 0 2024-05-09T00:07:53.571 INFO:tasks.workunit.client.0.smithi026.stdout:0/929: dwrite d1d/d1e/d2d/f77 [0,4194304] 0 2024-05-09T00:07:53.571 INFO:tasks.workunit.client.0.smithi026.stdout:4/749: mkdir d0/d12/da2/d97/d43/d49/de7/dfc 0 2024-05-09T00:07:53.575 INFO:tasks.workunit.client.0.smithi026.stdout:0/930: write d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc/de2/ff6 [2602306,70420] 0 2024-05-09T00:07:53.575 INFO:tasks.workunit.client.0.smithi026.stdout:0/931: stat d1d/d1e/d20/d51/f101 0 2024-05-09T00:07:53.575 INFO:tasks.workunit.client.0.smithi026.stdout:4/750: truncate d0/f22 2116489 0 2024-05-09T00:07:53.575 INFO:tasks.workunit.client.0.smithi026.stdout:4/751: stat d0/d12/da2/d97/d43/d49/fa0 0 2024-05-09T00:07:53.578 INFO:tasks.workunit.client.0.smithi026.stdout:0/932: mknod d1d/d25/d3c/c12d 0 2024-05-09T00:07:53.578 INFO:tasks.workunit.client.0.smithi026.stdout:0/933: dread - d1d/d25/f12b zero size 2024-05-09T00:07:53.579 INFO:tasks.workunit.client.0.smithi026.stdout:4/752: creat d0/d12/d64/ffd x:0 0 0 2024-05-09T00:07:53.579 INFO:tasks.workunit.client.0.smithi026.stdout:4/753: write d0/d12/da2/d97/d43/d49/fdf [483426,40492] 0 2024-05-09T00:07:53.579 INFO:tasks.workunit.client.0.smithi026.stdout:4/754: readlink d0/d12/da2/d97/d43/l65 0 2024-05-09T00:07:53.582 INFO:tasks.workunit.client.0.smithi026.stdout:0/934: mknod d1d/d33/dbb/c12e 0 2024-05-09T00:07:53.582 INFO:tasks.workunit.client.0.smithi026.stdout:0/935: dread - d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d96/fdc zero size 2024-05-09T00:07:53.586 INFO:tasks.workunit.client.0.smithi026.stdout:7/847: dwrite f7 [0,4194304] 0 2024-05-09T00:07:53.586 INFO:tasks.workunit.client.0.smithi026.stdout:3/607: dwrite d5/d1e/d7b/fc1 [0,4194304] 0 2024-05-09T00:07:53.586 INFO:tasks.workunit.client.0.smithi026.stdout:4/755: unlink d0/d12/d1b/c41 0 2024-05-09T00:07:53.588 INFO:tasks.workunit.client.0.smithi026.stdout:0/936: creat d1d/d1e/d20/d4d/d83/f12f x:0 0 0 2024-05-09T00:07:53.596 INFO:tasks.workunit.client.0.smithi026.stdout:4/756: dread d0/d12/da2/d97/d43/d49/fdf [0,4194304] 0 2024-05-09T00:07:53.598 INFO:tasks.workunit.client.0.smithi026.stdout:7/848: unlink d8/d2e/d84/db4/dbc/d1e/d3d/d6b/f88 0 2024-05-09T00:07:53.602 INFO:tasks.workunit.client.0.smithi026.stdout:3/608: creat d5/db1/fca x:0 0 0 2024-05-09T00:07:53.603 INFO:tasks.workunit.client.0.smithi026.stdout:3/609: write d5/d41/fa1 [2615047,28334] 0 2024-05-09T00:07:53.605 INFO:tasks.workunit.client.0.smithi026.stdout:4/757: symlink d0/d12/da2/lfe 0 2024-05-09T00:07:53.605 INFO:tasks.workunit.client.0.smithi026.stdout:4/758: truncate d0/d12/da2/db8/fc4 832269 0 2024-05-09T00:07:53.605 INFO:tasks.workunit.client.0.smithi026.stdout:4/759: fdatasync d0/d12/da2/d97/d43/d58/f7e 0 2024-05-09T00:07:53.605 INFO:tasks.workunit.client.0.smithi026.stdout:0/937: dwrite d1d/d1e/d20/d4d/d83/da0/dd2/da7/f10d [0,4194304] 0 2024-05-09T00:07:53.609 INFO:tasks.workunit.client.0.smithi026.stdout:3/610: mkdir d5/dcb 0 2024-05-09T00:07:53.609 INFO:tasks.workunit.client.0.smithi026.stdout:3/611: readlink d5/le 0 2024-05-09T00:07:53.614 INFO:tasks.workunit.client.0.smithi026.stdout:0/938: truncate d1d/f5b 3172473 0 2024-05-09T00:07:53.617 INFO:tasks.workunit.client.0.smithi026.stdout:3/612: mknod d5/d1e/ccc 0 2024-05-09T00:07:53.617 INFO:tasks.workunit.client.0.smithi026.stdout:3/613: write d5/d9/d71/faf [262555,116385] 0 2024-05-09T00:07:53.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/939: dread d1d/d25/d3c/f88 [0,4194304] 0 2024-05-09T00:07:53.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/940: write d1d/d1e/d20/d51/f86 [4286114,35982] 0 2024-05-09T00:07:53.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/941: chown l0 478 1 2024-05-09T00:07:53.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/942: write d1d/da4/fb8 [1168775,15305] 0 2024-05-09T00:07:53.623 INFO:tasks.workunit.client.0.smithi026.stdout:3/614: creat d5/d9/dc/d5b/fcd x:0 0 0 2024-05-09T00:07:53.626 INFO:tasks.workunit.client.0.smithi026.stdout:4/760: dwrite d0/d12/da2/d97/f39 [4194304,4194304] 0 2024-05-09T00:07:53.629 INFO:tasks.workunit.client.0.smithi026.stdout:0/943: creat d1d/d25/d3c/f130 x:0 0 0 2024-05-09T00:07:53.640 INFO:tasks.workunit.client.0.smithi026.stdout:0/944: rename d1d/d25/d47/dc8/le1 to d1d/d1e/d20/d100/l131 0 2024-05-09T00:07:53.640 INFO:tasks.workunit.client.0.smithi026.stdout:0/945: readlink d1d/d25/d47/lc4 0 2024-05-09T00:07:53.644 INFO:tasks.workunit.client.0.smithi026.stdout:4/761: truncate d0/f4c 178045 0 2024-05-09T00:07:53.647 INFO:tasks.workunit.client.0.smithi026.stdout:0/946: unlink d1d/d1e/l123 0 2024-05-09T00:07:53.655 INFO:tasks.workunit.client.0.smithi026.stdout:4/762: creat d0/d12/d1b/d4e/fff x:0 0 0 2024-05-09T00:07:53.657 INFO:tasks.workunit.client.0.smithi026.stdout:0/947: rmdir d1d/d25 39 2024-05-09T00:07:53.661 INFO:tasks.workunit.client.0.smithi026.stdout:0/948: mkdir d1d/d25/d47/d6e/dc2/d132 0 2024-05-09T00:07:53.661 INFO:tasks.workunit.client.0.smithi026.stdout:0/949: write d1d/d1e/f32 [289793,4329] 0 2024-05-09T00:07:53.661 INFO:tasks.workunit.client.0.smithi026.stdout:0/950: readlink d1d/d33/l6a 0 2024-05-09T00:07:53.664 INFO:tasks.workunit.client.0.smithi026.stdout:1/817: sync 2024-05-09T00:07:53.669 INFO:tasks.workunit.client.0.smithi026.stdout:0/951: dread f11 [4194304,4194304] 0 2024-05-09T00:07:53.669 INFO:tasks.workunit.client.0.smithi026.stdout:0/952: symlink d1d/d25/d47/d6e/dc2/d132/l133 0 2024-05-09T00:07:53.670 INFO:tasks.workunit.client.0.smithi026.stdout:0/953: mknod d1d/d25/d47/d6e/dc2/d132/c134 0 2024-05-09T00:07:53.670 INFO:tasks.workunit.client.0.smithi026.stdout:0/954: readlink d1d/d25/d3c/d11e/l120 0 2024-05-09T00:07:53.672 INFO:tasks.workunit.client.0.smithi026.stdout:4/763: dwrite d0/d12/da2/d97/fb1 [0,4194304] 0 2024-05-09T00:07:53.690 INFO:tasks.workunit.client.0.smithi026.stdout:0/955: dwrite d1d/d33/d64/fe7 [0,4194304] 0 2024-05-09T00:07:53.691 INFO:tasks.workunit.client.0.smithi026.stdout:4/764: dwrite d0/d12/da2/d97/d43/d49/de7/ff0 [0,4194304] 0 2024-05-09T00:07:53.697 INFO:tasks.workunit.client.0.smithi026.stdout:4/765: creat d0/d12/d1b/d4e/f100 x:0 0 0 2024-05-09T00:07:53.697 INFO:tasks.workunit.client.0.smithi026.stdout:4/766: truncate d0/d12/da2/d97/d43/d49/fa0 1012919 0 2024-05-09T00:07:53.699 INFO:tasks.workunit.client.0.smithi026.stdout:4/767: mkdir d0/d12/da2/d101 0 2024-05-09T00:07:53.701 INFO:tasks.workunit.client.0.smithi026.stdout:4/768: mknod d0/d12/d1b/d4e/c102 0 2024-05-09T00:07:53.701 INFO:tasks.workunit.client.0.smithi026.stdout:4/769: dread - d0/d12/da2/d97/dbf/dd1/fee zero size 2024-05-09T00:07:53.703 INFO:tasks.workunit.client.0.smithi026.stdout:4/770: unlink d0/d12/da2/d97/d43/d58/db3/fde 0 2024-05-09T00:07:53.704 INFO:tasks.workunit.client.0.smithi026.stdout:4/771: creat d0/d12/da2/d97/d43/d49/d8f/dc1/f103 x:0 0 0 2024-05-09T00:07:53.705 INFO:tasks.workunit.client.0.smithi026.stdout:4/772: rename d0/d12/da2/d97/d43/ca4 to d0/d12/da2/db8/c104 0 2024-05-09T00:07:53.707 INFO:tasks.workunit.client.0.smithi026.stdout:0/956: dwrite d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/fe4 [0,4194304] 0 2024-05-09T00:07:53.707 INFO:tasks.workunit.client.0.smithi026.stdout:0/957: chown d1d/d33/d64 11411897 1 2024-05-09T00:07:53.719 INFO:tasks.workunit.client.0.smithi026.stdout:0/958: dwrite d1d/d1e/d20/f68 [4194304,4194304] 0 2024-05-09T00:07:53.721 INFO:tasks.workunit.client.0.smithi026.stdout:0/959: link d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/f113 d1d/d1e/d20/d4d/d83/da0/f135 0 2024-05-09T00:07:53.722 INFO:tasks.workunit.client.0.smithi026.stdout:0/960: chown d1d/f5b 871839541 1 2024-05-09T00:07:53.723 INFO:tasks.workunit.client.0.smithi026.stdout:0/961: symlink d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d96/l136 0 2024-05-09T00:07:53.725 INFO:tasks.workunit.client.0.smithi026.stdout:0/962: creat d1d/d1e/d20/d4d/d83/da0/f137 x:0 0 0 2024-05-09T00:07:53.743 INFO:tasks.workunit.client.0.smithi026.stdout:0/963: dwrite d1d/d1e/d2d/fdd [4194304,4194304] 0 2024-05-09T00:07:53.743 INFO:tasks.workunit.client.0.smithi026.stdout:0/964: readlink d1d/d25/l60 0 2024-05-09T00:07:53.747 INFO:tasks.workunit.client.0.smithi026.stdout:0/965: creat d1d/d33/dbb/f138 x:0 0 0 2024-05-09T00:07:53.747 INFO:tasks.workunit.client.0.smithi026.stdout:0/966: write f1b [3657959,118576] 0 2024-05-09T00:07:53.751 INFO:tasks.workunit.client.0.smithi026.stdout:0/967: truncate d1d/d33/dbb/f75 3715977 0 2024-05-09T00:07:53.753 INFO:tasks.workunit.client.0.smithi026.stdout:0/968: link d1d/d25/d47/d6e/f8e d1d/d25/f139 0 2024-05-09T00:07:53.754 INFO:tasks.workunit.client.0.smithi026.stdout:0/969: creat d1d/d1e/d20/d4d/d83/da0/dd2/da7/dcc/de2/f13a x:0 0 0 2024-05-09T00:07:53.754 INFO:tasks.workunit.client.0.smithi026.stdout:0/970: write d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d96/f109 [1031585,74079] 0 2024-05-09T00:07:53.754 INFO:tasks.workunit.client.0.smithi026.stdout:0/971: read d1d/d33/dbb/f72 [1241902,123804] 0 2024-05-09T00:07:53.755 INFO:tasks.workunit.client.0.smithi026.stdout:0/972: chown d1d/d25/d47/fb9 11 1 2024-05-09T00:07:53.761 INFO:tasks.workunit.client.0.smithi026.stdout:0/973: dread d1d/d25/d47/fb9 [0,4194304] 0 2024-05-09T00:07:53.828 INFO:tasks.workunit.client.0.smithi026.stdout:0/974: mknod d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/d62/d96/d12c/c13b 0 2024-05-09T00:07:53.835 INFO:tasks.workunit.client.0.smithi026.stdout:0/975: mknod d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/d119/c13c 0 2024-05-09T00:07:53.835 INFO:tasks.workunit.client.0.smithi026.stdout:0/976: stat d1d/d33/d64/le6 0 2024-05-09T00:07:53.847 INFO:tasks.workunit.client.0.smithi026.stdout:0/977: dwrite d1d/da4/fb8 [0,4194304] 0 2024-05-09T00:07:53.848 INFO:tasks.workunit.client.0.smithi026.stdout:0/978: fdatasync d1d/d1e/d20/d4d/d83/f12f 0 2024-05-09T00:07:53.848 INFO:tasks.workunit.client.0.smithi026.stdout:0/979: dread - d1d/d33/d64/fa6 zero size 2024-05-09T00:07:53.851 INFO:tasks.workunit.client.0.smithi026.stdout:0/980: mkdir d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/dfe/d13d 0 2024-05-09T00:07:53.867 INFO:tasks.workunit.client.0.smithi026.stdout:0/981: dwrite d1d/f3f [0,4194304] 0 2024-05-09T00:07:53.869 INFO:tasks.workunit.client.0.smithi026.stdout:0/982: creat d1d/d25/d47/f13e x:0 0 0 2024-05-09T00:07:53.869 INFO:tasks.workunit.client.0.smithi026.stdout:0/983: write ff [2582291,106201] 0 2024-05-09T00:07:53.878 INFO:tasks.workunit.client.0.smithi026.stdout:0/984: dread d1d/d1e/d2d/f3b [0,4194304] 0 2024-05-09T00:07:53.881 INFO:tasks.workunit.client.0.smithi026.stdout:0/985: mknod d1d/d1e/d20/d4d/d83/da0/dd2/da7/d102/c13f 0 2024-05-09T00:07:53.882 INFO:tasks.workunit.client.0.smithi026.stdout:0/986: mkdir d1d/d1e/d2d/d10f/d140 0 2024-05-09T00:07:53.883 INFO:tasks.workunit.client.0.smithi026.stdout:0/987: mknod d1d/d25/d47/d11f/c141 0 2024-05-09T00:07:53.883 INFO:tasks.workunit.client.0.smithi026.stdout:0/988: chown d1d/d33/l6a 26421984 1 2024-05-09T00:07:53.884 INFO:tasks.workunit.client.0.smithi026.stdout:0/989: mkdir d1d/d1e/d20/d4d/d83/da0/d104/d142 0 2024-05-09T00:07:53.898 INFO:tasks.workunit.client.0.smithi026.stdout:9/789: sync 2024-05-09T00:07:53.899 INFO:tasks.workunit.client.0.smithi026.stdout:8/799: sync 2024-05-09T00:07:53.899 INFO:tasks.workunit.client.0.smithi026.stdout:6/588: sync 2024-05-09T00:07:53.899 INFO:tasks.workunit.client.0.smithi026.stdout:6/589: stat d15/d1e/d23/d73/d76/fb7 0 2024-05-09T00:07:53.899 INFO:tasks.workunit.client.0.smithi026.stdout:6/590: dread - d15/d1e/d30/d75/f89 zero size 2024-05-09T00:07:53.900 INFO:tasks.workunit.client.0.smithi026.stdout:8/800: getdents de/d6c 0 2024-05-09T00:07:53.902 INFO:tasks.workunit.client.0.smithi026.stdout:6/591: write d15/d62/f64 [7553673,47689] 0 2024-05-09T00:07:53.902 INFO:tasks.workunit.client.0.smithi026.stdout:6/592: fsync d15/f18 0 2024-05-09T00:07:53.902 INFO:tasks.workunit.client.0.smithi026.stdout:6/593: readlink d15/d1e/d23/d73/d8e/l9a 0 2024-05-09T00:07:53.902 INFO:tasks.workunit.client.0.smithi026.stdout:6/594: fdatasync d15/d2b/d33/d55/d5e/f87 0 2024-05-09T00:07:53.902 INFO:tasks.workunit.client.0.smithi026.stdout:6/595: truncate d15/d34/d52/f9d 1237384 0 2024-05-09T00:07:53.903 INFO:tasks.workunit.client.0.smithi026.stdout:0/990: dwrite d1d/d33/d64/fa6 [0,4194304] 0 2024-05-09T00:07:53.904 INFO:tasks.workunit.client.0.smithi026.stdout:9/790: creat d7/d23/f10d x:0 0 0 2024-05-09T00:07:53.904 INFO:tasks.workunit.client.0.smithi026.stdout:9/791: fsync d7/d23/f7b 0 2024-05-09T00:07:53.908 INFO:tasks.workunit.client.0.smithi026.stdout:8/801: creat de/d6c/d31/d4f/f109 x:0 0 0 2024-05-09T00:07:53.912 INFO:tasks.workunit.client.0.smithi026.stdout:6/596: rename d15/d1e/fb3 to d15/d34/d52/d8b/d4d/fc7 0 2024-05-09T00:07:53.921 INFO:tasks.workunit.client.0.smithi026.stdout:0/991: creat d1d/d25/d47/d6e/dc2/f143 x:0 0 0 2024-05-09T00:07:53.923 INFO:tasks.workunit.client.0.smithi026.stdout:9/792: creat d7/d23/d2f/d7d/d87/f10e x:0 0 0 2024-05-09T00:07:53.925 INFO:tasks.workunit.client.0.smithi026.stdout:0/992: creat d1d/d1e/d20/d4d/f144 x:0 0 0 2024-05-09T00:07:53.927 INFO:tasks.workunit.client.0.smithi026.stdout:9/793: mknod d7/d23/d29/d31/d40/d41/d54/d5c/c10f 0 2024-05-09T00:07:53.936 INFO:tasks.workunit.client.0.smithi026.stdout:8/802: dwrite de/d17/fa8 [0,4194304] 0 2024-05-09T00:07:53.938 INFO:tasks.workunit.client.0.smithi026.stdout:8/803: mkdir de/d17/d21/dca/d104/d10a 0 2024-05-09T00:07:53.938 INFO:tasks.workunit.client.0.smithi026.stdout:6/597: dwrite d15/d2b/f42 [0,4194304] 0 2024-05-09T00:07:53.939 INFO:tasks.workunit.client.0.smithi026.stdout:8/804: creat de/d48/d3e/d54/f10b x:0 0 0 2024-05-09T00:07:53.941 INFO:tasks.workunit.client.0.smithi026.stdout:6/598: creat d15/d1e/d3d/fc8 x:0 0 0 2024-05-09T00:07:53.941 INFO:tasks.workunit.client.0.smithi026.stdout:6/599: dread - d15/d1e/d23/d73/fa3 zero size 2024-05-09T00:07:53.941 INFO:tasks.workunit.client.0.smithi026.stdout:6/600: read d15/d34/d52/d74/f80 [729624,117248] 0 2024-05-09T00:07:53.941 INFO:tasks.workunit.client.0.smithi026.stdout:6/601: dread - d15/d2b/d33/d55/d67/d90/fa5 zero size 2024-05-09T00:07:53.941 INFO:tasks.workunit.client.0.smithi026.stdout:8/805: mknod de/d6c/d31/d4f/d87/c10c 0 2024-05-09T00:07:53.942 INFO:tasks.workunit.client.0.smithi026.stdout:6/602: unlink d15/d2b/f7e 0 2024-05-09T00:07:53.944 INFO:tasks.workunit.client.0.smithi026.stdout:8/806: creat de/d6c/d31/d4f/d87/d62/daa/ddb/d91/f10d x:0 0 0 2024-05-09T00:07:53.946 INFO:tasks.workunit.client.0.smithi026.stdout:8/807: creat de/d6c/db5/f10e x:0 0 0 2024-05-09T00:07:53.947 INFO:tasks.workunit.client.0.smithi026.stdout:8/808: creat de/d17/d21/d24/d3b/d3d/f10f x:0 0 0 2024-05-09T00:07:53.949 INFO:tasks.workunit.client.0.smithi026.stdout:8/809: mknod de/d17/d21/d24/c110 0 2024-05-09T00:07:53.951 INFO:tasks.workunit.client.0.smithi026.stdout:8/810: creat de/d6c/d31/d4f/d87/d62/daa/ddb/f111 x:0 0 0 2024-05-09T00:07:53.951 INFO:tasks.workunit.client.0.smithi026.stdout:8/811: dread - de/d17/d21/d24/fc6 zero size 2024-05-09T00:07:53.951 INFO:tasks.workunit.client.0.smithi026.stdout:8/812: truncate de/d17/d21/d6f/f9e 1069645 0 2024-05-09T00:07:53.954 INFO:tasks.workunit.client.0.smithi026.stdout:8/813: link de/d6c/d31/d4f/d87/f77 de/d6c/d31/d4f/df1/dfc/f112 0 2024-05-09T00:07:53.954 INFO:tasks.workunit.client.0.smithi026.stdout:8/814: chown de/d6c/c5e 7375191 1 2024-05-09T00:07:53.954 INFO:tasks.workunit.client.0.smithi026.stdout:8/815: write de/d6c/d31/d4f/d87/d62/daa/ddb/d91/fdd [140572,110733] 0 2024-05-09T00:07:53.967 INFO:tasks.workunit.client.0.smithi026.stdout:0/993: dwrite d1d/d1e/d20/d4d/d83/da0/dd2/f126 [4194304,4194304] 0 2024-05-09T00:07:53.968 INFO:tasks.workunit.client.0.smithi026.stdout:9/794: dwrite d7/d23/d29/d59/d91/fd4 [0,4194304] 0 2024-05-09T00:07:53.968 INFO:tasks.workunit.client.0.smithi026.stdout:0/994: write d1d/d33/dbb/fd7 [1027526,74302] 0 2024-05-09T00:07:53.968 INFO:tasks.workunit.client.0.smithi026.stdout:6/603: dwrite d15/d34/d52/d8b/f40 [4194304,4194304] 0 2024-05-09T00:07:53.972 INFO:tasks.workunit.client.0.smithi026.stdout:0/995: creat d1d/d1e/d20/d4d/d83/da0/dd2/da7/dda/f145 x:0 0 0 2024-05-09T00:07:53.973 INFO:tasks.workunit.client.0.smithi026.stdout:9/795: mknod d7/d23/d29/d31/d40/d41/d54/d5c/c110 0 2024-05-09T00:07:53.977 INFO:tasks.workunit.client.0.smithi026.stdout:6/604: link f11 d15/d2b/d33/d55/d67/d90/fc9 0 2024-05-09T00:07:53.977 INFO:tasks.workunit.client.0.smithi026.stdout:6/605: readlink d15/l50 0 2024-05-09T00:07:53.977 INFO:tasks.workunit.client.0.smithi026.stdout:6/606: stat d15/d1e/d23/d73/fa3 0 2024-05-09T00:07:53.977 INFO:tasks.workunit.client.0.smithi026.stdout:6/607: fdatasync d15/d34/d52/d8b/f91 0 2024-05-09T00:07:53.983 INFO:tasks.workunit.client.0.smithi026.stdout:9/796: dread d7/d23/d2f/f35 [0,4194304] 0 2024-05-09T00:07:53.983 INFO:tasks.workunit.client.0.smithi026.stdout:0/996: mknod d1d/d33/d116/c146 0 2024-05-09T00:07:53.986 INFO:tasks.workunit.client.0.smithi026.stdout:6/608: mknod d15/d41/d9f/cca 0 2024-05-09T00:07:53.987 INFO:tasks.workunit.client.0.smithi026.stdout:9/797: rename d7/d23/d2f/d7d/d87/f10e to d7/d23/d29/d31/d40/f111 0 2024-05-09T00:07:53.990 INFO:tasks.workunit.client.0.smithi026.stdout:0/997: link d1d/d25/d47/d11f/c141 d1d/d33/d64/c147 0 2024-05-09T00:07:53.991 INFO:tasks.workunit.client.0.smithi026.stdout:6/609: symlink d15/d2b/d33/db4/lcb 0 2024-05-09T00:07:53.996 INFO:tasks.workunit.client.0.smithi026.stdout:0/998: symlink d1d/d1e/d20/d4d/d83/da0/d104/l148 0 2024-05-09T00:07:53.998 INFO:tasks.workunit.client.0.smithi026.stdout:6/610: rename d15/d1e/d23/d73/d8e/fbc to d15/d1e/d23/d73/d58/fcc 0 2024-05-09T00:07:54.001 INFO:tasks.workunit.client.0.smithi026.stdout:9/798: dread d7/d23/d2f/d3a/f44 [0,4194304] 0 2024-05-09T00:07:54.001 INFO:tasks.workunit.client.0.smithi026.stdout:6/611: write d15/d1e/d23/d73/f3c [1670069,94465] 0 2024-05-09T00:07:54.002 INFO:tasks.workunit.client.0.smithi026.stdout:9/799: getdents d7/d23/d2f/d7d/db2 0 2024-05-09T00:07:54.002 INFO:tasks.workunit.client.0.smithi026.stdout:6/612: write d15/d2b/d33/d55/d67/dbb/dbf/fc3 [457015,97037] 0 2024-05-09T00:07:54.002 INFO:tasks.workunit.client.0.smithi026.stdout:6/613: fsync d15/d1e/d23/d73/d58/fa1 0 2024-05-09T00:07:54.002 INFO:tasks.workunit.client.0.smithi026.stdout:6/614: fsync d15/d1e/d23/d6f/f97 0 2024-05-09T00:07:54.004 INFO:tasks.workunit.client.0.smithi026.stdout:9/800: unlink d7/d23/d2f/d3a/fba 0 2024-05-09T00:07:54.004 INFO:tasks.workunit.client.0.smithi026.stdout:9/801: fdatasync d7/d26/deb/f10b 0 2024-05-09T00:07:54.004 INFO:tasks.workunit.client.0.smithi026.stdout:9/802: chown d7/d23/d2f/l69 18 1 2024-05-09T00:07:54.005 INFO:tasks.workunit.client.0.smithi026.stdout:2/740: sync 2024-05-09T00:07:54.005 INFO:tasks.workunit.client.0.smithi026.stdout:2/741: stat d14/d22/d55/d6b 0 2024-05-09T00:07:54.005 INFO:tasks.workunit.client.0.smithi026.stdout:5/666: sync 2024-05-09T00:07:54.005 INFO:tasks.workunit.client.0.smithi026.stdout:5/667: chown d2/d8/d6d 0 1 2024-05-09T00:07:54.008 INFO:tasks.workunit.client.0.smithi026.stdout:2/742: link d14/d22/d55/da3/d30/d6a/d5b/f91 d14/d22/d55/da3/d3b/d40/d68/ffa 0 2024-05-09T00:07:54.010 INFO:tasks.workunit.client.0.smithi026.stdout:5/668: creat d2/d8/d31/d63/d9c/dbc/fdf x:0 0 0 2024-05-09T00:07:54.012 INFO:tasks.workunit.client.0.smithi026.stdout:2/743: creat d14/d22/d55/da3/d30/ffb x:0 0 0 2024-05-09T00:07:54.012 INFO:tasks.workunit.client.0.smithi026.stdout:2/744: stat d14/d22/d55/da3/d30/lb7 0 2024-05-09T00:07:54.015 INFO:tasks.workunit.client.0.smithi026.stdout:5/669: rename d2/d8/d31/d63/fa6 to d2/d8/d31/dd8/fe0 0 2024-05-09T00:07:54.015 INFO:tasks.workunit.client.0.smithi026.stdout:5/670: write d2/d5a/fcc [599444,118204] 0 2024-05-09T00:07:54.017 INFO:tasks.workunit.client.0.smithi026.stdout:2/745: mkdir d14/d22/d55/deb/dfc 0 2024-05-09T00:07:54.019 INFO:tasks.workunit.client.0.smithi026.stdout:0/999: dwrite d1d/d1e/d20/d4d/f6f [0,4194304] 0 2024-05-09T00:07:54.019 INFO:tasks.workunit.client.0.smithi026.stdout:2/746: write d14/d22/d55/da3/d30/d6a/d5b/f64 [3705556,54809] 0 2024-05-09T00:07:54.020 INFO:tasks.workunit.client.0.smithi026.stdout:6/615: dwrite d15/d1e/d23/d73/d58/f6d [0,4194304] 0 2024-05-09T00:07:54.020 INFO:tasks.workunit.client.0.smithi026.stdout:6/616: write d15/d1e/d30/f86 [1040664,79346] 0 2024-05-09T00:07:54.045 INFO:tasks.workunit.client.0.smithi026.stdout:5/671: dwrite d2/d8/d2a/d8d/f9f [0,4194304] 0 2024-05-09T00:07:54.048 INFO:tasks.workunit.client.0.smithi026.stdout:5/672: symlink d2/d8/d31/d2e/d79/le1 0 2024-05-09T00:07:54.058 INFO:tasks.workunit.client.0.smithi026.stdout:2/747: dwrite d14/d22/d55/da3/d20/db2/f2d [0,4194304] 0 2024-05-09T00:07:54.058 INFO:tasks.workunit.client.0.smithi026.stdout:6/617: dwrite d15/f8c [0,4194304] 0 2024-05-09T00:07:54.058 INFO:tasks.workunit.client.0.smithi026.stdout:6/618: fdatasync d15/d1e/d23/d73/d58/fcc 0 2024-05-09T00:07:54.059 INFO:tasks.workunit.client.0.smithi026.stdout:2/748: mknod d14/d22/d55/da3/d20/db2/d70/cfd 0 2024-05-09T00:07:54.062 INFO:tasks.workunit.client.0.smithi026.stdout:2/749: creat d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/ffe x:0 0 0 2024-05-09T00:07:54.065 INFO:tasks.workunit.client.0.smithi026.stdout:2/750: link d14/d22/d55/da3/d20/l80 d14/d22/d55/d6b/da5/lff 0 2024-05-09T00:07:54.066 INFO:tasks.workunit.client.0.smithi026.stdout:2/751: stat d14/d22/d55/da3/d30/d6a/l62 0 2024-05-09T00:07:54.068 INFO:tasks.workunit.client.0.smithi026.stdout:5/673: dread d2/f44 [0,4194304] 0 2024-05-09T00:07:54.068 INFO:tasks.workunit.client.0.smithi026.stdout:5/674: fsync d2/d8/d31/d32/d48/db3/fd4 0 2024-05-09T00:07:54.068 INFO:tasks.workunit.client.0.smithi026.stdout:5/675: read - d2/d8/d31/d63/d9c/dbc/fdf zero size 2024-05-09T00:07:54.069 INFO:tasks.workunit.client.0.smithi026.stdout:2/752: getdents d14/d22/d55/da3/d30 0 2024-05-09T00:07:54.070 INFO:tasks.workunit.client.0.smithi026.stdout:5/676: creat d2/d8/d31/d32/fe2 x:0 0 0 2024-05-09T00:07:54.071 INFO:tasks.workunit.client.0.smithi026.stdout:6/619: dwrite d15/d1e/d23/d6f/f97 [0,4194304] 0 2024-05-09T00:07:54.072 INFO:tasks.workunit.client.0.smithi026.stdout:2/753: symlink d14/d22/d55/da3/l100 0 2024-05-09T00:07:54.073 INFO:tasks.workunit.client.0.smithi026.stdout:5/677: link d2/d8/d2a/l2b d2/d8/d2a/le3 0 2024-05-09T00:07:54.075 INFO:tasks.workunit.client.0.smithi026.stdout:6/620: mkdir d15/d1e/d23/d73/d58/dcd 0 2024-05-09T00:07:54.080 INFO:tasks.workunit.client.0.smithi026.stdout:2/754: dread d14/d22/d55/da3/d30/d6a/f81 [0,4194304] 0 2024-05-09T00:07:54.081 INFO:tasks.workunit.client.0.smithi026.stdout:5/678: dread d2/d8/d2a/f4f [0,4194304] 0 2024-05-09T00:07:54.082 INFO:tasks.workunit.client.0.smithi026.stdout:2/755: rmdir d14/d22/d55/da3/d20 39 2024-05-09T00:07:54.083 INFO:tasks.workunit.client.0.smithi026.stdout:5/679: symlink d2/d8/d31/d32/d48/db3/le4 0 2024-05-09T00:07:54.083 INFO:tasks.workunit.client.0.smithi026.stdout:5/680: fsync d2/d8/d2a/d8d/fb9 0 2024-05-09T00:07:54.085 INFO:tasks.workunit.client.0.smithi026.stdout:6/621: dread d15/d1e/d30/f46 [0,4194304] 0 2024-05-09T00:07:54.085 INFO:tasks.workunit.client.0.smithi026.stdout:2/756: mknod d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/c101 0 2024-05-09T00:07:54.086 INFO:tasks.workunit.client.0.smithi026.stdout:5/681: mkdir d2/d5a/d96/de5 0 2024-05-09T00:07:54.086 INFO:tasks.workunit.client.0.smithi026.stdout:5/682: stat d2/d8/l76 0 2024-05-09T00:07:54.087 INFO:tasks.workunit.client.0.smithi026.stdout:2/757: write d14/d22/d55/da3/d30/d6a/f57 [395242,110654] 0 2024-05-09T00:07:54.089 INFO:tasks.workunit.client.0.smithi026.stdout:5/683: rmdir d2/d8/d2a 39 2024-05-09T00:07:54.089 INFO:tasks.workunit.client.0.smithi026.stdout:2/758: getdents d14/d22/d55/da3/d3b/d40/d47 0 2024-05-09T00:07:54.091 INFO:tasks.workunit.client.0.smithi026.stdout:5/684: stat d2/d5a/d96/cc4 0 2024-05-09T00:07:54.092 INFO:tasks.workunit.client.0.smithi026.stdout:2/759: mkdir d14/d102 0 2024-05-09T00:07:54.094 INFO:tasks.workunit.client.0.smithi026.stdout:5/685: creat d2/d8/d2a/fe6 x:0 0 0 2024-05-09T00:07:54.095 INFO:tasks.workunit.client.0.smithi026.stdout:2/760: mkdir d14/d22/d55/da3/d30/d103 0 2024-05-09T00:07:54.095 INFO:tasks.workunit.client.0.smithi026.stdout:2/761: getdents d14/d22/d55/da3/d3b/d40/d47 0 2024-05-09T00:07:54.099 INFO:tasks.workunit.client.0.smithi026.stdout:2/762: rename d14/d22/d55/da3/d17/lc9 to d14/d22/d55/da3/d20/d41/d51/dc5/l104 0 2024-05-09T00:07:54.100 INFO:tasks.workunit.client.0.smithi026.stdout:6/622: dwrite d15/f8c [0,4194304] 0 2024-05-09T00:07:54.100 INFO:tasks.workunit.client.0.smithi026.stdout:6/623: chown d15/d2b/d33/d55/d67 1 1 2024-05-09T00:07:54.100 INFO:tasks.workunit.client.0.smithi026.stdout:6/624: fsync d15/d1e/d23/d73/fa3 0 2024-05-09T00:07:54.104 INFO:tasks.workunit.client.0.smithi026.stdout:6/625: mknod d15/d2b/d33/d55/d67/dbb/dbf/cce 0 2024-05-09T00:07:54.104 INFO:tasks.workunit.client.0.smithi026.stdout:6/626: truncate d15/f77 1257812 0 2024-05-09T00:07:54.105 INFO:tasks.workunit.client.0.smithi026.stdout:6/627: link d15/d34/d52/d8b/fac d15/d2b/d33/d7d/fcf 0 2024-05-09T00:07:54.108 INFO:tasks.workunit.client.0.smithi026.stdout:5/686: dwrite d2/d8/d31/f12 [0,4194304] 0 2024-05-09T00:07:54.108 INFO:tasks.workunit.client.0.smithi026.stdout:5/687: chown d2/d8/d2a/d8d/fdb 245 1 2024-05-09T00:07:54.108 INFO:tasks.workunit.client.0.smithi026.stdout:5/688: dread - d2/d8/d31/d32/fe2 zero size 2024-05-09T00:07:54.111 INFO:tasks.workunit.client.0.smithi026.stdout:6/628: rename d15/d41/d9f to d15/d34/d52/d74/dd0 0 2024-05-09T00:07:54.113 INFO:tasks.workunit.client.0.smithi026.stdout:6/629: rmdir d15/d2b/d33/d55/d5e 39 2024-05-09T00:07:54.115 INFO:tasks.workunit.client.0.smithi026.stdout:6/630: rename d15/d1e/d23/lc4 to d15/d1e/d23/d73/d58/d5c/ld1 0 2024-05-09T00:07:54.122 INFO:tasks.workunit.client.0.smithi026.stdout:6/631: dread d15/d34/f49 [0,4194304] 0 2024-05-09T00:07:54.125 INFO:tasks.workunit.client.0.smithi026.stdout:6/632: rename d15/d2b/d33/d55/d5e to d15/d2b/d33/d55/d67/dd2 0 2024-05-09T00:07:54.125 INFO:tasks.workunit.client.0.smithi026.stdout:6/633: stat d15/d34/d52/d8b/fac 0 2024-05-09T00:07:54.125 INFO:tasks.workunit.client.0.smithi026.stdout:6/634: chown ce 21961 1 2024-05-09T00:07:54.126 INFO:tasks.workunit.client.0.smithi026.stdout:6/635: rename d15/d1e/d23/d73/d58/f6d to d15/d1e/d30/fd3 0 2024-05-09T00:07:54.132 INFO:tasks.workunit.client.0.smithi026.stdout:6/636: symlink d15/d1e/d23/d73/d8e/ld4 0 2024-05-09T00:07:54.133 INFO:tasks.workunit.client.0.smithi026.stdout:5/689: dwrite d2/d8/d31/d4b/fd1 [0,4194304] 0 2024-05-09T00:07:54.133 INFO:tasks.workunit.client.0.smithi026.stdout:6/637: write f11 [3591390,55944] 0 2024-05-09T00:07:54.135 INFO:tasks.workunit.client.0.smithi026.stdout:6/638: write d15/f1f [36873,71980] 0 2024-05-09T00:07:54.144 INFO:tasks.workunit.client.0.smithi026.stdout:6/639: dread d15/d34/d52/d8b/f40 [4194304,4194304] 0 2024-05-09T00:07:54.145 INFO:tasks.workunit.client.0.smithi026.stdout:6/640: creat d15/d41/fd5 x:0 0 0 2024-05-09T00:07:54.145 INFO:tasks.workunit.client.0.smithi026.stdout:6/641: truncate d15/d1e/d30/fd3 4793347 0 2024-05-09T00:07:54.148 INFO:tasks.workunit.client.0.smithi026.stdout:6/642: link d15/d34/d52/d8b/fac d15/d1e/d23/d73/d76/fd6 0 2024-05-09T00:07:54.148 INFO:tasks.workunit.client.0.smithi026.stdout:6/643: creat d15/d1e/d23/d73/d76/fd7 x:0 0 0 2024-05-09T00:07:54.153 INFO:tasks.workunit.client.0.smithi026.stdout:5/690: dwrite d2/d8/d2a/f58 [0,4194304] 0 2024-05-09T00:07:54.155 INFO:tasks.workunit.client.0.smithi026.stdout:5/691: creat d2/d5a/fe7 x:0 0 0 2024-05-09T00:07:54.156 INFO:tasks.workunit.client.0.smithi026.stdout:5/692: write d2/d8/d31/f30 [4059921,117631] 0 2024-05-09T00:07:54.156 INFO:tasks.workunit.client.0.smithi026.stdout:5/693: fsync d2/d8/d31/fc1 0 2024-05-09T00:07:54.169 INFO:tasks.workunit.client.0.smithi026.stdout:5/694: mkdir d2/d5a/de8 0 2024-05-09T00:07:54.172 INFO:tasks.workunit.client.0.smithi026.stdout:5/695: creat d2/d8/d31/dd8/fe9 x:0 0 0 2024-05-09T00:07:54.173 INFO:tasks.workunit.client.0.smithi026.stdout:5/696: truncate d2/d8/d6d/f7d 948973 0 2024-05-09T00:07:54.173 INFO:tasks.workunit.client.0.smithi026.stdout:5/697: read - d2/d5a/d96/f8e zero size 2024-05-09T00:07:54.183 INFO:tasks.workunit.client.0.smithi026.stdout:3/615: sync 2024-05-09T00:07:54.183 INFO:tasks.workunit.client.0.smithi026.stdout:1/818: sync 2024-05-09T00:07:54.184 INFO:tasks.workunit.client.0.smithi026.stdout:4/773: sync 2024-05-09T00:07:54.184 INFO:tasks.workunit.client.0.smithi026.stdout:1/819: read - d5/d16/d60/f102 zero size 2024-05-09T00:07:54.184 INFO:tasks.workunit.client.0.smithi026.stdout:1/820: fdatasync d5/d16/d60/d66/f76 0 2024-05-09T00:07:54.185 INFO:tasks.workunit.client.0.smithi026.stdout:4/774: write d0/d12/da2/d97/d43/d58/f6a [333751,48564] 0 2024-05-09T00:07:54.185 INFO:tasks.workunit.client.0.smithi026.stdout:3/616: unlink d5/d1e/d3e/f86 0 2024-05-09T00:07:54.186 INFO:tasks.workunit.client.0.smithi026.stdout:4/775: write d0/d12/da2/d97/d43/d49/fdf [181377,58238] 0 2024-05-09T00:07:54.186 INFO:tasks.workunit.client.0.smithi026.stdout:4/776: stat d0/d12/d64/dac/dd3/fe9 0 2024-05-09T00:07:54.186 INFO:tasks.workunit.client.0.smithi026.stdout:4/777: fsync d0/d12/da2/d97/d43/d49/fb7 0 2024-05-09T00:07:54.186 INFO:tasks.workunit.client.0.smithi026.stdout:1/821: creat d5/db/d1d/f117 x:0 0 0 2024-05-09T00:07:54.187 INFO:tasks.workunit.client.0.smithi026.stdout:1/822: truncate d5/db/f5d 2641717 0 2024-05-09T00:07:54.188 INFO:tasks.workunit.client.0.smithi026.stdout:3/617: rename d5/d9/d4a/d5f/d6f/l8f to d5/d9/dc/d28/d63/lce 0 2024-05-09T00:07:54.188 INFO:tasks.workunit.client.0.smithi026.stdout:7/849: sync 2024-05-09T00:07:54.193 INFO:tasks.workunit.client.0.smithi026.stdout:4/778: unlink d0/d12/da2/d97/d43/d49/c59 0 2024-05-09T00:07:54.195 INFO:tasks.workunit.client.0.smithi026.stdout:1/823: creat d5/dd/d1f/d39/d47/f118 x:0 0 0 2024-05-09T00:07:54.195 INFO:tasks.workunit.client.0.smithi026.stdout:1/824: fsync d5/dd/d17/d7b/f9c 0 2024-05-09T00:07:54.195 INFO:tasks.workunit.client.0.smithi026.stdout:1/825: write d5/dd/d17/d7b/de1/fee [693754,31936] 0 2024-05-09T00:07:54.196 INFO:tasks.workunit.client.0.smithi026.stdout:7/850: mknod d8/d2e/d84/db4/dbc/d1e/d8a/d120/c124 0 2024-05-09T00:07:54.198 INFO:tasks.workunit.client.0.smithi026.stdout:4/779: symlink d0/d12/d34/l105 0 2024-05-09T00:07:54.199 INFO:tasks.workunit.client.0.smithi026.stdout:1/826: truncate d5/db/d108/d103/de0/fd8 441126 0 2024-05-09T00:07:54.202 INFO:tasks.workunit.client.0.smithi026.stdout:5/698: dwrite d2/d8/d31/d32/d5c/f67 [0,4194304] 0 2024-05-09T00:07:54.203 INFO:tasks.workunit.client.0.smithi026.stdout:3/618: dwrite d5/d1e/d3e/f68 [0,4194304] 0 2024-05-09T00:07:54.204 INFO:tasks.workunit.client.0.smithi026.stdout:7/851: rename d8/d1b/l7a to d8/d5c/d9a/d9f/l125 0 2024-05-09T00:07:54.206 INFO:tasks.workunit.client.0.smithi026.stdout:4/780: mkdir d0/d12/da2/d97/d43/d49/de7/dfc/d106 0 2024-05-09T00:07:54.211 INFO:tasks.workunit.client.0.smithi026.stdout:1/827: creat d5/db/d108/d103/db1/dc2/f119 x:0 0 0 2024-05-09T00:07:54.211 INFO:tasks.workunit.client.0.smithi026.stdout:1/828: write d5/dd/d17/fbe [57446,58762] 0 2024-05-09T00:07:54.212 INFO:tasks.workunit.client.0.smithi026.stdout:1/829: write d5/db/ffc [691170,51823] 0 2024-05-09T00:07:54.212 INFO:tasks.workunit.client.0.smithi026.stdout:5/699: symlink d2/d8/lea 0 2024-05-09T00:07:54.215 INFO:tasks.workunit.client.0.smithi026.stdout:3/619: mknod d5/d9/d49/ccf 0 2024-05-09T00:07:54.218 INFO:tasks.workunit.client.0.smithi026.stdout:4/781: creat d0/d12/da2/d97/d43/d58/db3/f107 x:0 0 0 2024-05-09T00:07:54.220 INFO:tasks.workunit.client.0.smithi026.stdout:1/830: unlink d5/dd/c6e 0 2024-05-09T00:07:54.220 INFO:tasks.workunit.client.0.smithi026.stdout:1/831: chown d5/dd/d1f/faf 0 1 2024-05-09T00:07:54.225 INFO:tasks.workunit.client.0.smithi026.stdout:5/700: symlink d2/d8/d31/dd8/leb 0 2024-05-09T00:07:54.225 INFO:tasks.workunit.client.0.smithi026.stdout:5/701: write d2/d5a/d96/f93 [841213,123738] 0 2024-05-09T00:07:54.226 INFO:tasks.workunit.client.0.smithi026.stdout:3/620: creat d5/d9/d4a/d5f/d6f/d75/fd0 x:0 0 0 2024-05-09T00:07:54.229 INFO:tasks.workunit.client.0.smithi026.stdout:1/832: symlink d5/dd/d17/d116/l11a 0 2024-05-09T00:07:54.232 INFO:tasks.workunit.client.0.smithi026.stdout:5/702: rename d2/d8/d31/d32/d48/db3/le4 to d2/d8/d31/d32/d48/db3/lec 0 2024-05-09T00:07:54.234 INFO:tasks.workunit.client.0.smithi026.stdout:7/852: rename d8/d5c to d8/d2e/d126 0 2024-05-09T00:07:54.234 INFO:tasks.workunit.client.0.smithi026.stdout:7/853: write d8/d2e/d126/f99 [218317,91747] 0 2024-05-09T00:07:54.234 INFO:tasks.workunit.client.0.smithi026.stdout:7/854: stat d8/d2e/d84/db4/dbc/d1e/d8a/d120 0 2024-05-09T00:07:54.234 INFO:tasks.workunit.client.0.smithi026.stdout:3/621: mknod d5/d9/dc/d28/d63/d81/cd1 0 2024-05-09T00:07:54.235 INFO:tasks.workunit.client.0.smithi026.stdout:4/782: dwrite d0/d12/da2/d97/d43/d58/f7e [0,4194304] 0 2024-05-09T00:07:54.237 INFO:tasks.workunit.client.0.smithi026.stdout:1/833: creat d5/dd/d17/d9f/da5/f11b x:0 0 0 2024-05-09T00:07:54.239 INFO:tasks.workunit.client.0.smithi026.stdout:5/703: creat d2/d8/d31/d2e/fed x:0 0 0 2024-05-09T00:07:54.243 INFO:tasks.workunit.client.0.smithi026.stdout:3/622: creat d5/d9/dc/d5b/fd2 x:0 0 0 2024-05-09T00:07:54.251 INFO:tasks.workunit.client.0.smithi026.stdout:4/783: creat d0/d12/da2/d97/d43/d49/de7/f108 x:0 0 0 2024-05-09T00:07:54.253 INFO:tasks.workunit.client.0.smithi026.stdout:1/834: creat d5/dd/d17/d7b/f11c x:0 0 0 2024-05-09T00:07:54.256 INFO:tasks.workunit.client.0.smithi026.stdout:5/704: dwrite d2/d8/d31/d4b/fd1 [0,4194304] 0 2024-05-09T00:07:54.260 INFO:tasks.workunit.client.0.smithi026.stdout:7/855: dwrite d8/d2e/f5d [0,4194304] 0 2024-05-09T00:07:54.262 INFO:tasks.workunit.client.0.smithi026.stdout:3/623: dwrite d5/d9/d4a/d5f/d6f/fb6 [0,4194304] 0 2024-05-09T00:07:54.267 INFO:tasks.workunit.client.0.smithi026.stdout:3/624: read d5/d9/dc/d28/f35 [869661,25007] 0 2024-05-09T00:07:54.267 INFO:tasks.workunit.client.0.smithi026.stdout:3/625: chown d5/d9/dc/c27 975442 1 2024-05-09T00:07:54.271 INFO:tasks.workunit.client.0.smithi026.stdout:4/784: creat d0/d12/da2/d97/dbf/dd1/dfb/f109 x:0 0 0 2024-05-09T00:07:54.272 INFO:tasks.workunit.client.0.smithi026.stdout:1/835: unlink d5/dd/l1a 0 2024-05-09T00:07:54.273 INFO:tasks.workunit.client.0.smithi026.stdout:1/836: readlink d5/d16/d60/d66/d97/l33 0 2024-05-09T00:07:54.277 INFO:tasks.workunit.client.0.smithi026.stdout:7/856: dread d8/d1b/f37 [0,4194304] 0 2024-05-09T00:07:54.280 INFO:tasks.workunit.client.0.smithi026.stdout:3/626: truncate d5/d9/f2a 1166648 0 2024-05-09T00:07:54.280 INFO:tasks.workunit.client.0.smithi026.stdout:3/627: dread - d5/d9/d4a/d5f/f8e zero size 2024-05-09T00:07:54.282 INFO:tasks.workunit.client.0.smithi026.stdout:5/705: dwrite d2/d8/d31/d63/d9c/dbc/fcf [0,4194304] 0 2024-05-09T00:07:54.309 INFO:tasks.workunit.client.0.smithi026.stdout:7/857: symlink d8/d2e/d84/db4/dbc/d22/da1/l127 0 2024-05-09T00:07:54.311 INFO:tasks.workunit.client.0.smithi026.stdout:3/628: mknod d5/d1e/cd3 0 2024-05-09T00:07:54.313 INFO:tasks.workunit.client.0.smithi026.stdout:1/837: dwrite d5/dd/fe [0,4194304] 0 2024-05-09T00:07:54.314 INFO:tasks.workunit.client.0.smithi026.stdout:5/706: creat d2/d8/d31/d32/fee x:0 0 0 2024-05-09T00:07:54.322 INFO:tasks.workunit.client.0.smithi026.stdout:7/858: write d8/d2e/d84/db4/dbc/d1e/d3d/f48 [1799407,47512] 0 2024-05-09T00:07:54.322 INFO:tasks.workunit.client.0.smithi026.stdout:7/859: stat d8/c4c 0 2024-05-09T00:07:54.322 INFO:tasks.workunit.client.0.smithi026.stdout:3/629: mkdir d5/dd4 0 2024-05-09T00:07:54.327 INFO:tasks.workunit.client.0.smithi026.stdout:7/860: creat d8/d1b/dfe/f128 x:0 0 0 2024-05-09T00:07:54.330 INFO:tasks.workunit.client.0.smithi026.stdout:7/861: getdents d8/d2e/d126/d9a/df4 0 2024-05-09T00:07:54.330 INFO:tasks.workunit.client.0.smithi026.stdout:7/862: chown d8/d2e/d84/db4/dbc/d1e/d3d/ff8 4248 1 2024-05-09T00:07:54.330 INFO:tasks.workunit.client.0.smithi026.stdout:7/863: readlink d8/d2e/d126/l8c 0 2024-05-09T00:07:54.330 INFO:tasks.workunit.client.0.smithi026.stdout:7/864: write d8/d2e/d84/db4/dbc/d1e/d3d/f48 [2228289,39910] 0 2024-05-09T00:07:54.334 INFO:tasks.workunit.client.0.smithi026.stdout:7/865: mknod d8/d2e/d84/db4/dbc/d1e/d3d/c129 0 2024-05-09T00:07:54.336 INFO:tasks.workunit.client.0.smithi026.stdout:7/866: mkdir d8/d2e/d84/db4/dbc/d1e/d3d/d6b/d12a 0 2024-05-09T00:07:54.337 INFO:tasks.workunit.client.0.smithi026.stdout:5/707: dread d2/d8/d31/d2e/f9b [0,4194304] 0 2024-05-09T00:07:54.337 INFO:tasks.workunit.client.0.smithi026.stdout:1/838: dwrite d5/dd/d1f/d39/d47/f59 [0,4194304] 0 2024-05-09T00:07:54.337 INFO:tasks.workunit.client.0.smithi026.stdout:5/708: chown d2/d8/d31/d2e/d79 384549 1 2024-05-09T00:07:54.340 INFO:tasks.workunit.client.0.smithi026.stdout:1/839: creat d5/dd/d1f/d39/d47/f11d x:0 0 0 2024-05-09T00:07:54.340 INFO:tasks.workunit.client.0.smithi026.stdout:1/840: read d5/db/f62 [3798770,82677] 0 2024-05-09T00:07:54.340 INFO:tasks.workunit.client.0.smithi026.stdout:1/841: chown d5/dd/d17/d7b/de1/fee 508890517 1 2024-05-09T00:07:54.340 INFO:tasks.workunit.client.0.smithi026.stdout:1/842: readlink d5/db/l6c 0 2024-05-09T00:07:54.341 INFO:tasks.workunit.client.0.smithi026.stdout:5/709: rename d2/d5a/d96/cc4 to d2/d8/d31/d32/d5c/cef 0 2024-05-09T00:07:54.341 INFO:tasks.workunit.client.0.smithi026.stdout:5/710: dread - d2/d8/d31/d24/f74 zero size 2024-05-09T00:07:54.341 INFO:tasks.workunit.client.0.smithi026.stdout:3/630: dwrite d5/db1/fca [0,4194304] 0 2024-05-09T00:07:54.343 INFO:tasks.workunit.client.0.smithi026.stdout:9/803: sync 2024-05-09T00:07:54.343 INFO:tasks.workunit.client.0.smithi026.stdout:6/644: sync 2024-05-09T00:07:54.343 INFO:tasks.workunit.client.0.smithi026.stdout:2/763: sync 2024-05-09T00:07:54.343 INFO:tasks.workunit.client.0.smithi026.stdout:8/816: sync 2024-05-09T00:07:54.344 INFO:tasks.workunit.client.0.smithi026.stdout:9/804: write d7/d23/d29/d2e/f6f [1572403,81006] 0 2024-05-09T00:07:54.344 INFO:tasks.workunit.client.0.smithi026.stdout:8/817: readlink de/d48/lf4 0 2024-05-09T00:07:54.345 INFO:tasks.workunit.client.0.smithi026.stdout:1/843: write d5/dd/d1f/fbb [1741014,127018] 0 2024-05-09T00:07:54.345 INFO:tasks.workunit.client.0.smithi026.stdout:9/805: read d7/d23/d29/d31/d40/d41/d54/dc5/ffa [1395018,26926] 0 2024-05-09T00:07:54.346 INFO:tasks.workunit.client.0.smithi026.stdout:5/711: mkdir d2/d8/d31/d32/da2/df0 0 2024-05-09T00:07:54.349 INFO:tasks.workunit.client.0.smithi026.stdout:3/631: unlink d5/d9/f16 0 2024-05-09T00:07:54.351 INFO:tasks.workunit.client.0.smithi026.stdout:6/645: rename d15/d41/c84 to d15/d2b/d33/db4/cd8 0 2024-05-09T00:07:54.352 INFO:tasks.workunit.client.0.smithi026.stdout:8/818: creat de/d6c/d31/d4f/d87/d62/daa/ddb/d91/f113 x:0 0 0 2024-05-09T00:07:54.356 INFO:tasks.workunit.client.0.smithi026.stdout:7/867: dwrite d8/d2e/d84/db4/dbc/d1e/f93 [0,4194304] 0 2024-05-09T00:07:54.356 INFO:tasks.workunit.client.0.smithi026.stdout:1/844: creat d5/dd/d17/d9f/dc6/de2/d10e/f11e x:0 0 0 2024-05-09T00:07:54.358 INFO:tasks.workunit.client.0.smithi026.stdout:1/845: write d5/db/f62 [2326325,7708] 0 2024-05-09T00:07:54.358 INFO:tasks.workunit.client.0.smithi026.stdout:1/846: stat d5/dd/ddd/fe3 0 2024-05-09T00:07:54.358 INFO:tasks.workunit.client.0.smithi026.stdout:9/806: mkdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/d112 0 2024-05-09T00:07:54.359 INFO:tasks.workunit.client.0.smithi026.stdout:3/632: mknod d5/d9/d71/cd5 0 2024-05-09T00:07:54.362 INFO:tasks.workunit.client.0.smithi026.stdout:5/712: rename d2/d8/d2a/fcd to d2/d8/ff1 0 2024-05-09T00:07:54.365 INFO:tasks.workunit.client.0.smithi026.stdout:8/819: mkdir de/d6c/d31/d4f/d87/d62/daa/ddb/d114 0 2024-05-09T00:07:54.368 INFO:tasks.workunit.client.0.smithi026.stdout:7/868: unlink d8/d2e/d126/d9a/d9f/d104/d116/fc5 0 2024-05-09T00:07:54.372 INFO:tasks.workunit.client.0.smithi026.stdout:1/847: creat d5/d16/dd5/de4/f11f x:0 0 0 2024-05-09T00:07:54.372 INFO:tasks.workunit.client.0.smithi026.stdout:1/848: chown d5/d16/f18 441 1 2024-05-09T00:07:54.372 INFO:tasks.workunit.client.0.smithi026.stdout:3/633: symlink d5/d9/dc/d5b/da5/db3/ld6 0 2024-05-09T00:07:54.373 INFO:tasks.workunit.client.0.smithi026.stdout:3/634: fdatasync d5/d9/dc/d28/f4c 0 2024-05-09T00:07:54.374 INFO:tasks.workunit.client.0.smithi026.stdout:5/713: rmdir d2/d8/d31/d32/d48/daa/db4 39 2024-05-09T00:07:54.375 INFO:tasks.workunit.client.0.smithi026.stdout:5/714: write d2/f41 [6632627,58113] 0 2024-05-09T00:07:54.378 INFO:tasks.workunit.client.0.smithi026.stdout:2/764: dwrite d14/d22/fe6 [0,4194304] 0 2024-05-09T00:07:54.378 INFO:tasks.workunit.client.0.smithi026.stdout:2/765: readlink d14/d22/d55/da3/l19 0 2024-05-09T00:07:54.378 INFO:tasks.workunit.client.0.smithi026.stdout:2/766: fsync d14/d22/d55/da3/d20/fac 0 2024-05-09T00:07:54.378 INFO:tasks.workunit.client.0.smithi026.stdout:7/869: unlink d8/d2e/d84/db4/dbc/d1e/f32 0 2024-05-09T00:07:54.378 INFO:tasks.workunit.client.0.smithi026.stdout:6/646: dwrite d15/d1e/d23/d73/d58/d5c/fad [0,4194304] 0 2024-05-09T00:07:54.380 INFO:tasks.workunit.client.0.smithi026.stdout:9/807: dwrite d7/d23/f10d [0,4194304] 0 2024-05-09T00:07:54.380 INFO:tasks.workunit.client.0.smithi026.stdout:9/808: chown d7/d23/f33 14147922 1 2024-05-09T00:07:54.380 INFO:tasks.workunit.client.0.smithi026.stdout:3/635: truncate d5/d9/dc/d28/f4c 2129351 0 2024-05-09T00:07:54.381 INFO:tasks.workunit.client.0.smithi026.stdout:8/820: dread de/d17/d21/d6f/f93 [0,4194304] 0 2024-05-09T00:07:54.381 INFO:tasks.workunit.client.0.smithi026.stdout:8/821: fsync de/d6c/d31/d4f/dbb/fd4 0 2024-05-09T00:07:54.385 INFO:tasks.workunit.client.0.smithi026.stdout:5/715: symlink d2/d8/d31/d32/d48/daa/db4/lf2 0 2024-05-09T00:07:54.385 INFO:tasks.workunit.client.0.smithi026.stdout:5/716: readlink d2/d5a/l7c 0 2024-05-09T00:07:54.389 INFO:tasks.workunit.client.0.smithi026.stdout:2/767: symlink d14/d22/d55/da3/d20/ddb/l105 0 2024-05-09T00:07:54.393 INFO:tasks.workunit.client.0.smithi026.stdout:6/647: creat d15/fd9 x:0 0 0 2024-05-09T00:07:54.395 INFO:tasks.workunit.client.0.smithi026.stdout:1/849: rename d5/dd/d17/d73/c36 to d5/dd/ddd/c120 0 2024-05-09T00:07:54.408 INFO:tasks.workunit.client.0.smithi026.stdout:8/822: dwrite de/d17/d21/d24/f7e [0,4194304] 0 2024-05-09T00:07:54.408 INFO:tasks.workunit.client.0.smithi026.stdout:7/870: dwrite d8/ff [0,4194304] 0 2024-05-09T00:07:54.408 INFO:tasks.workunit.client.0.smithi026.stdout:2/768: dread d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fb9 [0,4194304] 0 2024-05-09T00:07:54.411 INFO:tasks.workunit.client.0.smithi026.stdout:6/648: truncate d15/d34/d52/d8b/f40 1838572 0 2024-05-09T00:07:54.413 INFO:tasks.workunit.client.0.smithi026.stdout:1/850: dwrite d5/db/d108/d103/db1/dc2/f119 [0,4194304] 0 2024-05-09T00:07:54.414 INFO:tasks.workunit.client.0.smithi026.stdout:1/851: fsync d5/d16/f18 0 2024-05-09T00:07:54.414 INFO:tasks.workunit.client.0.smithi026.stdout:5/717: dwrite d2/d8/d31/d63/f83 [0,4194304] 0 2024-05-09T00:07:54.416 INFO:tasks.workunit.client.0.smithi026.stdout:5/718: dread d2/d8/d6d/fab [0,4194304] 0 2024-05-09T00:07:54.418 INFO:tasks.workunit.client.0.smithi026.stdout:8/823: mkdir de/d48/d3e/d54/d115 0 2024-05-09T00:07:54.419 INFO:tasks.workunit.client.0.smithi026.stdout:7/871: mkdir d8/d2e/d84/db4/dbc/d12b 0 2024-05-09T00:07:54.421 INFO:tasks.workunit.client.0.smithi026.stdout:2/769: creat d14/d22/d55/da3/d20/d41/d51/d82/daa/f106 x:0 0 0 2024-05-09T00:07:54.422 INFO:tasks.workunit.client.0.smithi026.stdout:2/770: write d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fc2 [3650980,37675] 0 2024-05-09T00:07:54.424 INFO:tasks.workunit.client.0.smithi026.stdout:6/649: rename d15/l19 to d15/d1e/d23/d73/d58/lda 0 2024-05-09T00:07:54.424 INFO:tasks.workunit.client.0.smithi026.stdout:7/872: dread d8/d2e/d126/fbd [0,4194304] 0 2024-05-09T00:07:54.424 INFO:tasks.workunit.client.0.smithi026.stdout:7/873: chown d8/d2e/d84/db4/dbc/d1e/d3d/d6b/faa 45 1 2024-05-09T00:07:54.432 INFO:tasks.workunit.client.0.smithi026.stdout:1/852: mkdir d5/dd/d121 0 2024-05-09T00:07:54.436 INFO:tasks.workunit.client.0.smithi026.stdout:5/719: dwrite d2/d8/d31/fcb [0,4194304] 0 2024-05-09T00:07:54.436 INFO:tasks.workunit.client.0.smithi026.stdout:5/720: dread - d2/d8/d2a/d8d/fdb zero size 2024-05-09T00:07:54.451 INFO:tasks.workunit.client.0.smithi026.stdout:2/771: creat d14/d22/d55/da3/d30/dc3/df7/f107 x:0 0 0 2024-05-09T00:07:54.454 INFO:tasks.workunit.client.0.smithi026.stdout:9/809: dwrite d7/d23/d2f/d3a/f44 [0,4194304] 0 2024-05-09T00:07:54.456 INFO:tasks.workunit.client.0.smithi026.stdout:8/824: rename de/d17/d7d to de/dd9/d116 0 2024-05-09T00:07:54.457 INFO:tasks.workunit.client.0.smithi026.stdout:6/650: mkdir d15/d34/d52/d8b/ddb 0 2024-05-09T00:07:54.459 INFO:tasks.workunit.client.0.smithi026.stdout:1/853: dwrite d5/f7 [0,4194304] 0 2024-05-09T00:07:54.462 INFO:tasks.workunit.client.0.smithi026.stdout:7/874: symlink d8/d2e/d126/d9a/d9f/d104/l12c 0 2024-05-09T00:07:54.463 INFO:tasks.workunit.client.0.smithi026.stdout:7/875: write d8/d2e/fea [134513,16567] 0 2024-05-09T00:07:54.463 INFO:tasks.workunit.client.0.smithi026.stdout:7/876: fsync d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/fa8 0 2024-05-09T00:07:54.467 INFO:tasks.workunit.client.0.smithi026.stdout:7/877: dread d8/d1b/d89/fd6 [0,4194304] 0 2024-05-09T00:07:54.470 INFO:tasks.workunit.client.0.smithi026.stdout:2/772: dwrite fd [4194304,4194304] 0 2024-05-09T00:07:54.470 INFO:tasks.workunit.client.0.smithi026.stdout:5/721: symlink d2/d8/d2a/d8d/lf3 0 2024-05-09T00:07:54.471 INFO:tasks.workunit.client.0.smithi026.stdout:8/825: dwrite de/d17/d21/d24/d5b/f103 [4194304,4194304] 0 2024-05-09T00:07:54.473 INFO:tasks.workunit.client.0.smithi026.stdout:4/785: sync 2024-05-09T00:07:54.473 INFO:tasks.workunit.client.0.smithi026.stdout:9/810: rmdir d7/d23/d29/d31/d40/d41/d54/d5c 39 2024-05-09T00:07:54.475 INFO:tasks.workunit.client.0.smithi026.stdout:6/651: stat c14 0 2024-05-09T00:07:54.477 INFO:tasks.workunit.client.0.smithi026.stdout:1/854: rename d5/dd/d1f/d39/d47/f93 to d5/dd/ddd/f122 0 2024-05-09T00:07:54.477 INFO:tasks.workunit.client.0.smithi026.stdout:1/855: read - d5/dd/d1f/faf zero size 2024-05-09T00:07:54.477 INFO:tasks.workunit.client.0.smithi026.stdout:1/856: dread - d5/d16/d60/f102 zero size 2024-05-09T00:07:54.480 INFO:tasks.workunit.client.0.smithi026.stdout:8/826: dread de/d48/d3e/f50 [0,4194304] 0 2024-05-09T00:07:54.482 INFO:tasks.workunit.client.0.smithi026.stdout:7/878: mkdir d8/d1b/d89/dc1/db0/d12d 0 2024-05-09T00:07:54.487 INFO:tasks.workunit.client.0.smithi026.stdout:2/773: mknod d14/d22/d55/da3/d20/d41/d51/dc5/c108 0 2024-05-09T00:07:54.492 INFO:tasks.workunit.client.0.smithi026.stdout:5/722: dwrite d2/d8/d31/fc7 [0,4194304] 0 2024-05-09T00:07:54.492 INFO:tasks.workunit.client.0.smithi026.stdout:4/786: creat d0/d12/da2/d97/d43/d49/de7/dfc/f10a x:0 0 0 2024-05-09T00:07:54.493 INFO:tasks.workunit.client.0.smithi026.stdout:8/827: dread de/d48/f52 [0,4194304] 0 2024-05-09T00:07:54.495 INFO:tasks.workunit.client.0.smithi026.stdout:9/811: creat d7/d23/d2f/d50/f113 x:0 0 0 2024-05-09T00:07:54.496 INFO:tasks.workunit.client.0.smithi026.stdout:6/652: getdents d15/d2b 0 2024-05-09T00:07:54.501 INFO:tasks.workunit.client.0.smithi026.stdout:7/879: unlink d8/d2e/d84/db4/dbc/d1e/f93 0 2024-05-09T00:07:54.501 INFO:tasks.workunit.client.0.smithi026.stdout:7/880: dread - d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/fc2 zero size 2024-05-09T00:07:54.503 INFO:tasks.workunit.client.0.smithi026.stdout:2/774: dwrite d14/d22/d55/d6b/d93/fe5 [0,4194304] 0 2024-05-09T00:07:54.503 INFO:tasks.workunit.client.0.smithi026.stdout:2/775: chown d14/d22/d55/da3/d20/d41/d51/d82/dd2/ff0 213 1 2024-05-09T00:07:54.506 INFO:tasks.workunit.client.0.smithi026.stdout:5/723: rename d2/fdc to d2/d8/d31/d2e/ff4 0 2024-05-09T00:07:54.507 INFO:tasks.workunit.client.0.smithi026.stdout:4/787: fsync d0/d83/f9e 0 2024-05-09T00:07:54.510 INFO:tasks.workunit.client.0.smithi026.stdout:8/828: truncate de/d48/f7c 4984561 0 2024-05-09T00:07:54.512 INFO:tasks.workunit.client.0.smithi026.stdout:9/812: rmdir d7/d23/d29/d31/d40/d41/d54/d5c/d103 0 2024-05-09T00:07:54.513 INFO:tasks.workunit.client.0.smithi026.stdout:7/881: mknod d8/d2e/d84/db4/dbc/d22/d29/d111/c12e 0 2024-05-09T00:07:54.513 INFO:tasks.workunit.client.0.smithi026.stdout:7/882: truncate d8/d2e/d84/db4/dbc/d22/f42 4281637 0 2024-05-09T00:07:54.518 INFO:tasks.workunit.client.0.smithi026.stdout:2/776: symlink d14/d22/d55/da3/d30/d6a/dd6/l109 0 2024-05-09T00:07:54.520 INFO:tasks.workunit.client.0.smithi026.stdout:7/883: dread d8/d2e/d126/d9a/d9f/d104/d116/f98 [0,4194304] 0 2024-05-09T00:07:54.520 INFO:tasks.workunit.client.0.smithi026.stdout:5/724: rename d2/d8/d31/c19 to d2/d8/d31/d32/d48/daa/db4/cf5 0 2024-05-09T00:07:54.520 INFO:tasks.workunit.client.0.smithi026.stdout:5/725: write d2/d8/d31/d32/d48/daa/db4/fc6 [347655,98280] 0 2024-05-09T00:07:54.521 INFO:tasks.workunit.client.0.smithi026.stdout:4/788: mknod d0/d12/d87/c10b 0 2024-05-09T00:07:54.522 INFO:tasks.workunit.client.0.smithi026.stdout:8/829: truncate de/d17/d21/d24/d5b/f98 3200481 0 2024-05-09T00:07:54.525 INFO:tasks.workunit.client.0.smithi026.stdout:9/813: symlink d7/d23/d2f/d7d/l114 0 2024-05-09T00:07:54.527 INFO:tasks.workunit.client.0.smithi026.stdout:2/777: mkdir d14/d22/d55/da3/d20/d10a 0 2024-05-09T00:07:54.530 INFO:tasks.workunit.client.0.smithi026.stdout:7/884: creat d8/d2e/d84/db4/dbc/d1e/f12f x:0 0 0 2024-05-09T00:07:54.532 INFO:tasks.workunit.client.0.smithi026.stdout:5/726: creat d2/d8/d31/d32/d48/db3/ff6 x:0 0 0 2024-05-09T00:07:54.534 INFO:tasks.workunit.client.0.smithi026.stdout:4/789: mknod d0/d12/d1b/d4e/d92/c10c 0 2024-05-09T00:07:54.536 INFO:tasks.workunit.client.0.smithi026.stdout:8/830: dwrite de/d17/d21/d24/d3b/d3d/f56 [0,4194304] 0 2024-05-09T00:07:54.538 INFO:tasks.workunit.client.0.smithi026.stdout:9/814: mknod d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/d112/c115 0 2024-05-09T00:07:54.543 INFO:tasks.workunit.client.0.smithi026.stdout:2/778: unlink d14/c1e 0 2024-05-09T00:07:54.551 INFO:tasks.workunit.client.0.smithi026.stdout:2/779: dread d14/d22/d55/da3/d30/fce [0,4194304] 0 2024-05-09T00:07:54.551 INFO:tasks.workunit.client.0.smithi026.stdout:2/780: fdatasync d14/d22/d55/da3/d20/fdc 0 2024-05-09T00:07:54.552 INFO:tasks.workunit.client.0.smithi026.stdout:8/831: dwrite de/d48/f94 [0,4194304] 0 2024-05-09T00:07:54.555 INFO:tasks.workunit.client.0.smithi026.stdout:7/885: creat d8/d2e/d84/db4/dbc/d1e/d80/da2/f130 x:0 0 0 2024-05-09T00:07:54.557 INFO:tasks.workunit.client.0.smithi026.stdout:5/727: mkdir d2/d8/d31/d32/d48/daa/db4/df7 0 2024-05-09T00:07:54.560 INFO:tasks.workunit.client.0.smithi026.stdout:4/790: rename d0/d12/fe4 to d0/d12/d1b/f10d 0 2024-05-09T00:07:54.565 INFO:tasks.workunit.client.0.smithi026.stdout:9/815: mkdir d7/d23/d116 0 2024-05-09T00:07:54.568 INFO:tasks.workunit.client.0.smithi026.stdout:4/791: dread d0/d12/da2/d97/d43/d58/f7e [0,4194304] 0 2024-05-09T00:07:54.569 INFO:tasks.workunit.client.0.smithi026.stdout:8/832: mknod de/d6c/d31/d4f/deb/c117 0 2024-05-09T00:07:54.569 INFO:tasks.workunit.client.0.smithi026.stdout:8/833: chown de/d48/d3e/d54/lae 0 1 2024-05-09T00:07:54.572 INFO:tasks.workunit.client.0.smithi026.stdout:7/886: creat d8/d2e/d126/d9a/d9f/f131 x:0 0 0 2024-05-09T00:07:54.574 INFO:tasks.workunit.client.0.smithi026.stdout:7/887: dread d8/d1b/ff7 [0,4194304] 0 2024-05-09T00:07:54.574 INFO:tasks.workunit.client.0.smithi026.stdout:7/888: readlink d8/d2e/d84/db4/dbc/d1e/d3d/dca/l11c 0 2024-05-09T00:07:54.575 INFO:tasks.workunit.client.0.smithi026.stdout:4/792: mkdir d0/d12/d10e 0 2024-05-09T00:07:54.583 INFO:tasks.workunit.client.0.smithi026.stdout:8/834: creat de/d6c/d31/d4f/d87/d62/daa/ddb/d114/f118 x:0 0 0 2024-05-09T00:07:54.583 INFO:tasks.workunit.client.0.smithi026.stdout:8/835: dread - de/d6c/db5/f10e zero size 2024-05-09T00:07:54.583 INFO:tasks.workunit.client.0.smithi026.stdout:8/836: chown de/d6c/d31/d4f/d87/d62/daa/ddb/d91/f9c 27705 1 2024-05-09T00:07:54.583 INFO:tasks.workunit.client.0.smithi026.stdout:7/889: creat d8/d2e/d126/d9a/df4/f132 x:0 0 0 2024-05-09T00:07:54.584 INFO:tasks.workunit.client.0.smithi026.stdout:5/728: dwrite d2/d5a/d96/fa5 [0,4194304] 0 2024-05-09T00:07:54.584 INFO:tasks.workunit.client.0.smithi026.stdout:5/729: chown d2/d8/d31/d24/f74 11474 1 2024-05-09T00:07:54.585 INFO:tasks.workunit.client.0.smithi026.stdout:4/793: mknod d0/d12/da2/d97/d43/d49/d8f/dc1/c10f 0 2024-05-09T00:07:54.586 INFO:tasks.workunit.client.0.smithi026.stdout:7/890: getdents d8/d2e/d84/db4/dbc/d22/d29/d111 0 2024-05-09T00:07:54.586 INFO:tasks.workunit.client.0.smithi026.stdout:8/837: read de/d17/d21/d24/d3b/d3d/f51 [793840,79330] 0 2024-05-09T00:07:54.587 INFO:tasks.workunit.client.0.smithi026.stdout:9/816: dwrite d7/d23/d29/d31/f10c [0,4194304] 0 2024-05-09T00:07:54.589 INFO:tasks.workunit.client.0.smithi026.stdout:8/838: rename de/f7f to de/d6c/db5/f119 0 2024-05-09T00:07:54.590 INFO:tasks.workunit.client.0.smithi026.stdout:9/817: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/f117 x:0 0 0 2024-05-09T00:07:54.591 INFO:tasks.workunit.client.0.smithi026.stdout:8/839: truncate de/f13 2562511 0 2024-05-09T00:07:54.595 INFO:tasks.workunit.client.0.smithi026.stdout:9/818: rename d7/d23/f61 to d7/d23/d29/d31/d40/f118 0 2024-05-09T00:07:54.595 INFO:tasks.workunit.client.0.smithi026.stdout:9/819: chown d7/d23/d29/ce8 3894 1 2024-05-09T00:07:54.596 INFO:tasks.workunit.client.0.smithi026.stdout:8/840: creat de/d17/d21/d24/f11a x:0 0 0 2024-05-09T00:07:54.598 INFO:tasks.workunit.client.0.smithi026.stdout:9/820: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/f119 x:0 0 0 2024-05-09T00:07:54.598 INFO:tasks.workunit.client.0.smithi026.stdout:9/821: readlink d7/d23/d76/l8b 0 2024-05-09T00:07:54.598 INFO:tasks.workunit.client.0.smithi026.stdout:9/822: write d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/f117 [1041440,12539] 0 2024-05-09T00:07:54.601 INFO:tasks.workunit.client.0.smithi026.stdout:8/841: symlink de/d17/d21/dca/d104/l11b 0 2024-05-09T00:07:54.601 INFO:tasks.workunit.client.0.smithi026.stdout:8/842: chown de/d48/lf4 17 1 2024-05-09T00:07:54.601 INFO:tasks.workunit.client.0.smithi026.stdout:8/843: fdatasync de/f5d 0 2024-05-09T00:07:54.604 INFO:tasks.workunit.client.0.smithi026.stdout:8/844: creat de/d6c/d31/d4f/d87/d62/daa/ddb/d91/f11c x:0 0 0 2024-05-09T00:07:54.608 INFO:tasks.workunit.client.0.smithi026.stdout:9/823: rename d7/f19 to d7/d23/d29/d31/d40/d41/d54/dc5/f11a 0 2024-05-09T00:07:54.613 INFO:tasks.workunit.client.0.smithi026.stdout:9/824: mkdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/d11b 0 2024-05-09T00:07:54.613 INFO:tasks.workunit.client.0.smithi026.stdout:5/730: dwrite d2/d8/d31/d2e/d33/f68 [0,4194304] 0 2024-05-09T00:07:54.613 INFO:tasks.workunit.client.0.smithi026.stdout:7/891: dwrite d8/d2e/f3c [8388608,4194304] 0 2024-05-09T00:07:54.614 INFO:tasks.workunit.client.0.smithi026.stdout:9/825: mkdir d7/d23/d76/d11c 0 2024-05-09T00:07:54.615 INFO:tasks.workunit.client.0.smithi026.stdout:9/826: stat d7/d23/d29/d31/d40/d41/d54/dc5/ffa 0 2024-05-09T00:07:54.617 INFO:tasks.workunit.client.0.smithi026.stdout:7/892: write d8/d2e/d84/db4/dbc/d1e/d3d/f61 [1213849,85974] 0 2024-05-09T00:07:54.617 INFO:tasks.workunit.client.0.smithi026.stdout:5/731: creat d2/d8/d31/d32/da2/df0/ff8 x:0 0 0 2024-05-09T00:07:54.619 INFO:tasks.workunit.client.0.smithi026.stdout:8/845: dwrite de/d6c/d31/d4f/f86 [0,4194304] 0 2024-05-09T00:07:54.620 INFO:tasks.workunit.client.0.smithi026.stdout:5/732: creat d2/d8/d6d/ddd/ff9 x:0 0 0 2024-05-09T00:07:54.620 INFO:tasks.workunit.client.0.smithi026.stdout:5/733: chown d2/d8/d31/d32/d48/daa/db4 932665359 1 2024-05-09T00:07:54.621 INFO:tasks.workunit.client.0.smithi026.stdout:8/846: mkdir de/d6c/d31/d4f/df1/dfc/d11d 0 2024-05-09T00:07:54.622 INFO:tasks.workunit.client.0.smithi026.stdout:5/734: creat d2/d8/ffa x:0 0 0 2024-05-09T00:07:54.622 INFO:tasks.workunit.client.0.smithi026.stdout:5/735: chown d2/d5a/fe7 406 1 2024-05-09T00:07:54.624 INFO:tasks.workunit.client.0.smithi026.stdout:8/847: link de/d6c/d31/d4f/d87/c10c de/d48/c11e 0 2024-05-09T00:07:54.625 INFO:tasks.workunit.client.0.smithi026.stdout:8/848: creat de/d6c/d31/f11f x:0 0 0 2024-05-09T00:07:54.626 INFO:tasks.workunit.client.0.smithi026.stdout:8/849: mknod de/dd9/d116/dd2/c120 0 2024-05-09T00:07:54.637 INFO:tasks.workunit.client.0.smithi026.stdout:7/893: dwrite d8/d2e/d84/db4/dbc/f25 [0,4194304] 0 2024-05-09T00:07:54.637 INFO:tasks.workunit.client.0.smithi026.stdout:7/894: write d8/d1b/d89/fd6 [469586,103254] 0 2024-05-09T00:07:54.638 INFO:tasks.workunit.client.0.smithi026.stdout:7/895: chown d8/d2e/d84/db4/dbc/d1e/d3d/ca4 27 1 2024-05-09T00:07:54.638 INFO:tasks.workunit.client.0.smithi026.stdout:7/896: read d8/d2e/f3c [9269336,50767] 0 2024-05-09T00:07:54.638 INFO:tasks.workunit.client.0.smithi026.stdout:7/897: write d8/d2e/d84/db4/dbc/d22/f85 [176312,80333] 0 2024-05-09T00:07:54.639 INFO:tasks.workunit.client.0.smithi026.stdout:7/898: creat d8/d1b/dfe/f133 x:0 0 0 2024-05-09T00:07:54.641 INFO:tasks.workunit.client.0.smithi026.stdout:5/736: dread d2/d8/d31/d63/d9c/dbc/fcf [0,4194304] 0 2024-05-09T00:07:54.642 INFO:tasks.workunit.client.0.smithi026.stdout:9/827: rename d7/d23/d29/d31/d40/d41/d54/dc5/f11a to d7/d23/d2f/d7d/d87/f11d 0 2024-05-09T00:07:54.647 INFO:tasks.workunit.client.0.smithi026.stdout:5/737: symlink d2/d8/d31/d2e/d35/lfb 0 2024-05-09T00:07:54.650 INFO:tasks.workunit.client.0.smithi026.stdout:9/828: rename d7/d23/d29/d59/d91/fcc to d7/d23/d2f/d3a/db5/f11e 0 2024-05-09T00:07:54.650 INFO:tasks.workunit.client.0.smithi026.stdout:9/829: chown d7/d23/d2f/d7d/db2/led 7325799 1 2024-05-09T00:07:54.650 INFO:tasks.workunit.client.0.smithi026.stdout:9/830: readlink d7/d23/d29/d59/l72 0 2024-05-09T00:07:54.650 INFO:tasks.workunit.client.0.smithi026.stdout:9/831: fdatasync d7/d23/d29/d59/f5f 0 2024-05-09T00:07:54.650 INFO:tasks.workunit.client.0.smithi026.stdout:9/832: truncate d7/d23/d29/fc3 124371 0 2024-05-09T00:07:54.650 INFO:tasks.workunit.client.0.smithi026.stdout:9/833: fdatasync d7/d23/d29/d31/f3d 0 2024-05-09T00:07:54.653 INFO:tasks.workunit.client.0.smithi026.stdout:5/738: link d2/d8/l76 d2/d8/d31/d32/da2/df0/lfc 0 2024-05-09T00:07:54.654 INFO:tasks.workunit.client.0.smithi026.stdout:8/850: dwrite de/d17/d21/d24/d5b/fbf [0,4194304] 0 2024-05-09T00:07:54.655 INFO:tasks.workunit.client.0.smithi026.stdout:9/834: symlink d7/d23/d29/d59/l11f 0 2024-05-09T00:07:54.655 INFO:tasks.workunit.client.0.smithi026.stdout:9/835: fdatasync d7/d26/f71 0 2024-05-09T00:07:54.658 INFO:tasks.workunit.client.0.smithi026.stdout:9/836: write d7/d23/f84 [3810355,62502] 0 2024-05-09T00:07:54.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/899: dwrite d8/d1b/f5b [0,4194304] 0 2024-05-09T00:07:54.660 INFO:tasks.workunit.client.0.smithi026.stdout:9/837: dread d7/d23/d29/f9e [0,4194304] 0 2024-05-09T00:07:54.667 INFO:tasks.workunit.client.0.smithi026.stdout:5/739: rename d2/d8/d31/d24/f43 to d2/d8/d31/d2e/d33/ffd 0 2024-05-09T00:07:54.671 INFO:tasks.workunit.client.0.smithi026.stdout:8/851: truncate de/d48/d3e/f50 605702 0 2024-05-09T00:07:54.675 INFO:tasks.workunit.client.0.smithi026.stdout:7/900: creat d8/d2e/f134 x:0 0 0 2024-05-09T00:07:54.676 INFO:tasks.workunit.client.0.smithi026.stdout:9/838: creat d7/d23/d29/d31/d40/f120 x:0 0 0 2024-05-09T00:07:54.677 INFO:tasks.workunit.client.0.smithi026.stdout:5/740: creat d2/d8/d2a/d8d/dbe/ffe x:0 0 0 2024-05-09T00:07:54.678 INFO:tasks.workunit.client.0.smithi026.stdout:5/741: fsync d2/d8/d31/d32/d48/daa/db4/fc6 0 2024-05-09T00:07:54.678 INFO:tasks.workunit.client.0.smithi026.stdout:5/742: stat d2/d8/d31/d32/d48/daa/fb8 0 2024-05-09T00:07:54.679 INFO:tasks.workunit.client.0.smithi026.stdout:7/901: mkdir d8/d2e/d84/db4/dbc/d22/d29/d111/d135 0 2024-05-09T00:07:54.681 INFO:tasks.workunit.client.0.smithi026.stdout:9/839: creat d7/d23/d29/d31/f121 x:0 0 0 2024-05-09T00:07:54.681 INFO:tasks.workunit.client.0.smithi026.stdout:9/840: chown d7/d26/deb 1 1 2024-05-09T00:07:54.681 INFO:tasks.workunit.client.0.smithi026.stdout:9/841: dread - d7/d23/d2f/d3a/db5/f11e zero size 2024-05-09T00:07:54.681 INFO:tasks.workunit.client.0.smithi026.stdout:9/842: truncate d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fde 857727 0 2024-05-09T00:07:54.682 INFO:tasks.workunit.client.0.smithi026.stdout:9/843: creat d7/d26/f122 x:0 0 0 2024-05-09T00:07:54.682 INFO:tasks.workunit.client.0.smithi026.stdout:5/743: dread d2/f72 [4194304,4194304] 0 2024-05-09T00:07:54.683 INFO:tasks.workunit.client.0.smithi026.stdout:9/844: truncate d7/fe3 627487 0 2024-05-09T00:07:54.685 INFO:tasks.workunit.client.0.smithi026.stdout:5/744: unlink d2/d8/ff1 0 2024-05-09T00:07:54.687 INFO:tasks.workunit.client.0.smithi026.stdout:9/845: symlink d7/l123 0 2024-05-09T00:07:54.687 INFO:tasks.workunit.client.0.smithi026.stdout:9/846: dread - d7/d23/d29/d31/fd0 zero size 2024-05-09T00:07:54.695 INFO:tasks.workunit.client.0.smithi026.stdout:8/852: dwrite de/d6c/d31/d4f/d87/d62/daa/ddb/fcd [0,4194304] 0 2024-05-09T00:07:54.696 INFO:tasks.workunit.client.0.smithi026.stdout:8/853: creat de/dd9/d116/dd2/f121 x:0 0 0 2024-05-09T00:07:54.697 INFO:tasks.workunit.client.0.smithi026.stdout:8/854: write de/d17/d21/fa1 [1596826,59159] 0 2024-05-09T00:07:54.707 INFO:tasks.workunit.client.0.smithi026.stdout:5/745: dwrite d2/d8/d6d/f8f [0,4194304] 0 2024-05-09T00:07:54.712 INFO:tasks.workunit.client.0.smithi026.stdout:5/746: creat d2/d8/d31/d32/d48/fff x:0 0 0 2024-05-09T00:07:54.714 INFO:tasks.workunit.client.0.smithi026.stdout:8/855: dwrite de/d6c/d31/d4f/d87/f4d [0,4194304] 0 2024-05-09T00:07:54.715 INFO:tasks.workunit.client.0.smithi026.stdout:5/747: dread d2/d8/d31/d32/d5c/dd7/fd9 [0,4194304] 0 2024-05-09T00:07:54.719 INFO:tasks.workunit.client.0.smithi026.stdout:5/748: read d2/d8/d31/d2e/d33/f68 [2035599,57598] 0 2024-05-09T00:07:54.722 INFO:tasks.workunit.client.0.smithi026.stdout:5/749: fsync d2/d8/d31/d2e/d33/ffd 0 2024-05-09T00:07:54.722 INFO:tasks.workunit.client.0.smithi026.stdout:5/750: write d2/d8/ffa [463693,121021] 0 2024-05-09T00:07:54.722 INFO:tasks.workunit.client.0.smithi026.stdout:5/751: dread - d2/d8/d31/d63/d9c/dbc/fdf zero size 2024-05-09T00:07:54.729 INFO:tasks.workunit.client.0.smithi026.stdout:5/752: mknod d2/d8/d31/d32/d48/daa/db4/c100 0 2024-05-09T00:07:54.733 INFO:tasks.workunit.client.0.smithi026.stdout:5/753: mkdir d2/d8/d31/d32/d5c/dd7/d101 0 2024-05-09T00:07:54.739 INFO:tasks.workunit.client.0.smithi026.stdout:5/754: rename d2/d8/d31/d32/fb0 to d2/d8/d31/d2e/f102 0 2024-05-09T00:07:54.739 INFO:tasks.workunit.client.0.smithi026.stdout:5/755: chown d2/d8/d2a/l2b 8 1 2024-05-09T00:07:54.764 INFO:tasks.workunit.client.0.smithi026.stdout:8/856: dwrite de/d48/d3e/f50 [0,4194304] 0 2024-05-09T00:07:54.765 INFO:tasks.workunit.client.0.smithi026.stdout:5/756: getdents d2/d8 0 2024-05-09T00:07:54.771 INFO:tasks.workunit.client.0.smithi026.stdout:5/757: symlink d2/d8/d2a/l103 0 2024-05-09T00:07:54.773 INFO:tasks.workunit.client.0.smithi026.stdout:9/847: write d7/d23/f7c [57549,68133] 0 2024-05-09T00:07:54.773 INFO:tasks.workunit.client.0.smithi026.stdout:9/848: dread - d7/d26/f95 zero size 2024-05-09T00:07:54.773 INFO:tasks.workunit.client.0.smithi026.stdout:9/849: stat d7/d23/d29/lb7 0 2024-05-09T00:07:54.773 INFO:tasks.workunit.client.0.smithi026.stdout:5/758: read d2/d8/d31/d24/f7b [3797780,7491] 0 2024-05-09T00:07:54.773 INFO:tasks.workunit.client.0.smithi026.stdout:5/759: stat d2/d8/d31/l89 0 2024-05-09T00:07:54.773 INFO:tasks.workunit.client.0.smithi026.stdout:5/760: dread - d2/d8/d31/d32/d48/fff zero size 2024-05-09T00:07:54.781 INFO:tasks.workunit.client.0.smithi026.stdout:9/850: dread d7/d23/d29/d31/d40/d41/d54/d9a/da4/fe0 [0,4194304] 0 2024-05-09T00:07:54.781 INFO:tasks.workunit.client.0.smithi026.stdout:5/761: mkdir d2/d5a/d104 0 2024-05-09T00:07:54.784 INFO:tasks.workunit.client.0.smithi026.stdout:9/851: getdents d7/d23/d29/d59/d91 0 2024-05-09T00:07:54.787 INFO:tasks.workunit.client.0.smithi026.stdout:5/762: creat d2/d8/d31/d24/f105 x:0 0 0 2024-05-09T00:07:54.788 INFO:tasks.workunit.client.0.smithi026.stdout:9/852: mknod d7/d23/d29/d2e/c124 0 2024-05-09T00:07:54.788 INFO:tasks.workunit.client.0.smithi026.stdout:9/853: fdatasync d7/f1b 0 2024-05-09T00:07:54.788 INFO:tasks.workunit.client.0.smithi026.stdout:9/854: write d7/d23/d29/d31/d40/d41/fb3 [1661234,12646] 0 2024-05-09T00:07:54.796 INFO:tasks.workunit.client.0.smithi026.stdout:5/763: dread d2/d8/d2a/f4f [0,4194304] 0 2024-05-09T00:07:54.814 INFO:tasks.workunit.client.0.smithi026.stdout:5/764: dwrite d2/d8/d31/d32/d5c/f67 [4194304,4194304] 0 2024-05-09T00:07:54.815 INFO:tasks.workunit.client.0.smithi026.stdout:5/765: write d2/d8/d31/d2e/f98 [813916,7351] 0 2024-05-09T00:07:54.815 INFO:tasks.workunit.client.0.smithi026.stdout:5/766: chown d2/d8/d31/d63/d9c/fb6 2385 1 2024-05-09T00:07:54.817 INFO:tasks.workunit.client.0.smithi026.stdout:5/767: read d2/fc [3135945,106830] 0 2024-05-09T00:07:54.817 INFO:tasks.workunit.client.0.smithi026.stdout:5/768: chown d2/d8/d31/d2e/f102 23021937 1 2024-05-09T00:07:54.819 INFO:tasks.workunit.client.0.smithi026.stdout:5/769: rename d2/d8/d31/d32/d5c/cef to d2/d8/c106 0 2024-05-09T00:07:54.819 INFO:tasks.workunit.client.0.smithi026.stdout:5/770: write d2/d8/d31/fc1 [435139,61311] 0 2024-05-09T00:07:54.849 INFO:tasks.workunit.client.0.smithi026.stdout:6/653: sync 2024-05-09T00:07:54.849 INFO:tasks.workunit.client.0.smithi026.stdout:1/857: sync 2024-05-09T00:07:54.849 INFO:tasks.workunit.client.0.smithi026.stdout:3/636: sync 2024-05-09T00:07:54.849 INFO:tasks.workunit.client.0.smithi026.stdout:1/858: chown d5/db/d108 1423959893 1 2024-05-09T00:07:54.850 INFO:tasks.workunit.client.0.smithi026.stdout:6/654: readlink d15/d34/d52/d74/dd0/la2 0 2024-05-09T00:07:54.850 INFO:tasks.workunit.client.0.smithi026.stdout:3/637: rmdir d5/d9/d4a/d5f/d6f/d75 39 2024-05-09T00:07:54.850 INFO:tasks.workunit.client.0.smithi026.stdout:3/638: chown d5/d44/l78 506 1 2024-05-09T00:07:54.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/655: mkdir d15/d62/ddc 0 2024-05-09T00:07:54.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/656: chown d15/f1f 79807 1 2024-05-09T00:07:54.853 INFO:tasks.workunit.client.0.smithi026.stdout:1/859: creat d5/d16/d60/d66/f123 x:0 0 0 2024-05-09T00:07:54.854 INFO:tasks.workunit.client.0.smithi026.stdout:6/657: mknod d15/d34/d52/d74/db8/cdd 0 2024-05-09T00:07:54.855 INFO:tasks.workunit.client.0.smithi026.stdout:6/658: mkdir d15/d34/d52/d74/db8/dde 0 2024-05-09T00:07:54.857 INFO:tasks.workunit.client.0.smithi026.stdout:6/659: mkdir d15/d1e/d23/d73/d8e/ddf 0 2024-05-09T00:07:54.857 INFO:tasks.workunit.client.0.smithi026.stdout:6/660: write d15/d34/d52/d8b/f91 [875843,53034] 0 2024-05-09T00:07:54.858 INFO:tasks.workunit.client.0.smithi026.stdout:3/639: dread d5/d9/d4a/d5f/d6f/fb6 [0,4194304] 0 2024-05-09T00:07:54.858 INFO:tasks.workunit.client.0.smithi026.stdout:3/640: dread - d5/d9/d49/fc9 zero size 2024-05-09T00:07:54.859 INFO:tasks.workunit.client.0.smithi026.stdout:3/641: write d5/d9/ff [1275478,24905] 0 2024-05-09T00:07:54.859 INFO:tasks.workunit.client.0.smithi026.stdout:6/661: symlink d15/d2b/d33/d55/d67/dbb/dbf/le0 0 2024-05-09T00:07:54.861 INFO:tasks.workunit.client.0.smithi026.stdout:6/662: truncate d15/d34/d52/f9d 891791 0 2024-05-09T00:07:54.870 INFO:tasks.workunit.client.0.smithi026.stdout:1/860: dwrite d5/db/d108/f88 [0,4194304] 0 2024-05-09T00:07:54.875 INFO:tasks.workunit.client.0.smithi026.stdout:1/861: getdents d5/db/d1d 0 2024-05-09T00:07:54.875 INFO:tasks.workunit.client.0.smithi026.stdout:1/862: chown d5/db/d108 140531263 1 2024-05-09T00:07:54.876 INFO:tasks.workunit.client.0.smithi026.stdout:1/863: stat d5/dd/d1f/f2e 0 2024-05-09T00:07:54.876 INFO:tasks.workunit.client.0.smithi026.stdout:1/864: fsync d5/d16/d60/d66/f123 0 2024-05-09T00:07:54.884 INFO:tasks.workunit.client.0.smithi026.stdout:1/865: dread d5/d16/f24 [0,4194304] 0 2024-05-09T00:07:54.884 INFO:tasks.workunit.client.0.smithi026.stdout:1/866: readlink d5/dd/d17/lfb 0 2024-05-09T00:07:54.888 INFO:tasks.workunit.client.0.smithi026.stdout:1/867: link d5/dd/d17/d9f/da5/f11b d5/db/d108/f124 0 2024-05-09T00:07:54.896 INFO:tasks.workunit.client.0.smithi026.stdout:1/868: dread d5/f27 [0,4194304] 0 2024-05-09T00:07:54.896 INFO:tasks.workunit.client.0.smithi026.stdout:1/869: readlink d5/db/l95 0 2024-05-09T00:07:54.898 INFO:tasks.workunit.client.0.smithi026.stdout:1/870: creat d5/d16/dd5/de4/f125 x:0 0 0 2024-05-09T00:07:54.899 INFO:tasks.workunit.client.0.smithi026.stdout:1/871: mknod d5/d16/d60/c126 0 2024-05-09T00:07:54.919 INFO:tasks.workunit.client.0.smithi026.stdout:1/872: dwrite d5/dd/d87/f10d [0,4194304] 0 2024-05-09T00:07:54.921 INFO:tasks.workunit.client.0.smithi026.stdout:1/873: mknod d5/db/c127 0 2024-05-09T00:07:54.922 INFO:tasks.workunit.client.0.smithi026.stdout:1/874: read d5/dd/d17/f2a [512609,26006] 0 2024-05-09T00:07:54.924 INFO:tasks.workunit.client.0.smithi026.stdout:1/875: dread d5/dd/d17/fd3 [0,4194304] 0 2024-05-09T00:07:54.941 INFO:tasks.workunit.client.0.smithi026.stdout:1/876: dwrite d5/d16/dd5/de4/f11f [0,4194304] 0 2024-05-09T00:07:54.943 INFO:tasks.workunit.client.0.smithi026.stdout:1/877: creat d5/db/d108/f128 x:0 0 0 2024-05-09T00:07:54.943 INFO:tasks.workunit.client.0.smithi026.stdout:1/878: fdatasync d5/dd/d17/d9f/dc6/f101 0 2024-05-09T00:07:54.944 INFO:tasks.workunit.client.0.smithi026.stdout:1/879: write d5/dd/d1f/f21 [4259480,13482] 0 2024-05-09T00:07:54.946 INFO:tasks.workunit.client.0.smithi026.stdout:1/880: rename d5/db/c38 to d5/db/c129 0 2024-05-09T00:07:54.947 INFO:tasks.workunit.client.0.smithi026.stdout:1/881: creat d5/d16/d60/d66/d97/d75/f12a x:0 0 0 2024-05-09T00:07:54.957 INFO:tasks.workunit.client.0.smithi026.stdout:1/882: dread f3 [4194304,4194304] 0 2024-05-09T00:07:54.957 INFO:tasks.workunit.client.0.smithi026.stdout:1/883: stat d5/dd/d1f/d51/c113 0 2024-05-09T00:07:55.045 INFO:tasks.workunit.client.0.smithi026.stdout:2/781: sync 2024-05-09T00:07:55.045 INFO:tasks.workunit.client.0.smithi026.stdout:2/782: creat d14/d22/d55/d6b/d93/f10b x:0 0 0 2024-05-09T00:07:55.047 INFO:tasks.workunit.client.0.smithi026.stdout:2/783: rename d14/d22/d55/da3/d30/lb7 to d14/d22/d55/d6b/l10c 0 2024-05-09T00:07:55.204 INFO:tasks.workunit.client.0.smithi026.stdout:4/794: sync 2024-05-09T00:07:55.205 INFO:tasks.workunit.client.0.smithi026.stdout:8/857: sync 2024-05-09T00:07:55.205 INFO:tasks.workunit.client.0.smithi026.stdout:9/855: sync 2024-05-09T00:07:55.205 INFO:tasks.workunit.client.0.smithi026.stdout:9/856: chown d7/d23/d29/d31/cbb 8 1 2024-05-09T00:07:55.205 INFO:tasks.workunit.client.0.smithi026.stdout:7/902: sync 2024-05-09T00:07:55.205 INFO:tasks.workunit.client.0.smithi026.stdout:7/903: chown f7 649245 1 2024-05-09T00:07:55.205 INFO:tasks.workunit.client.0.smithi026.stdout:7/904: chown d8/d2e/d84/db4/dbc/d1e/d3d/dca/l11c 1833393 1 2024-05-09T00:07:55.209 INFO:tasks.workunit.client.0.smithi026.stdout:4/795: mkdir d0/d12/d110 0 2024-05-09T00:07:55.209 INFO:tasks.workunit.client.0.smithi026.stdout:8/858: mkdir de/d6c/d31/d4f/d87/d122 0 2024-05-09T00:07:55.211 INFO:tasks.workunit.client.0.smithi026.stdout:7/905: getdents d8/d1b/d89/dc1 0 2024-05-09T00:07:55.213 INFO:tasks.workunit.client.0.smithi026.stdout:4/796: creat d0/d12/d64/dac/dd4/f111 x:0 0 0 2024-05-09T00:07:55.216 INFO:tasks.workunit.client.0.smithi026.stdout:4/797: truncate d0/d12/da2/d97/d43/d49/f54 1170808 0 2024-05-09T00:07:55.217 INFO:tasks.workunit.client.0.smithi026.stdout:4/798: fdatasync d0/d12/d1b/d4e/f5b 0 2024-05-09T00:07:55.218 INFO:tasks.workunit.client.0.smithi026.stdout:8/859: mknod de/d17/d21/d24/d3b/d3d/c123 0 2024-05-09T00:07:55.218 INFO:tasks.workunit.client.0.smithi026.stdout:8/860: truncate de/d17/d21/d24/fc6 518748 0 2024-05-09T00:07:55.220 INFO:tasks.workunit.client.0.smithi026.stdout:8/861: mknod de/d6c/d31/d4f/d87/d62/daa/ddb/c124 0 2024-05-09T00:07:55.220 INFO:tasks.workunit.client.0.smithi026.stdout:8/862: getdents de/d48/d3e/dc4 0 2024-05-09T00:07:55.222 INFO:tasks.workunit.client.0.smithi026.stdout:8/863: symlink de/d6c/d31/d4f/d87/d62/daa/l125 0 2024-05-09T00:07:55.224 INFO:tasks.workunit.client.0.smithi026.stdout:9/857: dwrite d7/d23/d29/d31/fbd [0,4194304] 0 2024-05-09T00:07:55.224 INFO:tasks.workunit.client.0.smithi026.stdout:9/858: read - d7/d23/d29/d31/d40/d41/d54/d9a/fcd zero size 2024-05-09T00:07:55.226 INFO:tasks.workunit.client.0.smithi026.stdout:8/864: read de/d6c/d31/d4f/d87/f6d [915615,121258] 0 2024-05-09T00:07:55.226 INFO:tasks.workunit.client.0.smithi026.stdout:8/865: chown de/d6c/d31/d4f/d87/d62/daa/ddb/d91/f9c 3000 1 2024-05-09T00:07:55.230 INFO:tasks.workunit.client.0.smithi026.stdout:9/859: rename d7/d23/d29/d2e/f47 to d7/d23/d29/d31/d40/d41/d54/d9a/f125 0 2024-05-09T00:07:55.231 INFO:tasks.workunit.client.0.smithi026.stdout:8/866: mknod de/d17/d21/d24/d5b/dbd/c126 0 2024-05-09T00:07:55.235 INFO:tasks.workunit.client.0.smithi026.stdout:4/799: dwrite d0/d12/da2/d97/dbf/fca [0,4194304] 0 2024-05-09T00:07:55.235 INFO:tasks.workunit.client.0.smithi026.stdout:9/860: creat d7/d23/d29/d31/d40/d41/d54/d9a/f126 x:0 0 0 2024-05-09T00:07:55.236 INFO:tasks.workunit.client.0.smithi026.stdout:7/906: dwrite d8/d2e/d84/db4/fb7 [0,4194304] 0 2024-05-09T00:07:55.236 INFO:tasks.workunit.client.0.smithi026.stdout:8/867: rmdir de/d60 39 2024-05-09T00:07:55.247 INFO:tasks.workunit.client.0.smithi026.stdout:9/861: fdatasync d7/f1d 0 2024-05-09T00:07:55.254 INFO:tasks.workunit.client.0.smithi026.stdout:7/907: mkdir d8/d1b/d136 0 2024-05-09T00:07:55.254 INFO:tasks.workunit.client.0.smithi026.stdout:7/908: fdatasync d8/d2e/d126/f99 0 2024-05-09T00:07:55.256 INFO:tasks.workunit.client.0.smithi026.stdout:8/868: creat de/d6c/d31/d4f/df1/dfc/f127 x:0 0 0 2024-05-09T00:07:55.257 INFO:tasks.workunit.client.0.smithi026.stdout:4/800: truncate d0/d12/da2/d97/dbf/fca 2529023 0 2024-05-09T00:07:55.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/909: creat d8/d2e/d84/db4/dbc/d22/d29/d111/f137 x:0 0 0 2024-05-09T00:07:55.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/910: truncate d8/d2e/d126/ff2 308774 0 2024-05-09T00:07:55.264 INFO:tasks.workunit.client.0.smithi026.stdout:9/862: dwrite d7/d23/d2f/d50/f113 [0,4194304] 0 2024-05-09T00:07:55.265 INFO:tasks.workunit.client.0.smithi026.stdout:8/869: getdents de/d17/d21/d6f 0 2024-05-09T00:07:55.268 INFO:tasks.workunit.client.0.smithi026.stdout:4/801: symlink d0/d83/l112 0 2024-05-09T00:07:55.270 INFO:tasks.workunit.client.0.smithi026.stdout:7/911: creat d8/d2e/d126/f138 x:0 0 0 2024-05-09T00:07:55.273 INFO:tasks.workunit.client.0.smithi026.stdout:9/863: creat d7/d23/d29/d31/d40/d41/d54/d5c/f127 x:0 0 0 2024-05-09T00:07:55.273 INFO:tasks.workunit.client.0.smithi026.stdout:9/864: chown d7/d26/fca 19325192 1 2024-05-09T00:07:55.275 INFO:tasks.workunit.client.0.smithi026.stdout:4/802: symlink d0/d12/da2/d97/d43/d58/db3/l113 0 2024-05-09T00:07:55.275 INFO:tasks.workunit.client.0.smithi026.stdout:4/803: write d0/d12/da2/d97/d43/d49/d8f/da3/f40 [1408939,92258] 0 2024-05-09T00:07:55.276 INFO:tasks.workunit.client.0.smithi026.stdout:7/912: mknod d8/d2e/d126/d9a/d9f/d104/c139 0 2024-05-09T00:07:55.278 INFO:tasks.workunit.client.0.smithi026.stdout:9/865: creat d7/d23/d2f/d7d/db2/f128 x:0 0 0 2024-05-09T00:07:55.279 INFO:tasks.workunit.client.0.smithi026.stdout:9/866: truncate d7/d23/d29/d31/d40/d41/d54/d5c/faa 1833970 0 2024-05-09T00:07:55.281 INFO:tasks.workunit.client.0.smithi026.stdout:7/913: rename d8/d2e/d84/db4/dbc/d1e/f64 to d8/d2e/d84/db4/dbc/d22/da1/f13a 0 2024-05-09T00:07:55.281 INFO:tasks.workunit.client.0.smithi026.stdout:7/914: stat d8/d2e/d126/d9a/d9f/d104/d116/l92 0 2024-05-09T00:07:55.281 INFO:tasks.workunit.client.0.smithi026.stdout:7/915: chown d8/d1b/f7b 26176 1 2024-05-09T00:07:55.293 INFO:tasks.workunit.client.0.smithi026.stdout:4/804: dwrite d0/d12/da2/fba [0,4194304] 0 2024-05-09T00:07:55.293 INFO:tasks.workunit.client.0.smithi026.stdout:4/805: write d0/d12/da2/d97/d43/d49/d8f/da3/f6f [46697,31327] 0 2024-05-09T00:07:55.324 INFO:tasks.workunit.client.0.smithi026.stdout:9/867: mknod d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/d11b/c129 0 2024-05-09T00:07:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:5/771: sync 2024-05-09T00:07:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:6/663: sync 2024-05-09T00:07:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:2/784: sync 2024-05-09T00:07:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:3/642: sync 2024-05-09T00:07:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:1/884: sync 2024-05-09T00:07:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:6/664: fdatasync d15/d2b/d33/d55/f95 0 2024-05-09T00:07:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:1/885: truncate d5/dd/f58 1663551 0 2024-05-09T00:07:55.385 INFO:tasks.workunit.client.0.smithi026.stdout:6/665: dwrite d15/d1e/d23/d73/fa3 [0,4194304] 0 2024-05-09T00:07:55.385 INFO:tasks.workunit.client.0.smithi026.stdout:6/666: truncate d15/fd9 375420 0 2024-05-09T00:07:55.386 INFO:tasks.workunit.client.0.smithi026.stdout:6/667: chown d15/d41/fd5 171 1 2024-05-09T00:07:55.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:53.909867+0000 mgr.smithi135.kkrhgf (mgr.24419) 60 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 92 MiB/s rd, 200 MiB/s wr, 349 op/s 2024-05-09T00:07:55.397 INFO:tasks.workunit.client.0.smithi026.stdout:7/916: rename d8/d2e/d126/f7d to d8/d1b/f13b 0 2024-05-09T00:07:55.397 INFO:tasks.workunit.client.0.smithi026.stdout:7/917: stat d8/d2e/d84/db4/dbc/d1e 0 2024-05-09T00:07:55.397 INFO:tasks.workunit.client.0.smithi026.stdout:7/918: chown d8/l45 99 1 2024-05-09T00:07:55.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:53.909867+0000 mgr.smithi135.kkrhgf (mgr.24419) 60 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 92 MiB/s rd, 200 MiB/s wr, 349 op/s 2024-05-09T00:07:55.406 INFO:tasks.workunit.client.0.smithi026.stdout:9/868: creat d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/f12a x:0 0 0 2024-05-09T00:07:55.406 INFO:tasks.workunit.client.0.smithi026.stdout:9/869: chown d7/d23/d2f/d3a/db5/l100 2596708 1 2024-05-09T00:07:55.411 INFO:tasks.workunit.client.0.smithi026.stdout:2/785: rmdir d14/d22/d55/da3/d20/db2/dc6 0 2024-05-09T00:07:55.412 INFO:tasks.workunit.client.0.smithi026.stdout:2/786: truncate d14/d22/d55/da3/d20/fdc 1618350 0 2024-05-09T00:07:55.412 INFO:tasks.workunit.client.0.smithi026.stdout:2/787: chown d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/lb6 486833 1 2024-05-09T00:07:55.412 INFO:tasks.workunit.client.0.smithi026.stdout:2/788: fsync d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fc2 0 2024-05-09T00:07:55.417 INFO:tasks.workunit.client.0.smithi026.stdout:5/772: creat d2/d8/d31/d32/d5c/f107 x:0 0 0 2024-05-09T00:07:55.418 INFO:tasks.workunit.client.0.smithi026.stdout:5/773: write d2/d8/d31/d2e/d33/f68 [623186,90511] 0 2024-05-09T00:07:55.420 INFO:tasks.workunit.client.0.smithi026.stdout:3/643: link d5/d9/dc/d28/d63/f66 d5/d44/d9f/fd7 0 2024-05-09T00:07:55.435 INFO:tasks.workunit.client.0.smithi026.stdout:9/870: creat d7/d23/d2f/d7d/d87/f12b x:0 0 0 2024-05-09T00:07:55.440 INFO:tasks.workunit.client.0.smithi026.stdout:5/774: creat d2/d5a/d96/de5/f108 x:0 0 0 2024-05-09T00:07:55.446 INFO:tasks.workunit.client.0.smithi026.stdout:3/644: mknod d5/d44/cd8 0 2024-05-09T00:07:55.450 INFO:tasks.workunit.client.0.smithi026.stdout:9/871: symlink d7/d23/d2f/d7d/d87/l12c 0 2024-05-09T00:07:55.455 INFO:tasks.workunit.client.0.smithi026.stdout:3/645: unlink d5/d9/dc/d28/d63/c69 0 2024-05-09T00:07:55.455 INFO:tasks.workunit.client.0.smithi026.stdout:3/646: write d5/d9/d4a/f52 [2073944,108527] 0 2024-05-09T00:07:55.457 INFO:tasks.workunit.client.0.smithi026.stdout:9/872: mknod d7/d23/d29/d59/dec/c12d 0 2024-05-09T00:07:55.457 INFO:tasks.workunit.client.0.smithi026.stdout:9/873: fdatasync d7/d23/d2f/f35 0 2024-05-09T00:07:55.458 INFO:tasks.workunit.client.0.smithi026.stdout:9/874: readlink d7/d23/d2f/d7d/d87/lf3 0 2024-05-09T00:07:55.458 INFO:tasks.workunit.client.0.smithi026.stdout:9/875: mkdir d7/d23/d2f/d3a/d12e 0 2024-05-09T00:07:55.464 INFO:tasks.workunit.client.0.smithi026.stdout:9/876: creat d7/d23/d2f/d7d/db2/f12f x:0 0 0 2024-05-09T00:07:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:9/877: unlink d7/d23/d29/d31/d40/f82 0 2024-05-09T00:07:55.517 INFO:tasks.workunit.client.0.smithi026.stdout:9/878: dwrite d7/d23/d2f/d7d/d87/fbe [0,4194304] 0 2024-05-09T00:07:55.520 INFO:tasks.workunit.client.0.smithi026.stdout:9/879: mkdir d7/d23/d2f/d7d/db2/d130 0 2024-05-09T00:07:55.533 INFO:tasks.workunit.client.0.smithi026.stdout:4/806: rename d0/lf3 to d0/d12/d64/l114 0 2024-05-09T00:07:55.534 INFO:tasks.workunit.client.0.smithi026.stdout:4/807: write d0/d12/da2/d97/f57 [230080,73311] 0 2024-05-09T00:07:55.534 INFO:tasks.workunit.client.0.smithi026.stdout:4/808: fsync d0/d12/da2/d97/d43/d49/de7/dfc/f10a 0 2024-05-09T00:07:55.536 INFO:tasks.workunit.client.0.smithi026.stdout:1/886: rename d5/d16/d60/d66 to d5/db/d108/d12b 0 2024-05-09T00:07:55.540 INFO:tasks.workunit.client.0.smithi026.stdout:4/809: mkdir d0/d83/d115 0 2024-05-09T00:07:55.544 INFO:tasks.workunit.client.0.smithi026.stdout:4/810: symlink d0/d12/da2/d97/d43/d49/de7/dfc/d106/l116 0 2024-05-09T00:07:55.549 INFO:tasks.workunit.client.0.smithi026.stdout:4/811: rmdir d0/d83 39 2024-05-09T00:07:55.576 INFO:tasks.workunit.client.0.smithi026.stdout:6/668: rename d15/d34/f53 to d15/d34/d52/d74/dd0/fe1 0 2024-05-09T00:07:55.579 INFO:tasks.workunit.client.0.smithi026.stdout:2/789: rename d14/d22/d55/da3/d20/db2/c27 to d14/d22/d55/da3/d20/c10d 0 2024-05-09T00:07:55.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/669: mkdir d15/d1e/d23/d3a/da6/de2 0 2024-05-09T00:07:55.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/670: fsync d15/d2b/d33/d55/f95 0 2024-05-09T00:07:55.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/671: write d15/d1e/d23/d73/d76/fd7 [935779,119112] 0 2024-05-09T00:07:55.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/672: fdatasync d15/d1e/d23/d3a/da6/fc5 0 2024-05-09T00:07:55.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/673: dread - d15/d1e/d23/d3a/da6/fc1 zero size 2024-05-09T00:07:55.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/674: dread - d15/d1e/d23/d73/d58/fa1 zero size 2024-05-09T00:07:55.585 INFO:tasks.workunit.client.0.smithi026.stdout:1/887: rename d5/d16/dd5/de4/f125 to d5/d16/dd5/f12c 0 2024-05-09T00:07:55.586 INFO:tasks.workunit.client.0.smithi026.stdout:2/790: truncate d14/d22/d55/da3/d20/fac 3536680 0 2024-05-09T00:07:55.587 INFO:tasks.workunit.client.0.smithi026.stdout:6/675: creat d15/d1e/d23/d3a/da6/de2/fe3 x:0 0 0 2024-05-09T00:07:55.589 INFO:tasks.workunit.client.0.smithi026.stdout:1/888: symlink d5/db/d108/d103/d110/l12d 0 2024-05-09T00:07:55.590 INFO:tasks.workunit.client.0.smithi026.stdout:1/889: write d5/dd/f49 [3329065,109238] 0 2024-05-09T00:07:55.591 INFO:tasks.workunit.client.0.smithi026.stdout:1/890: write d5/dd/d17/f112 [1526905,3554] 0 2024-05-09T00:07:55.592 INFO:tasks.workunit.client.0.smithi026.stdout:2/791: mkdir d14/d22/d55/deb/dfc/d10e 0 2024-05-09T00:07:55.596 INFO:tasks.workunit.client.0.smithi026.stdout:6/676: rename d15/d1e/d23/d73/l9c to d15/d1e/d30/d32/le4 0 2024-05-09T00:07:55.600 INFO:tasks.workunit.client.0.smithi026.stdout:5/775: mkdir d2/d8/d31/d2e/d109 0 2024-05-09T00:07:55.600 INFO:tasks.workunit.client.0.smithi026.stdout:5/776: write d2/fc [3189325,27999] 0 2024-05-09T00:07:55.602 INFO:tasks.workunit.client.0.smithi026.stdout:6/677: mkdir d15/d2b/d33/d55/d67/de5 0 2024-05-09T00:07:55.607 INFO:tasks.workunit.client.0.smithi026.stdout:4/812: mkdir d0/d12/d1b/d117 0 2024-05-09T00:07:55.607 INFO:tasks.workunit.client.0.smithi026.stdout:4/813: readlink d0/d12/da2/l80 0 2024-05-09T00:07:55.608 INFO:tasks.workunit.client.0.smithi026.stdout:6/678: rmdir d15/d2b/d33/d94 0 2024-05-09T00:07:55.609 INFO:tasks.workunit.client.0.smithi026.stdout:6/679: fsync d15/d34/d52/d8b/fa4 0 2024-05-09T00:07:55.609 INFO:tasks.workunit.client.0.smithi026.stdout:6/680: stat d15/d1e/d23/d73/d76/fd6 0 2024-05-09T00:07:55.611 INFO:tasks.workunit.client.0.smithi026.stdout:1/891: mknod d5/dd/d17/c12e 0 2024-05-09T00:07:55.611 INFO:tasks.workunit.client.0.smithi026.stdout:1/892: chown d5/c107 174841 1 2024-05-09T00:07:55.611 INFO:tasks.workunit.client.0.smithi026.stdout:4/814: mkdir d0/d12/d1b/d118 0 2024-05-09T00:07:55.612 INFO:tasks.workunit.client.0.smithi026.stdout:2/792: dwrite d14/d22/fe6 [0,4194304] 0 2024-05-09T00:07:55.612 INFO:tasks.workunit.client.0.smithi026.stdout:2/793: chown d14/d22/d55/da3/d3b/f3f 175265631 1 2024-05-09T00:07:55.613 INFO:tasks.workunit.client.0.smithi026.stdout:6/681: symlink d15/d1e/d23/d3a/da6/le6 0 2024-05-09T00:07:55.616 INFO:tasks.workunit.client.0.smithi026.stdout:4/815: mknod d0/d12/da2/d97/d43/d49/de7/dfc/c119 0 2024-05-09T00:07:55.616 INFO:tasks.workunit.client.0.smithi026.stdout:4/816: dread - d0/d12/d1b/f10d zero size 2024-05-09T00:07:55.618 INFO:tasks.workunit.client.0.smithi026.stdout:5/777: dwrite d2/d8/d31/d2e/ff4 [0,4194304] 0 2024-05-09T00:07:55.619 INFO:tasks.workunit.client.0.smithi026.stdout:5/778: fdatasync d2/d8/d31/d24/f65 0 2024-05-09T00:07:55.621 INFO:tasks.workunit.client.0.smithi026.stdout:4/817: mkdir d0/d12/da2/d97/dbf/dd1/d11a 0 2024-05-09T00:07:55.621 INFO:tasks.workunit.client.0.smithi026.stdout:4/818: read - d0/d12/da2/d97/d43/d58/f6b zero size 2024-05-09T00:07:55.629 INFO:tasks.workunit.client.0.smithi026.stdout:4/819: dread d0/d83/f76 [0,4194304] 0 2024-05-09T00:07:55.629 INFO:tasks.workunit.client.0.smithi026.stdout:2/794: dread d14/d22/d55/f9f [0,4194304] 0 2024-05-09T00:07:55.629 INFO:tasks.workunit.client.0.smithi026.stdout:4/820: write d0/d12/da2/d97/d43/d49/fb7 [205154,40833] 0 2024-05-09T00:07:55.630 INFO:tasks.workunit.client.0.smithi026.stdout:6/682: write f12 [8186697,90102] 0 2024-05-09T00:07:55.630 INFO:tasks.workunit.client.0.smithi026.stdout:6/683: chown d15/d34/d52/d8b/d4d/cbd 8 1 2024-05-09T00:07:55.630 INFO:tasks.workunit.client.0.smithi026.stdout:6/684: chown d15/d1e/d23/d73/f3c 216507878 1 2024-05-09T00:07:55.630 INFO:tasks.workunit.client.0.smithi026.stdout:1/893: dwrite d5/dd/f34 [0,4194304] 0 2024-05-09T00:07:55.630 INFO:tasks.workunit.client.0.smithi026.stdout:1/894: fdatasync d5/dd/fe 0 2024-05-09T00:07:55.631 INFO:tasks.workunit.client.0.smithi026.stdout:7/919: rmdir d8/d2e/d84/db4/dbc/d1e/d8a 39 2024-05-09T00:07:55.633 INFO:tasks.workunit.client.0.smithi026.stdout:1/895: link d5/db/d1d/ca2 d5/dd/d17/d73/d10c/c12f 0 2024-05-09T00:07:55.639 INFO:tasks.workunit.client.0.smithi026.stdout:1/896: symlink d5/dd/d17/d7b/de1/l130 0 2024-05-09T00:07:55.640 INFO:tasks.workunit.client.0.smithi026.stdout:7/920: dread d8/d2e/d84/db4/dbc/d1e/d3d/d6b/faa [0,4194304] 0 2024-05-09T00:07:55.642 INFO:tasks.workunit.client.0.smithi026.stdout:7/921: mknod d8/d2e/d126/d9a/d9f/d104/d116/c13c 0 2024-05-09T00:07:55.645 INFO:tasks.workunit.client.0.smithi026.stdout:5/779: rename d2/f3 to d2/d8/d6d/f10a 0 2024-05-09T00:07:55.647 INFO:tasks.workunit.client.0.smithi026.stdout:1/897: dread d5/d16/dd5/de4/f11f [0,4194304] 0 2024-05-09T00:07:55.647 INFO:tasks.workunit.client.0.smithi026.stdout:6/685: dread d15/d1e/d23/d73/d76/fb7 [0,4194304] 0 2024-05-09T00:07:55.648 INFO:tasks.workunit.client.0.smithi026.stdout:6/686: read d15/d1e/d23/f8a [1220417,59491] 0 2024-05-09T00:07:55.648 INFO:tasks.workunit.client.0.smithi026.stdout:6/687: write d15/d1e/d23/d73/d76/f8d [24273,62295] 0 2024-05-09T00:07:55.650 INFO:tasks.workunit.client.0.smithi026.stdout:4/821: dwrite d0/d12/f79 [0,4194304] 0 2024-05-09T00:07:55.650 INFO:tasks.workunit.client.0.smithi026.stdout:4/822: dread - d0/d12/da2/d97/d43/fea zero size 2024-05-09T00:07:55.650 INFO:tasks.workunit.client.0.smithi026.stdout:4/823: chown d0/d12/da2/d97/dbf/dd1/d11a 10064691 1 2024-05-09T00:07:55.650 INFO:tasks.workunit.client.0.smithi026.stdout:2/795: rename d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/lf6 to d14/d22/d55/da3/d20/d41/d51/d82/daa/l10f 0 2024-05-09T00:07:55.650 INFO:tasks.workunit.client.0.smithi026.stdout:4/824: write d0/d83/f9e [577785,49992] 0 2024-05-09T00:07:55.651 INFO:tasks.workunit.client.0.smithi026.stdout:5/780: creat d2/d5a/d96/f10b x:0 0 0 2024-05-09T00:07:55.651 INFO:tasks.workunit.client.0.smithi026.stdout:4/825: write d0/d12/da2/d97/f1e [895210,115237] 0 2024-05-09T00:07:55.653 INFO:tasks.workunit.client.0.smithi026.stdout:1/898: creat d5/d16/d60/dda/f131 x:0 0 0 2024-05-09T00:07:55.657 INFO:tasks.workunit.client.0.smithi026.stdout:6/688: truncate d15/d1e/d30/f3f 374090 0 2024-05-09T00:07:55.665 INFO:tasks.workunit.client.0.smithi026.stdout:1/899: dread d5/dd/f34 [0,4194304] 0 2024-05-09T00:07:55.666 INFO:tasks.workunit.client.0.smithi026.stdout:1/900: chown d5/db/d108/d103/fc4 1662213122 1 2024-05-09T00:07:55.666 INFO:tasks.workunit.client.0.smithi026.stdout:1/901: truncate d5/dd/d17/d9f/dc6/fed 59234 0 2024-05-09T00:07:55.666 INFO:tasks.workunit.client.0.smithi026.stdout:1/902: write d5/f2c [388652,73794] 0 2024-05-09T00:07:55.666 INFO:tasks.workunit.client.0.smithi026.stdout:2/796: creat d14/d22/d55/da3/d20/d41/d51/d82/daa/f110 x:0 0 0 2024-05-09T00:07:55.691 INFO:tasks.workunit.client.0.smithi026.stdout:1/903: dwrite d5/d16/f18 [0,4194304] 0 2024-05-09T00:07:55.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/689: creat d15/d1e/d30/fe7 x:0 0 0 2024-05-09T00:07:55.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/690: readlink d15/d1e/l5f 0 2024-05-09T00:07:55.699 INFO:tasks.workunit.client.0.smithi026.stdout:1/904: dread f4 [8388608,4194304] 0 2024-05-09T00:07:55.708 INFO:tasks.workunit.client.0.smithi026.stdout:4/826: dwrite d0/f22 [0,4194304] 0 2024-05-09T00:07:55.721 INFO:tasks.workunit.client.0.smithi026.stdout:1/905: dwrite d5/db/d108/d12b/f76 [0,4194304] 0 2024-05-09T00:07:55.721 INFO:tasks.workunit.client.0.smithi026.stdout:7/922: rename d8/d2e/d84/db4/dbc/d1e/d3d/ce7 to d8/d2e/d84/db4/dbc/d22/d29/c13d 0 2024-05-09T00:07:55.723 INFO:tasks.workunit.client.0.smithi026.stdout:4/827: dwrite d0/d12/d1b/f5f [0,4194304] 0 2024-05-09T00:07:55.723 INFO:tasks.workunit.client.0.smithi026.stdout:2/797: mkdir d14/d22/d55/da3/d111 0 2024-05-09T00:07:55.725 INFO:tasks.workunit.client.0.smithi026.stdout:6/691: rmdir d15/d1e/d23/d6f 39 2024-05-09T00:07:55.725 INFO:tasks.workunit.client.0.smithi026.stdout:6/692: write f4 [5198165,54440] 0 2024-05-09T00:07:55.729 INFO:tasks.workunit.client.0.smithi026.stdout:1/906: link d5/f2c d5/dd/d17/d7b/de1/f132 0 2024-05-09T00:07:55.730 INFO:tasks.workunit.client.0.smithi026.stdout:7/923: creat d8/d2e/d84/db4/dbc/d22/d105/f13e x:0 0 0 2024-05-09T00:07:55.732 INFO:tasks.workunit.client.0.smithi026.stdout:4/828: getdents d0/d12/da2/d97/d43/d58/db3 0 2024-05-09T00:07:55.736 INFO:tasks.workunit.client.0.smithi026.stdout:6/693: dread d15/d2b/d33/f51 [0,4194304] 0 2024-05-09T00:07:55.738 INFO:tasks.workunit.client.0.smithi026.stdout:1/907: mkdir d5/db/d108/d103/d110/d133 0 2024-05-09T00:07:55.739 INFO:tasks.workunit.client.0.smithi026.stdout:7/924: mkdir d8/d2e/d126/d9a/df4/d13f 0 2024-05-09T00:07:55.739 INFO:tasks.workunit.client.0.smithi026.stdout:2/798: dread d14/d22/d55/da3/d20/f2a [0,4194304] 0 2024-05-09T00:07:55.742 INFO:tasks.workunit.client.0.smithi026.stdout:6/694: rmdir d15/d1e/d23/d73/d58/dcd 0 2024-05-09T00:07:55.742 INFO:tasks.workunit.client.0.smithi026.stdout:6/695: chown d15/d2b/d33/d55/d67/d90/fc9 329722 1 2024-05-09T00:07:55.743 INFO:tasks.workunit.client.0.smithi026.stdout:6/696: stat d15/d2b/d33/d7d 0 2024-05-09T00:07:55.743 INFO:tasks.workunit.client.0.smithi026.stdout:6/697: readlink d15/d1e/d23/d73/d58/d5c/lb1 0 2024-05-09T00:07:55.743 INFO:tasks.workunit.client.0.smithi026.stdout:6/698: chown d15/d1e/d30/f86 954652 1 2024-05-09T00:07:55.745 INFO:tasks.workunit.client.0.smithi026.stdout:7/925: mkdir d8/d2e/d84/db4/dbc/d22/d105/d140 0 2024-05-09T00:07:55.747 INFO:tasks.workunit.client.0.smithi026.stdout:2/799: creat d14/d22/d55/da3/d20/d10a/f112 x:0 0 0 2024-05-09T00:07:55.748 INFO:tasks.workunit.client.0.smithi026.stdout:6/699: rmdir d15/d2b/d33/d55/d67/dd2 39 2024-05-09T00:07:55.749 INFO:tasks.workunit.client.0.smithi026.stdout:7/926: stat d8/d2e/d84/db4/dbc/d22/d29/c13d 0 2024-05-09T00:07:55.750 INFO:tasks.workunit.client.0.smithi026.stdout:2/800: symlink d14/d22/d55/da3/d30/d6a/dd6/l113 0 2024-05-09T00:07:55.750 INFO:tasks.workunit.client.0.smithi026.stdout:2/801: chown d14/d22/d55/da3/d20/d41 6 1 2024-05-09T00:07:55.751 INFO:tasks.workunit.client.0.smithi026.stdout:2/802: fsync f9 0 2024-05-09T00:07:55.751 INFO:tasks.workunit.client.0.smithi026.stdout:2/803: write d14/d22/d55/f56 [6118535,124856] 0 2024-05-09T00:07:55.752 INFO:tasks.workunit.client.0.smithi026.stdout:6/700: mkdir d15/d34/d52/d8b/d4d/de8 0 2024-05-09T00:07:55.752 INFO:tasks.workunit.client.0.smithi026.stdout:6/701: chown d15/d1e/d23/d73/c39 5554 1 2024-05-09T00:07:55.753 INFO:tasks.workunit.client.0.smithi026.stdout:7/927: unlink d8/d2e/d84/db4/dbc/d22/l44 0 2024-05-09T00:07:55.755 INFO:tasks.workunit.client.0.smithi026.stdout:6/702: truncate d15/d1e/d23/d73/f28 2832698 0 2024-05-09T00:07:55.756 INFO:tasks.workunit.client.0.smithi026.stdout:7/928: rename d8/d2e/d126/d9a/d9f/f131 to d8/d2e/d126/f141 0 2024-05-09T00:07:55.759 INFO:tasks.workunit.client.0.smithi026.stdout:7/929: creat d8/d2e/d84/db4/dbc/f142 x:0 0 0 2024-05-09T00:07:55.760 INFO:tasks.workunit.client.0.smithi026.stdout:5/781: truncate d2/f72 3354637 0 2024-05-09T00:07:55.760 INFO:tasks.workunit.client.0.smithi026.stdout:1/908: dwrite d5/dd/d17/d7b/de1/ff4 [0,4194304] 0 2024-05-09T00:07:55.761 INFO:tasks.workunit.client.0.smithi026.stdout:1/909: fdatasync d5/dd/d17/fbe 0 2024-05-09T00:07:55.761 INFO:tasks.workunit.client.0.smithi026.stdout:4/829: dwrite d0/d12/da2/d97/d43/d49/d8f/fa6 [0,4194304] 0 2024-05-09T00:07:55.763 INFO:tasks.workunit.client.0.smithi026.stdout:4/830: write d0/d12/da2/d97/f1e [3390853,97180] 0 2024-05-09T00:07:55.764 INFO:tasks.workunit.client.0.smithi026.stdout:7/930: write d8/d1b/d89/fa6 [2038812,64763] 0 2024-05-09T00:07:55.766 INFO:tasks.workunit.client.0.smithi026.stdout:1/910: getdents d5/d16/dd5/de4 0 2024-05-09T00:07:55.768 INFO:tasks.workunit.client.0.smithi026.stdout:6/703: dread d15/d1e/d23/d73/f3c [0,4194304] 0 2024-05-09T00:07:55.768 INFO:tasks.workunit.client.0.smithi026.stdout:6/704: readlink d15/d1e/d23/d73/d58/d5c/ld1 0 2024-05-09T00:07:55.770 INFO:tasks.workunit.client.0.smithi026.stdout:4/831: symlink d0/d12/da2/d97/d43/d49/de7/dfc/l11b 0 2024-05-09T00:07:55.771 INFO:tasks.workunit.client.0.smithi026.stdout:1/911: rmdir d5/dd/d17/d9f/da5 39 2024-05-09T00:07:55.772 INFO:tasks.workunit.client.0.smithi026.stdout:1/912: mkdir d5/d16/dd5/de4/d134 0 2024-05-09T00:07:55.772 INFO:tasks.workunit.client.0.smithi026.stdout:1/913: readlink d5/db/d1d/l5a 0 2024-05-09T00:07:55.776 INFO:tasks.workunit.client.0.smithi026.stdout:4/832: dread d0/d12/da2/d97/dbf/fca [0,4194304] 0 2024-05-09T00:07:55.779 INFO:tasks.workunit.client.0.smithi026.stdout:4/833: symlink d0/d12/da2/d97/d43/d58/db3/l11c 0 2024-05-09T00:07:55.779 INFO:tasks.workunit.client.0.smithi026.stdout:4/834: chown d0/d12/da2/d97/d43/d49/d8f/dc1/c10f 0 1 2024-05-09T00:07:55.781 INFO:tasks.workunit.client.0.smithi026.stdout:4/835: mknod d0/d12/da2/d97/d43/d49/d8f/c11d 0 2024-05-09T00:07:55.782 INFO:tasks.workunit.client.0.smithi026.stdout:6/705: dread d15/d1e/d23/d73/d58/f61 [0,4194304] 0 2024-05-09T00:07:55.784 INFO:tasks.workunit.client.0.smithi026.stdout:4/836: creat d0/d12/da2/d97/d43/d49/d8f/da3/d86/f11e x:0 0 0 2024-05-09T00:07:55.784 INFO:tasks.workunit.client.0.smithi026.stdout:5/782: dwrite d2/d8/d31/fc1 [0,4194304] 0 2024-05-09T00:07:55.785 INFO:tasks.workunit.client.0.smithi026.stdout:6/706: symlink d15/d62/ddc/le9 0 2024-05-09T00:07:55.787 INFO:tasks.workunit.client.0.smithi026.stdout:4/837: unlink d0/d12/da2/fba 0 2024-05-09T00:07:55.791 INFO:tasks.workunit.client.0.smithi026.stdout:5/783: mknod d2/d5a/d96/de5/c10c 0 2024-05-09T00:07:55.792 INFO:tasks.workunit.client.0.smithi026.stdout:7/931: dwrite d8/d2e/d84/db4/dbc/f7f [4194304,4194304] 0 2024-05-09T00:07:55.792 INFO:tasks.workunit.client.0.smithi026.stdout:4/838: getdents d0/d12/d1b 0 2024-05-09T00:07:55.793 INFO:tasks.workunit.client.0.smithi026.stdout:5/784: mkdir d2/d8/d10d 0 2024-05-09T00:07:55.793 INFO:tasks.workunit.client.0.smithi026.stdout:1/914: dwrite d5/dd/d17/f8b [0,4194304] 0 2024-05-09T00:07:55.794 INFO:tasks.workunit.client.0.smithi026.stdout:7/932: mknod d8/d2e/d84/db4/dbc/d1e/d8a/d120/d11d/c143 0 2024-05-09T00:07:55.794 INFO:tasks.workunit.client.0.smithi026.stdout:7/933: write d8/d2e/d84/db4/dbc/d1e/d3d/ff8 [5125381,50964] 0 2024-05-09T00:07:55.794 INFO:tasks.workunit.client.0.smithi026.stdout:7/934: readlink d8/d2e/d84/db4/dbc/d22/l109 0 2024-05-09T00:07:55.798 INFO:tasks.workunit.client.0.smithi026.stdout:4/839: dread d0/d12/da2/d97/d43/d49/f54 [0,4194304] 0 2024-05-09T00:07:55.799 INFO:tasks.workunit.client.0.smithi026.stdout:5/785: getdents d2/d8/d31/d2e/d35 0 2024-05-09T00:07:55.799 INFO:tasks.workunit.client.0.smithi026.stdout:5/786: readlink d2/d8/d31/d32/da2/dac/lc5 0 2024-05-09T00:07:55.799 INFO:tasks.workunit.client.0.smithi026.stdout:5/787: truncate d2/d8/d31/d32/d48/db3/ff6 228077 0 2024-05-09T00:07:55.799 INFO:tasks.workunit.client.0.smithi026.stdout:5/788: readlink d2/la 0 2024-05-09T00:07:55.799 INFO:tasks.workunit.client.0.smithi026.stdout:5/789: fdatasync d2/d5a/d96/f8e 0 2024-05-09T00:07:55.799 INFO:tasks.workunit.client.0.smithi026.stdout:5/790: write d2/d8/d31/d24/fd3 [872905,107606] 0 2024-05-09T00:07:55.804 INFO:tasks.workunit.client.0.smithi026.stdout:7/935: symlink d8/d1b/l144 0 2024-05-09T00:07:55.805 INFO:tasks.workunit.client.0.smithi026.stdout:5/791: rmdir d2/d8/d31/d32/d48 39 2024-05-09T00:07:55.808 INFO:tasks.workunit.client.0.smithi026.stdout:7/936: link d8/d2e/d84/db4/dbc/f142 d8/d2e/d84/f145 0 2024-05-09T00:07:55.810 INFO:tasks.workunit.client.0.smithi026.stdout:5/792: symlink d2/d8/d31/l10e 0 2024-05-09T00:07:55.813 INFO:tasks.workunit.client.0.smithi026.stdout:5/793: creat d2/d8/d31/f10f x:0 0 0 2024-05-09T00:07:55.816 INFO:tasks.workunit.client.0.smithi026.stdout:5/794: symlink d2/d5a/d104/l110 0 2024-05-09T00:07:55.817 INFO:tasks.workunit.client.0.smithi026.stdout:5/795: chown d2/d8/d31/d32/fee 456635 1 2024-05-09T00:07:55.817 INFO:tasks.workunit.client.0.smithi026.stdout:5/796: chown d2 0 1 2024-05-09T00:07:55.817 INFO:tasks.workunit.client.0.smithi026.stdout:5/797: fdatasync d2/d8/d2a/d8d/fb9 0 2024-05-09T00:07:55.820 INFO:tasks.workunit.client.0.smithi026.stdout:4/840: dwrite d0/d12/da2/d97/d43/d58/fbc [0,4194304] 0 2024-05-09T00:07:55.822 INFO:tasks.workunit.client.0.smithi026.stdout:5/798: rename d2/d8/d31/d32/d5c/dd7 to d2/d8/d2a/d111 0 2024-05-09T00:07:55.825 INFO:tasks.workunit.client.0.smithi026.stdout:4/841: truncate d0/d12/da2/d97/d43/f9b 225627 0 2024-05-09T00:07:55.826 INFO:tasks.workunit.client.0.smithi026.stdout:5/799: creat d2/d8/d2a/d8d/f112 x:0 0 0 2024-05-09T00:07:55.826 INFO:tasks.workunit.client.0.smithi026.stdout:5/800: stat d2/d8/d31/d2e/d4a/f3d 0 2024-05-09T00:07:55.826 INFO:tasks.workunit.client.0.smithi026.stdout:4/842: dread d0/d12/d1b/f3c [0,4194304] 0 2024-05-09T00:07:55.830 INFO:tasks.workunit.client.0.smithi026.stdout:5/801: truncate d2/d8/d2a/f88 1136877 0 2024-05-09T00:07:55.832 INFO:tasks.workunit.client.0.smithi026.stdout:4/843: link d0/d12/c42 d0/d12/d87/c11f 0 2024-05-09T00:07:55.833 INFO:tasks.workunit.client.0.smithi026.stdout:4/844: dread - d0/d12/da2/f85 zero size 2024-05-09T00:07:55.833 INFO:tasks.workunit.client.0.smithi026.stdout:7/937: dwrite d8/d2e/d84/db4/dbc/ffd [0,4194304] 0 2024-05-09T00:07:55.835 INFO:tasks.workunit.client.0.smithi026.stdout:7/938: read d8/d2e/d84/db4/dbc/d1e/d3d/d6b/faa [993235,95152] 0 2024-05-09T00:07:55.835 INFO:tasks.workunit.client.0.smithi026.stdout:7/939: chown d8/d2e/d84/db4/dbc/d1e/d3d/c10f 361 1 2024-05-09T00:07:55.836 INFO:tasks.workunit.client.0.smithi026.stdout:4/845: truncate d0/d12/da2/d97/d43/d49/d8f/da3/d66/fb9 433835 0 2024-05-09T00:07:55.839 INFO:tasks.workunit.client.0.smithi026.stdout:5/802: dread d2/f44 [0,4194304] 0 2024-05-09T00:07:55.839 INFO:tasks.workunit.client.0.smithi026.stdout:5/803: chown d2/d8/d31/d2e/d35/c38 16 1 2024-05-09T00:07:55.843 INFO:tasks.workunit.client.0.smithi026.stdout:7/940: creat d8/d2e/d126/d9a/f146 x:0 0 0 2024-05-09T00:07:55.847 INFO:tasks.workunit.client.0.smithi026.stdout:7/941: write d8/d2e/d84/db4/dbc/f7f [2809726,22280] 0 2024-05-09T00:07:55.847 INFO:tasks.workunit.client.0.smithi026.stdout:7/942: fdatasync d8/d2e/d126/f99 0 2024-05-09T00:07:55.865 INFO:tasks.workunit.client.0.smithi026.stdout:7/943: rename d8/d2e/d84/db4/dbc/d22/d29 to d8/d2e/d126/d9a/d9f/d104/d147 0 2024-05-09T00:07:55.866 INFO:tasks.workunit.client.0.smithi026.stdout:5/804: dwrite d2/f41 [0,4194304] 0 2024-05-09T00:07:55.868 INFO:tasks.workunit.client.0.smithi026.stdout:7/944: mkdir d8/d2e/d84/db4/dbc/d1e/d3d/d6b/d12a/d148 0 2024-05-09T00:07:55.875 INFO:tasks.workunit.client.0.smithi026.stdout:5/805: write d2/d8/d2a/d8d/fb9 [1756970,33416] 0 2024-05-09T00:07:55.876 INFO:tasks.workunit.client.0.smithi026.stdout:5/806: write d2/d8/d2a/d8d/fb9 [195384,10851] 0 2024-05-09T00:07:55.876 INFO:tasks.workunit.client.0.smithi026.stdout:5/807: fsync d2/d8/f8b 0 2024-05-09T00:07:55.877 INFO:tasks.workunit.client.0.smithi026.stdout:5/808: chown d2/d8/c4c 127347 1 2024-05-09T00:07:55.880 INFO:tasks.workunit.client.0.smithi026.stdout:7/945: dread d8/d2e/d84/db4/dbc/fd2 [0,4194304] 0 2024-05-09T00:07:55.880 INFO:tasks.workunit.client.0.smithi026.stdout:7/946: chown d8/d1b/d89 47881726 1 2024-05-09T00:07:55.884 INFO:tasks.workunit.client.0.smithi026.stdout:5/809: rename d2/d8/d31/l23 to d2/d8/d31/d24/l113 0 2024-05-09T00:07:55.886 INFO:tasks.workunit.client.0.smithi026.stdout:7/947: mknod d8/d2e/d126/d9a/d9f/d104/d147/d111/d135/c149 0 2024-05-09T00:07:55.889 INFO:tasks.workunit.client.0.smithi026.stdout:5/810: unlink d2/d8/d31/d2e/d33/f61 0 2024-05-09T00:07:55.891 INFO:tasks.workunit.client.0.smithi026.stdout:5/811: mknod d2/d5a/d96/c114 0 2024-05-09T00:07:55.895 INFO:tasks.workunit.client.0.smithi026.stdout:7/948: dread d8/d2e/d84/db4/dbc/d1e/d3d/d6b/db2/fa8 [0,4194304] 0 2024-05-09T00:07:55.899 INFO:tasks.workunit.client.0.smithi026.stdout:7/949: rmdir d8/d1b/d89/dc1 39 2024-05-09T00:07:55.900 INFO:tasks.workunit.client.0.smithi026.stdout:7/950: write d8/d2e/d84/db4/dbc/d22/f85 [1158181,125975] 0 2024-05-09T00:07:55.914 INFO:tasks.workunit.client.0.smithi026.stdout:7/951: dread d8/d2e/d84/db4/dbc/d1e/fec [0,4194304] 0 2024-05-09T00:07:55.916 INFO:tasks.workunit.client.0.smithi026.stdout:7/952: rename d8/d1b/f13b to d8/d2e/d84/f14a 0 2024-05-09T00:07:55.918 INFO:tasks.workunit.client.0.smithi026.stdout:7/953: read d8/d2e/d126/d9a/d9f/d104/d147/f18 [454871,101186] 0 2024-05-09T00:07:55.918 INFO:tasks.workunit.client.0.smithi026.stdout:7/954: truncate d8/fc8 920549 0 2024-05-09T00:07:55.919 INFO:tasks.workunit.client.0.smithi026.stdout:5/812: dwrite d2/d8/d2a/f4f [0,4194304] 0 2024-05-09T00:07:55.919 INFO:tasks.workunit.client.0.smithi026.stdout:5/813: write d2/d8/d31/d32/d48/db3/ff6 [455218,121953] 0 2024-05-09T00:07:55.922 INFO:tasks.workunit.client.0.smithi026.stdout:7/955: symlink d8/d2e/d84/db4/dbc/d1e/d8a/d120/l14b 0 2024-05-09T00:07:55.926 INFO:tasks.workunit.client.0.smithi026.stdout:5/814: rename d2/d8/d2a/le3 to d2/d8/d31/d32/d48/l115 0 2024-05-09T00:07:55.944 INFO:tasks.workunit.client.0.smithi026.stdout:7/956: dwrite d8/d2e/d84/db4/dbc/d1e/d80/da2/fdf [0,4194304] 0 2024-05-09T00:07:55.945 INFO:tasks.workunit.client.0.smithi026.stdout:5/815: dwrite d2/d8/d31/d24/fd3 [0,4194304] 0 2024-05-09T00:07:55.947 INFO:tasks.workunit.client.0.smithi026.stdout:7/957: rmdir d8/d1b/d89/dc1 39 2024-05-09T00:07:55.948 INFO:tasks.workunit.client.0.smithi026.stdout:7/958: read d8/d2e/d126/d9a/fc4 [617008,34405] 0 2024-05-09T00:07:55.951 INFO:tasks.workunit.client.0.smithi026.stdout:5/816: creat d2/d8/d31/d2e/d33/f116 x:0 0 0 2024-05-09T00:07:55.955 INFO:tasks.workunit.client.0.smithi026.stdout:7/959: dread d8/d2e/d84/db4/dbc/d1e/d3d/f48 [0,4194304] 0 2024-05-09T00:07:55.955 INFO:tasks.workunit.client.0.smithi026.stdout:7/960: chown d8/d2e/d84/db4/dbc/f142 1611159 1 2024-05-09T00:07:55.962 INFO:tasks.workunit.client.0.smithi026.stdout:8/870: sync 2024-05-09T00:07:55.963 INFO:tasks.workunit.client.0.smithi026.stdout:8/871: rmdir de/d60 39 2024-05-09T00:07:55.964 INFO:tasks.workunit.client.0.smithi026.stdout:8/872: mknod de/d6c/d31/d4f/d87/d62/daa/c128 0 2024-05-09T00:07:55.971 INFO:tasks.workunit.client.0.smithi026.stdout:8/873: dread de/d17/d21/d24/d5b/f98 [0,4194304] 0 2024-05-09T00:07:55.972 INFO:tasks.workunit.client.0.smithi026.stdout:8/874: rmdir de/d17/d21/d24/d3b 39 2024-05-09T00:07:55.972 INFO:tasks.workunit.client.0.smithi026.stdout:8/875: fsync de/d6c/d31/d4f/df1/dfc/f127 0 2024-05-09T00:07:55.973 INFO:tasks.workunit.client.0.smithi026.stdout:5/817: dwrite d2/d8/d31/d2e/d33/f116 [0,4194304] 0 2024-05-09T00:07:55.974 INFO:tasks.workunit.client.0.smithi026.stdout:5/818: write d2/d8/d6d/f7d [298245,55010] 0 2024-05-09T00:07:55.974 INFO:tasks.workunit.client.0.smithi026.stdout:5/819: readlink d2/d5a/l7c 0 2024-05-09T00:07:55.974 INFO:tasks.workunit.client.0.smithi026.stdout:8/876: mkdir de/d6c/d31/d4f/deb/dfb/d129 0 2024-05-09T00:07:55.979 INFO:tasks.workunit.client.0.smithi026.stdout:8/877: rmdir de 39 2024-05-09T00:07:55.981 INFO:tasks.workunit.client.0.smithi026.stdout:8/878: creat de/d6c/d31/d4f/df1/dfc/d11d/f12a x:0 0 0 2024-05-09T00:07:55.981 INFO:tasks.workunit.client.0.smithi026.stdout:8/879: fdatasync de/d17/f69 0 2024-05-09T00:07:55.982 INFO:tasks.workunit.client.0.smithi026.stdout:8/880: mkdir de/d6c/d31/d4f/d87/d12b 0 2024-05-09T00:07:55.985 INFO:tasks.workunit.client.0.smithi026.stdout:8/881: symlink de/d6c/d31/d4f/d87/l12c 0 2024-05-09T00:07:55.985 INFO:tasks.workunit.client.0.smithi026.stdout:8/882: write de/d17/d21/d6f/f93 [1241541,114513] 0 2024-05-09T00:07:55.986 INFO:tasks.workunit.client.0.smithi026.stdout:7/961: dwrite d8/d2e/d126/f99 [0,4194304] 0 2024-05-09T00:07:55.986 INFO:tasks.workunit.client.0.smithi026.stdout:7/962: chown d8/d2e/d84/db4/ldb 47290 1 2024-05-09T00:07:55.990 INFO:tasks.workunit.client.0.smithi026.stdout:5/820: dwrite d2/d8/d2a/fe6 [0,4194304] 0 2024-05-09T00:07:55.990 INFO:tasks.workunit.client.0.smithi026.stdout:5/821: write d2/d8/d2a/d8d/f112 [940580,114973] 0 2024-05-09T00:07:56.002 INFO:tasks.workunit.client.0.smithi026.stdout:7/963: dwrite d8/d2e/d84/ff3 [0,4194304] 0 2024-05-09T00:07:56.002 INFO:tasks.workunit.client.0.smithi026.stdout:7/964: chown d8/d2e/d84/db4/dbc/d1e/d3d/c10f 326474860 1 2024-05-09T00:07:56.057 INFO:tasks.workunit.client.0.smithi026.stdout:8/883: rename de/dd9/d116/dd2/dee/f108 to de/d48/d3e/dc4/f12d 0 2024-05-09T00:07:56.058 INFO:tasks.workunit.client.0.smithi026.stdout:8/884: write de/d48/d3e/dc4/f12d [4436739,101674] 0 2024-05-09T00:07:56.064 INFO:tasks.workunit.client.0.smithi026.stdout:5/822: mknod d2/d8/d31/d32/d48/c117 0 2024-05-09T00:07:56.069 INFO:tasks.workunit.client.0.smithi026.stdout:7/965: truncate d8/d2e/d84/db4/dbc/f50 3602692 0 2024-05-09T00:07:56.073 INFO:tasks.workunit.client.0.smithi026.stdout:8/885: rename de/dd9/d116/dd2/c120 to de/d6c/d31/d4f/deb/dfb/d129/c12e 0 2024-05-09T00:07:56.082 INFO:tasks.workunit.client.0.smithi026.stdout:5/823: truncate d2/f41 1340187 0 2024-05-09T00:07:56.082 INFO:tasks.workunit.client.0.smithi026.stdout:5/824: write d2/d8/fce [262682,95587] 0 2024-05-09T00:07:56.082 INFO:tasks.workunit.client.0.smithi026.stdout:5/825: read - d2/d8/d31/d32/d48/db3/fd4 zero size 2024-05-09T00:07:56.084 INFO:tasks.workunit.client.0.smithi026.stdout:8/886: symlink de/d17/d21/d6f/d107/l12f 0 2024-05-09T00:07:56.087 INFO:tasks.workunit.client.0.smithi026.stdout:5/826: mknod d2/d8/d31/d2e/c118 0 2024-05-09T00:07:56.091 INFO:tasks.workunit.client.0.smithi026.stdout:8/887: unlink de/ff 0 2024-05-09T00:07:56.091 INFO:tasks.workunit.client.0.smithi026.stdout:5/827: dread d2/d8/d31/d32/d48/db3/fb7 [0,4194304] 0 2024-05-09T00:07:56.093 INFO:tasks.workunit.client.0.smithi026.stdout:5/828: write d2/d5a/d96/fa5 [4461112,49163] 0 2024-05-09T00:07:56.093 INFO:tasks.workunit.client.0.smithi026.stdout:5/829: stat d2/d8/d2a/d8d/lf3 0 2024-05-09T00:07:56.093 INFO:tasks.workunit.client.0.smithi026.stdout:5/830: write d2/d8/d31/d24/f105 [844208,94750] 0 2024-05-09T00:07:56.094 INFO:tasks.workunit.client.0.smithi026.stdout:5/831: dread d2/d8/d2a/d111/fd9 [0,4194304] 0 2024-05-09T00:07:56.094 INFO:tasks.workunit.client.0.smithi026.stdout:8/888: unlink de/d6c/d31/d4f/d87/d62/daa/lb7 0 2024-05-09T00:07:56.094 INFO:tasks.workunit.client.0.smithi026.stdout:5/832: dread - d2/d8/d31/d2e/d79/f86 zero size 2024-05-09T00:07:56.097 INFO:tasks.workunit.client.0.smithi026.stdout:8/889: rmdir de/d48/d3e/dc4/dc7 39 2024-05-09T00:07:56.101 INFO:tasks.workunit.client.0.smithi026.stdout:5/833: rename d2/d8/c7a to d2/d8/d31/d63/c119 0 2024-05-09T00:07:56.104 INFO:tasks.workunit.client.0.smithi026.stdout:8/890: symlink de/dd9/d116/dd2/dee/l130 0 2024-05-09T00:07:56.111 INFO:tasks.workunit.client.0.smithi026.stdout:5/834: dread d2/d8/d2a/fe6 [0,4194304] 0 2024-05-09T00:07:56.111 INFO:tasks.workunit.client.0.smithi026.stdout:5/835: chown d2/d8/d6d/la7 14 1 2024-05-09T00:07:56.112 INFO:tasks.workunit.client.0.smithi026.stdout:5/836: link d2/d5a/d96/f93 d2/f11a 0 2024-05-09T00:07:56.113 INFO:tasks.workunit.client.0.smithi026.stdout:8/891: dread de/d17/d21/d24/f26 [0,4194304] 0 2024-05-09T00:07:56.113 INFO:tasks.workunit.client.0.smithi026.stdout:5/837: creat d2/d8/d31/d2e/d109/f11b x:0 0 0 2024-05-09T00:07:56.114 INFO:tasks.workunit.client.0.smithi026.stdout:8/892: mkdir de/dd9/d116/dd2/dee/d131 0 2024-05-09T00:07:56.116 INFO:tasks.workunit.client.0.smithi026.stdout:8/893: symlink de/dd9/d116/l132 0 2024-05-09T00:07:56.134 INFO:tasks.workunit.client.0.smithi026.stdout:8/894: dwrite de/d17/d21/d24/d5b/fbf [0,4194304] 0 2024-05-09T00:07:56.136 INFO:tasks.workunit.client.0.smithi026.stdout:8/895: unlink de/d6c/d31/d4f/d87/d62/daa/ddb/d91/fab 0 2024-05-09T00:07:56.137 INFO:tasks.workunit.client.0.smithi026.stdout:8/896: creat de/d6c/d31/d4f/dbb/f133 x:0 0 0 2024-05-09T00:07:56.139 INFO:tasks.workunit.client.0.smithi026.stdout:8/897: creat de/d6c/db5/f134 x:0 0 0 2024-05-09T00:07:56.156 INFO:tasks.workunit.client.0.smithi026.stdout:8/898: dwrite de/d48/f52 [0,4194304] 0 2024-05-09T00:07:56.176 INFO:tasks.workunit.client.0.smithi026.stdout:8/899: dwrite de/f13 [4194304,4194304] 0 2024-05-09T00:07:56.178 INFO:tasks.workunit.client.0.smithi026.stdout:8/900: creat de/d6c/d31/d4f/df1/dfc/f135 x:0 0 0 2024-05-09T00:07:56.180 INFO:tasks.workunit.client.0.smithi026.stdout:8/901: creat de/d48/d3e/d54/d115/f136 x:0 0 0 2024-05-09T00:07:56.181 INFO:tasks.workunit.client.0.smithi026.stdout:8/902: creat de/d48/d3e/dc4/f137 x:0 0 0 2024-05-09T00:07:56.197 INFO:tasks.workunit.client.0.smithi026.stdout:8/903: dwrite de/d6c/d31/d4f/d87/d62/daa/ddb/d91/fc9 [0,4194304] 0 2024-05-09T00:07:56.197 INFO:tasks.workunit.client.0.smithi026.stdout:3/647: sync 2024-05-09T00:07:56.197 INFO:tasks.workunit.client.0.smithi026.stdout:9/880: sync 2024-05-09T00:07:56.198 INFO:tasks.workunit.client.0.smithi026.stdout:3/648: write d5/d9/dc/d5d/f6c [1541723,32609] 0 2024-05-09T00:07:56.202 INFO:tasks.workunit.client.0.smithi026.stdout:9/881: creat d7/d23/d2f/f131 x:0 0 0 2024-05-09T00:07:56.206 INFO:tasks.workunit.client.0.smithi026.stdout:3/649: unlink d5/d9/dc/d28/f4c 0 2024-05-09T00:07:56.207 INFO:tasks.workunit.client.0.smithi026.stdout:8/904: link de/f5d de/d48/f138 0 2024-05-09T00:07:56.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/882: creat d7/d23/d2f/d3a/db5/f132 x:0 0 0 2024-05-09T00:07:56.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/883: dread - d7/d23/d2f/f131 zero size 2024-05-09T00:07:56.210 INFO:tasks.workunit.client.0.smithi026.stdout:3/650: mkdir d5/d44/dd9 0 2024-05-09T00:07:56.212 INFO:tasks.workunit.client.0.smithi026.stdout:3/651: mkdir d5/d1e/d3e/dda 0 2024-05-09T00:07:56.239 INFO:tasks.workunit.client.0.smithi026.stdout:8/905: dwrite de/d6c/d31/d4f/d87/f77 [0,4194304] 0 2024-05-09T00:07:56.239 INFO:tasks.workunit.client.0.smithi026.stdout:8/906: readlink de/d17/d21/d6f/l9a 0 2024-05-09T00:07:56.239 INFO:tasks.workunit.client.0.smithi026.stdout:9/884: dwrite d7/d23/d76/f90 [0,4194304] 0 2024-05-09T00:07:56.239 INFO:tasks.workunit.client.0.smithi026.stdout:3/652: dwrite d5/f1f [0,4194304] 0 2024-05-09T00:07:56.259 INFO:tasks.workunit.client.0.smithi026.stdout:9/885: dwrite f2 [0,4194304] 0 2024-05-09T00:07:56.307 INFO:tasks.workunit.client.0.smithi026.stdout:8/907: creat de/d6c/d31/d4f/deb/dfb/f139 x:0 0 0 2024-05-09T00:07:56.307 INFO:tasks.workunit.client.0.smithi026.stdout:8/908: stat de/d17/d21/dca 0 2024-05-09T00:07:56.311 INFO:tasks.workunit.client.0.smithi026.stdout:3/653: creat d5/d9/d4a/d5f/d6f/d75/fdb x:0 0 0 2024-05-09T00:07:56.313 INFO:tasks.workunit.client.0.smithi026.stdout:9/886: creat d7/d23/d29/d31/d40/d41/d54/d5c/f133 x:0 0 0 2024-05-09T00:07:56.314 INFO:tasks.workunit.client.0.smithi026.stdout:8/909: rmdir de/d6c/db5 39 2024-05-09T00:07:56.315 INFO:tasks.workunit.client.0.smithi026.stdout:3/654: creat d5/dcb/fdc x:0 0 0 2024-05-09T00:07:56.319 INFO:tasks.workunit.client.0.smithi026.stdout:9/887: unlink d7/d23/d29/d59/f97 0 2024-05-09T00:07:56.319 INFO:tasks.workunit.client.0.smithi026.stdout:9/888: write d7/d23/d2f/d7d/d87/fbe [4633583,86836] 0 2024-05-09T00:07:56.319 INFO:tasks.workunit.client.0.smithi026.stdout:9/889: readlink d7/l123 0 2024-05-09T00:07:56.321 INFO:tasks.workunit.client.0.smithi026.stdout:8/910: getdents de/d17/d21/dca 0 2024-05-09T00:07:56.322 INFO:tasks.workunit.client.0.smithi026.stdout:3/655: symlink d5/ldd 0 2024-05-09T00:07:56.324 INFO:tasks.workunit.client.0.smithi026.stdout:9/890: symlink d7/d23/d29/d31/d40/dd5/l134 0 2024-05-09T00:07:56.327 INFO:tasks.workunit.client.0.smithi026.stdout:8/911: creat de/d48/d3e/d54/f13a x:0 0 0 2024-05-09T00:07:56.328 INFO:tasks.workunit.client.0.smithi026.stdout:3/656: rename d5/d1e/f3d to d5/d41/fde 0 2024-05-09T00:07:56.330 INFO:tasks.workunit.client.0.smithi026.stdout:9/891: creat d7/d23/d29/d59/dec/f135 x:0 0 0 2024-05-09T00:07:56.331 INFO:tasks.workunit.client.0.smithi026.stdout:8/912: getdents de/d6c/d31/d4f/df1 0 2024-05-09T00:07:56.336 INFO:tasks.workunit.client.0.smithi026.stdout:3/657: truncate d5/d9/dc/d28/d63/f7e 3478485 0 2024-05-09T00:07:56.336 INFO:tasks.workunit.client.0.smithi026.stdout:9/892: symlink d7/d26/l136 0 2024-05-09T00:07:56.336 INFO:tasks.workunit.client.0.smithi026.stdout:9/893: write d7/d23/d29/d59/d91/ff2 [644850,107220] 0 2024-05-09T00:07:56.336 INFO:tasks.workunit.client.0.smithi026.stdout:9/894: fdatasync d7/d23/d2f/d3a/db5/f132 0 2024-05-09T00:07:56.336 INFO:tasks.workunit.client.0.smithi026.stdout:9/895: readlink d7/d26/l74 0 2024-05-09T00:07:56.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/913: link de/d17/d21/d24/d3b/l9f de/d17/d21/d6f/d106/l13b 0 2024-05-09T00:07:56.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/914: truncate de/d17/d21/d6f/d106/ff8 973834 0 2024-05-09T00:07:56.340 INFO:tasks.workunit.client.0.smithi026.stdout:3/658: rename d5/d1e/d7b/l8c to d5/db1/ldf 0 2024-05-09T00:07:56.343 INFO:tasks.workunit.client.0.smithi026.stdout:8/915: symlink de/dd9/d116/l13c 0 2024-05-09T00:07:56.346 INFO:tasks.workunit.client.0.smithi026.stdout:8/916: mknod de/c13d 0 2024-05-09T00:07:56.348 INFO:tasks.workunit.client.0.smithi026.stdout:9/896: dwrite d7/d23/d29/d31/d40/f120 [0,4194304] 0 2024-05-09T00:07:56.348 INFO:tasks.workunit.client.0.smithi026.stdout:9/897: chown d7/d23/d2f/fe5 3464 1 2024-05-09T00:07:56.348 INFO:tasks.workunit.client.0.smithi026.stdout:9/898: dread - d7/d26/deb/f10b zero size 2024-05-09T00:07:56.353 INFO:tasks.workunit.client.0.smithi026.stdout:8/917: dread de/d6c/d31/d4f/f86 [0,4194304] 0 2024-05-09T00:07:56.354 INFO:tasks.workunit.client.0.smithi026.stdout:3/659: rename d5/db1/ldf to d5/d9/le0 0 2024-05-09T00:07:56.356 INFO:tasks.workunit.client.0.smithi026.stdout:9/899: symlink d7/d23/d2f/d7d/d87/l137 0 2024-05-09T00:07:56.357 INFO:tasks.workunit.client.0.smithi026.stdout:9/900: dread - d7/fff zero size 2024-05-09T00:07:56.362 INFO:tasks.workunit.client.0.smithi026.stdout:8/918: truncate de/d6c/d31/d4f/d87/f8f 2036536 0 2024-05-09T00:07:56.364 INFO:tasks.workunit.client.0.smithi026.stdout:3/660: mkdir d5/d9/dc/de1 0 2024-05-09T00:07:56.367 INFO:tasks.workunit.client.0.smithi026.stdout:3/661: mknod d5/d9/ce2 0 2024-05-09T00:07:56.383 INFO:tasks.workunit.client.0.smithi026.stdout:9/901: dwrite d7/d23/d76/f8c [4194304,4194304] 0 2024-05-09T00:07:56.383 INFO:tasks.workunit.client.0.smithi026.stdout:8/919: dread de/d48/f52 [0,4194304] 0 2024-05-09T00:07:56.383 INFO:tasks.workunit.client.0.smithi026.stdout:9/902: write d7/d26/f122 [188359,14123] 0 2024-05-09T00:07:56.388 INFO:tasks.workunit.client.0.smithi026.stdout:8/920: unlink de/d17/d21/dca/d104/l11b 0 2024-05-09T00:07:56.391 INFO:tasks.workunit.client.0.smithi026.stdout:9/903: rename d7/d23/d29/d31/lea to d7/d23/d2f/d7d/db2/d130/l138 0 2024-05-09T00:07:56.391 INFO:tasks.workunit.client.0.smithi026.stdout:9/904: chown d7/d23/d2f/d50/cce 85194 1 2024-05-09T00:07:56.394 INFO:tasks.workunit.client.0.smithi026.stdout:8/921: mkdir de/d6c/d31/d4f/d87/d62/daa/ddb/d13e 0 2024-05-09T00:07:56.397 INFO:tasks.workunit.client.0.smithi026.stdout:3/662: dwrite d5/d44/f79 [0,4194304] 0 2024-05-09T00:07:56.403 INFO:tasks.workunit.client.0.smithi026.stdout:9/905: symlink d7/d26/deb/l139 0 2024-05-09T00:07:56.420 INFO:tasks.workunit.client.0.smithi026.stdout:3/663: dwrite d5/d9/dc/d28/d63/d81/f99 [0,4194304] 0 2024-05-09T00:07:56.420 INFO:tasks.workunit.client.0.smithi026.stdout:8/922: dwrite de/d6c/d31/d4f/dbb/fd4 [0,4194304] 0 2024-05-09T00:07:56.420 INFO:tasks.workunit.client.0.smithi026.stdout:8/923: rename de/d6c/d31 to de/d6c/d31/d4f/d13f 22 2024-05-09T00:07:56.423 INFO:tasks.workunit.client.0.smithi026.stdout:6/707: sync 2024-05-09T00:07:56.423 INFO:tasks.workunit.client.0.smithi026.stdout:2/804: sync 2024-05-09T00:07:56.426 INFO:tasks.workunit.client.0.smithi026.stdout:8/924: creat de/d6c/d31/d4f/deb/f140 x:0 0 0 2024-05-09T00:07:56.427 INFO:tasks.workunit.client.0.smithi026.stdout:2/805: getdents d14/d22/d55/d6b 0 2024-05-09T00:07:56.428 INFO:tasks.workunit.client.0.smithi026.stdout:6/708: creat d15/d34/dba/fea x:0 0 0 2024-05-09T00:07:56.429 INFO:tasks.workunit.client.0.smithi026.stdout:8/925: stat de/d17/d21/cdf 0 2024-05-09T00:07:56.429 INFO:tasks.workunit.client.0.smithi026.stdout:8/926: readlink de/d48/d3e/dc4/dc7/ld6 0 2024-05-09T00:07:56.429 INFO:tasks.workunit.client.0.smithi026.stdout:8/927: write de/d6c/db5/f10e [372699,90531] 0 2024-05-09T00:07:56.431 INFO:tasks.workunit.client.0.smithi026.stdout:2/806: unlink d14/d22/d55/da3/d20/d41/d51/d82/daa/fc8 0 2024-05-09T00:07:56.431 INFO:tasks.workunit.client.0.smithi026.stdout:2/807: chown d14/d22/d55/da3/d30/d6a/f63 37282 1 2024-05-09T00:07:56.437 INFO:tasks.workunit.client.0.smithi026.stdout:6/709: rename d15/d34/d52/d74/f80 to d15/d2b/d33/d55/d67/dd2/feb 0 2024-05-09T00:07:56.438 INFO:tasks.workunit.client.0.smithi026.stdout:6/710: write f4 [2892436,32575] 0 2024-05-09T00:07:56.438 INFO:tasks.workunit.client.0.smithi026.stdout:8/928: mknod de/d17/d21/d6f/d107/c141 0 2024-05-09T00:07:56.444 INFO:tasks.workunit.client.0.smithi026.stdout:3/664: dwrite d5/d9/d4a/d5f/d6f/d75/f7c [0,4194304] 0 2024-05-09T00:07:56.446 INFO:tasks.workunit.client.0.smithi026.stdout:6/711: creat d15/d1e/d30/fec x:0 0 0 2024-05-09T00:07:56.458 INFO:tasks.workunit.client.0.smithi026.stdout:2/808: dwrite d14/d22/d55/da3/f26 [4194304,4194304] 0 2024-05-09T00:07:56.463 INFO:tasks.workunit.client.0.smithi026.stdout:8/929: dwrite de/d6c/d31/d4f/df1/dfc/d11d/f12a [0,4194304] 0 2024-05-09T00:07:56.468 INFO:tasks.workunit.client.0.smithi026.stdout:8/930: mknod de/d6c/d31/d4f/d87/d12b/c142 0 2024-05-09T00:07:56.468 INFO:tasks.workunit.client.0.smithi026.stdout:3/665: dwrite d5/d9/dc/f11 [0,4194304] 0 2024-05-09T00:07:56.470 INFO:tasks.workunit.client.0.smithi026.stdout:3/666: read d5/d9/d4a/d5f/d6f/d75/f7c [670199,70502] 0 2024-05-09T00:07:56.472 INFO:tasks.workunit.client.0.smithi026.stdout:2/809: dwrite d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fb3 [0,4194304] 0 2024-05-09T00:07:56.480 INFO:tasks.workunit.client.0.smithi026.stdout:3/667: read d5/d44/f79 [2257823,96323] 0 2024-05-09T00:07:56.482 INFO:tasks.workunit.client.0.smithi026.stdout:3/668: mknod d5/da7/ce3 0 2024-05-09T00:07:56.496 INFO:tasks.workunit.client.0.smithi026.stdout:3/669: dread d5/d41/fde [0,4194304] 0 2024-05-09T00:07:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:2/810: dwrite d14/d22/fcc [0,4194304] 0 2024-05-09T00:07:56.498 INFO:tasks.workunit.client.0.smithi026.stdout:2/811: fdatasync d14/d22/d55/d6b/da5/fe4 0 2024-05-09T00:07:56.499 INFO:tasks.workunit.client.0.smithi026.stdout:8/931: dwrite de/f13 [0,4194304] 0 2024-05-09T00:07:56.504 INFO:tasks.workunit.client.0.smithi026.stdout:8/932: mknod de/d17/d21/d24/d3b/d3d/c143 0 2024-05-09T00:07:56.505 INFO:tasks.workunit.client.0.smithi026.stdout:8/933: symlink de/d6c/d31/d4f/dbb/l144 0 2024-05-09T00:07:56.506 INFO:tasks.workunit.client.0.smithi026.stdout:8/934: mkdir de/dd9/d116/d145 0 2024-05-09T00:07:56.508 INFO:tasks.workunit.client.0.smithi026.stdout:8/935: truncate de/d17/f8d 536906 0 2024-05-09T00:07:56.508 INFO:tasks.workunit.client.0.smithi026.stdout:8/936: dread - de/d6c/d31/d4f/d87/d62/ff0 zero size 2024-05-09T00:07:56.508 INFO:tasks.workunit.client.0.smithi026.stdout:8/937: chown de/d17/d21/dca/cd8 117706301 1 2024-05-09T00:07:56.510 INFO:tasks.workunit.client.0.smithi026.stdout:8/938: unlink de/d6c/d31/d4f/deb/c117 0 2024-05-09T00:07:56.512 INFO:tasks.workunit.client.0.smithi026.stdout:8/939: mkdir de/dd9/d116/d146 0 2024-05-09T00:07:56.512 INFO:tasks.workunit.client.0.smithi026.stdout:8/940: chown de/d17/d21/d24/d3b/f47 1888 1 2024-05-09T00:07:56.512 INFO:tasks.workunit.client.0.smithi026.stdout:8/941: chown de/d17/d21/dca/d104 2 1 2024-05-09T00:07:56.514 INFO:tasks.workunit.client.0.smithi026.stdout:8/942: rmdir de/d17/d21/d6f/d107 39 2024-05-09T00:07:56.514 INFO:tasks.workunit.client.0.smithi026.stdout:8/943: read - de/d48/d3e/d54/f13a zero size 2024-05-09T00:07:56.514 INFO:tasks.workunit.client.0.smithi026.stdout:8/944: readlink de/d6c/d31/d4f/d87/d62/daa/l125 0 2024-05-09T00:07:56.515 INFO:tasks.workunit.client.0.smithi026.stdout:8/945: symlink de/d17/d21/d6f/d107/l147 0 2024-05-09T00:07:56.517 INFO:tasks.workunit.client.0.smithi026.stdout:3/670: dwrite d5/d9/dc/d28/d2c/f4b [0,4194304] 0 2024-05-09T00:07:56.518 INFO:tasks.workunit.client.0.smithi026.stdout:2/812: dwrite d14/d22/d55/da3/d20/d41/faf [0,4194304] 0 2024-05-09T00:07:56.529 INFO:tasks.workunit.client.0.smithi026.stdout:3/671: mkdir d5/d9/d4a/d77/de4 0 2024-05-09T00:07:56.531 INFO:tasks.workunit.client.0.smithi026.stdout:8/946: dwrite de/d17/d21/d24/f7e [0,4194304] 0 2024-05-09T00:07:56.534 INFO:tasks.workunit.client.0.smithi026.stdout:2/813: dwrite d14/d22/d55/da3/d30/d6a/f63 [0,4194304] 0 2024-05-09T00:07:56.534 INFO:tasks.workunit.client.0.smithi026.stdout:2/814: fsync d14/d22/d55/d6b/f7f 0 2024-05-09T00:07:56.538 INFO:tasks.workunit.client.0.smithi026.stdout:3/672: mkdir d5/d9/dc/d28/d45/de5 0 2024-05-09T00:07:56.544 INFO:tasks.workunit.client.0.smithi026.stdout:2/815: truncate d14/d22/d55/da3/d30/d6a/f81 4081094 0 2024-05-09T00:07:56.544 INFO:tasks.workunit.client.0.smithi026.stdout:2/816: readlink d14/d22/d55/da3/d3b/d40/d68/lde 0 2024-05-09T00:07:56.544 INFO:tasks.workunit.client.0.smithi026.stdout:2/817: dread - d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fca zero size 2024-05-09T00:07:56.546 INFO:tasks.workunit.client.0.smithi026.stdout:2/818: write d14/d22/d55/d6b/f7f [3395536,72430] 0 2024-05-09T00:07:56.546 INFO:tasks.workunit.client.0.smithi026.stdout:2/819: write d14/d22/d55/da3/d17/fcd [44510,46335] 0 2024-05-09T00:07:56.548 INFO:tasks.workunit.client.0.smithi026.stdout:2/820: symlink d14/d22/d55/da3/d20/d41/d51/d82/daa/l114 0 2024-05-09T00:07:56.548 INFO:tasks.workunit.client.0.smithi026.stdout:8/947: dwrite de/d6c/db5/f10e [0,4194304] 0 2024-05-09T00:07:56.554 INFO:tasks.workunit.client.0.smithi026.stdout:3/673: dread d5/d9/dc/d28/f35 [0,4194304] 0 2024-05-09T00:07:56.554 INFO:tasks.workunit.client.0.smithi026.stdout:3/674: chown d5/d1e 22288257 1 2024-05-09T00:07:56.554 INFO:tasks.workunit.client.0.smithi026.stdout:3/675: chown d5/d9/lae 117524397 1 2024-05-09T00:07:56.554 INFO:tasks.workunit.client.0.smithi026.stdout:3/676: fsync d5/d1e/d7b/f92 0 2024-05-09T00:07:56.554 INFO:tasks.workunit.client.0.smithi026.stdout:3/677: truncate d5/d41/fab 181255 0 2024-05-09T00:07:56.554 INFO:tasks.workunit.client.0.smithi026.stdout:2/821: symlink d14/d22/d55/da3/d17/l115 0 2024-05-09T00:07:56.555 INFO:tasks.workunit.client.0.smithi026.stdout:8/948: readlink de/d48/lf4 0 2024-05-09T00:07:56.555 INFO:tasks.workunit.client.0.smithi026.stdout:8/949: chown de/d48/d3e/dc4/dc7/cf5 781 1 2024-05-09T00:07:56.555 INFO:tasks.workunit.client.0.smithi026.stdout:8/950: truncate de/d17/d21/d24/d5b/fde 398849 0 2024-05-09T00:07:56.555 INFO:tasks.workunit.client.0.smithi026.stdout:3/678: read d5/d9/d71/f9c [2518729,89714] 0 2024-05-09T00:07:56.555 INFO:tasks.workunit.client.0.smithi026.stdout:3/679: write d5/d9/dc/d28/d63/f67 [1674330,43747] 0 2024-05-09T00:07:56.556 INFO:tasks.workunit.client.0.smithi026.stdout:3/680: write d5/d9/dc/d5b/f85 [367173,24864] 0 2024-05-09T00:07:56.559 INFO:tasks.workunit.client.0.smithi026.stdout:2/822: symlink d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/l116 0 2024-05-09T00:07:56.570 INFO:tasks.workunit.client.0.smithi026.stdout:8/951: truncate de/d17/f8d 721739 0 2024-05-09T00:07:56.584 INFO:tasks.workunit.client.0.smithi026.stdout:1/915: sync 2024-05-09T00:07:56.584 INFO:tasks.workunit.client.0.smithi026.stdout:4/846: sync 2024-05-09T00:07:56.584 INFO:tasks.workunit.client.0.smithi026.stdout:4/847: dread - d0/d12/d87/fc6 zero size 2024-05-09T00:07:56.586 INFO:tasks.workunit.client.0.smithi026.stdout:1/916: rmdir d5/dd/d1f/d39/d47/db0 0 2024-05-09T00:07:56.586 INFO:tasks.workunit.client.0.smithi026.stdout:1/917: read d5/dd/d1f/f90 [29115,100599] 0 2024-05-09T00:07:56.587 INFO:tasks.workunit.client.0.smithi026.stdout:4/848: mkdir d0/d12/da2/d97/d43/d58/d120 0 2024-05-09T00:07:56.587 INFO:tasks.workunit.client.0.smithi026.stdout:4/849: dread - d0/d12/d64/ffd zero size 2024-05-09T00:07:56.595 INFO:tasks.workunit.client.0.smithi026.stdout:4/850: dread d0/d12/da2/d97/d43/d49/d8f/fe2 [0,4194304] 0 2024-05-09T00:07:56.597 INFO:tasks.workunit.client.0.smithi026.stdout:3/681: dwrite d5/f12 [0,4194304] 0 2024-05-09T00:07:56.597 INFO:tasks.workunit.client.0.smithi026.stdout:3/682: chown d5/f22 19545 1 2024-05-09T00:07:56.597 INFO:tasks.workunit.client.0.smithi026.stdout:3/683: chown d5/d9/dc/d8a 127778623 1 2024-05-09T00:07:56.597 INFO:tasks.workunit.client.0.smithi026.stdout:3/684: chown d5/d41/fde 56037 1 2024-05-09T00:07:56.598 INFO:tasks.workunit.client.0.smithi026.stdout:4/851: symlink d0/d12/da2/d97/d43/d58/d120/l121 0 2024-05-09T00:07:56.598 INFO:tasks.workunit.client.0.smithi026.stdout:4/852: stat d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5 0 2024-05-09T00:07:56.599 INFO:tasks.workunit.client.0.smithi026.stdout:3/685: mknod d5/d9/dc/d5b/ce6 0 2024-05-09T00:07:56.599 INFO:tasks.workunit.client.0.smithi026.stdout:3/686: write d5/d41/fa1 [4440985,79031] 0 2024-05-09T00:07:56.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/952: dwrite de/d6c/d31/d4f/d87/fe2 [4194304,4194304] 0 2024-05-09T00:07:56.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/953: truncate de/d17/d21/fa1 2195753 0 2024-05-09T00:07:56.602 INFO:tasks.workunit.client.0.smithi026.stdout:2/823: dwrite d14/d22/d55/da3/d30/fce [0,4194304] 0 2024-05-09T00:07:56.602 INFO:tasks.workunit.client.0.smithi026.stdout:2/824: truncate d14/d22/d55/da3/d30/d6a/d5b/f84 987955 0 2024-05-09T00:07:56.602 INFO:tasks.workunit.client.0.smithi026.stdout:2/825: chown d14/d22/d55/da3/d17/l115 13 1 2024-05-09T00:07:56.602 INFO:tasks.workunit.client.0.smithi026.stdout:3/687: mknod d5/d9/ce7 0 2024-05-09T00:07:56.603 INFO:tasks.workunit.client.0.smithi026.stdout:8/954: getdents de/d6c/d31/d4f/d87/d12b 0 2024-05-09T00:07:56.604 INFO:tasks.workunit.client.0.smithi026.stdout:2/826: write d14/d22/d55/da3/d30/d6a/d5b/fd5 [242867,4175] 0 2024-05-09T00:07:56.606 INFO:tasks.workunit.client.0.smithi026.stdout:1/918: dread d5/dd/d17/d73/fb5 [0,4194304] 0 2024-05-09T00:07:56.612 INFO:tasks.workunit.client.0.smithi026.stdout:4/853: dread d0/d12/f30 [0,4194304] 0 2024-05-09T00:07:56.612 INFO:tasks.workunit.client.0.smithi026.stdout:4/854: chown d0/d12/da2/d97/f39 182517604 1 2024-05-09T00:07:56.612 INFO:tasks.workunit.client.0.smithi026.stdout:3/688: link d5/d9/dc/d5b/fd2 d5/d44/dd9/fe8 0 2024-05-09T00:07:56.612 INFO:tasks.workunit.client.0.smithi026.stdout:3/689: stat d5/d9/dc/d28/fac 0 2024-05-09T00:07:56.615 INFO:tasks.workunit.client.0.smithi026.stdout:4/855: write d0/d12/da2/d97/d43/d58/f6a [1355119,113482] 0 2024-05-09T00:07:56.615 INFO:tasks.workunit.client.0.smithi026.stdout:4/856: write d0/d12/da2/db8/fc4 [1174891,80014] 0 2024-05-09T00:07:56.615 INFO:tasks.workunit.client.0.smithi026.stdout:8/955: rename de/d17/d21/d24/d3b/d3d/fef to de/d60/f148 0 2024-05-09T00:07:56.620 INFO:tasks.workunit.client.0.smithi026.stdout:1/919: dread d5/d16/d60/f6d [0,4194304] 0 2024-05-09T00:07:56.636 INFO:tasks.workunit.client.0.smithi026.stdout:3/690: creat d5/d41/fe9 x:0 0 0 2024-05-09T00:07:56.638 INFO:tasks.workunit.client.0.smithi026.stdout:4/857: symlink d0/d12/da2/d97/d43/l122 0 2024-05-09T00:07:56.641 INFO:tasks.workunit.client.0.smithi026.stdout:4/858: write d0/d12/da2/d97/d43/d58/fbc [2599806,47367] 0 2024-05-09T00:07:56.641 INFO:tasks.workunit.client.0.smithi026.stdout:2/827: rename d14/d22/d55/da3/d17/l65 to d14/d22/d55/da3/d3b/d40/d68/l117 0 2024-05-09T00:07:56.653 INFO:tasks.workunit.client.0.smithi026.stdout:1/920: link d5/dd/d17/d7b/lf7 d5/dd/d17/l135 0 2024-05-09T00:07:56.654 INFO:tasks.workunit.client.0.smithi026.stdout:1/921: write d5/db/d108/d103/db1/dc2/f119 [2795542,21103] 0 2024-05-09T00:07:56.655 INFO:tasks.workunit.client.0.smithi026.stdout:3/691: dwrite d5/dcb/fdc [0,4194304] 0 2024-05-09T00:07:56.656 INFO:tasks.workunit.client.0.smithi026.stdout:2/828: unlink d14/d22/d55/da3/d30/d6a/fed 0 2024-05-09T00:07:56.656 INFO:tasks.workunit.client.0.smithi026.stdout:2/829: chown d14/d22/d55/da3/d20/d41/c43 23856598 1 2024-05-09T00:07:56.656 INFO:tasks.workunit.client.0.smithi026.stdout:2/830: fsync d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/f8d 0 2024-05-09T00:07:56.656 INFO:tasks.workunit.client.0.smithi026.stdout:2/831: write d14/d22/d55/da3/d30/dc3/df7/f107 [873501,8479] 0 2024-05-09T00:07:56.657 INFO:tasks.workunit.client.0.smithi026.stdout:8/956: rename de/d17/f4a to de/d48/f149 0 2024-05-09T00:07:56.662 INFO:tasks.workunit.client.0.smithi026.stdout:1/922: symlink d5/d16/dd5/de4/d134/l136 0 2024-05-09T00:07:56.669 INFO:tasks.workunit.client.0.smithi026.stdout:3/692: read d5/d44/d9f/fd7 [8386,78906] 0 2024-05-09T00:07:56.669 INFO:tasks.workunit.client.0.smithi026.stdout:3/693: write d5/d9/dc/d5b/f91 [535255,126079] 0 2024-05-09T00:07:56.670 INFO:tasks.workunit.client.0.smithi026.stdout:4/859: rename d0/d12/da2/d97/dbf/dd1/cf1 to d0/d12/da2/d97/c123 0 2024-05-09T00:07:56.672 INFO:tasks.workunit.client.0.smithi026.stdout:1/923: link d5/db/d1d/l82 d5/db/d1d/dd1/l137 0 2024-05-09T00:07:56.676 INFO:tasks.workunit.client.0.smithi026.stdout:1/924: unlink d5/dd/d17/d7b/f11c 0 2024-05-09T00:07:56.678 INFO:tasks.workunit.client.0.smithi026.stdout:2/832: dwrite d14/d22/d55/da3/d20/d41/fe8 [0,4194304] 0 2024-05-09T00:07:56.679 INFO:tasks.workunit.client.0.smithi026.stdout:8/957: dwrite de/d17/d21/d24/f7e [0,4194304] 0 2024-05-09T00:07:56.679 INFO:tasks.workunit.client.0.smithi026.stdout:8/958: readlink de/d17/d21/d24/d3b/l9f 0 2024-05-09T00:07:56.679 INFO:tasks.workunit.client.0.smithi026.stdout:8/959: dread - de/d48/d3e/d54/fa3 zero size 2024-05-09T00:07:56.679 INFO:tasks.workunit.client.0.smithi026.stdout:1/925: readlink d5/dd/d17/l31 0 2024-05-09T00:07:56.682 INFO:tasks.workunit.client.0.smithi026.stdout:1/926: write d5/dd/d87/f10d [1157449,57415] 0 2024-05-09T00:07:56.683 INFO:tasks.workunit.client.0.smithi026.stdout:2/833: creat d14/f118 x:0 0 0 2024-05-09T00:07:56.683 INFO:tasks.workunit.client.0.smithi026.stdout:2/834: rename d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85 to d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/d119 22 2024-05-09T00:07:56.685 INFO:tasks.workunit.client.0.smithi026.stdout:2/835: mknod d14/d22/d55/da3/d3b/d40/c11a 0 2024-05-09T00:07:56.686 INFO:tasks.workunit.client.0.smithi026.stdout:2/836: write d14/d22/d55/da3/d20/db2/fd4 [321543,103872] 0 2024-05-09T00:07:56.686 INFO:tasks.workunit.client.0.smithi026.stdout:4/860: dwrite d0/d12/da2/d97/d8c/fd9 [0,4194304] 0 2024-05-09T00:07:56.688 INFO:tasks.workunit.client.0.smithi026.stdout:2/837: creat d14/d22/d55/da3/d20/d41/d51/dc5/f11b x:0 0 0 2024-05-09T00:07:56.689 INFO:tasks.workunit.client.0.smithi026.stdout:2/838: write d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/f8d [600189,108384] 0 2024-05-09T00:07:56.689 INFO:tasks.workunit.client.0.smithi026.stdout:2/839: truncate d14/d22/d55/da3/d3b/ff8 746172 0 2024-05-09T00:07:56.693 INFO:tasks.workunit.client.0.smithi026.stdout:4/861: mknod d0/d12/d34/c124 0 2024-05-09T00:07:56.694 INFO:tasks.workunit.client.0.smithi026.stdout:4/862: read d0/d83/f76 [730549,75242] 0 2024-05-09T00:07:56.694 INFO:tasks.workunit.client.0.smithi026.stdout:4/863: write d0/d12/d1b/f10d [419353,107726] 0 2024-05-09T00:07:56.695 INFO:tasks.workunit.client.0.smithi026.stdout:4/864: getdents d0/d83 0 2024-05-09T00:07:56.695 INFO:tasks.workunit.client.0.smithi026.stdout:4/865: chown d0/d12/da2/d97/d43/d58/fbb 332 1 2024-05-09T00:07:56.695 INFO:tasks.workunit.client.0.smithi026.stdout:4/866: truncate d0/d12/f1d 1474896 0 2024-05-09T00:07:56.695 INFO:tasks.workunit.client.0.smithi026.stdout:4/867: chown d0/d83/f9e 983 1 2024-05-09T00:07:56.699 INFO:tasks.workunit.client.0.smithi026.stdout:4/868: mkdir d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/d125 0 2024-05-09T00:07:56.699 INFO:tasks.workunit.client.0.smithi026.stdout:4/869: chown d0/d12/da2/d97/d43/d49/d8f/da3/d86 70511 1 2024-05-09T00:07:56.708 INFO:tasks.workunit.client.0.smithi026.stdout:3/694: getdents d5/d9 0 2024-05-09T00:07:56.708 INFO:tasks.workunit.client.0.smithi026.stdout:3/695: truncate d5/d1e/d7b/f92 726225 0 2024-05-09T00:07:56.708 INFO:tasks.workunit.client.0.smithi026.stdout:3/696: readlink d5/d1e/l50 0 2024-05-09T00:07:56.711 INFO:tasks.workunit.client.0.smithi026.stdout:1/927: dwrite d5/dd/d17/d9f/da5/fc1 [0,4194304] 0 2024-05-09T00:07:56.711 INFO:tasks.workunit.client.0.smithi026.stdout:8/960: dwrite de/d6c/d31/d4f/f96 [0,4194304] 0 2024-05-09T00:07:56.711 INFO:tasks.workunit.client.0.smithi026.stdout:8/961: write de/dd9/d116/fa7 [1766252,56037] 0 2024-05-09T00:07:56.712 INFO:tasks.workunit.client.0.smithi026.stdout:8/962: chown de/d6c/d31/d4f/d87/d62/f95 83437 1 2024-05-09T00:07:56.712 INFO:tasks.workunit.client.0.smithi026.stdout:2/840: dwrite d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/ffe [0,4194304] 0 2024-05-09T00:07:56.715 INFO:tasks.workunit.client.0.smithi026.stdout:8/963: mknod de/d6c/d31/d4f/d87/d62/daa/ddb/d91/c14a 0 2024-05-09T00:07:56.715 INFO:tasks.workunit.client.0.smithi026.stdout:8/964: chown de/d17/d21/d24/d5b/dbd/fd3 690496504 1 2024-05-09T00:07:56.715 INFO:tasks.workunit.client.0.smithi026.stdout:8/965: readlink de/d17/d21/d6f/d107/l147 0 2024-05-09T00:07:56.718 INFO:tasks.workunit.client.0.smithi026.stdout:2/841: creat d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/f11c x:0 0 0 2024-05-09T00:07:56.720 INFO:tasks.workunit.client.0.smithi026.stdout:8/966: symlink de/d17/d21/dca/d104/l14b 0 2024-05-09T00:07:56.721 INFO:tasks.workunit.client.0.smithi026.stdout:8/967: mkdir de/d6c/d31/d4f/deb/dfb/d14c 0 2024-05-09T00:07:56.723 INFO:tasks.workunit.client.0.smithi026.stdout:8/968: mknod de/d60/c14d 0 2024-05-09T00:07:56.725 INFO:tasks.workunit.client.0.smithi026.stdout:7/966: sync 2024-05-09T00:07:56.725 INFO:tasks.workunit.client.0.smithi026.stdout:7/967: readlink d8/lcc 0 2024-05-09T00:07:56.725 INFO:tasks.workunit.client.0.smithi026.stdout:7/968: fdatasync d8/d1b/d89/fef 0 2024-05-09T00:07:56.725 INFO:tasks.workunit.client.0.smithi026.stdout:5/838: sync 2024-05-09T00:07:56.727 INFO:tasks.workunit.client.0.smithi026.stdout:7/969: creat d8/d2e/d126/d9a/d9f/d104/d147/d111/d135/f14c x:0 0 0 2024-05-09T00:07:56.728 INFO:tasks.workunit.client.0.smithi026.stdout:5/839: creat d2/d5a/d96/f11c x:0 0 0 2024-05-09T00:07:56.728 INFO:tasks.workunit.client.0.smithi026.stdout:6/712: sync 2024-05-09T00:07:56.729 INFO:tasks.workunit.client.0.smithi026.stdout:9/906: sync 2024-05-09T00:07:56.729 INFO:tasks.workunit.client.0.smithi026.stdout:6/713: read d15/d2b/d33/d55/d67/d90/fc9 [129002,18145] 0 2024-05-09T00:07:56.732 INFO:tasks.workunit.client.0.smithi026.stdout:7/970: rename d8/d2e/d84/db4/dbc/c4b to d8/d2e/d126/d9a/df4/d13f/c14d 0 2024-05-09T00:07:56.733 INFO:tasks.workunit.client.0.smithi026.stdout:9/907: symlink d7/d23/d29/d2e/l13a 0 2024-05-09T00:07:56.733 INFO:tasks.workunit.client.0.smithi026.stdout:4/870: dwrite d0/d12/da2/d97/d43/d58/f9c [0,4194304] 0 2024-05-09T00:07:56.737 INFO:tasks.workunit.client.0.smithi026.stdout:6/714: mkdir d15/d34/d52/d74/db8/ded 0 2024-05-09T00:07:56.737 INFO:tasks.workunit.client.0.smithi026.stdout:3/697: dwrite d5/d41/f37 [4194304,4194304] 0 2024-05-09T00:07:56.737 INFO:tasks.workunit.client.0.smithi026.stdout:3/698: dread - d5/d9/dc/d28/d63/d81/fad zero size 2024-05-09T00:07:56.738 INFO:tasks.workunit.client.0.smithi026.stdout:6/715: read d15/f1f [5946,91349] 0 2024-05-09T00:07:56.738 INFO:tasks.workunit.client.0.smithi026.stdout:6/716: getdents d15/d34/d52/d8b/ddb 0 2024-05-09T00:07:56.738 INFO:tasks.workunit.client.0.smithi026.stdout:6/717: chown d15/d2b/d33/d55/d67/dd2 1144707700 1 2024-05-09T00:07:56.738 INFO:tasks.workunit.client.0.smithi026.stdout:6/718: fdatasync d15/d1e/d30/f72 0 2024-05-09T00:07:56.740 INFO:tasks.workunit.client.0.smithi026.stdout:5/840: rename d2/d8/d6d/c78 to d2/d8/d10d/c11d 0 2024-05-09T00:07:56.740 INFO:tasks.workunit.client.0.smithi026.stdout:5/841: truncate d2/d5a/d96/f93 1911490 0 2024-05-09T00:07:56.741 INFO:tasks.workunit.client.0.smithi026.stdout:7/971: link d8/f1f d8/d1b/d89/dc1/f14e 0 2024-05-09T00:07:56.744 INFO:tasks.workunit.client.0.smithi026.stdout:3/699: mknod d5/d9/dc/d28/d45/de5/cea 0 2024-05-09T00:07:56.744 INFO:tasks.workunit.client.0.smithi026.stdout:3/700: truncate d5/d41/fe9 433800 0 2024-05-09T00:07:56.744 INFO:tasks.workunit.client.0.smithi026.stdout:3/701: write d5/d9/f2a [1490703,64786] 0 2024-05-09T00:07:56.746 INFO:tasks.workunit.client.0.smithi026.stdout:5/842: symlink d2/d8/d31/d2e/d109/l11e 0 2024-05-09T00:07:56.747 INFO:tasks.workunit.client.0.smithi026.stdout:6/719: dread d15/d2b/d33/d55/d67/dbb/dbf/fc3 [0,4194304] 0 2024-05-09T00:07:56.748 INFO:tasks.workunit.client.0.smithi026.stdout:7/972: mkdir d8/d2e/d84/db4/d14f 0 2024-05-09T00:07:56.753 INFO:tasks.workunit.client.0.smithi026.stdout:9/908: symlink d7/d23/d2f/d50/l13b 0 2024-05-09T00:07:56.753 INFO:tasks.workunit.client.0.smithi026.stdout:9/909: write d7/d23/d29/d31/d40/d41/d54/d5c/fc4 [498642,125939] 0 2024-05-09T00:07:56.754 INFO:tasks.workunit.client.0.smithi026.stdout:3/702: mkdir d5/d1e/d7b/deb 0 2024-05-09T00:07:56.756 INFO:tasks.workunit.client.0.smithi026.stdout:5/843: getdents d2/d8/d31/d32/d48/daa 0 2024-05-09T00:07:56.756 INFO:tasks.workunit.client.0.smithi026.stdout:5/844: write d2/d8/d31/d32/fee [419520,122558] 0 2024-05-09T00:07:56.761 INFO:tasks.workunit.client.0.smithi026.stdout:6/720: mkdir d15/d1e/d23/d73/d8e/dee 0 2024-05-09T00:07:56.762 INFO:tasks.workunit.client.0.smithi026.stdout:9/910: symlink d7/d23/d29/d59/dec/l13c 0 2024-05-09T00:07:56.764 INFO:tasks.workunit.client.0.smithi026.stdout:5/845: mkdir d2/d5a/d104/d11f 0 2024-05-09T00:07:56.764 INFO:tasks.workunit.client.0.smithi026.stdout:8/969: dwrite de/d6c/d31/d4f/dbb/ff2 [0,4194304] 0 2024-05-09T00:07:56.764 INFO:tasks.workunit.client.0.smithi026.stdout:8/970: chown de/d6c/db5 5 1 2024-05-09T00:07:56.764 INFO:tasks.workunit.client.0.smithi026.stdout:8/971: write de/d17/f64 [1669762,25631] 0 2024-05-09T00:07:56.765 INFO:tasks.workunit.client.0.smithi026.stdout:4/871: dwrite d0/d12/d64/f6e [0,4194304] 0 2024-05-09T00:07:56.767 INFO:tasks.workunit.client.0.smithi026.stdout:1/928: dwrite d5/db/d108/d103/de0/ff6 [0,4194304] 0 2024-05-09T00:07:56.767 INFO:tasks.workunit.client.0.smithi026.stdout:1/929: chown d5/d16/cb8 5 1 2024-05-09T00:07:56.770 INFO:tasks.workunit.client.0.smithi026.stdout:9/911: rename d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/d112 to d7/d23/d2f/d7d/db2/d130/d13d 0 2024-05-09T00:07:56.774 INFO:tasks.workunit.client.0.smithi026.stdout:8/972: write de/d6c/d31/d4f/f86 [2667306,29497] 0 2024-05-09T00:07:56.774 INFO:tasks.workunit.client.0.smithi026.stdout:8/973: write de/d6c/d31/d4f/d87/d62/ff0 [296794,122029] 0 2024-05-09T00:07:56.775 INFO:tasks.workunit.client.0.smithi026.stdout:6/721: dread d15/d1e/d30/f46 [0,4194304] 0 2024-05-09T00:07:56.780 INFO:tasks.workunit.client.0.smithi026.stdout:5/846: dread d2/d8/d31/d2e/d4a/f3c [0,4194304] 0 2024-05-09T00:07:56.783 INFO:tasks.workunit.client.0.smithi026.stdout:2/842: dwrite d14/d22/d55/d6b/d93/f10b [0,4194304] 0 2024-05-09T00:07:56.789 INFO:tasks.workunit.client.0.smithi026.stdout:1/930: link d5/db/d108/d103/d110/l12d d5/dd/d17/d73/d10c/l138 0 2024-05-09T00:07:56.796 INFO:tasks.workunit.client.0.smithi026.stdout:6/722: getdents d15/d34/d52/d74/dd0 0 2024-05-09T00:07:56.797 INFO:tasks.workunit.client.0.smithi026.stdout:3/703: dwrite d5/d1e/d7b/fc1 [0,4194304] 0 2024-05-09T00:07:56.801 INFO:tasks.workunit.client.0.smithi026.stdout:9/912: dwrite d7/d23/d2f/d7d/d87/f11d [0,4194304] 0 2024-05-09T00:07:56.801 INFO:tasks.workunit.client.0.smithi026.stdout:9/913: stat d7/d23/d29/d2e/fd8 0 2024-05-09T00:07:56.801 INFO:tasks.workunit.client.0.smithi026.stdout:4/872: dwrite d0/d12/da2/d97/d43/d49/fc7 [0,4194304] 0 2024-05-09T00:07:56.804 INFO:tasks.workunit.client.0.smithi026.stdout:5/847: dwrite d2/d8/d6d/fab [0,4194304] 0 2024-05-09T00:07:56.805 INFO:tasks.workunit.client.0.smithi026.stdout:5/848: write d2/d8/d2a/d8d/f112 [1254232,24206] 0 2024-05-09T00:07:56.805 INFO:tasks.workunit.client.0.smithi026.stdout:5/849: chown d2/d8/d31/d2e/d4a/f3d 35453 1 2024-05-09T00:07:56.808 INFO:tasks.workunit.client.0.smithi026.stdout:2/843: creat d14/d102/f11d x:0 0 0 2024-05-09T00:07:56.808 INFO:tasks.workunit.client.0.smithi026.stdout:2/844: truncate d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fca 572886 0 2024-05-09T00:07:56.813 INFO:tasks.workunit.client.0.smithi026.stdout:5/850: dread d2/d8/d31/d63/d9c/fb6 [0,4194304] 0 2024-05-09T00:07:56.821 INFO:tasks.workunit.client.0.smithi026.stdout:4/873: dwrite d0/d12/da2/d97/fb1 [0,4194304] 0 2024-05-09T00:07:56.821 INFO:tasks.workunit.client.0.smithi026.stdout:4/874: write d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/fe5 [216178,111960] 0 2024-05-09T00:07:56.821 INFO:tasks.workunit.client.0.smithi026.stdout:6/723: truncate d15/d1e/d30/f72 3022932 0 2024-05-09T00:07:56.821 INFO:tasks.workunit.client.0.smithi026.stdout:6/724: stat d15/d1e/d30/c63 0 2024-05-09T00:07:56.821 INFO:tasks.workunit.client.0.smithi026.stdout:6/725: chown d15/d1e/l2a 154334 1 2024-05-09T00:07:56.822 INFO:tasks.workunit.client.0.smithi026.stdout:4/875: write d0/d12/da2/d97/d43/d49/fc7 [1434624,82636] 0 2024-05-09T00:07:56.824 INFO:tasks.workunit.client.0.smithi026.stdout:3/704: creat d5/d44/dd9/fec x:0 0 0 2024-05-09T00:07:56.829 INFO:tasks.workunit.client.0.smithi026.stdout:9/914: link d7/l4d d7/d23/d29/d31/d40/dd5/l13e 0 2024-05-09T00:07:56.829 INFO:tasks.workunit.client.0.smithi026.stdout:9/915: fsync d7/d23/d29/d31/d40/d41/f102 0 2024-05-09T00:07:56.830 INFO:tasks.workunit.client.0.smithi026.stdout:9/916: write d7/d23/d29/d31/d40/d41/d54/d5c/d66/d99/fa7 [2898117,87223] 0 2024-05-09T00:07:56.832 INFO:tasks.workunit.client.0.smithi026.stdout:5/851: dwrite d2/d8/d31/d32/d5c/f67 [0,4194304] 0 2024-05-09T00:07:56.832 INFO:tasks.workunit.client.0.smithi026.stdout:5/852: chown d2/d5a/d96/de5/c10c 0 1 2024-05-09T00:07:56.832 INFO:tasks.workunit.client.0.smithi026.stdout:5/853: write d2/d8/d31/d24/f105 [1706981,91455] 0 2024-05-09T00:07:56.836 INFO:tasks.workunit.client.0.smithi026.stdout:2/845: mknod d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/c11e 0 2024-05-09T00:07:56.838 INFO:tasks.workunit.client.0.smithi026.stdout:1/931: creat d5/dd/d17/d98/f139 x:0 0 0 2024-05-09T00:07:56.843 INFO:tasks.workunit.client.0.smithi026.stdout:6/726: symlink d15/d2b/d33/d55/d67/dd2/lef 0 2024-05-09T00:07:56.844 INFO:tasks.workunit.client.0.smithi026.stdout:5/854: dread d2/d8/d31/fc1 [0,4194304] 0 2024-05-09T00:07:56.845 INFO:tasks.workunit.client.0.smithi026.stdout:3/705: dwrite d5/d9/d71/f9c [0,4194304] 0 2024-05-09T00:07:56.847 INFO:tasks.workunit.client.0.smithi026.stdout:4/876: creat d0/d12/da2/d97/d43/d58/f126 x:0 0 0 2024-05-09T00:07:56.847 INFO:tasks.workunit.client.0.smithi026.stdout:4/877: fdatasync d0/d12/da2/d97/d43/f44 0 2024-05-09T00:07:56.848 INFO:tasks.workunit.client.0.smithi026.stdout:1/932: dread d5/dd/fe [0,4194304] 0 2024-05-09T00:07:56.850 INFO:tasks.workunit.client.0.smithi026.stdout:2/846: mkdir d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/df2/d11f 0 2024-05-09T00:07:56.852 INFO:tasks.workunit.client.0.smithi026.stdout:4/878: mknod d0/d12/da2/c127 0 2024-05-09T00:07:56.853 INFO:tasks.workunit.client.0.smithi026.stdout:9/917: dread d7/fe3 [0,4194304] 0 2024-05-09T00:07:56.853 INFO:tasks.workunit.client.0.smithi026.stdout:9/918: write d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc/fc6 [1240393,90724] 0 2024-05-09T00:07:56.853 INFO:tasks.workunit.client.0.smithi026.stdout:9/919: write d7/d23/d2f/d3a/db5/f132 [747492,53892] 0 2024-05-09T00:07:56.857 INFO:tasks.workunit.client.0.smithi026.stdout:1/933: unlink d5/d16/d60/c126 0 2024-05-09T00:07:56.857 INFO:tasks.workunit.client.0.smithi026.stdout:2/847: truncate d14/d22/d55/da3/d20/fac 550367 0 2024-05-09T00:07:56.860 INFO:tasks.workunit.client.0.smithi026.stdout:4/879: rename d0/d12/da2/d97/d43/d49/f54 to d0/d12/da2/d97/d43/d49/d8f/da3/d66/f128 0 2024-05-09T00:07:56.861 INFO:tasks.workunit.client.0.smithi026.stdout:1/934: write d5/dd/f34 [2106242,100743] 0 2024-05-09T00:07:56.862 INFO:tasks.workunit.client.0.smithi026.stdout:3/706: dwrite d5/d9/dc/d28/d2c/f6a [4194304,4194304] 0 2024-05-09T00:07:56.862 INFO:tasks.workunit.client.0.smithi026.stdout:4/880: mknod d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/c129 0 2024-05-09T00:07:56.862 INFO:tasks.workunit.client.0.smithi026.stdout:4/881: write d0/d12/da2/d97/dbf/fd7 [903232,123188] 0 2024-05-09T00:07:56.865 INFO:tasks.workunit.client.0.smithi026.stdout:6/727: dread d15/f18 [8388608,4194304] 0 2024-05-09T00:07:56.867 INFO:tasks.workunit.client.0.smithi026.stdout:9/920: rename d7/d23/d29/d31/d40/l5a to d7/l13f 0 2024-05-09T00:07:56.868 INFO:tasks.workunit.client.0.smithi026.stdout:1/935: symlink d5/dd/d17/d9f/l13a 0 2024-05-09T00:07:56.868 INFO:tasks.workunit.client.0.smithi026.stdout:1/936: chown d5/dd/d17/d9f/da5/ccc 6779 1 2024-05-09T00:07:56.868 INFO:tasks.workunit.client.0.smithi026.stdout:1/937: chown d5/dd/f67 433124 1 2024-05-09T00:07:56.869 INFO:tasks.workunit.client.0.smithi026.stdout:5/855: dwrite d2/d8/d31/fc1 [4194304,4194304] 0 2024-05-09T00:07:56.870 INFO:tasks.workunit.client.0.smithi026.stdout:2/848: dread d14/d22/d55/da3/d30/fce [0,4194304] 0 2024-05-09T00:07:56.873 INFO:tasks.workunit.client.0.smithi026.stdout:2/849: dread d14/d22/d55/da3/d30/d6a/d5f/f9e [0,4194304] 0 2024-05-09T00:07:56.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/850: write d14/d22/d55/da3/d20/d41/d51/d82/daa/fef [442974,100987] 0 2024-05-09T00:07:56.882 INFO:tasks.workunit.client.0.smithi026.stdout:1/938: creat d5/db/f13b x:0 0 0 2024-05-09T00:07:56.883 INFO:tasks.workunit.client.0.smithi026.stdout:1/939: chown d5/dd/d17/d9f/da5/cf2 5 1 2024-05-09T00:07:56.883 INFO:tasks.workunit.client.0.smithi026.stdout:1/940: dread - d5/dd/ddd/fef zero size 2024-05-09T00:07:56.883 INFO:tasks.workunit.client.0.smithi026.stdout:9/921: dwrite d7/d23/d29/d59/fe7 [4194304,4194304] 0 2024-05-09T00:07:56.885 INFO:tasks.workunit.client.0.smithi026.stdout:3/707: rename d5/d9/d4a/d5f to d5/dd4/ded 0 2024-05-09T00:07:56.887 INFO:tasks.workunit.client.0.smithi026.stdout:6/728: dwrite d15/d34/d52/d8b/f40 [0,4194304] 0 2024-05-09T00:07:56.896 INFO:tasks.workunit.client.0.smithi026.stdout:3/708: dread d5/db1/fca [0,4194304] 0 2024-05-09T00:07:56.897 INFO:tasks.workunit.client.0.smithi026.stdout:3/709: write d5/d41/fa1 [205775,50987] 0 2024-05-09T00:07:56.917 INFO:tasks.workunit.client.0.smithi026.stdout:2/851: unlink d14/d22/d55/da3/d3b/d40/d47/c7c 0 2024-05-09T00:07:56.917 INFO:tasks.workunit.client.0.smithi026.stdout:2/852: dread - d14/d22/d55/da3/d20/d41/d51/d82/daa/f106 zero size 2024-05-09T00:07:56.917 INFO:tasks.workunit.client.0.smithi026.stdout:2/853: write d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fca [166248,4178] 0 2024-05-09T00:07:56.918 INFO:tasks.workunit.client.0.smithi026.stdout:2/854: truncate d14/d22/d55/da3/d3b/f9b 1288115 0 2024-05-09T00:07:56.919 INFO:tasks.workunit.client.0.smithi026.stdout:1/941: symlink d5/db/d1d/l13c 0 2024-05-09T00:07:56.923 INFO:tasks.workunit.client.0.smithi026.stdout:9/922: symlink d7/d23/d29/d31/d40/d41/d54/d9a/l140 0 2024-05-09T00:07:56.923 INFO:tasks.workunit.client.0.smithi026.stdout:9/923: stat d7/d23/d2f/d7d/d87/f12b 0 2024-05-09T00:07:56.927 INFO:tasks.workunit.client.0.smithi026.stdout:9/924: dread d7/d23/d29/d31/d40/d41/d54/d5c/fc4 [0,4194304] 0 2024-05-09T00:07:56.927 INFO:tasks.workunit.client.0.smithi026.stdout:9/925: chown d7/d23/d29/d59/dec/l13c 0 1 2024-05-09T00:07:56.927 INFO:tasks.workunit.client.0.smithi026.stdout:9/926: chown d7/d26/c94 2 1 2024-05-09T00:07:56.927 INFO:tasks.workunit.client.0.smithi026.stdout:2/855: dread d14/d22/d55/f56 [0,4194304] 0 2024-05-09T00:07:56.927 INFO:tasks.workunit.client.0.smithi026.stdout:2/856: write d14/d22/d55/da3/d20/d41/d51/d82/daa/f110 [395532,14039] 0 2024-05-09T00:07:56.927 INFO:tasks.workunit.client.0.smithi026.stdout:2/857: chown d14/d22/d55/d6b/da5/fe4 37 1 2024-05-09T00:07:56.929 INFO:tasks.workunit.client.0.smithi026.stdout:5/856: rename d2/d8/d31/d2e/d4a/f3d to d2/d8/d31/d32/da2/f120 0 2024-05-09T00:07:56.930 INFO:tasks.workunit.client.0.smithi026.stdout:6/729: mknod d15/d34/d52/d8b/cf0 0 2024-05-09T00:07:56.933 INFO:tasks.workunit.client.0.smithi026.stdout:1/942: mknod d5/db/d108/d103/d110/c13d 0 2024-05-09T00:07:56.935 INFO:tasks.workunit.client.0.smithi026.stdout:9/927: mkdir d7/d23/d2f/d7d/d87/d141 0 2024-05-09T00:07:56.936 INFO:tasks.workunit.client.0.smithi026.stdout:2/858: creat d14/d22/d55/d6b/d93/f120 x:0 0 0 2024-05-09T00:07:56.942 INFO:tasks.workunit.client.0.smithi026.stdout:6/730: symlink d15/d34/d52/d8b/ddb/lf1 0 2024-05-09T00:07:56.942 INFO:tasks.workunit.client.0.smithi026.stdout:3/710: rename d5/d9/l90 to d5/d9/dc/d5b/lee 0 2024-05-09T00:07:56.942 INFO:tasks.workunit.client.0.smithi026.stdout:6/731: write d15/d1e/d23/d73/fa7 [4240990,111766] 0 2024-05-09T00:07:56.942 INFO:tasks.workunit.client.0.smithi026.stdout:3/711: dread - d5/d9/d4a/fc7 zero size 2024-05-09T00:07:56.946 INFO:tasks.workunit.client.0.smithi026.stdout:3/712: mkdir d5/d44/def 0 2024-05-09T00:07:56.947 INFO:tasks.workunit.client.0.smithi026.stdout:3/713: rmdir d5/d9/dc/d28/d63 39 2024-05-09T00:07:56.949 INFO:tasks.workunit.client.0.smithi026.stdout:3/714: truncate d5/d9/dc/d28/f35 1312779 0 2024-05-09T00:07:56.950 INFO:tasks.workunit.client.0.smithi026.stdout:3/715: write d5/f22 [3325825,51168] 0 2024-05-09T00:07:56.952 INFO:tasks.workunit.client.0.smithi026.stdout:3/716: mkdir d5/d9/dc/d28/df0 0 2024-05-09T00:07:56.956 INFO:tasks.workunit.client.0.smithi026.stdout:3/717: link d5/d9/f5a d5/d9/dc/ff1 0 2024-05-09T00:07:56.956 INFO:tasks.workunit.client.0.smithi026.stdout:3/718: chown d5/d9/d71/f9c 256 1 2024-05-09T00:07:56.971 INFO:tasks.workunit.client.0.smithi026.stdout:3/719: dwrite d5/d9/dc/d5d/f7d [0,4194304] 0 2024-05-09T00:07:56.975 INFO:tasks.workunit.client.0.smithi026.stdout:3/720: rename d5/dd4/ded/fb0 to d5/d9/d49/ff2 0 2024-05-09T00:07:56.977 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:56 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:55.910435+0000 mgr.smithi135.kkrhgf (mgr.24419) 61 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 125 MiB/s rd, 267 MiB/s wr, 483 op/s 2024-05-09T00:07:56.980 INFO:tasks.workunit.client.0.smithi026.stdout:3/721: mkdir d5/db1/df3 0 2024-05-09T00:07:56.981 INFO:tasks.workunit.client.0.smithi026.stdout:3/722: symlink d5/d9/dc/d5b/da5/db2/lf4 0 2024-05-09T00:07:56.993 INFO:tasks.workunit.client.0.smithi026.stdout:5/857: dwrite d2/d8/d31/d63/f9d [0,4194304] 0 2024-05-09T00:07:56.995 INFO:tasks.workunit.client.0.smithi026.stdout:5/858: creat d2/d5a/d104/d11f/f121 x:0 0 0 2024-05-09T00:07:56.995 INFO:tasks.workunit.client.0.smithi026.stdout:2/859: dwrite d14/d22/d55/da3/d20/db2/fd4 [0,4194304] 0 2024-05-09T00:07:56.999 INFO:tasks.workunit.client.0.smithi026.stdout:5/859: creat d2/d8/d31/d4b/f122 x:0 0 0 2024-05-09T00:07:57.002 INFO:tasks.workunit.client.0.smithi026.stdout:3/723: dwrite f0 [0,4194304] 0 2024-05-09T00:07:57.004 INFO:tasks.workunit.client.0.smithi026.stdout:5/860: symlink d2/d8/d31/d32/d48/daa/db4/df7/l123 0 2024-05-09T00:07:57.005 INFO:tasks.workunit.client.0.smithi026.stdout:3/724: read d5/d41/fde [238283,104552] 0 2024-05-09T00:07:57.008 INFO:tasks.workunit.client.0.smithi026.stdout:3/725: rmdir d5/d9/dc/d28/d45 39 2024-05-09T00:07:57.008 INFO:tasks.workunit.client.0.smithi026.stdout:3/726: chown d5/d9/dc/d28/d63 158 1 2024-05-09T00:07:57.013 INFO:tasks.workunit.client.0.smithi026.stdout:3/727: getdents d5/d9/dc/d5b 0 2024-05-09T00:07:57.015 INFO:tasks.workunit.client.0.smithi026.stdout:6/732: dwrite d15/d34/d52/d8b/d4d/fc7 [0,4194304] 0 2024-05-09T00:07:57.017 INFO:tasks.workunit.client.0.smithi026.stdout:3/728: unlink d5/d41/c88 0 2024-05-09T00:07:57.020 INFO:tasks.workunit.client.0.smithi026.stdout:6/733: getdents d15/d1e/d23 0 2024-05-09T00:07:57.020 INFO:tasks.workunit.client.0.smithi026.stdout:6/734: chown d15/d1e/d23/f24 12831113 1 2024-05-09T00:07:57.022 INFO:tasks.workunit.client.0.smithi026.stdout:6/735: dread d15/d34/d52/f9d [0,4194304] 0 2024-05-09T00:07:57.022 INFO:tasks.workunit.client.0.smithi026.stdout:6/736: chown d15/d34/d52/d8b/f40 1715 1 2024-05-09T00:07:57.022 INFO:tasks.workunit.client.0.smithi026.stdout:6/737: write d15/d2b/d33/d55/d67/d90/fa5 [911882,93634] 0 2024-05-09T00:07:57.022 INFO:tasks.workunit.client.0.smithi026.stdout:3/729: creat d5/d9/d4a/d77/ff5 x:0 0 0 2024-05-09T00:07:57.024 INFO:tasks.workunit.client.0.smithi026.stdout:6/738: creat d15/d34/d52/d8b/ddb/ff2 x:0 0 0 2024-05-09T00:07:57.025 INFO:tasks.workunit.client.0.smithi026.stdout:3/730: symlink d5/d9/dc/d28/d63/d81/lf6 0 2024-05-09T00:07:57.026 INFO:tasks.workunit.client.0.smithi026.stdout:3/731: mkdir d5/dd4/ded/df7 0 2024-05-09T00:07:57.027 INFO:tasks.workunit.client.0.smithi026.stdout:2/860: dwrite d14/d22/fe6 [0,4194304] 0 2024-05-09T00:07:57.027 INFO:tasks.workunit.client.0.smithi026.stdout:2/861: chown d14/d22/d55/da3/d20/d41/d51/dc5/f11b 95494 1 2024-05-09T00:07:57.029 INFO:tasks.workunit.client.0.smithi026.stdout:5/861: dwrite d2/d8/d31/d32/d48/db3/ff6 [0,4194304] 0 2024-05-09T00:07:57.030 INFO:tasks.workunit.client.0.smithi026.stdout:3/732: link d5/d41/fe9 d5/d1e/d7b/deb/ff8 0 2024-05-09T00:07:57.032 INFO:tasks.workunit.client.0.smithi026.stdout:6/739: dread d15/d1e/d23/d73/d76/fb7 [0,4194304] 0 2024-05-09T00:07:57.032 INFO:tasks.workunit.client.0.smithi026.stdout:2/862: mkdir d14/d22/d55/da3/d30/d6a/d5f/de9/d121 0 2024-05-09T00:07:57.033 INFO:tasks.workunit.client.0.smithi026.stdout:5/862: creat d2/d8/d2a/d8d/f124 x:0 0 0 2024-05-09T00:07:57.034 INFO:tasks.workunit.client.0.smithi026.stdout:6/740: stat d15/d2b/d33/db4/cd8 0 2024-05-09T00:07:57.034 INFO:tasks.workunit.client.0.smithi026.stdout:6/741: fdatasync d15/d1e/d30/fd3 0 2024-05-09T00:07:57.036 INFO:tasks.workunit.client.0.smithi026.stdout:2/863: mknod d14/d22/d55/da3/d20/d41/c122 0 2024-05-09T00:07:57.036 INFO:tasks.workunit.client.0.smithi026.stdout:2/864: getdents d14/d22/d55/da3/d111 0 2024-05-09T00:07:57.037 INFO:tasks.workunit.client.0.smithi026.stdout:5/863: creat d2/d8/d31/d2e/d35/f125 x:0 0 0 2024-05-09T00:07:57.038 INFO:tasks.workunit.client.0.smithi026.stdout:5/864: write d2/d8/d31/fcb [4369576,27029] 0 2024-05-09T00:07:57.038 INFO:tasks.workunit.client.0.smithi026.stdout:5/865: readlink d2/d8/d31/d32/d5c/l87 0 2024-05-09T00:07:57.038 INFO:tasks.workunit.client.0.smithi026.stdout:5/866: readlink d2/d8/lea 0 2024-05-09T00:07:57.039 INFO:tasks.workunit.client.0.smithi026.stdout:6/742: creat d15/d34/d52/d74/db8/ff3 x:0 0 0 2024-05-09T00:07:57.041 INFO:tasks.workunit.client.0.smithi026.stdout:2/865: creat d14/d22/d55/da3/d30/d6a/d5b/f123 x:0 0 0 2024-05-09T00:07:57.045 INFO:tasks.workunit.client.0.smithi026.stdout:5/867: mknod d2/d8/d31/d32/d48/daa/db4/c126 0 2024-05-09T00:07:57.045 INFO:tasks.workunit.client.0.smithi026.stdout:5/868: readlink d2/d8/laf 0 2024-05-09T00:07:57.045 INFO:tasks.workunit.client.0.smithi026.stdout:3/733: dwrite d5/d9/d49/ff2 [0,4194304] 0 2024-05-09T00:07:57.046 INFO:tasks.workunit.client.0.smithi026.stdout:5/869: creat d2/d5a/d96/f127 x:0 0 0 2024-05-09T00:07:57.046 INFO:tasks.workunit.client.0.smithi026.stdout:5/870: chown d2/d8/c39 124691625 1 2024-05-09T00:07:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:3/734: symlink d5/d9/dc/d28/lf9 0 2024-05-09T00:07:57.060 INFO:tasks.workunit.client.0.smithi026.stdout:6/743: dwrite d15/d1e/d23/d3a/da6/fc1 [0,4194304] 0 2024-05-09T00:07:57.079 INFO:tasks.workunit.client.0.smithi026.stdout:6/744: dwrite d15/d41/fd5 [0,4194304] 0 2024-05-09T00:07:57.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:55.910435+0000 mgr.smithi135.kkrhgf (mgr.24419) 61 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 125 MiB/s rd, 267 MiB/s wr, 483 op/s 2024-05-09T00:07:57.152 INFO:tasks.workunit.client.0.smithi026.stdout:6/745: creat d15/d1e/d23/ff4 x:0 0 0 2024-05-09T00:07:57.154 INFO:tasks.workunit.client.0.smithi026.stdout:6/746: symlink d15/d34/d52/d74/dd0/lf5 0 2024-05-09T00:07:57.157 INFO:tasks.workunit.client.0.smithi026.stdout:6/747: mkdir d15/d1e/d23/d73/d8e/ddf/df6 0 2024-05-09T00:07:57.158 INFO:tasks.workunit.client.0.smithi026.stdout:6/748: unlink d15/d2b/d33/d55/d67/dbb/dbf/cce 0 2024-05-09T00:07:57.158 INFO:tasks.workunit.client.0.smithi026.stdout:6/749: chown d15/d34/d52/l68 63731 1 2024-05-09T00:07:57.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/750: read d15/f8c [21308,39684] 0 2024-05-09T00:07:57.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/751: readlink d15/d34/d52/d8b/ddb/lf1 0 2024-05-09T00:07:57.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/752: read - d15/d1e/d30/fec zero size 2024-05-09T00:07:57.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/753: write d15/d34/d52/d8b/f40 [962556,49473] 0 2024-05-09T00:07:57.160 INFO:tasks.workunit.client.0.smithi026.stdout:6/754: symlink d15/d2b/d33/d55/lf7 0 2024-05-09T00:07:57.161 INFO:tasks.workunit.client.0.smithi026.stdout:6/755: creat d15/d1e/d23/ff8 x:0 0 0 2024-05-09T00:07:57.162 INFO:tasks.workunit.client.0.smithi026.stdout:6/756: creat d15/d2b/d33/d55/d67/d90/ff9 x:0 0 0 2024-05-09T00:07:57.163 INFO:tasks.workunit.client.0.smithi026.stdout:6/757: symlink d15/d34/lfa 0 2024-05-09T00:07:57.164 INFO:tasks.workunit.client.0.smithi026.stdout:6/758: creat d15/d34/d52/d74/dd0/ffb x:0 0 0 2024-05-09T00:07:57.174 INFO:tasks.workunit.client.0.smithi026.stdout:6/759: dread d15/d2b/d33/f51 [0,4194304] 0 2024-05-09T00:07:57.176 INFO:tasks.workunit.client.0.smithi026.stdout:6/760: rename d15/f1d to d15/d1e/d23/d3a/ffc 0 2024-05-09T00:07:57.176 INFO:tasks.workunit.client.0.smithi026.stdout:7/973: sync 2024-05-09T00:07:57.181 INFO:tasks.workunit.client.0.smithi026.stdout:6/761: rmdir d15/d1e/d30/d75 39 2024-05-09T00:07:57.184 INFO:tasks.workunit.client.0.smithi026.stdout:6/762: creat d15/d1e/d30/d32/ffd x:0 0 0 2024-05-09T00:07:57.184 INFO:tasks.workunit.client.0.smithi026.stdout:6/763: stat d15/d2b/d33 0 2024-05-09T00:07:57.210 INFO:tasks.workunit.client.0.smithi026.stdout:6/764: dwrite d15/d34/f49 [0,4194304] 0 2024-05-09T00:07:57.210 INFO:tasks.workunit.client.0.smithi026.stdout:6/765: fdatasync d15/d41/fd5 0 2024-05-09T00:07:57.210 INFO:tasks.workunit.client.0.smithi026.stdout:7/974: dwrite d8/fcd [4194304,4194304] 0 2024-05-09T00:07:57.210 INFO:tasks.workunit.client.0.smithi026.stdout:7/975: stat d8/d2e/d84/db4/dbc/d1e/c36 0 2024-05-09T00:07:57.210 INFO:tasks.workunit.client.0.smithi026.stdout:7/976: chown f7 376 1 2024-05-09T00:07:57.212 INFO:tasks.workunit.client.0.smithi026.stdout:6/766: unlink ce 0 2024-05-09T00:07:57.216 INFO:tasks.workunit.client.0.smithi026.stdout:7/977: creat d8/d2e/d84/db4/dbc/d1e/d80/f150 x:0 0 0 2024-05-09T00:07:57.216 INFO:tasks.workunit.client.0.smithi026.stdout:7/978: truncate d8/d2e/d84/db4/dbc/d1e/d8a/df0/f100 1550208 0 2024-05-09T00:07:57.216 INFO:tasks.workunit.client.0.smithi026.stdout:7/979: write d8/d2e/d84/db4/dbc/d22/f85 [1177254,76329] 0 2024-05-09T00:07:57.216 INFO:tasks.workunit.client.0.smithi026.stdout:7/980: write d8/d2e/d84/db4/dbc/d22/fb5 [367992,16251] 0 2024-05-09T00:07:57.216 INFO:tasks.workunit.client.0.smithi026.stdout:6/767: symlink d15/d34/lfe 0 2024-05-09T00:07:57.219 INFO:tasks.workunit.client.0.smithi026.stdout:7/981: stat d8/lcc 0 2024-05-09T00:07:57.219 INFO:tasks.workunit.client.0.smithi026.stdout:7/982: fsync d8/d1b/d89/fa6 0 2024-05-09T00:07:57.220 INFO:tasks.workunit.client.0.smithi026.stdout:6/768: mkdir d15/d62/dff 0 2024-05-09T00:07:57.222 INFO:tasks.workunit.client.0.smithi026.stdout:7/983: creat d8/d2e/d84/db4/dbc/d22/f151 x:0 0 0 2024-05-09T00:07:57.225 INFO:tasks.workunit.client.0.smithi026.stdout:6/769: unlink d15/d2b/d33/d7d/fcf 0 2024-05-09T00:07:57.228 INFO:tasks.workunit.client.0.smithi026.stdout:7/984: unlink d8/d2e/d84/db4/dbc/d1e/d3d/d6b/faa 0 2024-05-09T00:07:57.230 INFO:tasks.workunit.client.0.smithi026.stdout:6/770: mkdir d15/d1e/d30/d100 0 2024-05-09T00:07:57.232 INFO:tasks.workunit.client.0.smithi026.stdout:7/985: creat d8/d2e/d126/d9a/f152 x:0 0 0 2024-05-09T00:07:57.232 INFO:tasks.workunit.client.0.smithi026.stdout:7/986: chown d8/cd 851 1 2024-05-09T00:07:57.232 INFO:tasks.workunit.client.0.smithi026.stdout:7/987: write d8/d2e/f134 [268808,23989] 0 2024-05-09T00:07:57.235 INFO:tasks.workunit.client.0.smithi026.stdout:6/771: creat d15/d1e/d23/d73/d76/f101 x:0 0 0 2024-05-09T00:07:57.235 INFO:tasks.workunit.client.0.smithi026.stdout:6/772: dread - d15/d1e/d30/d75/f89 zero size 2024-05-09T00:07:57.238 INFO:tasks.workunit.client.0.smithi026.stdout:7/988: rename d8/fc8 to d8/d1b/d89/dc1/f153 0 2024-05-09T00:07:57.238 INFO:tasks.workunit.client.0.smithi026.stdout:7/989: chown d8/d2e/d84/db4/dbc/d1e/d80/da2/cb1 6692602 1 2024-05-09T00:07:57.238 INFO:tasks.workunit.client.0.smithi026.stdout:7/990: fdatasync d8/d2e/d84/fe3 0 2024-05-09T00:07:57.238 INFO:tasks.workunit.client.0.smithi026.stdout:7/991: write d8/d2e/d84/db4/dbc/d1e/d3d/f48 [1771897,19192] 0 2024-05-09T00:07:57.240 INFO:tasks.workunit.client.0.smithi026.stdout:6/773: write d15/d1e/d23/d73/d58/d5c/f5d [4128746,68722] 0 2024-05-09T00:07:57.240 INFO:tasks.workunit.client.0.smithi026.stdout:6/774: readlink d15/d34/d52/d8b/ddb/lf1 0 2024-05-09T00:07:57.240 INFO:tasks.workunit.client.0.smithi026.stdout:6/775: dread - d15/d1e/d30/d75/f89 zero size 2024-05-09T00:07:57.242 INFO:tasks.workunit.client.0.smithi026.stdout:6/776: rmdir d15/d34/d52/d8b/d4d/de8 0 2024-05-09T00:07:57.243 INFO:tasks.workunit.client.0.smithi026.stdout:6/777: chown d15/d1e/d30/fd3 1247549 1 2024-05-09T00:07:57.243 INFO:tasks.workunit.client.0.smithi026.stdout:8/974: sync 2024-05-09T00:07:57.243 INFO:tasks.workunit.client.0.smithi026.stdout:4/882: sync 2024-05-09T00:07:57.244 INFO:tasks.workunit.client.0.smithi026.stdout:4/883: getdents d0/d12/d1b/d118 0 2024-05-09T00:07:57.244 INFO:tasks.workunit.client.0.smithi026.stdout:7/992: rename d8/d2e/d84/db4/dbc/d1e/d3d/c96 to d8/d2e/d84/db4/dbc/d1e/d8a/df5/c154 0 2024-05-09T00:07:57.246 INFO:tasks.workunit.client.0.smithi026.stdout:6/778: mkdir d15/d2b/d33/db4/d102 0 2024-05-09T00:07:57.246 INFO:tasks.workunit.client.0.smithi026.stdout:6/779: write d15/d34/d52/d8b/fa4 [474539,62262] 0 2024-05-09T00:07:57.248 INFO:tasks.workunit.client.0.smithi026.stdout:8/975: mkdir de/d17/d21/d6f/d106/d14e 0 2024-05-09T00:07:57.248 INFO:tasks.workunit.client.0.smithi026.stdout:8/976: chown de/d17/d21/d24/d3b/d3d/cd0 260 1 2024-05-09T00:07:57.251 INFO:tasks.workunit.client.0.smithi026.stdout:4/884: rename d0/d83 to d0/d12/d64/dac/d12a 0 2024-05-09T00:07:57.254 INFO:tasks.workunit.client.0.smithi026.stdout:7/993: rmdir d8/d2e/d84/db4/d14f 0 2024-05-09T00:07:57.254 INFO:tasks.workunit.client.0.smithi026.stdout:7/994: truncate d8/d2e/d84/db4/dbc/d22/da1/f108 325465 0 2024-05-09T00:07:57.257 INFO:tasks.workunit.client.0.smithi026.stdout:6/780: symlink d15/d34/d52/d74/db8/l103 0 2024-05-09T00:07:57.257 INFO:tasks.workunit.client.0.smithi026.stdout:6/781: chown d15/d34/d52/d74/db8/ff3 246204 1 2024-05-09T00:07:57.262 INFO:tasks.workunit.client.0.smithi026.stdout:4/885: creat d0/d12/d64/dac/f12b x:0 0 0 2024-05-09T00:07:57.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/995: link d8/d2e/d126/f138 d8/d2e/d84/db4/dbc/d1e/f155 0 2024-05-09T00:07:57.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/996: fdatasync d8/d1b/dfe/f133 0 2024-05-09T00:07:57.262 INFO:tasks.workunit.client.0.smithi026.stdout:8/977: dwrite de/d48/d3e/dc4/f12d [0,4194304] 0 2024-05-09T00:07:57.263 INFO:tasks.workunit.client.0.smithi026.stdout:4/886: mkdir d0/d12/d1b/d12c 0 2024-05-09T00:07:57.268 INFO:tasks.workunit.client.0.smithi026.stdout:4/887: symlink d0/d12/d1b/d4e/l12d 0 2024-05-09T00:07:57.268 INFO:tasks.workunit.client.0.smithi026.stdout:4/888: getdents d0/d12/d64/dac/d12a/d115 0 2024-05-09T00:07:57.275 INFO:tasks.workunit.client.0.smithi026.stdout:6/782: dwrite d15/d1e/d23/d73/f3c [0,4194304] 0 2024-05-09T00:07:57.275 INFO:tasks.workunit.client.0.smithi026.stdout:8/978: dread de/d17/f69 [0,4194304] 0 2024-05-09T00:07:57.276 INFO:tasks.workunit.client.0.smithi026.stdout:4/889: mknod d0/d12/da2/d97/d43/d49/de7/dfc/d106/c12e 0 2024-05-09T00:07:57.281 INFO:tasks.workunit.client.0.smithi026.stdout:6/783: creat d15/d34/d52/d74/f104 x:0 0 0 2024-05-09T00:07:57.286 INFO:tasks.workunit.client.0.smithi026.stdout:6/784: dread d15/d1e/d23/d73/d58/d5c/f5d [0,4194304] 0 2024-05-09T00:07:57.286 INFO:tasks.workunit.client.0.smithi026.stdout:6/785: chown d15/d1e/d23/d73/d58/d5c/f5d 79761 1 2024-05-09T00:07:57.292 INFO:tasks.workunit.client.0.smithi026.stdout:8/979: symlink de/d17/d21/d24/d5b/l14f 0 2024-05-09T00:07:57.295 INFO:tasks.workunit.client.0.smithi026.stdout:4/890: mknod d0/d12/da2/d97/dbf/dd1/d11a/c12f 0 2024-05-09T00:07:57.297 INFO:tasks.workunit.client.0.smithi026.stdout:6/786: creat d15/d1e/d23/d73/f105 x:0 0 0 2024-05-09T00:07:57.298 INFO:tasks.workunit.client.0.smithi026.stdout:4/891: unlink d0/d12/da2/d97/d43/d49/fc7 0 2024-05-09T00:07:57.298 INFO:tasks.workunit.client.0.smithi026.stdout:4/892: stat d0/d12/da2/d97/d43/d49/d8f/da3/d86/fdb 0 2024-05-09T00:07:57.300 INFO:tasks.workunit.client.0.smithi026.stdout:7/997: dwrite d8/d2e/d84/db4/dbc/d1e/d3d/f48 [0,4194304] 0 2024-05-09T00:07:57.302 INFO:tasks.workunit.client.0.smithi026.stdout:6/787: stat c8 0 2024-05-09T00:07:57.305 INFO:tasks.workunit.client.0.smithi026.stdout:4/893: mkdir d0/d12/da2/d97/dbf/dd1/dfb/d130 0 2024-05-09T00:07:57.309 INFO:tasks.workunit.client.0.smithi026.stdout:6/788: symlink d15/d34/d52/d74/db8/ded/l106 0 2024-05-09T00:07:57.309 INFO:tasks.workunit.client.0.smithi026.stdout:6/789: dread - d15/d1e/d23/d73/d8e/fbe zero size 2024-05-09T00:07:57.310 INFO:tasks.workunit.client.0.smithi026.stdout:8/980: dwrite de/d17/d21/d24/f99 [0,4194304] 0 2024-05-09T00:07:57.310 INFO:tasks.workunit.client.0.smithi026.stdout:8/981: chown de/d6c/d31/d4f/d87/d62/daa/ddb/d91/f113 415841 1 2024-05-09T00:07:57.310 INFO:tasks.workunit.client.0.smithi026.stdout:4/894: creat d0/d12/da2/d97/d43/d49/de7/dfc/d106/f131 x:0 0 0 2024-05-09T00:07:57.313 INFO:tasks.workunit.client.0.smithi026.stdout:6/790: link d15/d41/c45 d15/d1e/d23/d73/d58/c107 0 2024-05-09T00:07:57.319 INFO:tasks.workunit.client.0.smithi026.stdout:7/998: dwrite d8/d2e/d84/db4/dbc/f142 [0,4194304] 0 2024-05-09T00:07:57.320 INFO:tasks.workunit.client.0.smithi026.stdout:8/982: mknod de/d6c/d31/d4f/df1/dfc/c150 0 2024-05-09T00:07:57.321 INFO:tasks.workunit.client.0.smithi026.stdout:8/983: write de/d17/f1a [90054,50948] 0 2024-05-09T00:07:57.321 INFO:tasks.workunit.client.0.smithi026.stdout:6/791: mknod d15/d62/c108 0 2024-05-09T00:07:57.325 INFO:tasks.workunit.client.0.smithi026.stdout:4/895: dread d0/d12/f13 [0,4194304] 0 2024-05-09T00:07:57.328 INFO:tasks.workunit.client.0.smithi026.stdout:7/999: unlink d8/d2e/d84/db4/dbc/d22/l114 0 2024-05-09T00:07:57.329 INFO:tasks.workunit.client.0.smithi026.stdout:8/984: rename de/d6c/d31/d4f/deb/f140 to de/d6c/db5/f151 0 2024-05-09T00:07:57.331 INFO:tasks.workunit.client.0.smithi026.stdout:8/985: creat de/f152 x:0 0 0 2024-05-09T00:07:57.333 INFO:tasks.workunit.client.0.smithi026.stdout:4/896: write d0/d12/da2/d97/d43/d58/f9c [1308203,87127] 0 2024-05-09T00:07:57.335 INFO:tasks.workunit.client.0.smithi026.stdout:4/897: creat d0/d12/d1b/d4e/d92/f132 x:0 0 0 2024-05-09T00:07:57.336 INFO:tasks.workunit.client.0.smithi026.stdout:4/898: getdents d0/d12/da2/d97/d43/d58/d120 0 2024-05-09T00:07:57.336 INFO:tasks.workunit.client.0.smithi026.stdout:4/899: fsync d0/d12/da2/d97/d43/d49/d8f/da3/d66/faf 0 2024-05-09T00:07:57.337 INFO:tasks.workunit.client.0.smithi026.stdout:4/900: write d0/d12/d64/fab [398943,123855] 0 2024-05-09T00:07:57.337 INFO:tasks.workunit.client.0.smithi026.stdout:4/901: write d0/d12/da2/db8/fc4 [1886957,116598] 0 2024-05-09T00:07:57.339 INFO:tasks.workunit.client.0.smithi026.stdout:4/902: symlink d0/d12/d64/dac/dd3/l133 0 2024-05-09T00:07:57.339 INFO:tasks.workunit.client.0.smithi026.stdout:4/903: truncate d0/d12/da2/d97/d43/d58/f9c 5052907 0 2024-05-09T00:07:57.341 INFO:tasks.workunit.client.0.smithi026.stdout:4/904: rename d0/d12/d1b/f3c to d0/d12/d1b/d118/f134 0 2024-05-09T00:07:57.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/905: mknod d0/d12/d64/dac/d12a/d115/c135 0 2024-05-09T00:07:57.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/906: write d0/d12/da2/d97/d43/d49/fdf [1184513,69770] 0 2024-05-09T00:07:57.344 INFO:tasks.workunit.client.0.smithi026.stdout:6/792: dwrite d15/d2b/f42 [0,4194304] 0 2024-05-09T00:07:57.345 INFO:tasks.workunit.client.0.smithi026.stdout:4/907: creat d0/d12/da2/d101/f136 x:0 0 0 2024-05-09T00:07:57.356 INFO:tasks.workunit.client.0.smithi026.stdout:6/793: dread d15/d1e/d23/d3a/da6/fc1 [0,4194304] 0 2024-05-09T00:07:57.368 INFO:tasks.workunit.client.0.smithi026.stdout:4/908: dwrite d0/d12/da2/d97/d43/d49/d8f/fe2 [0,4194304] 0 2024-05-09T00:07:57.371 INFO:tasks.workunit.client.0.smithi026.stdout:4/909: creat d0/d12/da2/d97/dbf/dd1/dfb/f137 x:0 0 0 2024-05-09T00:07:57.372 INFO:tasks.workunit.client.0.smithi026.stdout:8/986: dwrite de/d6c/d31/d4f/dbb/ff2 [0,4194304] 0 2024-05-09T00:07:57.372 INFO:tasks.workunit.client.0.smithi026.stdout:8/987: write de/d17/d21/fcb [72479,83803] 0 2024-05-09T00:07:57.374 INFO:tasks.workunit.client.0.smithi026.stdout:6/794: dwrite d15/d1e/d23/f4a [0,4194304] 0 2024-05-09T00:07:57.375 INFO:tasks.workunit.client.0.smithi026.stdout:4/910: link d0/d12/da2/db8/c104 d0/d12/d64/dac/d12a/c138 0 2024-05-09T00:07:57.379 INFO:tasks.workunit.client.0.smithi026.stdout:8/988: creat de/d17/d21/d24/d5b/dbd/f153 x:0 0 0 2024-05-09T00:07:57.384 INFO:tasks.workunit.client.0.smithi026.stdout:6/795: creat d15/d1e/f109 x:0 0 0 2024-05-09T00:07:57.384 INFO:tasks.workunit.client.0.smithi026.stdout:1/943: sync 2024-05-09T00:07:57.386 INFO:tasks.workunit.client.0.smithi026.stdout:4/911: creat d0/d12/d64/dac/d12a/d115/f139 x:0 0 0 2024-05-09T00:07:57.390 INFO:tasks.workunit.client.0.smithi026.stdout:1/944: rename d5/dd/d121 to d5/dd/d17/d9f/dc6/de2/d13e 0 2024-05-09T00:07:57.391 INFO:tasks.workunit.client.0.smithi026.stdout:4/912: truncate d0/d12/da2/d97/d43/d58/fbb 605615 0 2024-05-09T00:07:57.391 INFO:tasks.workunit.client.0.smithi026.stdout:4/913: fdatasync d0/d12/d64/f6e 0 2024-05-09T00:07:57.391 INFO:tasks.workunit.client.0.smithi026.stdout:4/914: chown d0/d12/da2/d97/dbf/dd1/d11a 7419 1 2024-05-09T00:07:57.392 INFO:tasks.workunit.client.0.smithi026.stdout:6/796: dread d15/d62/f64 [4194304,4194304] 0 2024-05-09T00:07:57.395 INFO:tasks.workunit.client.0.smithi026.stdout:8/989: dwrite de/d6c/d31/d4f/d87/fe1 [0,4194304] 0 2024-05-09T00:07:57.395 INFO:tasks.workunit.client.0.smithi026.stdout:8/990: chown de/d6c/d31/d4f/d87/d62/f95 5 1 2024-05-09T00:07:57.396 INFO:tasks.workunit.client.0.smithi026.stdout:1/945: getdents d5/dd/d17/d73 0 2024-05-09T00:07:57.400 INFO:tasks.workunit.client.0.smithi026.stdout:6/797: rename d15/d34/d52/d74 to d15/d1e/d30/d32/d10a 0 2024-05-09T00:07:57.401 INFO:tasks.workunit.client.0.smithi026.stdout:6/798: read d15/d1e/d23/d6f/f97 [3809998,120547] 0 2024-05-09T00:07:57.402 INFO:tasks.workunit.client.0.smithi026.stdout:8/991: creat de/dd9/d116/d146/f154 x:0 0 0 2024-05-09T00:07:57.405 INFO:tasks.workunit.client.0.smithi026.stdout:6/799: getdents d15/d1e 0 2024-05-09T00:07:57.410 INFO:tasks.workunit.client.0.smithi026.stdout:6/800: mkdir d15/d2b/d33/d7d/d10b 0 2024-05-09T00:07:57.410 INFO:tasks.workunit.client.0.smithi026.stdout:6/801: truncate d15/d1e/d30/fd3 5060196 0 2024-05-09T00:07:57.410 INFO:tasks.workunit.client.0.smithi026.stdout:6/802: chown d15/d1e/d23/d3a/caa 396228130 1 2024-05-09T00:07:57.418 INFO:tasks.workunit.client.0.smithi026.stdout:6/803: dread d15/d1e/d3d/f47 [0,4194304] 0 2024-05-09T00:07:57.424 INFO:tasks.workunit.client.0.smithi026.stdout:1/946: dwrite d5/dd/d17/d7b/f9c [0,4194304] 0 2024-05-09T00:07:57.424 INFO:tasks.workunit.client.0.smithi026.stdout:1/947: write d5/dd/d1f/faf [316306,117590] 0 2024-05-09T00:07:57.424 INFO:tasks.workunit.client.0.smithi026.stdout:1/948: fdatasync d5/db/f5d 0 2024-05-09T00:07:57.429 INFO:tasks.workunit.client.0.smithi026.stdout:4/915: dwrite d0/fe [0,4194304] 0 2024-05-09T00:07:57.429 INFO:tasks.workunit.client.0.smithi026.stdout:4/916: chown d0/d12/da2/d97/d43/d49/d8f/dc1/f103 215053 1 2024-05-09T00:07:57.430 INFO:tasks.workunit.client.0.smithi026.stdout:8/992: dread de/d6c/d31/d4f/d87/f77 [0,4194304] 0 2024-05-09T00:07:57.431 INFO:tasks.workunit.client.0.smithi026.stdout:6/804: write d15/f18 [13147173,35304] 0 2024-05-09T00:07:57.431 INFO:tasks.workunit.client.0.smithi026.stdout:6/805: stat d15/d1e 0 2024-05-09T00:07:57.434 INFO:tasks.workunit.client.0.smithi026.stdout:4/917: mkdir d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/d125/d13a 0 2024-05-09T00:07:57.437 INFO:tasks.workunit.client.0.smithi026.stdout:6/806: creat d15/d2b/d33/db4/d102/f10c x:0 0 0 2024-05-09T00:07:57.437 INFO:tasks.workunit.client.0.smithi026.stdout:6/807: fsync d15/d2b/d33/fc0 0 2024-05-09T00:07:57.437 INFO:tasks.workunit.client.0.smithi026.stdout:6/808: read d15/d2b/d33/d55/f95 [449085,35742] 0 2024-05-09T00:07:57.440 INFO:tasks.workunit.client.0.smithi026.stdout:1/949: dwrite d5/d16/dd5/f12c [0,4194304] 0 2024-05-09T00:07:57.440 INFO:tasks.workunit.client.0.smithi026.stdout:6/809: write d15/f18 [3045354,121294] 0 2024-05-09T00:07:57.441 INFO:tasks.workunit.client.0.smithi026.stdout:1/950: write d5/db/d108/d103/de0/ff6 [536787,98400] 0 2024-05-09T00:07:57.444 INFO:tasks.workunit.client.0.smithi026.stdout:6/810: truncate d15/f1f 3748172 0 2024-05-09T00:07:57.444 INFO:tasks.workunit.client.0.smithi026.stdout:6/811: chown d15/d34/d52/f9d 66389690 1 2024-05-09T00:07:57.445 INFO:tasks.workunit.client.0.smithi026.stdout:6/812: creat d15/d2b/d33/d55/d67/dbb/dbf/f10d x:0 0 0 2024-05-09T00:07:57.446 INFO:tasks.workunit.client.0.smithi026.stdout:8/993: truncate de/d6c/d31/d4f/d87/fe1 942184 0 2024-05-09T00:07:57.447 INFO:tasks.workunit.client.0.smithi026.stdout:8/994: symlink de/dd9/d116/dd2/l155 0 2024-05-09T00:07:57.448 INFO:tasks.workunit.client.0.smithi026.stdout:6/813: dread d15/d1e/d3d/f70 [0,4194304] 0 2024-05-09T00:07:57.449 INFO:tasks.workunit.client.0.smithi026.stdout:8/995: symlink de/d17/d21/dca/d104/d10a/l156 0 2024-05-09T00:07:57.450 INFO:tasks.workunit.client.0.smithi026.stdout:1/951: dread d5/dd/d1f/d39/f8e [0,4194304] 0 2024-05-09T00:07:57.451 INFO:tasks.workunit.client.0.smithi026.stdout:6/814: symlink d15/d62/dff/l10e 0 2024-05-09T00:07:57.452 INFO:tasks.workunit.client.0.smithi026.stdout:8/996: mkdir de/d6c/d31/d4f/df1/dfc/d11d/d157 0 2024-05-09T00:07:57.453 INFO:tasks.workunit.client.0.smithi026.stdout:6/815: mkdir d15/d1e/d23/d73/d76/d10f 0 2024-05-09T00:07:57.456 INFO:tasks.workunit.client.0.smithi026.stdout:8/997: rmdir de/d17/d21/d6f/d107 39 2024-05-09T00:07:57.456 INFO:tasks.workunit.client.0.smithi026.stdout:2/866: sync 2024-05-09T00:07:57.456 INFO:tasks.workunit.client.0.smithi026.stdout:9/928: sync 2024-05-09T00:07:57.456 INFO:tasks.workunit.client.0.smithi026.stdout:2/867: chown d14/d22/d55/da3/d20/d41 582524 1 2024-05-09T00:07:57.458 INFO:tasks.workunit.client.0.smithi026.stdout:4/918: dwrite d0/f75 [4194304,4194304] 0 2024-05-09T00:07:57.458 INFO:tasks.workunit.client.0.smithi026.stdout:1/952: dread d5/db/f62 [0,4194304] 0 2024-05-09T00:07:57.458 INFO:tasks.workunit.client.0.smithi026.stdout:1/953: fdatasync d5/dd/d17/d9f/da5/f11b 0 2024-05-09T00:07:57.459 INFO:tasks.workunit.client.0.smithi026.stdout:1/954: read - d5/dd/d17/d9f/dc6/de2/f114 zero size 2024-05-09T00:07:57.459 INFO:tasks.workunit.client.0.smithi026.stdout:1/955: chown d5/dd/d17/f8b 206364935 1 2024-05-09T00:07:57.459 INFO:tasks.workunit.client.0.smithi026.stdout:1/956: write d5/dd/d17/fd9 [241290,45805] 0 2024-05-09T00:07:57.460 INFO:tasks.workunit.client.0.smithi026.stdout:8/998: creat de/d6c/d31/d4f/deb/dfb/d14c/f158 x:0 0 0 2024-05-09T00:07:57.468 INFO:tasks.workunit.client.0.smithi026.stdout:1/957: dread d5/dd/d1f/d39/f8e [0,4194304] 0 2024-05-09T00:07:57.468 INFO:tasks.workunit.client.0.smithi026.stdout:1/958: truncate d5/dd/ddd/f122 39141 0 2024-05-09T00:07:57.468 INFO:tasks.workunit.client.0.smithi026.stdout:1/959: fdatasync d5/db/d108/d103/fc4 0 2024-05-09T00:07:57.472 INFO:tasks.workunit.client.0.smithi026.stdout:2/868: dread d14/d22/d55/f9f [0,4194304] 0 2024-05-09T00:07:57.472 INFO:tasks.workunit.client.0.smithi026.stdout:2/869: write d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/f11c [19405,113290] 0 2024-05-09T00:07:57.472 INFO:tasks.workunit.client.0.smithi026.stdout:9/929: dwrite d7/d26/fca [0,4194304] 0 2024-05-09T00:07:57.480 INFO:tasks.workunit.client.0.smithi026.stdout:1/960: dwrite f3 [0,4194304] 0 2024-05-09T00:07:57.482 INFO:tasks.workunit.client.0.smithi026.stdout:1/961: dread d5/dd/d1f/f57 [0,4194304] 0 2024-05-09T00:07:57.502 INFO:tasks.workunit.client.0.smithi026.stdout:4/919: rename d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/c129 to d0/d12/da2/d97/d43/d49/d8f/dc1/c13b 0 2024-05-09T00:07:57.507 INFO:tasks.workunit.client.0.smithi026.stdout:8/999: creat de/d6c/d31/d4f/df1/dfc/d11d/d157/f159 x:0 0 0 2024-05-09T00:07:57.510 INFO:tasks.workunit.client.0.smithi026.stdout:2/870: mknod d14/d102/c124 0 2024-05-09T00:07:57.510 INFO:tasks.workunit.client.0.smithi026.stdout:2/871: truncate d14/d22/d55/da3/d20/d10a/f112 442416 0 2024-05-09T00:07:57.510 INFO:tasks.workunit.client.0.smithi026.stdout:2/872: chown d14/d102/f11d 28 1 2024-05-09T00:07:57.514 INFO:tasks.workunit.client.0.smithi026.stdout:9/930: link d7/d26/f122 d7/d23/d116/f142 0 2024-05-09T00:07:57.515 INFO:tasks.workunit.client.0.smithi026.stdout:1/962: unlink d5/d16/d60/dda/l104 0 2024-05-09T00:07:57.516 INFO:tasks.workunit.client.0.smithi026.stdout:4/920: stat d0/d12/da2/d97/d43/d49/d8f/da3/c72 0 2024-05-09T00:07:57.516 INFO:tasks.workunit.client.0.smithi026.stdout:4/921: read d0/d12/d1b/f5f [3626319,56010] 0 2024-05-09T00:07:57.516 INFO:tasks.workunit.client.0.smithi026.stdout:4/922: fsync d0/f75 0 2024-05-09T00:07:57.517 INFO:tasks.workunit.client.0.smithi026.stdout:2/873: creat d14/d22/d55/da3/d30/dc3/f125 x:0 0 0 2024-05-09T00:07:57.517 INFO:tasks.workunit.client.0.smithi026.stdout:3/735: sync 2024-05-09T00:07:57.517 INFO:tasks.workunit.client.0.smithi026.stdout:5/871: sync 2024-05-09T00:07:57.518 INFO:tasks.workunit.client.0.smithi026.stdout:3/736: write d5/f1f [3962878,24158] 0 2024-05-09T00:07:57.518 INFO:tasks.workunit.client.0.smithi026.stdout:9/931: creat d7/d23/d29/d31/d40/dd5/f143 x:0 0 0 2024-05-09T00:07:57.519 INFO:tasks.workunit.client.0.smithi026.stdout:1/963: truncate d5/d16/f24 3770318 0 2024-05-09T00:07:57.523 INFO:tasks.workunit.client.0.smithi026.stdout:4/923: creat d0/d12/d10e/f13c x:0 0 0 2024-05-09T00:07:57.526 INFO:tasks.workunit.client.0.smithi026.stdout:2/874: creat d14/d22/d55/da3/d17/f126 x:0 0 0 2024-05-09T00:07:57.529 INFO:tasks.workunit.client.0.smithi026.stdout:5/872: link d2/d8/d31/d32/d48/daa/db4/fc6 d2/d5a/d104/d11f/f128 0 2024-05-09T00:07:57.532 INFO:tasks.workunit.client.0.smithi026.stdout:4/924: creat d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/f13d x:0 0 0 2024-05-09T00:07:57.538 INFO:tasks.workunit.client.0.smithi026.stdout:4/925: rename d0/d12/da2/d97/d43/f44 to d0/d12/da2/d97/dbf/f13e 0 2024-05-09T00:07:57.538 INFO:tasks.workunit.client.0.smithi026.stdout:4/926: getdents d0/d12/d110 0 2024-05-09T00:07:57.568 INFO:tasks.workunit.client.0.smithi026.stdout:1/964: dwrite d5/db/d108/d12b/d97/f55 [4194304,4194304] 0 2024-05-09T00:07:57.568 INFO:tasks.workunit.client.0.smithi026.stdout:3/737: dwrite d5/f22 [0,4194304] 0 2024-05-09T00:07:57.569 INFO:tasks.workunit.client.0.smithi026.stdout:5/873: dwrite d2/d8/d31/d4b/fd1 [0,4194304] 0 2024-05-09T00:07:57.570 INFO:tasks.workunit.client.0.smithi026.stdout:1/965: rename d5/d16/d60/f74 to d5/dd/d17/d7b/deb/f13f 0 2024-05-09T00:07:57.570 INFO:tasks.workunit.client.0.smithi026.stdout:1/966: fdatasync d5/dd/d17/f2a 0 2024-05-09T00:07:57.570 INFO:tasks.workunit.client.0.smithi026.stdout:1/967: chown d5/dd/f52 19010 1 2024-05-09T00:07:57.573 INFO:tasks.workunit.client.0.smithi026.stdout:3/738: dread d5/d9/d71/faf [0,4194304] 0 2024-05-09T00:07:57.573 INFO:tasks.workunit.client.0.smithi026.stdout:3/739: fsync d5/da7/fbc 0 2024-05-09T00:07:57.573 INFO:tasks.workunit.client.0.smithi026.stdout:9/932: dwrite d7/d23/d29/d31/d40/d41/d54/d5c/f8f [0,4194304] 0 2024-05-09T00:07:57.573 INFO:tasks.workunit.client.0.smithi026.stdout:2/875: dwrite d14/d22/d55/da3/d3b/f3f [0,4194304] 0 2024-05-09T00:07:57.574 INFO:tasks.workunit.client.0.smithi026.stdout:9/933: write d7/d23/d29/d31/d40/d41/d54/d9a/da4/fe0 [5117842,53714] 0 2024-05-09T00:07:57.574 INFO:tasks.workunit.client.0.smithi026.stdout:5/874: write d2/d8/d31/d2e/d33/f116 [2073675,93487] 0 2024-05-09T00:07:57.574 INFO:tasks.workunit.client.0.smithi026.stdout:4/927: dread d0/f9 [0,4194304] 0 2024-05-09T00:07:57.578 INFO:tasks.workunit.client.0.smithi026.stdout:1/968: creat d5/db/d108/d12b/d97/d75/f140 x:0 0 0 2024-05-09T00:07:57.581 INFO:tasks.workunit.client.0.smithi026.stdout:2/876: dread d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/fc2 [0,4194304] 0 2024-05-09T00:07:57.582 INFO:tasks.workunit.client.0.smithi026.stdout:3/740: rename d5/d9/f6d to d5/d44/d9f/dc5/ffa 0 2024-05-09T00:07:57.587 INFO:tasks.workunit.client.0.smithi026.stdout:9/934: getdents d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc 0 2024-05-09T00:07:57.595 INFO:tasks.workunit.client.0.smithi026.stdout:1/969: creat d5/dd/d17/d9f/da5/f141 x:0 0 0 2024-05-09T00:07:57.595 INFO:tasks.workunit.client.0.smithi026.stdout:1/970: write d5/dd/d17/fbe [5607627,21432] 0 2024-05-09T00:07:57.598 INFO:tasks.workunit.client.0.smithi026.stdout:2/877: unlink d14/d22/d55/da3/d20/f36 0 2024-05-09T00:07:57.601 INFO:tasks.workunit.client.0.smithi026.stdout:4/928: rename d0/d12/da2/f85 to d0/d12/d34/f13f 0 2024-05-09T00:07:57.604 INFO:tasks.workunit.client.0.smithi026.stdout:3/741: mknod d5/d44/d9f/cfb 0 2024-05-09T00:07:57.604 INFO:tasks.workunit.client.0.smithi026.stdout:3/742: write d5/dd4/ded/d6f/d75/fd0 [60126,94798] 0 2024-05-09T00:07:57.606 INFO:tasks.workunit.client.0.smithi026.stdout:3/743: write d5/d9/d49/ff2 [2093100,47878] 0 2024-05-09T00:07:57.606 INFO:tasks.workunit.client.0.smithi026.stdout:3/744: chown d5/dd4/ded/d6f/l8b 771 1 2024-05-09T00:07:57.606 INFO:tasks.workunit.client.0.smithi026.stdout:9/935: dwrite d7/d23/d29/d31/d40/d41/d54/dc5/ffa [4194304,4194304] 0 2024-05-09T00:07:57.607 INFO:tasks.workunit.client.0.smithi026.stdout:1/971: symlink d5/dd/d1f/d39/d47/l142 0 2024-05-09T00:07:57.607 INFO:tasks.workunit.client.0.smithi026.stdout:1/972: chown d5/dd/d17/d7b/deb 97669972 1 2024-05-09T00:07:57.608 INFO:tasks.workunit.client.0.smithi026.stdout:4/929: symlink d0/d12/d64/l140 0 2024-05-09T00:07:57.612 INFO:tasks.workunit.client.0.smithi026.stdout:9/936: creat d7/d23/d29/d2e/f144 x:0 0 0 2024-05-09T00:07:57.612 INFO:tasks.workunit.client.0.smithi026.stdout:9/937: chown d7/d23/d29/d31/d40/l83 152 1 2024-05-09T00:07:57.614 INFO:tasks.workunit.client.0.smithi026.stdout:1/973: rename d5/d16/dbd/ff1 to d5/db/d1d/dd1/d105/f143 0 2024-05-09T00:07:57.616 INFO:tasks.workunit.client.0.smithi026.stdout:4/930: getdents d0/d12/d64/dac/dd4 0 2024-05-09T00:07:57.618 INFO:tasks.workunit.client.0.smithi026.stdout:4/931: creat d0/d12/d64/dac/d12a/d115/f141 x:0 0 0 2024-05-09T00:07:57.618 INFO:tasks.workunit.client.0.smithi026.stdout:9/938: write d7/d23/d29/d31/f3d [728766,11004] 0 2024-05-09T00:07:57.618 INFO:tasks.workunit.client.0.smithi026.stdout:2/878: dwrite d14/d22/d55/f67 [0,4194304] 0 2024-05-09T00:07:57.621 INFO:tasks.workunit.client.0.smithi026.stdout:9/939: unlink d7/d23/d2f/l81 0 2024-05-09T00:07:57.622 INFO:tasks.workunit.client.0.smithi026.stdout:3/745: dwrite d5/d44/dd9/fec [0,4194304] 0 2024-05-09T00:07:57.629 INFO:tasks.workunit.client.0.smithi026.stdout:2/879: unlink d14/d22/d55/da3/d30/d6a/d5f/d61/d6c/d85/fee 0 2024-05-09T00:07:57.630 INFO:tasks.workunit.client.0.smithi026.stdout:9/940: creat d7/d23/d29/d31/d40/d41/d54/dc5/f145 x:0 0 0 2024-05-09T00:07:57.633 INFO:tasks.workunit.client.0.smithi026.stdout:1/974: dwrite f4 [8388608,4194304] 0 2024-05-09T00:07:57.633 INFO:tasks.workunit.client.0.smithi026.stdout:1/975: dread - d5/dd/d1f/d51/f6f zero size 2024-05-09T00:07:57.633 INFO:tasks.workunit.client.0.smithi026.stdout:1/976: readlink d5/db/d1d/l13c 0 2024-05-09T00:07:57.634 INFO:tasks.workunit.client.0.smithi026.stdout:2/880: dread d14/d22/d55/f56 [4194304,4194304] 0 2024-05-09T00:07:57.637 INFO:tasks.workunit.client.0.smithi026.stdout:3/746: symlink d5/d1e/d3e/lfc 0 2024-05-09T00:07:57.643 INFO:tasks.workunit.client.0.smithi026.stdout:1/977: rename d5/dd/d17/d7b/de1/c10b to d5/dd/d17/d9f/dc6/c144 0 2024-05-09T00:07:57.647 INFO:tasks.workunit.client.0.smithi026.stdout:2/881: creat d14/d22/d55/deb/dfc/f127 x:0 0 0 2024-05-09T00:07:57.648 INFO:tasks.workunit.client.0.smithi026.stdout:3/747: mkdir d5/dd4/ded/d6f/d9e/dfd 0 2024-05-09T00:07:57.650 INFO:tasks.workunit.client.0.smithi026.stdout:3/748: dread d5/d9/dc/d28/d2c/fa6 [0,4194304] 0 2024-05-09T00:07:57.651 INFO:tasks.workunit.client.0.smithi026.stdout:9/941: link d7/d26/ff7 d7/d23/d29/d31/d40/d41/d54/f146 0 2024-05-09T00:07:57.653 INFO:tasks.workunit.client.0.smithi026.stdout:1/978: symlink d5/dd/d17/d9f/da5/l145 0 2024-05-09T00:07:57.653 INFO:tasks.workunit.client.0.smithi026.stdout:1/979: chown d5/dd/d17/d9f/dc6/de2/f114 148808182 1 2024-05-09T00:07:57.655 INFO:tasks.workunit.client.0.smithi026.stdout:2/882: mknod d14/d22/d55/da3/d20/d41/d51/d82/daa/c128 0 2024-05-09T00:07:57.655 INFO:tasks.workunit.client.0.smithi026.stdout:2/883: write d14/d22/d55/da3/d3b/d40/ff3 [121183,83544] 0 2024-05-09T00:07:57.656 INFO:tasks.workunit.client.0.smithi026.stdout:3/749: getdents d5/d9/dc/d28/d45 0 2024-05-09T00:07:57.661 INFO:tasks.workunit.client.0.smithi026.stdout:3/750: write d5/da7/fbc [1553414,81347] 0 2024-05-09T00:07:57.665 INFO:tasks.workunit.client.0.smithi026.stdout:9/942: rename d7/d23/d29/d31/d40/d41/d54/d9a to d7/d23/d2f/d7d/db2/d147 0 2024-05-09T00:07:57.665 INFO:tasks.workunit.client.0.smithi026.stdout:1/980: creat d5/dd/d17/d9f/dc6/f146 x:0 0 0 2024-05-09T00:07:57.665 INFO:tasks.workunit.client.0.smithi026.stdout:2/884: creat d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/df2/d11f/f129 x:0 0 0 2024-05-09T00:07:57.671 INFO:tasks.workunit.client.0.smithi026.stdout:9/943: write d7/d23/f7b [805825,45156] 0 2024-05-09T00:07:57.671 INFO:tasks.workunit.client.0.smithi026.stdout:9/944: truncate d7/d23/d29/d2e/f144 579778 0 2024-05-09T00:07:57.671 INFO:tasks.workunit.client.0.smithi026.stdout:2/885: unlink d14/d22/d55/da3/d30/d6a/d5f/d61/fb4 0 2024-05-09T00:07:57.672 INFO:tasks.workunit.client.0.smithi026.stdout:2/886: creat d14/d22/d55/da3/d20/f12a x:0 0 0 2024-05-09T00:07:57.673 INFO:tasks.workunit.client.0.smithi026.stdout:2/887: truncate d14/d22/d55/da3/d20/f8c 896618 0 2024-05-09T00:07:57.674 INFO:tasks.workunit.client.0.smithi026.stdout:3/751: dread d5/d9/dc/d28/d63/f7e [0,4194304] 0 2024-05-09T00:07:57.675 INFO:tasks.workunit.client.0.smithi026.stdout:2/888: mkdir d14/d22/d55/da3/d17/d12b 0 2024-05-09T00:07:57.678 INFO:tasks.workunit.client.0.smithi026.stdout:2/889: symlink d14/d22/d55/da3/d20/ddb/l12c 0 2024-05-09T00:07:57.683 INFO:tasks.workunit.client.0.smithi026.stdout:2/890: rename d14/d22/fe6 to d14/d22/d55/da3/d3b/d40/d47/f12d 0 2024-05-09T00:07:57.684 INFO:tasks.workunit.client.0.smithi026.stdout:1/981: dwrite d5/db/d108/f124 [0,4194304] 0 2024-05-09T00:07:57.685 INFO:tasks.workunit.client.0.smithi026.stdout:2/891: unlink d14/d22/d55/da3/d17/l6e 0 2024-05-09T00:07:57.688 INFO:tasks.workunit.client.0.smithi026.stdout:1/982: rmdir d5/db/d108/d12b/d97/d75/d100/dfa 0 2024-05-09T00:07:57.689 INFO:tasks.workunit.client.0.smithi026.stdout:3/752: dwrite d5/f1f [0,4194304] 0 2024-05-09T00:07:57.689 INFO:tasks.workunit.client.0.smithi026.stdout:3/753: chown d5/dd4/ded/d6f/d75/lbe 417990871 1 2024-05-09T00:07:57.690 INFO:tasks.workunit.client.0.smithi026.stdout:2/892: unlink d14/d22/d55/da3/d20/db2/l54 0 2024-05-09T00:07:57.690 INFO:tasks.workunit.client.0.smithi026.stdout:2/893: fdatasync d14/d22/d55/da3/d20/fac 0 2024-05-09T00:07:57.690 INFO:tasks.workunit.client.0.smithi026.stdout:1/983: mknod d5/dd/d87/db3/c147 0 2024-05-09T00:07:57.691 INFO:tasks.workunit.client.0.smithi026.stdout:3/754: mknod d5/dcb/cfe 0 2024-05-09T00:07:57.693 INFO:tasks.workunit.client.0.smithi026.stdout:2/894: rename d14/d22/d55/da3/d20/d41/d51/dc5/c108 to d14/d22/d55/da3/d30/d6a/d5f/de9/c12e 0 2024-05-09T00:07:57.693 INFO:tasks.workunit.client.0.smithi026.stdout:2/895: chown d14/d22/d55/da3/d30/d6a/lf9 1424 1 2024-05-09T00:07:57.695 INFO:tasks.workunit.client.0.smithi026.stdout:1/984: creat d5/dd/f148 x:0 0 0 2024-05-09T00:07:57.698 INFO:tasks.workunit.client.0.smithi026.stdout:2/896: rename d14/d22/d55/da3/d20/d41/d51/d82/dd2 to d14/d22/d55/da3/d30/d6a/d5f/de9/d12f 0 2024-05-09T00:07:57.700 INFO:tasks.workunit.client.0.smithi026.stdout:1/985: creat d5/dd/d17/f149 x:0 0 0 2024-05-09T00:07:57.702 INFO:tasks.workunit.client.0.smithi026.stdout:1/986: rename d5/dd/d17/f149 to d5/dd/d87/db3/f14a 0 2024-05-09T00:07:57.702 INFO:tasks.workunit.client.0.smithi026.stdout:3/755: dwrite d5/d9/dc/d28/d2c/f58 [4194304,4194304] 0 2024-05-09T00:07:57.703 INFO:tasks.workunit.client.0.smithi026.stdout:1/987: mkdir d5/dd/d17/d73/d14b 0 2024-05-09T00:07:57.704 INFO:tasks.workunit.client.0.smithi026.stdout:3/756: symlink d5/d9/dc/d28/df0/lff 0 2024-05-09T00:07:57.708 INFO:tasks.workunit.client.0.smithi026.stdout:3/757: write d5/d41/fde [3501760,51432] 0 2024-05-09T00:07:57.710 INFO:tasks.workunit.client.0.smithi026.stdout:3/758: creat d5/dd4/ded/d6f/d75/f100 x:0 0 0 2024-05-09T00:07:57.710 INFO:tasks.workunit.client.0.smithi026.stdout:3/759: read d5/d9/ff [3025188,2380] 0 2024-05-09T00:07:57.715 INFO:tasks.workunit.client.0.smithi026.stdout:3/760: rename d5/d9/dc/d28/d63/d81/cd1 to d5/d9/dc/d28/d45/de5/c101 0 2024-05-09T00:07:57.717 INFO:tasks.workunit.client.0.smithi026.stdout:1/988: dwrite d5/d16/d60/f6d [0,4194304] 0 2024-05-09T00:07:57.717 INFO:tasks.workunit.client.0.smithi026.stdout:1/989: chown d5/db/d108/d12b/d97/c35 7725597 1 2024-05-09T00:07:57.720 INFO:tasks.workunit.client.0.smithi026.stdout:1/990: link d5/dd/d87/db3/c147 d5/c14c 0 2024-05-09T00:07:57.721 INFO:tasks.workunit.client.0.smithi026.stdout:1/991: write d5/dd/f52 [3700988,51548] 0 2024-05-09T00:07:57.721 INFO:tasks.workunit.client.0.smithi026.stdout:1/992: read - d5/dd/d17/d9f/da5/f141 zero size 2024-05-09T00:07:57.722 INFO:tasks.workunit.client.0.smithi026.stdout:3/761: dread d5/f1f [0,4194304] 0 2024-05-09T00:07:57.722 INFO:tasks.workunit.client.0.smithi026.stdout:3/762: fsync d5/f1f 0 2024-05-09T00:07:57.722 INFO:tasks.workunit.client.0.smithi026.stdout:3/763: stat d5/d9 0 2024-05-09T00:07:57.723 INFO:tasks.workunit.client.0.smithi026.stdout:3/764: write d5/d9/dc/f11 [3084595,110233] 0 2024-05-09T00:07:57.724 INFO:tasks.workunit.client.0.smithi026.stdout:3/765: read d5/d9/dc/f23 [808270,97867] 0 2024-05-09T00:07:57.725 INFO:tasks.workunit.client.0.smithi026.stdout:2/897: fsync d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/df2/d11f/f129 0 2024-05-09T00:07:57.734 INFO:tasks.workunit.client.0.smithi026.stdout:3/766: dread d5/d9/dc/d28/f5e [0,4194304] 0 2024-05-09T00:07:57.737 INFO:tasks.workunit.client.0.smithi026.stdout:3/767: mknod d5/d1e/c102 0 2024-05-09T00:07:57.739 INFO:tasks.workunit.client.0.smithi026.stdout:1/993: dwrite d5/db/d108/d103/db1/dc2/f119 [0,4194304] 0 2024-05-09T00:07:57.742 INFO:tasks.workunit.client.0.smithi026.stdout:3/768: getdents d5/db1 0 2024-05-09T00:07:57.742 INFO:tasks.workunit.client.0.smithi026.stdout:3/769: chown d5/d9/dc/d28/d63/d81/fad 7 1 2024-05-09T00:07:57.744 INFO:tasks.workunit.client.0.smithi026.stdout:3/770: creat d5/dd4/ded/d6f/d9e/f103 x:0 0 0 2024-05-09T00:07:57.748 INFO:tasks.workunit.client.0.smithi026.stdout:2/898: dwrite d14/d22/d55/da3/d20/db2/fba [0,4194304] 0 2024-05-09T00:07:57.755 INFO:tasks.workunit.client.0.smithi026.stdout:2/899: rename d14/d22/d55/da3/d17 to d14/d102/d130 0 2024-05-09T00:07:57.755 INFO:tasks.workunit.client.0.smithi026.stdout:2/900: write d14/d22/d55/d6b/d93/fe5 [646184,29137] 0 2024-05-09T00:07:57.759 INFO:tasks.workunit.client.0.smithi026.stdout:2/901: unlink fd 0 2024-05-09T00:07:57.768 INFO:tasks.workunit.client.0.smithi026.stdout:2/902: symlink d14/d102/d130/l131 0 2024-05-09T00:07:57.768 INFO:tasks.workunit.client.0.smithi026.stdout:2/903: write d14/d22/d55/fec [416161,49708] 0 2024-05-09T00:07:57.768 INFO:tasks.workunit.client.0.smithi026.stdout:2/904: fdatasync d14/d22/d55/da3/d20/d41/d51/d82/daa/fef 0 2024-05-09T00:07:57.768 INFO:tasks.workunit.client.0.smithi026.stdout:2/905: truncate d14/d22/d55/da3/d3b/f9b 1493361 0 2024-05-09T00:07:57.770 INFO:tasks.workunit.client.0.smithi026.stdout:3/771: dwrite d5/d44/f79 [0,4194304] 0 2024-05-09T00:07:57.770 INFO:tasks.workunit.client.0.smithi026.stdout:3/772: fdatasync d5/dd4/ded/d6f/d75/fd0 0 2024-05-09T00:07:57.771 INFO:tasks.workunit.client.0.smithi026.stdout:1/994: dwrite d5/f27 [0,4194304] 0 2024-05-09T00:07:57.771 INFO:tasks.workunit.client.0.smithi026.stdout:1/995: readlink d5/lc7 0 2024-05-09T00:07:57.771 INFO:tasks.workunit.client.0.smithi026.stdout:1/996: dread - d5/dd/d17/d73/f106 zero size 2024-05-09T00:07:57.775 INFO:tasks.workunit.client.0.smithi026.stdout:2/906: dread d14/d22/d55/f9f [0,4194304] 0 2024-05-09T00:07:57.777 INFO:tasks.workunit.client.0.smithi026.stdout:1/997: creat d5/db/d108/d103/d110/d133/f14d x:0 0 0 2024-05-09T00:07:57.777 INFO:tasks.workunit.client.0.smithi026.stdout:1/998: fdatasync d5/f8d 0 2024-05-09T00:07:57.778 INFO:tasks.workunit.client.0.smithi026.stdout:3/773: dread d5/dd4/ded/d6f/fb6 [0,4194304] 0 2024-05-09T00:07:57.780 INFO:tasks.workunit.client.0.smithi026.stdout:2/907: symlink d14/l132 0 2024-05-09T00:07:57.783 INFO:tasks.workunit.client.0.smithi026.stdout:1/999: mkdir d5/d16/dd5/de4/d14e 0 2024-05-09T00:07:57.787 INFO:tasks.workunit.client.0.smithi026.stdout:3/774: chown d5/d9/d4a/d95/daa 4509280 1 2024-05-09T00:07:57.787 INFO:tasks.workunit.client.0.smithi026.stdout:3/775: fsync d5/d9/dc/d5b/f91 0 2024-05-09T00:07:57.788 INFO:tasks.workunit.client.0.smithi026.stdout:3/776: write d5/d9/dc/d28/d63/d81/f99 [1886109,101470] 0 2024-05-09T00:07:57.791 INFO:tasks.workunit.client.0.smithi026.stdout:2/908: rename d14/d22/d55/da3/d3b/d40/fe0 to d14/d22/d55/da3/d20/d41/f133 0 2024-05-09T00:07:57.799 INFO:tasks.workunit.client.0.smithi026.stdout:3/777: symlink d5/d9/d49/l104 0 2024-05-09T00:07:57.822 INFO:tasks.workunit.client.0.smithi026.stdout:6/816: sync 2024-05-09T00:07:57.826 INFO:tasks.workunit.client.0.smithi026.stdout:6/817: rename d15/d34/l88 to d15/d1e/d30/d100/l110 0 2024-05-09T00:07:57.832 INFO:tasks.workunit.client.0.smithi026.stdout:6/818: rename d15/d2b/d33/fc0 to d15/d1e/d23/f111 0 2024-05-09T00:07:57.837 INFO:tasks.workunit.client.0.smithi026.stdout:6/819: mkdir d15/d1e/d23/d3a/d112 0 2024-05-09T00:07:57.837 INFO:tasks.workunit.client.0.smithi026.stdout:6/820: write d15/d1e/d30/fec [742324,89693] 0 2024-05-09T00:07:57.854 INFO:tasks.workunit.client.0.smithi026.stdout:6/821: dwrite d15/d1e/d23/d73/d58/f61 [0,4194304] 0 2024-05-09T00:07:57.872 INFO:tasks.workunit.client.0.smithi026.stdout:6/822: dwrite d15/d2b/d33/f51 [0,4194304] 0 2024-05-09T00:07:57.874 INFO:tasks.workunit.client.0.smithi026.stdout:6/823: link d15/d1e/d23/d73/d8e/cc2 d15/d2b/d33/d55/c113 0 2024-05-09T00:07:57.877 INFO:tasks.workunit.client.0.smithi026.stdout:6/824: creat d15/d34/d52/d8b/d4d/f114 x:0 0 0 2024-05-09T00:07:57.879 INFO:tasks.workunit.client.0.smithi026.stdout:6/825: rename d15/d1e/d30/f46 to d15/d2b/d33/f115 0 2024-05-09T00:07:57.879 INFO:tasks.workunit.client.0.smithi026.stdout:6/826: chown d15/d62/l78 233 1 2024-05-09T00:07:57.879 INFO:tasks.workunit.client.0.smithi026.stdout:6/827: chown d15/d34/d52/d8b/d4d/f114 101265 1 2024-05-09T00:07:57.879 INFO:tasks.workunit.client.0.smithi026.stdout:6/828: chown d15/d1e/d30/d32/lae 20626 1 2024-05-09T00:07:57.881 INFO:tasks.workunit.client.0.smithi026.stdout:6/829: getdents d15/d1e/d30/d32/d10a/db8 0 2024-05-09T00:07:57.883 INFO:tasks.workunit.client.0.smithi026.stdout:6/830: mkdir d15/d2b/d33/d7d/d116 0 2024-05-09T00:07:57.884 INFO:tasks.workunit.client.0.smithi026.stdout:6/831: creat d15/d2b/f117 x:0 0 0 2024-05-09T00:07:57.886 INFO:tasks.workunit.client.0.smithi026.stdout:6/832: rmdir d15/d1e/d30/d32/d10a/dd0 39 2024-05-09T00:07:57.888 INFO:tasks.workunit.client.0.smithi026.stdout:6/833: creat d15/d2b/d33/d55/d67/d90/f118 x:0 0 0 2024-05-09T00:07:57.889 INFO:tasks.workunit.client.0.smithi026.stdout:6/834: write d15/d1e/d23/d73/d76/fd6 [1052716,75293] 0 2024-05-09T00:07:57.889 INFO:tasks.workunit.client.0.smithi026.stdout:6/835: fdatasync d15/d2b/d33/d55/d67/d90/fa5 0 2024-05-09T00:07:57.908 INFO:tasks.workunit.client.0.smithi026.stdout:6/836: dwrite d15/f29 [0,4194304] 0 2024-05-09T00:07:57.908 INFO:tasks.workunit.client.0.smithi026.stdout:6/837: chown d15/d1e/d23/f4a 5397809 1 2024-05-09T00:07:57.908 INFO:tasks.workunit.client.0.smithi026.stdout:6/838: chown d15/d2b/f42 13766714 1 2024-05-09T00:07:57.908 INFO:tasks.workunit.client.0.smithi026.stdout:6/839: write d15/d2b/d33/d55/d67/d90/fc9 [4687279,44175] 0 2024-05-09T00:07:57.972 INFO:tasks.workunit.client.0.smithi026.stdout:4/932: sync 2024-05-09T00:07:57.972 INFO:tasks.workunit.client.0.smithi026.stdout:5/875: sync 2024-05-09T00:07:57.972 INFO:tasks.workunit.client.0.smithi026.stdout:4/933: write d0/d12/da2/d97/dbf/dd1/dfb/f137 [547365,34233] 0 2024-05-09T00:07:57.972 INFO:tasks.workunit.client.0.smithi026.stdout:4/934: truncate d0/d12/da2/d97/d43/d58/fbb 1158119 0 2024-05-09T00:07:57.985 INFO:tasks.workunit.client.0.smithi026.stdout:5/876: write d2/d8/d31/d32/d5c/fd2 [3531407,40949] 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:5/877: write d2/d8/d31/d4b/fd1 [3404438,97721] 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:5/878: creat d2/d8/d31/d2e/f129 x:0 0 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:5/879: creat d2/d8/d6d/f12a x:0 0 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:4/935: dwrite d0/d12/da2/d97/d43/d49/d8f/da3/d66/fd0 [0,4194304] 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:5/880: truncate d2/d8/d31/d2e/d33/f7f 3898152 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:5/881: dread - d2/d5a/d96/f127 zero size 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:4/936: rename d0/d12/d34/fe1 to d0/d12/da2/d97/d43/f142 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:4/937: creat d0/d12/d64/dac/dd4/f143 x:0 0 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:4/938: truncate d0/f22 3535121 0 2024-05-09T00:07:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:4/939: readlink d0/d12/da2/d97/d43/l6c 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:4/940: symlink d0/d12/da2/d97/l144 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:4/941: rmdir d0/d12/da2/d97/dbf/dd1/d11a 39 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:4/942: rmdir d0/d12/da2/d97/dbf/dd1/dfb/d130 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:4/943: creat d0/d12/da2/db8/f145 x:0 0 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/882: dwrite d2/d8/d31/d24/f7b [0,4194304] 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/883: rename d2/ce to d2/d8/d6d/ddd/c12b 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/884: write d2/d8/d2a/d111/fd9 [1311547,69802] 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/885: chown d2/d8/d31/d24/cbf 230011037 1 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/886: mknod d2/d8/d31/d2e/d109/c12c 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/887: write d2/d8/d31/d32/d5c/f67 [399273,2658] 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/888: dread - d2/d8/d31/d2e/fed zero size 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/889: readlink d2/d5a/l7c 0 2024-05-09T00:07:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:5/890: chown d2/d5a/d104/d11f/f121 121205 1 2024-05-09T00:07:58.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/891: rename d2/d8/d31/d63/f9d to d2/d8/d31/d63/d9c/f12d 0 2024-05-09T00:07:58.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/892: creat d2/d8/d31/d32/d5c/f12e x:0 0 0 2024-05-09T00:07:58.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/893: write d2/fc [2009319,41117] 0 2024-05-09T00:07:58.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/894: dread - d2/d8/d31/d32/fe2 zero size 2024-05-09T00:07:58.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/895: dwrite d2/d8/d31/d63/d9c/dbc/fcf [0,4194304] 0 2024-05-09T00:07:58.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/896: creat d2/f12f x:0 0 0 2024-05-09T00:07:58.102 INFO:tasks.workunit.client.0.smithi026.stdout:5/897: dwrite d2/fc [0,4194304] 0 2024-05-09T00:07:58.219 INFO:tasks.workunit.client.0.smithi026.stdout:9/945: sync 2024-05-09T00:07:58.219 INFO:tasks.workunit.client.0.smithi026.stdout:9/946: dread - d7/d23/d29/d31/d40/d41/d54/d5c/f133 zero size 2024-05-09T00:07:58.235 INFO:tasks.workunit.client.0.smithi026.stdout:9/947: dwrite d7/d23/d29/d31/d40/d41/d54/f146 [0,4194304] 0 2024-05-09T00:07:58.235 INFO:tasks.workunit.client.0.smithi026.stdout:9/948: readlink d7/d23/d29/d31/d40/d41/l101 0 2024-05-09T00:07:58.235 INFO:tasks.workunit.client.0.smithi026.stdout:9/949: chown d7/d23/d2f/d3a/ld2 34 1 2024-05-09T00:07:58.239 INFO:tasks.workunit.client.0.smithi026.stdout:9/950: creat d7/d23/d29/d31/d40/d41/f148 x:0 0 0 2024-05-09T00:07:58.242 INFO:tasks.workunit.client.0.smithi026.stdout:9/951: rename d7/f16 to d7/d23/f149 0 2024-05-09T00:07:58.244 INFO:tasks.workunit.client.0.smithi026.stdout:9/952: creat d7/d23/d2f/d3a/db5/f14a x:0 0 0 2024-05-09T00:07:58.244 INFO:tasks.workunit.client.0.smithi026.stdout:9/953: chown d7/d23/d2f/d7d/db2/d147/da4/ddb 3323281 1 2024-05-09T00:07:58.421 INFO:tasks.workunit.client.0.smithi026.stdout:6/840: sync 2024-05-09T00:07:58.421 INFO:tasks.workunit.client.0.smithi026.stdout:3/778: sync 2024-05-09T00:07:58.421 INFO:tasks.workunit.client.0.smithi026.stdout:2/909: sync 2024-05-09T00:07:58.424 INFO:tasks.workunit.client.0.smithi026.stdout:3/779: mknod d5/d9/d4a/c105 0 2024-05-09T00:07:58.424 INFO:tasks.workunit.client.0.smithi026.stdout:3/780: write d5/d41/f43 [1064963,31271] 0 2024-05-09T00:07:58.424 INFO:tasks.workunit.client.0.smithi026.stdout:3/781: chown d5/d9/dc/d28/d45 896743 1 2024-05-09T00:07:58.424 INFO:tasks.workunit.client.0.smithi026.stdout:3/782: readlink d5/d1e/d3e/l40 0 2024-05-09T00:07:58.424 INFO:tasks.workunit.client.0.smithi026.stdout:3/783: write d5/d9/dc/fa3 [977303,46228] 0 2024-05-09T00:07:58.425 INFO:tasks.workunit.client.0.smithi026.stdout:3/784: truncate d5/d9/dc/f23 1760194 0 2024-05-09T00:07:58.425 INFO:tasks.workunit.client.0.smithi026.stdout:3/785: getdents d5/d41 0 2024-05-09T00:07:58.435 INFO:tasks.workunit.client.0.smithi026.stdout:2/910: dread d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/ffe [0,4194304] 0 2024-05-09T00:07:58.436 INFO:tasks.workunit.client.0.smithi026.stdout:2/911: truncate d14/d22/d55/da3/d30/d6a/d5b/f123 20464 0 2024-05-09T00:07:58.438 INFO:tasks.workunit.client.0.smithi026.stdout:2/912: mknod d14/d22/d55/da3/d30/d6a/d5f/de9/c134 0 2024-05-09T00:07:58.438 INFO:tasks.workunit.client.0.smithi026.stdout:2/913: read - d14/d102/d130/f126 zero size 2024-05-09T00:07:58.439 INFO:tasks.workunit.client.0.smithi026.stdout:2/914: rmdir d14/d22/d55/da3/d3b/d40 39 2024-05-09T00:07:58.445 INFO:tasks.workunit.client.0.smithi026.stdout:2/915: rename d14/d22/d55/da3/d30/d6a/d5f/d61 to d14/d22/d55/da3/d30/d103/d135 0 2024-05-09T00:07:58.446 INFO:tasks.workunit.client.0.smithi026.stdout:3/786: dwrite d5/d9/dc/d28/d2c/fa6 [0,4194304] 0 2024-05-09T00:07:58.448 INFO:tasks.workunit.client.0.smithi026.stdout:2/916: mknod d14/d22/d55/da3/d20/d41/d51/c136 0 2024-05-09T00:07:58.449 INFO:tasks.workunit.client.0.smithi026.stdout:2/917: write d14/d22/d55/da3/d20/d41/fe8 [3205763,4150] 0 2024-05-09T00:07:58.454 INFO:tasks.workunit.client.0.smithi026.stdout:3/787: creat d5/dd4/f106 x:0 0 0 2024-05-09T00:07:58.457 INFO:tasks.workunit.client.0.smithi026.stdout:3/788: creat d5/db1/df3/f107 x:0 0 0 2024-05-09T00:07:58.458 INFO:tasks.workunit.client.0.smithi026.stdout:3/789: getdents d5/d9 0 2024-05-09T00:07:58.460 INFO:tasks.workunit.client.0.smithi026.stdout:3/790: creat d5/d9/f108 x:0 0 0 2024-05-09T00:07:58.462 INFO:tasks.workunit.client.0.smithi026.stdout:3/791: creat d5/d1e/d7b/deb/f109 x:0 0 0 2024-05-09T00:07:58.463 INFO:tasks.workunit.client.0.smithi026.stdout:2/918: dread d14/d22/d55/da3/d3b/f3f [0,4194304] 0 2024-05-09T00:07:58.464 INFO:tasks.workunit.client.0.smithi026.stdout:2/919: getdents d14 0 2024-05-09T00:07:58.466 INFO:tasks.workunit.client.0.smithi026.stdout:3/792: symlink d5/d9/dc/d28/d63/l10a 0 2024-05-09T00:07:58.479 INFO:tasks.workunit.client.0.smithi026.stdout:2/920: dwrite d14/d22/d55/da3/d30/d6a/d5f/f9e [0,4194304] 0 2024-05-09T00:07:58.482 INFO:tasks.workunit.client.0.smithi026.stdout:2/921: stat d14/d22/d55/d6b/da5/ca7 0 2024-05-09T00:07:58.485 INFO:tasks.workunit.client.0.smithi026.stdout:3/793: dwrite d5/d44/dd9/fec [4194304,4194304] 0 2024-05-09T00:07:58.485 INFO:tasks.workunit.client.0.smithi026.stdout:3/794: stat d5/d9/dc/f83 0 2024-05-09T00:07:58.492 INFO:tasks.workunit.client.0.smithi026.stdout:3/795: dread d5/d9/dc/d5d/f6c [0,4194304] 0 2024-05-09T00:07:58.495 INFO:tasks.workunit.client.0.smithi026.stdout:2/922: symlink d14/d22/d55/l137 0 2024-05-09T00:07:58.499 INFO:tasks.workunit.client.0.smithi026.stdout:2/923: creat d14/d22/d55/da3/d30/f138 x:0 0 0 2024-05-09T00:07:58.500 INFO:tasks.workunit.client.0.smithi026.stdout:3/796: mknod d5/d9/d4a/d95/c10b 0 2024-05-09T00:07:58.500 INFO:tasks.workunit.client.0.smithi026.stdout:2/924: write d14/d22/d55/da3/d30/d103/d135/d6c/d85/fb3 [2182414,47736] 0 2024-05-09T00:07:58.501 INFO:tasks.workunit.client.0.smithi026.stdout:2/925: read d14/d22/d55/da3/d20/d41/d51/d82/daa/fef [629605,45406] 0 2024-05-09T00:07:58.503 INFO:tasks.workunit.client.0.smithi026.stdout:3/797: creat d5/d9/f10c x:0 0 0 2024-05-09T00:07:58.510 INFO:tasks.workunit.client.0.smithi026.stdout:3/798: dread d5/d1e/d7b/fc1 [0,4194304] 0 2024-05-09T00:07:58.512 INFO:tasks.workunit.client.0.smithi026.stdout:3/799: link d5/dcb/fdc d5/d9/d49/f10d 0 2024-05-09T00:07:58.513 INFO:tasks.workunit.client.0.smithi026.stdout:3/800: readlink d5/d9/dc/d28/d45/l62 0 2024-05-09T00:07:58.514 INFO:tasks.workunit.client.0.smithi026.stdout:3/801: mkdir d5/d9/d71/d10e 0 2024-05-09T00:07:58.516 INFO:tasks.workunit.client.0.smithi026.stdout:3/802: rename d5/d1e/d7b/l80 to d5/d44/dd9/l10f 0 2024-05-09T00:07:58.518 INFO:tasks.workunit.client.0.smithi026.stdout:3/803: symlink d5/d9/l110 0 2024-05-09T00:07:58.520 INFO:tasks.workunit.client.0.smithi026.stdout:3/804: rename d5/d9/dc/ff1 to d5/d9/dc/d5b/f111 0 2024-05-09T00:07:58.541 INFO:tasks.workunit.client.0.smithi026.stdout:3/805: dwrite d5/d9/dc/d28/d63/f7e [0,4194304] 0 2024-05-09T00:07:58.542 INFO:tasks.workunit.client.0.smithi026.stdout:3/806: chown d5 153 1 2024-05-09T00:07:58.542 INFO:tasks.workunit.client.0.smithi026.stdout:3/807: write d5/d9/dc/d5b/f85 [893840,31553] 0 2024-05-09T00:07:58.555 INFO:tasks.workunit.client.0.smithi026.stdout:3/808: dwrite d5/d41/fe9 [0,4194304] 0 2024-05-09T00:07:58.555 INFO:tasks.workunit.client.0.smithi026.stdout:3/809: write d5/d9/dc/f31 [2303698,120920] 0 2024-05-09T00:07:58.555 INFO:tasks.workunit.client.0.smithi026.stdout:3/810: truncate d5/d9/f10c 648129 0 2024-05-09T00:07:58.558 INFO:tasks.workunit.client.0.smithi026.stdout:3/811: symlink d5/d44/def/l112 0 2024-05-09T00:07:58.657 INFO:tasks.workunit.client.0.smithi026.stdout:4/944: sync 2024-05-09T00:07:58.657 INFO:tasks.workunit.client.0.smithi026.stdout:4/945: write d0/d12/d87/fc6 [111499,95081] 0 2024-05-09T00:07:58.658 INFO:tasks.workunit.client.0.smithi026.stdout:4/946: chown d0/d12/d64/dac/d12a/d115/f141 1440201095 1 2024-05-09T00:07:58.658 INFO:tasks.workunit.client.0.smithi026.stdout:4/947: chown d0/d12/da2/d97/d43/d49/de7/dfc/d106/f131 9870 1 2024-05-09T00:07:58.658 INFO:tasks.workunit.client.0.smithi026.stdout:4/948: chown d0/d12/da2/d97/d43/d49/d8f/da3/d86/faa 6 1 2024-05-09T00:07:58.658 INFO:tasks.workunit.client.0.smithi026.stdout:4/949: stat d0/d12/da2/d97/d43/c84 0 2024-05-09T00:07:58.660 INFO:tasks.workunit.client.0.smithi026.stdout:4/950: mkdir d0/d12/d1b/d4e/d92/d146 0 2024-05-09T00:07:58.666 INFO:tasks.workunit.client.0.smithi026.stdout:4/951: rename d0/d12/d64/dac/d12a/l112 to d0/d12/da2/d97/d43/d49/d8f/da3/d86/dc5/d125/l147 0 2024-05-09T00:07:58.666 INFO:tasks.workunit.client.0.smithi026.stdout:4/952: chown d0/d12/da2/d97/d43/d49/de7/dfc/f10a 19 1 2024-05-09T00:07:58.666 INFO:tasks.workunit.client.0.smithi026.stdout:4/953: readlink d0/d12/da2/d97/d43/d49/d8f/da3/d66/l7d 0 2024-05-09T00:07:58.672 INFO:tasks.workunit.client.0.smithi026.stdout:4/954: mkdir d0/d12/da2/d97/d43/d58/d148 0 2024-05-09T00:07:58.673 INFO:tasks.workunit.client.0.smithi026.stdout:4/955: read d0/d12/d1b/f10d [136682,11289] 0 2024-05-09T00:07:58.674 INFO:tasks.workunit.client.0.smithi026.stdout:4/956: read d0/d12/da2/d97/d43/d49/d8f/da3/d86/faa [2130178,98992] 0 2024-05-09T00:07:58.677 INFO:tasks.workunit.client.0.smithi026.stdout:4/957: write d0/d12/da2/d97/d43/d49/d8f/da3/f40 [129778,112176] 0 2024-05-09T00:07:58.682 INFO:tasks.workunit.client.0.smithi026.stdout:4/958: creat d0/d12/da2/d97/dbf/f149 x:0 0 0 2024-05-09T00:07:58.683 INFO:tasks.workunit.client.0.smithi026.stdout:4/959: write d0/d12/f13 [1364608,66099] 0 2024-05-09T00:07:58.688 INFO:tasks.workunit.client.0.smithi026.stdout:4/960: rename d0/d12/da2/d97/d43/d49/d8f/da3/d86/faa to d0/d12/d1b/f14a 0 2024-05-09T00:07:58.689 INFO:tasks.workunit.client.0.smithi026.stdout:4/961: write d0/d12/d1b/d4e/f5b [2812418,13611] 0 2024-05-09T00:07:58.689 INFO:tasks.workunit.client.0.smithi026.stdout:4/962: readlink d0/d12/d34/l5d 0 2024-05-09T00:07:58.689 INFO:tasks.workunit.client.0.smithi026.stdout:4/963: fsync d0/d12/d1b/f5f 0 2024-05-09T00:07:58.693 INFO:tasks.workunit.client.0.smithi026.stdout:4/964: link d0/d12/da2/d97/d43/d58/d120/l121 d0/d12/da2/d97/d43/d49/l14b 0 2024-05-09T00:07:58.698 INFO:tasks.workunit.client.0.smithi026.stdout:4/965: dread d0/d12/da2/d97/dbf/f13e [0,4194304] 0 2024-05-09T00:07:58.704 INFO:tasks.workunit.client.0.smithi026.stdout:4/966: rmdir d0/d12/d64/dac/dd4 39 2024-05-09T00:07:58.704 INFO:tasks.workunit.client.0.smithi026.stdout:4/967: chown d0/d12/d87/ccc 74442 1 2024-05-09T00:07:58.711 INFO:tasks.workunit.client.0.smithi026.stdout:4/968: rmdir d0/d12/da2/d97 39 2024-05-09T00:07:58.714 INFO:tasks.workunit.client.0.smithi026.stdout:4/969: mknod d0/d12/d1b/d4e/d92/c14c 0 2024-05-09T00:07:58.737 INFO:tasks.workunit.client.0.smithi026.stdout:4/970: dwrite d0/d12/da2/d97/d8c/f9d [0,4194304] 0 2024-05-09T00:07:58.737 INFO:tasks.workunit.client.0.smithi026.stdout:4/971: stat d0/d12/da2/d101 0 2024-05-09T00:07:58.737 INFO:tasks.workunit.client.0.smithi026.stdout:4/972: chown d0/d12/l8e 1185 1 2024-05-09T00:07:58.737 INFO:tasks.workunit.client.0.smithi026.stdout:4/973: mknod d0/d12/d64/dac/d12a/c14d 0 2024-05-09T00:07:58.738 INFO:tasks.workunit.client.0.smithi026.stdout:4/974: read d0/d12/da2/d97/d43/d49/fdf [485204,72149] 0 2024-05-09T00:07:58.741 INFO:tasks.workunit.client.0.smithi026.stdout:4/975: rename d0/d12/d1b/d4e/fff to d0/d12/d110/f14e 0 2024-05-09T00:07:58.741 INFO:tasks.workunit.client.0.smithi026.stdout:4/976: fdatasync d0/d12/f30 0 2024-05-09T00:07:58.744 INFO:tasks.workunit.client.0.smithi026.stdout:4/977: mkdir d0/d12/da2/d97/dbf/dd1/dfb/d14f 0 2024-05-09T00:07:58.745 INFO:tasks.workunit.client.0.smithi026.stdout:4/978: creat d0/d12/d1b/d118/f150 x:0 0 0 2024-05-09T00:07:58.748 INFO:tasks.workunit.client.0.smithi026.stdout:4/979: read d0/d12/da2/d97/d43/d58/f9c [3823981,16535] 0 2024-05-09T00:07:58.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/980: mknod d0/d12/d34/c151 0 2024-05-09T00:07:58.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/981: chown d0/d12/da2/d97/dbf 208330 1 2024-05-09T00:07:58.750 INFO:tasks.workunit.client.0.smithi026.stdout:4/982: creat d0/d12/d64/dac/dd4/f152 x:0 0 0 2024-05-09T00:07:58.750 INFO:tasks.workunit.client.0.smithi026.stdout:4/983: stat d0/d12/da2/d97/l144 0 2024-05-09T00:07:58.767 INFO:tasks.workunit.client.0.smithi026.stdout:4/984: dwrite d0/d12/da2/d97/d43/fea [0,4194304] 0 2024-05-09T00:07:58.767 INFO:tasks.workunit.client.0.smithi026.stdout:4/985: fdatasync d0/d12/d64/ffd 0 2024-05-09T00:07:58.772 INFO:tasks.workunit.client.0.smithi026.stdout:4/986: creat d0/d12/d1b/d12c/f153 x:0 0 0 2024-05-09T00:07:58.773 INFO:tasks.workunit.client.0.smithi026.stdout:4/987: symlink d0/d12/da2/d97/d43/d49/d8f/dc1/l154 0 2024-05-09T00:07:58.774 INFO:tasks.workunit.client.0.smithi026.stdout:4/988: dread - d0/d12/da2/d97/d43/d49/de7/dfc/d106/f131 zero size 2024-05-09T00:07:58.783 INFO:tasks.workunit.client.0.smithi026.stdout:4/989: dread d0/d12/f79 [0,4194304] 0 2024-05-09T00:07:58.783 INFO:tasks.workunit.client.0.smithi026.stdout:4/990: chown d0/d12/da2/d97/d43/l65 38920 1 2024-05-09T00:07:58.785 INFO:tasks.workunit.client.0.smithi026.stdout:4/991: mkdir d0/d12/da2/d97/dbf/d155 0 2024-05-09T00:07:58.788 INFO:tasks.workunit.client.0.smithi026.stdout:4/992: dread d0/d12/da2/d97/d43/d49/f7f [0,4194304] 0 2024-05-09T00:07:58.789 INFO:tasks.workunit.client.0.smithi026.stdout:4/993: dread d0/d12/da2/d97/f57 [0,4194304] 0 2024-05-09T00:07:58.790 INFO:tasks.workunit.client.0.smithi026.stdout:4/994: creat d0/d12/da2/db8/f156 x:0 0 0 2024-05-09T00:07:58.790 INFO:tasks.workunit.client.0.smithi026.stdout:4/995: fsync d0/d12/d64/dac/d12a/d115/f139 0 2024-05-09T00:07:58.791 INFO:tasks.workunit.client.0.smithi026.stdout:4/996: stat d0/d12/d1b/d4e/l61 0 2024-05-09T00:07:58.791 INFO:tasks.workunit.client.0.smithi026.stdout:4/997: creat d0/d12/d87/f157 x:0 0 0 2024-05-09T00:07:58.792 INFO:tasks.workunit.client.0.smithi026.stdout:4/998: truncate d0/d12/d1b/d12c/f153 53432 0 2024-05-09T00:07:58.793 INFO:tasks.workunit.client.0.smithi026.stdout:4/999: creat d0/d12/d10e/f158 x:0 0 0 2024-05-09T00:07:58.837 INFO:tasks.workunit.client.0.smithi026.stdout:9/954: sync 2024-05-09T00:07:58.837 INFO:tasks.workunit.client.0.smithi026.stdout:6/841: sync 2024-05-09T00:07:58.838 INFO:tasks.workunit.client.0.smithi026.stdout:5/898: sync 2024-05-09T00:07:58.838 INFO:tasks.workunit.client.0.smithi026.stdout:6/842: fdatasync d15/d2b/f117 0 2024-05-09T00:07:58.838 INFO:tasks.workunit.client.0.smithi026.stdout:5/899: dread - d2/d8/d31/d32/d48/fff zero size 2024-05-09T00:07:58.838 INFO:tasks.workunit.client.0.smithi026.stdout:6/843: write d15/d34/d52/fc6 [872920,116995] 0 2024-05-09T00:07:58.838 INFO:tasks.workunit.client.0.smithi026.stdout:6/844: chown d15/d1e/d3d/f47 766322 1 2024-05-09T00:07:58.838 INFO:tasks.workunit.client.0.smithi026.stdout:2/926: sync 2024-05-09T00:07:58.838 INFO:tasks.workunit.client.0.smithi026.stdout:3/812: sync 2024-05-09T00:07:58.839 INFO:tasks.workunit.client.0.smithi026.stdout:9/955: rename d7/d23/d29/d31/d40/d41/d54/f146 to d7/d23/d76/f14b 0 2024-05-09T00:07:58.840 INFO:tasks.workunit.client.0.smithi026.stdout:6/845: mknod d15/d34/dba/c119 0 2024-05-09T00:07:58.840 INFO:tasks.workunit.client.0.smithi026.stdout:6/846: readlink d15/d2b/d33/d55/d67/dbb/dbf/le0 0 2024-05-09T00:07:58.842 INFO:tasks.workunit.client.0.smithi026.stdout:2/927: creat d14/d22/d55/da3/d20/db2/d70/f139 x:0 0 0 2024-05-09T00:07:58.843 INFO:tasks.workunit.client.0.smithi026.stdout:2/928: chown d14/d22/d55/da3/d30/d6a/dd6 1709131 1 2024-05-09T00:07:58.845 INFO:tasks.workunit.client.0.smithi026.stdout:9/956: link d7/d23/d29/d31/d40/f104 d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/f14c 0 2024-05-09T00:07:58.848 INFO:tasks.workunit.client.0.smithi026.stdout:6/847: getdents d15/d2b/d33/d7d/da9 0 2024-05-09T00:07:58.849 INFO:tasks.workunit.client.0.smithi026.stdout:2/929: mknod d14/d22/d55/da3/c13a 0 2024-05-09T00:07:58.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/848: mkdir d15/d62/dff/d11a 0 2024-05-09T00:07:58.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/849: chown d15/d2b 365018 1 2024-05-09T00:07:58.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/850: readlink l0 0 2024-05-09T00:07:58.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/851: write d15/d34/d52/d8b/fa4 [916756,70595] 0 2024-05-09T00:07:58.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/852: write f4 [5883243,106151] 0 2024-05-09T00:07:58.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/853: fsync d15/d1e/d23/d73/d76/fd7 0 2024-05-09T00:07:58.852 INFO:tasks.workunit.client.0.smithi026.stdout:2/930: link d14/d22/d55/da3/d20/f69 d14/d22/d55/da3/d3b/d40/d68/f13b 0 2024-05-09T00:07:58.852 INFO:tasks.workunit.client.0.smithi026.stdout:2/931: chown d14/d22/d55/da3/d30/d103/d135/d6c/fc2 2645280 1 2024-05-09T00:07:58.855 INFO:tasks.workunit.client.0.smithi026.stdout:6/854: symlink d15/d2b/d33/l11b 0 2024-05-09T00:07:58.858 INFO:tasks.workunit.client.0.smithi026.stdout:5/900: dwrite d2/d5a/fcc [0,4194304] 0 2024-05-09T00:07:58.858 INFO:tasks.workunit.client.0.smithi026.stdout:2/932: rmdir d14/d22/d55/deb/dfc/d10e 0 2024-05-09T00:07:58.858 INFO:tasks.workunit.client.0.smithi026.stdout:2/933: readlink d14/d102/d130/l131 0 2024-05-09T00:07:58.860 INFO:tasks.workunit.client.0.smithi026.stdout:5/901: creat d2/d8/d31/d32/da2/df0/f130 x:0 0 0 2024-05-09T00:07:58.861 INFO:tasks.workunit.client.0.smithi026.stdout:2/934: stat f8 0 2024-05-09T00:07:58.861 INFO:tasks.workunit.client.0.smithi026.stdout:3/813: dwrite d5/da7/fbc [0,4194304] 0 2024-05-09T00:07:58.869 INFO:tasks.workunit.client.0.smithi026.stdout:9/957: dwrite d7/d26/ff7 [0,4194304] 0 2024-05-09T00:07:58.876 INFO:tasks.workunit.client.0.smithi026.stdout:9/958: dread d7/d23/f149 [0,4194304] 0 2024-05-09T00:07:58.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/935: dwrite d14/d22/d55/da3/d20/db2/fba [4194304,4194304] 0 2024-05-09T00:07:58.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/936: chown d14/d22/d55/da3/d30/d6a/lf9 1 1 2024-05-09T00:07:58.891 INFO:tasks.workunit.client.0.smithi026.stdout:2/937: dread d14/d22/f7d [0,4194304] 0 2024-05-09T00:07:58.892 INFO:tasks.workunit.client.0.smithi026.stdout:2/938: truncate d14/d102/f11d 183169 0 2024-05-09T00:07:58.892 INFO:tasks.workunit.client.0.smithi026.stdout:2/939: read d14/d22/d55/da3/d20/db2/f2d [3800415,76934] 0 2024-05-09T00:07:58.949 INFO:tasks.workunit.client.0.smithi026.stdout:5/902: truncate d2/d8/d31/d32/d5c/fd2 2188144 0 2024-05-09T00:07:58.951 INFO:tasks.workunit.client.0.smithi026.stdout:3/814: link d5/d1e/cd3 d5/d9/d4a/d77/c113 0 2024-05-09T00:07:58.952 INFO:tasks.workunit.client.0.smithi026.stdout:3/815: write d5/d9/dc/d28/d2c/fa6 [508146,122103] 0 2024-05-09T00:07:58.970 INFO:tasks.workunit.client.0.smithi026.stdout:5/903: dwrite d2/d8/d31/f10f [0,4194304] 0 2024-05-09T00:07:58.970 INFO:tasks.workunit.client.0.smithi026.stdout:5/904: dread - d2/d8/d6d/f12a zero size 2024-05-09T00:07:58.970 INFO:tasks.workunit.client.0.smithi026.stdout:5/905: truncate d2/d8/d31/dd8/fe9 569024 0 2024-05-09T00:07:58.971 INFO:tasks.workunit.client.0.smithi026.stdout:5/906: write d2/d8/d2a/f4f [4011986,5447] 0 2024-05-09T00:07:58.993 INFO:tasks.workunit.client.0.smithi026.stdout:9/959: rmdir d7/d23/d29/d31/d40/d41/d54/d5c/d66/dbc 39 2024-05-09T00:07:58.995 INFO:tasks.workunit.client.0.smithi026.stdout:2/940: symlink d14/d22/d55/da3/d20/l13c 0 2024-05-09T00:07:58.996 INFO:tasks.workunit.client.0.smithi026.stdout:3/816: creat d5/d9/d71/d10e/f114 x:0 0 0 2024-05-09T00:07:59.001 INFO:tasks.workunit.client.0.smithi026.stdout:5/907: creat d2/d8/d31/d32/da2/df0/f131 x:0 0 0 2024-05-09T00:07:59.002 INFO:tasks.workunit.client.0.smithi026.stdout:9/960: truncate f2 2492868 0 2024-05-09T00:07:59.012 INFO:tasks.workunit.client.0.smithi026.stdout:2/941: mknod d14/d22/d55/da3/d30/d103/c13d 0 2024-05-09T00:07:59.012 INFO:tasks.workunit.client.0.smithi026.stdout:2/942: chown d14/d102/d130/fcd 220231288 1 2024-05-09T00:07:59.015 INFO:tasks.workunit.client.0.smithi026.stdout:3/817: creat d5/dd4/f115 x:0 0 0 2024-05-09T00:07:59.015 INFO:tasks.workunit.client.0.smithi026.stdout:3/818: write d5/d9/dc/f11 [4442369,7384] 0 2024-05-09T00:07:59.016 INFO:tasks.workunit.client.0.smithi026.stdout:5/908: mkdir d2/d8/d2a/d8d/dbe/d132 0 2024-05-09T00:07:59.018 INFO:tasks.workunit.client.0.smithi026.stdout:9/961: getdents d7/d23/d76 0 2024-05-09T00:07:59.018 INFO:tasks.workunit.client.0.smithi026.stdout:9/962: readlink d7/l123 0 2024-05-09T00:07:59.020 INFO:tasks.workunit.client.0.smithi026.stdout:2/943: link d14/d22/d55/da3/d20/d41/d51/fa4 d14/d22/d55/da3/d20/ddb/f13e 0 2024-05-09T00:07:59.024 INFO:tasks.workunit.client.0.smithi026.stdout:3/819: unlink d5/d41/f43 0 2024-05-09T00:07:59.024 INFO:tasks.workunit.client.0.smithi026.stdout:3/820: chown d5/d9/dc/d28/d45/de5 1960 1 2024-05-09T00:07:59.025 INFO:tasks.workunit.client.0.smithi026.stdout:5/909: creat d2/d8/d31/d2e/f133 x:0 0 0 2024-05-09T00:07:59.027 INFO:tasks.workunit.client.0.smithi026.stdout:2/944: mkdir d14/d22/d55/da3/d30/d6a/dd6/d13f 0 2024-05-09T00:07:59.028 INFO:tasks.workunit.client.0.smithi026.stdout:9/963: dread d7/d23/d76/f14b [0,4194304] 0 2024-05-09T00:07:59.028 INFO:tasks.workunit.client.0.smithi026.stdout:9/964: dread - d7/d23/d29/d31/d40/d41/f102 zero size 2024-05-09T00:07:59.028 INFO:tasks.workunit.client.0.smithi026.stdout:9/965: chown d7/lf4 924539 1 2024-05-09T00:07:59.028 INFO:tasks.workunit.client.0.smithi026.stdout:9/966: stat d7/d26/l136 0 2024-05-09T00:07:59.031 INFO:tasks.workunit.client.0.smithi026.stdout:3/821: rename d5/db1/df3 to d5/d9/d4a/d77/d116 0 2024-05-09T00:07:59.034 INFO:tasks.workunit.client.0.smithi026.stdout:2/945: creat d14/d22/d55/da3/d20/d41/d51/dc5/f140 x:0 0 0 2024-05-09T00:07:59.035 INFO:tasks.workunit.client.0.smithi026.stdout:9/967: chown d7/f9 938 1 2024-05-09T00:07:59.035 INFO:tasks.workunit.client.0.smithi026.stdout:9/968: fdatasync d7/d23/d29/d31/d40/d41/f102 0 2024-05-09T00:07:59.035 INFO:tasks.workunit.client.0.smithi026.stdout:9/969: fsync d7/d23/d2f/d3a/db5/f132 0 2024-05-09T00:07:59.036 INFO:tasks.workunit.client.0.smithi026.stdout:3/822: rmdir d5/d9/dc/d5d 39 2024-05-09T00:07:59.036 INFO:tasks.workunit.client.0.smithi026.stdout:3/823: stat d5/ldd 0 2024-05-09T00:07:59.038 INFO:tasks.workunit.client.0.smithi026.stdout:2/946: mknod d14/d22/d55/da3/d30/d103/d135/d6c/c141 0 2024-05-09T00:07:59.039 INFO:tasks.workunit.client.0.smithi026.stdout:2/947: mknod d14/d22/d55/da3/d30/c142 0 2024-05-09T00:07:59.039 INFO:tasks.workunit.client.0.smithi026.stdout:2/948: chown d14/d22/d55/da3/d30/d6a/d5f/de9/c12e 19010856 1 2024-05-09T00:07:59.049 INFO:tasks.workunit.client.0.smithi026.stdout:2/949: dread d14/d22/d55/da3/d20/d41/d51/d82/daa/f110 [0,4194304] 0 2024-05-09T00:07:59.051 INFO:tasks.workunit.client.0.smithi026.stdout:5/910: dwrite d2/d8/d2a/d111/fd9 [0,4194304] 0 2024-05-09T00:07:59.051 INFO:tasks.workunit.client.0.smithi026.stdout:2/950: unlink d14/d22/d55/da3/d3b/d40/d47/lc7 0 2024-05-09T00:07:59.055 INFO:tasks.workunit.client.0.smithi026.stdout:5/911: creat d2/d8/d31/d63/d9c/dbc/f134 x:0 0 0 2024-05-09T00:07:59.058 INFO:tasks.workunit.client.0.smithi026.stdout:2/951: symlink d14/d22/d55/da3/d30/d6a/dd6/l143 0 2024-05-09T00:07:59.066 INFO:tasks.workunit.client.0.smithi026.stdout:3/824: dwrite d5/d9/dc/d28/d2c/f4b [4194304,4194304] 0 2024-05-09T00:07:59.070 INFO:tasks.workunit.client.0.smithi026.stdout:9/970: dwrite d7/d23/d2f/d7d/d87/f11d [0,4194304] 0 2024-05-09T00:07:59.079 INFO:tasks.workunit.client.0.smithi026.stdout:2/952: dwrite d14/d22/d55/da3/d30/d6a/f57 [0,4194304] 0 2024-05-09T00:07:59.082 INFO:tasks.workunit.client.0.smithi026.stdout:2/953: rename d14/d22/d55/d6b/da5/ca7 to d14/d22/d55/da3/d20/db2/d70/c144 0 2024-05-09T00:07:59.110 INFO:tasks.workunit.client.0.smithi026.stdout:3/825: dwrite d5/f12 [0,4194304] 0 2024-05-09T00:07:59.110 INFO:tasks.workunit.client.0.smithi026.stdout:9/971: dwrite d7/d23/d116/f142 [0,4194304] 0 2024-05-09T00:07:59.110 INFO:tasks.workunit.client.0.smithi026.stdout:2/954: dwrite d14/d22/d55/f67 [8388608,4194304] 0 2024-05-09T00:07:59.113 INFO:tasks.workunit.client.0.smithi026.stdout:9/972: getdents d7/d23/d29/d31/d40/d41/d54 0 2024-05-09T00:07:59.113 INFO:tasks.workunit.client.0.smithi026.stdout:9/973: read d7/d23/d29/f9e [141609,118281] 0 2024-05-09T00:07:59.122 INFO:tasks.workunit.client.0.smithi026.stdout:2/955: link d14/d22/d55/da3/d20/d41/d51/d82/l88 d14/d22/dea/l145 0 2024-05-09T00:07:59.124 INFO:tasks.workunit.client.0.smithi026.stdout:9/974: rename d7/d23/d2f/d7d/db2/d130/d13d/c115 to d7/d23/d2f/d7d/db2/d130/d13d/c14d 0 2024-05-09T00:07:59.124 INFO:tasks.workunit.client.0.smithi026.stdout:3/826: dwrite d5/d9/dc/d5b/f91 [0,4194304] 0 2024-05-09T00:07:59.132 INFO:tasks.workunit.client.0.smithi026.stdout:2/956: dread d14/d102/f11d [0,4194304] 0 2024-05-09T00:07:59.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/975: dwrite d7/d23/d29/d59/fe7 [4194304,4194304] 0 2024-05-09T00:07:59.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/976: fsync d7/d23/d29/d59/d91/f92 0 2024-05-09T00:07:59.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/977: chown d7/d23/d29/d31/d40/dd5 1034 1 2024-05-09T00:07:59.148 INFO:tasks.workunit.client.0.smithi026.stdout:2/957: dwrite d14/d102/d130/fad [0,4194304] 0 2024-05-09T00:07:59.148 INFO:tasks.workunit.client.0.smithi026.stdout:2/958: readlink d14/d22/d55/da3/d20/l13c 0 2024-05-09T00:07:59.148 INFO:tasks.workunit.client.0.smithi026.stdout:2/959: stat f8 0 2024-05-09T00:07:59.149 INFO:tasks.workunit.client.0.smithi026.stdout:3/827: dwrite d5/d9/dc/f70 [4194304,4194304] 0 2024-05-09T00:07:59.150 INFO:tasks.workunit.client.0.smithi026.stdout:2/960: mkdir d14/d22/d55/da3/d3b/d40/d146 0 2024-05-09T00:07:59.152 INFO:tasks.workunit.client.0.smithi026.stdout:2/961: symlink d14/d22/d55/da3/d20/d41/d51/d82/daa/dbc/df2/l147 0 2024-05-09T00:07:59.153 INFO:tasks.workunit.client.0.smithi026.stdout:2/962: truncate d14/d22/d55/da3/d30/d103/d135/d6c/fb9 3812403 0 2024-05-09T00:07:59.168 INFO:tasks.workunit.client.0.smithi026.stdout:3/828: dwrite d5/d9/dc/f31 [0,4194304] 0 2024-05-09T00:07:59.168 INFO:tasks.workunit.client.0.smithi026.stdout:3/829: fdatasync d5/d9/dc/d5b/f85 0 2024-05-09T00:07:59.175 INFO:tasks.workunit.client.0.smithi026.stdout:3/830: dread d5/d9/dc/d28/d2c/f6a [4194304,4194304] 0 2024-05-09T00:07:59.177 INFO:tasks.workunit.client.0.smithi026.stdout:3/831: creat d5/d9/dc/d28/d45/db7/f117 x:0 0 0 2024-05-09T00:07:59.178 INFO:tasks.workunit.client.0.smithi026.stdout:3/832: creat d5/d9/d49/f118 x:0 0 0 2024-05-09T00:07:59.183 INFO:tasks.workunit.client.0.smithi026.stdout:6/855: sync 2024-05-09T00:07:59.185 INFO:tasks.workunit.client.0.smithi026.stdout:6/856: creat d15/d2b/d33/d7d/da9/f11c x:0 0 0 2024-05-09T00:07:59.185 INFO:tasks.workunit.client.0.smithi026.stdout:6/857: chown d15/d1e/d23/f4a 24919913 1 2024-05-09T00:07:59.185 INFO:tasks.workunit.client.0.smithi026.stdout:6/858: write d15/d1e/d30/fec [798427,82498] 0 2024-05-09T00:07:59.201 INFO:tasks.workunit.client.0.smithi026.stdout:6/859: dread d15/d1e/d23/d73/f28 [0,4194304] 0 2024-05-09T00:07:59.202 INFO:tasks.workunit.client.0.smithi026.stdout:6/860: creat d15/d1e/d23/d73/d76/d10f/f11d x:0 0 0 2024-05-09T00:07:59.204 INFO:tasks.workunit.client.0.smithi026.stdout:3/833: dwrite d5/d44/f79 [0,4194304] 0 2024-05-09T00:07:59.207 INFO:tasks.workunit.client.0.smithi026.stdout:3/834: creat d5/d44/f119 x:0 0 0 2024-05-09T00:07:59.208 INFO:tasks.workunit.client.0.smithi026.stdout:3/835: read d5/d9/dc/d28/fac [124151,97377] 0 2024-05-09T00:07:59.210 INFO:tasks.workunit.client.0.smithi026.stdout:3/836: getdents d5/d9/d71 0 2024-05-09T00:07:59.211 INFO:tasks.workunit.client.0.smithi026.stdout:3/837: mknod d5/d9/d49/c11a 0 2024-05-09T00:07:59.213 INFO:tasks.workunit.client.0.smithi026.stdout:3/838: rmdir d5/d44/d9f 39 2024-05-09T00:07:59.213 INFO:tasks.workunit.client.0.smithi026.stdout:3/839: truncate d5/dcb/fdc 4972074 0 2024-05-09T00:07:59.217 INFO:tasks.workunit.client.0.smithi026.stdout:6/861: dwrite d15/d1e/d23/d73/d76/f8d [0,4194304] 0 2024-05-09T00:07:59.221 INFO:tasks.workunit.client.0.smithi026.stdout:6/862: mkdir d15/d1e/d30/d32/d10a/dd0/d11e 0 2024-05-09T00:07:59.221 INFO:tasks.workunit.client.0.smithi026.stdout:6/863: write d15/d1e/d23/ff8 [315385,87289] 0 2024-05-09T00:07:59.236 INFO:tasks.workunit.client.0.smithi026.stdout:3/840: dwrite d5/d9/dc/d28/f5e [0,4194304] 0 2024-05-09T00:07:59.236 INFO:tasks.workunit.client.0.smithi026.stdout:3/841: dread - d5/dd4/ded/d6f/d75/fa2 zero size 2024-05-09T00:07:59.243 INFO:tasks.workunit.client.0.smithi026.stdout:6/864: dwrite d15/f1f [4194304,4194304] 0 2024-05-09T00:07:59.243 INFO:tasks.workunit.client.0.smithi026.stdout:6/865: fsync d15/f8c 0 2024-05-09T00:07:59.249 INFO:tasks.workunit.client.0.smithi026.stdout:6/866: creat d15/d1e/d30/d100/f11f x:0 0 0 2024-05-09T00:07:59.250 INFO:tasks.workunit.client.0.smithi026.stdout:6/867: getdents d15/d2b/d33/d55/d67/dd2 0 2024-05-09T00:07:59.253 INFO:tasks.workunit.client.0.smithi026.stdout:3/842: dwrite d5/dd4/f115 [0,4194304] 0 2024-05-09T00:07:59.258 INFO:tasks.workunit.client.0.smithi026.stdout:3/843: rename d5/dd4/ded/f8e to d5/d9/d4a/d77/f11b 0 2024-05-09T00:07:59.275 INFO:tasks.workunit.client.0.smithi026.stdout:6/868: dwrite d15/d2b/d33/d55/d67/dbb/dbf/fc3 [0,4194304] 0 2024-05-09T00:07:59.275 INFO:tasks.workunit.client.0.smithi026.stdout:6/869: dread - d15/d1e/d23/d73/d8e/fbe zero size 2024-05-09T00:07:59.275 INFO:tasks.workunit.client.0.smithi026.stdout:6/870: chown d15/d1e/d23/d73/d76/d10f 1884 1 2024-05-09T00:07:59.276 INFO:tasks.workunit.client.0.smithi026.stdout:3/844: dwrite d5/d1e/d3e/f68 [0,4194304] 0 2024-05-09T00:07:59.278 INFO:tasks.workunit.client.0.smithi026.stdout:6/871: mknod d15/d62/c120 0 2024-05-09T00:07:59.278 INFO:tasks.workunit.client.0.smithi026.stdout:3/845: mknod d5/d9/d71/d10e/c11c 0 2024-05-09T00:07:59.283 INFO:tasks.workunit.client.0.smithi026.stdout:6/872: symlink d15/d2b/d33/l121 0 2024-05-09T00:07:59.283 INFO:tasks.workunit.client.0.smithi026.stdout:6/873: stat d15/d1e/d23/ff4 0 2024-05-09T00:07:59.284 INFO:tasks.workunit.client.0.smithi026.stdout:6/874: write d15/d1e/d23/f4a [672274,15528] 0 2024-05-09T00:07:59.287 INFO:tasks.workunit.client.0.smithi026.stdout:6/875: creat d15/d34/f122 x:0 0 0 2024-05-09T00:07:59.288 INFO:tasks.workunit.client.0.smithi026.stdout:6/876: read d15/d62/f9e [6968124,120933] 0 2024-05-09T00:07:59.294 INFO:tasks.workunit.client.0.smithi026.stdout:3/846: dwrite d5/d9/dc/d5d/f6c [0,4194304] 0 2024-05-09T00:07:59.294 INFO:tasks.workunit.client.0.smithi026.stdout:3/847: write d5/dd4/ded/d6f/d75/fdb [751662,79546] 0 2024-05-09T00:07:59.297 INFO:tasks.workunit.client.0.smithi026.stdout:3/848: chown d5/d9/f42 476508 1 2024-05-09T00:07:59.297 INFO:tasks.workunit.client.0.smithi026.stdout:3/849: chown d5/d9/dc/d28/d2c/f84 769111 1 2024-05-09T00:07:59.297 INFO:tasks.workunit.client.0.smithi026.stdout:3/850: write d5/d9/d4a/fc7 [693164,95961] 0 2024-05-09T00:07:59.298 INFO:tasks.workunit.client.0.smithi026.stdout:3/851: creat d5/d9/d4a/d95/daa/f11d x:0 0 0 2024-05-09T00:07:59.300 INFO:tasks.workunit.client.0.smithi026.stdout:3/852: creat d5/d9/dc/d28/df0/f11e x:0 0 0 2024-05-09T00:07:59.301 INFO:tasks.workunit.client.0.smithi026.stdout:6/877: dread d15/d1e/d23/d73/d58/d5c/fad [0,4194304] 0 2024-05-09T00:07:59.301 INFO:tasks.workunit.client.0.smithi026.stdout:3/853: symlink d5/dd4/ded/d6f/l11f 0 2024-05-09T00:07:59.305 INFO:tasks.workunit.client.0.smithi026.stdout:6/878: unlink d15/d2b/d33/l121 0 2024-05-09T00:07:59.305 INFO:tasks.workunit.client.0.smithi026.stdout:6/879: write d15/d1e/d3d/fc8 [268018,105770] 0 2024-05-09T00:07:59.321 INFO:tasks.workunit.client.0.smithi026.stdout:3/854: dwrite d5/d9/dc/d28/d2c/fa6 [4194304,4194304] 0 2024-05-09T00:07:59.328 INFO:tasks.workunit.client.0.smithi026.stdout:6/880: dwrite f1 [4194304,4194304] 0 2024-05-09T00:07:59.338 INFO:tasks.workunit.client.0.smithi026.stdout:3/855: unlink d5/le 0 2024-05-09T00:07:59.342 INFO:tasks.workunit.client.0.smithi026.stdout:3/856: creat d5/dd4/ded/d6f/d9e/f120 x:0 0 0 2024-05-09T00:07:59.344 INFO:tasks.workunit.client.0.smithi026.stdout:6/881: dwrite d15/d1e/d30/fe7 [0,4194304] 0 2024-05-09T00:07:59.345 INFO:tasks.workunit.client.0.smithi026.stdout:6/882: read d15/d1e/d23/d3a/f7c [4004053,16043] 0 2024-05-09T00:07:59.345 INFO:tasks.workunit.client.0.smithi026.stdout:6/883: dread - d15/d1e/d30/d100/f11f zero size 2024-05-09T00:07:59.345 INFO:tasks.workunit.client.0.smithi026.stdout:3/857: write d5/d9/dc/d28/d45/f57 [579319,6745] 0 2024-05-09T00:07:59.346 INFO:tasks.workunit.client.0.smithi026.stdout:3/858: dread - d5/d9/dc/d28/df0/f11e zero size 2024-05-09T00:07:59.349 INFO:tasks.workunit.client.0.smithi026.stdout:6/884: unlink d15/d2b/d33/db4/lcb 0 2024-05-09T00:07:59.351 INFO:tasks.workunit.client.0.smithi026.stdout:6/885: mkdir d15/d1e/d23/d73/d8e/d123 0 2024-05-09T00:07:59.358 INFO:tasks.workunit.client.0.smithi026.stdout:3/859: dwrite d5/d9/d71/d10e/f114 [0,4194304] 0 2024-05-09T00:07:59.365 INFO:tasks.workunit.client.0.smithi026.stdout:3/860: getdents d5/d9/d4a/d95/daa 0 2024-05-09T00:07:59.367 INFO:tasks.workunit.client.0.smithi026.stdout:3/861: write d5/da7/fbc [1057417,39962] 0 2024-05-09T00:07:59.370 INFO:tasks.workunit.client.0.smithi026.stdout:3/862: symlink d5/dd4/ded/d6f/l121 0 2024-05-09T00:07:59.370 INFO:tasks.workunit.client.0.smithi026.stdout:5/912: sync 2024-05-09T00:07:59.371 INFO:tasks.workunit.client.0.smithi026.stdout:3/863: symlink d5/d9/dc/d28/d45/db7/l122 0 2024-05-09T00:07:59.372 INFO:tasks.workunit.client.0.smithi026.stdout:5/913: read d2/d8/d31/dd8/fe9 [413798,46675] 0 2024-05-09T00:07:59.373 INFO:tasks.workunit.client.0.smithi026.stdout:3/864: unlink d5/d9/dc/d5b/da5/db3/cc4 0 2024-05-09T00:07:59.374 INFO:tasks.workunit.client.0.smithi026.stdout:6/886: dwrite d15/d41/fd5 [4194304,4194304] 0 2024-05-09T00:07:59.375 INFO:tasks.workunit.client.0.smithi026.stdout:5/914: mknod d2/d8/d31/d32/d48/daa/c135 0 2024-05-09T00:07:59.375 INFO:tasks.workunit.client.0.smithi026.stdout:5/915: write d2/d8/d31/d2e/f129 [234185,69087] 0 2024-05-09T00:07:59.375 INFO:tasks.workunit.client.0.smithi026.stdout:5/916: chown d2/d8/d31/fc1 864044464 1 2024-05-09T00:07:59.376 INFO:tasks.workunit.client.0.smithi026.stdout:5/917: read d2/d8/d31/fc1 [8106447,53754] 0 2024-05-09T00:07:59.378 INFO:tasks.workunit.client.0.smithi026.stdout:5/918: rmdir d2/d8/d31/d32/d48/daa/db4/df7 39 2024-05-09T00:07:59.381 INFO:tasks.workunit.client.0.smithi026.stdout:5/919: mkdir d2/d8/d2a/d111/d101/d136 0 2024-05-09T00:07:59.382 INFO:tasks.workunit.client.0.smithi026.stdout:5/920: mkdir d2/d5a/d96/d137 0 2024-05-09T00:07:59.385 INFO:tasks.workunit.client.0.smithi026.stdout:5/921: unlink d2/la 0 2024-05-09T00:07:59.385 INFO:tasks.workunit.client.0.smithi026.stdout:5/922: getdents d2/d8/d2a/d8d/dbe 0 2024-05-09T00:07:59.385 INFO:tasks.workunit.client.0.smithi026.stdout:5/923: chown d2/d8/d31/d2e/d109/l11e 58255 1 2024-05-09T00:07:59.385 INFO:tasks.workunit.client.0.smithi026.stdout:5/924: symlink d2/d8/d6d/ddd/l138 0 2024-05-09T00:07:59.386 INFO:tasks.workunit.client.0.smithi026.stdout:5/925: fsync d2/f12f 0 2024-05-09T00:07:59.386 INFO:tasks.workunit.client.0.smithi026.stdout:5/926: chown d2/d8/d31/f10f 1 1 2024-05-09T00:07:59.388 INFO:tasks.workunit.client.0.smithi026.stdout:5/927: rename d2/d8/d31/d4b to d2/d8/d31/d2e/d35/d139 0 2024-05-09T00:07:59.388 INFO:tasks.workunit.client.0.smithi026.stdout:5/928: write d2/d8/d31/d63/d9c/dbc/f134 [455993,31045] 0 2024-05-09T00:07:59.388 INFO:tasks.workunit.client.0.smithi026.stdout:5/929: fsync d2/d8/d31/d2e/d35/fa8 0 2024-05-09T00:07:59.388 INFO:tasks.workunit.client.0.smithi026.stdout:5/930: rmdir d2/d8/d31/d63/d9c 39 2024-05-09T00:07:59.390 INFO:tasks.workunit.client.0.smithi026.stdout:5/931: symlink d2/d8/d31/d32/d48/daa/l13a 0 2024-05-09T00:07:59.390 INFO:tasks.workunit.client.0.smithi026.stdout:6/887: dwrite d15/d34/d52/d8b/fac [0,4194304] 0 2024-05-09T00:07:59.392 INFO:tasks.workunit.client.0.smithi026.stdout:6/888: write f11 [166095,113339] 0 2024-05-09T00:07:59.392 INFO:tasks.workunit.client.0.smithi026.stdout:6/889: write d15/d1e/d23/d73/d8e/fbe [34298,87348] 0 2024-05-09T00:07:59.394 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:07:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:57.910806+0000 mgr.smithi135.kkrhgf (mgr.24419) 62 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 65 MiB/s rd, 138 MiB/s wr, 281 op/s 2024-05-09T00:07:59.396 INFO:tasks.workunit.client.0.smithi026.stdout:6/890: rename d15/d1e/d23/d73/d8e/ddf to d15/d1e/d23/d124 0 2024-05-09T00:07:59.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:07:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:57.910806+0000 mgr.smithi135.kkrhgf (mgr.24419) 62 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 65 MiB/s rd, 138 MiB/s wr, 281 op/s 2024-05-09T00:07:59.398 INFO:tasks.workunit.client.0.smithi026.stdout:6/891: mkdir d15/d1e/d30/d32/d10a/d125 0 2024-05-09T00:07:59.401 INFO:tasks.workunit.client.0.smithi026.stdout:5/932: dread d2/d8/d31/d2e/d33/f116 [0,4194304] 0 2024-05-09T00:07:59.401 INFO:tasks.workunit.client.0.smithi026.stdout:6/892: mknod d15/d2b/d33/d7d/c126 0 2024-05-09T00:07:59.402 INFO:tasks.workunit.client.0.smithi026.stdout:3/865: dwrite d5/d1e/d7b/fc1 [0,4194304] 0 2024-05-09T00:07:59.404 INFO:tasks.workunit.client.0.smithi026.stdout:5/933: rename d2/d5a/l7c to d2/d8/d31/d32/d48/db3/l13b 0 2024-05-09T00:07:59.405 INFO:tasks.workunit.client.0.smithi026.stdout:6/893: write d15/d1e/d23/d73/f27 [2175065,86841] 0 2024-05-09T00:07:59.421 INFO:tasks.workunit.client.0.smithi026.stdout:5/934: rename d2/d8/d2a/l47 to d2/d8/d2a/d111/d101/l13c 0 2024-05-09T00:07:59.423 INFO:tasks.workunit.client.0.smithi026.stdout:6/894: mknod d15/d1e/d30/d32/d10a/db8/dde/c127 0 2024-05-09T00:07:59.423 INFO:tasks.workunit.client.0.smithi026.stdout:6/895: fsync d15/d2b/d33/d7d/da9/faf 0 2024-05-09T00:07:59.426 INFO:tasks.workunit.client.0.smithi026.stdout:6/896: dread d15/d1e/d3d/f70 [0,4194304] 0 2024-05-09T00:07:59.429 INFO:tasks.workunit.client.0.smithi026.stdout:6/897: unlink d15/d1e/d30/d32/d10a/f104 0 2024-05-09T00:07:59.429 INFO:tasks.workunit.client.0.smithi026.stdout:6/898: chown d15/d1e/d23/d73/f27 101412043 1 2024-05-09T00:07:59.431 INFO:tasks.workunit.client.0.smithi026.stdout:5/935: dread d2/d8/d31/d2e/d33/f68 [0,4194304] 0 2024-05-09T00:07:59.431 INFO:tasks.workunit.client.0.smithi026.stdout:5/936: chown d2/d8/d6d/f8f 3587 1 2024-05-09T00:07:59.432 INFO:tasks.workunit.client.0.smithi026.stdout:6/899: write d15/d1e/d23/d3a/ffc [3121231,102811] 0 2024-05-09T00:07:59.432 INFO:tasks.workunit.client.0.smithi026.stdout:3/866: dwrite d5/dcb/fdc [0,4194304] 0 2024-05-09T00:07:59.433 INFO:tasks.workunit.client.0.smithi026.stdout:5/937: mkdir d2/d5a/d96/d137/d13d 0 2024-05-09T00:07:59.433 INFO:tasks.workunit.client.0.smithi026.stdout:5/938: write d2/d8/d31/d2e/d109/f11b [40160,68323] 0 2024-05-09T00:07:59.434 INFO:tasks.workunit.client.0.smithi026.stdout:3/867: mkdir d5/d1e/d3e/dda/d123 0 2024-05-09T00:07:59.437 INFO:tasks.workunit.client.0.smithi026.stdout:6/900: dread d15/d1e/d23/d73/d58/d5c/fad [0,4194304] 0 2024-05-09T00:07:59.437 INFO:tasks.workunit.client.0.smithi026.stdout:3/868: rmdir d5/d9/d4a/d77 39 2024-05-09T00:07:59.437 INFO:tasks.workunit.client.0.smithi026.stdout:3/869: chown d5/d9/d49/lb4 73360 1 2024-05-09T00:07:59.439 INFO:tasks.workunit.client.0.smithi026.stdout:5/939: symlink d2/d8/d31/l13e 0 2024-05-09T00:07:59.440 INFO:tasks.workunit.client.0.smithi026.stdout:6/901: mknod d15/d62/dff/d11a/c128 0 2024-05-09T00:07:59.441 INFO:tasks.workunit.client.0.smithi026.stdout:3/870: mkdir d5/dd4/ded/d124 0 2024-05-09T00:07:59.444 INFO:tasks.workunit.client.0.smithi026.stdout:5/940: symlink d2/d8/d31/d32/d48/daa/db4/df7/l13f 0 2024-05-09T00:07:59.445 INFO:tasks.workunit.client.0.smithi026.stdout:6/902: mkdir d15/d1e/d23/d3a/da6/d129 0 2024-05-09T00:07:59.447 INFO:tasks.workunit.client.0.smithi026.stdout:3/871: getdents d5/d9/dc/d5b/da5/db2 0 2024-05-09T00:07:59.448 INFO:tasks.workunit.client.0.smithi026.stdout:5/941: getdents d2/d8/d31/d32/d5c 0 2024-05-09T00:07:59.451 INFO:tasks.workunit.client.0.smithi026.stdout:6/903: creat d15/d1e/d23/d3a/da6/f12a x:0 0 0 2024-05-09T00:07:59.455 INFO:tasks.workunit.client.0.smithi026.stdout:5/942: symlink d2/d5a/d96/l140 0 2024-05-09T00:07:59.457 INFO:tasks.workunit.client.0.smithi026.stdout:6/904: truncate d15/d2b/d33/d55/d67/dbb/dbf/fc3 2571631 0 2024-05-09T00:07:59.457 INFO:tasks.workunit.client.0.smithi026.stdout:2/963: sync 2024-05-09T00:07:59.458 INFO:tasks.workunit.client.0.smithi026.stdout:9/978: sync 2024-05-09T00:07:59.460 INFO:tasks.workunit.client.0.smithi026.stdout:3/872: link d5/d44/c4e d5/d44/dd9/c125 0 2024-05-09T00:07:59.463 INFO:tasks.workunit.client.0.smithi026.stdout:6/905: truncate d15/f1f 8385863 0 2024-05-09T00:07:59.467 INFO:tasks.workunit.client.0.smithi026.stdout:3/873: creat d5/d1e/d3e/dda/f126 x:0 0 0 2024-05-09T00:07:59.468 INFO:tasks.workunit.client.0.smithi026.stdout:5/943: link d2/d8/d31/d2e/f133 d2/d8/d31/d63/d9c/dbc/f141 0 2024-05-09T00:07:59.470 INFO:tasks.workunit.client.0.smithi026.stdout:6/906: mkdir d15/d62/dff/d11a/d12b 0 2024-05-09T00:07:59.471 INFO:tasks.workunit.client.0.smithi026.stdout:3/874: readlink d5/d9/l30 0 2024-05-09T00:07:59.472 INFO:tasks.workunit.client.0.smithi026.stdout:6/907: creat d15/d1e/d23/d73/d8e/f12c x:0 0 0 2024-05-09T00:07:59.474 INFO:tasks.workunit.client.0.smithi026.stdout:3/875: mknod d5/dd4/ded/d6f/c127 0 2024-05-09T00:07:59.475 INFO:tasks.workunit.client.0.smithi026.stdout:6/908: creat d15/d2b/d33/d7d/f12d x:0 0 0 2024-05-09T00:07:59.476 INFO:tasks.workunit.client.0.smithi026.stdout:5/944: dread d2/d8/d31/d32/da2/f120 [0,4194304] 0 2024-05-09T00:07:59.479 INFO:tasks.workunit.client.0.smithi026.stdout:3/876: rename d5/dd4/ded/df7 to d5/d1e/d3e/dda/d123/d128 0 2024-05-09T00:07:59.479 INFO:tasks.workunit.client.0.smithi026.stdout:9/979: dwrite d7/d23/d2f/d7d/db2/d147/f126 [0,4194304] 0 2024-05-09T00:07:59.480 INFO:tasks.workunit.client.0.smithi026.stdout:9/980: stat d7/d26/l74 0 2024-05-09T00:07:59.480 INFO:tasks.workunit.client.0.smithi026.stdout:9/981: truncate d7/fff 12695 0 2024-05-09T00:07:59.480 INFO:tasks.workunit.client.0.smithi026.stdout:2/964: dwrite d14/d22/d55/da3/d20/d10a/f112 [0,4194304] 0 2024-05-09T00:07:59.485 INFO:tasks.workunit.client.0.smithi026.stdout:6/909: unlink d15/d1e/d30/d32/d10a/db8/dde/c127 0 2024-05-09T00:07:59.489 INFO:tasks.workunit.client.0.smithi026.stdout:5/945: dwrite d2/d5a/d104/d11f/f128 [0,4194304] 0 2024-05-09T00:07:59.489 INFO:tasks.workunit.client.0.smithi026.stdout:5/946: chown d2/d8/d31/d2e/d4a/cb2 14 1 2024-05-09T00:07:59.490 INFO:tasks.workunit.client.0.smithi026.stdout:5/947: dread - d2/d8/d2a/d8d/dbe/ffe zero size 2024-05-09T00:07:59.490 INFO:tasks.workunit.client.0.smithi026.stdout:3/877: creat d5/d9/dc/de1/f129 x:0 0 0 2024-05-09T00:07:59.492 INFO:tasks.workunit.client.0.smithi026.stdout:3/878: dread d5/dd4/ded/d6f/d75/fd0 [0,4194304] 0 2024-05-09T00:07:59.494 INFO:tasks.workunit.client.0.smithi026.stdout:2/965: creat d14/d22/d55/da3/d20/d41/d51/f148 x:0 0 0 2024-05-09T00:07:59.496 INFO:tasks.workunit.client.0.smithi026.stdout:6/910: mkdir d15/d2b/d33/d7d/d116/d12e 0 2024-05-09T00:07:59.501 INFO:tasks.workunit.client.0.smithi026.stdout:9/982: dwrite d7/d23/d2f/d7d/d87/f12b [0,4194304] 0 2024-05-09T00:07:59.501 INFO:tasks.workunit.client.0.smithi026.stdout:9/983: chown d7/d23/d2f/fe5 9564229 1 2024-05-09T00:07:59.501 INFO:tasks.workunit.client.0.smithi026.stdout:5/948: mkdir d2/d8/d31/dd8/d142 0 2024-05-09T00:07:59.502 INFO:tasks.workunit.client.0.smithi026.stdout:3/879: rename d5/d9/dc/d5b/lee to d5/d9/d4a/d95/l12a 0 2024-05-09T00:07:59.504 INFO:tasks.workunit.client.0.smithi026.stdout:2/966: unlink d14/d102/d130/l115 0 2024-05-09T00:07:59.505 INFO:tasks.workunit.client.0.smithi026.stdout:6/911: mknod d15/d1e/d23/d124/c12f 0 2024-05-09T00:07:59.505 INFO:tasks.workunit.client.0.smithi026.stdout:6/912: readlink d15/d1e/d23/d73/d76/l93 0 2024-05-09T00:07:59.505 INFO:tasks.workunit.client.0.smithi026.stdout:6/913: getdents d15/d1e/d30/d32/d10a/db8 0 2024-05-09T00:07:59.507 INFO:tasks.workunit.client.0.smithi026.stdout:5/949: creat d2/d8/d10d/f143 x:0 0 0 2024-05-09T00:07:59.509 INFO:tasks.workunit.client.0.smithi026.stdout:9/984: rename d7/d23/d29/d2e/f109 to d7/d23/d2f/f14e 0 2024-05-09T00:07:59.510 INFO:tasks.workunit.client.0.smithi026.stdout:6/914: mknod d15/d1e/d23/d6f/c130 0 2024-05-09T00:07:59.512 INFO:tasks.workunit.client.0.smithi026.stdout:5/950: link d2/d5a/fcc d2/d8/d31/d32/da2/dac/f144 0 2024-05-09T00:07:59.512 INFO:tasks.workunit.client.0.smithi026.stdout:5/951: write d2/d8/d31/d24/f74 [134081,19522] 0 2024-05-09T00:07:59.515 INFO:tasks.workunit.client.0.smithi026.stdout:9/985: creat d7/f14f x:0 0 0 2024-05-09T00:07:59.515 INFO:tasks.workunit.client.0.smithi026.stdout:9/986: chown d7/d23/d29/d59/dec/c108 1764 1 2024-05-09T00:07:59.516 INFO:tasks.workunit.client.0.smithi026.stdout:3/880: rename d5/dd4/ded/d6f/d9e/f103 to d5/d9/d4a/d95/f12b 0 2024-05-09T00:07:59.522 INFO:tasks.workunit.client.0.smithi026.stdout:6/915: getdents d15/d1e/d23/d3a 0 2024-05-09T00:07:59.522 INFO:tasks.workunit.client.0.smithi026.stdout:5/952: mkdir d2/d5a/de8/d145 0 2024-05-09T00:07:59.525 INFO:tasks.workunit.client.0.smithi026.stdout:2/967: rename d14/d22/d55/da3/d30/d6a/d5b/f123 to d14/d22/d55/da3/d20/d41/d51/dc5/f149 0 2024-05-09T00:07:59.525 INFO:tasks.workunit.client.0.smithi026.stdout:2/968: readlink d14/d22/d55/da3/d30/d6a/lf9 0 2024-05-09T00:07:59.525 INFO:tasks.workunit.client.0.smithi026.stdout:3/881: symlink d5/d9/dc/d28/d45/db7/l12c 0 2024-05-09T00:07:59.525 INFO:tasks.workunit.client.0.smithi026.stdout:3/882: dread - d5/d9/d4a/d77/d116/f107 zero size 2024-05-09T00:07:59.528 INFO:tasks.workunit.client.0.smithi026.stdout:2/969: rmdir d14/d22/d55/deb/dfc 39 2024-05-09T00:07:59.531 INFO:tasks.workunit.client.0.smithi026.stdout:9/987: rename d7/d23/d29/d2e/f144 to d7/d23/d2f/d3a/f150 0 2024-05-09T00:07:59.534 INFO:tasks.workunit.client.0.smithi026.stdout:2/970: link d14/d22/d55/da3/d30/c142 d14/d22/d55/da3/d30/dc3/df7/c14a 0 2024-05-09T00:07:59.535 INFO:tasks.workunit.client.0.smithi026.stdout:9/988: mknod d7/d23/d76/d11c/c151 0 2024-05-09T00:07:59.536 INFO:tasks.workunit.client.0.smithi026.stdout:9/989: write d7/fe3 [456764,82352] 0 2024-05-09T00:07:59.536 INFO:tasks.workunit.client.0.smithi026.stdout:9/990: truncate d7/d23/d29/d31/d40/d41/d54/d5c/d66/ddd/f10a 989959 0 2024-05-09T00:07:59.538 INFO:tasks.workunit.client.0.smithi026.stdout:3/883: symlink d5/l12d 0 2024-05-09T00:07:59.539 INFO:tasks.workunit.client.0.smithi026.stdout:3/884: write d5/d9/d71/d10e/f114 [4360140,79248] 0 2024-05-09T00:07:59.545 INFO:tasks.workunit.client.0.smithi026.stdout:2/971: dread d14/d22/d55/da3/d30/d6a/d5b/fd5 [0,4194304] 0 2024-05-09T00:07:59.545 INFO:tasks.workunit.client.0.smithi026.stdout:9/991: mknod d7/d23/d116/c152 0 2024-05-09T00:07:59.548 INFO:tasks.workunit.client.0.smithi026.stdout:3/885: unlink d5/d9/d4a/d95/f12b 0 2024-05-09T00:07:59.550 INFO:tasks.workunit.client.0.smithi026.stdout:2/972: truncate d14/d102/d130/f8b 2682827 0 2024-05-09T00:07:59.550 INFO:tasks.workunit.client.0.smithi026.stdout:2/973: chown d14/d22/d55/da3/d30/d103/d135/d6c/c11e 17586892 1 2024-05-09T00:07:59.553 INFO:tasks.workunit.client.0.smithi026.stdout:6/916: dwrite d15/d1e/d23/d6f/f97 [0,4194304] 0 2024-05-09T00:07:59.554 INFO:tasks.workunit.client.0.smithi026.stdout:3/886: mkdir d5/d9/dc/d5b/da5/d12e 0 2024-05-09T00:07:59.559 INFO:tasks.workunit.client.0.smithi026.stdout:2/974: truncate d14/d22/d55/f56 5353150 0 2024-05-09T00:07:59.561 INFO:tasks.workunit.client.0.smithi026.stdout:6/917: getdents d15/d34/dba 0 2024-05-09T00:07:59.565 INFO:tasks.workunit.client.0.smithi026.stdout:2/975: mkdir d14/d22/d55/da3/d20/d41/d51/d82/d14b 0 2024-05-09T00:07:59.565 INFO:tasks.workunit.client.0.smithi026.stdout:2/976: chown d14/d22/d55/da3/d20/db2/la6 201594 1 2024-05-09T00:07:59.566 INFO:tasks.workunit.client.0.smithi026.stdout:9/992: getdents d7/d23/d116 0 2024-05-09T00:07:59.567 INFO:tasks.workunit.client.0.smithi026.stdout:9/993: write d7/d23/d29/d31/d40/d41/d54/d5c/f8f [3622521,1054] 0 2024-05-09T00:07:59.568 INFO:tasks.workunit.client.0.smithi026.stdout:6/918: symlink d15/d1e/d30/d32/d10a/db8/ded/l131 0 2024-05-09T00:07:59.568 INFO:tasks.workunit.client.0.smithi026.stdout:3/887: mkdir d5/d9/d4a/d12f 0 2024-05-09T00:07:59.574 INFO:tasks.workunit.client.0.smithi026.stdout:2/977: rename d14/d22/d55/da3/f92 to d14/d22/d55/da3/d30/d6a/dd6/d13f/f14c 0 2024-05-09T00:07:59.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/919: rename d15/d62/dff/d11a to d15/d1e/d30/d32/d10a/dd0/d11e/d132 0 2024-05-09T00:07:59.588 INFO:tasks.workunit.client.0.smithi026.stdout:9/994: dwrite d7/d23/d29/d31/d40/f111 [0,4194304] 0 2024-05-09T00:07:59.589 INFO:tasks.workunit.client.0.smithi026.stdout:2/978: creat d14/d22/d55/da3/d30/dc3/df7/f14d x:0 0 0 2024-05-09T00:07:59.591 INFO:tasks.workunit.client.0.smithi026.stdout:3/888: truncate d5/d9/d4a/f52 653718 0 2024-05-09T00:07:59.591 INFO:tasks.workunit.client.0.smithi026.stdout:3/889: readlink d5/d9/l110 0 2024-05-09T00:07:59.593 INFO:tasks.workunit.client.0.smithi026.stdout:6/920: mknod d15/d1e/d23/d3a/da6/c133 0 2024-05-09T00:07:59.593 INFO:tasks.workunit.client.0.smithi026.stdout:6/921: readlink d15/d34/lfa 0 2024-05-09T00:07:59.597 INFO:tasks.workunit.client.0.smithi026.stdout:9/995: creat d7/d23/d29/d31/f153 x:0 0 0 2024-05-09T00:07:59.598 INFO:tasks.workunit.client.0.smithi026.stdout:2/979: rmdir d14/d22/d55/da3/d30/d103/d135 39 2024-05-09T00:07:59.600 INFO:tasks.workunit.client.0.smithi026.stdout:3/890: rename d5/d9/d4a/d95/c10b to d5/dd4/ded/d6f/d9e/c130 0 2024-05-09T00:07:59.605 INFO:tasks.workunit.client.0.smithi026.stdout:9/996: mknod d7/d23/d29/d2e/c154 0 2024-05-09T00:07:59.608 INFO:tasks.workunit.client.0.smithi026.stdout:2/980: symlink d14/d22/d55/da3/d30/d6a/d5b/l14e 0 2024-05-09T00:07:59.609 INFO:tasks.workunit.client.0.smithi026.stdout:6/922: dread d15/fd9 [0,4194304] 0 2024-05-09T00:07:59.612 INFO:tasks.workunit.client.0.smithi026.stdout:2/981: mknod d14/d22/d55/da3/d30/d103/d135/c14f 0 2024-05-09T00:07:59.613 INFO:tasks.workunit.client.0.smithi026.stdout:3/891: dwrite d5/d9/dc/d5d/f6c [0,4194304] 0 2024-05-09T00:07:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:3/892: stat d5/d9/dc/d5b/da5/d12e 0 2024-05-09T00:07:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:3/893: readlink d5/d9/dc/d28/df0/lff 0 2024-05-09T00:07:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:3/894: stat d5/d44/d9f/cfb 0 2024-05-09T00:07:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:3/895: fsync d5/d9/dc/f23 0 2024-05-09T00:07:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:6/923: symlink d15/d62/ddc/l134 0 2024-05-09T00:07:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:9/997: dread d7/d23/d2f/f35 [0,4194304] 0 2024-05-09T00:07:59.615 INFO:tasks.workunit.client.0.smithi026.stdout:2/982: rmdir d14/d22/d55/da3/d30/dc3/df7 39 2024-05-09T00:07:59.619 INFO:tasks.workunit.client.0.smithi026.stdout:3/896: creat d5/d1e/d3e/dda/d123/f131 x:0 0 0 2024-05-09T00:07:59.619 INFO:tasks.workunit.client.0.smithi026.stdout:3/897: read - d5/d9/d4a/d77/d116/f107 zero size 2024-05-09T00:07:59.619 INFO:tasks.workunit.client.0.smithi026.stdout:3/898: dread - d5/d9/d4a/d95/daa/f11d zero size 2024-05-09T00:07:59.619 INFO:tasks.workunit.client.0.smithi026.stdout:3/899: chown d5/d9/dc/d28/d45/db7/l12c 429582 1 2024-05-09T00:07:59.619 INFO:tasks.workunit.client.0.smithi026.stdout:9/998: creat d7/d23/d2f/d50/f155 x:0 0 0 2024-05-09T00:07:59.621 INFO:tasks.workunit.client.0.smithi026.stdout:2/983: creat d14/d22/dea/f150 x:0 0 0 2024-05-09T00:07:59.622 INFO:tasks.workunit.client.0.smithi026.stdout:3/900: unlink d5/dd4/ded/d6f/d75/lbe 0 2024-05-09T00:07:59.625 INFO:tasks.workunit.client.0.smithi026.stdout:9/999: rmdir d7/d26 39 2024-05-09T00:07:59.628 INFO:tasks.workunit.client.0.smithi026.stdout:2/984: symlink d14/d22/d55/da3/d30/l151 0 2024-05-09T00:07:59.629 INFO:tasks.workunit.client.0.smithi026.stdout:2/985: creat d14/d22/d55/d6b/f152 x:0 0 0 2024-05-09T00:07:59.629 INFO:tasks.workunit.client.0.smithi026.stdout:2/986: write d14/d22/d55/da3/d3b/d40/d68/f13b [449196,130805] 0 2024-05-09T00:07:59.632 INFO:tasks.workunit.client.0.smithi026.stdout:6/924: dread d15/d62/f64 [0,4194304] 0 2024-05-09T00:07:59.643 INFO:tasks.workunit.client.0.smithi026.stdout:3/901: dwrite d5/d9/dc/d28/fac [0,4194304] 0 2024-05-09T00:07:59.649 INFO:tasks.workunit.client.0.smithi026.stdout:3/902: rmdir d5/d9/dc/d28/d2c 39 2024-05-09T00:07:59.650 INFO:tasks.workunit.client.0.smithi026.stdout:2/987: dwrite d14/d22/dea/f150 [0,4194304] 0 2024-05-09T00:07:59.652 INFO:tasks.workunit.client.0.smithi026.stdout:3/903: rename d5/d9/dc/d28/d45/de5/cea to d5/d9/d71/d10e/c132 0 2024-05-09T00:07:59.656 INFO:tasks.workunit.client.0.smithi026.stdout:6/925: dwrite d15/d2b/d33/d55/d67/d90/fa5 [0,4194304] 0 2024-05-09T00:07:59.658 INFO:tasks.workunit.client.0.smithi026.stdout:2/988: symlink d14/d22/d55/d6b/l153 0 2024-05-09T00:07:59.660 INFO:tasks.workunit.client.0.smithi026.stdout:3/904: rename d5/d44/dd9/fec to d5/dd4/ded/d6f/f133 0 2024-05-09T00:07:59.660 INFO:tasks.workunit.client.0.smithi026.stdout:3/905: chown d5/d9/dc/d28/d63/d81/f99 10 1 2024-05-09T00:07:59.660 INFO:tasks.workunit.client.0.smithi026.stdout:3/906: chown d5/d44/l78 61867 1 2024-05-09T00:07:59.674 INFO:tasks.workunit.client.0.smithi026.stdout:2/989: unlink d14/d22/d55/da3/d20/d41/d51/cd9 0 2024-05-09T00:07:59.674 INFO:tasks.workunit.client.0.smithi026.stdout:3/907: mknod d5/da7/c134 0 2024-05-09T00:07:59.674 INFO:tasks.workunit.client.0.smithi026.stdout:2/990: mkdir d14/d22/d55/da3/d30/d154 0 2024-05-09T00:07:59.680 INFO:tasks.workunit.client.0.smithi026.stdout:2/991: dread d14/d22/d55/da3/d3b/d40/d47/f12d [0,4194304] 0 2024-05-09T00:07:59.681 INFO:tasks.workunit.client.0.smithi026.stdout:2/992: mkdir d14/d22/d55/deb/dfc/d155 0 2024-05-09T00:07:59.681 INFO:tasks.workunit.client.0.smithi026.stdout:2/993: fsync d14/d22/d55/f56 0 2024-05-09T00:07:59.686 INFO:tasks.workunit.client.0.smithi026.stdout:2/994: rename d14/d22/d55/d6b/f152 to d14/d22/d55/da3/d20/d41/d51/d82/d14b/f156 0 2024-05-09T00:07:59.690 INFO:tasks.workunit.client.0.smithi026.stdout:2/995: symlink d14/d22/d55/da3/d20/db2/l157 0 2024-05-09T00:07:59.699 INFO:tasks.workunit.client.0.smithi026.stdout:2/996: dread d14/d22/d55/da3/d3b/f3f [0,4194304] 0 2024-05-09T00:07:59.702 INFO:tasks.workunit.client.0.smithi026.stdout:2/997: creat d14/d22/d55/d6b/f158 x:0 0 0 2024-05-09T00:07:59.703 INFO:tasks.workunit.client.0.smithi026.stdout:2/998: symlink d14/d22/d55/da3/d30/d6a/l159 0 2024-05-09T00:07:59.703 INFO:tasks.workunit.client.0.smithi026.stdout:2/999: chown d14/d22/d55/da3/d20/db2/d70/c144 0 1 2024-05-09T00:07:59.712 INFO:tasks.workunit.client.0.smithi026.stdout:3/908: dwrite d5/d9/dc/d28/d2c/f58 [8388608,4194304] 0 2024-05-09T00:07:59.712 INFO:tasks.workunit.client.0.smithi026.stdout:3/909: truncate d5/d9/dc/d5b/fcd 223534 0 2024-05-09T00:07:59.714 INFO:tasks.workunit.client.0.smithi026.stdout:3/910: unlink d5/dd4/f115 0 2024-05-09T00:07:59.715 INFO:tasks.workunit.client.0.smithi026.stdout:3/911: truncate d5/dd4/ded/d6f/fb6 4025612 0 2024-05-09T00:07:59.715 INFO:tasks.workunit.client.0.smithi026.stdout:3/912: write d5/d9/dc/d28/d63/f7e [4387054,8966] 0 2024-05-09T00:07:59.716 INFO:tasks.workunit.client.0.smithi026.stdout:3/913: write d5/d9/dc/f11 [839273,64241] 0 2024-05-09T00:07:59.717 INFO:tasks.workunit.client.0.smithi026.stdout:3/914: mknod d5/d9/d4a/d77/de4/c135 0 2024-05-09T00:07:59.717 INFO:tasks.workunit.client.0.smithi026.stdout:3/915: readlink d5/d44/dd9/l10f 0 2024-05-09T00:07:59.718 INFO:tasks.workunit.client.0.smithi026.stdout:3/916: creat d5/d9/dc/d5b/f136 x:0 0 0 2024-05-09T00:07:59.719 INFO:tasks.workunit.client.0.smithi026.stdout:3/917: chown d5/d9/dc/d5b/fd2 0 1 2024-05-09T00:07:59.720 INFO:tasks.workunit.client.0.smithi026.stdout:3/918: link d5/d9/d4a/d77/f11b d5/d9/dc/d28/d63/d81/f137 0 2024-05-09T00:07:59.721 INFO:tasks.workunit.client.0.smithi026.stdout:3/919: mkdir d5/dd4/ded/d6f/d9e/dfd/d138 0 2024-05-09T00:07:59.722 INFO:tasks.workunit.client.0.smithi026.stdout:3/920: creat d5/d9/dc/d5b/da5/d12e/f139 x:0 0 0 2024-05-09T00:07:59.925 INFO:tasks.workunit.client.0.smithi026.stdout:3/921: sync 2024-05-09T00:07:59.925 INFO:tasks.workunit.client.0.smithi026.stdout:6/926: sync 2024-05-09T00:07:59.925 INFO:tasks.workunit.client.0.smithi026.stdout:5/953: sync 2024-05-09T00:07:59.925 INFO:tasks.workunit.client.0.smithi026.stdout:5/954: fsync d2/d8/d31/d2e/f9b 0 2024-05-09T00:07:59.926 INFO:tasks.workunit.client.0.smithi026.stdout:6/927: write d15/d2b/d33/d55/d67/dd2/f87 [3802296,122973] 0 2024-05-09T00:07:59.926 INFO:tasks.workunit.client.0.smithi026.stdout:6/928: truncate d15/d1e/d23/d73/d58/fcc 503194 0 2024-05-09T00:07:59.926 INFO:tasks.workunit.client.0.smithi026.stdout:3/922: mknod d5/d9/d4a/d77/d116/c13a 0 2024-05-09T00:07:59.927 INFO:tasks.workunit.client.0.smithi026.stdout:5/955: creat d2/d8/d31/d32/d48/db3/f146 x:0 0 0 2024-05-09T00:07:59.927 INFO:tasks.workunit.client.0.smithi026.stdout:5/956: chown d2/d8/d31/d32/d48/daa/db4/df7/l13f 299 1 2024-05-09T00:07:59.927 INFO:tasks.workunit.client.0.smithi026.stdout:5/957: chown d2/d5a/de8 4 1 2024-05-09T00:07:59.927 INFO:tasks.workunit.client.0.smithi026.stdout:5/958: readlink d2/l16 0 2024-05-09T00:07:59.930 INFO:tasks.workunit.client.0.smithi026.stdout:6/929: symlink d15/d1e/d30/d75/l135 0 2024-05-09T00:07:59.934 INFO:tasks.workunit.client.0.smithi026.stdout:3/923: creat d5/d9/dc/d28/d45/db7/f13b x:0 0 0 2024-05-09T00:07:59.935 INFO:tasks.workunit.client.0.smithi026.stdout:5/959: truncate d2/d8/d31/f85 3111811 0 2024-05-09T00:07:59.936 INFO:tasks.workunit.client.0.smithi026.stdout:6/930: creat d15/d1e/d23/d73/d76/f136 x:0 0 0 2024-05-09T00:07:59.939 INFO:tasks.workunit.client.0.smithi026.stdout:3/924: link d5/d9/dc/d28/d63/l10a d5/d44/def/l13c 0 2024-05-09T00:07:59.939 INFO:tasks.workunit.client.0.smithi026.stdout:3/925: fdatasync d5/d9/dc/d28/d63/d81/fad 0 2024-05-09T00:07:59.942 INFO:tasks.workunit.client.0.smithi026.stdout:6/931: creat d15/d1e/d23/d6f/f137 x:0 0 0 2024-05-09T00:07:59.943 INFO:tasks.workunit.client.0.smithi026.stdout:6/932: write d15/d34/d52/f9d [1505188,59878] 0 2024-05-09T00:07:59.956 INFO:tasks.workunit.client.0.smithi026.stdout:3/926: rmdir d5/d9/dc/d28 39 2024-05-09T00:08:00.216 INFO:tasks.workunit.client.0.smithi026.stdout:6/933: sync 2024-05-09T00:08:00.216 INFO:tasks.workunit.client.0.smithi026.stdout:3/927: sync 2024-05-09T00:08:00.216 INFO:tasks.workunit.client.0.smithi026.stdout:5/960: sync 2024-05-09T00:08:00.216 INFO:tasks.workunit.client.0.smithi026.stdout:6/934: chown d15/d1e/d23/d73/d58/c107 149689 1 2024-05-09T00:08:00.216 INFO:tasks.workunit.client.0.smithi026.stdout:3/928: truncate d5/d9/dc/d5b/f136 354097 0 2024-05-09T00:08:00.217 INFO:tasks.workunit.client.0.smithi026.stdout:5/961: rmdir d2/d8/d31/dd8 39 2024-05-09T00:08:00.225 INFO:tasks.workunit.client.0.smithi026.stdout:3/929: dread d5/d9/d71/f9c [0,4194304] 0 2024-05-09T00:08:00.226 INFO:tasks.workunit.client.0.smithi026.stdout:3/930: symlink d5/d1e/d3e/dda/l13d 0 2024-05-09T00:08:00.234 INFO:tasks.workunit.client.0.smithi026.stdout:6/935: write d15/d1e/d30/d32/d10a/dd0/fe1 [1557249,30215] 0 2024-05-09T00:08:00.236 INFO:tasks.workunit.client.0.smithi026.stdout:6/936: link d15/d1e/d30/d32/d10a/db8/ded/l106 d15/d1e/d23/d3a/da6/l138 0 2024-05-09T00:08:00.237 INFO:tasks.workunit.client.0.smithi026.stdout:5/962: dwrite d2/d5a/d104/d11f/f121 [0,4194304] 0 2024-05-09T00:08:00.237 INFO:tasks.workunit.client.0.smithi026.stdout:6/937: creat d15/d1e/d23/d3a/d112/f139 x:0 0 0 2024-05-09T00:08:00.241 INFO:tasks.workunit.client.0.smithi026.stdout:5/963: unlink d2/c40 0 2024-05-09T00:08:00.244 INFO:tasks.workunit.client.0.smithi026.stdout:5/964: mknod d2/d8/d31/d24/c147 0 2024-05-09T00:08:00.244 INFO:tasks.workunit.client.0.smithi026.stdout:5/965: write d2/d8/d31/d32/d5c/f67 [8411165,74397] 0 2024-05-09T00:08:00.244 INFO:tasks.workunit.client.0.smithi026.stdout:5/966: truncate d2/d8/d2a/d8d/f124 468005 0 2024-05-09T00:08:00.245 INFO:tasks.workunit.client.0.smithi026.stdout:5/967: getdents d2/d5a/d96 0 2024-05-09T00:08:00.246 INFO:tasks.workunit.client.0.smithi026.stdout:5/968: readlink d2/d8/d31/d2e/d79/le1 0 2024-05-09T00:08:00.248 INFO:tasks.workunit.client.0.smithi026.stdout:5/969: symlink d2/d8/d31/d32/d48/db3/l148 0 2024-05-09T00:08:00.248 INFO:tasks.workunit.client.0.smithi026.stdout:5/970: stat d2/d8/d31/d32/da2/df0/ff8 0 2024-05-09T00:08:00.248 INFO:tasks.workunit.client.0.smithi026.stdout:3/931: dwrite d5/d9/dc/f31 [0,4194304] 0 2024-05-09T00:08:00.252 INFO:tasks.workunit.client.0.smithi026.stdout:3/932: readlink d5/d9/lc0 0 2024-05-09T00:08:00.255 INFO:tasks.workunit.client.0.smithi026.stdout:5/971: link d2/d8/d31/d32/d48/db3/l148 d2/d8/d31/l149 0 2024-05-09T00:08:00.256 INFO:tasks.workunit.client.0.smithi026.stdout:3/933: fdatasync d5/d41/fe9 0 2024-05-09T00:08:00.258 INFO:tasks.workunit.client.0.smithi026.stdout:5/972: mknod d2/d8/d2a/d8d/dbe/d132/c14a 0 2024-05-09T00:08:00.258 INFO:tasks.workunit.client.0.smithi026.stdout:3/934: creat d5/d9/dc/de1/f13e x:0 0 0 2024-05-09T00:08:00.259 INFO:tasks.workunit.client.0.smithi026.stdout:5/973: creat d2/f14b x:0 0 0 2024-05-09T00:08:00.260 INFO:tasks.workunit.client.0.smithi026.stdout:5/974: symlink d2/d5a/l14c 0 2024-05-09T00:08:00.263 INFO:tasks.workunit.client.0.smithi026.stdout:3/935: dread d5/d9/dc/d28/f35 [0,4194304] 0 2024-05-09T00:08:00.264 INFO:tasks.workunit.client.0.smithi026.stdout:3/936: dread - d5/d9/dc/d28/df0/f11e zero size 2024-05-09T00:08:00.266 INFO:tasks.workunit.client.0.smithi026.stdout:3/937: creat d5/f13f x:0 0 0 2024-05-09T00:08:00.268 INFO:tasks.workunit.client.0.smithi026.stdout:5/975: dread d2/d8/d31/f30 [0,4194304] 0 2024-05-09T00:08:00.269 INFO:tasks.workunit.client.0.smithi026.stdout:3/938: rmdir d5/d9/dc/d28/dba 0 2024-05-09T00:08:00.270 INFO:tasks.workunit.client.0.smithi026.stdout:5/976: mknod d2/d8/d31/d24/c14d 0 2024-05-09T00:08:00.271 INFO:tasks.workunit.client.0.smithi026.stdout:5/977: dread - d2/d8/d31/d63/d9c/dbc/f141 zero size 2024-05-09T00:08:00.271 INFO:tasks.workunit.client.0.smithi026.stdout:3/939: creat d5/d9/dc/d28/d63/f140 x:0 0 0 2024-05-09T00:08:00.274 INFO:tasks.workunit.client.0.smithi026.stdout:5/978: rename d2/d8/d31/d63/d9c/f12d to d2/d8/d2a/d111/f14e 0 2024-05-09T00:08:00.277 INFO:tasks.workunit.client.0.smithi026.stdout:5/979: creat d2/d8/d31/d32/d5c/f14f x:0 0 0 2024-05-09T00:08:00.277 INFO:tasks.workunit.client.0.smithi026.stdout:5/980: chown d2/d5a/d96/fa5 427456 1 2024-05-09T00:08:00.277 INFO:tasks.workunit.client.0.smithi026.stdout:5/981: read - d2/d8/d31/d32/da2/df0/f131 zero size 2024-05-09T00:08:00.278 INFO:tasks.workunit.client.0.smithi026.stdout:3/940: link d5/d9/dc/f70 d5/d9/f141 0 2024-05-09T00:08:00.279 INFO:tasks.workunit.client.0.smithi026.stdout:3/941: rmdir d5/d9/d4a/d77 39 2024-05-09T00:08:00.282 INFO:tasks.workunit.client.0.smithi026.stdout:3/942: read d5/d9/dc/d5b/fcd [33519,130732] 0 2024-05-09T00:08:00.282 INFO:tasks.workunit.client.0.smithi026.stdout:3/943: dread - d5/d9/dc/de1/f13e zero size 2024-05-09T00:08:00.285 INFO:tasks.workunit.client.0.smithi026.stdout:3/944: rename d5/d9/dc/de1 to d5/dd4/d142 0 2024-05-09T00:08:00.292 INFO:tasks.workunit.client.0.smithi026.stdout:5/982: dwrite d2/d8/d31/d32/d5c/fd2 [0,4194304] 0 2024-05-09T00:08:00.303 INFO:tasks.workunit.client.0.smithi026.stdout:3/945: dwrite d5/d1e/d3e/dda/d123/f131 [0,4194304] 0 2024-05-09T00:08:00.303 INFO:tasks.workunit.client.0.smithi026.stdout:3/946: write d5/d9/dc/d5b/f111 [4944320,59966] 0 2024-05-09T00:08:00.372 INFO:tasks.workunit.client.0.smithi026.stdout:5/983: link d2/d8/d31/d32/da2/fba d2/d5a/d96/d137/f150 0 2024-05-09T00:08:00.378 INFO:tasks.workunit.client.0.smithi026.stdout:3/947: unlink d5/d1e/l50 0 2024-05-09T00:08:00.378 INFO:tasks.workunit.client.0.smithi026.stdout:3/948: chown d5/dd4/ded/d6f/d75 43821 1 2024-05-09T00:08:00.382 INFO:tasks.workunit.client.0.smithi026.stdout:5/984: dread d2/d8/d6d/f8f [0,4194304] 0 2024-05-09T00:08:00.429 INFO:tasks.workunit.client.0.smithi026.stdout:3/949: mknod d5/d9/d4a/c143 0 2024-05-09T00:08:00.476 INFO:tasks.workunit.client.0.smithi026.stdout:3/950: rmdir d5/d9 39 2024-05-09T00:08:00.476 INFO:tasks.workunit.client.0.smithi026.stdout:3/951: chown d5/d41/f6e 2210513 1 2024-05-09T00:08:00.478 INFO:tasks.workunit.client.0.smithi026.stdout:3/952: creat d5/d9/d4a/d77/de4/f144 x:0 0 0 2024-05-09T00:08:00.478 INFO:tasks.workunit.client.0.smithi026.stdout:3/953: creat d5/d9/dc/d5b/da5/db2/f145 x:0 0 0 2024-05-09T00:08:00.479 INFO:tasks.workunit.client.0.smithi026.stdout:3/954: symlink d5/d9/d4a/d12f/l146 0 2024-05-09T00:08:00.483 INFO:tasks.workunit.client.0.smithi026.stdout:3/955: truncate d5/f22 373992 0 2024-05-09T00:08:00.483 INFO:tasks.workunit.client.0.smithi026.stdout:3/956: fdatasync d5/d44/dd9/fe8 0 2024-05-09T00:08:00.483 INFO:tasks.workunit.client.0.smithi026.stdout:3/957: truncate d5/d9/d4a/d77/de4/f144 91403 0 2024-05-09T00:08:00.484 INFO:tasks.workunit.client.0.smithi026.stdout:3/958: symlink d5/d9/dc/d5d/l147 0 2024-05-09T00:08:00.487 INFO:tasks.workunit.client.0.smithi026.stdout:3/959: creat d5/d44/f148 x:0 0 0 2024-05-09T00:08:00.491 INFO:tasks.workunit.client.0.smithi026.stdout:5/985: creat d2/d8/d31/d32/da2/f151 x:0 0 0 2024-05-09T00:08:00.495 INFO:tasks.workunit.client.0.smithi026.stdout:5/986: link d2/d8/d31/d32/da2/fc3 d2/d8/d31/d32/d48/daa/db4/f152 0 2024-05-09T00:08:00.495 INFO:tasks.workunit.client.0.smithi026.stdout:5/987: fdatasync d2/f44 0 2024-05-09T00:08:00.498 INFO:tasks.workunit.client.0.smithi026.stdout:5/988: link d2/d8/d31/d2e/d4a/cb2 d2/d5a/d96/de5/c153 0 2024-05-09T00:08:00.498 INFO:tasks.workunit.client.0.smithi026.stdout:5/989: read - d2/d8/d2a/d8d/fdb zero size 2024-05-09T00:08:00.501 INFO:tasks.workunit.client.0.smithi026.stdout:5/990: unlink d2/d5a/d96/c114 0 2024-05-09T00:08:00.503 INFO:tasks.workunit.client.0.smithi026.stdout:5/991: mknod d2/d8/d31/d2e/c154 0 2024-05-09T00:08:00.505 INFO:tasks.workunit.client.0.smithi026.stdout:3/960: dwrite d5/f1f [0,4194304] 0 2024-05-09T00:08:00.505 INFO:tasks.workunit.client.0.smithi026.stdout:3/961: read d5/d41/f6e [452618,119726] 0 2024-05-09T00:08:00.506 INFO:tasks.workunit.client.0.smithi026.stdout:5/992: mknod d2/d8/d31/d2e/d33/c155 0 2024-05-09T00:08:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:3/962: dwrite d5/d1e/d7b/fc1 [4194304,4194304] 0 2024-05-09T00:08:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:5/993: dwrite d2/d8/d2a/f4f [0,4194304] 0 2024-05-09T00:08:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:5/994: dread - d2/d8/d31/d32/d5c/f14f zero size 2024-05-09T00:08:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:5/995: readlink d2/d8/d31/d2e/ld0 0 2024-05-09T00:08:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:5/996: rename d2/d8/d31/d32/d5c/f12e to d2/d8/d31/d63/f156 0 2024-05-09T00:08:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:3/963: write d5/d9/dc/f11 [3506143,118303] 0 2024-05-09T00:08:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:3/964: fdatasync d5/dd4/ded/d6f/d75/fdb 0 2024-05-09T00:08:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:3/965: chown d5/la 516891 1 2024-05-09T00:08:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:3/966: chown d5/f13f 15743 1 2024-05-09T00:08:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:5/997: write d2/d8/d31/f10f [4127562,30910] 0 2024-05-09T00:08:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:5/998: mkdir d2/d5a/d157 0 2024-05-09T00:08:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:3/967: dread d5/d9/d49/ff2 [0,4194304] 0 2024-05-09T00:08:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:3/968: chown d5/d9/dc/d5b/da5/db2/f145 11782245 1 2024-05-09T00:08:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:5/999: mknod d2/d8/d31/d32/d48/c158 0 2024-05-09T00:08:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:3/969: creat d5/dd4/ded/d6f/d9e/dfd/f149 x:0 0 0 2024-05-09T00:08:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:6/938: sync 2024-05-09T00:08:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:6/939: mknod d15/d34/d52/d8b/ddb/c13a 0 2024-05-09T00:08:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:6/940: fdatasync d15/d1e/d23/d73/d58/f61 0 2024-05-09T00:08:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:6/941: creat d15/d1e/d30/d32/d10a/dd0/d11e/d132/d12b/f13b x:0 0 0 2024-05-09T00:08:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:6/942: creat d15/d2b/d33/d7d/d116/d12e/f13c x:0 0 0 2024-05-09T00:08:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:3/970: dwrite d5/d9/dc/d28/d63/d81/f137 [0,4194304] 0 2024-05-09T00:08:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:6/943: mkdir d15/d1e/d30/d32/d10a/db8/dde/d13d 0 2024-05-09T00:08:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:3/971: write d5/dd4/ded/d6f/d75/fdb [451106,73049] 0 2024-05-09T00:08:00.571 INFO:tasks.workunit.client.0.smithi026.stdout:6/944: symlink d15/d34/d52/d8b/d4d/l13e 0 2024-05-09T00:08:00.575 INFO:tasks.workunit.client.0.smithi026.stdout:3/972: creat d5/dd4/ded/d6f/d9e/dfd/f14a x:0 0 0 2024-05-09T00:08:00.582 INFO:tasks.workunit.client.0.smithi026.stdout:3/973: link d5/f39 d5/d1e/d3e/f14b 0 2024-05-09T00:08:00.586 INFO:tasks.workunit.client.0.smithi026.stdout:3/974: creat d5/d44/d9f/dc5/f14c x:0 0 0 2024-05-09T00:08:00.587 INFO:tasks.workunit.client.0.smithi026.stdout:6/945: dwrite d15/d1e/d23/d73/d76/fd6 [0,4194304] 0 2024-05-09T00:08:00.587 INFO:tasks.workunit.client.0.smithi026.stdout:6/946: fsync d15/d1e/d23/d73/f27 0 2024-05-09T00:08:00.588 INFO:tasks.workunit.client.0.smithi026.stdout:6/947: mkdir d15/d1e/d30/d32/d10a/db8/dde/d13d/d13f 0 2024-05-09T00:08:00.598 INFO:tasks.workunit.client.0.smithi026.stdout:6/948: creat d15/d34/d52/d8b/f140 x:0 0 0 2024-05-09T00:08:00.598 INFO:tasks.workunit.client.0.smithi026.stdout:3/975: fsync d5/f39 0 2024-05-09T00:08:00.599 INFO:tasks.workunit.client.0.smithi026.stdout:6/949: symlink d15/d1e/l141 0 2024-05-09T00:08:00.599 INFO:tasks.workunit.client.0.smithi026.stdout:6/950: write d15/d34/dba/fea [883376,127734] 0 2024-05-09T00:08:00.602 INFO:tasks.workunit.client.0.smithi026.stdout:6/951: mkdir d15/d2b/d33/d142 0 2024-05-09T00:08:00.609 INFO:tasks.workunit.client.0.smithi026.stdout:6/952: dread d15/d1e/d23/f4a [0,4194304] 0 2024-05-09T00:08:00.612 INFO:tasks.workunit.client.0.smithi026.stdout:6/953: rename d15/d1e/d23/d73/d8e/cc2 to d15/d1e/d30/d75/c143 0 2024-05-09T00:08:00.612 INFO:tasks.workunit.client.0.smithi026.stdout:6/954: stat d15/d2b/d33/d55/d67/dbb/dbf/fc3 0 2024-05-09T00:08:00.613 INFO:tasks.workunit.client.0.smithi026.stdout:6/955: write d15/d34/d52/d8b/f91 [452309,58494] 0 2024-05-09T00:08:00.613 INFO:tasks.workunit.client.0.smithi026.stdout:6/956: readlink d15/d1e/d23/d73/d58/d5c/lb1 0 2024-05-09T00:08:00.614 INFO:tasks.workunit.client.0.smithi026.stdout:6/957: rmdir d15/d2b/d33/d55 39 2024-05-09T00:08:00.616 INFO:tasks.workunit.client.0.smithi026.stdout:6/958: creat d15/d2b/d33/d7d/d10b/f144 x:0 0 0 2024-05-09T00:08:00.616 INFO:tasks.workunit.client.0.smithi026.stdout:6/959: fsync d15/d1e/d23/f24 0 2024-05-09T00:08:00.616 INFO:tasks.workunit.client.0.smithi026.stdout:3/976: dwrite d5/db1/fca [0,4194304] 0 2024-05-09T00:08:00.617 INFO:tasks.workunit.client.0.smithi026.stdout:6/960: creat d15/d2b/d33/d7d/d116/d12e/f145 x:0 0 0 2024-05-09T00:08:00.618 INFO:tasks.workunit.client.0.smithi026.stdout:6/961: write f1 [5891667,127464] 0 2024-05-09T00:08:00.618 INFO:tasks.workunit.client.0.smithi026.stdout:6/962: readlink d15/d2b/d33/d55/l66 0 2024-05-09T00:08:00.618 INFO:tasks.workunit.client.0.smithi026.stdout:6/963: write d15/d1e/d23/d73/fa3 [4826156,12180] 0 2024-05-09T00:08:00.618 INFO:tasks.workunit.client.0.smithi026.stdout:3/977: mkdir d5/d9/d71/d10e/d14d 0 2024-05-09T00:08:00.620 INFO:tasks.workunit.client.0.smithi026.stdout:6/964: symlink d15/d2b/d33/d55/d67/d90/l146 0 2024-05-09T00:08:00.625 INFO:tasks.workunit.client.0.smithi026.stdout:3/978: dread d5/d9/dc/f70 [0,4194304] 0 2024-05-09T00:08:00.625 INFO:tasks.workunit.client.0.smithi026.stdout:3/979: write d5/dd4/ded/d6f/d75/f100 [382593,39037] 0 2024-05-09T00:08:00.625 INFO:tasks.workunit.client.0.smithi026.stdout:3/980: chown d5/d9/dc/d5b/da5/db3/ld6 14854 1 2024-05-09T00:08:00.628 INFO:tasks.workunit.client.0.smithi026.stdout:3/981: symlink d5/d44/dd9/l14e 0 2024-05-09T00:08:00.628 INFO:tasks.workunit.client.0.smithi026.stdout:3/982: write d5/d44/d9f/dc5/ffa [4767124,107938] 0 2024-05-09T00:08:00.628 INFO:tasks.workunit.client.0.smithi026.stdout:3/983: write d5/f39 [4758220,86690] 0 2024-05-09T00:08:00.628 INFO:tasks.workunit.client.0.smithi026.stdout:3/984: truncate d5/d1e/d7b/deb/f109 584505 0 2024-05-09T00:08:00.629 INFO:tasks.workunit.client.0.smithi026.stdout:6/965: dread d15/d2b/d33/f115 [0,4194304] 0 2024-05-09T00:08:00.629 INFO:tasks.workunit.client.0.smithi026.stdout:6/966: fsync d15/d1e/d23/d73/f27 0 2024-05-09T00:08:00.629 INFO:tasks.workunit.client.0.smithi026.stdout:6/967: write d15/d1e/d30/d32/ffd [271763,41482] 0 2024-05-09T00:08:00.630 INFO:tasks.workunit.client.0.smithi026.stdout:6/968: creat d15/d1e/d23/f147 x:0 0 0 2024-05-09T00:08:00.631 INFO:tasks.workunit.client.0.smithi026.stdout:6/969: write f12 [5258794,114010] 0 2024-05-09T00:08:00.641 INFO:tasks.workunit.client.0.smithi026.stdout:3/985: dwrite d5/d9/dc/d28/d45/db7/f13b [0,4194304] 0 2024-05-09T00:08:00.643 INFO:tasks.workunit.client.0.smithi026.stdout:3/986: truncate d5/d9/f2a 204444 0 2024-05-09T00:08:00.646 INFO:tasks.workunit.client.0.smithi026.stdout:3/987: fsync d5/d1e/d3e/f14b 0 2024-05-09T00:08:00.647 INFO:tasks.workunit.client.0.smithi026.stdout:3/988: symlink d5/d1e/d7b/deb/l14f 0 2024-05-09T00:08:00.656 INFO:tasks.workunit.client.0.smithi026.stdout:6/970: dwrite d15/d1e/d23/d73/f6a [0,4194304] 0 2024-05-09T00:08:00.656 INFO:tasks.workunit.client.0.smithi026.stdout:6/971: chown d15/d1e/d30/d32 2907192 1 2024-05-09T00:08:00.659 INFO:tasks.workunit.client.0.smithi026.stdout:6/972: rename d15/d2b/d33/d7d/d116 to d15/d2b/d33/d55/d67/dd2/d148 0 2024-05-09T00:08:00.660 INFO:tasks.workunit.client.0.smithi026.stdout:3/989: dread d5/d9/dc/d28/fac [0,4194304] 0 2024-05-09T00:08:00.662 INFO:tasks.workunit.client.0.smithi026.stdout:6/973: unlink d15/d1e/d23/c92 0 2024-05-09T00:08:00.665 INFO:tasks.workunit.client.0.smithi026.stdout:6/974: truncate d15/d41/fd5 1095885 0 2024-05-09T00:08:00.665 INFO:tasks.workunit.client.0.smithi026.stdout:6/975: truncate f11 4954603 0 2024-05-09T00:08:00.665 INFO:tasks.workunit.client.0.smithi026.stdout:6/976: write d15/d2b/d33/d55/d67/dd2/d148/d12e/f145 [484811,109743] 0 2024-05-09T00:08:00.669 INFO:tasks.workunit.client.0.smithi026.stdout:3/990: dread d5/d9/dc/d28/d2c/f84 [0,4194304] 0 2024-05-09T00:08:00.672 INFO:tasks.workunit.client.0.smithi026.stdout:3/991: truncate d5/d9/dc/f11 1602053 0 2024-05-09T00:08:00.672 INFO:tasks.workunit.client.0.smithi026.stdout:3/992: readlink d5/d9/dc/d28/d63/d81/lc2 0 2024-05-09T00:08:00.672 INFO:tasks.workunit.client.0.smithi026.stdout:3/993: truncate d5/dd4/ded/d6f/d75/fa2 998344 0 2024-05-09T00:08:00.675 INFO:tasks.workunit.client.0.smithi026.stdout:3/994: link d5/d9/dc/d5b/c98 d5/dd4/d142/c150 0 2024-05-09T00:08:00.678 INFO:tasks.workunit.client.0.smithi026.stdout:3/995: dread d5/d9/dc/d5b/f85 [0,4194304] 0 2024-05-09T00:08:00.678 INFO:tasks.workunit.client.0.smithi026.stdout:3/996: stat d5/d9/lc0 0 2024-05-09T00:08:00.683 INFO:tasks.workunit.client.0.smithi026.stdout:6/977: dwrite d15/d34/d52/d8b/fac [0,4194304] 0 2024-05-09T00:08:00.684 INFO:tasks.workunit.client.0.smithi026.stdout:6/978: creat d15/d1e/d23/d73/d8e/d123/f149 x:0 0 0 2024-05-09T00:08:00.694 INFO:tasks.workunit.client.0.smithi026.stdout:6/979: mknod d15/d34/d52/d8b/c14a 0 2024-05-09T00:08:00.694 INFO:tasks.workunit.client.0.smithi026.stdout:6/980: fsync d15/d1e/d23/f147 0 2024-05-09T00:08:00.698 INFO:tasks.workunit.client.0.smithi026.stdout:6/981: creat d15/d2b/d33/d55/d67/de5/f14b x:0 0 0 2024-05-09T00:08:00.701 INFO:tasks.workunit.client.0.smithi026.stdout:6/982: creat d15/d1e/d23/d3a/da6/de2/f14c x:0 0 0 2024-05-09T00:08:00.704 INFO:tasks.workunit.client.0.smithi026.stdout:6/983: rmdir d15/d1e/d23/d6f 39 2024-05-09T00:08:00.705 INFO:tasks.workunit.client.0.smithi026.stdout:3/997: dwrite d5/d9/dc/d28/df0/f11e [0,4194304] 0 2024-05-09T00:08:00.711 INFO:tasks.workunit.client.0.smithi026.stdout:6/984: rename d15/d1e/d23/f8a to d15/d2b/d33/d55/f14d 0 2024-05-09T00:08:00.711 INFO:tasks.workunit.client.0.smithi026.stdout:6/985: truncate d15/d62/f8f 266313 0 2024-05-09T00:08:00.743 INFO:tasks.workunit.client.0.smithi026.stdout:6/986: dwrite d15/d2b/f42 [4194304,4194304] 0 2024-05-09T00:08:00.753 INFO:tasks.workunit.client.0.smithi026.stdout:3/998: dwrite d5/d9/dc/f1b [0,4194304] 0 2024-05-09T00:08:00.753 INFO:tasks.workunit.client.0.smithi026.stdout:3/999: chown d5/d44/dd9/fe8 17 1 2024-05-09T00:08:00.763 INFO:tasks.workunit.client.0.smithi026.stdout:6/987: dwrite d15/d1e/d23/d73/fa7 [0,4194304] 0 2024-05-09T00:08:00.766 INFO:tasks.workunit.client.0.smithi026.stdout:6/988: creat d15/d1e/d23/d73/f14e x:0 0 0 2024-05-09T00:08:00.766 INFO:tasks.workunit.client.0.smithi026.stdout:6/989: chown d15/d1e/d23/d73/d76 5 1 2024-05-09T00:08:00.766 INFO:tasks.workunit.client.0.smithi026.stdout:6/990: write d15/d2b/d33/d55/d67/dd2/d148/d12e/f13c [182861,118081] 0 2024-05-09T00:08:00.771 INFO:tasks.workunit.client.0.smithi026.stdout:6/991: creat d15/d1e/d30/d75/f14f x:0 0 0 2024-05-09T00:08:00.775 INFO:tasks.workunit.client.0.smithi026.stdout:6/992: read d15/d1e/d23/d6f/f97 [233288,22775] 0 2024-05-09T00:08:00.785 INFO:tasks.workunit.client.0.smithi026.stdout:6/993: dread d15/d1e/d30/fe7 [0,4194304] 0 2024-05-09T00:08:00.785 INFO:tasks.workunit.client.0.smithi026.stdout:6/994: truncate d15/d1e/d30/f86 1922768 0 2024-05-09T00:08:00.789 INFO:tasks.workunit.client.0.smithi026.stdout:6/995: mknod d15/d1e/d23/d73/d76/d10f/c150 0 2024-05-09T00:08:00.818 INFO:tasks.workunit.client.0.smithi026.stdout:6/996: dwrite d15/d1e/d23/d73/d58/f61 [0,4194304] 0 2024-05-09T00:08:00.820 INFO:tasks.workunit.client.0.smithi026.stdout:6/997: mkdir d15/d1e/d30/d32/d10a/db8/d151 0 2024-05-09T00:08:00.820 INFO:tasks.workunit.client.0.smithi026.stdout:6/998: truncate d15/d1e/d23/d73/d76/f136 509716 0 2024-05-09T00:08:00.834 INFO:tasks.workunit.client.0.smithi026.stdout:6/999: dread d15/d1e/d30/f72 [0,4194304] 0 2024-05-09T00:08:00.841 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -rf -- ./tmp.lNzgA45L2o 2024-05-09T00:08:00.982 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:00 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:07:59.911241+0000 mgr.smithi135.kkrhgf (mgr.24419) 63 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 93 MiB/s rd, 206 MiB/s wr, 411 op/s 2024-05-09T00:08:01.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:07:59.911241+0000 mgr.smithi135.kkrhgf (mgr.24419) 63 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 93 MiB/s rd, 206 MiB/s wr, 411 op/s 2024-05-09T00:08:03.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:01.911729+0000 mgr.smithi135.kkrhgf (mgr.24419) 64 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 60 MiB/s rd, 136 MiB/s wr, 264 op/s 2024-05-09T00:08:03.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:02.077812+0000 mon.smithi026 (mon.0) 692 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:03.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:02.084141+0000 mon.smithi026 (mon.0) 693 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:03.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:02.133225+0000 mgr.smithi135.kkrhgf (mgr.24419) 65 : cephadm [INF] Reconfiguring grafana.smithi026 (dependencies changed)... 2024-05-09T00:08:03.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:02.144563+0000 mgr.smithi135.kkrhgf (mgr.24419) 66 : cephadm [INF] Reconfiguring daemon grafana.smithi026 on smithi026 2024-05-09T00:08:03.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:01.911729+0000 mgr.smithi135.kkrhgf (mgr.24419) 64 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 60 MiB/s rd, 136 MiB/s wr, 264 op/s 2024-05-09T00:08:03.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:02.077812+0000 mon.smithi026 (mon.0) 692 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:03.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:02.084141+0000 mon.smithi026 (mon.0) 693 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:03.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:02.133225+0000 mgr.smithi135.kkrhgf (mgr.24419) 65 : cephadm [INF] Reconfiguring grafana.smithi026 (dependencies changed)... 2024-05-09T00:08:03.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:02.144563+0000 mgr.smithi135.kkrhgf (mgr.24419) 66 : cephadm [INF] Reconfiguring daemon grafana.smithi026 on smithi026 2024-05-09T00:08:04.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:03.111678+0000 mon.smithi135 (mon.1) 62 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:08:04.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:03.111678+0000 mon.smithi135 (mon.1) 62 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:08:05.615 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T00:08:05.616 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-09T00:08:05.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:03.912236+0000 mgr.smithi135.kkrhgf (mgr.24419) 67 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 60 MiB/s rd, 136 MiB/s wr, 264 op/s 2024-05-09T00:08:05.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:03.912236+0000 mgr.smithi135.kkrhgf (mgr.24419) 67 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 60 MiB/s rd, 136 MiB/s wr, 264 op/s 2024-05-09T00:08:07.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:05.912699+0000 mgr.smithi135.kkrhgf (mgr.24419) 68 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 68 MiB/s rd, 151 MiB/s wr, 349 op/s 2024-05-09T00:08:07.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:05.912699+0000 mgr.smithi135.kkrhgf (mgr.24419) 68 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 68 MiB/s rd, 151 MiB/s wr, 349 op/s 2024-05-09T00:08:09.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:07.913020+0000 mgr.smithi135.kkrhgf (mgr.24419) 69 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 35 MiB/s rd, 84 MiB/s wr, 215 op/s 2024-05-09T00:08:09.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:07.913020+0000 mgr.smithi135.kkrhgf (mgr.24419) 69 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 2.3 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 35 MiB/s rd, 84 MiB/s wr, 215 op/s 2024-05-09T00:08:11.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:09.913634+0000 mgr.smithi135.kkrhgf (mgr.24419) 70 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 35 MiB/s rd, 85 MiB/s wr, 302 op/s 2024-05-09T00:08:11.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:09.913634+0000 mgr.smithi135.kkrhgf (mgr.24419) 70 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 35 MiB/s rd, 85 MiB/s wr, 302 op/s 2024-05-09T00:08:12.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.347+0000 7f9060586700 1 -- 172.21.15.26:0/3416908140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 msgr2=0x7f90580f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:12.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.347+0000 7f9060586700 1 --2- 172.21.15.26:0/3416908140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 0x7f90580f6b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f90540047f0 tx=0x7f9054009cb0).stop 2024-05-09T00:08:12.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.347+0000 7f9060586700 1 -- 172.21.15.26:0/3416908140 shutdown_connections 2024-05-09T00:08:12.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.347+0000 7f9060586700 1 --2- 172.21.15.26:0/3416908140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90580f79a0 0x7f90580f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:12.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.347+0000 7f9060586700 1 --2- 172.21.15.26:0/3416908140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 0x7f90580f6b20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:12.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.347+0000 7f9060586700 1 -- 172.21.15.26:0/3416908140 >> 172.21.15.26:0/3416908140 conn(0x7f90580f1e60 msgr2=0x7f90580f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:12.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.347+0000 7f9060586700 1 -- 172.21.15.26:0/3416908140 shutdown_connections 2024-05-09T00:08:12.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.347+0000 7f9060586700 1 -- 172.21.15.26:0/3416908140 wait complete. 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f9060586700 1 Processor -- start 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f9060586700 1 -- start start 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f9060586700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 0x7f90581080b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f9060586700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90580f79a0 0x7f90581085a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f9060586700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058108b50 con 0x7f90580f6700 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f9060586700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058108c90 con 0x7f90580f79a0 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f905e322700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 0x7f90581080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f905e322700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 0x7f90581080b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34914/0 (socket says 172.21.15.26:34914) 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f905e322700 1 -- 172.21.15.26:0/4104445066 learned_addr learned my addr 172.21.15.26:0/4104445066 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.348+0000 7f905db21700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90580f79a0 0x7f90581085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f905e322700 1 -- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90580f79a0 msgr2=0x7f90581085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f905e322700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90580f79a0 0x7f90581085a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f905e322700 1 -- 172.21.15.26:0/4104445066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054005040 con 0x7f90580f6700 2024-05-09T00:08:12.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f905e322700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 0x7f90581080b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f9054013560 tx=0x7f9054009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f904f7fe700 1 -- 172.21.15.26:0/4104445066 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9054018070 con 0x7f90580f6700 2024-05-09T00:08:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f904f7fe700 1 -- 172.21.15.26:0/4104445066 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9054007e90 con 0x7f90580f6700 2024-05-09T00:08:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f904f7fe700 1 -- 172.21.15.26:0/4104445066 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f905401c380 con 0x7f90580f6700 2024-05-09T00:08:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90580f8bc0 con 0x7f90580f6700 2024-05-09T00:08:12.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.349+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90580f9180 con 0x7f90580f6700 2024-05-09T00:08:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.351+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90580feee0 con 0x7f90580f6700 2024-05-09T00:08:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.352+0000 7f904f7fe700 1 -- 172.21.15.26:0/4104445066 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f90540123c0 con 0x7f90580f6700 2024-05-09T00:08:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.352+0000 7f904f7fe700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f904406b1d0 0x7f904406d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.352+0000 7f904f7fe700 1 -- 172.21.15.26:0/4104445066 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f90540852d0 con 0x7f90580f6700 2024-05-09T00:08:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.357+0000 7f905db21700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f904406b1d0 0x7f904406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.357+0000 7f904f7fe700 1 -- 172.21.15.26:0/4104445066 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f9054053470 con 0x7f90580f6700 2024-05-09T00:08:12.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.357+0000 7f905db21700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f904406b1d0 0x7f904406d690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9048004ee0 tx=0x7f904800b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:12.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.658+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90580fbde0 con 0x7f904406b1d0 2024-05-09T00:08:12.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.660+0000 7f904f7fe700 1 -- 172.21.15.26:0/4104445066 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f90580fbde0 con 0x7f904406b1d0 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.662+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f904406b1d0 msgr2=0x7f904406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.662+0000 7f9060586700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f904406b1d0 0x7f904406d690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9048004ee0 tx=0x7f904800b040).stop 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.662+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 msgr2=0x7f90581080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.662+0000 7f9060586700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 0x7f90581080b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f9054013560 tx=0x7f9054009cb0).stop 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.663+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 shutdown_connections 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.663+0000 7f9060586700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f904406b1d0 0x7f904406d690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.663+0000 7f9060586700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90580f6700 0x7f90581080b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.663+0000 7f9060586700 1 --2- 172.21.15.26:0/4104445066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90580f79a0 0x7f90581085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.663+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 >> 172.21.15.26:0/4104445066 conn(0x7f90580f1e60 msgr2=0x7f9058060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.663+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 shutdown_connections 2024-05-09T00:08:12.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.663+0000 7f9060586700 1 -- 172.21.15.26:0/4104445066 wait complete. 2024-05-09T00:08:12.672 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:08:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.812+0000 7fde135a5700 1 -- 172.21.15.26:0/3639017070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f6710 msgr2=0x7fde0c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.812+0000 7fde135a5700 1 --2- 172.21.15.26:0/3639017070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f6710 0x7fde0c0f6b30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fde080047f0 tx=0x7fde08009cb0).stop 2024-05-09T00:08:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.813+0000 7fde135a5700 1 -- 172.21.15.26:0/3639017070 shutdown_connections 2024-05-09T00:08:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.813+0000 7fde135a5700 1 --2- 172.21.15.26:0/3639017070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0c0f7020 0x7fde0c0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.813+0000 7fde135a5700 1 --2- 172.21.15.26:0/3639017070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f6710 0x7fde0c0f6b30 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0x7fde080047f0 tx=0x7fde08009cb0).stop 2024-05-09T00:08:12.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.813+0000 7fde135a5700 1 -- 172.21.15.26:0/3639017070 >> 172.21.15.26:0/3639017070 conn(0x7fde0c0f1f10 msgr2=0x7fde0c0f4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:12.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.813+0000 7fde135a5700 1 -- 172.21.15.26:0/3639017070 shutdown_connections 2024-05-09T00:08:12.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.813+0000 7fde135a5700 1 -- 172.21.15.26:0/3639017070 wait complete. 2024-05-09T00:08:12.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.814+0000 7fde135a5700 1 Processor -- start 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.814+0000 7fde135a5700 1 -- start start 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.814+0000 7fde135a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f7020 0x7fde0c107130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.814+0000 7fde135a5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0c107620 0x7fde0c10c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.814+0000 7fde135a5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c107af0 con 0x7fde0c0f7020 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.814+0000 7fde135a5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c107c30 con 0x7fde0c107620 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde11341700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f7020 0x7fde0c107130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde11341700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f7020 0x7fde0c107130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34940/0 (socket says 172.21.15.26:34940) 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde11341700 1 -- 172.21.15.26:0/775968584 learned_addr learned my addr 172.21.15.26:0/775968584 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:12.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde10b40700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0c107620 0x7fde0c10c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:12.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde11341700 1 -- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0c107620 msgr2=0x7fde0c10c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:12.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde11341700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0c107620 0x7fde0c10c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:12.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde11341700 1 -- 172.21.15.26:0/775968584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08005040 con 0x7fde0c0f7020 2024-05-09T00:08:12.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde11341700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f7020 0x7fde0c107130 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fde080047c0 tx=0x7fde0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:12.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.815+0000 7fde027fc700 1 -- 172.21.15.26:0/775968584 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde08019070 con 0x7fde0c0f7020 2024-05-09T00:08:12.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.816+0000 7fde027fc700 1 -- 172.21.15.26:0/775968584 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde08007e90 con 0x7fde0c0f7020 2024-05-09T00:08:12.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.816+0000 7fde027fc700 1 -- 172.21.15.26:0/775968584 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde080123c0 con 0x7fde0c0f7020 2024-05-09T00:08:12.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.816+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c062700 con 0x7fde0c0f7020 2024-05-09T00:08:12.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.816+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c062c10 con 0x7fde0c0f7020 2024-05-09T00:08:12.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.817+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c0fef10 con 0x7fde0c0f7020 2024-05-09T00:08:12.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.818+0000 7fde027fc700 1 -- 172.21.15.26:0/775968584 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fde0801e420 con 0x7fde0c0f7020 2024-05-09T00:08:12.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.818+0000 7fde027fc700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fddf8066dc0 0x7fddf8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:12.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.818+0000 7fde027fc700 1 -- 172.21.15.26:0/775968584 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fde08085690 con 0x7fde0c0f7020 2024-05-09T00:08:12.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.818+0000 7fde10b40700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fddf8066dc0 0x7fddf8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:12.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.819+0000 7fde10b40700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fddf8066dc0 0x7fddf8069280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fddfc0092f0 tx=0x7fddfc00b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:12.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:12.825+0000 7fde027fc700 1 -- 172.21.15.26:0/775968584 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7fde080537e0 con 0x7fde0c0f7020 2024-05-09T00:08:13.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.184+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde0c059120 con 0x7fddf8066dc0 2024-05-09T00:08:13.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.187+0000 7fde027fc700 1 -- 172.21.15.26:0/775968584 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fde0c059120 con 0x7fddf8066dc0 2024-05-09T00:08:13.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.191+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fddf8066dc0 msgr2=0x7fddf8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:13.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.191+0000 7fde135a5700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fddf8066dc0 0x7fddf8069280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fddfc0092f0 tx=0x7fddfc00b040).stop 2024-05-09T00:08:13.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.191+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f7020 msgr2=0x7fde0c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:13.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.191+0000 7fde135a5700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f7020 0x7fde0c107130 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fde080047c0 tx=0x7fde0800b040).stop 2024-05-09T00:08:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.194+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 shutdown_connections 2024-05-09T00:08:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.194+0000 7fde135a5700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fddf8066dc0 0x7fddf8069280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.194+0000 7fde135a5700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde0c0f7020 0x7fde0c107130 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.194+0000 7fde135a5700 1 --2- 172.21.15.26:0/775968584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde0c107620 0x7fde0c10c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.194+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 >> 172.21.15.26:0/775968584 conn(0x7fde0c0f1f10 msgr2=0x7fde0c0fb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:13.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.195+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 shutdown_connections 2024-05-09T00:08:13.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.195+0000 7fde135a5700 1 -- 172.21.15.26:0/775968584 wait complete. 2024-05-09T00:08:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.349+0000 7fbe3404f700 1 -- 172.21.15.26:0/3453213710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f5e70 msgr2=0x7fbe2c0f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.349+0000 7fbe3404f700 1 --2- 172.21.15.26:0/3453213710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f5e70 0x7fbe2c0f6290 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fbe280047f0 tx=0x7fbe28009cb0).stop 2024-05-09T00:08:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.349+0000 7fbe3404f700 1 -- 172.21.15.26:0/3453213710 shutdown_connections 2024-05-09T00:08:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.349+0000 7fbe3404f700 1 --2- 172.21.15.26:0/3453213710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe2c0f7070 0x7fbe2c0f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:08:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.349+0000 7fbe3404f700 1 --2- 172.21.15.26:0/3453213710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f5e70 0x7fbe2c0f6290 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.349+0000 7fbe3404f700 1 -- 172.21.15.26:0/3453213710 >> 172.21.15.26:0/3453213710 conn(0x7fbe2c0f15d0 msgr2=0x7fbe2c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.349+0000 7fbe3404f700 1 -- 172.21.15.26:0/3453213710 shutdown_connections 2024-05-09T00:08:13.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.349+0000 7fbe3404f700 1 -- 172.21.15.26:0/3453213710 wait complete. 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.350+0000 7fbe3404f700 1 Processor -- start 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.350+0000 7fbe3404f700 1 -- start start 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.350+0000 7fbe3404f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe2c0f5e70 0x7fbe2c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.350+0000 7fbe3404f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f7070 0x7fbe2c107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.350+0000 7fbe3404f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c107a40 con 0x7fbe2c0f7070 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.350+0000 7fbe3404f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c107b80 con 0x7fbe2c0f5e70 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe315ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f7070 0x7fbe2c107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe315ea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f7070 0x7fbe2c107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34964/0 (socket says 172.21.15.26:34964) 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe315ea700 1 -- 172.21.15.26:0/3572594138 learned_addr learned my addr 172.21.15.26:0/3572594138 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:13.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe31deb700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe2c0f5e70 0x7fbe2c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe315ea700 1 -- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe2c0f5e70 msgr2=0x7fbe2c106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe315ea700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe2c0f5e70 0x7fbe2c106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe315ea700 1 -- 172.21.15.26:0/3572594138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe28005040 con 0x7fbe2c0f7070 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe315ea700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f7070 0x7fbe2c107400 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fbe1c00b410 tx=0x7fbe1c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe22ffd700 1 -- 172.21.15.26:0/3572594138 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe1c012410 con 0x7fbe2c0f7070 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.351+0000 7fbe22ffd700 1 -- 172.21.15.26:0/3572594138 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe1c012a20 con 0x7fbe2c0f7070 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.352+0000 7fbe22ffd700 1 -- 172.21.15.26:0/3572594138 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe1c00daf0 con 0x7fbe2c0f7070 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.352+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c0f8380 con 0x7fbe2c0f7070 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.352+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c0f88f0 con 0x7fbe2c0f7070 2024-05-09T00:08:13.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.353+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c0fe6f0 con 0x7fbe2c0f7070 2024-05-09T00:08:13.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.354+0000 7fbe22ffd700 1 -- 172.21.15.26:0/3572594138 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fbe1c00dd70 con 0x7fbe2c0f7070 2024-05-09T00:08:13.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.354+0000 7fbe22ffd700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fbe18066dc0 0x7fbe18069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.354+0000 7fbe22ffd700 1 -- 172.21.15.26:0/3572594138 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fbe1c0840f0 con 0x7fbe2c0f7070 2024-05-09T00:08:13.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.355+0000 7fbe31deb700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fbe18066dc0 0x7fbe18069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:13.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.356+0000 7fbe31deb700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fbe18066dc0 0x7fbe18069280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fbe28004f10 tx=0x7fbe28009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:13.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.362+0000 7fbe22ffd700 1 -- 172.21.15.26:0/3572594138 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7fbe1c0522a0 con 0x7fbe2c0f7070 2024-05-09T00:08:13.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.616+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe2c0fbb50 con 0x7fbe18066dc0 2024-05-09T00:08:13.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.626+0000 7fbe22ffd700 1 -- 172.21.15.26:0/3572594138 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbe2c0fbb50 con 0x7fbe18066dc0 2024-05-09T00:08:13.622 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 starting - - - - 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (8m) 78s ago 8m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (8m) 69s ago 8m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (7m) 78s ago 8m 58.1M - 8.3.5 dad864ee21e9 0d0dbb754a90 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (3m) 78s ago 3m 12.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (3m) 78s ago 3m 106M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (3m) 69s ago 3m 12.6M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (3m) 69s ago 3m 12.4M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:9283 running (10m) 78s ago 10m 320M - 16.2.15-1-g8963e9de 727f386679cb 405cee21e657 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (94s) 69s ago 8m 479M - 18.2.2-1322-gd21e4f96 af23193ff691 8681491889c9 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (10m) 78s ago 10m 48.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (8m) 69s ago 8m 40.7M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (8m) 78s ago 8m 25.3M - 1.3.1 1dbe0e931976 eb62f1a664c9 2024-05-09T00:08:13.623 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (8m) 69s ago 7m 25.8M - 1.3.1 1dbe0e931976 0ef67083c290 2024-05-09T00:08:13.624 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (7m) 78s ago 7m 82.7M 1911M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:08:13.624 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (7m) 78s ago 7m 81.8M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:08:13.624 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (6m) 78s ago 6m 67.7M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:08:13.624 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (6m) 69s ago 6m 87.4M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:08:13.624 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (5m) 69s ago 5m 84.2M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:08:13.624 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (5m) 69s ago 5m 82.1M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:08:13.624 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (7m) 69s ago 7m 62.8M - 2.33.4 514e6a882f6e dbc569e4b23d 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.628+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fbe18066dc0 msgr2=0x7fbe18069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.628+0000 7fbe3404f700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fbe18066dc0 0x7fbe18069280 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fbe28004f10 tx=0x7fbe28009cb0).stop 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.628+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f7070 msgr2=0x7fbe2c107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.628+0000 7fbe3404f700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f7070 0x7fbe2c107400 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fbe1c00b410 tx=0x7fbe1c009060).stop 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.629+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 shutdown_connections 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.629+0000 7fbe3404f700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fbe18066dc0 0x7fbe18069280 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.629+0000 7fbe3404f700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe2c0f5e70 0x7fbe2c106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.629+0000 7fbe3404f700 1 --2- 172.21.15.26:0/3572594138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe2c0f7070 0x7fbe2c107400 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.629+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 >> 172.21.15.26:0/3572594138 conn(0x7fbe2c0f15d0 msgr2=0x7fbe2c0fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.629+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 shutdown_connections 2024-05-09T00:08:13.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.629+0000 7fbe3404f700 1 -- 172.21.15.26:0/3572594138 wait complete. 2024-05-09T00:08:13.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:11.913984+0000 mgr.smithi135.kkrhgf (mgr.24419) 71 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 1.5 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 7.6 MiB/s rd, 16 MiB/s wr, 172 op/s 2024-05-09T00:08:13.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:11.913984+0000 mgr.smithi135.kkrhgf (mgr.24419) 71 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 1.5 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 7.6 MiB/s rd, 16 MiB/s wr, 172 op/s 2024-05-09T00:08:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.735+0000 7fa75e2ac700 1 -- 172.21.15.26:0/2162538755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f7990 msgr2=0x7fa7580f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.735+0000 7fa75e2ac700 1 --2- 172.21.15.26:0/2162538755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f7990 0x7fa7580f7df0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa74c0047f0 tx=0x7fa74c009cb0).stop 2024-05-09T00:08:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.735+0000 7fa75e2ac700 1 -- 172.21.15.26:0/2162538755 shutdown_connections 2024-05-09T00:08:13.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.735+0000 7fa75e2ac700 1 --2- 172.21.15.26:0/2162538755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f7990 0x7fa7580f7df0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.735+0000 7fa75e2ac700 1 --2- 172.21.15.26:0/2162538755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7580f66f0 0x7fa7580f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.735+0000 7fa75e2ac700 1 -- 172.21.15.26:0/2162538755 >> 172.21.15.26:0/2162538755 conn(0x7fa7580f1e50 msgr2=0x7fa7580f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.735+0000 7fa75e2ac700 1 -- 172.21.15.26:0/2162538755 shutdown_connections 2024-05-09T00:08:13.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.735+0000 7fa75e2ac700 1 -- 172.21.15.26:0/2162538755 wait complete. 2024-05-09T00:08:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa75e2ac700 1 Processor -- start 2024-05-09T00:08:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa75e2ac700 1 -- start start 2024-05-09T00:08:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa75e2ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f66f0 0x7fa758106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa75e2ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7580f7990 0x7fa758107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:13.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa75e2ac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758107a00 con 0x7fa7580f66f0 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa75e2ac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758107b40 con 0x7fa7580f7990 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa757fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f66f0 0x7fa758106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa757fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f66f0 0x7fa758106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34982/0 (socket says 172.21.15.26:34982) 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa757fff700 1 -- 172.21.15.26:0/472039206 learned_addr learned my addr 172.21.15.26:0/472039206 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.736+0000 7fa7577fe700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7580f7990 0x7fa758107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.737+0000 7fa757fff700 1 -- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7580f7990 msgr2=0x7fa758107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.737+0000 7fa757fff700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7580f7990 0x7fa758107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.737+0000 7fa757fff700 1 -- 172.21.15.26:0/472039206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c005040 con 0x7fa7580f66f0 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.737+0000 7fa757fff700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f66f0 0x7fa758106f60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fa748010ad0 tx=0x7fa74800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.737+0000 7fa755775700 1 -- 172.21.15.26:0/472039206 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa748007d20 con 0x7fa7580f66f0 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.737+0000 7fa755775700 1 -- 172.21.15.26:0/472039206 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa748007e80 con 0x7fa7580f66f0 2024-05-09T00:08:13.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.737+0000 7fa755775700 1 -- 172.21.15.26:0/472039206 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa748012430 con 0x7fa7580f66f0 2024-05-09T00:08:13.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.738+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7580605f0 con 0x7fa7580f66f0 2024-05-09T00:08:13.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.738+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa758060b80 con 0x7fa7580f66f0 2024-05-09T00:08:13.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.739+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7580feeb0 con 0x7fa7580f66f0 2024-05-09T00:08:13.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.739+0000 7fa755775700 1 -- 172.21.15.26:0/472039206 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fa74800e7c0 con 0x7fa7580f66f0 2024-05-09T00:08:13.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.740+0000 7fa755775700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa740066dc0 0x7fa740069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:13.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.740+0000 7fa755775700 1 -- 172.21.15.26:0/472039206 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fa748085e00 con 0x7fa7580f66f0 2024-05-09T00:08:13.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.740+0000 7fa7577fe700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa740066dc0 0x7fa740069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:13.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.740+0000 7fa7577fe700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa740066dc0 0x7fa740069280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa74c0047c0 tx=0x7fa74c009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:13.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:13.745+0000 7fa755775700 1 -- 172.21.15.26:0/472039206 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7fa748053f20 con 0x7fa7580f66f0 2024-05-09T00:08:14.168 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:08:14.168 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:08:14.168 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:08:14.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:08:14.168 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:08:14.168 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-05-09T00:08:14.168 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:08:14.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:08:14.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.168+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa75810c520 con 0x7fa7580f66f0 2024-05-09T00:08:14.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.169+0000 7fa755775700 1 -- 172.21.15.26:0/472039206 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fa748053b10 con 0x7fa7580f66f0 2024-05-09T00:08:14.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.174+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa740066dc0 msgr2=0x7fa740069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.174+0000 7fa75e2ac700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa740066dc0 0x7fa740069280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa74c0047c0 tx=0x7fa74c009cb0).stop 2024-05-09T00:08:14.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.174+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f66f0 msgr2=0x7fa758106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.174+0000 7fa75e2ac700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f66f0 0x7fa758106f60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fa748010ad0 tx=0x7fa74800b040).stop 2024-05-09T00:08:14.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.175+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 shutdown_connections 2024-05-09T00:08:14.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.175+0000 7fa75e2ac700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fa740066dc0 0x7fa740069280 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0x7fa74c0047c0 tx=0x7fa74c009cb0).stop 2024-05-09T00:08:14.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.175+0000 7fa75e2ac700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7580f66f0 0x7fa758106f60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.175+0000 7fa75e2ac700 1 --2- 172.21.15.26:0/472039206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7580f7990 0x7fa758107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.175+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 >> 172.21.15.26:0/472039206 conn(0x7fa7580f1e50 msgr2=0x7fa7580fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.179+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 shutdown_connections 2024-05-09T00:08:14.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.180+0000 7fa75e2ac700 1 -- 172.21.15.26:0/472039206 wait complete. 2024-05-09T00:08:14.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.298+0000 7f899a7fe700 1 -- 172.21.15.26:0/917192446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 msgr2=0x7f89940fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.298+0000 7f899a7fe700 1 --2- 172.21.15.26:0/917192446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 0x7f89940fa3d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f89840047f0 tx=0x7f8984009cb0).stop 2024-05-09T00:08:14.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.298+0000 7f899a7fe700 1 -- 172.21.15.26:0/917192446 shutdown_connections 2024-05-09T00:08:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.298+0000 7f899a7fe700 1 --2- 172.21.15.26:0/917192446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89940fa950 0x7f89940fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.298+0000 7f899a7fe700 1 --2- 172.21.15.26:0/917192446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 0x7f89940fa3d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.298+0000 7f899a7fe700 1 -- 172.21.15.26:0/917192446 >> 172.21.15.26:0/917192446 conn(0x7f89940f1e50 msgr2=0x7f89940f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.298+0000 7f899a7fe700 1 -- 172.21.15.26:0/917192446 shutdown_connections 2024-05-09T00:08:14.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.298+0000 7f899a7fe700 1 -- 172.21.15.26:0/917192446 wait complete. 2024-05-09T00:08:14.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f899a7fe700 1 Processor -- start 2024-05-09T00:08:14.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f899a7fe700 1 -- start start 2024-05-09T00:08:14.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f899a7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 0x7f89940f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:14.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f899a7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89940fa950 0x7f89940f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:14.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f899a7fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89940f8220 con 0x7f8994061280 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f899a7fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89940f67c0 con 0x7f89940fa950 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f8993fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 0x7f89940f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f8993fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 0x7f89940f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35000/0 (socket says 172.21.15.26:35000) 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.299+0000 7f8993fff700 1 -- 172.21.15.26:0/206601045 learned_addr learned my addr 172.21.15.26:0/206601045 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f89937fe700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89940fa950 0x7f89940f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f8993fff700 1 -- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89940fa950 msgr2=0x7f89940f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f8993fff700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89940fa950 0x7f89940f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f8993fff700 1 -- 172.21.15.26:0/206601045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984005040 con 0x7f8994061280 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f8993fff700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 0x7f89940f7c70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f8984013560 tx=0x7f8984009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f89917fa700 1 -- 172.21.15.26:0/206601045 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8984018070 con 0x7f8994061280 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89940f69e0 con 0x7f8994061280 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f89917fa700 1 -- 172.21.15.26:0/206601045 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8984007e90 con 0x7f8994061280 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f89917fa700 1 -- 172.21.15.26:0/206601045 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898401c380 con 0x7f8994061280 2024-05-09T00:08:14.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.300+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89940f6f40 con 0x7f8994061280 2024-05-09T00:08:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.301+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89940fffe0 con 0x7f8994061280 2024-05-09T00:08:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.302+0000 7f89917fa700 1 -- 172.21.15.26:0/206601045 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f89840123c0 con 0x7f8994061280 2024-05-09T00:08:14.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.302+0000 7f89917fa700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f897c066dc0 0x7f897c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:14.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.302+0000 7f89917fa700 1 -- 172.21.15.26:0/206601045 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f89840850e0 con 0x7f8994061280 2024-05-09T00:08:14.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.303+0000 7f89937fe700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f897c066dc0 0x7f897c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.303+0000 7f89937fe700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f897c066dc0 0x7f897c069280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8994061050 tx=0x7f898800b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.307+0000 7f89917fa700 1 -- 172.21.15.26:0/206601045 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f8984053200 con 0x7f8994061280 2024-05-09T00:08:14.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.576+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8994101e50 con 0x7f8994061280 2024-05-09T00:08:14.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.576+0000 7f89917fa700 1 -- 172.21.15.26:0/206601045 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7f8984052df0 con 0x7f8994061280 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:08:14.573 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:08:14.574 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:08:14.575 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:08:14.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.578+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f897c066dc0 msgr2=0x7f897c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.578+0000 7f899a7fe700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f897c066dc0 0x7f897c069280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8994061050 tx=0x7f898800b040).stop 2024-05-09T00:08:14.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.578+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 msgr2=0x7f89940f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.578+0000 7f899a7fe700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 0x7f89940f7c70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f8984013560 tx=0x7f8984009cb0).stop 2024-05-09T00:08:14.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.579+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 shutdown_connections 2024-05-09T00:08:14.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.579+0000 7f899a7fe700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f897c066dc0 0x7f897c069280 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.579+0000 7f899a7fe700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8994061280 0x7f89940f7c70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.579+0000 7f899a7fe700 1 --2- 172.21.15.26:0/206601045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89940fa950 0x7f89940f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.579+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 >> 172.21.15.26:0/206601045 conn(0x7f89940f1e50 msgr2=0x7f89940f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.579+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 shutdown_connections 2024-05-09T00:08:14.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.579+0000 7f899a7fe700 1 -- 172.21.15.26:0/206601045 wait complete. 2024-05-09T00:08:14.577 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:08:14.602 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:12.661416+0000 mgr.smithi135.kkrhgf (mgr.24419) 72 : audit [DBG] from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:14.602 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:13.188192+0000 mgr.smithi135.kkrhgf (mgr.24419) 73 : audit [DBG] from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:14.602 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:14.170778+0000 mon.smithi026 (mon.0) 694 : audit [DBG] from='client.? 172.21.15.26:0/472039206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:08:14.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:12.661416+0000 mgr.smithi135.kkrhgf (mgr.24419) 72 : audit [DBG] from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:14.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:13.188192+0000 mgr.smithi135.kkrhgf (mgr.24419) 73 : audit [DBG] from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:14.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:14.170778+0000 mon.smithi026 (mon.0) 694 : audit [DBG] from='client.? 172.21.15.26:0/472039206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:08:14.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.694+0000 7f3bf4328700 1 -- 172.21.15.26:0/2230741443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 msgr2=0x7f3bec0f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.694+0000 7f3bf4328700 1 --2- 172.21.15.26:0/2230741443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 0x7f3bec0f7c20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f3be80047f0 tx=0x7f3be8009cb0).stop 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.694+0000 7f3bf4328700 1 -- 172.21.15.26:0/2230741443 shutdown_connections 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.694+0000 7f3bf4328700 1 --2- 172.21.15.26:0/2230741443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bec0f8aa0 0x7f3bec0f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.694+0000 7f3bf4328700 1 --2- 172.21.15.26:0/2230741443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 0x7f3bec0f7c20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.694+0000 7f3bf4328700 1 -- 172.21.15.26:0/2230741443 >> 172.21.15.26:0/2230741443 conn(0x7f3bec0f2f80 msgr2=0x7f3bec0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.694+0000 7f3bf4328700 1 -- 172.21.15.26:0/2230741443 shutdown_connections 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.694+0000 7f3bf4328700 1 -- 172.21.15.26:0/2230741443 wait complete. 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf4328700 1 Processor -- start 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf4328700 1 -- start start 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf4328700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 0x7f3bec06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf4328700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bec0f8aa0 0x7f3bec06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf4328700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec06cf80 con 0x7f3bec0f7800 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf4328700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec06b520 con 0x7f3bec0f8aa0 2024-05-09T00:08:14.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf20c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 0x7f3bec06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:14.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf20c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 0x7f3bec06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35010/0 (socket says 172.21.15.26:35010) 2024-05-09T00:08:14.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.695+0000 7f3bf20c4700 1 -- 172.21.15.26:0/3087541442 learned_addr learned my addr 172.21.15.26:0/3087541442 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:14.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3bf18c3700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bec0f8aa0 0x7f3bec06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3bf20c4700 1 -- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bec0f8aa0 msgr2=0x7f3bec06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3bf20c4700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bec0f8aa0 0x7f3bec06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3bf20c4700 1 -- 172.21.15.26:0/3087541442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc005040 con 0x7f3bec0f7800 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3bf20c4700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 0x7f3bec06c9d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f3be8013560 tx=0x7f3be8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3be37fe700 1 -- 172.21.15.26:0/3087541442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be8018070 con 0x7f3bec0f7800 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3be37fe700 1 -- 172.21.15.26:0/3087541442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3be8007e90 con 0x7f3bec0f7800 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be8005040 con 0x7f3bec0f7800 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3be37fe700 1 -- 172.21.15.26:0/3087541442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be801c380 con 0x7f3bec0f7800 2024-05-09T00:08:14.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.696+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec06bb10 con 0x7f3bec0f7800 2024-05-09T00:08:14.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.697+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec0fffc0 con 0x7f3bec0f7800 2024-05-09T00:08:14.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.705+0000 7f3be37fe700 1 -- 172.21.15.26:0/3087541442 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f3be80123c0 con 0x7f3bec0f7800 2024-05-09T00:08:14.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.705+0000 7f3be37fe700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f3bd8066dc0 0x7f3bd8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:14.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.705+0000 7f3be37fe700 1 -- 172.21.15.26:0/3087541442 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f3be80850f0 con 0x7f3bec0f7800 2024-05-09T00:08:14.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.705+0000 7f3be37fe700 1 -- 172.21.15.26:0/3087541442 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f3be8085650 con 0x7f3bec0f7800 2024-05-09T00:08:14.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.706+0000 7f3bf18c3700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f3bd8066dc0 0x7f3bd8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.707+0000 7f3bf18c3700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f3bd8066dc0 0x7f3bd8069280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3bdc009350 tx=0x7f3bdc00b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.979+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bec101f40 con 0x7f3bd8066dc0 2024-05-09T00:08:14.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.983+0000 7f3be37fe700 1 -- 172.21.15.26:0/3087541442 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3bec101f40 con 0x7f3bd8066dc0 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [], 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "1/21 daemons upgraded", 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "", 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:08:14.980 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:08:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.987+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f3bd8066dc0 msgr2=0x7f3bd8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.987+0000 7f3bf4328700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f3bd8066dc0 0x7f3bd8069280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3bdc009350 tx=0x7f3bdc00b040).stop 2024-05-09T00:08:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.987+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 msgr2=0x7f3bec06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.987+0000 7f3bf4328700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 0x7f3bec06c9d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f3be8013560 tx=0x7f3be8009cb0).stop 2024-05-09T00:08:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.989+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 shutdown_connections 2024-05-09T00:08:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.989+0000 7f3bf4328700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f3bd8066dc0 0x7f3bd8069280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.989+0000 7f3bf4328700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3bec0f7800 0x7f3bec06c9d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.989+0000 7f3bf4328700 1 --2- 172.21.15.26:0/3087541442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bec0f8aa0 0x7f3bec06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.989+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 >> 172.21.15.26:0/3087541442 conn(0x7f3bec0f2f80 msgr2=0x7f3bec0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.989+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 shutdown_connections 2024-05-09T00:08:14.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:14.989+0000 7f3bf4328700 1 -- 172.21.15.26:0/3087541442 wait complete. 2024-05-09T00:08:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.096+0000 7f1f32e84700 1 -- 172.21.15.26:0/567308338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f6a80 msgr2=0x7f1f2c0f6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.096+0000 7f1f32e84700 1 --2- 172.21.15.26:0/567308338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f6a80 0x7f1f2c0f6f00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1f18004870 tx=0x7f1f18009cb0).stop 2024-05-09T00:08:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.096+0000 7f1f32e84700 1 -- 172.21.15.26:0/567308338 shutdown_connections 2024-05-09T00:08:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.096+0000 7f1f32e84700 1 --2- 172.21.15.26:0/567308338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f6a80 0x7f1f2c0f6f00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.096+0000 7f1f32e84700 1 --2- 172.21.15.26:0/567308338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f2c0f7d70 0x7f1f2c0f8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.096+0000 7f1f32e84700 1 -- 172.21.15.26:0/567308338 >> 172.21.15.26:0/567308338 conn(0x7f1f2c0f15d0 msgr2=0x7f1f2c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.096+0000 7f1f32e84700 1 -- 172.21.15.26:0/567308338 shutdown_connections 2024-05-09T00:08:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.096+0000 7f1f32e84700 1 -- 172.21.15.26:0/567308338 wait complete. 2024-05-09T00:08:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f32e84700 1 Processor -- start 2024-05-09T00:08:15.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f32e84700 1 -- start start 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f32e84700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f2c0f6a80 0x7f1f2c10a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f32e84700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f7d70 0x7f1f2c10a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f32e84700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c10ad50 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f32e84700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c10ae90 con 0x7f1f2c0f6a80 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f30c20700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f2c0f6a80 0x7f1f2c10a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f30c20700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f2c0f6a80 0x7f1f2c10a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:59330/0 (socket says 172.21.15.26:59330) 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f30c20700 1 -- 172.21.15.26:0/2114813729 learned_addr learned my addr 172.21.15.26:0/2114813729 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.097+0000 7f1f2bfff700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f7d70 0x7f1f2c10a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f2bfff700 1 -- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f2c0f6a80 msgr2=0x7f1f2c10a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f2bfff700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f2c0f6a80 0x7f1f2c10a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f2bfff700 1 -- 172.21.15.26:0/2114813729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18005040 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f30c20700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f2c0f6a80 0x7f1f2c10a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f2bfff700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f7d70 0x7f1f2c10a7a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f1f18000c00 tx=0x7f1f18009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:15.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f29ffb700 1 -- 172.21.15.26:0/2114813729 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f18007b40 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f29ffb700 1 -- 172.21.15.26:0/2114813729 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f18007ca0 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c10f8d0 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f29ffb700 1 -- 172.21.15.26:0/2114813729 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f1801a430 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.098+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c10fe90 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.100+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c0fde50 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.100+0000 7f1f29ffb700 1 -- 172.21.15.26:0/2114813729 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f1f18018040 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.100+0000 7f1f29ffb700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f1f1c066dc0 0x7f1f1c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.100+0000 7f1f29ffb700 1 -- 172.21.15.26:0/2114813729 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f1f180854e0 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.101+0000 7f1f30c20700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f1f1c066dc0 0x7f1f1c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.101+0000 7f1f30c20700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f1f1c066dc0 0x7f1f1c069280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1f20004fd0 tx=0x7f1f2000b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:15.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.105+0000 7f1f29ffb700 1 -- 172.21.15.26:0/2114813729 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f1f18053580 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.490+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1f2c0ffcc0 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.490+0000 7f1f29ffb700 1 -- 172.21.15.26:0/2114813729 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1f18053170 con 0x7f1f2c0f7d70 2024-05-09T00:08:15.487 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:08:15.487 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:08:15.487 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:08:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f1f1c066dc0 msgr2=0x7f1f1c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f1f1c066dc0 0x7f1f1c069280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1f20004fd0 tx=0x7f1f2000b040).stop 2024-05-09T00:08:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f7d70 msgr2=0x7f1f2c10a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f7d70 0x7f1f2c10a7a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f1f18000c00 tx=0x7f1f18009cb0).stop 2024-05-09T00:08:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 shutdown_connections 2024-05-09T00:08:15.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f1f1c066dc0 0x7f1f1c069280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f2c0f6a80 0x7f1f2c10a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 --2- 172.21.15.26:0/2114813729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f2c0f7d70 0x7f1f2c10a7a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 >> 172.21.15.26:0/2114813729 conn(0x7f1f2c0f15d0 msgr2=0x7f1f2c0fb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 shutdown_connections 2024-05-09T00:08:15.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:15.493+0000 7f1f32e84700 1 -- 172.21.15.26:0/2114813729 wait complete. 2024-05-09T00:08:15.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:13.618357+0000 mgr.smithi135.kkrhgf (mgr.24419) 74 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:15.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:13.914369+0000 mgr.smithi135.kkrhgf (mgr.24419) 75 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 1.5 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 7.6 MiB/s rd, 16 MiB/s wr, 172 op/s 2024-05-09T00:08:15.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:14.577894+0000 mon.smithi026 (mon.0) 695 : audit [DBG] from='client.? 172.21.15.26:0/206601045' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:08:15.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:13.618357+0000 mgr.smithi135.kkrhgf (mgr.24419) 74 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:15.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:13.914369+0000 mgr.smithi135.kkrhgf (mgr.24419) 75 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 1.5 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 7.6 MiB/s rd, 16 MiB/s wr, 172 op/s 2024-05-09T00:08:15.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:14.577894+0000 mon.smithi026 (mon.0) 695 : audit [DBG] from='client.? 172.21.15.26:0/206601045' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:08:16.632 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:14.981642+0000 mgr.smithi135.kkrhgf (mgr.24419) 76 : audit [DBG] from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:16.632 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:15.491999+0000 mon.smithi026 (mon.0) 696 : audit [DBG] from='client.? 172.21.15.26:0/2114813729' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:08:16.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:14.981642+0000 mgr.smithi135.kkrhgf (mgr.24419) 76 : audit [DBG] from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:16.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:15.491999+0000 mon.smithi026 (mon.0) 696 : audit [DBG] from='client.? 172.21.15.26:0/2114813729' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:08:17.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:15.914814+0000 mgr.smithi135.kkrhgf (mgr.24419) 77 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 1.1 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 7.7 MiB/s rd, 17 MiB/s wr, 276 op/s 2024-05-09T00:08:17.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:15.914814+0000 mgr.smithi135.kkrhgf (mgr.24419) 77 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 1.1 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 7.7 MiB/s rd, 17 MiB/s wr, 276 op/s 2024-05-09T00:08:18.215 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:18.112177+0000 mon.smithi135 (mon.1) 63 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:08:18.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:18.112177+0000 mon.smithi135 (mon.1) 63 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:08:19.222 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:17.915292+0000 mgr.smithi135.kkrhgf (mgr.24419) 78 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 1.1 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 190 op/s 2024-05-09T00:08:19.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:17.915292+0000 mgr.smithi135.kkrhgf (mgr.24419) 78 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 1.1 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 190 op/s 2024-05-09T00:08:20.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:19.235384+0000 mon.smithi026 (mon.0) 697 : cluster [DBG] mgrmap e25: smithi135.kkrhgf(active, since 91s), standbys: smithi026.brymfp 2024-05-09T00:08:20.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:19.717219+0000 mon.smithi026 (mon.0) 698 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:20.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:19.722958+0000 mon.smithi026 (mon.0) 699 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:20.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:19.235384+0000 mon.smithi026 (mon.0) 697 : cluster [DBG] mgrmap e25: smithi135.kkrhgf(active, since 91s), standbys: smithi026.brymfp 2024-05-09T00:08:20.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:19.717219+0000 mon.smithi026 (mon.0) 698 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:20.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:19.722958+0000 mon.smithi026 (mon.0) 699 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:20.697 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T00:08:20.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T00:08:21.429 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:19.743701+0000 mgr.smithi135.kkrhgf (mgr.24419) 79 : cephadm [INF] Reconfiguring node-exporter.smithi026 (dependencies changed)... 2024-05-09T00:08:21.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:19.744053+0000 mgr.smithi135.kkrhgf (mgr.24419) 80 : cephadm [INF] Reconfiguring daemon node-exporter.smithi026 on smithi026 2024-05-09T00:08:21.430 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:19.915900+0000 mgr.smithi135.kkrhgf (mgr.24419) 81 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 552 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-05-09T00:08:21.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:19.743701+0000 mgr.smithi135.kkrhgf (mgr.24419) 79 : cephadm [INF] Reconfiguring node-exporter.smithi026 (dependencies changed)... 2024-05-09T00:08:21.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:19.744053+0000 mgr.smithi135.kkrhgf (mgr.24419) 80 : cephadm [INF] Reconfiguring daemon node-exporter.smithi026 on smithi026 2024-05-09T00:08:21.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:19.915900+0000 mgr.smithi135.kkrhgf (mgr.24419) 81 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 552 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-05-09T00:08:23.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:21.916248+0000 mgr.smithi135.kkrhgf (mgr.24419) 82 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 552 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-05-09T00:08:23.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:21.916248+0000 mgr.smithi135.kkrhgf (mgr.24419) 82 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 552 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-05-09T00:08:25.600 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:23.916562+0000 mgr.smithi135.kkrhgf (mgr.24419) 83 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 552 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-05-09T00:08:25.600 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:24.443948+0000 mon.smithi026 (mon.0) 700 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:25.600 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:24.449732+0000 mon.smithi026 (mon.0) 701 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:25.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:23.916562+0000 mgr.smithi135.kkrhgf (mgr.24419) 83 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 552 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-05-09T00:08:25.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:24.443948+0000 mon.smithi026 (mon.0) 700 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:25.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:24.449732+0000 mon.smithi026 (mon.0) 701 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:26.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:26 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:24.471038+0000 mgr.smithi135.kkrhgf (mgr.24419) 84 : cephadm [INF] Reconfiguring node-exporter.smithi135 (dependencies changed)... 2024-05-09T00:08:26.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:26 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:24.471365+0000 mgr.smithi135.kkrhgf (mgr.24419) 85 : cephadm [INF] Reconfiguring daemon node-exporter.smithi135 on smithi135 2024-05-09T00:08:26.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:26 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:24.471038+0000 mgr.smithi135.kkrhgf (mgr.24419) 84 : cephadm [INF] Reconfiguring node-exporter.smithi135 (dependencies changed)... 2024-05-09T00:08:26.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:26 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:24.471365+0000 mgr.smithi135.kkrhgf (mgr.24419) 85 : cephadm [INF] Reconfiguring daemon node-exporter.smithi135 on smithi135 2024-05-09T00:08:27.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:25.917261+0000 mgr.smithi135.kkrhgf (mgr.24419) 86 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.8 MiB/s wr, 351 op/s 2024-05-09T00:08:27.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:26.433180+0000 mon.smithi026 (mon.0) 702 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:27.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:26.438449+0000 mon.smithi026 (mon.0) 703 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:27.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:25.917261+0000 mgr.smithi135.kkrhgf (mgr.24419) 86 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.8 MiB/s wr, 351 op/s 2024-05-09T00:08:27.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:26.433180+0000 mon.smithi026 (mon.0) 702 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:27.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:26.438449+0000 mon.smithi026 (mon.0) 703 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:28.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:26.489733+0000 mgr.smithi135.kkrhgf (mgr.24419) 87 : cephadm [INF] Reconfiguring prometheus.smithi135 (dependencies changed)... 2024-05-09T00:08:28.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:26.712846+0000 mgr.smithi135.kkrhgf (mgr.24419) 88 : cephadm [INF] Reconfiguring daemon prometheus.smithi135 on smithi135 2024-05-09T00:08:28.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:26.489733+0000 mgr.smithi135.kkrhgf (mgr.24419) 87 : cephadm [INF] Reconfiguring prometheus.smithi135 (dependencies changed)... 2024-05-09T00:08:28.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:26.712846+0000 mgr.smithi135.kkrhgf (mgr.24419) 88 : cephadm [INF] Reconfiguring daemon prometheus.smithi135 on smithi135 2024-05-09T00:08:29.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:27.917592+0000 mgr.smithi135.kkrhgf (mgr.24419) 89 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 247 op/s 2024-05-09T00:08:29.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:27.917592+0000 mgr.smithi135.kkrhgf (mgr.24419) 89 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 247 op/s 2024-05-09T00:08:31.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:29.918032+0000 mgr.smithi135.kkrhgf (mgr.24419) 90 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.6 MiB/s wr, 270 op/s 2024-05-09T00:08:31.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:29.918032+0000 mgr.smithi135.kkrhgf (mgr.24419) 90 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.6 MiB/s wr, 270 op/s 2024-05-09T00:08:33.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:31.918325+0000 mgr.smithi135.kkrhgf (mgr.24419) 91 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 2.0 MiB/s wr, 152 op/s 2024-05-09T00:08:33.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:33.112289+0000 mon.smithi135 (mon.1) 64 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:08:33.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:31.918325+0000 mgr.smithi135.kkrhgf (mgr.24419) 91 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 2.0 MiB/s wr, 152 op/s 2024-05-09T00:08:33.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:33.112289+0000 mon.smithi135 (mon.1) 64 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:08:35.621 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:33.918689+0000 mgr.smithi135.kkrhgf (mgr.24419) 92 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 2.0 MiB/s wr, 152 op/s 2024-05-09T00:08:35.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:33.918689+0000 mgr.smithi135.kkrhgf (mgr.24419) 92 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 298 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 2.0 MiB/s wr, 152 op/s 2024-05-09T00:08:37.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:35.919234+0000 mgr.smithi135.kkrhgf (mgr.24419) 93 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 304 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 2.7 MiB/s wr, 276 op/s 2024-05-09T00:08:37.647 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:35.919234+0000 mgr.smithi135.kkrhgf (mgr.24419) 93 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 304 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 2.7 MiB/s wr, 276 op/s 2024-05-09T00:08:39.506 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:37.919522+0000 mgr.smithi135.kkrhgf (mgr.24419) 94 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 304 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 147 op/s 2024-05-09T00:08:39.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:37.919522+0000 mgr.smithi135.kkrhgf (mgr.24419) 94 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 304 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 147 op/s 2024-05-09T00:08:40.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.606206+0000 mon.smithi026 (mon.0) 704 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:40.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.611190+0000 mon.smithi026 (mon.0) 705 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:40.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.655718+0000 mon.smithi135 (mon.1) 65 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:08:40.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.656064+0000 mgr.smithi135.kkrhgf (mgr.24419) 95 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:08:40.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.659042+0000 mon.smithi135 (mon.1) 66 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:08:40.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.659338+0000 mgr.smithi135.kkrhgf (mgr.24419) 96 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:08:40.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.661510+0000 mon.smithi135 (mon.1) 67 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:08:40.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.661819+0000 mgr.smithi135.kkrhgf (mgr.24419) 97 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:08:40.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:39.667151+0000 mon.smithi135 (mon.1) 68 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:08:40.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:39.669176+0000 mgr.smithi135.kkrhgf (mgr.24419) 98 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi135.kkrhgf) 2024-05-09T00:08:40.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:39.669557+0000 mgr.smithi135.kkrhgf (mgr.24419) 99 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi135.kkrhgf) 2024-05-09T00:08:40.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:39.919936+0000 mgr.smithi135.kkrhgf (mgr.24419) 100 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 2.8 MiB/s wr, 311 op/s 2024-05-09T00:08:40.897 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.606206+0000 mon.smithi026 (mon.0) 704 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.611190+0000 mon.smithi026 (mon.0) 705 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.655718+0000 mon.smithi135 (mon.1) 65 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.656064+0000 mgr.smithi135.kkrhgf (mgr.24419) 95 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.659042+0000 mon.smithi135 (mon.1) 66 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.659338+0000 mgr.smithi135.kkrhgf (mgr.24419) 96 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.661510+0000 mon.smithi135 (mon.1) 67 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.661819+0000 mgr.smithi135.kkrhgf (mgr.24419) 97 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:39.667151+0000 mon.smithi135 (mon.1) 68 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:39.669176+0000 mgr.smithi135.kkrhgf (mgr.24419) 98 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi135.kkrhgf) 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:39.669557+0000 mgr.smithi135.kkrhgf (mgr.24419) 99 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi135.kkrhgf) 2024-05-09T00:08:40.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:39.919936+0000 mgr.smithi135.kkrhgf (mgr.24419) 100 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 2.8 MiB/s wr, 311 op/s 2024-05-09T00:08:43.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:42 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:41.920306+0000 mgr.smithi135.kkrhgf (mgr.24419) 101 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 288 op/s 2024-05-09T00:08:43.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:42 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:41.920306+0000 mgr.smithi135.kkrhgf (mgr.24419) 101 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 288 op/s 2024-05-09T00:08:44.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:43.043503+0000 mgr.smithi135.kkrhgf (mgr.24419) 102 : cephadm [INF] Upgrade: Updating mgr.smithi026.brymfp 2024-05-09T00:08:44.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:43.047714+0000 mon.smithi026 (mon.0) 706 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:44.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:43.048857+0000 mon.smithi135 (mon.1) 69 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.brymfp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:08:44.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:43.049127+0000 mon.smithi026 (mon.0) 707 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.brymfp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:08:44.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:43.049831+0000 mon.smithi135 (mon.1) 70 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:08:44.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:43.050435+0000 mon.smithi135 (mon.1) 71 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:08:44.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:08:43.051058+0000 mgr.smithi135.kkrhgf (mgr.24419) 103 : cephadm [INF] Deploying daemon mgr.smithi026.brymfp on smithi026 2024-05-09T00:08:44.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:43.043503+0000 mgr.smithi135.kkrhgf (mgr.24419) 102 : cephadm [INF] Upgrade: Updating mgr.smithi026.brymfp 2024-05-09T00:08:44.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:43.047714+0000 mon.smithi026 (mon.0) 706 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:43.048857+0000 mon.smithi135 (mon.1) 69 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.brymfp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:08:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:43.049127+0000 mon.smithi026 (mon.0) 707 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.brymfp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:08:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:43.049831+0000 mon.smithi135 (mon.1) 70 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:08:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:43.050435+0000 mon.smithi135 (mon.1) 71 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:08:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:44 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:08:43.051058+0000 mgr.smithi135.kkrhgf (mgr.24419) 103 : cephadm [INF] Deploying daemon mgr.smithi026.brymfp on smithi026 2024-05-09T00:08:45.051 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:43.920610+0000 mgr.smithi135.kkrhgf (mgr.24419) 104 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 288 op/s 2024-05-09T00:08:45.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:45 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:43.920610+0000 mgr.smithi135.kkrhgf (mgr.24419) 104 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 288 op/s 2024-05-09T00:08:45.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.629+0000 7fd5afc6e700 1 -- 172.21.15.26:0/163468053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 msgr2=0x7fd5a80fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.629+0000 7fd5afc6e700 1 --2- 172.21.15.26:0/163468053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 0x7fd5a80fa3d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fd5a40047f0 tx=0x7fd5a4009cb0).stop 2024-05-09T00:08:45.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.630+0000 7fd5afc6e700 1 -- 172.21.15.26:0/163468053 shutdown_connections 2024-05-09T00:08:45.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.630+0000 7fd5afc6e700 1 --2- 172.21.15.26:0/163468053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a80fa950 0x7fd5a80fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.630+0000 7fd5afc6e700 1 --2- 172.21.15.26:0/163468053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 0x7fd5a80fa3d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.630+0000 7fd5afc6e700 1 -- 172.21.15.26:0/163468053 >> 172.21.15.26:0/163468053 conn(0x7fd5a80f1e50 msgr2=0x7fd5a80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.630+0000 7fd5afc6e700 1 -- 172.21.15.26:0/163468053 shutdown_connections 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.630+0000 7fd5afc6e700 1 -- 172.21.15.26:0/163468053 wait complete. 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.630+0000 7fd5afc6e700 1 Processor -- start 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.630+0000 7fd5afc6e700 1 -- start start 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5afc6e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 0x7fd5a8107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5afc6e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a80fa950 0x7fd5a8108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5afc6e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8108a00 con 0x7fd5a8061280 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5afc6e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8108b40 con 0x7fd5a80fa950 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5ada0a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 0x7fd5a8107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:45.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5ada0a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 0x7fd5a8107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34954/0 (socket says 172.21.15.26:34954) 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5ada0a700 1 -- 172.21.15.26:0/3314028418 learned_addr learned my addr 172.21.15.26:0/3314028418 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5ad209700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a80fa950 0x7fd5a8108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5ada0a700 1 -- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a80fa950 msgr2=0x7fd5a8108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5ada0a700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a80fa950 0x7fd5a8108450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5ada0a700 1 -- 172.21.15.26:0/3314028418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4005040 con 0x7fd5a8061280 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5ada0a700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 0x7fd5a8107f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fd5a4013620 tx=0x7fd5a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd59effd700 1 -- 172.21.15.26:0/3314028418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a400e070 con 0x7fd5a8061280 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd59effd700 1 -- 172.21.15.26:0/3314028418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5a4007e90 con 0x7fd5a8061280 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a810d580 con 0x7fd5a8061280 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.631+0000 7fd59effd700 1 -- 172.21.15.26:0/3314028418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a4018070 con 0x7fd5a8061280 2024-05-09T00:08:45.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.632+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a810db40 con 0x7fd5a8061280 2024-05-09T00:08:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.633+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a80fffe0 con 0x7fd5a8061280 2024-05-09T00:08:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.633+0000 7fd59effd700 1 -- 172.21.15.26:0/3314028418 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7fd5a4012500 con 0x7fd5a8061280 2024-05-09T00:08:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.633+0000 7fd59effd700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fd594066ca0 0x7fd594069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.633+0000 7fd59effd700 1 -- 172.21.15.26:0/3314028418 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fd5a4084e40 con 0x7fd5a8061280 2024-05-09T00:08:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.634+0000 7fd5ad209700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fd594066ca0 0x7fd594069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:45.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.634+0000 7fd5ad209700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fd594066ca0 0x7fd594069160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd5a8061050 tx=0x7fd59800b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:45.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.638+0000 7fd59effd700 1 -- 172.21.15.26:0/3314028418 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7fd5a4053100 con 0x7fd5a8061280 2024-05-09T00:08:45.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.947+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5a8059120 con 0x7fd594066ca0 2024-05-09T00:08:45.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.948+0000 7fd59effd700 1 -- 172.21.15.26:0/3314028418 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fd5a8059120 con 0x7fd594066ca0 2024-05-09T00:08:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fd594066ca0 msgr2=0x7fd594069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fd594066ca0 0x7fd594069160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd5a8061050 tx=0x7fd59800b040).stop 2024-05-09T00:08:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 msgr2=0x7fd5a8107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 0x7fd5a8107f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fd5a4013620 tx=0x7fd5a4009cb0).stop 2024-05-09T00:08:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 shutdown_connections 2024-05-09T00:08:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fd594066ca0 0x7fd594069160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5a8061280 0x7fd5a8107f60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 --2- 172.21.15.26:0/3314028418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a80fa950 0x7fd5a8108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 >> 172.21.15.26:0/3314028418 conn(0x7fd5a80f1e50 msgr2=0x7fd5a80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 shutdown_connections 2024-05-09T00:08:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:45.952+0000 7fd5afc6e700 1 -- 172.21.15.26:0/3314028418 wait complete. 2024-05-09T00:08:45.963 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:08:46.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.078+0000 7f8651cc3700 1 -- 172.21.15.26:0/861282936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f66f0 msgr2=0x7f864c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.078+0000 7f8651cc3700 1 --2- 172.21.15.26:0/861282936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f66f0 0x7f864c0f6b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f863c0047f0 tx=0x7f863c009cb0).stop 2024-05-09T00:08:46.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.079+0000 7f8651cc3700 1 -- 172.21.15.26:0/861282936 shutdown_connections 2024-05-09T00:08:46.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.079+0000 7f8651cc3700 1 --2- 172.21.15.26:0/861282936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f864c0f7990 0x7f864c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.079+0000 7f8651cc3700 1 --2- 172.21.15.26:0/861282936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f66f0 0x7f864c0f6b10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.079+0000 7f8651cc3700 1 -- 172.21.15.26:0/861282936 >> 172.21.15.26:0/861282936 conn(0x7f864c0f1e50 msgr2=0x7f864c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:46.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.079+0000 7f8651cc3700 1 -- 172.21.15.26:0/861282936 shutdown_connections 2024-05-09T00:08:46.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.079+0000 7f8651cc3700 1 -- 172.21.15.26:0/861282936 wait complete. 2024-05-09T00:08:46.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f8651cc3700 1 Processor -- start 2024-05-09T00:08:46.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f8651cc3700 1 -- start start 2024-05-09T00:08:46.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f8651cc3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f864c0f66f0 0x7f864c110d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f8651cc3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f7990 0x7f864c111280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f8651cc3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0feca0 con 0x7f864c0f7990 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f8651cc3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c111770 con 0x7f864c0f66f0 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f864affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f7990 0x7f864c111280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f864affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f7990 0x7f864c111280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34978/0 (socket says 172.21.15.26:34978) 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f864affd700 1 -- 172.21.15.26:0/146301467 learned_addr learned my addr 172.21.15.26:0/146301467 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.080+0000 7f864b7fe700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f864c0f66f0 0x7f864c110d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f864affd700 1 -- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f864c0f66f0 msgr2=0x7f864c110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f864affd700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f864c0f66f0 0x7f864c110d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f864affd700 1 -- 172.21.15.26:0/146301467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c005040 con 0x7f864c0f7990 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f864affd700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f7990 0x7f864c111280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f86400041d0 tx=0x7f8640009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f8648ff9700 1 -- 172.21.15.26:0/146301467 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8640007b40 con 0x7f864c0f7990 2024-05-09T00:08:46.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f8648ff9700 1 -- 172.21.15.26:0/146301467 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f864000f040 con 0x7f864c0f7990 2024-05-09T00:08:46.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f8648ff9700 1 -- 172.21.15.26:0/146301467 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86400137d0 con 0x7f864c0f7990 2024-05-09T00:08:46.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c118210 con 0x7f864c0f7990 2024-05-09T00:08:46.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.081+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c118690 con 0x7f864c0f7990 2024-05-09T00:08:46.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.083+0000 7f8648ff9700 1 -- 172.21.15.26:0/146301467 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f8640013970 con 0x7f864c0f7990 2024-05-09T00:08:46.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.083+0000 7f8648ff9700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8634066ca0 0x7f8634069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.083+0000 7f8648ff9700 1 -- 172.21.15.26:0/146301467 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f8640083100 con 0x7f864c0f7990 2024-05-09T00:08:46.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.083+0000 7f864b7fe700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8634066ca0 0x7f8634069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.084+0000 7f864b7fe700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8634066ca0 0x7f8634069160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f863c0047c0 tx=0x7f863c009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.084+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c047540 con 0x7f864c0f7990 2024-05-09T00:08:46.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.089+0000 7f8648ff9700 1 -- 172.21.15.26:0/146301467 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f8640088060 con 0x7f864c0f7990 2024-05-09T00:08:46.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.403+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f864c059120 con 0x7f8634066ca0 2024-05-09T00:08:46.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.405+0000 7f8648ff9700 1 -- 172.21.15.26:0/146301467 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f864c059120 con 0x7f8634066ca0 2024-05-09T00:08:46.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8634066ca0 msgr2=0x7f8634069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8634066ca0 0x7f8634069160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f863c0047c0 tx=0x7f863c009cb0).stop 2024-05-09T00:08:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f7990 msgr2=0x7f864c111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f7990 0x7f864c111280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f86400041d0 tx=0x7f8640009f60).stop 2024-05-09T00:08:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 shutdown_connections 2024-05-09T00:08:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f8634066ca0 0x7f8634069160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f864c0f66f0 0x7f864c110d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 --2- 172.21.15.26:0/146301467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f864c0f7990 0x7f864c111280 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 >> 172.21.15.26:0/146301467 conn(0x7f864c0f1e50 msgr2=0x7f864c0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 shutdown_connections 2024-05-09T00:08:46.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.409+0000 7f8651cc3700 1 -- 172.21.15.26:0/146301467 wait complete. 2024-05-09T00:08:46.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.541+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/2681290663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f8920 msgr2=0x7f4d880f8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.541+0000 7f4d8d3ff700 1 --2- 172.21.15.26:0/2681290663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f8920 0x7f4d880f8d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f4d7c0047f0 tx=0x7f4d7c009cb0).stop 2024-05-09T00:08:46.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.541+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/2681290663 shutdown_connections 2024-05-09T00:08:46.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.541+0000 7f4d8d3ff700 1 --2- 172.21.15.26:0/2681290663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f8920 0x7f4d880f8d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.541+0000 7f4d8d3ff700 1 --2- 172.21.15.26:0/2681290663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d880f7680 0x7f4d880f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:08:46.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.541+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/2681290663 >> 172.21.15.26:0/2681290663 conn(0x7f4d880f2de0 msgr2=0x7f4d880f5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:46.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.541+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/2681290663 shutdown_connections 2024-05-09T00:08:46.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.541+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/2681290663 wait complete. 2024-05-09T00:08:46.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.542+0000 7f4d8d3ff700 1 Processor -- start 2024-05-09T00:08:46.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.542+0000 7f4d8d3ff700 1 -- start start 2024-05-09T00:08:46.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d8d3ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f7680 0x7f4d8806cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d8d3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d880f8920 0x7f4d8806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d8d3ff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8806b620 con 0x7f4d880f7680 2024-05-09T00:08:46.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d8d3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8806b760 con 0x7f4d880f8920 2024-05-09T00:08:46.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d86ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f7680 0x7f4d8806cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:46.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d86ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f7680 0x7f4d8806cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34988/0 (socket says 172.21.15.26:34988) 2024-05-09T00:08:46.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d86ffd700 1 -- 172.21.15.26:0/4253240466 learned_addr learned my addr 172.21.15.26:0/4253240466 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:46.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d867fc700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d880f8920 0x7f4d8806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:46.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d86ffd700 1 -- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d880f8920 msgr2=0x7f4d8806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d86ffd700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d880f8920 0x7f4d8806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d86ffd700 1 -- 172.21.15.26:0/4253240466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c005040 con 0x7f4d880f7680 2024-05-09T00:08:46.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d86ffd700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f7680 0x7f4d8806cbb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4d7800b480 tx=0x7f4d780090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d6ffff700 1 -- 172.21.15.26:0/4253240466 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d78002500 con 0x7f4d880f7680 2024-05-09T00:08:46.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.543+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8806ba40 con 0x7f4d880f7680 2024-05-09T00:08:46.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.544+0000 7f4d6ffff700 1 -- 172.21.15.26:0/4253240466 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d78002b10 con 0x7f4d880f7680 2024-05-09T00:08:46.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.544+0000 7f4d6ffff700 1 -- 172.21.15.26:0/4253240466 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d78012c60 con 0x7f4d880f7680 2024-05-09T00:08:46.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.544+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8810ffb0 con 0x7f4d880f7680 2024-05-09T00:08:46.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.545+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d88046ce0 con 0x7f4d880f7680 2024-05-09T00:08:46.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.546+0000 7f4d6ffff700 1 -- 172.21.15.26:0/4253240466 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f4d78002660 con 0x7f4d880f7680 2024-05-09T00:08:46.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.546+0000 7f4d6ffff700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4d70066ca0 0x7f4d70069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.546+0000 7f4d6ffff700 1 -- 172.21.15.26:0/4253240466 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f4d78084170 con 0x7f4d880f7680 2024-05-09T00:08:46.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.546+0000 7f4d867fc700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4d70066ca0 0x7f4d70069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.547+0000 7f4d867fc700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4d70066ca0 0x7f4d70069160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4d7c004f10 tx=0x7f4d7c00b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.551+0000 7f4d6ffff700 1 -- 172.21.15.26:0/4253240466 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f4d7804e940 con 0x7f4d880f7680 2024-05-09T00:08:46.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.848+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d88101ec0 con 0x7f4d70066ca0 2024-05-09T00:08:46.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.857+0000 7f4d6ffff700 1 -- 172.21.15.26:0/4253240466 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f4d88101ec0 con 0x7f4d70066ca0 2024-05-09T00:08:46.852 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:08:46.852 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 starting - - - - 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (9m) 111s ago 9m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (8m) 102s ago 8m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 starting - - - - 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (4m) 111s ago 4m 12.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (4m) 111s ago 4m 106M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (4m) 102s ago 4m 12.6M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (4m) 102s ago 4m 12.4M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:9283 running (10m) 111s ago 10m 320M - 16.2.15-1-g8963e9de 727f386679cb 405cee21e657 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (2m) 102s ago 8m 479M - 18.2.2-1322-gd21e4f96 af23193ff691 8681491889c9 2024-05-09T00:08:46.853 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (10m) 111s ago 11m 48.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (8m) 102s ago 8m 40.7M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 starting - - - - 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 starting - - - - 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (8m) 111s ago 8m 82.7M 1911M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (7m) 111s ago 7m 81.8M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (7m) 111s ago 7m 67.7M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (6m) 102s ago 6m 87.4M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (6m) 102s ago 6m 84.2M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (5m) 102s ago 5m 82.1M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:08:46.854 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 starting - - - - 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4d70066ca0 msgr2=0x7f4d70069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4d70066ca0 0x7f4d70069160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4d7c004f10 tx=0x7f4d7c00b040).stop 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f7680 msgr2=0x7f4d8806cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f7680 0x7f4d8806cbb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4d7800b480 tx=0x7f4d780090f0).stop 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 shutdown_connections 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f4d70066ca0 0x7f4d70069160 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d880f7680 0x7f4d8806cbb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 --2- 172.21.15.26:0/4253240466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d880f8920 0x7f4d8806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 >> 172.21.15.26:0/4253240466 conn(0x7f4d880f2de0 msgr2=0x7f4d880fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 shutdown_connections 2024-05-09T00:08:46.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.859+0000 7f4d8d3ff700 1 -- 172.21.15.26:0/4253240466 wait complete. 2024-05-09T00:08:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.971+0000 7f074b213700 1 -- 172.21.15.26:0/3072853302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0744061710 msgr2=0x7f07440fa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.971+0000 7f074b213700 1 --2- 172.21.15.26:0/3072853302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0744061710 0x7f07440fa4e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f07380047f0 tx=0x7f0738009cb0).stop 2024-05-09T00:08:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.971+0000 7f074b213700 1 -- 172.21.15.26:0/3072853302 shutdown_connections 2024-05-09T00:08:46.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.971+0000 7f074b213700 1 --2- 172.21.15.26:0/3072853302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07440fa9d0 0x7f07440fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:08:46.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.971+0000 7f074b213700 1 --2- 172.21.15.26:0/3072853302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0744061710 0x7f07440fa4e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.971+0000 7f074b213700 1 -- 172.21.15.26:0/3072853302 >> 172.21.15.26:0/3072853302 conn(0x7f07440f1ee0 msgr2=0x7f07440f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:46.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.972+0000 7f074b213700 1 -- 172.21.15.26:0/3072853302 shutdown_connections 2024-05-09T00:08:46.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.972+0000 7f074b213700 1 -- 172.21.15.26:0/3072853302 wait complete. 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.972+0000 7f074b213700 1 Processor -- start 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.972+0000 7f074b213700 1 -- start start 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f074b213700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744061710 0x7f0744108030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f074b213700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07440fa9d0 0x7f0744108520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f074b213700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0744108b60 con 0x7f07440fa9d0 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f074b213700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0744108ca0 con 0x7f0744061710 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f0743fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07440fa9d0 0x7f0744108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f0748faf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744061710 0x7f0744108030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:46.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f0743fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07440fa9d0 0x7f0744108520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35012/0 (socket says 172.21.15.26:35012) 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f0743fff700 1 -- 172.21.15.26:0/2108188805 learned_addr learned my addr 172.21.15.26:0/2108188805 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f0743fff700 1 -- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744061710 msgr2=0x7f0744108030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f0743fff700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744061710 0x7f0744108030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f0743fff700 1 -- 172.21.15.26:0/2108188805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738005040 con 0x7f07440fa9d0 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.973+0000 7f0743fff700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07440fa9d0 0x7f0744108520 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f073000b4b0 tx=0x7f07300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.974+0000 7f0741ffb700 1 -- 172.21.15.26:0/2108188805 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0730002500 con 0x7f07440fa9d0 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.974+0000 7f0741ffb700 1 -- 172.21.15.26:0/2108188805 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0730002b10 con 0x7f07440fa9d0 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.974+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074410d740 con 0x7f07440fa9d0 2024-05-09T00:08:46.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.974+0000 7f0741ffb700 1 -- 172.21.15.26:0/2108188805 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0730012bf0 con 0x7f07440fa9d0 2024-05-09T00:08:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.974+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074410dc80 con 0x7f07440fa9d0 2024-05-09T00:08:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.975+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0744100030 con 0x7f07440fa9d0 2024-05-09T00:08:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.976+0000 7f0741ffb700 1 -- 172.21.15.26:0/2108188805 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f0730002660 con 0x7f07440fa9d0 2024-05-09T00:08:46.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.976+0000 7f0741ffb700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f0734066ca0 0x7f0734069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.976+0000 7f0741ffb700 1 -- 172.21.15.26:0/2108188805 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f0730084130 con 0x7f07440fa9d0 2024-05-09T00:08:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.976+0000 7f0748faf700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f0734066ca0 0x7f0734069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:46.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.977+0000 7f0748faf700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f0734066ca0 0x7f0734069160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0738004f10 tx=0x7f0738009cb0).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:46.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:46.981+0000 7f0741ffb700 1 -- 172.21.15.26:0/2108188805 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f07300523f0 con 0x7f07440fa9d0 2024-05-09T00:08:47.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.293+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f07440598f0 con 0x7f07440fa9d0 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.293+0000 7f0741ffb700 1 -- 172.21.15.26:0/2108188805 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f0730051fe0 con 0x7f07440fa9d0 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:08:47.289 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:08:47.290 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:08:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.295+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f0734066ca0 msgr2=0x7f0734069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.295+0000 7f074b213700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f0734066ca0 0x7f0734069160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0738004f10 tx=0x7f0738009cb0).stop 2024-05-09T00:08:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.295+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07440fa9d0 msgr2=0x7f0744108520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.295+0000 7f074b213700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07440fa9d0 0x7f0744108520 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f073000b4b0 tx=0x7f07300090f0).stop 2024-05-09T00:08:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.296+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 shutdown_connections 2024-05-09T00:08:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.296+0000 7f074b213700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f0734066ca0 0x7f0734069160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.296+0000 7f074b213700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0744061710 0x7f0744108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.296+0000 7f074b213700 1 --2- 172.21.15.26:0/2108188805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07440fa9d0 0x7f0744108520 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.296+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 >> 172.21.15.26:0/2108188805 conn(0x7f07440f1ee0 msgr2=0x7f07440f42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:47.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.296+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 shutdown_connections 2024-05-09T00:08:47.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.296+0000 7f074b213700 1 -- 172.21.15.26:0/2108188805 wait complete. 2024-05-09T00:08:47.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:45.921065+0000 mgr.smithi135.kkrhgf (mgr.24419) 105 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 455 op/s 2024-05-09T00:08:47.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:45.948589+0000 mgr.smithi135.kkrhgf (mgr.24419) 106 : audit [DBG] from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:47.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:45.921065+0000 mgr.smithi135.kkrhgf (mgr.24419) 105 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 455 op/s 2024-05-09T00:08:47.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:47 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:45.948589+0000 mgr.smithi135.kkrhgf (mgr.24419) 106 : audit [DBG] from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:47.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.410+0000 7fe11d292700 1 -- 172.21.15.26:0/3206612488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f8cb0 msgr2=0x7fe1180f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.410+0000 7fe11d292700 1 --2- 172.21.15.26:0/3206612488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f8cb0 0x7fe1180f9110 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fe10c0047f0 tx=0x7fe10c009cb0).stop 2024-05-09T00:08:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.410+0000 7fe11d292700 1 -- 172.21.15.26:0/3206612488 shutdown_connections 2024-05-09T00:08:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.410+0000 7fe11d292700 1 --2- 172.21.15.26:0/3206612488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f8cb0 0x7fe1180f9110 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.410+0000 7fe11d292700 1 --2- 172.21.15.26:0/3206612488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1180f7a10 0x7fe1180f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.410+0000 7fe11d292700 1 -- 172.21.15.26:0/3206612488 >> 172.21.15.26:0/3206612488 conn(0x7fe1180f3150 msgr2=0x7fe1180f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.410+0000 7fe11d292700 1 -- 172.21.15.26:0/3206612488 shutdown_connections 2024-05-09T00:08:47.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.410+0000 7fe11d292700 1 -- 172.21.15.26:0/3206612488 wait complete. 2024-05-09T00:08:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe11d292700 1 Processor -- start 2024-05-09T00:08:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe11d292700 1 -- start start 2024-05-09T00:08:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe11d292700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f7a10 0x7fe118108270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe11d292700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1180f8cb0 0x7fe118108760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe11d292700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe118108d10 con 0x7fe1180f7a10 2024-05-09T00:08:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe11d292700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe118108e50 con 0x7fe1180f8cb0 2024-05-09T00:08:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe116ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f7a10 0x7fe118108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:47.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe116ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f7a10 0x7fe118108270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35030/0 (socket says 172.21.15.26:35030) 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe116ffd700 1 -- 172.21.15.26:0/1800017733 learned_addr learned my addr 172.21.15.26:0/1800017733 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe1167fc700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1180f8cb0 0x7fe118108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe116ffd700 1 -- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1180f8cb0 msgr2=0x7fe118108760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe116ffd700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1180f8cb0 0x7fe118108760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.411+0000 7fe116ffd700 1 -- 172.21.15.26:0/1800017733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c005040 con 0x7fe1180f7a10 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.412+0000 7fe116ffd700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f7a10 0x7fe118108270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fe10800e8c0 tx=0x7fe10800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:47.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.412+0000 7fe0fffff700 1 -- 172.21.15.26:0/1800017733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe10800ee60 con 0x7fe1180f7a10 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.412+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11810d8f0 con 0x7fe1180f7a10 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.412+0000 7fe0fffff700 1 -- 172.21.15.26:0/1800017733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe10800f040 con 0x7fe1180f7a10 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.412+0000 7fe0fffff700 1 -- 172.21.15.26:0/1800017733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe10800c7f0 con 0x7fe1180f7a10 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.413+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11810deb0 con 0x7fe1180f7a10 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.413+0000 7fe0fffff700 1 -- 172.21.15.26:0/1800017733 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7fe108007b40 con 0x7fe1180f7a10 2024-05-09T00:08:47.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.413+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11805fb50 con 0x7fe1180f7a10 2024-05-09T00:08:47.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.414+0000 7fe0fffff700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fe100066ca0 0x7fe100069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:47.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.414+0000 7fe0fffff700 1 -- 172.21.15.26:0/1800017733 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fe108083ce0 con 0x7fe1180f7a10 2024-05-09T00:08:47.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.414+0000 7fe1167fc700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fe100066ca0 0x7fe100069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.415+0000 7fe1167fc700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fe100066ca0 0x7fe100069160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe10c004540 tx=0x7fe10c00b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:47.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.423+0000 7fe0fffff700 1 -- 172.21.15.26:0/1800017733 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7fe108051fa0 con 0x7fe1180f7a10 2024-05-09T00:08:47.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.738+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe118102150 con 0x7fe1180f7a10 2024-05-09T00:08:47.776 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:08:47.776 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:08:47.776 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:08:47.776 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:08:47.776 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:08:47.777 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:08:47.778 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.739+0000 7fe0fffff700 1 -- 172.21.15.26:0/1800017733 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7fe108056e60 con 0x7fe1180f7a10 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fe100066ca0 msgr2=0x7fe100069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fe100066ca0 0x7fe100069160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe10c004540 tx=0x7fe10c00b040).stop 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f7a10 msgr2=0x7fe118108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f7a10 0x7fe118108270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fe10800e8c0 tx=0x7fe10800b040).stop 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 shutdown_connections 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7fe100066ca0 0x7fe100069160 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1180f7a10 0x7fe118108270 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 --2- 172.21.15.26:0/1800017733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1180f8cb0 0x7fe118108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 >> 172.21.15.26:0/1800017733 conn(0x7fe1180f3150 msgr2=0x7fe1180fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 shutdown_connections 2024-05-09T00:08:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.741+0000 7fe11d292700 1 -- 172.21.15.26:0/1800017733 wait complete. 2024-05-09T00:08:47.780 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:08:47.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.847+0000 7ff08f2ae700 1 -- 172.21.15.26:0/712118936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 msgr2=0x7ff0880f62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.847+0000 7ff08f2ae700 1 --2- 172.21.15.26:0/712118936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 0x7ff0880f62a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7ff0840047f0 tx=0x7ff084009cb0).stop 2024-05-09T00:08:47.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.847+0000 7ff08f2ae700 1 -- 172.21.15.26:0/712118936 shutdown_connections 2024-05-09T00:08:47.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.847+0000 7ff08f2ae700 1 --2- 172.21.15.26:0/712118936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0880f6790 0x7ff0880f71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.847+0000 7ff08f2ae700 1 --2- 172.21.15.26:0/712118936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 0x7ff0880f62a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.847+0000 7ff08f2ae700 1 -- 172.21.15.26:0/712118936 >> 172.21.15.26:0/712118936 conn(0x7ff0880f1680 msgr2=0x7ff0880f3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:47.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.847+0000 7ff08f2ae700 1 -- 172.21.15.26:0/712118936 shutdown_connections 2024-05-09T00:08:47.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.847+0000 7ff08f2ae700 1 -- 172.21.15.26:0/712118936 wait complete. 2024-05-09T00:08:47.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08f2ae700 1 Processor -- start 2024-05-09T00:08:47.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08f2ae700 1 -- start start 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08f2ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 0x7ff088108240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08f2ae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0880f6790 0x7ff088108730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08f2ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff088108ce0 con 0x7ff0880f5e80 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08f2ae700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff088108e20 con 0x7ff0880f6790 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08d04a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 0x7ff088108240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08d04a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 0x7ff088108240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35054/0 (socket says 172.21.15.26:35054) 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08d04a700 1 -- 172.21.15.26:0/3315354653 learned_addr learned my addr 172.21.15.26:0/3315354653 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08c849700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0880f6790 0x7ff088108730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:47.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08d04a700 1 -- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0880f6790 msgr2=0x7ff088108730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:47.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08d04a700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0880f6790 0x7ff088108730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:47.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.848+0000 7ff08d04a700 1 -- 172.21.15.26:0/3315354653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084005040 con 0x7ff0880f5e80 2024-05-09T00:08:47.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.849+0000 7ff08d04a700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 0x7ff088108240 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ff084013560 tx=0x7ff084009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:47.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.849+0000 7ff07e777700 1 -- 172.21.15.26:0/3315354653 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff084018070 con 0x7ff0880f5e80 2024-05-09T00:08:47.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.849+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08810d860 con 0x7ff0880f5e80 2024-05-09T00:08:47.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.849+0000 7ff07e777700 1 -- 172.21.15.26:0/3315354653 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff084007e90 con 0x7ff0880f5e80 2024-05-09T00:08:47.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.849+0000 7ff07e777700 1 -- 172.21.15.26:0/3315354653 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff08401c380 con 0x7ff0880f5e80 2024-05-09T00:08:47.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.849+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08810dda0 con 0x7ff0880f5e80 2024-05-09T00:08:47.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.850+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0880fe670 con 0x7ff0880f5e80 2024-05-09T00:08:47.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.851+0000 7ff07e777700 1 -- 172.21.15.26:0/3315354653 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7ff0840123c0 con 0x7ff0880f5e80 2024-05-09T00:08:47.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.851+0000 7ff07e777700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7ff074066ca0 0x7ff074069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:47.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.851+0000 7ff07e777700 1 -- 172.21.15.26:0/3315354653 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7ff084084ae0 con 0x7ff0880f5e80 2024-05-09T00:08:47.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.851+0000 7ff08c849700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7ff074066ca0 0x7ff074069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:47.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.852+0000 7ff08c849700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7ff074066ca0 0x7ff074069160 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff0780048b0 tx=0x7ff07800b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:47.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:47.861+0000 7ff07e777700 1 -- 172.21.15.26:0/3315354653 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7ff084052da0 con 0x7ff0880f5e80 2024-05-09T00:08:48.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.147+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 --> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0880f3850 con 0x7ff074066ca0 2024-05-09T00:08:48.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.148+0000 7ff07e777700 1 -- 172.21.15.26:0/3315354653 <== mgr.24419 v2:172.21.15.135:6828/2528047954 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7ff0880f3850 con 0x7ff074066ca0 2024-05-09T00:08:48.144 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:08:48.144 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:08:48.144 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:08:48.144 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:08:48.144 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [], 2024-05-09T00:08:48.144 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "1/21 daemons upgraded", 2024-05-09T00:08:48.144 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading mgr daemons", 2024-05-09T00:08:48.145 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:08:48.145 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:08:48.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.151+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7ff074066ca0 msgr2=0x7ff074069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.151+0000 7ff08f2ae700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7ff074066ca0 0x7ff074069160 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff0780048b0 tx=0x7ff07800b040).stop 2024-05-09T00:08:48.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.151+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 msgr2=0x7ff088108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.151+0000 7ff08f2ae700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 0x7ff088108240 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ff084013560 tx=0x7ff084009cb0).stop 2024-05-09T00:08:48.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.153+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 shutdown_connections 2024-05-09T00:08:48.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.153+0000 7ff08f2ae700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7ff074066ca0 0x7ff074069160 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:48.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.153+0000 7ff08f2ae700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0880f5e80 0x7ff088108240 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:48.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.153+0000 7ff08f2ae700 1 --2- 172.21.15.26:0/3315354653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0880f6790 0x7ff088108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:48.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.153+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 >> 172.21.15.26:0/3315354653 conn(0x7ff0880f1680 msgr2=0x7ff0880f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:48.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.153+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 shutdown_connections 2024-05-09T00:08:48.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.154+0000 7ff08f2ae700 1 -- 172.21.15.26:0/3315354653 wait complete. 2024-05-09T00:08:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.310+0000 7f62d7750700 1 -- 172.21.15.26:0/743525327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d006a7d0 msgr2=0x7f62d0068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.310+0000 7f62d7750700 1 --2- 172.21.15.26:0/743525327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d006a7d0 0x7f62d0068f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f62cc0047f0 tx=0x7f62cc009cb0).stop 2024-05-09T00:08:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.310+0000 7f62d7750700 1 -- 172.21.15.26:0/743525327 shutdown_connections 2024-05-09T00:08:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.310+0000 7f62d7750700 1 --2- 172.21.15.26:0/743525327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d00693f0 0x7f62d0069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.310+0000 7f62d7750700 1 --2- 172.21.15.26:0/743525327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d006a7d0 0x7f62d0068f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.310+0000 7f62d7750700 1 -- 172.21.15.26:0/743525327 >> 172.21.15.26:0/743525327 conn(0x7f62d0064880 msgr2=0x7f62d0066ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.311+0000 7f62d7750700 1 -- 172.21.15.26:0/743525327 shutdown_connections 2024-05-09T00:08:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.311+0000 7f62d7750700 1 -- 172.21.15.26:0/743525327 wait complete. 2024-05-09T00:08:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.311+0000 7f62d7750700 1 Processor -- start 2024-05-09T00:08:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.311+0000 7f62d7750700 1 -- start start 2024-05-09T00:08:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d7750700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d00693f0 0x7f62d0116eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d7750700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d006a7d0 0x7f62d01173a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d7750700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0117950 con 0x7f62d006a7d0 2024-05-09T00:08:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d7750700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0117a90 con 0x7f62d00693f0 2024-05-09T00:08:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d54ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d00693f0 0x7f62d0116eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d54ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d00693f0 0x7f62d0116eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:54216/0 (socket says 172.21.15.26:54216) 2024-05-09T00:08:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d54ec700 1 -- 172.21.15.26:0/2138551561 learned_addr learned my addr 172.21.15.26:0/2138551561 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:08:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d4ceb700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d006a7d0 0x7f62d01173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:08:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d54ec700 1 -- 172.21.15.26:0/2138551561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d006a7d0 msgr2=0x7f62d01173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d54ec700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d006a7d0 0x7f62d01173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.312+0000 7f62d54ec700 1 -- 172.21.15.26:0/2138551561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc005040 con 0x7f62d00693f0 2024-05-09T00:08:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.313+0000 7f62d54ec700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d00693f0 0x7f62d0116eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f62cc000c00 tx=0x7f62cc009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.313+0000 7f62c67fc700 1 -- 172.21.15.26:0/2138551561 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62cc018070 con 0x7f62d00693f0 2024-05-09T00:08:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.313+0000 7f62c67fc700 1 -- 172.21.15.26:0/2138551561 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62cc007e90 con 0x7f62d00693f0 2024-05-09T00:08:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.313+0000 7f62c67fc700 1 -- 172.21.15.26:0/2138551561 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62cc012620 con 0x7f62d00693f0 2024-05-09T00:08:48.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.314+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d011c4d0 con 0x7f62d00693f0 2024-05-09T00:08:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.314+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d011ca90 con 0x7f62d00693f0 2024-05-09T00:08:48.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.315+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d010edc0 con 0x7f62d00693f0 2024-05-09T00:08:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.315+0000 7f62c67fc700 1 -- 172.21.15.26:0/2138551561 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f62cc01d9d0 con 0x7f62d00693f0 2024-05-09T00:08:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.316+0000 7f62c67fc700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f62bc066ca0 0x7f62bc069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:08:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.316+0000 7f62c67fc700 1 -- 172.21.15.26:0/2138551561 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f62cc085130 con 0x7f62d00693f0 2024-05-09T00:08:48.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.316+0000 7f62d4ceb700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f62bc066ca0 0x7f62bc069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:48.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.316+0000 7f62d4ceb700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f62bc066ca0 0x7f62bc069160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f62c00048b0 tx=0x7f62c000b040).ready entity=mgr.24419 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:48.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:46.404972+0000 mgr.smithi135.kkrhgf (mgr.24419) 107 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:48.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:46.849570+0000 mgr.smithi135.kkrhgf (mgr.24419) 108 : audit [DBG] from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:48.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:47.293787+0000 mon.smithi026 (mon.0) 708 : audit [DBG] from='client.? 172.21.15.26:0/2108188805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:08:48.312 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:48 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:47.739370+0000 mon.smithi026 (mon.0) 709 : audit [DBG] from='client.? 172.21.15.26:0/1800017733' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:08:48.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.321+0000 7f62c67fc700 1 -- 172.21.15.26:0/2138551561 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f62cc053460 con 0x7f62d00693f0 2024-05-09T00:08:48.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:46.404972+0000 mgr.smithi135.kkrhgf (mgr.24419) 107 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:48.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:46.849570+0000 mgr.smithi135.kkrhgf (mgr.24419) 108 : audit [DBG] from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:48.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:47.293787+0000 mon.smithi026 (mon.0) 708 : audit [DBG] from='client.? 172.21.15.26:0/2108188805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:08:48.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:47.739370+0000 mon.smithi026 (mon.0) 709 : audit [DBG] from='client.? 172.21.15.26:0/1800017733' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:08:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.711+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f62d0110c30 con 0x7f62d00693f0 2024-05-09T00:08:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.712+0000 7f62c67fc700 1 -- 172.21.15.26:0/2138551561 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f62cc053050 con 0x7f62d00693f0 2024-05-09T00:08:48.707 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:08:48.708 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:08:48.708 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:08:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f62bc066ca0 msgr2=0x7f62bc069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f62bc066ca0 0x7f62bc069160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f62c00048b0 tx=0x7f62c000b040).stop 2024-05-09T00:08:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d00693f0 msgr2=0x7f62d0116eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d00693f0 0x7f62d0116eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f62cc000c00 tx=0x7f62cc009cb0).stop 2024-05-09T00:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 shutdown_connections 2024-05-09T00:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:6828/2528047954,v1:172.21.15.135:6829/2528047954] conn(0x7f62bc066ca0 0x7f62bc069160 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0x7f62c00048b0 tx=0x7f62c000b040).stop 2024-05-09T00:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d00693f0 0x7f62d0116eb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 --2- 172.21.15.26:0/2138551561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62d006a7d0 0x7f62d01173a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 >> 172.21.15.26:0/2138551561 conn(0x7f62d0064880 msgr2=0x7f62d0102510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 shutdown_connections 2024-05-09T00:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:08:48.714+0000 7f62d7750700 1 -- 172.21.15.26:0/2138551561 wait complete. 2024-05-09T00:08:49.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:47.921478+0000 mgr.smithi135.kkrhgf (mgr.24419) 109 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 331 op/s 2024-05-09T00:08:49.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:48.112413+0000 mon.smithi135 (mon.1) 72 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:08:49.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:48.148991+0000 mgr.smithi135.kkrhgf (mgr.24419) 110 : audit [DBG] from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:49.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:48.712428+0000 mon.smithi135 (mon.1) 73 : audit [DBG] from='client.? 172.21.15.26:0/2138551561' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:08:49.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:49.032202+0000 mon.smithi026 (mon.0) 710 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:49.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:49 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:49.038272+0000 mon.smithi026 (mon.0) 711 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:49.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:47.921478+0000 mgr.smithi135.kkrhgf (mgr.24419) 109 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 331 op/s 2024-05-09T00:08:49.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:48.112413+0000 mon.smithi135 (mon.1) 72 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:08:49.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:48.148991+0000 mgr.smithi135.kkrhgf (mgr.24419) 110 : audit [DBG] from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:08:49.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:48.712428+0000 mon.smithi135 (mon.1) 73 : audit [DBG] from='client.? 172.21.15.26:0/2138551561' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:08:49.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:49.032202+0000 mon.smithi026 (mon.0) 710 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:49.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:49 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:49.038272+0000 mon.smithi026 (mon.0) 711 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:50.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:49.076484+0000 mon.smithi135 (mon.1) 74 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:08:50.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:49.396270+0000 mon.smithi026 (mon.0) 712 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:50.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:50 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:49.401572+0000 mon.smithi026 (mon.0) 713 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:50.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:49.076484+0000 mon.smithi135 (mon.1) 74 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:08:50.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:49.396270+0000 mon.smithi026 (mon.0) 712 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:50.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:49.401572+0000 mon.smithi026 (mon.0) 713 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:51.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:49.921904+0000 mgr.smithi135.kkrhgf (mgr.24419) 111 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 488 op/s 2024-05-09T00:08:51.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:51 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:49.921904+0000 mgr.smithi135.kkrhgf (mgr.24419) 111 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 488 op/s 2024-05-09T00:08:53.310 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:51.922210+0000 mgr.smithi135.kkrhgf (mgr.24419) 112 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 324 op/s 2024-05-09T00:08:53.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:51.922210+0000 mgr.smithi135.kkrhgf (mgr.24419) 112 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 324 op/s 2024-05-09T00:08:54.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:53.089288+0000 mon.smithi026 (mon.0) 714 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:54.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:54 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:53.095404+0000 mon.smithi026 (mon.0) 715 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:54.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:53.089288+0000 mon.smithi026 (mon.0) 714 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:54.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:53.095404+0000 mon.smithi026 (mon.0) 715 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:55.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:53.922546+0000 mgr.smithi135.kkrhgf (mgr.24419) 113 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 324 op/s 2024-05-09T00:08:55.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:53.922546+0000 mgr.smithi135.kkrhgf (mgr.24419) 113 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 324 op/s 2024-05-09T00:08:57.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:55.923113+0000 mgr.smithi135.kkrhgf (mgr.24419) 114 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.1 MiB/s wr, 1.14k op/s 2024-05-09T00:08:57.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:56.989056+0000 mon.smithi026 (mon.0) 716 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:57.273 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:57 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:56.995372+0000 mon.smithi026 (mon.0) 717 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:57.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:55.923113+0000 mgr.smithi135.kkrhgf (mgr.24419) 114 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.1 MiB/s wr, 1.14k op/s 2024-05-09T00:08:57.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:56.989056+0000 mon.smithi026 (mon.0) 716 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:57.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:56.995372+0000 mon.smithi026 (mon.0) 717 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:58.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:57.442557+0000 mon.smithi026 (mon.0) 718 : cluster [DBG] Standby manager daemon smithi026.brymfp restarted 2024-05-09T00:08:58.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:57.442654+0000 mon.smithi026 (mon.0) 719 : cluster [DBG] Standby manager daemon smithi026.brymfp started 2024-05-09T00:08:58.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:57.445919+0000 mon.smithi026 (mon.0) 720 : audit [DBG] from='mgr.? 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.brymfp/crt"}]: dispatch 2024-05-09T00:08:58.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:57.446478+0000 mon.smithi026 (mon.0) 721 : audit [DBG] from='mgr.? 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:08:58.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:57.448766+0000 mon.smithi026 (mon.0) 722 : audit [DBG] from='mgr.? 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.brymfp/key"}]: dispatch 2024-05-09T00:08:58.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:57.450228+0000 mon.smithi026 (mon.0) 723 : audit [DBG] from='mgr.? 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:08:58.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:57.780133+0000 mon.smithi026 (mon.0) 724 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:58.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:58 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:08:57.785662+0000 mon.smithi026 (mon.0) 725 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:58.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:57.442557+0000 mon.smithi026 (mon.0) 718 : cluster [DBG] Standby manager daemon smithi026.brymfp restarted 2024-05-09T00:08:58.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:57.442654+0000 mon.smithi026 (mon.0) 719 : cluster [DBG] Standby manager daemon smithi026.brymfp started 2024-05-09T00:08:58.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:57.445919+0000 mon.smithi026 (mon.0) 720 : audit [DBG] from='mgr.? 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.brymfp/crt"}]: dispatch 2024-05-09T00:08:58.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:57.446478+0000 mon.smithi026 (mon.0) 721 : audit [DBG] from='mgr.? 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:08:58.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:57.448766+0000 mon.smithi026 (mon.0) 722 : audit [DBG] from='mgr.? 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi026.brymfp/key"}]: dispatch 2024-05-09T00:08:58.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:57.450228+0000 mon.smithi026 (mon.0) 723 : audit [DBG] from='mgr.? 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:08:58.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:57.780133+0000 mon.smithi026 (mon.0) 724 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:58.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:08:57.785662+0000 mon.smithi026 (mon.0) 725 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:08:59.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:57.923476+0000 mgr.smithi135.kkrhgf (mgr.24419) 115 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 973 op/s 2024-05-09T00:08:59.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:08:59 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:58.105398+0000 mon.smithi026 (mon.0) 726 : cluster [DBG] mgrmap e26: smithi135.kkrhgf(active, since 2m), standbys: smithi026.brymfp 2024-05-09T00:08:59.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:57.923476+0000 mgr.smithi135.kkrhgf (mgr.24419) 115 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 973 op/s 2024-05-09T00:08:59.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:08:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:58.105398+0000 mon.smithi026 (mon.0) 726 : cluster [DBG] mgrmap e26: smithi135.kkrhgf(active, since 2m), standbys: smithi026.brymfp 2024-05-09T00:09:01.107 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:01 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:08:59.923874+0000 mgr.smithi135.kkrhgf (mgr.24419) 116 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.0 MiB/s wr, 1.21k op/s 2024-05-09T00:09:01.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:08:59.923874+0000 mgr.smithi135.kkrhgf (mgr.24419) 116 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.0 MiB/s wr, 1.21k op/s 2024-05-09T00:09:03.362 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:01.924232+0000 mgr.smithi135.kkrhgf (mgr.24419) 117 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 1.05k op/s 2024-05-09T00:09:03.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:01.924232+0000 mgr.smithi135.kkrhgf (mgr.24419) 117 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 1.05k op/s 2024-05-09T00:09:04.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:03.112964+0000 mon.smithi135 (mon.1) 75 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:04.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:03.883639+0000 mon.smithi026 (mon.0) 727 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:09:04.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:03.895024+0000 mon.smithi026 (mon.0) 728 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:09:04.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:03.900033+0000 mon.smithi135 (mon.1) 76 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:04.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:03.900811+0000 mon.smithi135 (mon.1) 77 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:04.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:03.909315+0000 mon.smithi026 (mon.0) 729 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:09:04.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.048922+0000 mon.smithi135 (mon.1) 78 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.053733+0000 mon.smithi135 (mon.1) 79 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr fail", "who": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.053978+0000 mon.smithi026 (mon.0) 730 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr fail", "who": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:04.059498+0000 mon.smithi026 (mon.0) 731 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.059756+0000 mon.smithi026 (mon.0) 732 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd='[{"prefix": "mgr fail", "who": "smithi135.kkrhgf"}]': finished 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:04.059806+0000 mon.smithi026 (mon.0) 733 : cluster [DBG] mgrmap e27: smithi026.brymfp(active, starting, since 0.00544275s) 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.066847+0000 mon.smithi026 (mon.0) 734 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.067068+0000 mon.smithi026 (mon.0) 735 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.067406+0000 mon.smithi026 (mon.0) 736 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.067716+0000 mon.smithi026 (mon.0) 737 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.067956+0000 mon.smithi026 (mon.0) 738 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.068150+0000 mon.smithi026 (mon.0) 739 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.068369+0000 mon.smithi026 (mon.0) 740 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-09T00:09:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.068741+0000 mon.smithi026 (mon.0) 741 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.069065+0000 mon.smithi026 (mon.0) 742 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.069379+0000 mon.smithi026 (mon.0) 743 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.069714+0000 mon.smithi026 (mon.0) 744 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.070030+0000 mon.smithi026 (mon.0) 745 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.070345+0000 mon.smithi026 (mon.0) 746 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.070658+0000 mon.smithi026 (mon.0) 747 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.071083+0000 mon.smithi026 (mon.0) 748 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.071455+0000 mon.smithi026 (mon.0) 749 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:09:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:04 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:04.103843+0000 mon.smithi026 (mon.0) 750 : cluster [INF] Manager daemon smithi026.brymfp is now available 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:03.112964+0000 mon.smithi135 (mon.1) 75 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:03.883639+0000 mon.smithi026 (mon.0) 727 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:03.895024+0000 mon.smithi026 (mon.0) 728 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:03.900033+0000 mon.smithi135 (mon.1) 76 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:03.900811+0000 mon.smithi135 (mon.1) 77 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:03.909315+0000 mon.smithi026 (mon.0) 729 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.048922+0000 mon.smithi135 (mon.1) 78 : audit [DBG] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.053733+0000 mon.smithi135 (mon.1) 79 : audit [INF] from='mgr.24419 172.21.15.135:0/3985923625' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr fail", "who": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.053978+0000 mon.smithi026 (mon.0) 730 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "mgr fail", "who": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:04.059498+0000 mon.smithi026 (mon.0) 731 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.059756+0000 mon.smithi026 (mon.0) 732 : audit [INF] from='mgr.24419 ' entity='mgr.smithi135.kkrhgf' cmd='[{"prefix": "mgr fail", "who": "smithi135.kkrhgf"}]': finished 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:04.059806+0000 mon.smithi026 (mon.0) 733 : cluster [DBG] mgrmap e27: smithi026.brymfp(active, starting, since 0.00544275s) 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.066847+0000 mon.smithi026 (mon.0) 734 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:09:04.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.067068+0000 mon.smithi026 (mon.0) 735 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.067406+0000 mon.smithi026 (mon.0) 736 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.067716+0000 mon.smithi026 (mon.0) 737 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.067956+0000 mon.smithi026 (mon.0) 738 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.068150+0000 mon.smithi026 (mon.0) 739 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.068369+0000 mon.smithi026 (mon.0) 740 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.068741+0000 mon.smithi026 (mon.0) 741 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.069065+0000 mon.smithi026 (mon.0) 742 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.069379+0000 mon.smithi026 (mon.0) 743 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.069714+0000 mon.smithi026 (mon.0) 744 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.070030+0000 mon.smithi026 (mon.0) 745 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.070345+0000 mon.smithi026 (mon.0) 746 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.070658+0000 mon.smithi026 (mon.0) 747 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.071083+0000 mon.smithi026 (mon.0) 748 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:09:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.071455+0000 mon.smithi026 (mon.0) 749 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:09:04.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:04.103843+0000 mon.smithi026 (mon.0) 750 : cluster [INF] Manager daemon smithi026.brymfp is now available 2024-05-09T00:09:05.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.130766+0000 mon.smithi026 (mon.0) 751 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:05.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.155952+0000 mon.smithi026 (mon.0) 752 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:05.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.177129+0000 mon.smithi026 (mon.0) 753 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:09:05.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:04.194884+0000 mon.smithi026 (mon.0) 754 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-09T00:09:05.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:05.062939+0000 mon.smithi026 (mon.0) 755 : cluster [DBG] mgrmap e28: smithi026.brymfp(active, since 1.00857s) 2024-05-09T00:09:05.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.130766+0000 mon.smithi026 (mon.0) 751 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:05.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.155952+0000 mon.smithi026 (mon.0) 752 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:05.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.177129+0000 mon.smithi026 (mon.0) 753 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:09:05.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:04.194884+0000 mon.smithi026 (mon.0) 754 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-09T00:09:05.396 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:05 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:05.062939+0000 mon.smithi026 (mon.0) 755 : cluster [DBG] mgrmap e28: smithi026.brymfp(active, since 1.00857s) 2024-05-09T00:09:06.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:04.975100+0000 mgr.smithi026.brymfp (mgr.14750) 1 : cephadm [INF] [09/May/2024:00:09:04] ENGINE Bus STARTING 2024-05-09T00:09:06.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:05.075706+0000 mgr.smithi026.brymfp (mgr.14750) 2 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:06.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:05.095918+0000 mgr.smithi026.brymfp (mgr.14750) 3 : cephadm [INF] [09/May/2024:00:09:05] ENGINE Serving on https://172.21.15.26:7150 2024-05-09T00:09:06.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:05.196938+0000 mgr.smithi026.brymfp (mgr.14750) 4 : cephadm [INF] [09/May/2024:00:09:05] ENGINE Serving on http://172.21.15.26:8765 2024-05-09T00:09:06.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:06 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:05.197076+0000 mgr.smithi026.brymfp (mgr.14750) 5 : cephadm [INF] [09/May/2024:00:09:05] ENGINE Bus STARTED 2024-05-09T00:09:06.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:04.975100+0000 mgr.smithi026.brymfp (mgr.14750) 1 : cephadm [INF] [09/May/2024:00:09:04] ENGINE Bus STARTING 2024-05-09T00:09:06.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:05.075706+0000 mgr.smithi026.brymfp (mgr.14750) 2 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:06.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:05.095918+0000 mgr.smithi026.brymfp (mgr.14750) 3 : cephadm [INF] [09/May/2024:00:09:05] ENGINE Serving on https://172.21.15.26:7150 2024-05-09T00:09:06.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:05.196938+0000 mgr.smithi026.brymfp (mgr.14750) 4 : cephadm [INF] [09/May/2024:00:09:05] ENGINE Serving on http://172.21.15.26:8765 2024-05-09T00:09:06.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:06 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:05.197076+0000 mgr.smithi026.brymfp (mgr.14750) 5 : cephadm [INF] [09/May/2024:00:09:05] ENGINE Bus STARTED 2024-05-09T00:09:07.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:06.070524+0000 mgr.smithi026.brymfp (mgr.14750) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:07.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:07 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:06.122421+0000 mon.smithi026 (mon.0) 756 : cluster [DBG] mgrmap e29: smithi026.brymfp(active, since 2s) 2024-05-09T00:09:07.397 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:06.070524+0000 mgr.smithi026.brymfp (mgr.14750) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:07.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:07 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:06.122421+0000 mon.smithi026 (mon.0) 756 : cluster [DBG] mgrmap e29: smithi026.brymfp(active, since 2s) 2024-05-09T00:09:09.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:08.070878+0000 mgr.smithi026.brymfp (mgr.14750) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:09.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:08.132835+0000 mon.smithi026 (mon.0) 757 : cluster [DBG] mgrmap e30: smithi026.brymfp(active, since 4s) 2024-05-09T00:09:09.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:08.306246+0000 mon.smithi026 (mon.0) 758 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:09.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:08.311463+0000 mon.smithi026 (mon.0) 759 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:09.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:09.066683+0000 mon.smithi026 (mon.0) 760 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:09.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:09.071968+0000 mon.smithi026 (mon.0) 761 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:09.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:08.070878+0000 mgr.smithi026.brymfp (mgr.14750) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:09.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:08.132835+0000 mon.smithi026 (mon.0) 757 : cluster [DBG] mgrmap e30: smithi026.brymfp(active, since 4s) 2024-05-09T00:09:09.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:08.306246+0000 mon.smithi026 (mon.0) 758 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:09.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:08.311463+0000 mon.smithi026 (mon.0) 759 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:09.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:09.066683+0000 mon.smithi026 (mon.0) 760 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:09.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:09 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:09.071968+0000 mon.smithi026 (mon.0) 761 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:10.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:09.404453+0000 mon.smithi026 (mon.0) 762 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:10.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:09.408280+0000 mon.smithi026 (mon.0) 763 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:10.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:10.302279+0000 mon.smithi026 (mon.0) 764 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:10.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:10 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:10.306072+0000 mon.smithi026 (mon.0) 765 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:10.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:09.404453+0000 mon.smithi026 (mon.0) 762 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:10.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:09.408280+0000 mon.smithi026 (mon.0) 763 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:10.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:10.302279+0000 mon.smithi026 (mon.0) 764 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:10.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:10 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:10.306072+0000 mon.smithi026 (mon.0) 765 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:11.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:10.071259+0000 mgr.smithi026.brymfp (mgr.14750) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 872 KiB/s wr, 232 op/s 2024-05-09T00:09:11.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:10.071259+0000 mgr.smithi026.brymfp (mgr.14750) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 872 KiB/s wr, 232 op/s 2024-05-09T00:09:12.631 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:12.000667+0000 mon.smithi026 (mon.0) 766 : cluster [DBG] Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:09:12.631 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:12.002956+0000 mon.smithi135 (mon.1) 80 : audit [DBG] from='mgr.? 172.21.15.135:0/221896629' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:09:12.631 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:12.003406+0000 mon.smithi135 (mon.1) 81 : audit [DBG] from='mgr.? 172.21.15.135:0/221896629' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:09:12.632 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:12.005787+0000 mon.smithi135 (mon.1) 82 : audit [DBG] from='mgr.? 172.21.15.135:0/221896629' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/key"}]: dispatch 2024-05-09T00:09:12.632 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:12 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:12.006096+0000 mon.smithi135 (mon.1) 83 : audit [DBG] from='mgr.? 172.21.15.135:0/221896629' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:09:12.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:12.000667+0000 mon.smithi026 (mon.0) 766 : cluster [DBG] Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:09:12.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:12.002956+0000 mon.smithi135 (mon.1) 80 : audit [DBG] from='mgr.? 172.21.15.135:0/221896629' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:09:12.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:12.003406+0000 mon.smithi135 (mon.1) 81 : audit [DBG] from='mgr.? 172.21.15.135:0/221896629' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:09:12.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:12.005787+0000 mon.smithi135 (mon.1) 82 : audit [DBG] from='mgr.? 172.21.15.135:0/221896629' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/key"}]: dispatch 2024-05-09T00:09:12.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:12 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:12.006096+0000 mon.smithi135 (mon.1) 83 : audit [DBG] from='mgr.? 172.21.15.135:0/221896629' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:09:13.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:12.071804+0000 mgr.smithi026.brymfp (mgr.14750) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 456 op/s 2024-05-09T00:09:13.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:12.435988+0000 mon.smithi026 (mon.0) 767 : cluster [DBG] mgrmap e31: smithi026.brymfp(active, since 8s), standbys: smithi135.kkrhgf 2024-05-09T00:09:13.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:13 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:12.436120+0000 mon.smithi026 (mon.0) 768 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi135.kkrhgf", "id": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:13.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:12.071804+0000 mgr.smithi026.brymfp (mgr.14750) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 456 op/s 2024-05-09T00:09:13.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:12.435988+0000 mon.smithi026 (mon.0) 767 : cluster [DBG] mgrmap e31: smithi026.brymfp(active, since 8s), standbys: smithi135.kkrhgf 2024-05-09T00:09:13.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:12.436120+0000 mon.smithi026 (mon.0) 768 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi135.kkrhgf", "id": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:14.072180+0000 mgr.smithi026.brymfp (mgr.14750) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 945 KiB/s wr, 354 op/s 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:14.448741+0000 mon.smithi026 (mon.0) 769 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:14.453395+0000 mon.smithi026 (mon.0) 770 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:14.454725+0000 mon.smithi026 (mon.0) 771 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:14.455415+0000 mon.smithi026 (mon.0) 772 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:14.456555+0000 mgr.smithi026.brymfp (mgr.14750) 11 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:14.456744+0000 mgr.smithi026.brymfp (mgr.14750) 12 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:14.721681+0000 mgr.smithi026.brymfp (mgr.14750) 13 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:09:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:15 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:14.771376+0000 mgr.smithi026.brymfp (mgr.14750) 14 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:14.072180+0000 mgr.smithi026.brymfp (mgr.14750) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 945 KiB/s wr, 354 op/s 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:14.448741+0000 mon.smithi026 (mon.0) 769 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:14.453395+0000 mon.smithi026 (mon.0) 770 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:14.454725+0000 mon.smithi026 (mon.0) 771 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:14.455415+0000 mon.smithi026 (mon.0) 772 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:14.456555+0000 mgr.smithi026.brymfp (mgr.14750) 11 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:14.456744+0000 mgr.smithi026.brymfp (mgr.14750) 12 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:14.721681+0000 mgr.smithi026.brymfp (mgr.14750) 13 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:09:15.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:14.771376+0000 mgr.smithi026.brymfp (mgr.14750) 14 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:09:16.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:15.040064+0000 mgr.smithi026.brymfp (mgr.14750) 15 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:09:16.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:15.090123+0000 mgr.smithi026.brymfp (mgr.14750) 16 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:09:16.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:15.304076+0000 mgr.smithi026.brymfp (mgr.14750) 17 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:09:16.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:15.354320+0000 mgr.smithi026.brymfp (mgr.14750) 18 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:09:16.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:15.986275+0000 mon.smithi026 (mon.0) 773 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:15.997207+0000 mon.smithi026 (mon.0) 774 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:16.171426+0000 mon.smithi026 (mon.0) 775 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:16.181301+0000 mon.smithi026 (mon.0) 776 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:16 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:16.202997+0000 mon.smithi026 (mon.0) 777 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:15.040064+0000 mgr.smithi026.brymfp (mgr.14750) 15 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:15.090123+0000 mgr.smithi026.brymfp (mgr.14750) 16 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:15.304076+0000 mgr.smithi026.brymfp (mgr.14750) 17 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:15.354320+0000 mgr.smithi026.brymfp (mgr.14750) 18 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:15.986275+0000 mon.smithi026 (mon.0) 773 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:15.997207+0000 mon.smithi026 (mon.0) 774 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:16.171426+0000 mon.smithi026 (mon.0) 775 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:16.181301+0000 mon.smithi026 (mon.0) 776 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:16.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:16.202997+0000 mon.smithi026 (mon.0) 777 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:17.617 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:16.072668+0000 mgr.smithi026.brymfp (mgr.14750) 19 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 578 op/s 2024-05-09T00:09:17.617 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:16.342495+0000 mgr.smithi026.brymfp (mgr.14750) 20 : cephadm [INF] Reconfiguring prometheus.smithi135 (dependencies changed)... 2024-05-09T00:09:17.617 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:16.606855+0000 mgr.smithi026.brymfp (mgr.14750) 21 : cephadm [INF] Reconfiguring daemon prometheus.smithi135 on smithi135 2024-05-09T00:09:17.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:16.072668+0000 mgr.smithi026.brymfp (mgr.14750) 19 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 578 op/s 2024-05-09T00:09:17.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:16.342495+0000 mgr.smithi026.brymfp (mgr.14750) 20 : cephadm [INF] Reconfiguring prometheus.smithi135 (dependencies changed)... 2024-05-09T00:09:17.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:16.606855+0000 mgr.smithi026.brymfp (mgr.14750) 21 : cephadm [INF] Reconfiguring daemon prometheus.smithi135 on smithi135 2024-05-09T00:09:18.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.880+0000 7f9997db8700 1 -- 172.21.15.26:0/2044239175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999006a260 msgr2=0x7f9990103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:18.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.880+0000 7f9997db8700 1 --2- 172.21.15.26:0/2044239175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999006a260 0x7f9990103d00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f998c0048f0 tx=0x7f998c00adc0).stop 2024-05-09T00:09:18.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.880+0000 7f9997db8700 1 -- 172.21.15.26:0/2044239175 shutdown_connections 2024-05-09T00:09:18.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.880+0000 7f9997db8700 1 --2- 172.21.15.26:0/2044239175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999006a260 0x7f9990103d00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:18.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.880+0000 7f9997db8700 1 --2- 172.21.15.26:0/2044239175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9990069950 0x7f9990069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:09:18.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.880+0000 7f9997db8700 1 -- 172.21.15.26:0/2044239175 >> 172.21.15.26:0/2044239175 conn(0x7f9990064880 msgr2=0x7f9990066ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:18.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.883+0000 7f9997db8700 1 -- 172.21.15.26:0/2044239175 shutdown_connections 2024-05-09T00:09:18.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.883+0000 7f9997db8700 1 -- 172.21.15.26:0/2044239175 wait complete. 2024-05-09T00:09:18.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.883+0000 7f9997db8700 1 Processor -- start 2024-05-09T00:09:18.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.884+0000 7f9997db8700 1 -- start start 2024-05-09T00:09:18.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.884+0000 7f9997db8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9990069950 0x7f999010e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:18.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.884+0000 7f9997db8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999006a260 0x7f999010eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:18.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.884+0000 7f9997db8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999010f0e0 con 0x7f999006a260 2024-05-09T00:09:18.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.884+0000 7f9997db8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999010f220 con 0x7f9990069950 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.884+0000 7f9995b54700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9990069950 0x7f999010e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.884+0000 7f9995b54700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9990069950 0x7f999010e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:55672/0 (socket says 172.21.15.26:55672) 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.884+0000 7f9995b54700 1 -- 172.21.15.26:0/290992810 learned_addr learned my addr 172.21.15.26:0/290992810 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9995b54700 1 -- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999006a260 msgr2=0x7f999010eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9995b54700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999006a260 0x7f999010eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9995b54700 1 -- 172.21.15.26:0/290992810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c005040 con 0x7f9990069950 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9995b54700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9990069950 0x7f999010e5b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f998800bae0 tx=0x7f9988009810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9986ffd700 1 -- 172.21.15.26:0/290992810 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f998800caa0 con 0x7f9990069950 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9986ffd700 1 -- 172.21.15.26:0/290992810 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f998800cc00 con 0x7f9990069950 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9986ffd700 1 -- 172.21.15.26:0/290992810 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9988014610 con 0x7f9990069950 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9990111c50 con 0x7f9990069950 2024-05-09T00:09:18.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.885+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9990112190 con 0x7f9990069950 2024-05-09T00:09:18.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.888+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9974005150 con 0x7f9990069950 2024-05-09T00:09:18.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.888+0000 7f9986ffd700 1 -- 172.21.15.26:0/290992810 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 31) v1 ==== 90779+0+0 (secure 0 0 0) 0x7f9988012020 con 0x7f9990069950 2024-05-09T00:09:18.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.889+0000 7f9986ffd700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f997c06c8e0 0x7f997c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:18.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.889+0000 7f9986ffd700 1 -- 172.21.15.26:0/290992810 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f998808bd30 con 0x7f9990069950 2024-05-09T00:09:18.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.890+0000 7f9995353700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f997c06c8e0 0x7f997c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:18.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.893+0000 7f9995353700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f997c06c8e0 0x7f997c06eda0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f998c000c00 tx=0x7f998c00adc0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:18.897+0000 7f9986ffd700 1 -- 172.21.15.26:0/290992810 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f9988059c60 con 0x7f9990069950 2024-05-09T00:09:19.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.138+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 --> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9974000bf0 con 0x7f997c06c8e0 2024-05-09T00:09:19.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.140+0000 7f9986ffd700 1 -- 172.21.15.26:0/290992810 <== mgr.14750 v2:172.21.15.26:6800/3811609814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9974000bf0 con 0x7f997c06c8e0 2024-05-09T00:09:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f997c06c8e0 msgr2=0x7f997c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f997c06c8e0 0x7f997c06eda0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f998c000c00 tx=0x7f998c00adc0).stop 2024-05-09T00:09:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9990069950 msgr2=0x7f999010e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9990069950 0x7f999010e5b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f998800bae0 tx=0x7f9988009810).stop 2024-05-09T00:09:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 shutdown_connections 2024-05-09T00:09:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f997c06c8e0 0x7f997c06eda0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9990069950 0x7f999010e5b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 --2- 172.21.15.26:0/290992810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f999006a260 0x7f999010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:09:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 >> 172.21.15.26:0/290992810 conn(0x7f9990064880 msgr2=0x7f9990101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 shutdown_connections 2024-05-09T00:09:19.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.142+0000 7f9997db8700 1 -- 172.21.15.26:0/290992810 wait complete. 2024-05-09T00:09:19.149 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:09:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.266+0000 7f72bb2f5700 1 -- 172.21.15.26:0/2596591587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 msgr2=0x7f72b40f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.266+0000 7f72bb2f5700 1 --2- 172.21.15.26:0/2596591587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 0x7f72b40f8bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f72a40047f0 tx=0x7f72a4009cb0).stop 2024-05-09T00:09:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.266+0000 7f72bb2f5700 1 -- 172.21.15.26:0/2596591587 shutdown_connections 2024-05-09T00:09:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.266+0000 7f72bb2f5700 1 --2- 172.21.15.26:0/2596591587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 0x7f72b40f8bd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.266+0000 7f72bb2f5700 1 --2- 172.21.15.26:0/2596591587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b40f5ab0 0x7f72b40f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.266+0000 7f72bb2f5700 1 -- 172.21.15.26:0/2596591587 >> 172.21.15.26:0/2596591587 conn(0x7f72b40f15d0 msgr2=0x7f72b40f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:19.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.266+0000 7f72bb2f5700 1 -- 172.21.15.26:0/2596591587 shutdown_connections 2024-05-09T00:09:19.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.266+0000 7f72bb2f5700 1 -- 172.21.15.26:0/2596591587 wait complete. 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72bb2f5700 1 Processor -- start 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72bb2f5700 1 -- start start 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72bb2f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b40f5ab0 0x7f72b41080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72bb2f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 0x7f72b41085b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72bb2f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4108b60 con 0x7f72b40f6450 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72bb2f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4108ca0 con 0x7f72b40f5ab0 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72b8890700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 0x7f72b41085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72b9091700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b40f5ab0 0x7f72b41080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:19.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72b8890700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 0x7f72b41085b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60192/0 (socket says 172.21.15.26:60192) 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.267+0000 7f72b8890700 1 -- 172.21.15.26:0/842649195 learned_addr learned my addr 172.21.15.26:0/842649195 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72b9091700 1 -- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 msgr2=0x7f72b41085b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72b9091700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 0x7f72b41085b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72b9091700 1 -- 172.21.15.26:0/842649195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4005040 con 0x7f72b40f5ab0 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72b9091700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b40f5ab0 0x7f72b41080c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f72b000e840 tx=0x7f72b000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72aa7fc700 1 -- 172.21.15.26:0/842649195 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b0007b40 con 0x7f72b40f5ab0 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72aa7fc700 1 -- 172.21.15.26:0/842649195 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f72b000f040 con 0x7f72b40f5ab0 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72aa7fc700 1 -- 172.21.15.26:0/842649195 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b0014860 con 0x7f72b40f5ab0 2024-05-09T00:09:19.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b410d740 con 0x7f72b40f5ab0 2024-05-09T00:09:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.268+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b410dd00 con 0x7f72b40f5ab0 2024-05-09T00:09:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.269+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b40ffff0 con 0x7f72b40f5ab0 2024-05-09T00:09:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.270+0000 7f72aa7fc700 1 -- 172.21.15.26:0/842649195 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 31) v1 ==== 90779+0+0 (secure 0 0 0) 0x7f72b0007ca0 con 0x7f72b40f5ab0 2024-05-09T00:09:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.271+0000 7f72aa7fc700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f72a006c7c0 0x7f72a006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.271+0000 7f72aa7fc700 1 -- 172.21.15.26:0/842649195 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f72b008b210 con 0x7f72b40f5ab0 2024-05-09T00:09:19.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.271+0000 7f72b8890700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f72a006c7c0 0x7f72a006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:19.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.271+0000 7f72b8890700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f72a006c7c0 0x7f72a006ec80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f72a4004540 tx=0x7f72a400b040).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:19.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.277+0000 7f72aa7fc700 1 -- 172.21.15.26:0/842649195 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f72b00590f0 con 0x7f72b40f5ab0 2024-05-09T00:09:19.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.506+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 --> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72b4059120 con 0x7f72a006c7c0 2024-05-09T00:09:19.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.507+0000 7f72aa7fc700 1 -- 172.21.15.26:0/842649195 <== mgr.14750 v2:172.21.15.26:6800/3811609814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f72b4059120 con 0x7f72a006c7c0 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f72a006c7c0 msgr2=0x7f72a006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f72a006c7c0 0x7f72a006ec80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f72a4004540 tx=0x7f72a400b040).stop 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b40f5ab0 msgr2=0x7f72b41080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b40f5ab0 0x7f72b41080c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f72b000e840 tx=0x7f72b000b040).stop 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 shutdown_connections 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f72a006c7c0 0x7f72a006ec80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b40f5ab0 0x7f72b41080c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 --2- 172.21.15.26:0/842649195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72b40f6450 0x7f72b41085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 >> 172.21.15.26:0/842649195 conn(0x7f72b40f15d0 msgr2=0x7f72b40fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 shutdown_connections 2024-05-09T00:09:19.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.511+0000 7f72bb2f5700 1 -- 172.21.15.26:0/842649195 wait complete. 2024-05-09T00:09:19.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 -- 172.21.15.26:0/2539006683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f66f0 msgr2=0x7f52d00f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 --2- 172.21.15.26:0/2539006683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f66f0 0x7f52d00f6b10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f52cc0047f0 tx=0x7f52cc009cb0).stop 2024-05-09T00:09:19.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 -- 172.21.15.26:0/2539006683 shutdown_connections 2024-05-09T00:09:19.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 --2- 172.21.15.26:0/2539006683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d00f7990 0x7f52d00f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 --2- 172.21.15.26:0/2539006683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f66f0 0x7f52d00f6b10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 -- 172.21.15.26:0/2539006683 >> 172.21.15.26:0/2539006683 conn(0x7f52d00f1e50 msgr2=0x7f52d00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:19.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 -- 172.21.15.26:0/2539006683 shutdown_connections 2024-05-09T00:09:19.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 -- 172.21.15.26:0/2539006683 wait complete. 2024-05-09T00:09:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.633+0000 7f52d7e1e700 1 Processor -- start 2024-05-09T00:09:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d7e1e700 1 -- start start 2024-05-09T00:09:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d7e1e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d00f66f0 0x7f52d0106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d7e1e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f7990 0x7f52d0107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:19.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d7e1e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0107930 con 0x7f52d00f7990 2024-05-09T00:09:19.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d7e1e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0107a70 con 0x7f52d00f66f0 2024-05-09T00:09:19.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d53b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f7990 0x7f52d0107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:19.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d53b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f7990 0x7f52d0107380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60204/0 (socket says 172.21.15.26:60204) 2024-05-09T00:09:19.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d53b9700 1 -- 172.21.15.26:0/970445828 learned_addr learned my addr 172.21.15.26:0/970445828 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:19.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d5bba700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d00f66f0 0x7f52d0106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:19.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d53b9700 1 -- 172.21.15.26:0/970445828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d00f66f0 msgr2=0x7f52d0106e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d53b9700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d00f66f0 0x7f52d0106e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d53b9700 1 -- 172.21.15.26:0/970445828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc005040 con 0x7f52d00f7990 2024-05-09T00:09:19.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.634+0000 7f52d53b9700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f7990 0x7f52d0107380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f52c00041d0 tx=0x7f52c0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:19.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.635+0000 7f52c6ffd700 1 -- 172.21.15.26:0/970445828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52c0007b40 con 0x7f52d00f7990 2024-05-09T00:09:19.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.635+0000 7f52c6ffd700 1 -- 172.21.15.26:0/970445828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f52c000f040 con 0x7f52d00f7990 2024-05-09T00:09:19.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.635+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00605f0 con 0x7f52d00f7990 2024-05-09T00:09:19.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.635+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d0060bb0 con 0x7f52d00f7990 2024-05-09T00:09:19.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.635+0000 7f52c6ffd700 1 -- 172.21.15.26:0/970445828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52c00147b0 con 0x7f52d00f7990 2024-05-09T00:09:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.636+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b4005150 con 0x7f52d00f7990 2024-05-09T00:09:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.636+0000 7f52c6ffd700 1 -- 172.21.15.26:0/970445828 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 31) v1 ==== 90779+0+0 (secure 0 0 0) 0x7f52c0007ca0 con 0x7f52d00f7990 2024-05-09T00:09:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.637+0000 7f52c6ffd700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f52bc06c7c0 0x7f52bc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.637+0000 7f52c6ffd700 1 -- 172.21.15.26:0/970445828 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f52c008ba40 con 0x7f52d00f7990 2024-05-09T00:09:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.637+0000 7f52d5bba700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f52bc06c7c0 0x7f52bc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.638+0000 7f52d5bba700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f52bc06c7c0 0x7f52bc06ec80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f52cc004f10 tx=0x7f52cc00b040).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.642+0000 7f52c6ffd700 1 -- 172.21.15.26:0/970445828 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f52c00598a0 con 0x7f52d00f7990 2024-05-09T00:09:19.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:18.072962+0000 mgr.smithi026.brymfp (mgr.14750) 22 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.3 MiB/s wr, 530 op/s 2024-05-09T00:09:19.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:19.156553+0000 mon.smithi026 (mon.0) 778 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:19.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:18.072962+0000 mgr.smithi026.brymfp (mgr.14750) 22 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.3 MiB/s wr, 530 op/s 2024-05-09T00:09:19.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:19.156553+0000 mon.smithi026 (mon.0) 778 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:19.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.943+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 --> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f52b4000bf0 con 0x7f52bc06c7c0 2024-05-09T00:09:19.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.963+0000 7f52c6ffd700 1 -- 172.21.15.26:0/970445828 <== mgr.14750 v2:172.21.15.26:6800/3811609814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f52b4000bf0 con 0x7f52bc06c7c0 2024-05-09T00:09:19.961 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:09:19.961 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (78s) 10s ago 10m 15.6M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:09:19.961 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (10m) 10s ago 9m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:09:19.961 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (9m) 11s ago 9m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (60s) 10s ago 9m 45.4M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (4m) 10s ago 4m 13.9M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (4m) 10s ago 4m 213M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (4m) 11s ago 4m 13.8M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (4m) 11s ago 4m 13.5M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (33s) 10s ago 11m 469M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283 running (2m) 11s ago 9m 65.9M - 18.2.2-1322-gd21e4f96 af23193ff691 8681491889c9 2024-05-09T00:09:19.962 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (11m) 10s ago 11m 48.0M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:09:19.963 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (9m) 11s ago 9m 44.8M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:09:19.963 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (58s) 10s ago 9m 16.3M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:09:19.963 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (54s) 11s ago 9m 21.4M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:09:19.963 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (8m) 10s ago 8m 214M 1911M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:09:19.963 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (8m) 10s ago 8m 231M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:09:19.963 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (7m) 10s ago 7m 191M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:09:19.963 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (7m) 11s ago 7m 262M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:09:19.964 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (6m) 11s ago 6m 225M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:09:19.964 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (6m) 11s ago 6m 218M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:09:19.964 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (40s) 11s ago 8m 49.4M - 2.33.4 514e6a882f6e da5643014a1d 2024-05-09T00:09:19.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f52bc06c7c0 msgr2=0x7f52bc06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f52bc06c7c0 0x7f52bc06ec80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f52cc004f10 tx=0x7f52cc00b040).stop 2024-05-09T00:09:19.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f7990 msgr2=0x7f52d0107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:19.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f7990 0x7f52d0107380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f52c00041d0 tx=0x7f52c0009f60).stop 2024-05-09T00:09:19.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 shutdown_connections 2024-05-09T00:09:19.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f52bc06c7c0 0x7f52bc06ec80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d00f66f0 0x7f52d0106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 --2- 172.21.15.26:0/970445828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52d00f7990 0x7f52d0107380 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:19.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 >> 172.21.15.26:0/970445828 conn(0x7f52d00f1e50 msgr2=0x7f52d00fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:19.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 shutdown_connections 2024-05-09T00:09:19.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:19.966+0000 7f52d7e1e700 1 -- 172.21.15.26:0/970445828 wait complete. 2024-05-09T00:09:20.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.079+0000 7f4ca0b61700 1 -- 172.21.15.26:0/4162014400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f8aa0 msgr2=0x7f4c9c0f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.079+0000 7f4ca0b61700 1 --2- 172.21.15.26:0/4162014400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f8aa0 0x7f4c9c0f8f00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f4c900047f0 tx=0x7f4c90009cb0).stop 2024-05-09T00:09:20.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.080+0000 7f4ca0b61700 1 -- 172.21.15.26:0/4162014400 shutdown_connections 2024-05-09T00:09:20.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.080+0000 7f4ca0b61700 1 --2- 172.21.15.26:0/4162014400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f8aa0 0x7f4c9c0f8f00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:20.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.080+0000 7f4ca0b61700 1 --2- 172.21.15.26:0/4162014400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c9c0f7800 0x7f4c9c0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:20.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.080+0000 7f4ca0b61700 1 -- 172.21.15.26:0/4162014400 >> 172.21.15.26:0/4162014400 conn(0x7f4c9c0f2f80 msgr2=0x7f4c9c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.080+0000 7f4ca0b61700 1 -- 172.21.15.26:0/4162014400 shutdown_connections 2024-05-09T00:09:20.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.080+0000 7f4ca0b61700 1 -- 172.21.15.26:0/4162014400 wait complete. 2024-05-09T00:09:20.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.080+0000 7f4ca0b61700 1 Processor -- start 2024-05-09T00:09:20.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4ca0b61700 1 -- start start 2024-05-09T00:09:20.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4ca0b61700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f7800 0x7f4c9c108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:20.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4ca0b61700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c9c0f8aa0 0x7f4c9c108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4ca0b61700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c108ae0 con 0x7f4c9c0f7800 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4ca0b61700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c108c20 con 0x7f4c9c0f8aa0 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4c9a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f7800 0x7f4c9c108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4c9a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f7800 0x7f4c9c108040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60228/0 (socket says 172.21.15.26:60228) 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4c9a59c700 1 -- 172.21.15.26:0/3586183041 learned_addr learned my addr 172.21.15.26:0/3586183041 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4c99d9b700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c9c0f8aa0 0x7f4c9c108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4c9a59c700 1 -- 172.21.15.26:0/3586183041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c9c0f8aa0 msgr2=0x7f4c9c108530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4c9a59c700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c9c0f8aa0 0x7f4c9c108530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4c9a59c700 1 -- 172.21.15.26:0/3586183041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c90005040 con 0x7f4c9c0f7800 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.081+0000 7f4c9a59c700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f7800 0x7f4c9c108040 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f4c8c00e8c0 tx=0x7f4c8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.082+0000 7f4c8b7fe700 1 -- 172.21.15.26:0/3586183041 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c8c007b40 con 0x7f4c9c0f7800 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.082+0000 7f4c8b7fe700 1 -- 172.21.15.26:0/3586183041 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c8c00f040 con 0x7f4c9c0f7800 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.082+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c10d6c0 con 0x7f4c9c0f7800 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.082+0000 7f4c8b7fe700 1 -- 172.21.15.26:0/3586183041 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c8c014880 con 0x7f4c9c0f7800 2024-05-09T00:09:20.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.082+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c06af90 con 0x7f4c9c0f7800 2024-05-09T00:09:20.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.083+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c0fffc0 con 0x7f4c9c0f7800 2024-05-09T00:09:20.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.084+0000 7f4c8b7fe700 1 -- 172.21.15.26:0/3586183041 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 31) v1 ==== 90779+0+0 (secure 0 0 0) 0x7f4c8c007ca0 con 0x7f4c9c0f7800 2024-05-09T00:09:20.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.084+0000 7f4c8b7fe700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f4c84070bd0 0x7f4c84073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:20.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.084+0000 7f4c8b7fe700 1 -- 172.21.15.26:0/3586183041 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f4c8c08b370 con 0x7f4c9c0f7800 2024-05-09T00:09:20.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.084+0000 7f4c99d9b700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f4c84070bd0 0x7f4c84073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.085+0000 7f4c99d9b700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f4c84070bd0 0x7f4c84073090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4c900047c0 tx=0x7f4c90009cb0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.089+0000 7f4c8b7fe700 1 -- 172.21.15.26:0/3586183041 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f4c8c0591c0 con 0x7f4c9c0f7800 2024-05-09T00:09:20.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.434+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c9c101e30 con 0x7f4c9c0f7800 2024-05-09T00:09:20.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.437+0000 7f4c8b7fe700 1 -- 172.21.15.26:0/3586183041 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f4c8c058d50 con 0x7f4c9c0f7800 2024-05-09T00:09:20.434 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:09:20.434 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:09:20.434 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-05-09T00:09:20.434 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:09:20.434 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:09:20.434 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:09:20.434 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:09:20.434 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:09:20.435 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:09:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.445+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f4c84070bd0 msgr2=0x7f4c84073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.445+0000 7f4ca0b61700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f4c84070bd0 0x7f4c84073090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4c900047c0 tx=0x7f4c90009cb0).stop 2024-05-09T00:09:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.445+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f7800 msgr2=0x7f4c9c108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.445+0000 7f4ca0b61700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f7800 0x7f4c9c108040 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f4c8c00e8c0 tx=0x7f4c8c00b040).stop 2024-05-09T00:09:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.448+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 shutdown_connections 2024-05-09T00:09:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.448+0000 7f4ca0b61700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f4c84070bd0 0x7f4c84073090 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.448+0000 7f4ca0b61700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c9c0f7800 0x7f4c9c108040 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:20.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.448+0000 7f4ca0b61700 1 --2- 172.21.15.26:0/3586183041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c9c0f8aa0 0x7f4c9c108530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:20.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.448+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 >> 172.21.15.26:0/3586183041 conn(0x7f4c9c0f2f80 msgr2=0x7f4c9c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.457+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 shutdown_connections 2024-05-09T00:09:20.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.458+0000 7f4ca0b61700 1 -- 172.21.15.26:0/3586183041 wait complete. 2024-05-09T00:09:20.610 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:19.141285+0000 mgr.smithi026.brymfp (mgr.14750) 23 : audit [DBG] from='client.24573 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:20.610 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:19.508817+0000 mgr.smithi026.brymfp (mgr.14750) 24 : audit [DBG] from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:20.610 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:19.945990+0000 mgr.smithi026.brymfp (mgr.14750) 25 : audit [DBG] from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:20.610 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:20.436369+0000 mon.smithi026 (mon.0) 779 : audit [DBG] from='client.? 172.21.15.26:0/3586183041' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:09:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.661+0000 7f653a973700 1 -- 172.21.15.26:0/3013167984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 msgr2=0x7f65340fae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.661+0000 7f653a973700 1 --2- 172.21.15.26:0/3013167984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 0x7f65340fae10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f65240047f0 tx=0x7f6524009cb0).stop 2024-05-09T00:09:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.674+0000 7f653a973700 1 -- 172.21.15.26:0/3013167984 shutdown_connections 2024-05-09T00:09:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.674+0000 7f653a973700 1 --2- 172.21.15.26:0/3013167984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 0x7f65340fae10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.674+0000 7f653a973700 1 --2- 172.21.15.26:0/3013167984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6534061300 0x7f65340f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:09:20.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.674+0000 7f653a973700 1 -- 172.21.15.26:0/3013167984 >> 172.21.15.26:0/3013167984 conn(0x7f65340f2070 msgr2=0x7f65340f44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.682+0000 7f653a973700 1 -- 172.21.15.26:0/3013167984 shutdown_connections 2024-05-09T00:09:20.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.686+0000 7f653a973700 1 -- 172.21.15.26:0/3013167984 wait complete. 2024-05-09T00:09:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.687+0000 7f653a973700 1 Processor -- start 2024-05-09T00:09:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.687+0000 7f653a973700 1 -- start start 2024-05-09T00:09:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.688+0000 7f653a973700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6534061300 0x7f65341040b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.688+0000 7f653a973700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 0x7f65341045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.688+0000 7f653a973700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6534104be0 con 0x7f65340f8980 2024-05-09T00:09:20.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.688+0000 7f653a973700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6534104d50 con 0x7f6534061300 2024-05-09T00:09:20.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.696+0000 7f65337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 0x7f65341045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.696+0000 7f65337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 0x7f65341045a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60244/0 (socket says 172.21.15.26:60244) 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.696+0000 7f65337fe700 1 -- 172.21.15.26:0/1861585028 learned_addr learned my addr 172.21.15.26:0/1861585028 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.696+0000 7f6533fff700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6534061300 0x7f65341040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.697+0000 7f65337fe700 1 -- 172.21.15.26:0/1861585028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6534061300 msgr2=0x7f65341040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.697+0000 7f65337fe700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6534061300 0x7f65341040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.697+0000 7f65337fe700 1 -- 172.21.15.26:0/1861585028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524005040 con 0x7f65340f8980 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.697+0000 7f65337fe700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 0x7f65341045a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f6524009f20 tx=0x7f6524009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.698+0000 7f65317fa700 1 -- 172.21.15.26:0/1861585028 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652400e030 con 0x7f65340f8980 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.698+0000 7f65317fa700 1 -- 172.21.15.26:0/1861585028 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6524007e90 con 0x7f65340f8980 2024-05-09T00:09:20.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.698+0000 7f65317fa700 1 -- 172.21.15.26:0/1861585028 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6524018070 con 0x7f65340f8980 2024-05-09T00:09:20.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.700+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65340627c0 con 0x7f65340f8980 2024-05-09T00:09:20.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.700+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6534062cf0 con 0x7f65340f8980 2024-05-09T00:09:20.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.701+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653405fb50 con 0x7f65340f8980 2024-05-09T00:09:20.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.703+0000 7f65317fa700 1 -- 172.21.15.26:0/1861585028 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 31) v1 ==== 90779+0+0 (secure 0 0 0) 0x7f652401d960 con 0x7f65340f8980 2024-05-09T00:09:20.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.704+0000 7f65317fa700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f651c06c950 0x7f651c06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:20.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.704+0000 7f65317fa700 1 -- 172.21.15.26:0/1861585028 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f652408cc50 con 0x7f65340f8980 2024-05-09T00:09:20.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.713+0000 7f6533fff700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f651c06c950 0x7f651c06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.714+0000 7f65317fa700 1 -- 172.21.15.26:0/1861585028 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f652405aaf0 con 0x7f65340f8980 2024-05-09T00:09:20.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:20.715+0000 7f6533fff700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f651c06c950 0x7f651c06ee10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f652c001310 tx=0x7f652c009600).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:19.141285+0000 mgr.smithi026.brymfp (mgr.14750) 23 : audit [DBG] from='client.24573 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:20.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:19.508817+0000 mgr.smithi026.brymfp (mgr.14750) 24 : audit [DBG] from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:20.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:19.945990+0000 mgr.smithi026.brymfp (mgr.14750) 25 : audit [DBG] from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:20.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:20.436369+0000 mon.smithi026 (mon.0) 779 : audit [DBG] from='client.? 172.21.15.26:0/3586183041' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:09:21.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.046+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6534106880 con 0x7f65340f8980 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.047+0000 7f65317fa700 1 -- 172.21.15.26:0/1861585028 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1768 (secure 0 0 0) 0x7f652405a680 con 0x7f65340f8980 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 2024-05-09T00:09:21.044 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:09:21.045 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:09:21.046 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:09:21.047 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:09:21.047 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:21.047 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:21.047 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:21.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f651c06c950 msgr2=0x7f651c06ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f651c06c950 0x7f651c06ee10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f652c001310 tx=0x7f652c009600).stop 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 msgr2=0x7f65341045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 0x7f65341045a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f6524009f20 tx=0x7f6524009cb0).stop 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 shutdown_connections 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f651c06c950 0x7f651c06ee10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6534061300 0x7f65341040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 --2- 172.21.15.26:0/1861585028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65340f8980 0x7f65341045a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 >> 172.21.15.26:0/1861585028 conn(0x7f65340f2070 msgr2=0x7f65340f44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 shutdown_connections 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.049+0000 7f653a973700 1 -- 172.21.15.26:0/1861585028 wait complete. 2024-05-09T00:09:21.048 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:09:21.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 -- 172.21.15.26:0/3805035921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f6450 msgr2=0x7f48bc0f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 --2- 172.21.15.26:0/3805035921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f6450 0x7f48bc0f8bd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f48b00047f0 tx=0x7f48b0009cb0).stop 2024-05-09T00:09:21.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 -- 172.21.15.26:0/3805035921 shutdown_connections 2024-05-09T00:09:21.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 --2- 172.21.15.26:0/3805035921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f6450 0x7f48bc0f8bd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 --2- 172.21.15.26:0/3805035921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc0f5ab0 0x7f48bc0f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 -- 172.21.15.26:0/3805035921 >> 172.21.15.26:0/3805035921 conn(0x7f48bc0f15d0 msgr2=0x7f48bc0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:21.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 -- 172.21.15.26:0/3805035921 shutdown_connections 2024-05-09T00:09:21.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 -- 172.21.15.26:0/3805035921 wait complete. 2024-05-09T00:09:21.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.176+0000 7f48c174d700 1 Processor -- start 2024-05-09T00:09:21.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48c174d700 1 -- start start 2024-05-09T00:09:21.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48c174d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f5ab0 0x7f48bc107fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:21.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48c174d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc0f6450 0x7f48bc1084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:21.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48c174d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc108a60 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48c174d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc108ba0 con 0x7f48bc0f6450 2024-05-09T00:09:21.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f5ab0 0x7f48bc107fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:21.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48baffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f5ab0 0x7f48bc107fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60270/0 (socket says 172.21.15.26:60270) 2024-05-09T00:09:21.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48baffd700 1 -- 172.21.15.26:0/4066755086 learned_addr learned my addr 172.21.15.26:0/4066755086 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48ba7fc700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc0f6450 0x7f48bc1084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48baffd700 1 -- 172.21.15.26:0/4066755086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc0f6450 msgr2=0x7f48bc1084b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48baffd700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc0f6450 0x7f48bc1084b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.177+0000 7f48baffd700 1 -- 172.21.15.26:0/4066755086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0005040 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.178+0000 7f48baffd700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f5ab0 0x7f48bc107fc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f48ac002820 tx=0x7f48ac009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.178+0000 7f48a3fff700 1 -- 172.21.15.26:0/4066755086 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48ac007b40 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.178+0000 7f48a3fff700 1 -- 172.21.15.26:0/4066755086 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f48ac00f040 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.178+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc10d640 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.178+0000 7f48a3fff700 1 -- 172.21.15.26:0/4066755086 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48ac014820 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.178+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc10dc00 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.179+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc0fffd0 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.180+0000 7f48a3fff700 1 -- 172.21.15.26:0/4066755086 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 31) v1 ==== 90779+0+0 (secure 0 0 0) 0x7f48ac009110 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.180+0000 7f48a3fff700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f48a406c7c0 0x7f48a406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:21.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.180+0000 7f48a3fff700 1 -- 172.21.15.26:0/4066755086 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f48ac08b600 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.180+0000 7f48ba7fc700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f48a406c7c0 0x7f48a406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:21.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.181+0000 7f48ba7fc700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f48a406c7c0 0x7f48a406ec80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f48b0004f10 tx=0x7f48b000b040).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:21.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.185+0000 7f48a3fff700 1 -- 172.21.15.26:0/4066755086 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f48ac0594e0 con 0x7f48bc0f5ab0 2024-05-09T00:09:21.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.456+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 --> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48bc059120 con 0x7f48a406c7c0 2024-05-09T00:09:21.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.458+0000 7f48a3fff700 1 -- 172.21.15.26:0/4066755086 <== mgr.14750 v2:172.21.15.26:6800/3811609814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f48bc059120 con 0x7f48a406c7c0 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr" 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "2/21 daemons upgraded", 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "", 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:09:21.455 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f48a406c7c0 msgr2=0x7f48a406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f48a406c7c0 0x7f48a406ec80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f48b0004f10 tx=0x7f48b000b040).stop 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f5ab0 msgr2=0x7f48bc107fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f5ab0 0x7f48bc107fc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f48ac002820 tx=0x7f48ac009f00).stop 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 shutdown_connections 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f48a406c7c0 0x7f48a406ec80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48bc0f5ab0 0x7f48bc107fc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 --2- 172.21.15.26:0/4066755086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48bc0f6450 0x7f48bc1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 >> 172.21.15.26:0/4066755086 conn(0x7f48bc0f15d0 msgr2=0x7f48bc0fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 shutdown_connections 2024-05-09T00:09:21.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.460+0000 7f48c174d700 1 -- 172.21.15.26:0/4066755086 wait complete. 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.571+0000 7f218c153700 1 -- 172.21.15.26:0/2147803524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f8cb0 msgr2=0x7f21840f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.571+0000 7f218c153700 1 --2- 172.21.15.26:0/2147803524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f8cb0 0x7f21840f9110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f21740047f0 tx=0x7f2174009cb0).stop 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.571+0000 7f218c153700 1 -- 172.21.15.26:0/2147803524 shutdown_connections 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.571+0000 7f218c153700 1 --2- 172.21.15.26:0/2147803524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f8cb0 0x7f21840f9110 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.571+0000 7f218c153700 1 --2- 172.21.15.26:0/2147803524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21840f7a10 0x7f21840f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.571+0000 7f218c153700 1 -- 172.21.15.26:0/2147803524 >> 172.21.15.26:0/2147803524 conn(0x7f21840f3150 msgr2=0x7f21840f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.572+0000 7f218c153700 1 -- 172.21.15.26:0/2147803524 shutdown_connections 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.572+0000 7f218c153700 1 -- 172.21.15.26:0/2147803524 wait complete. 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.572+0000 7f218c153700 1 Processor -- start 2024-05-09T00:09:21.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.572+0000 7f218c153700 1 -- start start 2024-05-09T00:09:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.572+0000 7f218c153700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f7a10 0x7f218406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.572+0000 7f218c153700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21840f8cb0 0x7f218406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f218c153700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218406cf80 con 0x7f21840f7a10 2024-05-09T00:09:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f218c153700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218406b520 con 0x7f21840f8cb0 2024-05-09T00:09:21.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f2189eef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f7a10 0x7f218406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f21896ee700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21840f8cb0 0x7f218406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f2189eef700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f7a10 0x7f218406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33370/0 (socket says 172.21.15.26:33370) 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f2189eef700 1 -- 172.21.15.26:0/3841844532 learned_addr learned my addr 172.21.15.26:0/3841844532 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f2189eef700 1 -- 172.21.15.26:0/3841844532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21840f8cb0 msgr2=0x7f218406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f2189eef700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21840f8cb0 0x7f218406b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f2189eef700 1 -- 172.21.15.26:0/3841844532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174005040 con 0x7f21840f7a10 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f2189eef700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f7a10 0x7f218406c9d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f2180002820 tx=0x7f2180009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f217affd700 1 -- 172.21.15.26:0/3841844532 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2180007b40 con 0x7f21840f7a10 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f217affd700 1 -- 172.21.15.26:0/3841844532 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f218000f040 con 0x7f21840f7a10 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218406b7a0 con 0x7f21840f7a10 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f217affd700 1 -- 172.21.15.26:0/3841844532 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2180014820 con 0x7f21840f7a10 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.573+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218406bd60 con 0x7f21840f7a10 2024-05-09T00:09:21.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.575+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218405fb50 con 0x7f21840f7a10 2024-05-09T00:09:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.576+0000 7f217affd700 1 -- 172.21.15.26:0/3841844532 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 31) v1 ==== 90779+0+0 (secure 0 0 0) 0x7f2180009110 con 0x7f21840f7a10 2024-05-09T00:09:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.576+0000 7f217affd700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f217006c7c0 0x7f217006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.576+0000 7f217affd700 1 -- 172.21.15.26:0/3841844532 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f218008b480 con 0x7f21840f7a10 2024-05-09T00:09:21.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.576+0000 7f21896ee700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f217006c7c0 0x7f217006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:21.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.577+0000 7f21896ee700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f217006c7c0 0x7f217006ec80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2174004f10 tx=0x7f217400b040).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:21.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.581+0000 7f217affd700 1 -- 172.21.15.26:0/3841844532 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181382 (secure 0 0 0) 0x7f2180059360 con 0x7f21840f7a10 2024-05-09T00:09:21.774 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:20.073404+0000 mgr.smithi026.brymfp (mgr.14750) 26 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.7 MiB/s wr, 735 op/s 2024-05-09T00:09:21.775 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:21.048335+0000 mon.smithi026 (mon.0) 780 : audit [DBG] from='client.? 172.21.15.26:0/1861585028' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:09:21.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:20.073404+0000 mgr.smithi026.brymfp (mgr.14750) 26 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.7 MiB/s wr, 735 op/s 2024-05-09T00:09:21.895 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:21 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:21.048335+0000 mon.smithi026 (mon.0) 780 : audit [DBG] from='client.? 172.21.15.26:0/1861585028' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:09:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.967+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2184102150 con 0x7f21840f7a10 2024-05-09T00:09:21.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.967+0000 7f217affd700 1 -- 172.21.15.26:0/3841844532 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2180058ef0 con 0x7f21840f7a10 2024-05-09T00:09:21.964 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:09:21.965 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:09:21.965 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:09:21.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.969+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f217006c7c0 msgr2=0x7f217006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.969+0000 7f218c153700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f217006c7c0 0x7f217006ec80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2174004f10 tx=0x7f217400b040).stop 2024-05-09T00:09:21.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f7a10 msgr2=0x7f218406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f7a10 0x7f218406c9d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f2180002820 tx=0x7f2180009f00).stop 2024-05-09T00:09:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 shutdown_connections 2024-05-09T00:09:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:6800/3811609814,v1:172.21.15.26:6801/3811609814] conn(0x7f217006c7c0 0x7f217006ec80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21840f7a10 0x7f218406c9d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 --2- 172.21.15.26:0/3841844532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21840f8cb0 0x7f218406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 >> 172.21.15.26:0/3841844532 conn(0x7f21840f3150 msgr2=0x7f21840fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 shutdown_connections 2024-05-09T00:09:21.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:21.970+0000 7f218c153700 1 -- 172.21.15.26:0/3841844532 wait complete. 2024-05-09T00:09:23.064 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:21.459361+0000 mgr.smithi026.brymfp (mgr.14750) 27 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:23.064 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:21.826676+0000 mon.smithi026 (mon.0) 781 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:23.064 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:21.840080+0000 mon.smithi026 (mon.0) 782 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:23.064 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:21.866541+0000 mon.smithi026 (mon.0) 783 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:09:23.064 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:21.867108+0000 mgr.smithi026.brymfp (mgr.14750) 28 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:09:23.064 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:21.872931+0000 mon.smithi026 (mon.0) 784 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:23.064 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:21.969196+0000 mon.smithi026 (mon.0) 785 : audit [DBG] from='client.? 172.21.15.26:0/3841844532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:09:23.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:21.459361+0000 mgr.smithi026.brymfp (mgr.14750) 27 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:23.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:21.826676+0000 mon.smithi026 (mon.0) 781 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:23.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:21.840080+0000 mon.smithi026 (mon.0) 782 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:23.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:21.866541+0000 mon.smithi026 (mon.0) 783 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:09:23.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:21.867108+0000 mgr.smithi026.brymfp (mgr.14750) 28 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:09:23.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:21.872931+0000 mon.smithi026 (mon.0) 784 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:23.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:22 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:21.969196+0000 mon.smithi026 (mon.0) 785 : audit [DBG] from='client.? 172.21.15.26:0/3841844532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:09:24.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:22.073828+0000 mgr.smithi026.brymfp (mgr.14750) 29 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.7 MiB/s wr, 1.03k op/s 2024-05-09T00:09:24.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:23.442178+0000 mon.smithi026 (mon.0) 786 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:09:24.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:23.443020+0000 mon.smithi026 (mon.0) 787 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:09:24.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:23 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:23.443788+0000 mon.smithi026 (mon.0) 788 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:24.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:22.073828+0000 mgr.smithi026.brymfp (mgr.14750) 29 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.7 MiB/s wr, 1.03k op/s 2024-05-09T00:09:24.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:23.442178+0000 mon.smithi026 (mon.0) 786 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:09:24.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:23.443020+0000 mon.smithi026 (mon.0) 787 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:09:24.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:23.443788+0000 mon.smithi026 (mon.0) 788 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:24.988 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:23.441770+0000 mgr.smithi026.brymfp (mgr.14750) 30 : cephadm [INF] Upgrade: Updating mgr.smithi135.kkrhgf 2024-05-09T00:09:24.988 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:23.444656+0000 mgr.smithi026.brymfp (mgr.14750) 31 : cephadm [INF] Deploying daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:09:25.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:23.441770+0000 mgr.smithi026.brymfp (mgr.14750) 30 : cephadm [INF] Upgrade: Updating mgr.smithi135.kkrhgf 2024-05-09T00:09:25.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:24 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:23.444656+0000 mgr.smithi026.brymfp (mgr.14750) 31 : cephadm [INF] Deploying daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:09:26.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:25 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:24.074135+0000 mgr.smithi026.brymfp (mgr.14750) 32 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 863 op/s 2024-05-09T00:09:26.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:24.074135+0000 mgr.smithi026.brymfp (mgr.14750) 32 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 863 op/s 2024-05-09T00:09:27.911 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-05-09T00:09:27.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-09T00:09:28.130 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:26.074652+0000 mgr.smithi026.brymfp (mgr.14750) 33 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.1 MiB/s wr, 1.23k op/s 2024-05-09T00:09:28.130 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:27.214740+0000 mon.smithi026 (mon.0) 789 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:28.130 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:27.218827+0000 mon.smithi026 (mon.0) 790 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:28.130 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:27.268063+0000 mon.smithi026 (mon.0) 791 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:28.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:26.074652+0000 mgr.smithi026.brymfp (mgr.14750) 33 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.1 MiB/s wr, 1.23k op/s 2024-05-09T00:09:28.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:27.214740+0000 mon.smithi026 (mon.0) 789 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:28.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:27.218827+0000 mon.smithi026 (mon.0) 790 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:28.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:27.268063+0000 mon.smithi026 (mon.0) 791 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:28.468 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:30.126 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:28.075045+0000 mgr.smithi026.brymfp (mgr.14750) 34 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 966 op/s 2024-05-09T00:09:30.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:28.075045+0000 mgr.smithi026.brymfp (mgr.14750) 34 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 966 op/s 2024-05-09T00:09:32.082 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:30.075521+0000 mgr.smithi026.brymfp (mgr.14750) 35 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 1.05k op/s 2024-05-09T00:09:32.082 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:31.397808+0000 mon.smithi026 (mon.0) 792 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:32.082 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:31.402588+0000 mon.smithi026 (mon.0) 793 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:32.145 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:30.075521+0000 mgr.smithi026.brymfp (mgr.14750) 35 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 1.05k op/s 2024-05-09T00:09:32.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:31.397808+0000 mon.smithi026 (mon.0) 792 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:32.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:31 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:31.402588+0000 mon.smithi026 (mon.0) 793 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:33.308 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:32.075918+0000 mgr.smithi026.brymfp (mgr.14750) 36 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.7 MiB/s wr, 1.01k op/s 2024-05-09T00:09:33.309 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:32.141793+0000 mon.smithi026 (mon.0) 794 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:33.309 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:32.147088+0000 mon.smithi026 (mon.0) 795 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:33.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:32.075918+0000 mgr.smithi026.brymfp (mgr.14750) 36 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.7 MiB/s wr, 1.01k op/s 2024-05-09T00:09:33.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:32.141793+0000 mon.smithi026 (mon.0) 794 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:33.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:33 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:32.147088+0000 mon.smithi026 (mon.0) 795 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:34.995 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-05-09T00:09:34.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T00:09:35.347 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:34.076244+0000 mgr.smithi026.brymfp (mgr.14750) 37 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 612 op/s 2024-05-09T00:09:35.347 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:34.156525+0000 mon.smithi026 (mon.0) 796 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:35.348 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:34.809234+0000 mon.smithi026 (mon.0) 797 : cluster [DBG] Standby manager daemon smithi135.kkrhgf restarted 2024-05-09T00:09:35.348 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:34.809338+0000 mon.smithi026 (mon.0) 798 : cluster [DBG] Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:09:35.348 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:34.810562+0000 mon.smithi135 (mon.1) 84 : audit [DBG] from='mgr.? 172.21.15.135:0/4099045090' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:09:35.348 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:34.810991+0000 mon.smithi135 (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.135:0/4099045090' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:09:35.348 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:34.812802+0000 mon.smithi135 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.135:0/4099045090' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/key"}]: dispatch 2024-05-09T00:09:35.348 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:34.813707+0000 mon.smithi135 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.135:0/4099045090' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:09:35.349 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:35.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T00:09:35.382 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T00:09:35.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T00:09:35.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:34.076244+0000 mgr.smithi026.brymfp (mgr.14750) 37 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 612 op/s 2024-05-09T00:09:35.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:34.156525+0000 mon.smithi026 (mon.0) 796 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:35.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:34.809234+0000 mon.smithi026 (mon.0) 797 : cluster [DBG] Standby manager daemon smithi135.kkrhgf restarted 2024-05-09T00:09:35.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:34.809338+0000 mon.smithi026 (mon.0) 798 : cluster [DBG] Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:09:35.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:34.810562+0000 mon.smithi135 (mon.1) 84 : audit [DBG] from='mgr.? 172.21.15.135:0/4099045090' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:09:35.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:34.810991+0000 mon.smithi135 (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.135:0/4099045090' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:09:35.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:34.812802+0000 mon.smithi135 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.135:0/4099045090' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/key"}]: dispatch 2024-05-09T00:09:35.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:35 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:34.813707+0000 mon.smithi135 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.135:0/4099045090' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:09:35.418 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T00:09:35.419 DEBUG:teuthology.parallel:result is None 2024-05-09T00:09:36.441 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:36 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:35.163811+0000 mon.smithi026 (mon.0) 799 : cluster [DBG] mgrmap e32: smithi026.brymfp(active, since 31s), standbys: smithi135.kkrhgf 2024-05-09T00:09:36.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:36 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:35.163811+0000 mon.smithi026 (mon.0) 799 : cluster [DBG] mgrmap e32: smithi026.brymfp(active, since 31s), standbys: smithi135.kkrhgf 2024-05-09T00:09:37.633 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:37 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:36.076937+0000 mgr.smithi026.brymfp (mgr.14750) 38 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 768 op/s 2024-05-09T00:09:37.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:37 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:36.076937+0000 mgr.smithi026.brymfp (mgr.14750) 38 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 768 op/s 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.031368+0000 mon.smithi026 (mon.0) 800 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.036134+0000 mon.smithi026 (mon.0) 801 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.037148+0000 mon.smithi026 (mon.0) 802 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.038036+0000 mon.smithi026 (mon.0) 803 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.042720+0000 mon.smithi026 (mon.0) 804 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cluster 2024-05-09T00:09:38.077319+0000 mgr.smithi026.brymfp (mgr.14750) 39 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 402 op/s 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.181838+0000 mon.smithi026 (mon.0) 805 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.184968+0000 mon.smithi026 (mon.0) 806 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:38.185616+0000 mgr.smithi026.brymfp (mgr.14750) 40 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-05-09T00:09:39.317 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.189844+0000 mon.smithi026 (mon.0) 807 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:39.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.190698+0000 mon.smithi026 (mon.0) 808 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi026.brymfp"}]: dispatch 2024-05-09T00:09:39.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.193993+0000 mon.smithi026 (mon.0) 809 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi026.brymfp"}]': finished 2024-05-09T00:09:39.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.194676+0000 mon.smithi026 (mon.0) 810 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:39.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.198033+0000 mon.smithi026 (mon.0) 811 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi135.kkrhgf"}]': finished 2024-05-09T00:09:39.318 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:38.199075+0000 mon.smithi026 (mon.0) 812 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T00:09:39.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.031368+0000 mon.smithi026 (mon.0) 800 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.036134+0000 mon.smithi026 (mon.0) 801 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.037148+0000 mon.smithi026 (mon.0) 802 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.038036+0000 mon.smithi026 (mon.0) 803 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.042720+0000 mon.smithi026 (mon.0) 804 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:38.077319+0000 mgr.smithi026.brymfp (mgr.14750) 39 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 402 op/s 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.181838+0000 mon.smithi026 (mon.0) 805 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.184968+0000 mon.smithi026 (mon.0) 806 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:38.185616+0000 mgr.smithi026.brymfp (mgr.14750) 40 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.189844+0000 mon.smithi026 (mon.0) 807 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.190698+0000 mon.smithi026 (mon.0) 808 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi026.brymfp"}]: dispatch 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.193993+0000 mon.smithi026 (mon.0) 809 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi026.brymfp"}]': finished 2024-05-09T00:09:39.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.194676+0000 mon.smithi026 (mon.0) 810 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:39.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.198033+0000 mon.smithi026 (mon.0) 811 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi135.kkrhgf"}]': finished 2024-05-09T00:09:39.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:39 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:38.199075+0000 mon.smithi026 (mon.0) 812 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T00:09:41.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:39.766421+0000 mgr.smithi026.brymfp (mgr.14750) 41 : cephadm [INF] Upgrade: Updating mon.smithi026 2024-05-09T00:09:41.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:39.771376+0000 mon.smithi026 (mon.0) 813 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:41.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:39.772289+0000 mon.smithi026 (mon.0) 814 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:09:41.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:39.772944+0000 mon.smithi026 (mon.0) 815 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:09:41.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: audit 2024-05-09T00:09:39.773571+0000 mon.smithi026 (mon.0) 816 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:41.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:40 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: cephadm 2024-05-09T00:09:39.774580+0000 mgr.smithi026.brymfp (mgr.14750) 42 : cephadm [INF] Deploying daemon mon.smithi026 on smithi026 2024-05-09T00:09:41.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:39.766421+0000 mgr.smithi026.brymfp (mgr.14750) 41 : cephadm [INF] Upgrade: Updating mon.smithi026 2024-05-09T00:09:41.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:39.771376+0000 mon.smithi026 (mon.0) 813 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:41.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:39.772289+0000 mon.smithi026 (mon.0) 814 : audit [INF] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:09:41.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:39.772944+0000 mon.smithi026 (mon.0) 815 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:09:41.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:39.773571+0000 mon.smithi026 (mon.0) 816 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:41.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:40 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:39.774580+0000 mgr.smithi026.brymfp (mgr.14750) 42 : cephadm [INF] Deploying daemon mon.smithi026 on smithi026 2024-05-09T00:09:41.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:41 smithi026 systemd[1]: Stopping Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:09:42.027 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-09T00:09:41.741+0000 7f1fd37f3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi026 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-05-09T00:09:42.028 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:41 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[40044]: debug 2024-05-09T00:09:41.741+0000 7f1fd37f3700 -1 mon.smithi026@0(leader) e2 *** Got Signal Terminated *** 2024-05-09T00:09:42.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:42 smithi026 bash[93464]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026 2024-05-09T00:09:42.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:42 smithi026 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi026.service: Succeeded. 2024-05-09T00:09:42.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:42 smithi026 systemd[1]: Stopped Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:09:42.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:42 smithi026 systemd[1]: Starting Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:09:43.362 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable), process ceph-mon, pid 7 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: pidfile_write: ignore empty --pid-file 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: load: jerasure load: lrc 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: RocksDB version: 7.9.2 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Git sha 0 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Compile date 2024-05-08 17:55:50 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: DB SUMMARY 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: DB Session ID: RCNKEO862HXACIBXDUO7 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: CURRENT file: CURRENT 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: MANIFEST file: MANIFEST-000008 size: 794 Bytes 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi026/store.db dir, Total Num: 1, files: 000020.sst 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi026/store.db: 000018.log size: 4005040 ; 2024-05-09T00:09:43.363 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.error_if_exists: 0 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.create_if_missing: 0 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.paranoid_checks: 1 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.env: 0x5651f0a5e820 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.info_log: 0x5651f2e033e0 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.statistics: (nil) 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.use_fsync: 0 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_log_file_size: 0 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T00:09:43.364 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.allow_fallocate: 1 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.use_direct_reads: 0 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.db_log_dir: 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.wal_dir: 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T00:09:43.365 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.write_buffer_manager: 0x5651f2078140 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.unordered_write: 0 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T00:09:43.366 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.row_cache: None 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.wal_filter: None 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.two_write_queues: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.wal_compression: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.atomic_flush: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.log_readahead_size: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T00:09:43.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_background_jobs: 2 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_background_compactions: -1 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_subcompactions: 1 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T00:09:43.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_open_files: -1 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_background_flushes: -1 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Compression algorithms supported: 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: kZSTD supported: 0 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: kXpressCompression supported: 0 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: kZlibCompression supported: 1 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: kSnappyCompression supported: 1 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: kLZ4Compression supported: 1 2024-05-09T00:09:43.369 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: kBZip2Compression supported: 0 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000008 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.merge_operator: 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_filter: None 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5651f2e03500) 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: cache_index_and_filter_blocks: 1 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T00:09:43.370 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: pin_top_level_index_and_filter: 1 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: index_type: 0 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: data_block_index_type: 0 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: index_shortening: 1 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: checksum: 4 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: no_block_cache: 0 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_cache: 0x5651f211b1f0 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_cache_name: BinnedLRUCache 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_cache_options: 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: capacity : 536870912 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: num_shard_bits : 4 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: strict_capacity_limit : 0 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: high_pri_pool_ratio: 0.000 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_cache_compressed: (nil) 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: persistent_cache: (nil) 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_size: 4096 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_size_deviation: 10 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_restart_interval: 16 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: index_block_restart_interval: 1 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: metadata_block_size: 4096 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: partition_filters: 0 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: use_delta_encoding: 1 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: filter_policy: bloomfilter 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: whole_key_filtering: 1 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: verify_compression: 0 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: read_amp_bytes_per_bit: 0 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: format_version: 5 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: enable_index_compression: 1 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: block_align: 0 2024-05-09T00:09:43.372 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: max_auto_readahead_size: 262144 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: prepopulate_block_cache: 0 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: initial_auto_readahead_size: 8192 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression: NoCompression 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.num_levels: 7 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T00:09:43.373 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T00:09:43.374 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T00:09:43.375 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T00:09:43.376 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.table_properties_collectors: 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.inplace_update_support: 0 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.bloom_locality: 0 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.max_successive_merges: 0 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T00:09:43.377 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.ttl: 2592000 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.enable_blob_files: false 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.min_blob_size: 0 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T00:09:43.378 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 20.sst 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi026/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 22, last_sequence is 8920, log_number is 18,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 18 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 47fe9fb4-f1e7-4069-b399-e8b8f94fe0dc 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715213383091465, "job": 1, "event": "recovery_started", "wal_files": [18]} 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #18 mode 2 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715213383105582, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 23, "file_size": 3856777, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8922, "largest_seqno": 9631, "table_properties": {"data_size": 3851314, "index_size": 3804, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 5297, "raw_average_key_size": 20, "raw_value_size": 3843534, "raw_average_value_size": 15132, "num_data_blocks": 170, "num_entries": 254, "num_filter_entries": 254, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715213383, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "47fe9fb4-f1e7-4069-b399-e8b8f94fe0dc", "db_session_id": "RCNKEO862HXACIBXDUO7", "orig_file_number": 23, "seqno_to_time_mapping": "N/A"}} 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715213383105697, "job": 1, "event": "recovery_finished"} 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/version_set.cc:5047] Creating manifest 25 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi026/store.db/000018.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5651f21b8000 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: DB pointer 0x5651f21a6000 2024-05-09T00:09:43.379 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** DB Stats ** 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** Compaction Stats [default] ** 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: L0 1/0 3.68 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.1 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-05-09T00:09:43.380 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: L6 1/0 24.46 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Sum 2/0 28.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.1 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.1 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** Compaction Stats [default] ** 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 597.1 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.381 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Cumulative compaction: 0.00 GB write, 215.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Interval compaction: 0.00 GB write, 215.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Block cache BinnedLRUCache@0x5651f211b1f0#7 capacity: 512.00 MB usage: 4.80 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.7e-05 secs_since: 0 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.72 KB,0.000137091%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T00:09:43.382 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: starting mon.smithi026 rank 0 at public addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] at bind addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi026 fsid aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: mon.smithi026@-1(???) e2 preinit fsid aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: mon.smithi026@-1(???).mds e11 new map 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: mon.smithi026@-1(???).mds e11 print_map 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: e11 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: legacy client fscid: 1 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Filesystem 'cephfs' (1) 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: fs_name cephfs 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: epoch 11 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: tableserver 0 2024-05-09T00:09:43.383 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: root 0 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: session_timeout 60 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: session_autoclose 300 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: max_file_size 1099511627776 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: max_xattr_size 65536 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: required_client_features {} 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: last_failure 0 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: last_failure_osd_epoch 0 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: max_mds 1 2024-05-09T00:09:43.384 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: in 0 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: up {0=14434} 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: failed 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: damaged 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: stopped 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: data_pools [3] 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: metadata_pool 2 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: inline_data enabled 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: balancer 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: bal_rank_mask -1 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: standby_count_wanted 1 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: [mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: Standby daemons: 2024-05-09T00:09:43.385 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: [mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: [mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout: [mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: mon.smithi026@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: mon.smithi026@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: mon.smithi026@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: mon.smithi026@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 ceph-mon[93667]: mon.smithi026@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 bash[93629]: 4c64ed5c2c4101a66914ee75913c5da9e461775913f4a9f28f943e9f436391fe 2024-05-09T00:09:43.386 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:09:43 smithi026 systemd[1]: Started Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:09:43.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:41.747759+0000 mon.smithi135 (mon.1) 88 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:41.747939+0000 mon.smithi135 (mon.1) 89 : audit [DBG] from='mgr.14750 172.21.15.26:0/2693302064' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:42.078054+0000 mgr.smithi026.brymfp (mgr.14750) 44 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 200 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 951 KiB/s wr, 339 op/s 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.317868+0000 mon.smithi026 (mon.0) 1 : cluster [INF] mon.smithi026 calling monitor election 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.319760+0000 mon.smithi026 (mon.0) 2 : cluster [INF] mon.smithi026 is new leader, mons smithi026,smithi135 in quorum (ranks 0,1) 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.323340+0000 mon.smithi026 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.323858+0000 mon.smithi026 (mon.0) 4 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.323896+0000 mon.smithi026 (mon.0) 5 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.324543+0000 mon.smithi026 (mon.0) 6 : cluster [DBG] mgrmap e32: smithi026.brymfp(active, since 39s), standbys: smithi135.kkrhgf 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.325045+0000 mon.smithi026 (mon.0) 7 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.325063+0000 mon.smithi026 (mon.0) 8 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.325077+0000 mon.smithi026 (mon.0) 9 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:43.332054+0000 mon.smithi026 (mon.0) 10 : cluster [DBG] mgrmap e33: smithi026.brymfp(active, since 39s), standbys: smithi135.kkrhgf 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:43.332123+0000 mon.smithi026 (mon.0) 11 : audit [INF] from='mgr.14750 ' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:43.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:43 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:43.342007+0000 mon.smithi026 (mon.0) 12 : audit [INF] from='mgr.14750 ' entity='' 2024-05-09T00:09:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:50.183958+0000 mon.smithi026 (mon.0) 13 : cluster [DBG] Standby manager daemon smithi135.kkrhgf restarted 2024-05-09T00:09:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:50.184049+0000 mon.smithi026 (mon.0) 14 : cluster [DBG] Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:09:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.186206+0000 mon.smithi135 (mon.1) 90 : audit [DBG] from='mgr.? 172.21.15.135:0/2875882444' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/crt"}]: dispatch 2024-05-09T00:09:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.186715+0000 mon.smithi135 (mon.1) 91 : audit [DBG] from='mgr.? 172.21.15.135:0/2875882444' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:09:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.189203+0000 mon.smithi135 (mon.1) 92 : audit [DBG] from='mgr.? 172.21.15.135:0/2875882444' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.kkrhgf/key"}]: dispatch 2024-05-09T00:09:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:50 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.189536+0000 mon.smithi135 (mon.1) 93 : audit [DBG] from='mgr.? 172.21.15.135:0/2875882444' entity='mgr.smithi135.kkrhgf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:50.239041+0000 mon.smithi026 (mon.0) 15 : cluster [DBG] mgrmap e34: smithi026.brymfp(active, since 46s), standbys: smithi135.kkrhgf 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:50.526239+0000 mon.smithi026 (mon.0) 16 : cluster [INF] Active manager daemon smithi026.brymfp restarted 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:50.526592+0000 mon.smithi026 (mon.0) 17 : cluster [INF] Activating manager daemon smithi026.brymfp 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:50.531403+0000 mon.smithi026 (mon.0) 18 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:50.531690+0000 mon.smithi026 (mon.0) 19 : cluster [DBG] mgrmap e35: smithi026.brymfp(active, starting, since 0.00520346s), standbys: smithi135.kkrhgf 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.533258+0000 mon.smithi026 (mon.0) 20 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.533473+0000 mon.smithi026 (mon.0) 21 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.536008+0000 mon.smithi026 (mon.0) 22 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.536304+0000 mon.smithi026 (mon.0) 23 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:09:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.536513+0000 mon.smithi026 (mon.0) 24 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.536717+0000 mon.smithi026 (mon.0) 25 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.537019+0000 mon.smithi026 (mon.0) 26 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.537247+0000 mon.smithi026 (mon.0) 27 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi135.kkrhgf", "id": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.537471+0000 mon.smithi026 (mon.0) 28 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.537781+0000 mon.smithi026 (mon.0) 29 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.538013+0000 mon.smithi026 (mon.0) 30 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.538221+0000 mon.smithi026 (mon.0) 31 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.538398+0000 mon.smithi026 (mon.0) 32 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.538595+0000 mon.smithi026 (mon.0) 33 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.538797+0000 mon.smithi026 (mon.0) 34 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.539065+0000 mon.smithi026 (mon.0) 35 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.539634+0000 mon.smithi026 (mon.0) 36 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:50.559371+0000 mon.smithi026 (mon.0) 37 : cluster [INF] Manager daemon smithi026.brymfp is now available 2024-05-09T00:09:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.581464+0000 mon.smithi026 (mon.0) 38 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:51.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.602935+0000 mon.smithi026 (mon.0) 39 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:09:51.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.613495+0000 mon.smithi026 (mon.0) 40 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:09:51.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:50.628316+0000 mon.smithi026 (mon.0) 41 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-09T00:09:51.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:51.170942+0000 mon.smithi026 (mon.0) 42 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:51.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:51 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:51.175697+0000 mon.smithi026 (mon.0) 43 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:52.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.086+0000 7f1fde1a3700 1 -- 172.21.15.26:0/2598252826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd80f66f0 msgr2=0x7f1fd80f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.086+0000 7f1fde1a3700 1 --2- 172.21.15.26:0/2598252826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd80f66f0 0x7f1fd80f6b10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1fcc0047f0 tx=0x7f1fcc009cb0).stop 2024-05-09T00:09:52.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.086+0000 7f1fde1a3700 1 -- 172.21.15.26:0/2598252826 shutdown_connections 2024-05-09T00:09:52.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.086+0000 7f1fde1a3700 1 --2- 172.21.15.26:0/2598252826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fd80f7990 0x7f1fd80f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.086+0000 7f1fde1a3700 1 --2- 172.21.15.26:0/2598252826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd80f66f0 0x7f1fd80f6b10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.086+0000 7f1fde1a3700 1 -- 172.21.15.26:0/2598252826 >> 172.21.15.26:0/2598252826 conn(0x7f1fd80f1e50 msgr2=0x7f1fd80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:52.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.086+0000 7f1fde1a3700 1 -- 172.21.15.26:0/2598252826 shutdown_connections 2024-05-09T00:09:52.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.086+0000 7f1fde1a3700 1 -- 172.21.15.26:0/2598252826 wait complete. 2024-05-09T00:09:52.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fde1a3700 1 Processor -- start 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fde1a3700 1 -- start start 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fde1a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd80f66f0 0x7f1fd8061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fde1a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fd80f7990 0x7f1fd810ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fde1a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd810d370 con 0x7f1fd80f66f0 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fde1a3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd810d4b0 con 0x7f1fd80f7990 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fd80f7990 0x7f1fd810ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fd80f7990 0x7f1fd810ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:57044/0 (socket says 172.21.15.26:57044) 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.087+0000 7f1fd6ffd700 1 -- 172.21.15.26:0/478190848 learned_addr learned my addr 172.21.15.26:0/478190848 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fd77fe700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd80f66f0 0x7f1fd8061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fd6ffd700 1 -- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd80f66f0 msgr2=0x7f1fd8061040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fd6ffd700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd80f66f0 0x7f1fd8061040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fd6ffd700 1 -- 172.21.15.26:0/478190848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc005040 con 0x7f1fd80f7990 2024-05-09T00:09:52.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fd6ffd700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fd80f7990 0x7f1fd810ce80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1fc800e8f0 tx=0x7f1fc800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:52.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fd4ff9700 1 -- 172.21.15.26:0/478190848 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc8007b40 con 0x7f1fd80f7990 2024-05-09T00:09:52.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fd4ff9700 1 -- 172.21.15.26:0/478190848 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1fc800f040 con 0x7f1fd80f7990 2024-05-09T00:09:52.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd810d710 con 0x7f1fd80f7990 2024-05-09T00:09:52.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fd4ff9700 1 -- 172.21.15.26:0/478190848 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc8014880 con 0x7f1fd80f7990 2024-05-09T00:09:52.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.088+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd810dca0 con 0x7f1fd80f7990 2024-05-09T00:09:52.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.089+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd80feeb0 con 0x7f1fd80f7990 2024-05-09T00:09:52.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.090+0000 7f1fd4ff9700 1 -- 172.21.15.26:0/478190848 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 36) v1 ==== 90594+0+0 (secure 0 0 0) 0x7f1fc8014ab0 con 0x7f1fd80f7990 2024-05-09T00:09:52.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.090+0000 7f1fd4ff9700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1fc006c7a0 0x7f1fc006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.090+0000 7f1fd4ff9700 1 -- 172.21.15.26:0/478190848 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1fc808b4b0 con 0x7f1fd80f7990 2024-05-09T00:09:52.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.090+0000 7f1fd77fe700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1fc006c7a0 0x7f1fc006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:52.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.091+0000 7f1fd77fe700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1fc006c7a0 0x7f1fc006ec60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f1fcc0047c0 tx=0x7f1fcc009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:52.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.095+0000 7f1fd4ff9700 1 -- 172.21.15.26:0/478190848 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f1fc8055ad0 con 0x7f1fd80f7990 2024-05-09T00:09:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.327+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fd8059120 con 0x7f1fc006c7a0 2024-05-09T00:09:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.329+0000 7f1fd4ff9700 1 -- 172.21.15.26:0/478190848 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f1fd8059120 con 0x7f1fc006c7a0 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1fc006c7a0 msgr2=0x7f1fc006ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1fc006c7a0 0x7f1fc006ec60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f1fcc0047c0 tx=0x7f1fcc009cb0).stop 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fd80f7990 msgr2=0x7f1fd810ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fd80f7990 0x7f1fd810ce80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1fc800e8f0 tx=0x7f1fc800b040).stop 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 shutdown_connections 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1fc006c7a0 0x7f1fc006ec60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fd80f66f0 0x7f1fd8061040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 --2- 172.21.15.26:0/478190848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fd80f7990 0x7f1fd810ce80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 >> 172.21.15.26:0/478190848 conn(0x7f1fd80f1e50 msgr2=0x7f1fd80fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 shutdown_connections 2024-05-09T00:09:52.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.331+0000 7f1fde1a3700 1 -- 172.21.15.26:0/478190848 wait complete. 2024-05-09T00:09:52.337 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:09:52.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.449+0000 7ff0dda80700 1 -- 172.21.15.26:0/1462413192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 msgr2=0x7ff0d80f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.449+0000 7ff0dda80700 1 --2- 172.21.15.26:0/1462413192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 0x7ff0d80f8f00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff0cc0047f0 tx=0x7ff0cc009cb0).stop 2024-05-09T00:09:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.449+0000 7ff0dda80700 1 -- 172.21.15.26:0/1462413192 shutdown_connections 2024-05-09T00:09:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.449+0000 7ff0dda80700 1 --2- 172.21.15.26:0/1462413192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 0x7ff0d80f8f00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.449+0000 7ff0dda80700 1 --2- 172.21.15.26:0/1462413192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d80f7800 0x7ff0d80f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.449+0000 7ff0dda80700 1 -- 172.21.15.26:0/1462413192 >> 172.21.15.26:0/1462413192 conn(0x7ff0d80f2f80 msgr2=0x7ff0d80f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.449+0000 7ff0dda80700 1 -- 172.21.15.26:0/1462413192 shutdown_connections 2024-05-09T00:09:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.449+0000 7ff0dda80700 1 -- 172.21.15.26:0/1462413192 wait complete. 2024-05-09T00:09:52.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.450+0000 7ff0dda80700 1 Processor -- start 2024-05-09T00:09:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.450+0000 7ff0dda80700 1 -- start start 2024-05-09T00:09:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.450+0000 7ff0dda80700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d80f7800 0x7ff0d8107f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.450+0000 7ff0dda80700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 0x7ff0d8108410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.450+0000 7ff0dda80700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81089c0 con 0x7ff0d80f7800 2024-05-09T00:09:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.450+0000 7ff0dda80700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8108b00 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d80f7800 0x7ff0d8107f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 0x7ff0d8108410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 0x7ff0d8108410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:57066/0 (socket says 172.21.15.26:57066) 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d6ffd700 1 -- 172.21.15.26:0/1218425899 learned_addr learned my addr 172.21.15.26:0/1218425899 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d80f7800 0x7ff0d8107f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42126/0 (socket says 172.21.15.26:42126) 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d6ffd700 1 -- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d80f7800 msgr2=0x7ff0d8107f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d6ffd700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d80f7800 0x7ff0d8107f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d6ffd700 1 -- 172.21.15.26:0/1218425899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc005040 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d6ffd700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 0x7ff0d8108410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff0cc013620 tx=0x7ff0cc009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d4f74700 1 -- 172.21.15.26:0/1218425899 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0cc00e070 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d4f74700 1 -- 172.21.15.26:0/1218425899 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0cc007e90 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d810d540 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0d4f74700 1 -- 172.21.15.26:0/1218425899 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0cc018070 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.451+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d810da80 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.452+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d80fffc0 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.453+0000 7ff0d4f74700 1 -- 172.21.15.26:0/1218425899 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 36) v1 ==== 90594+0+0 (secure 0 0 0) 0x7ff0cc01d420 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.454+0000 7ff0d4f74700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff0c006c7a0 0x7ff0c006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.454+0000 7ff0d4f74700 1 -- 172.21.15.26:0/1218425899 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff0cc08cc00 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.454+0000 7ff0d77fe700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff0c006c7a0 0x7ff0c006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:52.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.454+0000 7ff0d77fe700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff0c006c7a0 0x7ff0c006ec60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff0d80f8900 tx=0x7ff0c800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:52.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.458+0000 7ff0d4f74700 1 -- 172.21.15.26:0/1218425899 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7ff0cc056f80 con 0x7ff0d80f8aa0 2024-05-09T00:09:52.596 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:51.008056+0000 mgr.smithi026.brymfp (mgr.34102) 1 : cephadm [INF] [09/May/2024:00:09:51] ENGINE Bus STARTING 2024-05-09T00:09:52.597 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:51.124727+0000 mgr.smithi026.brymfp (mgr.34102) 2 : cephadm [INF] [09/May/2024:00:09:51] ENGINE Serving on https://172.21.15.26:7150 2024-05-09T00:09:52.597 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:51.225994+0000 mgr.smithi026.brymfp (mgr.34102) 3 : cephadm [INF] [09/May/2024:00:09:51] ENGINE Serving on http://172.21.15.26:8765 2024-05-09T00:09:52.597 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:51.226147+0000 mgr.smithi026.brymfp (mgr.34102) 4 : cephadm [INF] [09/May/2024:00:09:51] ENGINE Bus STARTED 2024-05-09T00:09:52.597 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:52 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:51.537712+0000 mon.smithi026 (mon.0) 44 : cluster [DBG] mgrmap e36: smithi026.brymfp(active, since 1.01122s), standbys: smithi135.kkrhgf 2024-05-09T00:09:52.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.682+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0d8059120 con 0x7ff0c006c7a0 2024-05-09T00:09:52.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.684+0000 7ff0d4f74700 1 -- 172.21.15.26:0/1218425899 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ff0d8059120 con 0x7ff0c006c7a0 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff0c006c7a0 msgr2=0x7ff0c006ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff0c006c7a0 0x7ff0c006ec60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff0d80f8900 tx=0x7ff0c800b040).stop 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 msgr2=0x7ff0d8108410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 0x7ff0d8108410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff0cc013620 tx=0x7ff0cc009cb0).stop 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 shutdown_connections 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff0c006c7a0 0x7ff0c006ec60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0d80f7800 0x7ff0d8107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 --2- 172.21.15.26:0/1218425899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d80f8aa0 0x7ff0d8108410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 >> 172.21.15.26:0/1218425899 conn(0x7ff0d80f2f80 msgr2=0x7ff0d80fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 shutdown_connections 2024-05-09T00:09:52.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.686+0000 7ff0dda80700 1 -- 172.21.15.26:0/1218425899 wait complete. 2024-05-09T00:09:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.788+0000 7feb944ec700 1 -- 172.21.15.26:0/2809904014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 msgr2=0x7feb8c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.788+0000 7feb944ec700 1 --2- 172.21.15.26:0/2809904014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 0x7feb8c0ff130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7feb80004820 tx=0x7feb80009cb0).stop 2024-05-09T00:09:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.788+0000 7feb944ec700 1 -- 172.21.15.26:0/2809904014 shutdown_connections 2024-05-09T00:09:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.788+0000 7feb944ec700 1 --2- 172.21.15.26:0/2809904014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 0x7feb8c0ff130 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.788+0000 7feb944ec700 1 --2- 172.21.15.26:0/2809904014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb8c061200 0x7feb8c0fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:09:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.788+0000 7feb944ec700 1 -- 172.21.15.26:0/2809904014 >> 172.21.15.26:0/2809904014 conn(0x7feb8c0f1e50 msgr2=0x7feb8c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.788+0000 7feb944ec700 1 -- 172.21.15.26:0/2809904014 shutdown_connections 2024-05-09T00:09:52.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.788+0000 7feb944ec700 1 -- 172.21.15.26:0/2809904014 wait complete. 2024-05-09T00:09:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.789+0000 7feb944ec700 1 Processor -- start 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.789+0000 7feb944ec700 1 -- start start 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb944ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb8c061200 0x7feb8c10a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb944ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 0x7feb8c10a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb944ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c10ad30 con 0x7feb8c0fcd40 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb944ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c10ae70 con 0x7feb8c061200 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb91a87700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 0x7feb8c10a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb91a87700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 0x7feb8c10a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42160/0 (socket says 172.21.15.26:42160) 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb91a87700 1 -- 172.21.15.26:0/1125128128 learned_addr learned my addr 172.21.15.26:0/1125128128 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb92288700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb8c061200 0x7feb8c10a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb91a87700 1 -- 172.21.15.26:0/1125128128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb8c061200 msgr2=0x7feb8c10a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb91a87700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb8c061200 0x7feb8c10a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb91a87700 1 -- 172.21.15.26:0/1125128128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80005040 con 0x7feb8c0fcd40 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb92288700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb8c061200 0x7feb8c10a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb91a87700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 0x7feb8c10a6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7feb80005010 tx=0x7feb80009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb7f7fe700 1 -- 172.21.15.26:0/1125128128 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb8000e030 con 0x7feb8c0fcd40 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb7f7fe700 1 -- 172.21.15.26:0/1125128128 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb80007e90 con 0x7feb8c0fcd40 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c10f8b0 con 0x7feb8c0fcd40 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb7f7fe700 1 -- 172.21.15.26:0/1125128128 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb80018070 con 0x7feb8c0fcd40 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.790+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c10fd90 con 0x7feb8c0fcd40 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.791+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c102240 con 0x7feb8c0fcd40 2024-05-09T00:09:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.792+0000 7feb7f7fe700 1 -- 172.21.15.26:0/1125128128 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 90602+0+0 (secure 0 0 0) 0x7feb80012730 con 0x7feb8c0fcd40 2024-05-09T00:09:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.792+0000 7feb7f7fe700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb7806c7a0 0x7feb7806ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.792+0000 7feb7f7fe700 1 -- 172.21.15.26:0/1125128128 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7feb8008cda0 con 0x7feb8c0fcd40 2024-05-09T00:09:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.792+0000 7feb92288700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb7806c7a0 0x7feb7806ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.793+0000 7feb92288700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb7806c7a0 0x7feb7806ec60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7feb88009990 tx=0x7feb88008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:52.797+0000 7feb7f7fe700 1 -- 172.21.15.26:0/1125128128 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7feb80057120 con 0x7feb8c0fcd40 2024-05-09T00:09:53.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.017+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb8c059120 con 0x7feb7806c7a0 2024-05-09T00:09:53.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.027+0000 7feb7f7fe700 1 -- 172.21.15.26:0/1125128128 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7feb8c059120 con 0x7feb7806c7a0 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (111s) 43s ago 10m 15.6M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (10m) 43s ago 10m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (9m) 21s ago 9m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (93s) 43s ago 10m 45.4M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (5m) 43s ago 5m 13.9M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (5m) 43s ago 5m 213M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (5m) 21s ago 5m 14.0M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (5m) 21s ago 5m 13.8M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (66s) 43s ago 11m 469M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (26s) 21s ago 9m 52.2M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:09:53.024 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (12m) 43s ago 12m 48.0M 2048M 16.2.15-1-g8963e9de 727f386679cb 716d736ba3e0 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (9m) 21s ago 9m 45.7M 2048M 16.2.15-1-g8963e9de 727f386679cb 494b9e6f1eee 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (91s) 43s ago 10m 16.3M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (87s) 21s ago 9m 21.9M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (9m) 43s ago 9m 214M 1911M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (8m) 43s ago 8m 231M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (8m) 43s ago 8m 191M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (7m) 21s ago 7m 285M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (7m) 21s ago 7m 250M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (6m) 21s ago 6m 234M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:09:53.025 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (31s) 21s ago 9m 48.8M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.029+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb7806c7a0 msgr2=0x7feb7806ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.029+0000 7feb944ec700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb7806c7a0 0x7feb7806ec60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7feb88009990 tx=0x7feb88008040).stop 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.029+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 msgr2=0x7feb8c10a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.029+0000 7feb944ec700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 0x7feb8c10a6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7feb80005010 tx=0x7feb80009cb0).stop 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.030+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 shutdown_connections 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.030+0000 7feb944ec700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb7806c7a0 0x7feb7806ec60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.030+0000 7feb944ec700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb8c061200 0x7feb8c10a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.030+0000 7feb944ec700 1 --2- 172.21.15.26:0/1125128128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c0fcd40 0x7feb8c10a6f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.030+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 >> 172.21.15.26:0/1125128128 conn(0x7feb8c0f1e50 msgr2=0x7feb8c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.030+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 shutdown_connections 2024-05-09T00:09:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.030+0000 7feb944ec700 1 -- 172.21.15.26:0/1125128128 wait complete. 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.134+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2789678768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 msgr2=0x7fb4b40fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.134+0000 7fb4bad3a700 1 --2- 172.21.15.26:0/2789678768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 0x7fb4b40fcda0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb4a00047f0 tx=0x7fb4a0009cb0).stop 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.134+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2789678768 shutdown_connections 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.134+0000 7fb4bad3a700 1 --2- 172.21.15.26:0/2789678768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 0x7fb4b40fcda0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.134+0000 7fb4bad3a700 1 --2- 172.21.15.26:0/2789678768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4061280 0x7fb4b40fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.134+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2789678768 >> 172.21.15.26:0/2789678768 conn(0x7fb4b40f1e50 msgr2=0x7fb4b40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.134+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2789678768 shutdown_connections 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.134+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2789678768 wait complete. 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4bad3a700 1 Processor -- start 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4bad3a700 1 -- start start 2024-05-09T00:09:53.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4bad3a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4061280 0x7fb4b4108060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4bad3a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 0x7fb4b4108550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4bad3a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4108b00 con 0x7fb4b40fa950 2024-05-09T00:09:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4bad3a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4108c40 con 0x7fb4b4061280 2024-05-09T00:09:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4b3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 0x7fb4b4108550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4b3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 0x7fb4b4108550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42174/0 (socket says 172.21.15.26:42174) 2024-05-09T00:09:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4b3fff700 1 -- 172.21.15.26:0/2251566565 learned_addr learned my addr 172.21.15.26:0/2251566565 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:53.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4b8ad6700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4061280 0x7fb4b4108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4b3fff700 1 -- 172.21.15.26:0/2251566565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4061280 msgr2=0x7fb4b4108060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4b3fff700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4061280 0x7fb4b4108060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4b3fff700 1 -- 172.21.15.26:0/2251566565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a0005040 con 0x7fb4b40fa950 2024-05-09T00:09:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.135+0000 7fb4b3fff700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 0x7fb4b4108550 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb4a0013560 tx=0x7fb4a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.136+0000 7fb4b1ffb700 1 -- 172.21.15.26:0/2251566565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4a0018070 con 0x7fb4b40fa950 2024-05-09T00:09:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.136+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b410d680 con 0x7fb4b40fa950 2024-05-09T00:09:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.136+0000 7fb4b1ffb700 1 -- 172.21.15.26:0/2251566565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4a0007e90 con 0x7fb4b40fa950 2024-05-09T00:09:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.136+0000 7fb4b1ffb700 1 -- 172.21.15.26:0/2251566565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4a001c380 con 0x7fb4b40fa950 2024-05-09T00:09:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.136+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b410dc40 con 0x7fb4b40fa950 2024-05-09T00:09:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.137+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b40fffb0 con 0x7fb4b40fa950 2024-05-09T00:09:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.138+0000 7fb4b1ffb700 1 -- 172.21.15.26:0/2251566565 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 36) v1 ==== 90602+0+0 (secure 0 0 0) 0x7fb4a00123c0 con 0x7fb4b40fa950 2024-05-09T00:09:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.138+0000 7fb4b1ffb700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb4a406c7a0 0x7fb4a406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.138+0000 7fb4b1ffb700 1 -- 172.21.15.26:0/2251566565 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb4a008c5d0 con 0x7fb4b40fa950 2024-05-09T00:09:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.138+0000 7fb4b8ad6700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb4a406c7a0 0x7fb4a406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.139+0000 7fb4b8ad6700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb4a406c7a0 0x7fb4a406ec60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb4a80048b0 tx=0x7fb4a800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.142+0000 7fb4b1ffb700 1 -- 172.21.15.26:0/2251566565 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fb4a0056950 con 0x7fb4b40fa950 2024-05-09T00:09:53.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.429+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4b4101e20 con 0x7fb4b40fa950 2024-05-09T00:09:53.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.430+0000 7fb4b1ffb700 1 -- 172.21.15.26:0/2251566565 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fb4a0059f70 con 0x7fb4b40fa950 2024-05-09T00:09:53.426 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:09:53.426 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:09:53.426 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 11, 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 3 2024-05-09T00:09:53.427 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:09:53.428 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:09:53.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb4a406c7a0 msgr2=0x7fb4a406ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb4a406c7a0 0x7fb4a406ec60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb4a80048b0 tx=0x7fb4a800b040).stop 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 msgr2=0x7fb4b4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 0x7fb4b4108550 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb4a0013560 tx=0x7fb4a0009cb0).stop 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 shutdown_connections 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb4a406c7a0 0x7fb4a406ec60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4b4061280 0x7fb4b4108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 --2- 172.21.15.26:0/2251566565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4b40fa950 0x7fb4b4108550 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 >> 172.21.15.26:0/2251566565 conn(0x7fb4b40f1e50 msgr2=0x7fb4b40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 shutdown_connections 2024-05-09T00:09:53.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.432+0000 7fb4bad3a700 1 -- 172.21.15.26:0/2251566565 wait complete. 2024-05-09T00:09:53.499 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:51.542583+0000 mgr.smithi026.brymfp (mgr.34102) 5 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:53.500 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:52.328924+0000 mgr.smithi026.brymfp (mgr.34102) 6 : audit [DBG] from='client.24631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.536+0000 7f6172ab2700 1 -- 172.21.15.26:0/756388229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 msgr2=0x7f616c0f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.536+0000 7f6172ab2700 1 --2- 172.21.15.26:0/756388229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 0x7f616c0f7c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f61600047f0 tx=0x7f6160009cb0).stop 2024-05-09T00:09:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.536+0000 7f6172ab2700 1 -- 172.21.15.26:0/756388229 shutdown_connections 2024-05-09T00:09:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.536+0000 7f6172ab2700 1 --2- 172.21.15.26:0/756388229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f616c0f8aa0 0x7f616c0f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.537+0000 7f6172ab2700 1 --2- 172.21.15.26:0/756388229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 0x7f616c0f7c20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.537+0000 7f6172ab2700 1 -- 172.21.15.26:0/756388229 >> 172.21.15.26:0/756388229 conn(0x7f616c0f2f80 msgr2=0x7f616c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.537+0000 7f6172ab2700 1 -- 172.21.15.26:0/756388229 shutdown_connections 2024-05-09T00:09:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.537+0000 7f6172ab2700 1 -- 172.21.15.26:0/756388229 wait complete. 2024-05-09T00:09:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.537+0000 7f6172ab2700 1 Processor -- start 2024-05-09T00:09:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.537+0000 7f6172ab2700 1 -- start start 2024-05-09T00:09:53.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f6172ab2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 0x7f616c108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f6172ab2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f616c0f8aa0 0x7f616c108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f6172ab2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c108b20 con 0x7f616c0f7800 2024-05-09T00:09:53.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f6172ab2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c108c60 con 0x7f616c0f8aa0 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f617084e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 0x7f616c108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f617084e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 0x7f616c108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42190/0 (socket says 172.21.15.26:42190) 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f617084e700 1 -- 172.21.15.26:0/2076326634 learned_addr learned my addr 172.21.15.26:0/2076326634 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f616bfff700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f616c0f8aa0 0x7f616c108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f617084e700 1 -- 172.21.15.26:0/2076326634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f616c0f8aa0 msgr2=0x7f616c108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f617084e700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f616c0f8aa0 0x7f616c108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f617084e700 1 -- 172.21.15.26:0/2076326634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160005040 con 0x7f616c0f7800 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.538+0000 7f617084e700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 0x7f616c108080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6160000c00 tx=0x7f6160009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.540+0000 7f6169f76700 1 -- 172.21.15.26:0/2076326634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6160018070 con 0x7f616c0f7800 2024-05-09T00:09:53.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.540+0000 7f6169f76700 1 -- 172.21.15.26:0/2076326634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6160007e90 con 0x7f616c0f7800 2024-05-09T00:09:53.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.540+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c10d6a0 con 0x7f616c0f7800 2024-05-09T00:09:53.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.540+0000 7f6169f76700 1 -- 172.21.15.26:0/2076326634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6160012620 con 0x7f616c0f7800 2024-05-09T00:09:53.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.541+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c10dc60 con 0x7f616c0f7800 2024-05-09T00:09:53.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.542+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c0fffe0 con 0x7f616c0f7800 2024-05-09T00:09:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.544+0000 7f6169f76700 1 -- 172.21.15.26:0/2076326634 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 37) v1 ==== 90896+0+0 (secure 0 0 0) 0x7f616001d960 con 0x7f616c0f7800 2024-05-09T00:09:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.544+0000 7f6169f76700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f615c06cb40 0x7f615c06f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.544+0000 7f6169f76700 1 -- 172.21.15.26:0/2076326634 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f616008cef0 con 0x7f616c0f7800 2024-05-09T00:09:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.544+0000 7f616bfff700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f615c06cb40 0x7f615c06f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:53.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.545+0000 7f616bfff700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f615c06cb40 0x7f615c06f000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6158004ee0 tx=0x7f615800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:53.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.548+0000 7f6169f76700 1 -- 172.21.15.26:0/2076326634 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f616005aa70 con 0x7f616c0f7800 2024-05-09T00:09:53.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.794+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f616c0598f0 con 0x7f616c0f7800 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.795+0000 7f6169f76700 1 -- 172.21.15.26:0/2076326634 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f616005a600 con 0x7f616c0f7800 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:09:53.791 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:09:53.792 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:09:53.793 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:53.794 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:53.794 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:09:53.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f615c06cb40 msgr2=0x7f615c06f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f615c06cb40 0x7f615c06f000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6158004ee0 tx=0x7f615800b040).stop 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 msgr2=0x7f616c108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 0x7f616c108080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6160000c00 tx=0x7f6160009cb0).stop 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 shutdown_connections 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f615c06cb40 0x7f615c06f000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f616c0f7800 0x7f616c108080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 --2- 172.21.15.26:0/2076326634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f616c0f8aa0 0x7f616c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 >> 172.21.15.26:0/2076326634 conn(0x7f616c0f2f80 msgr2=0x7f616c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 shutdown_connections 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.797+0000 7f6172ab2700 1 -- 172.21.15.26:0/2076326634 wait complete. 2024-05-09T00:09:53.795 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:09:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.905+0000 7fc706ae1700 1 -- 172.21.15.26:0/1186391415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7000f5ab0 msgr2=0x7fc7000f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.905+0000 7fc706ae1700 1 --2- 172.21.15.26:0/1186391415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7000f5ab0 0x7fc7000f5ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc6f40047f0 tx=0x7fc6f4009cb0).stop 2024-05-09T00:09:53.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.905+0000 7fc706ae1700 1 -- 172.21.15.26:0/1186391415 shutdown_connections 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.905+0000 7fc706ae1700 1 --2- 172.21.15.26:0/1186391415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7000f6450 0x7fc7000f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.905+0000 7fc706ae1700 1 --2- 172.21.15.26:0/1186391415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7000f5ab0 0x7fc7000f5ed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.905+0000 7fc706ae1700 1 -- 172.21.15.26:0/1186391415 >> 172.21.15.26:0/1186391415 conn(0x7fc7000f15d0 msgr2=0x7fc7000f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.905+0000 7fc706ae1700 1 -- 172.21.15.26:0/1186391415 shutdown_connections 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.905+0000 7fc706ae1700 1 -- 172.21.15.26:0/1186391415 wait complete. 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.906+0000 7fc706ae1700 1 Processor -- start 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.906+0000 7fc706ae1700 1 -- start start 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.906+0000 7fc706ae1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7000f5ab0 0x7fc700107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.906+0000 7fc706ae1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7000f6450 0x7fc7001084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.906+0000 7fc706ae1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc700108a80 con 0x7fc7000f6450 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.906+0000 7fc706ae1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc700108bc0 con 0x7fc7000f5ab0 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.906+0000 7fc70487d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7000f5ab0 0x7fc700107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc70487d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7000f5ab0 0x7fc700107fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.26:57172/0 (socket says 172.21.15.26:57172) 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc70487d700 1 -- 172.21.15.26:0/3344978921 learned_addr learned my addr 172.21.15.26:0/3344978921 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:53.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc6fffff700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7000f6450 0x7fc7001084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc70487d700 1 -- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7000f6450 msgr2=0x7fc7001084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc70487d700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7000f6450 0x7fc7001084d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc70487d700 1 -- 172.21.15.26:0/3344978921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f4005040 con 0x7fc7000f5ab0 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc70487d700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7000f5ab0 0x7fc700107fe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc6f4013620 tx=0x7fc6f4009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc6fdf76700 1 -- 172.21.15.26:0/3344978921 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f400e030 con 0x7fc7000f5ab0 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70010d600 con 0x7fc7000f5ab0 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc6fdf76700 1 -- 172.21.15.26:0/3344978921 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6f4007e90 con 0x7fc7000f5ab0 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc6fdf76700 1 -- 172.21.15.26:0/3344978921 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f4018070 con 0x7fc7000f5ab0 2024-05-09T00:09:53.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.907+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70010dbc0 con 0x7fc7000f5ab0 2024-05-09T00:09:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.908+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc700100000 con 0x7fc7000f5ab0 2024-05-09T00:09:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.910+0000 7fc6fdf76700 1 -- 172.21.15.26:0/3344978921 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 37) v1 ==== 90888+0+0 (secure 0 0 0) 0x7fc6f401d420 con 0x7fc7000f5ab0 2024-05-09T00:09:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.910+0000 7fc6fdf76700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6f006cb40 0x7fc6f006f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:53.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.910+0000 7fc6fdf76700 1 -- 172.21.15.26:0/3344978921 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc6f408d4d0 con 0x7fc7000f5ab0 2024-05-09T00:09:53.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.910+0000 7fc6fffff700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6f006cb40 0x7fc6f006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:53.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.910+0000 7fc6fffff700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6f006cb40 0x7fc6f006f000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc7000f6890 tx=0x7fc6ec00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:53.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:53.915+0000 7fc6fdf76700 1 -- 172.21.15.26:0/3344978921 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc6f405af20 con 0x7fc7000f5ab0 2024-05-09T00:09:54.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.136+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc700059120 con 0x7fc6f006cb40 2024-05-09T00:09:54.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.137+0000 7fc6fdf76700 1 -- 172.21.15.26:0/3344978921 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fc700059120 con 0x7fc6f006cb40 2024-05-09T00:09:54.133 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:09:54.133 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr" 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "2/21 daemons upgraded", 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "", 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:09:54.134 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.139+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6f006cb40 msgr2=0x7fc6f006f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.139+0000 7fc706ae1700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6f006cb40 0x7fc6f006f000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc7000f6890 tx=0x7fc6ec00b040).stop 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.139+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7000f5ab0 msgr2=0x7fc700107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.139+0000 7fc706ae1700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7000f5ab0 0x7fc700107fe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc6f4013620 tx=0x7fc6f4009cb0).stop 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.140+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 shutdown_connections 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.140+0000 7fc706ae1700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6f006cb40 0x7fc6f006f000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.140+0000 7fc706ae1700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7000f5ab0 0x7fc700107fe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.140+0000 7fc706ae1700 1 --2- 172.21.15.26:0/3344978921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7000f6450 0x7fc7001084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.140+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 >> 172.21.15.26:0/3344978921 conn(0x7fc7000f15d0 msgr2=0x7fc7000fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.140+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 shutdown_connections 2024-05-09T00:09:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.140+0000 7fc706ae1700 1 -- 172.21.15.26:0/3344978921 wait complete. 2024-05-09T00:09:54.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 -- 172.21.15.26:0/88089440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f7990 msgr2=0x7f50280f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:54.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 --2- 172.21.15.26:0/88089440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f7990 0x7f50280f7df0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f50180047f0 tx=0x7f5018009cb0).stop 2024-05-09T00:09:54.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 -- 172.21.15.26:0/88089440 shutdown_connections 2024-05-09T00:09:54.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 --2- 172.21.15.26:0/88089440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f7990 0x7f50280f7df0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 --2- 172.21.15.26:0/88089440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50280f66f0 0x7f50280f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 -- 172.21.15.26:0/88089440 >> 172.21.15.26:0/88089440 conn(0x7f50280f1e50 msgr2=0x7f50280f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:54.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 -- 172.21.15.26:0/88089440 shutdown_connections 2024-05-09T00:09:54.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 -- 172.21.15.26:0/88089440 wait complete. 2024-05-09T00:09:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 Processor -- start 2024-05-09T00:09:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.242+0000 7f502fadb700 1 -- start start 2024-05-09T00:09:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502fadb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f66f0 0x7f50280fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502fadb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50280f7990 0x7f50280f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:54.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502fadb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280fac20 con 0x7f50280f66f0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502fadb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280f91c0 con 0x7f50280f7990 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502d877700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f66f0 0x7f50280fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502d877700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f66f0 0x7f50280fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42224/0 (socket says 172.21.15.26:42224) 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502d877700 1 -- 172.21.15.26:0/4064611344 learned_addr learned my addr 172.21.15.26:0/4064611344 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502d076700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50280f7990 0x7f50280f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502d877700 1 -- 172.21.15.26:0/4064611344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50280f7990 msgr2=0x7f50280f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502d877700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50280f7990 0x7f50280f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502d877700 1 -- 172.21.15.26:0/4064611344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018005040 con 0x7f50280f66f0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f502d877700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f66f0 0x7f50280fa670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5024002770 tx=0x7f5024002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.243+0000 7f501ef78700 1 -- 172.21.15.26:0/4064611344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5024007b40 con 0x7f50280f66f0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.244+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50280f9440 con 0x7f50280f66f0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.244+0000 7f501ef78700 1 -- 172.21.15.26:0/4064611344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f502400f040 con 0x7f50280f66f0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.244+0000 7f501ef78700 1 -- 172.21.15.26:0/4064611344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5024014820 con 0x7f50280f66f0 2024-05-09T00:09:54.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.244+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50280f9980 con 0x7f50280f66f0 2024-05-09T00:09:54.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.244+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50280feeb0 con 0x7f50280f66f0 2024-05-09T00:09:54.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.245+0000 7f501ef78700 1 -- 172.21.15.26:0/4064611344 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 37) v1 ==== 90896+0+0 (secure 0 0 0) 0x7f5024007ca0 con 0x7f50280f66f0 2024-05-09T00:09:54.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.246+0000 7f501ef78700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f501406cb40 0x7f501406f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:09:54.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.246+0000 7f501ef78700 1 -- 172.21.15.26:0/4064611344 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f502408be20 con 0x7f50280f66f0 2024-05-09T00:09:54.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.246+0000 7f502d076700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f501406cb40 0x7f501406f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:54.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.246+0000 7f502d076700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f501406cb40 0x7f501406f000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5018004f10 tx=0x7f501800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:54.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.250+0000 7f501ef78700 1 -- 172.21.15.26:0/4064611344 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f50240597b0 con 0x7f50280f66f0 2024-05-09T00:09:54.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:52.537979+0000 mgr.smithi026.brymfp (mgr.34102) 7 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:54.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:52.684089+0000 mgr.smithi026.brymfp (mgr.34102) 8 : audit [DBG] from='client.24635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:54.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:53.019077+0000 mgr.smithi026.brymfp (mgr.34102) 9 : audit [DBG] from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:54.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:53.430658+0000 mon.smithi026 (mon.0) 45 : audit [DBG] from='client.? 172.21.15.26:0/2251566565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:09:54.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:53.540978+0000 mon.smithi026 (mon.0) 46 : cluster [DBG] mgrmap e37: smithi026.brymfp(active, since 3s), standbys: smithi135.kkrhgf 2024-05-09T00:09:54.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:54 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:53.795299+0000 mon.smithi026 (mon.0) 47 : audit [DBG] from='client.? 172.21.15.26:0/2076326634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:09:54.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.555+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5028110480 con 0x7f50280f66f0 2024-05-09T00:09:54.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.556+0000 7f501ef78700 1 -- 172.21.15.26:0/4064611344 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5024059340 con 0x7f50280f66f0 2024-05-09T00:09:54.552 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:09:54.552 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:09:54.552 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:09:54.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f501406cb40 msgr2=0x7f501406f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:54.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f501406cb40 0x7f501406f000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5018004f10 tx=0x7f501800b040).stop 2024-05-09T00:09:54.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f66f0 msgr2=0x7f50280fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:54.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f66f0 0x7f50280fa670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5024002770 tx=0x7f5024002a80).stop 2024-05-09T00:09:54.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 shutdown_connections 2024-05-09T00:09:54.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f501406cb40 0x7f501406f000 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50280f66f0 0x7f50280fa670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 --2- 172.21.15.26:0/4064611344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50280f7990 0x7f50280f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:09:54.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 >> 172.21.15.26:0/4064611344 conn(0x7f50280f1e50 msgr2=0x7f5028060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:54.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 shutdown_connections 2024-05-09T00:09:54.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:09:54.558+0000 7f502fadb700 1 -- 172.21.15.26:0/4064611344 wait complete. 2024-05-09T00:09:55.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:54.137777+0000 mgr.smithi026.brymfp (mgr.34102) 10 : audit [DBG] from='client.24653 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:09:55.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:54.556467+0000 mon.smithi026 (mon.0) 48 : audit [DBG] from='client.? 172.21.15.26:0/4064611344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:09:55.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:54.703228+0000 mon.smithi026 (mon.0) 49 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:55.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:54.707902+0000 mon.smithi026 (mon.0) 50 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:56.394 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:54.538289+0000 mgr.smithi026.brymfp (mgr.34102) 11 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:56.394 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:55.257574+0000 mon.smithi026 (mon.0) 51 : cluster [DBG] mgrmap e38: smithi026.brymfp(active, since 4s), standbys: smithi135.kkrhgf 2024-05-09T00:09:56.395 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:55.348318+0000 mon.smithi026 (mon.0) 52 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:56.395 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:55.353720+0000 mon.smithi026 (mon.0) 53 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:56.395 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:55.426545+0000 mon.smithi026 (mon.0) 54 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:56.395 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:55.430448+0000 mon.smithi026 (mon.0) 55 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:56.395 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:56.114560+0000 mon.smithi026 (mon.0) 56 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:56.395 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:56 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:56.118703+0000 mon.smithi026 (mon.0) 57 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:58.339 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:58 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:56.538695+0000 mgr.smithi026.brymfp (mgr.34102) 12 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:09:59.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:58.390037+0000 mon.smithi026 (mon.0) 58 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:59.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:58.394839+0000 mon.smithi026 (mon.0) 59 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:09:59.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:58.396402+0000 mon.smithi026 (mon.0) 60 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:59.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:09:59 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:58.397461+0000 mon.smithi026 (mon.0) 61 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:58.398855+0000 mgr.smithi026.brymfp (mgr.34102) 13 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:58.399065+0000 mgr.smithi026.brymfp (mgr.34102) 14 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:09:58.539149+0000 mgr.smithi026.brymfp (mgr.34102) 15 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:58.663116+0000 mgr.smithi026.brymfp (mgr.34102) 16 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:58.663604+0000 mgr.smithi026.brymfp (mgr.34102) 17 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:58.927315+0000 mgr.smithi026.brymfp (mgr.34102) 18 : cephadm [INF] Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:58.927918+0000 mgr.smithi026.brymfp (mgr.34102) 19 : cephadm [INF] Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:59.191654+0000 mgr.smithi026.brymfp (mgr.34102) 20 : cephadm [INF] Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:09:59.192211+0000 mgr.smithi026.brymfp (mgr.34102) 21 : cephadm [INF] Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:59.459988+0000 mon.smithi026 (mon.0) 62 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:59.465193+0000 mon.smithi026 (mon.0) 63 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:59.468769+0000 mon.smithi026 (mon.0) 64 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:00.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:59.472962+0000 mon.smithi026 (mon.0) 65 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:00.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:59.476672+0000 mon.smithi026 (mon.0) 66 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:00.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:59.614510+0000 mon.smithi026 (mon.0) 67 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:00.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:59.616999+0000 mon.smithi026 (mon.0) 68 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:00.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:09:59.617985+0000 mon.smithi026 (mon.0) 69 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T00:10:00.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:00 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:10:00.000103+0000 mon.smithi026 (mon.0) 70 : cluster [WRN] overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:02.398 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cluster 2024-05-09T00:10:00.539724+0000 mgr.smithi026.brymfp (mgr.34102) 22 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-05-09T00:10:02.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:10:01.035842+0000 mgr.smithi026.brymfp (mgr.34102) 23 : cephadm [INF] Upgrade: Updating mon.smithi135 2024-05-09T00:10:02.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:10:01.041008+0000 mon.smithi026 (mon.0) 71 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:02.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:10:01.041950+0000 mon.smithi026 (mon.0) 72 : audit [INF] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:10:02.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:10:01.042652+0000 mon.smithi026 (mon.0) 73 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:10:02.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: audit 2024-05-09T00:10:01.043383+0000 mon.smithi026 (mon.0) 74 : audit [DBG] from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:02.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: cephadm 2024-05-09T00:10:01.044366+0000 mgr.smithi026.brymfp (mgr.34102) 24 : cephadm [INF] Deploying daemon mon.smithi135 on smithi135 2024-05-09T00:10:03.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:03 smithi135 systemd[1]: Stopping Ceph mon.smithi135 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:10:03.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: debug 2024-05-09T00:10:03.309+0000 7f502e9af700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi135 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-05-09T00:10:03.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[43032]: debug 2024-05-09T00:10:03.309+0000 7f502e9af700 -1 mon.smithi135@1(peon) e2 *** Got Signal Terminated *** 2024-05-09T00:10:04.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:03 smithi135 bash[80269]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135 2024-05-09T00:10:04.619 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi135.service: Succeeded. 2024-05-09T00:10:04.619 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 systemd[1]: Stopped Ceph mon.smithi135 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:10:04.620 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 systemd[1]: Starting Ceph mon.smithi135 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:10:04.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable), process ceph-mon, pid 7 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: pidfile_write: ignore empty --pid-file 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: load: jerasure load: lrc 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: RocksDB version: 7.9.2 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Git sha 0 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Compile date 2024-05-08 17:55:50 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: DB SUMMARY 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: DB Session ID: FK8CG1JORVK639FR74OU 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: CURRENT file: CURRENT 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: MANIFEST file: MANIFEST-000005 size: 813 Bytes 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi135/store.db dir, Total Num: 1, files: 000019.sst 2024-05-09T00:10:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi135/store.db: 000017.log size: 10027137 ; 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.error_if_exists: 0 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.create_if_missing: 0 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.paranoid_checks: 1 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.env: 0x55ec58184820 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.info_log: 0x55ec59f2f3e0 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.statistics: (nil) 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.use_fsync: 0 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_log_file_size: 0 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T00:10:04.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.allow_fallocate: 1 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.use_direct_reads: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.db_log_dir: 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.wal_dir: 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T00:10:04.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.write_buffer_manager: 0x55ec591a4140 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T00:10:04.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.unordered_write: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.row_cache: None 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.wal_filter: None 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.two_write_queues: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.wal_compression: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.atomic_flush: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T00:10:04.904 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.log_readahead_size: 0 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T00:10:04.905 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_background_jobs: 2 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_background_compactions: -1 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_subcompactions: 1 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_open_files: -1 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T00:10:04.906 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_background_flushes: -1 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Compression algorithms supported: 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: kZSTD supported: 0 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: kXpressCompression supported: 0 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: kZlibCompression supported: 1 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: kSnappyCompression supported: 1 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: kLZ4Compression supported: 1 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: kBZip2Compression supported: 0 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi135/store.db/MANIFEST-000005 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T00:10:04.907 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.merge_operator: 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_filter: None 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ec59f2f500) 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: index_type: 0 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: data_block_index_type: 0 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: index_shortening: 1 2024-05-09T00:10:04.908 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: checksum: 4 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: no_block_cache: 0 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_cache: 0x55ec592471f0 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_cache_options: 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: capacity : 536870912 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: num_shard_bits : 4 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: strict_capacity_limit : 0 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_cache_compressed: (nil) 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: persistent_cache: (nil) 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_size: 4096 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_size_deviation: 10 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_restart_interval: 16 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: index_block_restart_interval: 1 2024-05-09T00:10:04.909 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: metadata_block_size: 4096 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: partition_filters: 0 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: use_delta_encoding: 1 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: filter_policy: bloomfilter 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: whole_key_filtering: 1 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: verify_compression: 0 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: format_version: 5 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: enable_index_compression: 1 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_align: 0 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: max_auto_readahead_size: 262144 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: prepopulate_block_cache: 0 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: initial_auto_readahead_size: 8192 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T00:10:04.910 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression: NoCompression 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.num_levels: 7 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T00:10:04.911 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T00:10:04.912 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T00:10:04.913 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T00:10:04.914 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T00:10:04.915 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.table_properties_collectors: 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.inplace_update_support: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.bloom_locality: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.max_successive_merges: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.ttl: 2592000 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T00:10:04.916 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.enable_blob_files: false 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.min_blob_size: 0 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 19.sst 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi135/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 21, last_sequence is 9173, log_number is 17,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 17 2024-05-09T00:10:04.917 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 19faf425-f7a7-45df-942c-c44e77121fad 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715213404775197, "job": 1, "event": "recovery_started", "wal_files": [17]} 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #17 mode 2 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715213404800987, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 22, "file_size": 6330893, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 9178, "largest_seqno": 10390, "table_properties": {"data_size": 6323216, "index_size": 5698, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 965, "raw_key_size": 7569, "raw_average_key_size": 20, "raw_value_size": 6311832, "raw_average_value_size": 16876, "num_data_blocks": 255, "num_entries": 374, "num_filter_entries": 374, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715213404, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "19faf425-f7a7-45df-942c-c44e77121fad", "db_session_id": "FK8CG1JORVK639FR74OU", "orig_file_number": 22, "seqno_to_time_mapping": "N/A"}} 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715213404801134, "job": 1, "event": "recovery_finished"} 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/version_set.cc:5047] Creating manifest 24 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi135/store.db/000017.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ec592e4000 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 bash[80428]: f09e06117134a01b94e39dd6d39001a2829617e7043583d8abe70e768fef0a7d 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: DB pointer 0x55ec592d2000 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T00:10:04.918 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ** DB Stats ** 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ** Compaction Stats [default] ** 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: L0 1/0 6.04 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 537.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: L6 1/0 24.46 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-09T00:10:04.919 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Sum 2/0 30.50 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 537.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 537.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ** Compaction Stats [default] ** 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 537.2 0.01 0.00 1 0.011 0 0 0.0 0.0 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Flush(GB): cumulative 0.006, interval 0.006 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T00:10:04.920 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Cumulative compaction: 0.01 GB write, 208.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Interval compaction: 0.01 GB write, 208.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Block cache BinnedLRUCache@0x55ec592471f0#7 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.03 KB,0.000196695%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: starting mon.smithi135 rank 1 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi135 fsid aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: mon.smithi135@-1(???) e2 preinit fsid aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: mon.smithi135@-1(???).mds e11 new map 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: mon.smithi135@-1(???).mds e11 print_map 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: e11 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:10:04.921 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: legacy client fscid: 1 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Filesystem 'cephfs' (1) 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: fs_name cephfs 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: epoch 11 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: tableserver 0 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: root 0 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: session_timeout 60 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: session_autoclose 300 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: max_file_size 1099511627776 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: max_xattr_size 65536 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: required_client_features {} 2024-05-09T00:10:04.922 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: last_failure 0 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: last_failure_osd_epoch 0 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: max_mds 1 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: in 0 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: up {0=14434} 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: failed 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: damaged 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: stopped 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: data_pools [3] 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: metadata_pool 2 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: inline_data enabled 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: balancer 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: bal_rank_mask -1 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: standby_count_wanted 1 2024-05-09T00:10:04.923 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: [mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Standby daemons: 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: [mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: [mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: [mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: mon.smithi135@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: mon.smithi135@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: mon.smithi135@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: mon.smithi135@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 systemd[1]: Started Ceph mon.smithi135 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:10:04.924 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:04 smithi135 ceph-mon[80466]: mon.smithi135@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-05-09T00:10:07.362 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mkfs aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-09T00:10:07.362 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mkfs aa42787e-0d96-11ef-bc97-c7b262605968 2024-05-09T00:10:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring alertmanager.smithi026 (dependencies changed)... 2024-05-09T00:10:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring daemon alertmanager.smithi026 on smithi026 2024-05-09T00:10:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring grafana.smithi026 (dependencies changed)... 2024-05-09T00:10:07.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring daemon grafana.smithi026 on smithi026 2024-05-09T00:10:07.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring node-exporter.smithi026 (dependencies changed)... 2024-05-09T00:10:07.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring daemon node-exporter.smithi026 on smithi026 2024-05-09T00:10:07.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring node-exporter.smithi135 (dependencies changed)... 2024-05-09T00:10:07.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring daemon node-exporter.smithi135 on smithi135 2024-05-09T00:10:07.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring prometheus.smithi135 (dependencies changed)... 2024-05-09T00:10:07.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring daemon prometheus.smithi135 on smithi135 2024-05-09T00:10:07.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Upgrade: Need to upgrade myself (mgr.smithi135.kkrhgf) 2024-05-09T00:10:07.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Upgrade: Need to upgrade myself (mgr.smithi135.kkrhgf) 2024-05-09T00:10:07.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Upgrade: Updating mgr.smithi026.brymfp 2024-05-09T00:10:07.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Deploying daemon mgr.smithi026.brymfp on smithi026 2024-05-09T00:10:07.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [09/May/2024:00:09:04] ENGINE Bus STARTING 2024-05-09T00:10:07.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [09/May/2024:00:09:05] ENGINE Serving on https://172.21.15.26:7150 2024-05-09T00:10:07.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [09/May/2024:00:09:05] ENGINE Serving on http://172.21.15.26:8765 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [09/May/2024:00:09:05] ENGINE Bus STARTED 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v6: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 872 KiB/s wr, 232 op/s 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 456 op/s 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e31: smithi026.brymfp(active, since 8s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 945 KiB/s wr, 354 op/s 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:10:07.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v9: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 578 op/s 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring prometheus.smithi135 (dependencies changed)... 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Reconfiguring daemon prometheus.smithi135 on smithi135 2024-05-09T00:10:07.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v10: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.3 MiB/s wr, 530 op/s 2024-05-09T00:10:07.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v11: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.7 MiB/s wr, 735 op/s 2024-05-09T00:10:07.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v12: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.7 MiB/s wr, 1.03k op/s 2024-05-09T00:10:07.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Upgrade: Updating mgr.smithi135.kkrhgf 2024-05-09T00:10:07.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Deploying daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:10:07.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v13: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 863 op/s 2024-05-09T00:10:07.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v14: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.1 MiB/s wr, 1.23k op/s 2024-05-09T00:10:07.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v15: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 966 op/s 2024-05-09T00:10:07.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v16: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 1.05k op/s 2024-05-09T00:10:07.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v17: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.7 MiB/s wr, 1.01k op/s 2024-05-09T00:10:07.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v18: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 612 op/s 2024-05-09T00:10:07.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Standby manager daemon smithi135.kkrhgf restarted 2024-05-09T00:10:07.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:10:07.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e32: smithi026.brymfp(active, since 31s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v19: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 768 op/s 2024-05-09T00:10:07.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v20: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 402 op/s 2024-05-09T00:10:07.655 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all mgr 2024-05-09T00:10:07.655 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Upgrade: Updating mon.smithi026 2024-05-09T00:10:07.655 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Deploying daemon mon.smithi026 on smithi026 2024-05-09T00:10:07.655 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v22: 65 pgs: 65 active+clean; 200 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 951 KiB/s wr, 339 op/s 2024-05-09T00:10:07.655 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mon.smithi026 calling monitor election 2024-05-09T00:10:07.655 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mon.smithi026 is new leader, mons smithi026,smithi135 in quorum (ranks 0,1) 2024-05-09T00:10:07.655 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e32: smithi026.brymfp(active, since 39s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e33: smithi026.brymfp(active, since 39s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Standby manager daemon smithi135.kkrhgf restarted 2024-05-09T00:10:07.656 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e34: smithi026.brymfp(active, since 46s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Active manager daemon smithi026.brymfp restarted 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Activating manager daemon smithi026.brymfp 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e35: smithi026.brymfp(active, starting, since 0.00520346s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-09T00:10:07.657 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi135.kkrhgf", "id": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:10:07.658 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:10:07.659 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Manager daemon smithi026.brymfp is now available 2024-05-09T00:10:07.659 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:07.659 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:10:07.659 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:10:07.659 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-09T00:10:07.659 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [09/May/2024:00:09:51] ENGINE Bus STARTING 2024-05-09T00:10:07.659 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [09/May/2024:00:09:51] ENGINE Serving on https://172.21.15.26:7150 2024-05-09T00:10:07.660 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.660 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.660 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [09/May/2024:00:09:51] ENGINE Serving on http://172.21.15.26:8765 2024-05-09T00:10:07.660 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [09/May/2024:00:09:51] ENGINE Bus STARTED 2024-05-09T00:10:07.660 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e36: smithi026.brymfp(active, since 1.01122s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.660 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v3: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:07.660 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='client.24631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:07.661 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v4: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:07.661 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='client.24635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:07.661 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:07.661 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2251566565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:07.661 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e37: smithi026.brymfp(active, since 3s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.661 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2076326634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:10:07.661 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:07.662 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v5: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:07.662 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/4064611344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:10:07.662 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.662 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.662 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e38: smithi026.brymfp(active, since 4s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.662 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.662 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.663 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.663 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.663 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.663 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.663 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v6: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:07.663 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.663 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.664 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:07.664 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:10:07.664 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:10:07.664 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:10:07.664 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v7: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-05-09T00:10:07.664 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:07.664 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:07.665 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.665 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.665 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.665 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.665 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.665 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.665 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.666 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.666 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.666 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:07.666 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:07.666 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T00:10:07.666 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.667 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v8: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-05-09T00:10:07.667 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Upgrade: Updating mon.smithi135 2024-05-09T00:10:07.667 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.667 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:10:07.667 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:10:07.667 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:07.667 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Deploying daemon mon.smithi135 on smithi135 2024-05-09T00:10:07.668 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: pgmap v9: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-09T00:10:07.668 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:10:07.668 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mon.smithi026 calling monitor election 2024-05-09T00:10:07.668 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mon.smithi135 calling monitor election 2024-05-09T00:10:07.668 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mon.smithi026 is new leader, mons smithi026,smithi135 in quorum (ranks 0,1) 2024-05-09T00:10:07.668 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:10:07.668 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: monmap e3: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T00:10:07.669 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:10:07.669 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T00:10:07.669 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: mgrmap e38: smithi026.brymfp(active, since 15s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.669 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.669 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.669 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:10:07.669 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.670 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:07.671 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring alertmanager.smithi026 (dependencies changed)... 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring daemon alertmanager.smithi026 on smithi026 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring grafana.smithi026 (dependencies changed)... 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring daemon grafana.smithi026 on smithi026 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring node-exporter.smithi026 (dependencies changed)... 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring daemon node-exporter.smithi026 on smithi026 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring node-exporter.smithi135 (dependencies changed)... 2024-05-09T00:10:07.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring daemon node-exporter.smithi135 on smithi135 2024-05-09T00:10:07.673 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring prometheus.smithi135 (dependencies changed)... 2024-05-09T00:10:07.673 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring daemon prometheus.smithi135 on smithi135 2024-05-09T00:10:07.673 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Upgrade: Need to upgrade myself (mgr.smithi135.kkrhgf) 2024-05-09T00:10:07.673 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Upgrade: Need to upgrade myself (mgr.smithi135.kkrhgf) 2024-05-09T00:10:07.673 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Upgrade: Updating mgr.smithi026.brymfp 2024-05-09T00:10:07.673 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Deploying daemon mgr.smithi026.brymfp on smithi026 2024-05-09T00:10:07.673 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [09/May/2024:00:09:04] ENGINE Bus STARTING 2024-05-09T00:10:07.673 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [09/May/2024:00:09:05] ENGINE Serving on https://172.21.15.26:7150 2024-05-09T00:10:07.674 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [09/May/2024:00:09:05] ENGINE Serving on http://172.21.15.26:8765 2024-05-09T00:10:07.674 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [09/May/2024:00:09:05] ENGINE Bus STARTED 2024-05-09T00:10:07.674 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v6: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 872 KiB/s wr, 232 op/s 2024-05-09T00:10:07.674 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:10:07.674 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 456 op/s 2024-05-09T00:10:07.674 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e31: smithi026.brymfp(active, since 8s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.674 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 945 KiB/s wr, 354 op/s 2024-05-09T00:10:07.675 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:10:07.675 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:10:07.675 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:07.675 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:07.675 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.675 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.675 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v9: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 578 op/s 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring prometheus.smithi135 (dependencies changed)... 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Reconfiguring daemon prometheus.smithi135 on smithi135 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v10: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.3 MiB/s wr, 530 op/s 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v11: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.7 MiB/s wr, 735 op/s 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v12: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.7 MiB/s wr, 1.03k op/s 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Upgrade: Updating mgr.smithi135.kkrhgf 2024-05-09T00:10:07.676 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Deploying daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:10:07.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v13: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 863 op/s 2024-05-09T00:10:07.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v14: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.1 MiB/s wr, 1.23k op/s 2024-05-09T00:10:07.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v15: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 966 op/s 2024-05-09T00:10:07.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v16: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 1.05k op/s 2024-05-09T00:10:07.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v17: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.7 MiB/s wr, 1.01k op/s 2024-05-09T00:10:07.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v18: 65 pgs: 65 active+clean; 231 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 612 op/s 2024-05-09T00:10:07.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Standby manager daemon smithi135.kkrhgf restarted 2024-05-09T00:10:07.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:10:07.678 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e32: smithi026.brymfp(active, since 31s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.678 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v19: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 768 op/s 2024-05-09T00:10:07.678 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v20: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 402 op/s 2024-05-09T00:10:07.678 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all mgr 2024-05-09T00:10:07.678 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Upgrade: Updating mon.smithi026 2024-05-09T00:10:07.679 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Deploying daemon mon.smithi026 on smithi026 2024-05-09T00:10:07.679 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v22: 65 pgs: 65 active+clean; 200 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 951 KiB/s wr, 339 op/s 2024-05-09T00:10:07.679 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mon.smithi026 calling monitor election 2024-05-09T00:10:07.679 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mon.smithi026 is new leader, mons smithi026,smithi135 in quorum (ranks 0,1) 2024-05-09T00:10:07.679 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: monmap e2: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T00:10:07.679 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:10:07.679 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T00:10:07.680 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e32: smithi026.brymfp(active, since 39s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.680 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.680 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.680 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:10:07.680 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e33: smithi026.brymfp(active, since 39s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.680 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Standby manager daemon smithi135.kkrhgf restarted 2024-05-09T00:10:07.681 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Standby manager daemon smithi135.kkrhgf started 2024-05-09T00:10:07.681 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e34: smithi026.brymfp(active, since 46s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.681 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Active manager daemon smithi026.brymfp restarted 2024-05-09T00:10:07.681 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Activating manager daemon smithi026.brymfp 2024-05-09T00:10:07.681 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T00:10:07.681 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e35: smithi026.brymfp(active, starting, since 0.00520346s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.682 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:10:07.682 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:10:07.682 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi026.brymfp", "id": "smithi026.brymfp"}]: dispatch 2024-05-09T00:10:07.682 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr metadata", "who": "smithi135.kkrhgf", "id": "smithi135.kkrhgf"}]: dispatch 2024-05-09T00:10:07.682 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:10:07.682 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:10:07.683 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:10:07.683 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:10:07.683 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:10:07.683 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:10:07.683 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:10:07.684 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:10:07.684 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:10:07.684 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Manager daemon smithi026.brymfp is now available 2024-05-09T00:10:07.684 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:07.684 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:10:07.684 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:10:07.685 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi026.brymfp/trash_purge_schedule"}]: dispatch 2024-05-09T00:10:07.685 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [09/May/2024:00:09:51] ENGINE Bus STARTING 2024-05-09T00:10:07.685 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [09/May/2024:00:09:51] ENGINE Serving on https://172.21.15.26:7150 2024-05-09T00:10:07.685 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.685 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [09/May/2024:00:09:51] ENGINE Serving on http://172.21.15.26:8765 2024-05-09T00:10:07.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [09/May/2024:00:09:51] ENGINE Bus STARTED 2024-05-09T00:10:07.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e36: smithi026.brymfp(active, since 1.01122s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v3: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:07.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='client.24631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:07.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v4: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:07.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='client.24635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:07.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:07.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2251566565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:07.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e37: smithi026.brymfp(active, since 3s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2076326634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:10:07.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:07.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v5: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:07.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/4064611344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:10:07.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e38: smithi026.brymfp(active, since 4s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v6: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:07.690 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.690 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.690 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:07.690 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:10:07.690 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/etc/ceph/ceph.conf 2024-05-09T00:10:07.690 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/etc/ceph/ceph.conf 2024-05-09T00:10:07.690 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v7: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-05-09T00:10:07.691 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:07.691 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:10:07.691 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.691 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:10:07.691 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.691 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Updating smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:10:07.692 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.692 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.692 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.692 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.692 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.693 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:07.693 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:07.693 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T00:10:07.693 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.693 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v8: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-05-09T00:10:07.693 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Upgrade: Updating mon.smithi135 2024-05-09T00:10:07.693 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.694 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:10:07.694 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:10:07.694 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:07.694 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Deploying daemon mon.smithi135 on smithi135 2024-05-09T00:10:07.694 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: pgmap v9: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-09T00:10:07.694 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi026"}]: dispatch 2024-05-09T00:10:07.694 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mon.smithi026 calling monitor election 2024-05-09T00:10:07.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mon.smithi135 calling monitor election 2024-05-09T00:10:07.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mon.smithi026 is new leader, mons smithi026,smithi135 in quorum (ranks 0,1) 2024-05-09T00:10:07.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-05-09T00:10:07.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: monmap e3: 2 mons at {smithi026=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T00:10:07.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:10:07.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T00:10:07.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: mgrmap e38: smithi026.brymfp(active, since 15s), standbys: smithi135.kkrhgf 2024-05-09T00:10:07.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:07.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:10:07.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:07.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:08.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:08 smithi026 ceph-mon[93667]: pgmap v11: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-09T00:10:08.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:08 smithi135 ceph-mon[80466]: pgmap v11: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-09T00:10:10.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:10 smithi026 ceph-mon[93667]: pgmap v12: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-09T00:10:10.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:10 smithi135 ceph-mon[80466]: pgmap v12: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-09T00:10:11.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:11 smithi026 ceph-mon[93667]: pgmap v13: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:11.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:11 smithi135 ceph-mon[80466]: pgmap v13: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:12.973 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:12 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:12.973 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:12 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:12.973 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:12 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:12.973 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:12 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:13.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:12 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:13.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:12 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:13.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:12 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:13.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:12 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:14.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:14 smithi026 ceph-mon[93667]: pgmap v14: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:14.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:14 smithi135 ceph-mon[80466]: pgmap v14: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:16.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: pgmap v15: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:16.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:16.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:16.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:16.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:10:16.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:16.392 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: Reconfiguring mon.smithi026 (monmap changed)... 2024-05-09T00:10:16.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:10:16.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:10:16.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:16.393 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:16 smithi026 ceph-mon[93667]: Reconfiguring daemon mon.smithi026 on smithi026 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: pgmap v15: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: Reconfiguring mon.smithi026 (monmap changed)... 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:16 smithi135 ceph-mon[80466]: Reconfiguring daemon mon.smithi026 on smithi026 2024-05-09T00:10:18.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:17 smithi026 ceph-mon[93667]: pgmap v16: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:18.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:18.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:18.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:17 smithi026 ceph-mon[93667]: Reconfiguring mgr.smithi026.brymfp (monmap changed)... 2024-05-09T00:10:18.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.brymfp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:10:18.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:10:18.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:18.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:17 smithi026 ceph-mon[93667]: Reconfiguring daemon mgr.smithi026.brymfp on smithi026 2024-05-09T00:10:18.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:17 smithi135 ceph-mon[80466]: pgmap v16: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:18.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:18.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:18.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:17 smithi135 ceph-mon[80466]: Reconfiguring mgr.smithi026.brymfp (monmap changed)... 2024-05-09T00:10:18.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi026.brymfp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:10:18.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:10:18.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:18.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:17 smithi135 ceph-mon[80466]: Reconfiguring daemon mgr.smithi026.brymfp on smithi026 2024-05-09T00:10:19.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:19 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:19.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:19 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:19.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:19 smithi026 ceph-mon[93667]: pgmap v17: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:19.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:19 smithi026 ceph-mon[93667]: Reconfiguring crash.smithi026 (monmap changed)... 2024-05-09T00:10:19.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:19 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:10:19.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:19 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:19.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:19 smithi026 ceph-mon[93667]: Reconfiguring daemon crash.smithi026 on smithi026 2024-05-09T00:10:19.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:19 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:19.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:19 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:19.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:19 smithi135 ceph-mon[80466]: pgmap v17: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:19.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:19 smithi135 ceph-mon[80466]: Reconfiguring crash.smithi026 (monmap changed)... 2024-05-09T00:10:19.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:19 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:10:19.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:19 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:19.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:19 smithi135 ceph-mon[80466]: Reconfiguring daemon crash.smithi026 on smithi026 2024-05-09T00:10:21.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:21 smithi026 ceph-mon[93667]: pgmap v18: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:21.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:10:21.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:21.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:21.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:21 smithi026 ceph-mon[93667]: Reconfiguring osd.0 (monmap changed)... 2024-05-09T00:10:21.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:10:21.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:21.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:21 smithi026 ceph-mon[93667]: Reconfiguring daemon osd.0 on smithi026 2024-05-09T00:10:21.898 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:21 smithi135 ceph-mon[80466]: pgmap v18: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:10:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:21 smithi135 ceph-mon[80466]: Reconfiguring osd.0 (monmap changed)... 2024-05-09T00:10:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:10:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:21 smithi135 ceph-mon[80466]: Reconfiguring daemon osd.0 on smithi026 2024-05-09T00:10:23.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:23 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:23.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:23 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:23.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:23 smithi026 ceph-mon[93667]: Reconfiguring osd.1 (monmap changed)... 2024-05-09T00:10:23.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:23 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:10:23.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:23 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:23.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:23 smithi026 ceph-mon[93667]: Reconfiguring daemon osd.1 on smithi026 2024-05-09T00:10:23.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:23 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:23.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:23 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:23.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:23 smithi135 ceph-mon[80466]: Reconfiguring osd.1 (monmap changed)... 2024-05-09T00:10:23.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:23 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:10:23.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:23 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:23.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:23 smithi135 ceph-mon[80466]: Reconfiguring daemon osd.1 on smithi026 2024-05-09T00:10:24.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:24 smithi026 ceph-mon[93667]: pgmap v19: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:24.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:24 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:24.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:24 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:24.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:24 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:10:24.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:24 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:24.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:24 smithi135 ceph-mon[80466]: pgmap v19: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:24.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:24 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:24.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:24 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:24.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:24 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:10:24.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:24 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.664+0000 7fad17f02700 1 -- 172.21.15.26:0/3695839094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 msgr2=0x7fad100f8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.664+0000 7fad17f02700 1 --2- 172.21.15.26:0/3695839094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 0x7fad100f8c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fad000047f0 tx=0x7fad00009cb0).stop 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.664+0000 7fad17f02700 1 -- 172.21.15.26:0/3695839094 shutdown_connections 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.664+0000 7fad17f02700 1 --2- 172.21.15.26:0/3695839094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 0x7fad100f8c10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.664+0000 7fad17f02700 1 --2- 172.21.15.26:0/3695839094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad100f5af0 0x7fad100f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.664+0000 7fad17f02700 1 -- 172.21.15.26:0/3695839094 >> 172.21.15.26:0/3695839094 conn(0x7fad100f1610 msgr2=0x7fad100f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.664+0000 7fad17f02700 1 -- 172.21.15.26:0/3695839094 shutdown_connections 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.664+0000 7fad17f02700 1 -- 172.21.15.26:0/3695839094 wait complete. 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad17f02700 1 Processor -- start 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad17f02700 1 -- start start 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad17f02700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad100f5af0 0x7fad10108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:24.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad17f02700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 0x7fad10108510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad17f02700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad10108ac0 con 0x7fad100f6490 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad17f02700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad10108c00 con 0x7fad100f5af0 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad1549d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 0x7fad10108510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad1549d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 0x7fad10108510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35232/0 (socket says 172.21.15.26:35232) 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad1549d700 1 -- 172.21.15.26:0/1914823237 learned_addr learned my addr 172.21.15.26:0/1914823237 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad15c9e700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad100f5af0 0x7fad10108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad1549d700 1 -- 172.21.15.26:0/1914823237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad100f5af0 msgr2=0x7fad10108020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad1549d700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad100f5af0 0x7fad10108020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad1549d700 1 -- 172.21.15.26:0/1914823237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00005040 con 0x7fad100f6490 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad15c9e700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad100f5af0 0x7fad10108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:24.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.665+0000 7fad1549d700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 0x7fad10108510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fad00000c00 tx=0x7fad00009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.666+0000 7fad06ffd700 1 -- 172.21.15.26:0/1914823237 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0000e030 con 0x7fad100f6490 2024-05-09T00:10:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.666+0000 7fad06ffd700 1 -- 172.21.15.26:0/1914823237 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad00007e90 con 0x7fad100f6490 2024-05-09T00:10:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.666+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1010d640 con 0x7fad100f6490 2024-05-09T00:10:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.666+0000 7fad06ffd700 1 -- 172.21.15.26:0/1914823237 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad00018070 con 0x7fad100f6490 2024-05-09T00:10:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.666+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1010dc00 con 0x7fad100f6490 2024-05-09T00:10:24.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.667+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad10100010 con 0x7fad100f6490 2024-05-09T00:10:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.667+0000 7fad06ffd700 1 -- 172.21.15.26:0/1914823237 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fad0001d960 con 0x7fad100f6490 2024-05-09T00:10:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.667+0000 7fad06ffd700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7facfc06cbc0 0x7facfc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.668+0000 7fad06ffd700 1 -- 172.21.15.26:0/1914823237 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fad0008d440 con 0x7fad100f6490 2024-05-09T00:10:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.668+0000 7fad15c9e700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7facfc06cbc0 0x7facfc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:24.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.668+0000 7fad15c9e700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7facfc06cbc0 0x7facfc06f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fad100608c0 tx=0x7fad0c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:24.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.673+0000 7fad06ffd700 1 -- 172.21.15.26:0/1914823237 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fad0005add0 con 0x7fad100f6490 2024-05-09T00:10:24.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.897+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad10059120 con 0x7facfc06cbc0 2024-05-09T00:10:24.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.898+0000 7fad06ffd700 1 -- 172.21.15.26:0/1914823237 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fad10059120 con 0x7facfc06cbc0 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.900+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7facfc06cbc0 msgr2=0x7facfc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.900+0000 7fad17f02700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7facfc06cbc0 0x7facfc06f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fad100608c0 tx=0x7fad0c009040).stop 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.900+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 msgr2=0x7fad10108510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.900+0000 7fad17f02700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 0x7fad10108510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fad00000c00 tx=0x7fad00009cb0).stop 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.901+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 shutdown_connections 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.901+0000 7fad17f02700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7facfc06cbc0 0x7facfc06f080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.901+0000 7fad17f02700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad100f5af0 0x7fad10108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.901+0000 7fad17f02700 1 --2- 172.21.15.26:0/1914823237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad100f6490 0x7fad10108510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.901+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 >> 172.21.15.26:0/1914823237 conn(0x7fad100f1610 msgr2=0x7fad100fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:24.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.901+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 shutdown_connections 2024-05-09T00:10:24.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:24.901+0000 7fad17f02700 1 -- 172.21.15.26:0/1914823237 wait complete. 2024-05-09T00:10:24.908 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:10:25.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 -- 172.21.15.26:0/2670186488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c061280 msgr2=0x7fc06c0fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 --2- 172.21.15.26:0/2670186488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c061280 0x7fc06c0fa3d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc0600047f0 tx=0x7fc060009cb0).stop 2024-05-09T00:10:25.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 -- 172.21.15.26:0/2670186488 shutdown_connections 2024-05-09T00:10:25.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 --2- 172.21.15.26:0/2670186488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc06c0fa950 0x7fc06c0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 --2- 172.21.15.26:0/2670186488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c061280 0x7fc06c0fa3d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 -- 172.21.15.26:0/2670186488 >> 172.21.15.26:0/2670186488 conn(0x7fc06c0f1e50 msgr2=0x7fc06c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:25.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 -- 172.21.15.26:0/2670186488 shutdown_connections 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 -- 172.21.15.26:0/2670186488 wait complete. 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.003+0000 7fc07112b700 1 Processor -- start 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc07112b700 1 -- start start 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc07112b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc06c061280 0x7fc06c107ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc07112b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c0fa950 0x7fc06c1083e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc07112b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c108990 con 0x7fc06c0fa950 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc07112b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c108ad0 con 0x7fc06c061280 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c0fa950 0x7fc06c1083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c0fa950 0x7fc06c1083e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35238/0 (socket says 172.21.15.26:35238) 2024-05-09T00:10:25.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06a59c700 1 -- 172.21.15.26:0/589281712 learned_addr learned my addr 172.21.15.26:0/589281712 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06ad9d700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc06c061280 0x7fc06c107ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06a59c700 1 -- 172.21.15.26:0/589281712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc06c061280 msgr2=0x7fc06c107ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06a59c700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc06c061280 0x7fc06c107ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06a59c700 1 -- 172.21.15.26:0/589281712 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc060005040 con 0x7fc06c0fa950 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06ad9d700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc06c061280 0x7fc06c107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.004+0000 7fc06a59c700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c0fa950 0x7fc06c1083e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc05c002780 tx=0x7fc05c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.005+0000 7fc053fff700 1 -- 172.21.15.26:0/589281712 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05c007b40 con 0x7fc06c0fa950 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.005+0000 7fc053fff700 1 -- 172.21.15.26:0/589281712 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc05c00f040 con 0x7fc06c0fa950 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.005+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c10d570 con 0x7fc06c0fa950 2024-05-09T00:10:25.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.005+0000 7fc053fff700 1 -- 172.21.15.26:0/589281712 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05c014780 con 0x7fc06c0fa950 2024-05-09T00:10:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.005+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c10db30 con 0x7fc06c0fa950 2024-05-09T00:10:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.006+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c0fffe0 con 0x7fc06c0fa950 2024-05-09T00:10:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.006+0000 7fc053fff700 1 -- 172.21.15.26:0/589281712 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fc05c007ca0 con 0x7fc06c0fa950 2024-05-09T00:10:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.007+0000 7fc053fff700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc05406cbc0 0x7fc05406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.007+0000 7fc053fff700 1 -- 172.21.15.26:0/589281712 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc05c08bee0 con 0x7fc06c0fa950 2024-05-09T00:10:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.007+0000 7fc06ad9d700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc05406cbc0 0x7fc05406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.007+0000 7fc06ad9d700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc05406cbc0 0x7fc05406f080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc060000c00 tx=0x7fc060009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:25.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.011+0000 7fc053fff700 1 -- 172.21.15.26:0/589281712 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc05c059870 con 0x7fc06c0fa950 2024-05-09T00:10:25.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.233+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc06c059120 con 0x7fc05406cbc0 2024-05-09T00:10:25.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.234+0000 7fc053fff700 1 -- 172.21.15.26:0/589281712 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc06c059120 con 0x7fc05406cbc0 2024-05-09T00:10:25.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc05406cbc0 msgr2=0x7fc05406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc05406cbc0 0x7fc05406f080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc060000c00 tx=0x7fc060009cb0).stop 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c0fa950 msgr2=0x7fc06c1083e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c0fa950 0x7fc06c1083e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc05c002780 tx=0x7fc05c009ee0).stop 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 shutdown_connections 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc05406cbc0 0x7fc05406f080 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc06c061280 0x7fc06c107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 --2- 172.21.15.26:0/589281712 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc06c0fa950 0x7fc06c1083e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 >> 172.21.15.26:0/589281712 conn(0x7fc06c0f1e50 msgr2=0x7fc06c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 shutdown_connections 2024-05-09T00:10:25.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.236+0000 7fc07112b700 1 -- 172.21.15.26:0/589281712 wait complete. 2024-05-09T00:10:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.337+0000 7f07cdd46700 1 -- 172.21.15.26:0/848253348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 msgr2=0x7f07c80fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.337+0000 7f07cdd46700 1 --2- 172.21.15.26:0/848253348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 0x7f07c80fcda0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f07bc0047f0 tx=0x7f07bc009cb0).stop 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.337+0000 7f07cdd46700 1 -- 172.21.15.26:0/848253348 shutdown_connections 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.337+0000 7f07cdd46700 1 --2- 172.21.15.26:0/848253348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 0x7f07c80fcda0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.337+0000 7f07cdd46700 1 --2- 172.21.15.26:0/848253348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8061280 0x7f07c80fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.337+0000 7f07cdd46700 1 -- 172.21.15.26:0/848253348 >> 172.21.15.26:0/848253348 conn(0x7f07c80f1e50 msgr2=0x7f07c80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.337+0000 7f07cdd46700 1 -- 172.21.15.26:0/848253348 shutdown_connections 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.337+0000 7f07cdd46700 1 -- 172.21.15.26:0/848253348 wait complete. 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07cdd46700 1 Processor -- start 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07cdd46700 1 -- start start 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07cdd46700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8061280 0x7f07c80f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07cdd46700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 0x7f07c80f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07cdd46700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80f8220 con 0x7f07c80fa950 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07cdd46700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80f67c0 con 0x7f07c8061280 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 0x7f07c80f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07c6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 0x7f07c80f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35266/0 (socket says 172.21.15.26:35266) 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07c6ffd700 1 -- 172.21.15.26:0/14811414 learned_addr learned my addr 172.21.15.26:0/14811414 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07c77fe700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8061280 0x7f07c80f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07c6ffd700 1 -- 172.21.15.26:0/14811414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8061280 msgr2=0x7f07c80f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07c6ffd700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8061280 0x7f07c80f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.338+0000 7f07c6ffd700 1 -- 172.21.15.26:0/14811414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc005040 con 0x7f07c80fa950 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.339+0000 7f07c6ffd700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 0x7f07c80f62d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f07bc013620 tx=0x7f07bc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:25.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.339+0000 7f07c4ff9700 1 -- 172.21.15.26:0/14811414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07bc00e070 con 0x7f07c80fa950 2024-05-09T00:10:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.339+0000 7f07c4ff9700 1 -- 172.21.15.26:0/14811414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07bc007e90 con 0x7f07c80fa950 2024-05-09T00:10:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.339+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c80f69e0 con 0x7f07c80fa950 2024-05-09T00:10:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.339+0000 7f07c4ff9700 1 -- 172.21.15.26:0/14811414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07bc018070 con 0x7f07c80fa950 2024-05-09T00:10:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.339+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c80f6f40 con 0x7f07c80fa950 2024-05-09T00:10:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.340+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c8047540 con 0x7f07c80fa950 2024-05-09T00:10:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.340+0000 7f07c4ff9700 1 -- 172.21.15.26:0/14811414 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f07bc01d420 con 0x7f07c80fa950 2024-05-09T00:10:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.341+0000 7f07c4ff9700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f07b006cbc0 0x7f07b006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.341+0000 7f07c4ff9700 1 -- 172.21.15.26:0/14811414 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f07bc08ccd0 con 0x7f07c80fa950 2024-05-09T00:10:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.341+0000 7f07c77fe700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f07b006cbc0 0x7f07b006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.341+0000 7f07c77fe700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f07b006cbc0 0x7f07b006f080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f07b8009170 tx=0x7f07b8009d60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:25.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.347+0000 7f07c4ff9700 1 -- 172.21.15.26:0/14811414 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f07bc05a660 con 0x7f07c80fa950 2024-05-09T00:10:25.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:25 smithi026 ceph-mon[93667]: Reconfiguring osd.2 (monmap changed)... 2024-05-09T00:10:25.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:25 smithi026 ceph-mon[93667]: Reconfiguring daemon osd.2 on smithi026 2024-05-09T00:10:25.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.557+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f07c8102010 con 0x7f07b006cbc0 2024-05-09T00:10:25.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.567+0000 7f07c4ff9700 1 -- 172.21.15.26:0/14811414 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f07b8004720 con 0x7f07b006cbc0 2024-05-09T00:10:25.565 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:10:25.565 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (2m) 30s ago 11m 15.6M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:10:25.565 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (11m) 30s ago 11m 6639k - 16.2.15-1-g8963e9de 727f386679cb 9b63f094ef3e 2024-05-09T00:10:25.565 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (10m) 13s ago 10m 6643k - 16.2.15-1-g8963e9de 727f386679cb 09f7f01dbeaa 2024-05-09T00:10:25.565 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (2m) 30s ago 10m 48.8M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:10:25.565 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (5m) 30s ago 5m 14.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:10:25.565 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (5m) 30s ago 5m 156M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (5m) 13s ago 5m 14.3M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (5m) 13s ago 5m 14.4M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (99s) 30s ago 12m 472M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (58s) 13s ago 10m 448M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (42s) 30s ago 12m 27.1M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (21s) 13s ago 10m 29.4M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2m) 30s ago 10m 15.4M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (119s) 13s ago 10m 22.0M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (9m) 30s ago 9m 242M 1911M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (9m) 30s ago 9m 256M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (8m) 30s ago 8m 213M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (8m) 13s ago 8m 286M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:10:25.566 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (7m) 13s ago 7m 250M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:10:25.567 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (7m) 13s ago 7m 239M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:10:25.567 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (64s) 13s ago 9m 65.7M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:10:25.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f07b006cbc0 msgr2=0x7f07b006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f07b006cbc0 0x7f07b006f080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f07b8009170 tx=0x7f07b8009d60).stop 2024-05-09T00:10:25.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 msgr2=0x7f07c80f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 0x7f07c80f62d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f07bc013620 tx=0x7f07bc009cb0).stop 2024-05-09T00:10:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 shutdown_connections 2024-05-09T00:10:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f07b006cbc0 0x7f07b006f080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8061280 0x7f07c80f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 --2- 172.21.15.26:0/14811414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07c80fa950 0x7f07c80f62d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 >> 172.21.15.26:0/14811414 conn(0x7f07c80f1e50 msgr2=0x7f07c80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 shutdown_connections 2024-05-09T00:10:25.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.570+0000 7f07cdd46700 1 -- 172.21.15.26:0/14811414 wait complete. 2024-05-09T00:10:25.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:25 smithi135 ceph-mon[80466]: Reconfiguring osd.2 (monmap changed)... 2024-05-09T00:10:25.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:25 smithi135 ceph-mon[80466]: Reconfiguring daemon osd.2 on smithi026 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 -- 172.21.15.26:0/4144238316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 msgr2=0x7f1b580f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 --2- 172.21.15.26:0/4144238316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 0x7f1b580f6b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1b480047f0 tx=0x7f1b48009cb0).stop 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 -- 172.21.15.26:0/4144238316 shutdown_connections 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 --2- 172.21.15.26:0/4144238316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b580f7990 0x7f1b580f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 --2- 172.21.15.26:0/4144238316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 0x7f1b580f6b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 -- 172.21.15.26:0/4144238316 >> 172.21.15.26:0/4144238316 conn(0x7f1b580f1e50 msgr2=0x7f1b580f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 -- 172.21.15.26:0/4144238316 shutdown_connections 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 -- 172.21.15.26:0/4144238316 wait complete. 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.674+0000 7f1b5db2e700 1 Processor -- start 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b5db2e700 1 -- start start 2024-05-09T00:10:25.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b5db2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 0x7f1b580fae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b5db2e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b580f7990 0x7f1b580f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b5db2e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580fb440 con 0x7f1b580f66f0 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b5db2e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580f99e0 con 0x7f1b580f7990 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 0x7f1b580fae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 0x7f1b580fae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35282/0 (socket says 172.21.15.26:35282) 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b577fe700 1 -- 172.21.15.26:0/1460508132 learned_addr learned my addr 172.21.15.26:0/1460508132 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b56ffd700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b580f7990 0x7f1b580f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b577fe700 1 -- 172.21.15.26:0/1460508132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b580f7990 msgr2=0x7f1b580f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b577fe700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b580f7990 0x7f1b580f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b577fe700 1 -- 172.21.15.26:0/1460508132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48005040 con 0x7f1b580f66f0 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b56ffd700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b580f7990 0x7f1b580f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b577fe700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 0x7f1b580fae90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1b48013620 tx=0x7f1b48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:25.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b54ff9700 1 -- 172.21.15.26:0/1460508132 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4800e070 con 0x7f1b580f66f0 2024-05-09T00:10:25.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b580f9c00 con 0x7f1b580f66f0 2024-05-09T00:10:25.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b54ff9700 1 -- 172.21.15.26:0/1460508132 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b48007e90 con 0x7f1b580f66f0 2024-05-09T00:10:25.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.675+0000 7f1b54ff9700 1 -- 172.21.15.26:0/1460508132 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b48018070 con 0x7f1b580f66f0 2024-05-09T00:10:25.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.676+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580fa160 con 0x7f1b580f66f0 2024-05-09T00:10:25.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.676+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b58047540 con 0x7f1b580f66f0 2024-05-09T00:10:25.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.677+0000 7f1b54ff9700 1 -- 172.21.15.26:0/1460508132 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f1b4801d420 con 0x7f1b580f66f0 2024-05-09T00:10:25.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.677+0000 7f1b54ff9700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406cbc0 0x7f1b4406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:25.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.677+0000 7f1b54ff9700 1 -- 172.21.15.26:0/1460508132 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1b4808ccd0 con 0x7f1b580f66f0 2024-05-09T00:10:25.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.677+0000 7f1b56ffd700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406cbc0 0x7f1b4406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:25.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.678+0000 7f1b56ffd700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406cbc0 0x7f1b4406f080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1b40004c80 tx=0x7f1b4000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:25.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.682+0000 7f1b54ff9700 1 -- 172.21.15.26:0/1460508132 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f1b4805a660 con 0x7f1b580f66f0 2024-05-09T00:10:25.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.987+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1b58110690 con 0x7f1b580f66f0 2024-05-09T00:10:25.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.987+0000 7f1b54ff9700 1 -- 172.21.15.26:0/1460508132 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f1b4801de60 con 0x7f1b580f66f0 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:10:25.985 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:10:25.986 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:10:25.986 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:10:25.986 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:10:25.986 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:10:25.986 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 10, 2024-05-09T00:10:25.986 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 4 2024-05-09T00:10:25.986 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:10:25.986 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:10:25.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406cbc0 msgr2=0x7f1b4406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406cbc0 0x7f1b4406f080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1b40004c80 tx=0x7f1b4000b040).stop 2024-05-09T00:10:25.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 msgr2=0x7f1b580fae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:25.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 0x7f1b580fae90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1b48013620 tx=0x7f1b48009cb0).stop 2024-05-09T00:10:25.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 shutdown_connections 2024-05-09T00:10:25.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406cbc0 0x7f1b4406f080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b580f66f0 0x7f1b580fae90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 --2- 172.21.15.26:0/1460508132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b580f7990 0x7f1b580f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:25.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.989+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 >> 172.21.15.26:0/1460508132 conn(0x7f1b580f1e50 msgr2=0x7f1b58060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:25.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.990+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 shutdown_connections 2024-05-09T00:10:25.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:25.990+0000 7f1b5db2e700 1 -- 172.21.15.26:0/1460508132 wait complete. 2024-05-09T00:10:26.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 -- 172.21.15.26:0/2514197309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80616f0 msgr2=0x7f03f80fa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 --2- 172.21.15.26:0/2514197309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80616f0 0x7f03f80fa4d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f03e80047f0 tx=0x7f03e8009cb0).stop 2024-05-09T00:10:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 -- 172.21.15.26:0/2514197309 shutdown_connections 2024-05-09T00:10:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 --2- 172.21.15.26:0/2514197309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03f80fa9c0 0x7f03f80fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:10:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 --2- 172.21.15.26:0/2514197309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80616f0 0x7f03f80fa4d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 -- 172.21.15.26:0/2514197309 >> 172.21.15.26:0/2514197309 conn(0x7f03f80f1ef0 msgr2=0x7f03f80f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 -- 172.21.15.26:0/2514197309 shutdown_connections 2024-05-09T00:10:26.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 -- 172.21.15.26:0/2514197309 wait complete. 2024-05-09T00:10:26.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.092+0000 7f03fd72c700 1 Processor -- start 2024-05-09T00:10:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03fd72c700 1 -- start start 2024-05-09T00:10:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03fd72c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03f80616f0 0x7f03f8108380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03fd72c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80fa9c0 0x7f03f8108870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03fd72c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8108eb0 con 0x7f03f80fa9c0 2024-05-09T00:10:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03fd72c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8108ff0 con 0x7f03f80616f0 2024-05-09T00:10:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80fa9c0 0x7f03f8108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80fa9c0 0x7f03f8108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35298/0 (socket says 172.21.15.26:35298) 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03f67fc700 1 -- 172.21.15.26:0/847720644 learned_addr learned my addr 172.21.15.26:0/847720644 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03f6ffd700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03f80616f0 0x7f03f8108380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03f67fc700 1 -- 172.21.15.26:0/847720644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03f80616f0 msgr2=0x7f03f8108380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03f67fc700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03f80616f0 0x7f03f8108380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03f67fc700 1 -- 172.21.15.26:0/847720644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8005040 con 0x7f03f80fa9c0 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.093+0000 7f03f67fc700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80fa9c0 0x7f03f8108870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f03e000b4b0 tx=0x7f03e00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.094+0000 7f03effff700 1 -- 172.21.15.26:0/847720644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03e0002500 con 0x7f03f80fa9c0 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.094+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f810da90 con 0x7f03f80fa9c0 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.094+0000 7f03effff700 1 -- 172.21.15.26:0/847720644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03e0002b10 con 0x7f03f80fa9c0 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.094+0000 7f03effff700 1 -- 172.21.15.26:0/847720644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03e0012bf0 con 0x7f03f80fa9c0 2024-05-09T00:10:26.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.094+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f810dfd0 con 0x7f03f80fa9c0 2024-05-09T00:10:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.095+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f80607e0 con 0x7f03f80fa9c0 2024-05-09T00:10:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.095+0000 7f03effff700 1 -- 172.21.15.26:0/847720644 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f03e0002660 con 0x7f03f80fa9c0 2024-05-09T00:10:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.096+0000 7f03effff700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f03e406cbc0 0x7f03e406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.096+0000 7f03effff700 1 -- 172.21.15.26:0/847720644 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f03e008bf40 con 0x7f03f80fa9c0 2024-05-09T00:10:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.096+0000 7f03f6ffd700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f03e406cbc0 0x7f03e406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.096+0000 7f03f6ffd700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f03e406cbc0 0x7f03e406f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f03e8007cf0 tx=0x7f03e800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.100+0000 7f03effff700 1 -- 172.21.15.26:0/847720644 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f03e00bf570 con 0x7f03f80fa9c0 2024-05-09T00:10:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.348+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f03f8100040 con 0x7f03f80fa9c0 2024-05-09T00:10:26.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.348+0000 7f03effff700 1 -- 172.21.15.26:0/847720644 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f03e00599e0 con 0x7f03f80fa9c0 2024-05-09T00:10:26.346 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:10:26.346 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:10:26.346 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:10:26.346 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:10:26.346 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:10:26.346 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:10:26.346 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:10:26.346 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:10:26.347 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:10:26.348 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:26.349 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:10:26.349 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:10:26.349 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:10:26.349 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:10:26.349 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:26.349 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:26.349 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.350+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f03e406cbc0 msgr2=0x7f03e406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.350+0000 7f03fd72c700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f03e406cbc0 0x7f03e406f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f03e8007cf0 tx=0x7f03e800b040).stop 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.350+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80fa9c0 msgr2=0x7f03f8108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.350+0000 7f03fd72c700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80fa9c0 0x7f03f8108870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f03e000b4b0 tx=0x7f03e00090f0).stop 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.351+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 shutdown_connections 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.351+0000 7f03fd72c700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f03e406cbc0 0x7f03e406f080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.351+0000 7f03fd72c700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03f80616f0 0x7f03f8108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.351+0000 7f03fd72c700 1 --2- 172.21.15.26:0/847720644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03f80fa9c0 0x7f03f8108870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.351+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 >> 172.21.15.26:0/847720644 conn(0x7f03f80f1ef0 msgr2=0x7f03f80f42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.351+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 shutdown_connections 2024-05-09T00:10:26.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.351+0000 7f03fd72c700 1 -- 172.21.15.26:0/847720644 wait complete. 2024-05-09T00:10:26.351 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:10:26.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:26 smithi026 ceph-mon[93667]: pgmap v20: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:26.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:26 smithi026 ceph-mon[93667]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:26.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:26 smithi026 ceph-mon[93667]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:26.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:26 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:26.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:26 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:26.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:26 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.nhrcgk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:10:26.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:26 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:26.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:26 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1460508132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.458+0000 7faea4adb700 1 -- 172.21.15.26:0/2327995773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea00fa950 msgr2=0x7faea00fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.458+0000 7faea4adb700 1 --2- 172.21.15.26:0/2327995773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea00fa950 0x7faea00fcda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fae880047f0 tx=0x7fae88009cb0).stop 2024-05-09T00:10:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.458+0000 7faea4adb700 1 -- 172.21.15.26:0/2327995773 shutdown_connections 2024-05-09T00:10:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.458+0000 7faea4adb700 1 --2- 172.21.15.26:0/2327995773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea00fa950 0x7faea00fcda0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.458+0000 7faea4adb700 1 --2- 172.21.15.26:0/2327995773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea0061280 0x7faea00fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.458+0000 7faea4adb700 1 -- 172.21.15.26:0/2327995773 >> 172.21.15.26:0/2327995773 conn(0x7faea00f1e50 msgr2=0x7faea00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.458+0000 7faea4adb700 1 -- 172.21.15.26:0/2327995773 shutdown_connections 2024-05-09T00:10:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.458+0000 7faea4adb700 1 -- 172.21.15.26:0/2327995773 wait complete. 2024-05-09T00:10:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7faea4adb700 1 Processor -- start 2024-05-09T00:10:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7faea4adb700 1 -- start start 2024-05-09T00:10:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7faea4adb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea0061280 0x7faea0107f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7faea4adb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea00fa950 0x7faea0108400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7faea4adb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea01089b0 con 0x7faea0061280 2024-05-09T00:10:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7faea4adb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea0108af0 con 0x7faea00fa950 2024-05-09T00:10:26.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7fae9e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea0061280 0x7faea0107f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7fae9e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea0061280 0x7faea0107f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35320/0 (socket says 172.21.15.26:35320) 2024-05-09T00:10:26.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.459+0000 7fae9e59c700 1 -- 172.21.15.26:0/1749516043 learned_addr learned my addr 172.21.15.26:0/1749516043 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:26.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7fae9dd9b700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea00fa950 0x7faea0108400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7fae9e59c700 1 -- 172.21.15.26:0/1749516043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea00fa950 msgr2=0x7faea0108400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7fae9e59c700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea00fa950 0x7faea0108400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7fae9e59c700 1 -- 172.21.15.26:0/1749516043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88005040 con 0x7faea0061280 2024-05-09T00:10:26.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7fae9e59c700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea0061280 0x7faea0107f10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fae9800dad0 tx=0x7fae98004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7fae977fe700 1 -- 172.21.15.26:0/1749516043 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae9800b750 con 0x7faea0061280 2024-05-09T00:10:26.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7fae977fe700 1 -- 172.21.15.26:0/1749516043 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae9800f040 con 0x7faea0061280 2024-05-09T00:10:26.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea010d590 con 0x7faea0061280 2024-05-09T00:10:26.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7fae977fe700 1 -- 172.21.15.26:0/1749516043 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae98013ce0 con 0x7faea0061280 2024-05-09T00:10:26.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.460+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea010db50 con 0x7faea0061280 2024-05-09T00:10:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.461+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea00fffb0 con 0x7faea0061280 2024-05-09T00:10:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.461+0000 7fae977fe700 1 -- 172.21.15.26:0/1749516043 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fae9800b8b0 con 0x7faea0061280 2024-05-09T00:10:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.462+0000 7fae977fe700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fae8c06cbc0 0x7fae8c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.462+0000 7fae977fe700 1 -- 172.21.15.26:0/1749516043 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fae9808ba70 con 0x7faea0061280 2024-05-09T00:10:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.462+0000 7fae9dd9b700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fae8c06cbc0 0x7fae8c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.463+0000 7fae9dd9b700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fae8c06cbc0 0x7fae8c06f080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fae88004f10 tx=0x7fae8800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.466+0000 7fae977fe700 1 -- 172.21.15.26:0/1749516043 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fae980594b0 con 0x7faea0061280 2024-05-09T00:10:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:26 smithi135 ceph-mon[80466]: pgmap v20: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:26 smithi135 ceph-mon[80466]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:26 smithi135 ceph-mon[80466]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:26 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:26 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:26 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.nhrcgk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:10:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:26 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:26 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1460508132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:26.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.687+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faea0059120 con 0x7fae8c06cbc0 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.689+0000 7fae977fe700 1 -- 172.21.15.26:0/1749516043 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7faea0059120 con 0x7fae8c06cbc0 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "4/21 daemons upgraded", 2024-05-09T00:10:26.686 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading mon daemons", 2024-05-09T00:10:26.687 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:10:26.687 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fae8c06cbc0 msgr2=0x7fae8c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fae8c06cbc0 0x7fae8c06f080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fae88004f10 tx=0x7fae8800b040).stop 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea0061280 msgr2=0x7faea0107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea0061280 0x7faea0107f10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fae9800dad0 tx=0x7fae98004ee0).stop 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 shutdown_connections 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fae8c06cbc0 0x7fae8c06f080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea0061280 0x7faea0107f10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 --2- 172.21.15.26:0/1749516043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea00fa950 0x7faea0108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 >> 172.21.15.26:0/1749516043 conn(0x7faea00f1e50 msgr2=0x7faea00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 shutdown_connections 2024-05-09T00:10:26.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.691+0000 7faea4adb700 1 -- 172.21.15.26:0/1749516043 wait complete. 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.793+0000 7fe0e3e11700 1 -- 172.21.15.26:0/1556528319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f7a10 msgr2=0x7fe0dc0f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.793+0000 7fe0e3e11700 1 --2- 172.21.15.26:0/1556528319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f7a10 0x7fe0dc0f7e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe0d80047f0 tx=0x7fe0d8009cb0).stop 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.793+0000 7fe0e3e11700 1 -- 172.21.15.26:0/1556528319 shutdown_connections 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.793+0000 7fe0e3e11700 1 --2- 172.21.15.26:0/1556528319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc0f8cb0 0x7fe0dc0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.793+0000 7fe0e3e11700 1 --2- 172.21.15.26:0/1556528319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f7a10 0x7fe0dc0f7e30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.793+0000 7fe0e3e11700 1 -- 172.21.15.26:0/1556528319 >> 172.21.15.26:0/1556528319 conn(0x7fe0dc0f3150 msgr2=0x7fe0dc0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.793+0000 7fe0e3e11700 1 -- 172.21.15.26:0/1556528319 shutdown_connections 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.793+0000 7fe0e3e11700 1 -- 172.21.15.26:0/1556528319 wait complete. 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e3e11700 1 Processor -- start 2024-05-09T00:10:26.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e3e11700 1 -- start start 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e3e11700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc0f7a10 0x7fe0dc1082e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e3e11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f8cb0 0x7fe0dc1087d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e3e11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc108d80 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e3e11700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc108ec0 con 0x7fe0dc0f7a10 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e13ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f8cb0 0x7fe0dc1087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e13ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f8cb0 0x7fe0dc1087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35326/0 (socket says 172.21.15.26:35326) 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e13ac700 1 -- 172.21.15.26:0/3017673981 learned_addr learned my addr 172.21.15.26:0/3017673981 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e1bad700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc0f7a10 0x7fe0dc1082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e13ac700 1 -- 172.21.15.26:0/3017673981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc0f7a10 msgr2=0x7fe0dc1082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e13ac700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc0f7a10 0x7fe0dc1082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e13ac700 1 -- 172.21.15.26:0/3017673981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8005040 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e1bad700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc0f7a10 0x7fe0dc1082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0e13ac700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f8cb0 0x7fe0dc1087d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe0cc00e910 tx=0x7fe0cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.794+0000 7fe0d2ffd700 1 -- 172.21.15.26:0/3017673981 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0cc00eeb0 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.795+0000 7fe0d2ffd700 1 -- 172.21.15.26:0/3017673981 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0cc00f040 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.795+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc10d960 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.795+0000 7fe0d2ffd700 1 -- 172.21.15.26:0/3017673981 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0cc00c8a0 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.795+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc10df20 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.796+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc05fb50 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.796+0000 7fe0d2ffd700 1 -- 172.21.15.26:0/3017673981 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fe0cc0090d0 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.796+0000 7fe0d2ffd700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe0c806cbc0 0x7fe0c806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.797+0000 7fe0d2ffd700 1 -- 172.21.15.26:0/3017673981 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe0cc08ba10 con 0x7fe0dc0f8cb0 2024-05-09T00:10:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.797+0000 7fe0e1bad700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe0c806cbc0 0x7fe0c806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.797+0000 7fe0e1bad700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe0c806cbc0 0x7fe0c806f080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe0d8009ee0 tx=0x7fe0d800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:26.801+0000 7fe0d2ffd700 1 -- 172.21.15.26:0/3017673981 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fe0cc0593a0 con 0x7fe0dc0f8cb0 2024-05-09T00:10:27.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.079+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe0dc1001f0 con 0x7fe0dc0f8cb0 2024-05-09T00:10:27.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.080+0000 7fe0d2ffd700 1 -- 172.21.15.26:0/3017673981 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe0cc058f30 con 0x7fe0dc0f8cb0 2024-05-09T00:10:27.077 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:27.077 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:27.077 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:10:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe0c806cbc0 msgr2=0x7fe0c806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe0c806cbc0 0x7fe0c806f080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe0d8009ee0 tx=0x7fe0d800b040).stop 2024-05-09T00:10:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f8cb0 msgr2=0x7fe0dc1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f8cb0 0x7fe0dc1087d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe0cc00e910 tx=0x7fe0cc00b040).stop 2024-05-09T00:10:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 shutdown_connections 2024-05-09T00:10:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe0c806cbc0 0x7fe0c806f080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc0f7a10 0x7fe0dc1082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:27.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 --2- 172.21.15.26:0/3017673981 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0dc0f8cb0 0x7fe0dc1087d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:27.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 >> 172.21.15.26:0/3017673981 conn(0x7fe0dc0f3150 msgr2=0x7fe0dc0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:27.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 shutdown_connections 2024-05-09T00:10:27.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:27.082+0000 7fe0e3e11700 1 -- 172.21.15.26:0/3017673981 wait complete. 2024-05-09T00:10:27.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:27.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: Reconfiguring mds.cephfs.smithi026.nhrcgk (monmap changed)... 2024-05-09T00:10:27.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: Reconfiguring daemon mds.cephfs.smithi026.nhrcgk on smithi026 2024-05-09T00:10:27.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/847720644' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:10:27.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3017673981' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:10:27.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:27.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:27.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.gbyppy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:10:27.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:27 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:27.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:27.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: Reconfiguring mds.cephfs.smithi026.nhrcgk (monmap changed)... 2024-05-09T00:10:27.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: Reconfiguring daemon mds.cephfs.smithi026.nhrcgk on smithi026 2024-05-09T00:10:27.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/847720644' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:10:27.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3017673981' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:10:27.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:27.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:27.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.gbyppy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:10:27.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:27 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:28.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:28 smithi026 ceph-mon[93667]: pgmap v21: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:28.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:28 smithi026 ceph-mon[93667]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:28.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:28 smithi026 ceph-mon[93667]: Reconfiguring mds.cephfs.smithi026.gbyppy (monmap changed)... 2024-05-09T00:10:28.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:28 smithi026 ceph-mon[93667]: Reconfiguring daemon mds.cephfs.smithi026.gbyppy on smithi026 2024-05-09T00:10:28.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:28 smithi135 ceph-mon[80466]: pgmap v21: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:28.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:28 smithi135 ceph-mon[80466]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:28.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:28 smithi135 ceph-mon[80466]: Reconfiguring mds.cephfs.smithi026.gbyppy (monmap changed)... 2024-05-09T00:10:28.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:28 smithi135 ceph-mon[80466]: Reconfiguring daemon mds.cephfs.smithi026.gbyppy on smithi026 2024-05-09T00:10:30.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:29 smithi026 ceph-mon[93667]: pgmap v22: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:30.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:30.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:29 smithi026 ceph-mon[93667]: Reconfiguring crash.smithi135 (monmap changed)... 2024-05-09T00:10:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:10:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:29 smithi026 ceph-mon[93667]: Reconfiguring daemon crash.smithi135 on smithi135 2024-05-09T00:10:30.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:29 smithi135 ceph-mon[80466]: pgmap v22: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:30.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:30.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:30.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:29 smithi135 ceph-mon[80466]: Reconfiguring crash.smithi135 (monmap changed)... 2024-05-09T00:10:30.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:10:30.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:30.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:29 smithi135 ceph-mon[80466]: Reconfiguring daemon crash.smithi135 on smithi135 2024-05-09T00:10:31.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:31.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:31.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:31 smithi135 ceph-mon[80466]: Reconfiguring mgr.smithi135.kkrhgf (monmap changed)... 2024-05-09T00:10:31.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:10:31.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:10:31.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:31.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:31 smithi135 ceph-mon[80466]: Reconfiguring daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:10:31.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:31 smithi026 ceph-mon[93667]: Reconfiguring mgr.smithi135.kkrhgf (monmap changed)... 2024-05-09T00:10:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.kkrhgf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:10:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:10:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:31 smithi026 ceph-mon[93667]: Reconfiguring daemon mgr.smithi135.kkrhgf on smithi135 2024-05-09T00:10:32.307 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:32 smithi135 ceph-mon[80466]: pgmap v23: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:32.308 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:32 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:32.308 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:32 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:32.308 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:32 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:10:32.308 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:32 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:10:32.308 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:32 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:32.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:32 smithi026 ceph-mon[93667]: pgmap v23: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:32.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:32 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:32.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:32 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:32.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:32 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:10:32.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:32 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:10:32.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:32 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:33.267 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:33 smithi135 ceph-mon[80466]: Reconfiguring mon.smithi135 (monmap changed)... 2024-05-09T00:10:33.267 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:33 smithi135 ceph-mon[80466]: Reconfiguring daemon mon.smithi135 on smithi135 2024-05-09T00:10:33.267 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:33 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:33.267 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:33 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:33.268 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:33 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:10:33.268 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:33 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:33.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:33 smithi026 ceph-mon[93667]: Reconfiguring mon.smithi135 (monmap changed)... 2024-05-09T00:10:33.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:33 smithi026 ceph-mon[93667]: Reconfiguring daemon mon.smithi135 on smithi135 2024-05-09T00:10:33.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:33 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:33.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:33 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:33.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:33 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:10:33.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:33 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:34.311 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:34 smithi135 ceph-mon[80466]: pgmap v24: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:34.311 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:34 smithi135 ceph-mon[80466]: Reconfiguring osd.3 (monmap changed)... 2024-05-09T00:10:34.311 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:34 smithi135 ceph-mon[80466]: Reconfiguring daemon osd.3 on smithi135 2024-05-09T00:10:34.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:34 smithi026 ceph-mon[93667]: pgmap v24: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:34.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:34 smithi026 ceph-mon[93667]: Reconfiguring osd.3 (monmap changed)... 2024-05-09T00:10:34.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:34 smithi026 ceph-mon[93667]: Reconfiguring daemon osd.3 on smithi135 2024-05-09T00:10:35.846 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:35 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:35.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:35 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:35.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:35 smithi135 ceph-mon[80466]: Reconfiguring osd.4 (monmap changed)... 2024-05-09T00:10:35.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:35 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:10:35.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:35 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:35.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:35 smithi135 ceph-mon[80466]: Reconfiguring daemon osd.4 on smithi135 2024-05-09T00:10:35.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:35 smithi135 ceph-mon[80466]: pgmap v25: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:35.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:35 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:35.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:35 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:35.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:35 smithi026 ceph-mon[93667]: Reconfiguring osd.4 (monmap changed)... 2024-05-09T00:10:35.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:35 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:10:35.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:35 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:35.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:35 smithi026 ceph-mon[93667]: Reconfiguring daemon osd.4 on smithi135 2024-05-09T00:10:35.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:35 smithi026 ceph-mon[93667]: pgmap v25: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:36.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:10:36.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:36.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:36.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:36 smithi135 ceph-mon[80466]: Reconfiguring osd.5 (monmap changed)... 2024-05-09T00:10:36.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:10:36.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:36.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:36 smithi135 ceph-mon[80466]: Reconfiguring daemon osd.5 on smithi135 2024-05-09T00:10:36.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:10:36.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:36.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:36.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:36 smithi026 ceph-mon[93667]: Reconfiguring osd.5 (monmap changed)... 2024-05-09T00:10:36.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:10:36.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:36.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:36 smithi026 ceph-mon[93667]: Reconfiguring daemon osd.5 on smithi135 2024-05-09T00:10:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:37 smithi135 ceph-mon[80466]: pgmap v26: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:37.896 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:37 smithi026 ceph-mon[93667]: pgmap v26: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:39.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:38 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:39.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:38 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:39.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:38 smithi026 ceph-mon[93667]: Reconfiguring mds.cephfs.smithi135.lzxgvd (monmap changed)... 2024-05-09T00:10:39.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:38 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lzxgvd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:10:39.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:38 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:39.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:38 smithi026 ceph-mon[93667]: Reconfiguring daemon mds.cephfs.smithi135.lzxgvd on smithi135 2024-05-09T00:10:39.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:38 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:39.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:38 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:39.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:38 smithi135 ceph-mon[80466]: Reconfiguring mds.cephfs.smithi135.lzxgvd (monmap changed)... 2024-05-09T00:10:39.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:38 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lzxgvd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:10:39.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:38 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:39.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:38 smithi135 ceph-mon[80466]: Reconfiguring daemon mds.cephfs.smithi135.lzxgvd on smithi135 2024-05-09T00:10:40.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:40 smithi135 ceph-mon[80466]: pgmap v27: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:40.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:40 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:40.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:40 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:40.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:40 smithi135 ceph-mon[80466]: Reconfiguring mds.cephfs.smithi135.hcciyw (monmap changed)... 2024-05-09T00:10:40.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:40 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.hcciyw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:10:40.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:40 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:40.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:40 smithi135 ceph-mon[80466]: Reconfiguring daemon mds.cephfs.smithi135.hcciyw on smithi135 2024-05-09T00:10:40.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:40 smithi026 ceph-mon[93667]: pgmap v27: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:40.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:40 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:40.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:40 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:40.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:40 smithi026 ceph-mon[93667]: Reconfiguring mds.cephfs.smithi135.hcciyw (monmap changed)... 2024-05-09T00:10:40.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:40 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.hcciyw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:10:40.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:40 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:40.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:40 smithi026 ceph-mon[93667]: Reconfiguring daemon mds.cephfs.smithi135.hcciyw on smithi135 2024-05-09T00:10:41.853 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: pgmap v28: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:41.853 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all mon 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi026"}]: dispatch 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi026"}]': finished 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi135"}]: dispatch 2024-05-09T00:10:41.854 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi135"}]': finished 2024-05-09T00:10:41.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: pgmap v28: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:41.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:41.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:41.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:41.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:41.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:41.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all mon 2024-05-09T00:10:41.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:41.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi026"}]: dispatch 2024-05-09T00:10:41.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi026"}]': finished 2024-05-09T00:10:41.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi135"}]: dispatch 2024-05-09T00:10:41.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi135"}]': finished 2024-05-09T00:10:43.501 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:43 smithi135 ceph-mon[80466]: Upgrade: Updating crash.smithi026 (1/2) 2024-05-09T00:10:43.501 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:43 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:43.501 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:43 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:10:43.501 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:43 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:43.501 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:43 smithi135 ceph-mon[80466]: Deploying daemon crash.smithi026 on smithi026 2024-05-09T00:10:43.593 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:43 smithi026 ceph-mon[93667]: Upgrade: Updating crash.smithi026 (1/2) 2024-05-09T00:10:43.593 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:43 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:43.593 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:43 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi026", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:10:43.593 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:43 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:43.593 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:43 smithi026 ceph-mon[93667]: Deploying daemon crash.smithi026 on smithi026 2024-05-09T00:10:44.631 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:44 smithi026 ceph-mon[93667]: pgmap v29: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:44.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:44 smithi135 ceph-mon[80466]: pgmap v29: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:46.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:46 smithi026 ceph-mon[93667]: pgmap v30: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:46.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:46 smithi135 ceph-mon[80466]: pgmap v30: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:47.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:47 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:47.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:47 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:47.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:47 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:47.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:47 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:48.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:48 smithi026 ceph-mon[93667]: pgmap v31: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:48.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:48 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:48.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:48 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:10:48.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:48 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:48.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:48 smithi135 ceph-mon[80466]: pgmap v31: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:48.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:48 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:48.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:48 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T00:10:48.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:48 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:49.593 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:49 smithi135 ceph-mon[80466]: Upgrade: Updating crash.smithi135 (2/2) 2024-05-09T00:10:49.593 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:49 smithi135 ceph-mon[80466]: Deploying daemon crash.smithi135 on smithi135 2024-05-09T00:10:49.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:49 smithi026 ceph-mon[93667]: Upgrade: Updating crash.smithi135 (2/2) 2024-05-09T00:10:49.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:49 smithi026 ceph-mon[93667]: Deploying daemon crash.smithi135 on smithi135 2024-05-09T00:10:50.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:50 smithi026 ceph-mon[93667]: pgmap v32: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:50.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:50 smithi135 ceph-mon[80466]: pgmap v32: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:51.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:10:51.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:51.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:51.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:10:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:51.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:52.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:52 smithi026 ceph-mon[93667]: pgmap v33: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:52.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:52 smithi135 ceph-mon[80466]: pgmap v33: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:54.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:54 smithi026 ceph-mon[93667]: pgmap v34: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:54.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:54 smithi135 ceph-mon[80466]: pgmap v34: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:55.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:55 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:55.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:55 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:55.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:55 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:55.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:55 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:55.648 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:55 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:55.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:55 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:55.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:55 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:55.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:55 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:56.553 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:56 smithi135 ceph-mon[80466]: pgmap v35: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:56.553 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:56 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:56.553 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:56 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:56.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:56 smithi026 ceph-mon[93667]: pgmap v35: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:56.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:56 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:56.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:56 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:57.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.189+0000 7f7e21698700 1 -- 172.21.15.26:0/74775055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 msgr2=0x7f7e1c0f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.189+0000 7f7e21698700 1 --2- 172.21.15.26:0/74775055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 0x7f7e1c0f8120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7e0c0047f0 tx=0x7f7e0c009cb0).stop 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.189+0000 7f7e21698700 1 -- 172.21.15.26:0/74775055 shutdown_connections 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.189+0000 7f7e21698700 1 --2- 172.21.15.26:0/74775055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e1c0f6a00 0x7f7e1c0f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.189+0000 7f7e21698700 1 --2- 172.21.15.26:0/74775055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 0x7f7e1c0f8120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.189+0000 7f7e21698700 1 -- 172.21.15.26:0/74775055 >> 172.21.15.26:0/74775055 conn(0x7f7e1c0f1610 msgr2=0x7f7e1c0f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.189+0000 7f7e21698700 1 -- 172.21.15.26:0/74775055 shutdown_connections 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.189+0000 7f7e21698700 1 -- 172.21.15.26:0/74775055 wait complete. 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e21698700 1 Processor -- start 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e21698700 1 -- start start 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e21698700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e1c0f6a00 0x7f7e1c0fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e21698700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 0x7f7e1c0f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e21698700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0faca0 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e21698700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0f9240 con 0x7f7e1c0f6a00 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e1a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 0x7f7e1c0f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e1affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e1c0f6a00 0x7f7e1c0fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e1a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 0x7f7e1c0f8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41930/0 (socket says 172.21.15.26:41930) 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.190+0000 7f7e1a7fc700 1 -- 172.21.15.26:0/1605028686 learned_addr learned my addr 172.21.15.26:0/1605028686 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e1a7fc700 1 -- 172.21.15.26:0/1605028686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e1c0f6a00 msgr2=0x7f7e1c0fa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e1a7fc700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e1c0f6a00 0x7f7e1c0fa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e1a7fc700 1 -- 172.21.15.26:0/1605028686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c005040 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e1a7fc700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 0x7f7e1c0f8d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7e0400e8c0 tx=0x7f7e0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e13fff700 1 -- 172.21.15.26:0/1605028686 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e04007b40 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e13fff700 1 -- 172.21.15.26:0/1605028686 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7e0400f040 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e13fff700 1 -- 172.21.15.26:0/1605028686 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e04014880 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c0f94c0 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.191+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c0f9a80 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.192+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c0fef10 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.192+0000 7f7e13fff700 1 -- 172.21.15.26:0/1605028686 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f7e04007ca0 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.193+0000 7f7e13fff700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7e0806cbc0 0x7f7e0806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.193+0000 7f7e13fff700 1 -- 172.21.15.26:0/1605028686 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7e0408bbb0 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.193+0000 7f7e1affd700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7e0806cbc0 0x7f7e0806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.193+0000 7f7e1affd700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7e0806cbc0 0x7f7e0806f080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7e0c0047c0 tx=0x7f7e0c009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:57.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.198+0000 7f7e13fff700 1 -- 172.21.15.26:0/1605028686 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f7e04092080 con 0x7f7e1c0f7d00 2024-05-09T00:10:57.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.421+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e1c110630 con 0x7f7e0806cbc0 2024-05-09T00:10:57.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.423+0000 7f7e13fff700 1 -- 172.21.15.26:0/1605028686 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f7e1c110630 con 0x7f7e0806cbc0 2024-05-09T00:10:57.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7e0806cbc0 msgr2=0x7f7e0806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7e0806cbc0 0x7f7e0806f080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7e0c0047c0 tx=0x7f7e0c009cb0).stop 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 msgr2=0x7f7e1c0f8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 0x7f7e1c0f8d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7e0400e8c0 tx=0x7f7e0400b040).stop 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 shutdown_connections 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7e0806cbc0 0x7f7e0806f080 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e1c0f6a00 0x7f7e1c0fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 --2- 172.21.15.26:0/1605028686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7e1c0f7d00 0x7f7e1c0f8d50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 >> 172.21.15.26:0/1605028686 conn(0x7f7e1c0f1610 msgr2=0x7f7e1c0f6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 shutdown_connections 2024-05-09T00:10:57.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.425+0000 7f7e21698700 1 -- 172.21.15.26:0/1605028686 wait complete. 2024-05-09T00:10:57.432 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:10:57.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.528+0000 7f1dfdc91700 1 -- 172.21.15.26:0/3329414321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 msgr2=0x7f1df80f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.528+0000 7f1dfdc91700 1 --2- 172.21.15.26:0/3329414321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 0x7f1df80f8bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1dec0047f0 tx=0x7f1dec009cb0).stop 2024-05-09T00:10:57.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.528+0000 7f1dfdc91700 1 -- 172.21.15.26:0/3329414321 shutdown_connections 2024-05-09T00:10:57.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.528+0000 7f1dfdc91700 1 --2- 172.21.15.26:0/3329414321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 0x7f1df80f8bd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.528+0000 7f1dfdc91700 1 --2- 172.21.15.26:0/3329414321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df80f5ab0 0x7f1df80f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.528+0000 7f1dfdc91700 1 -- 172.21.15.26:0/3329414321 >> 172.21.15.26:0/3329414321 conn(0x7f1df80f15d0 msgr2=0x7f1df80f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:57.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.528+0000 7f1dfdc91700 1 -- 172.21.15.26:0/3329414321 shutdown_connections 2024-05-09T00:10:57.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.528+0000 7f1dfdc91700 1 -- 172.21.15.26:0/3329414321 wait complete. 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.529+0000 7f1dfdc91700 1 Processor -- start 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1dfdc91700 1 -- start start 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1dfdc91700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df80f5ab0 0x7f1df8107fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1dfdc91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 0x7f1df81084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1dfdc91700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8108a60 con 0x7f1df80f6450 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1dfdc91700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8108ba0 con 0x7f1df80f5ab0 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 0x7f1df81084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 0x7f1df81084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41952/0 (socket says 172.21.15.26:41952) 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df6ffd700 1 -- 172.21.15.26:0/1540908624 learned_addr learned my addr 172.21.15.26:0/1540908624 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df77fe700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df80f5ab0 0x7f1df8107fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df6ffd700 1 -- 172.21.15.26:0/1540908624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df80f5ab0 msgr2=0x7f1df8107fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df6ffd700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df80f5ab0 0x7f1df8107fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df6ffd700 1 -- 172.21.15.26:0/1540908624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec005040 con 0x7f1df80f6450 2024-05-09T00:10:57.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df6ffd700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 0x7f1df81084b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1dec013620 tx=0x7f1dec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:57.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.530+0000 7f1df4ff9700 1 -- 172.21.15.26:0/1540908624 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dec00e070 con 0x7f1df80f6450 2024-05-09T00:10:57.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.531+0000 7f1df4ff9700 1 -- 172.21.15.26:0/1540908624 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1dec007e90 con 0x7f1df80f6450 2024-05-09T00:10:57.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.531+0000 7f1df4ff9700 1 -- 172.21.15.26:0/1540908624 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dec018070 con 0x7f1df80f6450 2024-05-09T00:10:57.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.531+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df810d5e0 con 0x7f1df80f6450 2024-05-09T00:10:57.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.531+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df810db20 con 0x7f1df80f6450 2024-05-09T00:10:57.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.532+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df80fffd0 con 0x7f1df80f6450 2024-05-09T00:10:57.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.532+0000 7f1df4ff9700 1 -- 172.21.15.26:0/1540908624 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f1dec01d420 con 0x7f1df80f6450 2024-05-09T00:10:57.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.533+0000 7f1df4ff9700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1de006cbc0 0x7f1de006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.533+0000 7f1df4ff9700 1 -- 172.21.15.26:0/1540908624 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1dec08ccd0 con 0x7f1df80f6450 2024-05-09T00:10:57.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.533+0000 7f1df77fe700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1de006cbc0 0x7f1de006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.533+0000 7f1df77fe700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1de006cbc0 0x7f1de006f080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1df805fad0 tx=0x7f1de8009e00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:57.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.537+0000 7f1df4ff9700 1 -- 172.21.15.26:0/1540908624 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f1dec05a660 con 0x7f1df80f6450 2024-05-09T00:10:57.597 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:57 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:57.598 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:57 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:57.598 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:57 smithi135 ceph-mon[80466]: pgmap v36: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:57.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:57 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:57.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:57 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:57.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:57 smithi026 ceph-mon[93667]: pgmap v36: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:10:57.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.757+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1df8059120 con 0x7f1de006cbc0 2024-05-09T00:10:57.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.759+0000 7f1df4ff9700 1 -- 172.21.15.26:0/1540908624 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f1df8059120 con 0x7f1de006cbc0 2024-05-09T00:10:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1de006cbc0 msgr2=0x7f1de006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1de006cbc0 0x7f1de006f080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1df805fad0 tx=0x7f1de8009e00).stop 2024-05-09T00:10:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 msgr2=0x7f1df81084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 0x7f1df81084b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1dec013620 tx=0x7f1dec009cb0).stop 2024-05-09T00:10:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 shutdown_connections 2024-05-09T00:10:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1de006cbc0 0x7f1de006f080 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1df80f5ab0 0x7f1df8107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 --2- 172.21.15.26:0/1540908624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1df80f6450 0x7f1df81084b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 >> 172.21.15.26:0/1540908624 conn(0x7f1df80f15d0 msgr2=0x7f1df80fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 shutdown_connections 2024-05-09T00:10:57.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.761+0000 7f1dfdc91700 1 -- 172.21.15.26:0/1540908624 wait complete. 2024-05-09T00:10:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.863+0000 7fce34cd9700 1 -- 172.21.15.26:0/3138812162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f66f0 msgr2=0x7fce300f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.863+0000 7fce34cd9700 1 --2- 172.21.15.26:0/3138812162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f66f0 0x7fce300f6b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fce200047f0 tx=0x7fce20009cb0).stop 2024-05-09T00:10:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.863+0000 7fce34cd9700 1 -- 172.21.15.26:0/3138812162 shutdown_connections 2024-05-09T00:10:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.863+0000 7fce34cd9700 1 --2- 172.21.15.26:0/3138812162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce300f7990 0x7fce300f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.863+0000 7fce34cd9700 1 --2- 172.21.15.26:0/3138812162 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f66f0 0x7fce300f6b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.863+0000 7fce34cd9700 1 -- 172.21.15.26:0/3138812162 >> 172.21.15.26:0/3138812162 conn(0x7fce300f1e50 msgr2=0x7fce300f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.863+0000 7fce34cd9700 1 -- 172.21.15.26:0/3138812162 shutdown_connections 2024-05-09T00:10:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.863+0000 7fce34cd9700 1 -- 172.21.15.26:0/3138812162 wait complete. 2024-05-09T00:10:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce34cd9700 1 Processor -- start 2024-05-09T00:10:57.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce34cd9700 1 -- start start 2024-05-09T00:10:57.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce34cd9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce300f66f0 0x7fce300fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce34cd9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f7990 0x7fce300f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce34cd9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300fac20 con 0x7fce300f7990 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce34cd9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300f91c0 con 0x7fce300f66f0 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce2dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f7990 0x7fce300f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce2e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce300f66f0 0x7fce300fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce2dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f7990 0x7fce300f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41974/0 (socket says 172.21.15.26:41974) 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.864+0000 7fce2dd9b700 1 -- 172.21.15.26:0/3577794275 learned_addr learned my addr 172.21.15.26:0/3577794275 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce2dd9b700 1 -- 172.21.15.26:0/3577794275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce300f66f0 msgr2=0x7fce300fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce2dd9b700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce300f66f0 0x7fce300fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce2dd9b700 1 -- 172.21.15.26:0/3577794275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20005040 con 0x7fce300f7990 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce2e59c700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce300f66f0 0x7fce300fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce2dd9b700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f7990 0x7fce300f8cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fce2400e8f0 tx=0x7fce2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce1f7fe700 1 -- 172.21.15.26:0/3577794275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce24007b40 con 0x7fce300f7990 2024-05-09T00:10:57.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce1f7fe700 1 -- 172.21.15.26:0/3577794275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce2400f040 con 0x7fce300f7990 2024-05-09T00:10:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce300f9440 con 0x7fce300f7990 2024-05-09T00:10:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce1f7fe700 1 -- 172.21.15.26:0/3577794275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce24014880 con 0x7fce300f7990 2024-05-09T00:10:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.865+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce300f9a00 con 0x7fce300f7990 2024-05-09T00:10:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.866+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce300feeb0 con 0x7fce300f7990 2024-05-09T00:10:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.866+0000 7fce1f7fe700 1 -- 172.21.15.26:0/3577794275 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fce24014ab0 con 0x7fce300f7990 2024-05-09T00:10:57.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.867+0000 7fce1f7fe700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fce1806cbc0 0x7fce1806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.867+0000 7fce1f7fe700 1 -- 172.21.15.26:0/3577794275 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fce2408bb80 con 0x7fce300f7990 2024-05-09T00:10:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.867+0000 7fce2e59c700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fce1806cbc0 0x7fce1806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:57.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.867+0000 7fce2e59c700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fce1806cbc0 0x7fce1806f080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fce200047c0 tx=0x7fce20009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:57.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:57.871+0000 7fce1f7fe700 1 -- 172.21.15.26:0/3577794275 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fce24059510 con 0x7fce300f7990 2024-05-09T00:10:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.079+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce301105b0 con 0x7fce1806cbc0 2024-05-09T00:10:58.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.089+0000 7fce1f7fe700 1 -- 172.21.15.26:0/3577794275 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fce301105b0 con 0x7fce1806cbc0 2024-05-09T00:10:58.086 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:10:58.087 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (2m) 2s ago 11m 23.8M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:10:58.087 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (12s) 2s ago 11m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:10:58.087 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (7s) 3s ago 11m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:10:58.087 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (2m) 2s ago 11m 48.2M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:10:58.087 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (6m) 2s ago 6m 15.3M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:10:58.087 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (6m) 2s ago 6m 154M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:10:58.087 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (6m) 3s ago 6m 14.5M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:10:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (6m) 3s ago 6m 14.6M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:10:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (2m) 2s ago 12m 493M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:10:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (91s) 3s ago 10m 449M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:10:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (75s) 2s ago 13m 46.6M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:10:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (53s) 3s ago 10m 39.2M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:10:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2m) 2s ago 11m 16.0M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:10:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (2m) 3s ago 10m 22.4M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:10:58.088 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (10m) 2s ago 10m 241M 1911M 16.2.15-1-g8963e9de 727f386679cb 368a46c2d2cc 2024-05-09T00:10:58.089 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (9m) 2s ago 9m 255M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:10:58.089 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (9m) 2s ago 9m 213M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:10:58.089 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (8m) 3s ago 8m 286M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:10:58.089 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (8m) 3s ago 8m 250M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:10:58.089 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (7m) 3s ago 7m 239M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:10:58.089 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (96s) 3s ago 10m 70.1M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:10:58.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fce1806cbc0 msgr2=0x7fce1806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fce1806cbc0 0x7fce1806f080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fce200047c0 tx=0x7fce20009cb0).stop 2024-05-09T00:10:58.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f7990 msgr2=0x7fce300f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f7990 0x7fce300f8cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fce2400e8f0 tx=0x7fce2400b040).stop 2024-05-09T00:10:58.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 shutdown_connections 2024-05-09T00:10:58.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fce1806cbc0 0x7fce1806f080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce300f66f0 0x7fce300fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 --2- 172.21.15.26:0/3577794275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce300f7990 0x7fce300f8cd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 >> 172.21.15.26:0/3577794275 conn(0x7fce300f1e50 msgr2=0x7fce30060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:58.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 shutdown_connections 2024-05-09T00:10:58.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.091+0000 7fce34cd9700 1 -- 172.21.15.26:0/3577794275 wait complete. 2024-05-09T00:10:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.192+0000 7f25904ff700 1 -- 172.21.15.26:0/2692206322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 msgr2=0x7f25880f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.192+0000 7f25904ff700 1 --2- 172.21.15.26:0/2692206322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 0x7f25880f7df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f25780047f0 tx=0x7f2578009cb0).stop 2024-05-09T00:10:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.192+0000 7f25904ff700 1 -- 172.21.15.26:0/2692206322 shutdown_connections 2024-05-09T00:10:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 --2- 172.21.15.26:0/2692206322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 0x7f25880f7df0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 --2- 172.21.15.26:0/2692206322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25880f66f0 0x7f25880f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 -- 172.21.15.26:0/2692206322 >> 172.21.15.26:0/2692206322 conn(0x7f25880f1e50 msgr2=0x7f25880f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 -- 172.21.15.26:0/2692206322 shutdown_connections 2024-05-09T00:10:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 -- 172.21.15.26:0/2692206322 wait complete. 2024-05-09T00:10:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 Processor -- start 2024-05-09T00:10:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 -- start start 2024-05-09T00:10:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25880f66f0 0x7f2588108060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 0x7f2588108550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2588108b00 con 0x7f25880f7990 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.193+0000 7f25904ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2588108c40 con 0x7f25880f66f0 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258da9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 0x7f2588108550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258e29b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25880f66f0 0x7f2588108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258da9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 0x7f2588108550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41996/0 (socket says 172.21.15.26:41996) 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258da9a700 1 -- 172.21.15.26:0/2182349202 learned_addr learned my addr 172.21.15.26:0/2182349202 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258da9a700 1 -- 172.21.15.26:0/2182349202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25880f66f0 msgr2=0x7f2588108060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258da9a700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25880f66f0 0x7f2588108060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258da9a700 1 -- 172.21.15.26:0/2182349202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578005040 con 0x7f25880f7990 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258e29b700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25880f66f0 0x7f2588108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f258da9a700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 0x7f2588108550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2578013560 tx=0x7f2578009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f257f7fe700 1 -- 172.21.15.26:0/2182349202 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2578018070 con 0x7f25880f7990 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f257f7fe700 1 -- 172.21.15.26:0/2182349202 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2578007e90 con 0x7f25880f7990 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f257f7fe700 1 -- 172.21.15.26:0/2182349202 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257801c380 con 0x7f25880f7990 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258810d680 con 0x7f25880f7990 2024-05-09T00:10:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.194+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258810dc40 con 0x7f25880f7990 2024-05-09T00:10:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.195+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25880feeb0 con 0x7f25880f7990 2024-05-09T00:10:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.196+0000 7f257f7fe700 1 -- 172.21.15.26:0/2182349202 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f25780123c0 con 0x7f25880f7990 2024-05-09T00:10:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.196+0000 7f257f7fe700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f257406cbc0 0x7f257406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.196+0000 7f257f7fe700 1 -- 172.21.15.26:0/2182349202 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f257808cce0 con 0x7f25880f7990 2024-05-09T00:10:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.196+0000 7f258e29b700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f257406cbc0 0x7f257406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.197+0000 7f258e29b700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f257406cbc0 0x7f257406f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f25880f77f0 tx=0x7f258400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:58.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.201+0000 7f257f7fe700 1 -- 172.21.15.26:0/2182349202 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f257805a670 con 0x7f25880f7990 2024-05-09T00:10:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.497+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f258810e2d0 con 0x7f25880f7990 2024-05-09T00:10:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.497+0000 7f257f7fe700 1 -- 172.21.15.26:0/2182349202 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f257805a200 con 0x7f25880f7990 2024-05-09T00:10:58.494 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 10, 2024-05-09T00:10:58.495 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 4 2024-05-09T00:10:58.496 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:10:58.496 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:10:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.499+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f257406cbc0 msgr2=0x7f257406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.499+0000 7f25904ff700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f257406cbc0 0x7f257406f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f25880f77f0 tx=0x7f258400b040).stop 2024-05-09T00:10:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.499+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 msgr2=0x7f2588108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.499+0000 7f25904ff700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 0x7f2588108550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2578013560 tx=0x7f2578009cb0).stop 2024-05-09T00:10:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.500+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 shutdown_connections 2024-05-09T00:10:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.500+0000 7f25904ff700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f257406cbc0 0x7f257406f080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.500+0000 7f25904ff700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25880f66f0 0x7f2588108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.500+0000 7f25904ff700 1 --2- 172.21.15.26:0/2182349202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25880f7990 0x7f2588108550 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.500+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 >> 172.21.15.26:0/2182349202 conn(0x7f25880f1e50 msgr2=0x7f2588060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.500+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 shutdown_connections 2024-05-09T00:10:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.500+0000 7f25904ff700 1 -- 172.21.15.26:0/2182349202 wait complete. 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 -- 172.21.15.26:0/1651750910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 msgr2=0x7faaf80fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 --2- 172.21.15.26:0/1651750910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 0x7faaf80fa3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7faae80047f0 tx=0x7faae8009cb0).stop 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 -- 172.21.15.26:0/1651750910 shutdown_connections 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 --2- 172.21.15.26:0/1651750910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf80fa950 0x7faaf80fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 --2- 172.21.15.26:0/1651750910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 0x7faaf80fa3d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 -- 172.21.15.26:0/1651750910 >> 172.21.15.26:0/1651750910 conn(0x7faaf80f1e50 msgr2=0x7faaf80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 -- 172.21.15.26:0/1651750910 shutdown_connections 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 -- 172.21.15.26:0/1651750910 wait complete. 2024-05-09T00:10:58.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.603+0000 7faafdffb700 1 Processor -- start 2024-05-09T00:10:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faafdffb700 1 -- start start 2024-05-09T00:10:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faafdffb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 0x7faaf810a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faafdffb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf80fa950 0x7faaf810a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faafdffb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf810ac00 con 0x7faaf8061280 2024-05-09T00:10:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faafdffb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf810ad40 con 0x7faaf80fa950 2024-05-09T00:10:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 0x7faaf810a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 0x7faaf810a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42012/0 (socket says 172.21.15.26:42012) 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf77fe700 1 -- 172.21.15.26:0/2201769219 learned_addr learned my addr 172.21.15.26:0/2201769219 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf6ffd700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf80fa950 0x7faaf810a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf77fe700 1 -- 172.21.15.26:0/2201769219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf80fa950 msgr2=0x7faaf810a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf77fe700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf80fa950 0x7faaf810a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf77fe700 1 -- 172.21.15.26:0/2201769219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8005040 con 0x7faaf8061280 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf77fe700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 0x7faaf810a160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7faae8013620 tx=0x7faae8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.604+0000 7faaf4ff9700 1 -- 172.21.15.26:0/2201769219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae800e070 con 0x7faaf8061280 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.605+0000 7faaf4ff9700 1 -- 172.21.15.26:0/2201769219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faae8007e90 con 0x7faaf8061280 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.605+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf810f780 con 0x7faaf8061280 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.605+0000 7faaf4ff9700 1 -- 172.21.15.26:0/2201769219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae8018070 con 0x7faaf8061280 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.605+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf810fd40 con 0x7faaf8061280 2024-05-09T00:10:58.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.605+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf8100000 con 0x7faaf8061280 2024-05-09T00:10:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.606+0000 7faaf4ff9700 1 -- 172.21.15.26:0/2201769219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7faae801d420 con 0x7faaf8061280 2024-05-09T00:10:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.607+0000 7faaf4ff9700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faae006cbc0 0x7faae006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.607+0000 7faaf6ffd700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faae006cbc0 0x7faae006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.607+0000 7faaf4ff9700 1 -- 172.21.15.26:0/2201769219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7faae808cd30 con 0x7faaf8061280 2024-05-09T00:10:58.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.607+0000 7faaf6ffd700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faae006cbc0 0x7faae006f080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7faaf8061050 tx=0x7faaec00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:58.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.611+0000 7faaf4ff9700 1 -- 172.21.15.26:0/2201769219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7faae805a6c0 con 0x7faaf8061280 2024-05-09T00:10:58.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.863+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faaf81103e0 con 0x7faaf8061280 2024-05-09T00:10:58.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.863+0000 7faaf4ff9700 1 -- 172.21.15.26:0/2201769219 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1848 (secure 0 0 0) 0x7faae805a250 con 0x7faaf8061280 2024-05-09T00:10:58.860 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:10:58.860 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:10:58.861 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:10:58.862 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:10:58.863 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:10:58.864 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:10:58.864 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:10:58.864 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:58.864 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:58.864 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:10:58.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.865+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faae006cbc0 msgr2=0x7faae006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.865+0000 7faafdffb700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faae006cbc0 0x7faae006f080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7faaf8061050 tx=0x7faaec00b040).stop 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 msgr2=0x7faaf810a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 0x7faaf810a160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7faae8013620 tx=0x7faae8009cb0).stop 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 shutdown_connections 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faae006cbc0 0x7faae006f080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaf8061280 0x7faaf810a160 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 --2- 172.21.15.26:0/2201769219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf80fa950 0x7faaf810a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 >> 172.21.15.26:0/2201769219 conn(0x7faaf80f1e50 msgr2=0x7faaf80f61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 shutdown_connections 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.866+0000 7faafdffb700 1 -- 172.21.15.26:0/2201769219 wait complete. 2024-05-09T00:10:58.865 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:10:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.970+0000 7ff774aac700 1 -- 172.21.15.26:0/2160656203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 msgr2=0x7ff7700f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.970+0000 7ff774aac700 1 --2- 172.21.15.26:0/2160656203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 0x7ff7700f7c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff7600047f0 tx=0x7ff760009cb0).stop 2024-05-09T00:10:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.970+0000 7ff774aac700 1 -- 172.21.15.26:0/2160656203 shutdown_connections 2024-05-09T00:10:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.970+0000 7ff774aac700 1 --2- 172.21.15.26:0/2160656203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7700f8aa0 0x7ff7700f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.970+0000 7ff774aac700 1 --2- 172.21.15.26:0/2160656203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 0x7ff7700f7c20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.970+0000 7ff774aac700 1 -- 172.21.15.26:0/2160656203 >> 172.21.15.26:0/2160656203 conn(0x7ff7700f2f80 msgr2=0x7ff7700f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.970+0000 7ff774aac700 1 -- 172.21.15.26:0/2160656203 shutdown_connections 2024-05-09T00:10:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.970+0000 7ff774aac700 1 -- 172.21.15.26:0/2160656203 wait complete. 2024-05-09T00:10:58.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff774aac700 1 Processor -- start 2024-05-09T00:10:58.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff774aac700 1 -- start start 2024-05-09T00:10:58.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff774aac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 0x7ff770107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff774aac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7700f8aa0 0x7ff770108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff774aac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff770108a00 con 0x7ff7700f7800 2024-05-09T00:10:58.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff774aac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff770108b40 con 0x7ff7700f8aa0 2024-05-09T00:10:58.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff76e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 0x7ff770107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff76e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 0x7ff770107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42030/0 (socket says 172.21.15.26:42030) 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff76e59c700 1 -- 172.21.15.26:0/4052044349 learned_addr learned my addr 172.21.15.26:0/4052044349 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.971+0000 7ff76dd9b700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7700f8aa0 0x7ff770108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff76e59c700 1 -- 172.21.15.26:0/4052044349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7700f8aa0 msgr2=0x7ff770108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff76e59c700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7700f8aa0 0x7ff770108450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff76e59c700 1 -- 172.21.15.26:0/4052044349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff760005040 con 0x7ff7700f7800 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff76e59c700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 0x7ff770107f60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff760013620 tx=0x7ff760009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff75f7fe700 1 -- 172.21.15.26:0/4052044349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff76000e030 con 0x7ff7700f7800 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff75f7fe700 1 -- 172.21.15.26:0/4052044349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff760007e90 con 0x7ff7700f7800 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77010d580 con 0x7ff7700f7800 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff75f7fe700 1 -- 172.21.15.26:0/4052044349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff760018070 con 0x7ff7700f7800 2024-05-09T00:10:58.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.972+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77010db40 con 0x7ff7700f7800 2024-05-09T00:10:58.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.973+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7700fffc0 con 0x7ff7700f7800 2024-05-09T00:10:58.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.974+0000 7ff75f7fe700 1 -- 172.21.15.26:0/4052044349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7ff76001d420 con 0x7ff7700f7800 2024-05-09T00:10:58.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.974+0000 7ff75f7fe700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff75806cbc0 0x7ff75806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:58.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.974+0000 7ff75f7fe700 1 -- 172.21.15.26:0/4052044349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff76008d510 con 0x7ff7700f7800 2024-05-09T00:10:58.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.974+0000 7ff76dd9b700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff75806cbc0 0x7ff75806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:58.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.974+0000 7ff76dd9b700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff75806cbc0 0x7ff75806f080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff764004dc0 tx=0x7ff76400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:58.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:58.978+0000 7ff75f7fe700 1 -- 172.21.15.26:0/4052044349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7ff76005af60 con 0x7ff7700f7800 2024-05-09T00:10:59.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:58 smithi026 ceph-mon[93667]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:59.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:58 smithi026 ceph-mon[93667]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:59.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:58 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:59.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:58 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:59.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:58 smithi026 ceph-mon[93667]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:59.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:58 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2182349202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:59.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:58 smithi135 ceph-mon[80466]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:59.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:58 smithi135 ceph-mon[80466]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:59.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:58 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:59.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:58 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:10:59.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:58 smithi135 ceph-mon[80466]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:10:59.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:58 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2182349202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:10:59.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.203+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff770059120 con 0x7ff75806cbc0 2024-05-09T00:10:59.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.204+0000 7ff75f7fe700 1 -- 172.21.15.26:0/4052044349 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7ff770059120 con 0x7ff75806cbc0 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "6/21 daemons upgraded", 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading crash daemons", 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:10:59.201 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:10:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff75806cbc0 msgr2=0x7ff75806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff75806cbc0 0x7ff75806f080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff764004dc0 tx=0x7ff76400b040).stop 2024-05-09T00:10:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 msgr2=0x7ff770107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 0x7ff770107f60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff760013620 tx=0x7ff760009cb0).stop 2024-05-09T00:10:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 shutdown_connections 2024-05-09T00:10:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff75806cbc0 0x7ff75806f080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7700f7800 0x7ff770107f60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 --2- 172.21.15.26:0/4052044349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7700f8aa0 0x7ff770108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.206+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 >> 172.21.15.26:0/4052044349 conn(0x7ff7700f2f80 msgr2=0x7ff7700fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.207+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 shutdown_connections 2024-05-09T00:10:59.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.207+0000 7ff774aac700 1 -- 172.21.15.26:0/4052044349 wait complete. 2024-05-09T00:10:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.310+0000 7fe338a89700 1 -- 172.21.15.26:0/781467654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f8cb0 msgr2=0x7fe3340f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.310+0000 7fe338a89700 1 --2- 172.21.15.26:0/781467654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f8cb0 0x7fe3340f9110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe31c0047f0 tx=0x7fe31c009cb0).stop 2024-05-09T00:10:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.310+0000 7fe338a89700 1 -- 172.21.15.26:0/781467654 shutdown_connections 2024-05-09T00:10:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.310+0000 7fe338a89700 1 --2- 172.21.15.26:0/781467654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f8cb0 0x7fe3340f9110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.310+0000 7fe338a89700 1 --2- 172.21.15.26:0/781467654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340f7a10 0x7fe3340f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.310+0000 7fe338a89700 1 -- 172.21.15.26:0/781467654 >> 172.21.15.26:0/781467654 conn(0x7fe3340f3150 msgr2=0x7fe3340f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.310+0000 7fe338a89700 1 -- 172.21.15.26:0/781467654 shutdown_connections 2024-05-09T00:10:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.310+0000 7fe338a89700 1 -- 172.21.15.26:0/781467654 wait complete. 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe338a89700 1 Processor -- start 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe338a89700 1 -- start start 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe338a89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f7a10 0x7fe334108270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe338a89700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340f8cb0 0x7fe334108760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe338a89700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334108d10 con 0x7fe3340f7a10 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe338a89700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334108e50 con 0x7fe3340f8cb0 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe33259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f7a10 0x7fe334108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe33259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f7a10 0x7fe334108270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42052/0 (socket says 172.21.15.26:42052) 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe33259c700 1 -- 172.21.15.26:0/2044287369 learned_addr learned my addr 172.21.15.26:0/2044287369 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.311+0000 7fe32bfff700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340f8cb0 0x7fe334108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe33259c700 1 -- 172.21.15.26:0/2044287369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340f8cb0 msgr2=0x7fe334108760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe33259c700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340f8cb0 0x7fe334108760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe33259c700 1 -- 172.21.15.26:0/2044287369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c005040 con 0x7fe3340f7a10 2024-05-09T00:10:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe33259c700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f7a10 0x7fe334108270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fe32400e8c0 tx=0x7fe32400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe32b7fe700 1 -- 172.21.15.26:0/2044287369 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe324007b40 con 0x7fe3340f7a10 2024-05-09T00:10:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33410d8f0 con 0x7fe3340f7a10 2024-05-09T00:10:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe32b7fe700 1 -- 172.21.15.26:0/2044287369 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe32400f040 con 0x7fe3340f7a10 2024-05-09T00:10:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe32b7fe700 1 -- 172.21.15.26:0/2044287369 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe324014880 con 0x7fe3340f7a10 2024-05-09T00:10:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.312+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33410deb0 con 0x7fe3340f7a10 2024-05-09T00:10:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.313+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33405fb50 con 0x7fe3340f7a10 2024-05-09T00:10:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.314+0000 7fe32b7fe700 1 -- 172.21.15.26:0/2044287369 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fe324007ca0 con 0x7fe3340f7a10 2024-05-09T00:10:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.314+0000 7fe32b7fe700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe32006cbc0 0x7fe32006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:10:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.314+0000 7fe32b7fe700 1 -- 172.21.15.26:0/2044287369 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe32408bc90 con 0x7fe3340f7a10 2024-05-09T00:10:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.314+0000 7fe32bfff700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe32006cbc0 0x7fe32006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.315+0000 7fe32bfff700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe32006cbc0 0x7fe32006f080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe31c0047c0 tx=0x7fe31c009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:59.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.319+0000 7fe32b7fe700 1 -- 172.21.15.26:0/2044287369 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fe324059620 con 0x7fe3340f7a10 2024-05-09T00:10:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.631+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe3341001d0 con 0x7fe3340f7a10 2024-05-09T00:10:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.632+0000 7fe32b7fe700 1 -- 172.21.15.26:0/2044287369 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe3240591b0 con 0x7fe3340f7a10 2024-05-09T00:10:59.629 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:59.629 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:10:59.629 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:10:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe32006cbc0 msgr2=0x7fe32006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe32006cbc0 0x7fe32006f080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe31c0047c0 tx=0x7fe31c009cb0).stop 2024-05-09T00:10:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f7a10 msgr2=0x7fe334108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f7a10 0x7fe334108270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fe32400e8c0 tx=0x7fe32400b040).stop 2024-05-09T00:10:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 shutdown_connections 2024-05-09T00:10:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe32006cbc0 0x7fe32006f080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3340f7a10 0x7fe334108270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 --2- 172.21.15.26:0/2044287369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3340f8cb0 0x7fe334108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:10:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 >> 172.21.15.26:0/2044287369 conn(0x7fe3340f3150 msgr2=0x7fe3340fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 shutdown_connections 2024-05-09T00:10:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:10:59.634+0000 7fe338a89700 1 -- 172.21.15.26:0/2044287369 wait complete. 2024-05-09T00:11:00.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:59 smithi026 ceph-mon[93667]: pgmap v37: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:00.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:59 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2201769219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:11:00.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:59 smithi026 ceph-mon[93667]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:00.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:10:59 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2044287369' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:11:00.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:59 smithi135 ceph-mon[80466]: pgmap v37: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:00.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:59 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2201769219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:11:00.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:59 smithi135 ceph-mon[80466]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:00.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:10:59 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2044287369' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:01.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi026"}]: dispatch 2024-05-09T00:11:01.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi026"}]': finished 2024-05-09T00:11:01.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi135"}]: dispatch 2024-05-09T00:11:01.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi135"}]': finished 2024-05-09T00:11:01.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi026"}]: dispatch 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi026"}]': finished 2024-05-09T00:11:01.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi135"}]: dispatch 2024-05-09T00:11:01.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi135"}]': finished 2024-05-09T00:11:01.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T00:11:02.568 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:02 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all crash 2024-05-09T00:11:02.568 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:02 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T00:11:02.569 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:02 smithi026 ceph-mon[93667]: Upgrade: osd.0 is safe to restart 2024-05-09T00:11:02.569 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:02 smithi026 ceph-mon[93667]: pgmap v38: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:02.569 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:02 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:02.569 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:02 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:11:02.569 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:02 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:02.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:02 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all crash 2024-05-09T00:11:02.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:02 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T00:11:02.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:02 smithi135 ceph-mon[80466]: Upgrade: osd.0 is safe to restart 2024-05-09T00:11:02.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:02 smithi135 ceph-mon[80466]: pgmap v38: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:02.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:02 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:02.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:02 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:11:02.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:02 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:03.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:03 smithi026 ceph-mon[93667]: Upgrade: Updating osd.0 2024-05-09T00:11:03.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:03 smithi026 ceph-mon[93667]: Deploying daemon osd.0 on smithi026 2024-05-09T00:11:03.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:03 smithi135 ceph-mon[80466]: Upgrade: Updating osd.0 2024-05-09T00:11:03.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:03 smithi135 ceph-mon[80466]: Deploying daemon osd.0 on smithi026 2024-05-09T00:11:04.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:04 smithi026 ceph-mon[93667]: pgmap v39: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:04.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:04 smithi135 ceph-mon[80466]: pgmap v39: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:05.586 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:05 smithi026 systemd[1]: Stopping Ceph osd.0 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:11:05.896 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[52772]: debug 2024-05-09T00:11:05.588+0000 7f35ff299700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-09T00:11:05.897 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[52772]: debug 2024-05-09T00:11:05.588+0000 7f35ff299700 -1 osd.0 49 *** Got signal Terminated *** 2024-05-09T00:11:05.897 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:05 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[52772]: debug 2024-05-09T00:11:05.588+0000 7f35ff299700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:11:06.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:06 smithi026 ceph-mon[93667]: pgmap v40: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:06.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:06 smithi026 ceph-mon[93667]: osd.0 marked itself down and dead 2024-05-09T00:11:06.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:11:06.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:06 smithi135 ceph-mon[80466]: pgmap v40: 65 pgs: 65 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:06.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:06 smithi135 ceph-mon[80466]: osd.0 marked itself down and dead 2024-05-09T00:11:06.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:11:07.146 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:06 smithi026 bash[100825]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0 2024-05-09T00:11:07.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:07 smithi026 ceph-mon[93667]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:11:07.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:07 smithi026 ceph-mon[93667]: osdmap e50: 6 total, 5 up, 6 in 2024-05-09T00:11:07.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:07 smithi026 ceph-mon[93667]: osdmap e51: 6 total, 5 up, 6 in 2024-05-09T00:11:07.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:07 smithi135 ceph-mon[80466]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:11:07.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:07 smithi135 ceph-mon[80466]: osdmap e50: 6 total, 5 up, 6 in 2024-05-09T00:11:07.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:07 smithi135 ceph-mon[80466]: osdmap e51: 6 total, 5 up, 6 in 2024-05-09T00:11:08.617 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:08 smithi026 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.0.service: Succeeded. 2024-05-09T00:11:08.618 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:08 smithi026 systemd[1]: Stopped Ceph osd.0 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:11:08.618 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:08 smithi026 ceph-mon[93667]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:08.618 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:08 smithi026 ceph-mon[93667]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-05-09T00:11:08.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:08 smithi135 ceph-mon[80466]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:08.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:08 smithi135 ceph-mon[80466]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-05-09T00:11:08.896 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:08 smithi026 systemd[1]: Starting Ceph osd.0 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:11:09.896 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:09 smithi026 bash[101099]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T00:11:09.896 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:09 smithi026 bash[101099]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T00:11:09.897 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:09 smithi026 bash[101099]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T00:11:09.897 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:09 smithi026 bash[101099]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T00:11:09.897 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:09 smithi026 bash[101099]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-09T00:11:09.897 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:09 smithi026 bash[101099]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T00:11:09.897 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:09 smithi026 bash[101099]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-09T00:11:10.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:10 smithi026 ceph-mon[93667]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:10.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:10 smithi135 ceph-mon[80466]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:11.146 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:10 smithi026 ceph-osd[101398]: -- 172.21.15.26:0/6616839 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bc4184d1e0 con 0x55bc4181cc00 2024-05-09T00:11:11.147 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:10 smithi026 bash[101360]: 443f82cb22bd9e3743dac33a7517dbf6f18e4f93241072a18a79db201682af1f 2024-05-09T00:11:11.147 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:10 smithi026 systemd[1]: Started Ceph osd.0 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:11:11.647 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:11 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[101375]: 2024-05-09T00:11:11.341+0000 7fed484567c0 -1 Falling back to public interface 2024-05-09T00:11:11.938 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:11 smithi026 ceph-mon[93667]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:11.938 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:11 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:12.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:11 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:12.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:11 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:12.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:11 smithi135 ceph-mon[80466]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:12.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:11 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:12.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:11 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:12.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:11 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:13.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:12 smithi026 ceph-mon[93667]: Health check failed: Degraded data redundancy: 43/219 objects degraded (19.635%), 18 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:13.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:12 smithi026 ceph-mon[93667]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-05-09T00:11:13.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:12 smithi135 ceph-mon[80466]: Health check failed: Degraded data redundancy: 43/219 objects degraded (19.635%), 18 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:13.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:12 smithi135 ceph-mon[80466]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-05-09T00:11:14.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:13 smithi026 ceph-mon[93667]: pgmap v46: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:14.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:13 smithi135 ceph-mon[80466]: pgmap v46: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:16.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:15 smithi026 ceph-mon[93667]: pgmap v47: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:16.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:15 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:16.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:15 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:15 smithi135 ceph-mon[80466]: pgmap v47: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:15 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:16.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:15 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:17.397 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[101375]: 2024-05-09T00:11:17.216+0000 7fed484567c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-05-09T00:11:17.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:17.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:17.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:17.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:18.076 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:17 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[101375]: 2024-05-09T00:11:17.739+0000 7fed484567c0 -1 osd.0 49 log_to_monitors true 2024-05-09T00:11:18.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:18 smithi026 ceph-mon[93667]: pgmap v48: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:18.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:18 smithi026 ceph-mon[93667]: from='osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T00:11:18.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:18 smithi135 ceph-mon[80466]: pgmap v48: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:18.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:18 smithi135 ceph-mon[80466]: from='osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T00:11:19.174 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:11:18 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[101375]: 2024-05-09T00:11:18.922+0000 7fed358a7700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:11:19.586 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:19 smithi026 ceph-mon[93667]: from='osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T00:11:19.586 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:19 smithi026 ceph-mon[93667]: osdmap e52: 6 total, 5 up, 6 in 2024-05-09T00:11:19.586 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:19 smithi026 ceph-mon[93667]: from='osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:11:19.586 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:19 smithi026 ceph-mon[93667]: from='osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802]' entity='osd.0' 2024-05-09T00:11:19.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:19 smithi135 ceph-mon[80466]: from='osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T00:11:19.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:19 smithi135 ceph-mon[80466]: osdmap e52: 6 total, 5 up, 6 in 2024-05-09T00:11:19.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:19 smithi135 ceph-mon[80466]: from='osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:11:19.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:19 smithi135 ceph-mon[80466]: from='osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802]' entity='osd.0' 2024-05-09T00:11:20.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: pgmap v50: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T00:11:20.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:11:20.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802] boot 2024-05-09T00:11:20.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: osdmap e53: 6 total, 6 up, 6 in 2024-05-09T00:11:20.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:11:20.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: pgmap v50: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:20.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:20.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:20.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:20.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:20.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:20.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:20.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:20.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:20.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:20.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T00:11:20.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:11:20.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: osd.0 [v2:172.21.15.26:6802/2546986802,v1:172.21.15.26:6803/2546986802] boot 2024-05-09T00:11:20.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: osdmap e53: 6 total, 6 up, 6 in 2024-05-09T00:11:20.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:11:21.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:21 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T00:11:21.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:21 smithi026 ceph-mon[93667]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-05-09T00:11:21.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:21.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:11:21.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:21 smithi026 ceph-mon[93667]: osdmap e54: 6 total, 6 up, 6 in 2024-05-09T00:11:21.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:21 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T00:11:21.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:21 smithi135 ceph-mon[80466]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-05-09T00:11:21.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:21.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:11:21.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:21 smithi135 ceph-mon[80466]: osdmap e54: 6 total, 6 up, 6 in 2024-05-09T00:11:22.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:22 smithi026 ceph-mon[93667]: pgmap v52: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:22.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:22 smithi135 ceph-mon[80466]: pgmap v52: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 196 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-05-09T00:11:23.501 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:23 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:23.501 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:23 smithi135 ceph-mon[80466]: mgrmap e39: smithi026.brymfp(active, since 92s), standbys: smithi135.kkrhgf 2024-05-09T00:11:23.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:23 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:23.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:23 smithi026 ceph-mon[93667]: mgrmap e39: smithi026.brymfp(active, since 92s), standbys: smithi135.kkrhgf 2024-05-09T00:11:24.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:24 smithi026 ceph-mon[93667]: pgmap v54: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 196 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/219 objects degraded (2.740%) 2024-05-09T00:11:24.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:24 smithi135 ceph-mon[80466]: pgmap v54: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 196 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/219 objects degraded (2.740%) 2024-05-09T00:11:25.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:25 smithi026 ceph-mon[93667]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded) 2024-05-09T00:11:25.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:25 smithi135 ceph-mon[80466]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded) 2024-05-09T00:11:26.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:26 smithi026 ceph-mon[93667]: pgmap v55: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 480 B/s wr, 0 op/s 2024-05-09T00:11:26.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:26 smithi135 ceph-mon[80466]: pgmap v55: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 480 B/s wr, 0 op/s 2024-05-09T00:11:28.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:28 smithi026 ceph-mon[93667]: pgmap v56: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-05-09T00:11:28.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:28 smithi135 ceph-mon[80466]: pgmap v56: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-05-09T00:11:29.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.750+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/1863962008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f7990 msgr2=0x7f9a340f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.750+0000 7f9a3c2bd700 1 --2- 172.21.15.26:0/1863962008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f7990 0x7f9a340f7df0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9a300047f0 tx=0x7f9a30009cb0).stop 2024-05-09T00:11:29.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.750+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/1863962008 shutdown_connections 2024-05-09T00:11:29.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.750+0000 7f9a3c2bd700 1 --2- 172.21.15.26:0/1863962008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f7990 0x7f9a340f7df0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:29.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.750+0000 7f9a3c2bd700 1 --2- 172.21.15.26:0/1863962008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a340f66f0 0x7f9a340f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:29.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.750+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/1863962008 >> 172.21.15.26:0/1863962008 conn(0x7f9a340f1e50 msgr2=0x7f9a340f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:29.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.750+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/1863962008 shutdown_connections 2024-05-09T00:11:29.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.750+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/1863962008 wait complete. 2024-05-09T00:11:29.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3c2bd700 1 Processor -- start 2024-05-09T00:11:29.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3c2bd700 1 -- start start 2024-05-09T00:11:29.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3c2bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f66f0 0x7f9a34060ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:29.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3c2bd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a340f7990 0x7f9a3410cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:29.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3c2bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3410d290 con 0x7f9a340f66f0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3c2bd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3410d3d0 con 0x7f9a340f7990 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3a059700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f66f0 0x7f9a34060ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3a059700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f66f0 0x7f9a34060ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43696/0 (socket says 172.21.15.26:43696) 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.751+0000 7f9a3a059700 1 -- 172.21.15.26:0/959487627 learned_addr learned my addr 172.21.15.26:0/959487627 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a39858700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a340f7990 0x7f9a3410cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a3a059700 1 -- 172.21.15.26:0/959487627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a340f7990 msgr2=0x7f9a3410cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a3a059700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a340f7990 0x7f9a3410cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a3a059700 1 -- 172.21.15.26:0/959487627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30005040 con 0x7f9a340f66f0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a3a059700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f66f0 0x7f9a34060ff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9a24002820 tx=0x7f9a24009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a2b779700 1 -- 172.21.15.26:0/959487627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a24007b40 con 0x7f9a340f66f0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a2b779700 1 -- 172.21.15.26:0/959487627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a2400f040 con 0x7f9a340f66f0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3410d5d0 con 0x7f9a340f66f0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a2b779700 1 -- 172.21.15.26:0/959487627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a24014820 con 0x7f9a340f66f0 2024-05-09T00:11:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.752+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3410db90 con 0x7f9a340f66f0 2024-05-09T00:11:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.753+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a340feeb0 con 0x7f9a340f66f0 2024-05-09T00:11:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.754+0000 7f9a2b779700 1 -- 172.21.15.26:0/959487627 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9a24009110 con 0x7f9a340f66f0 2024-05-09T00:11:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.754+0000 7f9a2b779700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9a2006caa0 0x7f9a2006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.754+0000 7f9a39858700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9a2006caa0 0x7f9a2006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.754+0000 7f9a2b779700 1 -- 172.21.15.26:0/959487627 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9a2408b800 con 0x7f9a340f66f0 2024-05-09T00:11:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.755+0000 7f9a39858700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9a2006caa0 0x7f9a2006ef60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9a30004f10 tx=0x7f9a3000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:29.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.759+0000 7f9a2b779700 1 -- 172.21.15.26:0/959487627 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f9a240593b0 con 0x7f9a340f66f0 2024-05-09T00:11:29.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.976+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a34059120 con 0x7f9a2006caa0 2024-05-09T00:11:29.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.978+0000 7f9a2b779700 1 -- 172.21.15.26:0/959487627 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9a34059120 con 0x7f9a2006caa0 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9a2006caa0 msgr2=0x7f9a2006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9a2006caa0 0x7f9a2006ef60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9a30004f10 tx=0x7f9a3000b040).stop 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f66f0 msgr2=0x7f9a34060ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f66f0 0x7f9a34060ff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9a24002820 tx=0x7f9a24009f00).stop 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 shutdown_connections 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9a2006caa0 0x7f9a2006ef60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a340f66f0 0x7f9a34060ff0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 --2- 172.21.15.26:0/959487627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a340f7990 0x7f9a3410cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 >> 172.21.15.26:0/959487627 conn(0x7f9a340f1e50 msgr2=0x7f9a340fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 shutdown_connections 2024-05-09T00:11:29.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:29.980+0000 7f9a3c2bd700 1 -- 172.21.15.26:0/959487627 wait complete. 2024-05-09T00:11:29.988 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:11:30.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 -- 172.21.15.26:0/49085853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f7a10 msgr2=0x7fb3bc0f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 --2- 172.21.15.26:0/49085853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f7a10 0x7fb3bc0f7e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb3b00047f0 tx=0x7fb3b0009cb0).stop 2024-05-09T00:11:30.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 -- 172.21.15.26:0/49085853 shutdown_connections 2024-05-09T00:11:30.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 --2- 172.21.15.26:0/49085853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc0f8cb0 0x7fb3bc0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 --2- 172.21.15.26:0/49085853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f7a10 0x7fb3bc0f7e30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 -- 172.21.15.26:0/49085853 >> 172.21.15.26:0/49085853 conn(0x7fb3bc0f3150 msgr2=0x7fb3bc0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 -- 172.21.15.26:0/49085853 shutdown_connections 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 -- 172.21.15.26:0/49085853 wait complete. 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 Processor -- start 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.083+0000 7fb3c3271700 1 -- start start 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c3271700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc0f7a10 0x7fb3bc10a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c3271700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f8cb0 0x7fb3bc10a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c3271700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc10af40 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c3271700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc10b080 con 0x7fb3bc0f7a10 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c080c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f8cb0 0x7fb3bc10a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c080c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f8cb0 0x7fb3bc10a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43720/0 (socket says 172.21.15.26:43720) 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c080c700 1 -- 172.21.15.26:0/2084852594 learned_addr learned my addr 172.21.15.26:0/2084852594 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c100d700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc0f7a10 0x7fb3bc10a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c080c700 1 -- 172.21.15.26:0/2084852594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc0f7a10 msgr2=0x7fb3bc10a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c080c700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc0f7a10 0x7fb3bc10a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c080c700 1 -- 172.21.15.26:0/2084852594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b0005040 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c080c700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f8cb0 0x7fb3bc10a990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb3b800e8f0 tx=0x7fb3b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:30.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3ae777700 1 -- 172.21.15.26:0/2084852594 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b800ee90 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3ae777700 1 -- 172.21.15.26:0/2084852594 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3b800f040 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc10fb20 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3ae777700 1 -- 172.21.15.26:0/2084852594 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b800c930 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.084+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc1100e0 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.086+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc05fb50 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.086+0000 7fb3ae777700 1 -- 172.21.15.26:0/2084852594 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb3b8007b40 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.087+0000 7fb3ae777700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb3a806cab0 0x7fb3a806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.087+0000 7fb3c100d700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb3a806cab0 0x7fb3a806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.087+0000 7fb3ae777700 1 -- 172.21.15.26:0/2084852594 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb3b808b9f0 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.087+0000 7fb3c100d700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb3a806cab0 0x7fb3a806ef70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb3b0005010 tx=0x7fb3b000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.091+0000 7fb3ae777700 1 -- 172.21.15.26:0/2084852594 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fb3b808de60 con 0x7fb3bc0f8cb0 2024-05-09T00:11:30.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.307+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3bc0fd660 con 0x7fb3a806cab0 2024-05-09T00:11:30.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.308+0000 7fb3ae777700 1 -- 172.21.15.26:0/2084852594 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb3bc0fd660 con 0x7fb3a806cab0 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb3a806cab0 msgr2=0x7fb3a806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb3a806cab0 0x7fb3a806ef70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb3b0005010 tx=0x7fb3b000b040).stop 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f8cb0 msgr2=0x7fb3bc10a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f8cb0 0x7fb3bc10a990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fb3b800e8f0 tx=0x7fb3b800b040).stop 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 shutdown_connections 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb3a806cab0 0x7fb3a806ef70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc0f7a10 0x7fb3bc10a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 --2- 172.21.15.26:0/2084852594 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3bc0f8cb0 0x7fb3bc10a990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 >> 172.21.15.26:0/2084852594 conn(0x7fb3bc0f3150 msgr2=0x7fb3bc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 shutdown_connections 2024-05-09T00:11:30.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.310+0000 7fb3c3271700 1 -- 172.21.15.26:0/2084852594 wait complete. 2024-05-09T00:11:30.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.412+0000 7fdbfe899700 1 -- 172.21.15.26:0/2556911878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f7990 msgr2=0x7fdbf80f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.412+0000 7fdbfe899700 1 --2- 172.21.15.26:0/2556911878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f7990 0x7fdbf80f7df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fdbec0047f0 tx=0x7fdbec009cb0).stop 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.412+0000 7fdbfe899700 1 -- 172.21.15.26:0/2556911878 shutdown_connections 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.412+0000 7fdbfe899700 1 --2- 172.21.15.26:0/2556911878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f7990 0x7fdbf80f7df0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.412+0000 7fdbfe899700 1 --2- 172.21.15.26:0/2556911878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf80f66f0 0x7fdbf80f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.412+0000 7fdbfe899700 1 -- 172.21.15.26:0/2556911878 >> 172.21.15.26:0/2556911878 conn(0x7fdbf80f1e50 msgr2=0x7fdbf80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.412+0000 7fdbfe899700 1 -- 172.21.15.26:0/2556911878 shutdown_connections 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.413+0000 7fdbfe899700 1 -- 172.21.15.26:0/2556911878 wait complete. 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.413+0000 7fdbfe899700 1 Processor -- start 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.413+0000 7fdbfe899700 1 -- start start 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.413+0000 7fdbfe899700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f66f0 0x7fdbf80610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.413+0000 7fdbfe899700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf80f7990 0x7fdbf810ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.413+0000 7fdbfe899700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf810d300 con 0x7fdbf80f66f0 2024-05-09T00:11:30.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.413+0000 7fdbfe899700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf810d440 con 0x7fdbf80f7990 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f66f0 0x7fdbf80610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f66f0 0x7fdbf80610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43730/0 (socket says 172.21.15.26:43730) 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf7fff700 1 -- 172.21.15.26:0/1861579612 learned_addr learned my addr 172.21.15.26:0/1861579612 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf77fe700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf80f7990 0x7fdbf810ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf7fff700 1 -- 172.21.15.26:0/1861579612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf80f7990 msgr2=0x7fdbf810ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf7fff700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf80f7990 0x7fdbf810ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf7fff700 1 -- 172.21.15.26:0/1861579612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec005040 con 0x7fdbf80f66f0 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf77fe700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf80f7990 0x7fdbf810ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf7fff700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f66f0 0x7fdbf80610a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdbe800e8c0 tx=0x7fdbe800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf57fa700 1 -- 172.21.15.26:0/1861579612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe800ee60 con 0x7fdbf80f66f0 2024-05-09T00:11:30.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf810d6d0 con 0x7fdbf80f66f0 2024-05-09T00:11:30.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf57fa700 1 -- 172.21.15.26:0/1861579612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdbe800f040 con 0x7fdbf80f66f0 2024-05-09T00:11:30.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbf57fa700 1 -- 172.21.15.26:0/1861579612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe800c810 con 0x7fdbf80f66f0 2024-05-09T00:11:30.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.414+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf810dc90 con 0x7fdbf80f66f0 2024-05-09T00:11:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.415+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf80feeb0 con 0x7fdbf80f66f0 2024-05-09T00:11:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.416+0000 7fdbf57fa700 1 -- 172.21.15.26:0/1861579612 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdbe8007b40 con 0x7fdbf80f66f0 2024-05-09T00:11:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.417+0000 7fdbf57fa700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbe006caa0 0x7fdbe006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.417+0000 7fdbf57fa700 1 -- 172.21.15.26:0/1861579612 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fdbe808c0b0 con 0x7fdbf80f66f0 2024-05-09T00:11:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.417+0000 7fdbf77fe700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbe006caa0 0x7fdbe006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.417+0000 7fdbf77fe700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbe006caa0 0x7fdbe006ef60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdbec009ee0 tx=0x7fdbec00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:30.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.421+0000 7fdbf57fa700 1 -- 172.21.15.26:0/1861579612 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fdbe8059ce0 con 0x7fdbf80f66f0 2024-05-09T00:11:30.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.628+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbf8059120 con 0x7fdbe006caa0 2024-05-09T00:11:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.638+0000 7fdbf57fa700 1 -- 172.21.15.26:0/1861579612 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdbf8059120 con 0x7fdbe006caa0 2024-05-09T00:11:30.636 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:11:30.636 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (3m) 15s ago 12m 23.8M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:11:30.636 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (45s) 15s ago 12m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:11:30.636 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (40s) 36s ago 11m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (3m) 15s ago 11m 49.1M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (6m) 15s ago 6m 15.4M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (6m) 15s ago 6m 154M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (6m) 36s ago 6m 14.5M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (6m) 36s ago 6m 14.6M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (2m) 15s ago 13m 496M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (2m) 36s ago 11m 449M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (107s) 15s ago 13m 41.9M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (86s) 36s ago 11m 39.2M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (3m) 15s ago 11m 16.4M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (3m) 36s ago 11m 22.4M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (20s) 15s ago 10m 11.3M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (10m) 15s ago 10m 256M 1911M 16.2.15-1-g8963e9de 727f386679cb 6f58ba97811c 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (9m) 15s ago 9m 213M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (9m) 36s ago 9m 286M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:11:30.637 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (8m) 36s ago 8m 250M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:11:30.638 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (8m) 36s ago 8m 239M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:11:30.638 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (2m) 36s ago 11m 70.1M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbe006caa0 msgr2=0x7fdbe006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbe006caa0 0x7fdbe006ef60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdbec009ee0 tx=0x7fdbec00b040).stop 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f66f0 msgr2=0x7fdbf80610a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f66f0 0x7fdbf80610a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdbe800e8c0 tx=0x7fdbe800b040).stop 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 shutdown_connections 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbe006caa0 0x7fdbe006ef60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbf80f66f0 0x7fdbf80610a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 --2- 172.21.15.26:0/1861579612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf80f7990 0x7fdbf810ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 >> 172.21.15.26:0/1861579612 conn(0x7fdbf80f1e50 msgr2=0x7fdbf80fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 shutdown_connections 2024-05-09T00:11:30.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.640+0000 7fdbfe899700 1 -- 172.21.15.26:0/1861579612 wait complete. 2024-05-09T00:11:30.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:30 smithi026 ceph-mon[93667]: pgmap v57: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 355 B/s wr, 0 op/s 2024-05-09T00:11:30.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:30 smithi135 ceph-mon[80466]: pgmap v57: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 355 B/s wr, 0 op/s 2024-05-09T00:11:30.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.741+0000 7f1abf8b0700 1 -- 172.21.15.26:0/1905022323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 msgr2=0x7f1ab80f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.741+0000 7f1abf8b0700 1 --2- 172.21.15.26:0/1905022323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 0x7f1ab80f6b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1ab40047f0 tx=0x7f1ab4009cb0).stop 2024-05-09T00:11:30.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.741+0000 7f1abf8b0700 1 -- 172.21.15.26:0/1905022323 shutdown_connections 2024-05-09T00:11:30.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.741+0000 7f1abf8b0700 1 --2- 172.21.15.26:0/1905022323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab80f7990 0x7f1ab80f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.741+0000 7f1abf8b0700 1 --2- 172.21.15.26:0/1905022323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 0x7f1ab80f6b10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.741+0000 7f1abf8b0700 1 -- 172.21.15.26:0/1905022323 >> 172.21.15.26:0/1905022323 conn(0x7f1ab80f1e50 msgr2=0x7f1ab80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:30.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.741+0000 7f1abf8b0700 1 -- 172.21.15.26:0/1905022323 shutdown_connections 2024-05-09T00:11:30.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.741+0000 7f1abf8b0700 1 -- 172.21.15.26:0/1905022323 wait complete. 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abf8b0700 1 Processor -- start 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abf8b0700 1 -- start start 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abf8b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 0x7f1ab80fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abf8b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab80f7990 0x7f1ab80f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abf8b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80fac20 con 0x7f1ab80f66f0 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abf8b0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80f91c0 con 0x7f1ab80f7990 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abd64c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 0x7f1ab80fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abd64c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 0x7f1ab80fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43756/0 (socket says 172.21.15.26:43756) 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.742+0000 7f1abd64c700 1 -- 172.21.15.26:0/3967448367 learned_addr learned my addr 172.21.15.26:0/3967448367 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:11:30.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1abce4b700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab80f7990 0x7f1ab80f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1abd64c700 1 -- 172.21.15.26:0/3967448367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab80f7990 msgr2=0x7f1ab80f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1abd64c700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab80f7990 0x7f1ab80f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1abd64c700 1 -- 172.21.15.26:0/3967448367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4005040 con 0x7f1ab80f66f0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1abce4b700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab80f7990 0x7f1ab80f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1abd64c700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 0x7f1ab80fa670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f1ab4013620 tx=0x7f1ab4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1aae7fc700 1 -- 172.21.15.26:0/3967448367 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab400e030 con 0x7f1ab80f66f0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1aae7fc700 1 -- 172.21.15.26:0/3967448367 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ab4007e90 con 0x7f1ab80f66f0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab80f93e0 con 0x7f1ab80f66f0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1aae7fc700 1 -- 172.21.15.26:0/3967448367 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab4018070 con 0x7f1ab80f66f0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.743+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab80f9940 con 0x7f1ab80f66f0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.744+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab8047540 con 0x7f1ab80f66f0 2024-05-09T00:11:30.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.744+0000 7f1aae7fc700 1 -- 172.21.15.26:0/3967448367 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1ab401d9d0 con 0x7f1ab80f66f0 2024-05-09T00:11:30.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.745+0000 7f1aae7fc700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1aa406cab0 0x7f1aa406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:30.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.745+0000 7f1aae7fc700 1 -- 172.21.15.26:0/3967448367 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1ab408d2a0 con 0x7f1ab80f66f0 2024-05-09T00:11:30.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.745+0000 7f1abce4b700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1aa406cab0 0x7f1aa406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:30.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.745+0000 7f1abce4b700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1aa406cab0 0x7f1aa406ef70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1aa8007fd0 tx=0x7f1aa8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:30.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:30.749+0000 7f1aae7fc700 1 -- 172.21.15.26:0/3967448367 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f1ab405ae50 con 0x7f1ab80f66f0 2024-05-09T00:11:31.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.036+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1ab81105e0 con 0x7f1ab80f66f0 2024-05-09T00:11:31.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.037+0000 7f1aae7fc700 1 -- 172.21.15.26:0/3967448367 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f1ab405a9e0 con 0x7f1ab80f66f0 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 5, 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 1 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:11:31.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:11:31.036 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:11:31.036 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:11:31.036 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 9, 2024-05-09T00:11:31.036 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 5 2024-05-09T00:11:31.036 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:11:31.036 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1aa406cab0 msgr2=0x7f1aa406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1aa406cab0 0x7f1aa406ef70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1aa8007fd0 tx=0x7f1aa8009040).stop 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 msgr2=0x7f1ab80fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 0x7f1ab80fa670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f1ab4013620 tx=0x7f1ab4009cb0).stop 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 shutdown_connections 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1aa406cab0 0x7f1aa406ef70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab80f66f0 0x7f1ab80fa670 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 --2- 172.21.15.26:0/3967448367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab80f7990 0x7f1ab80f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 >> 172.21.15.26:0/3967448367 conn(0x7f1ab80f1e50 msgr2=0x7f1ab8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 shutdown_connections 2024-05-09T00:11:31.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.039+0000 7f1abf8b0700 1 -- 172.21.15.26:0/3967448367 wait complete. 2024-05-09T00:11:31.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.140+0000 7f42daf7c700 1 -- 172.21.15.26:0/1893337968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 msgr2=0x7f42d40f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.140+0000 7f42daf7c700 1 --2- 172.21.15.26:0/1893337968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 0x7f42d40f6b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f42c80047f0 tx=0x7f42c8009cb0).stop 2024-05-09T00:11:31.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.140+0000 7f42daf7c700 1 -- 172.21.15.26:0/1893337968 shutdown_connections 2024-05-09T00:11:31.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.140+0000 7f42daf7c700 1 --2- 172.21.15.26:0/1893337968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40f7990 0x7f42d40f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.140+0000 7f42daf7c700 1 --2- 172.21.15.26:0/1893337968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 0x7f42d40f6b10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.140+0000 7f42daf7c700 1 -- 172.21.15.26:0/1893337968 >> 172.21.15.26:0/1893337968 conn(0x7f42d40f1e50 msgr2=0x7f42d40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:31.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.140+0000 7f42daf7c700 1 -- 172.21.15.26:0/1893337968 shutdown_connections 2024-05-09T00:11:31.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.140+0000 7f42daf7c700 1 -- 172.21.15.26:0/1893337968 wait complete. 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42daf7c700 1 Processor -- start 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42daf7c700 1 -- start start 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42daf7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 0x7f42d40fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42daf7c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40f7990 0x7f42d40f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42daf7c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40fac20 con 0x7f42d40f66f0 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42daf7c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40f91c0 con 0x7f42d40f7990 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42d8d18700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 0x7f42d40fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42d8d18700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 0x7f42d40fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43776/0 (socket says 172.21.15.26:43776) 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.141+0000 7f42d8d18700 1 -- 172.21.15.26:0/3867827608 learned_addr learned my addr 172.21.15.26:0/3867827608 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d3fff700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40f7990 0x7f42d40f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d8d18700 1 -- 172.21.15.26:0/3867827608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40f7990 msgr2=0x7f42d40f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d8d18700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40f7990 0x7f42d40f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d8d18700 1 -- 172.21.15.26:0/3867827608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8005040 con 0x7f42d40f66f0 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d3fff700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40f7990 0x7f42d40f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:31.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d8d18700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 0x7f42d40fa670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f42c800b120 tx=0x7f42c8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:31.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d1ffb700 1 -- 172.21.15.26:0/3867827608 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c800e030 con 0x7f42d40f66f0 2024-05-09T00:11:31.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d40f93e0 con 0x7f42d40f66f0 2024-05-09T00:11:31.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d1ffb700 1 -- 172.21.15.26:0/3867827608 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f42c8007e90 con 0x7f42d40f66f0 2024-05-09T00:11:31.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42d1ffb700 1 -- 172.21.15.26:0/3867827608 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c8018070 con 0x7f42d40f66f0 2024-05-09T00:11:31.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.142+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d40f9940 con 0x7f42d40f66f0 2024-05-09T00:11:31.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.143+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d40feeb0 con 0x7f42d40f66f0 2024-05-09T00:11:31.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.144+0000 7f42d1ffb700 1 -- 172.21.15.26:0/3867827608 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f42c801d960 con 0x7f42d40f66f0 2024-05-09T00:11:31.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.144+0000 7f42d1ffb700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f42c406caa0 0x7f42c406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.144+0000 7f42d1ffb700 1 -- 172.21.15.26:0/3867827608 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f42c808d2e0 con 0x7f42d40f66f0 2024-05-09T00:11:31.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.144+0000 7f42d3fff700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f42c406caa0 0x7f42c406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.144+0000 7f42d3fff700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f42c406caa0 0x7f42c406ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f42c0004ba0 tx=0x7f42c0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:31.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.148+0000 7f42d1ffb700 1 -- 172.21.15.26:0/3867827608 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f42c805ae90 con 0x7f42d40f66f0 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.397+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f42d4110720 con 0x7f42d40f66f0 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.397+0000 7f42d1ffb700 1 -- 172.21.15.26:0/3867827608 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f42c805aa20 con 0x7f42d40f66f0 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:11:31.395 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:11:31.396 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:11:31.397 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:11:31.398 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:11:31.398 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:11:31.398 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:11:31.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f42c406caa0 msgr2=0x7f42c406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f42c406caa0 0x7f42c406ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f42c0004ba0 tx=0x7f42c0009040).stop 2024-05-09T00:11:31.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 msgr2=0x7f42d40fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 0x7f42d40fa670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f42c800b120 tx=0x7f42c8009cb0).stop 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 shutdown_connections 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f42c406caa0 0x7f42c406ef60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42d40f66f0 0x7f42d40fa670 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 --2- 172.21.15.26:0/3867827608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d40f7990 0x7f42d40f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 >> 172.21.15.26:0/3867827608 conn(0x7f42d40f1e50 msgr2=0x7f42d4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 shutdown_connections 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.400+0000 7f42daf7c700 1 -- 172.21.15.26:0/3867827608 wait complete. 2024-05-09T00:11:31.399 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:11:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.502+0000 7fc4deaec700 1 -- 172.21.15.26:0/1915894292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f7990 msgr2=0x7fc4d80f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.502+0000 7fc4deaec700 1 --2- 172.21.15.26:0/1915894292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f7990 0x7fc4d80f7df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc4c40047f0 tx=0x7fc4c4009cb0).stop 2024-05-09T00:11:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.502+0000 7fc4deaec700 1 -- 172.21.15.26:0/1915894292 shutdown_connections 2024-05-09T00:11:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.502+0000 7fc4deaec700 1 --2- 172.21.15.26:0/1915894292 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f7990 0x7fc4d80f7df0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.502+0000 7fc4deaec700 1 --2- 172.21.15.26:0/1915894292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d80f66f0 0x7fc4d80f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.502+0000 7fc4deaec700 1 -- 172.21.15.26:0/1915894292 >> 172.21.15.26:0/1915894292 conn(0x7fc4d80f1e50 msgr2=0x7fc4d80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.502+0000 7fc4deaec700 1 -- 172.21.15.26:0/1915894292 shutdown_connections 2024-05-09T00:11:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.503+0000 7fc4deaec700 1 -- 172.21.15.26:0/1915894292 wait complete. 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.503+0000 7fc4deaec700 1 Processor -- start 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.503+0000 7fc4deaec700 1 -- start start 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.503+0000 7fc4deaec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f66f0 0x7fc4d8060ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.503+0000 7fc4deaec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d80f7990 0x7fc4d810cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4deaec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d810d290 con 0x7fc4d80f66f0 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4deaec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d810d3d0 con 0x7fc4d80f7990 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4dc888700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f66f0 0x7fc4d8060ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4dc888700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f66f0 0x7fc4d8060ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53724/0 (socket says 172.21.15.26:53724) 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4dc888700 1 -- 172.21.15.26:0/1125887346 learned_addr learned my addr 172.21.15.26:0/1125887346 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:11:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4d7fff700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d80f7990 0x7fc4d810cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4dc888700 1 -- 172.21.15.26:0/1125887346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d80f7990 msgr2=0x7fc4d810cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4dc888700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d80f7990 0x7fc4d810cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4dc888700 1 -- 172.21.15.26:0/1125887346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c4005040 con 0x7fc4d80f66f0 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4dc888700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f66f0 0x7fc4d8060ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc4cc002820 tx=0x7fc4cc009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4d5ffb700 1 -- 172.21.15.26:0/1125887346 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4cc007b40 con 0x7fc4d80f66f0 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4d5ffb700 1 -- 172.21.15.26:0/1125887346 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4cc00f040 con 0x7fc4d80f66f0 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d810d5d0 con 0x7fc4d80f66f0 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4d5ffb700 1 -- 172.21.15.26:0/1125887346 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4cc014820 con 0x7fc4d80f66f0 2024-05-09T00:11:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.504+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d810db90 con 0x7fc4d80f66f0 2024-05-09T00:11:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.505+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d80feeb0 con 0x7fc4d80f66f0 2024-05-09T00:11:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.506+0000 7fc4d5ffb700 1 -- 172.21.15.26:0/1125887346 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc4cc009110 con 0x7fc4d80f66f0 2024-05-09T00:11:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.506+0000 7fc4d5ffb700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc4c806caa0 0x7fc4c806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.506+0000 7fc4d5ffb700 1 -- 172.21.15.26:0/1125887346 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc4cc08b800 con 0x7fc4d80f66f0 2024-05-09T00:11:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.506+0000 7fc4d7fff700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc4c806caa0 0x7fc4c806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.507+0000 7fc4d7fff700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc4c806caa0 0x7fc4c806ef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc4c4004f10 tx=0x7fc4c400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:31.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.511+0000 7fc4d5ffb700 1 -- 172.21.15.26:0/1125887346 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc4cc0593b0 con 0x7fc4d80f66f0 2024-05-09T00:11:31.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:31 smithi026 ceph-mon[93667]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:31 smithi026 ceph-mon[93667]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:31.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:31 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3967448367' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:31.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:31 smithi135 ceph-mon[80466]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:31.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:31 smithi135 ceph-mon[80466]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:31.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:31.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:31 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3967448367' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:31.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.728+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4d8059120 con 0x7fc4c806caa0 2024-05-09T00:11:31.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.729+0000 7fc4d5ffb700 1 -- 172.21.15.26:0/1125887346 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc4d8059120 con 0x7fc4c806caa0 2024-05-09T00:11:31.727 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:11:31.727 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:11:31.727 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:11:31.727 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "7/21 daemons upgraded", 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:11:31.728 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc4c806caa0 msgr2=0x7fc4c806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc4c806caa0 0x7fc4c806ef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc4c4004f10 tx=0x7fc4c400b040).stop 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f66f0 msgr2=0x7fc4d8060ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f66f0 0x7fc4d8060ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc4cc002820 tx=0x7fc4cc009f00).stop 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 shutdown_connections 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc4c806caa0 0x7fc4c806ef60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4d80f66f0 0x7fc4d8060ff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 --2- 172.21.15.26:0/1125887346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4d80f7990 0x7fc4d810cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 >> 172.21.15.26:0/1125887346 conn(0x7fc4d80f1e50 msgr2=0x7fc4d80fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:31.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 shutdown_connections 2024-05-09T00:11:31.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.732+0000 7fc4deaec700 1 -- 172.21.15.26:0/1125887346 wait complete. 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.836+0000 7fcc6379a700 1 -- 172.21.15.26:0/679873994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 msgr2=0x7fcc5c0f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.836+0000 7fcc6379a700 1 --2- 172.21.15.26:0/679873994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 0x7fcc5c0f7c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fcc580047f0 tx=0x7fcc58009cb0).stop 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.836+0000 7fcc6379a700 1 -- 172.21.15.26:0/679873994 shutdown_connections 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.836+0000 7fcc6379a700 1 --2- 172.21.15.26:0/679873994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc5c0f8aa0 0x7fcc5c0f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.836+0000 7fcc6379a700 1 --2- 172.21.15.26:0/679873994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 0x7fcc5c0f7c20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 -- 172.21.15.26:0/679873994 >> 172.21.15.26:0/679873994 conn(0x7fcc5c0f2f80 msgr2=0x7fcc5c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 -- 172.21.15.26:0/679873994 shutdown_connections 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 -- 172.21.15.26:0/679873994 wait complete. 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 Processor -- start 2024-05-09T00:11:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 -- start start 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 0x7fcc5c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc5c0f8aa0 0x7fcc5c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c06cf80 con 0x7fcc5c0f7800 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.837+0000 7fcc6379a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c06b520 con 0x7fcc5c0f8aa0 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc61536700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 0x7fcc5c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc61536700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 0x7fcc5c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53740/0 (socket says 172.21.15.26:53740) 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc61536700 1 -- 172.21.15.26:0/4196857909 learned_addr learned my addr 172.21.15.26:0/4196857909 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc60d35700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc5c0f8aa0 0x7fcc5c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc61536700 1 -- 172.21.15.26:0/4196857909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc5c0f8aa0 msgr2=0x7fcc5c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc61536700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc5c0f8aa0 0x7fcc5c06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc61536700 1 -- 172.21.15.26:0/4196857909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc58005040 con 0x7fcc5c0f7800 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc60d35700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc5c0f8aa0 0x7fcc5c06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc61536700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 0x7fcc5c06c9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcc5800b120 tx=0x7fcc58009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc527fc700 1 -- 172.21.15.26:0/4196857909 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc5800e030 con 0x7fcc5c0f7800 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c06b740 con 0x7fcc5c0f7800 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc527fc700 1 -- 172.21.15.26:0/4196857909 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc58007e90 con 0x7fcc5c0f7800 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc527fc700 1 -- 172.21.15.26:0/4196857909 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc58018070 con 0x7fcc5c0f7800 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.838+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c06bca0 con 0x7fcc5c0f7800 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.839+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c047540 con 0x7fcc5c0f7800 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.840+0000 7fcc527fc700 1 -- 172.21.15.26:0/4196857909 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcc5801d960 con 0x7fcc5c0f7800 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.840+0000 7fcc527fc700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcc4806caa0 0x7fcc4806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.840+0000 7fcc527fc700 1 -- 172.21.15.26:0/4196857909 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fcc5808d300 con 0x7fcc5c0f7800 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.840+0000 7fcc60d35700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcc4806caa0 0x7fcc4806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.841+0000 7fcc60d35700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcc4806caa0 0x7fcc4806ef60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fcc4c004ba0 tx=0x7fcc4c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:31.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:31.845+0000 7fcc527fc700 1 -- 172.21.15.26:0/4196857909 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fcc5805aeb0 con 0x7fcc5c0f7800 2024-05-09T00:11:32.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.124+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcc5c0fffc0 con 0x7fcc5c0f7800 2024-05-09T00:11:32.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.124+0000 7fcc527fc700 1 -- 172.21.15.26:0/4196857909 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fcc5c0fffc0 con 0x7fcc5c0f7800 2024-05-09T00:11:32.122 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:11:32.122 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:11:32.122 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcc4806caa0 msgr2=0x7fcc4806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcc4806caa0 0x7fcc4806ef60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fcc4c004ba0 tx=0x7fcc4c009040).stop 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 msgr2=0x7fcc5c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 0x7fcc5c06c9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fcc5800b120 tx=0x7fcc58009cb0).stop 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 shutdown_connections 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcc4806caa0 0x7fcc4806ef60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc5c0f7800 0x7fcc5c06c9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 --2- 172.21.15.26:0/4196857909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc5c0f8aa0 0x7fcc5c06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 >> 172.21.15.26:0/4196857909 conn(0x7fcc5c0f2f80 msgr2=0x7fcc5c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:32.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 shutdown_connections 2024-05-09T00:11:32.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:11:32.126+0000 7fcc6379a700 1 -- 172.21.15.26:0/4196857909 wait complete. 2024-05-09T00:11:32.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:32 smithi026 ceph-mon[93667]: pgmap v58: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-05-09T00:11:32.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:32 smithi026 ceph-mon[93667]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:32.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:32 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3867827608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:11:32.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:32 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/4196857909' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:11:32.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:32 smithi135 ceph-mon[80466]: pgmap v58: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-05-09T00:11:32.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:32 smithi135 ceph-mon[80466]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:32.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:32 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3867827608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:11:32.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:32 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/4196857909' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:11:33.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:33 smithi026 ceph-mon[93667]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:33.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:33 smithi135 ceph-mon[80466]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:11:34.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:34 smithi026 ceph-mon[93667]: pgmap v59: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 263 B/s wr, 0 op/s 2024-05-09T00:11:34.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:34 smithi135 ceph-mon[80466]: pgmap v59: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 263 B/s wr, 0 op/s 2024-05-09T00:11:35.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:35 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T00:11:35.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:35 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T00:11:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:36 smithi026 ceph-mon[93667]: pgmap v60: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:36 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T00:11:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:36 smithi026 ceph-mon[93667]: Upgrade: osd.1 is safe to restart 2024-05-09T00:11:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:11:36.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:36 smithi135 ceph-mon[80466]: pgmap v60: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:36.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:36 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T00:11:36.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:36 smithi135 ceph-mon[80466]: Upgrade: osd.1 is safe to restart 2024-05-09T00:11:36.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:36.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:11:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:37 smithi026 ceph-mon[93667]: Upgrade: Updating osd.1 2024-05-09T00:11:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:37 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:37 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:11:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:37 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:37 smithi026 ceph-mon[93667]: Deploying daemon osd.1 on smithi026 2024-05-09T00:11:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:37 smithi135 ceph-mon[80466]: Upgrade: Updating osd.1 2024-05-09T00:11:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:37 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:37 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:11:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:37 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:37 smithi135 ceph-mon[80466]: Deploying daemon osd.1 on smithi026 2024-05-09T00:11:38.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:38 smithi026 ceph-mon[93667]: pgmap v61: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:38.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:38 smithi135 ceph-mon[80466]: pgmap v61: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:40.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:39 smithi026 systemd[1]: Stopping Ceph osd.1 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:11:40.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[58184]: debug 2024-05-09T00:11:39.931+0000 7fd462e42700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-09T00:11:40.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[58184]: debug 2024-05-09T00:11:39.931+0000 7fd462e42700 -1 osd.1 54 *** Got signal Terminated *** 2024-05-09T00:11:40.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:39 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[58184]: debug 2024-05-09T00:11:39.931+0000 7fd462e42700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:11:40.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:40 smithi026 ceph-mon[93667]: pgmap v62: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:40.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:40 smithi026 ceph-mon[93667]: osd.1 marked itself down and dead 2024-05-09T00:11:40.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:40 smithi135 ceph-mon[80466]: pgmap v62: 65 pgs: 65 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:40.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:40 smithi135 ceph-mon[80466]: osd.1 marked itself down and dead 2024-05-09T00:11:41.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:40 smithi026 bash[104982]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1 2024-05-09T00:11:41.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:41 smithi026 ceph-mon[93667]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:11:41.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:41 smithi026 ceph-mon[93667]: osdmap e55: 6 total, 5 up, 6 in 2024-05-09T00:11:41.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:41 smithi135 ceph-mon[80466]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:11:41.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:41 smithi135 ceph-mon[80466]: osdmap e55: 6 total, 5 up, 6 in 2024-05-09T00:11:42.610 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:42 smithi026 ceph-mon[93667]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:42.610 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:42 smithi026 ceph-mon[93667]: osdmap e56: 6 total, 5 up, 6 in 2024-05-09T00:11:42.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:42 smithi135 ceph-mon[80466]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T00:11:42.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:42 smithi135 ceph-mon[80466]: osdmap e56: 6 total, 5 up, 6 in 2024-05-09T00:11:42.897 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:42 smithi026 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.1.service: Succeeded. 2024-05-09T00:11:42.897 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:42 smithi026 systemd[1]: Stopped Ceph osd.1 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:11:42.897 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:42 smithi026 systemd[1]: Starting Ceph osd.1 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:11:43.747 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:43 smithi026 ceph-mon[93667]: Health check failed: Degraded data redundancy: 28/219 objects degraded (12.785%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:43.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:43 smithi135 ceph-mon[80466]: Health check failed: Degraded data redundancy: 28/219 objects degraded (12.785%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:44.146 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:43 smithi026 bash[105262]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T00:11:44.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:43 smithi026 bash[105262]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T00:11:44.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:43 smithi026 bash[105262]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T00:11:44.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:43 smithi026 bash[105262]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T00:11:44.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:43 smithi026 bash[105262]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-09T00:11:44.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:43 smithi026 bash[105262]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T00:11:44.147 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:43 smithi026 bash[105262]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-09T00:11:44.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:44 smithi026 ceph-mon[93667]: pgmap v66: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-05-09T00:11:44.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:44 smithi135 ceph-mon[80466]: pgmap v66: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-05-09T00:11:45.397 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:44 smithi026 ceph-osd[105563]: -- 172.21.15.26:0/1305710366 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e7abf931e0 con 0x55e7abf62c00 2024-05-09T00:11:45.397 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:45 smithi026 bash[105525]: ec17e8a4a4e9c0b2b41bde3c28d8d15b8da317a8fbf2e1dbb46caeab5af7fa81 2024-05-09T00:11:45.397 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:45 smithi026 systemd[1]: Started Ceph osd.1 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:11:45.830 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:45 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[105540]: 2024-05-09T00:11:45.518+0000 7f7a211497c0 -1 Falling back to public interface 2024-05-09T00:11:46.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:46 smithi026 ceph-mon[93667]: pgmap v67: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:46.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:46.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:46.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:46.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:46 smithi135 ceph-mon[80466]: pgmap v67: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:46.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:46.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:46.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:48.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:48 smithi026 ceph-mon[93667]: pgmap v68: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:48.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:48 smithi135 ceph-mon[80466]: pgmap v68: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:50.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:50 smithi026 ceph-mon[93667]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:50.396 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:50.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:50 smithi135 ceph-mon[80466]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:50.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:51.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:51.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:51.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:51 smithi026 ceph-mon[93667]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:51.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:51.776 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:11:51.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:51.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:51.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:51 smithi135 ceph-mon[80466]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:51.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:51.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:11:52.065 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[105540]: 2024-05-09T00:11:51.999+0000 7f7a211497c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-05-09T00:11:52.897 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:52 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[105540]: 2024-05-09T00:11:52.665+0000 7f7a211497c0 -1 osd.1 54 log_to_monitors true 2024-05-09T00:11:53.872 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:11:53 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[105540]: 2024-05-09T00:11:53.640+0000 7f7a125a2700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:11:53.872 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:53 smithi026 ceph-mon[93667]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:53.872 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:53 smithi026 ceph-mon[93667]: from='osd.1 [v2:172.21.15.26:6810/512757979,v1:172.21.15.26:6811/512757979]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:11:53.872 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:53 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 30/219 objects degraded (13.699%), 13 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:53.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:53 smithi135 ceph-mon[80466]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:53.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:53 smithi135 ceph-mon[80466]: from='osd.1 [v2:172.21.15.26:6810/512757979,v1:172.21.15.26:6811/512757979]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:11:53.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:53 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 30/219 objects degraded (13.699%), 13 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:54.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='osd.1 [v2:172.21.15.26:6810/512757979,v1:172.21.15.26:6811/512757979]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T00:11:54.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: osdmap e57: 6 total, 5 up, 6 in 2024-05-09T00:11:54.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='osd.1 [v2:172.21.15.26:6810/512757979,v1:172.21.15.26:6811/512757979]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:11:54.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:54.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:54.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:54.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:54.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:54.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:54.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:54.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:54.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:54.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T00:11:54.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T00:11:54.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:54 smithi026 ceph-mon[93667]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-05-09T00:11:54.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='osd.1 [v2:172.21.15.26:6810/512757979,v1:172.21.15.26:6811/512757979]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T00:11:54.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: osdmap e57: 6 total, 5 up, 6 in 2024-05-09T00:11:54.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='osd.1 [v2:172.21.15.26:6810/512757979,v1:172.21.15.26:6811/512757979]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:11:54.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:54.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:54.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:54.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:54.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:11:54.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:54.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:54.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:54.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:11:54.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T00:11:54.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T00:11:54.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:54 smithi135 ceph-mon[80466]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-05-09T00:11:55.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:55 smithi026 ceph-mon[93667]: pgmap v73: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:55.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:55 smithi026 ceph-mon[93667]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:11:55.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:55 smithi026 ceph-mon[93667]: osd.1 [v2:172.21.15.26:6810/512757979,v1:172.21.15.26:6811/512757979] boot 2024-05-09T00:11:55.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:55 smithi026 ceph-mon[93667]: osdmap e58: 6 total, 6 up, 6 in 2024-05-09T00:11:55.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:55 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:11:55.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:55 smithi026 ceph-mon[93667]: osdmap e59: 6 total, 6 up, 6 in 2024-05-09T00:11:55.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:55 smithi135 ceph-mon[80466]: pgmap v73: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2024-05-09T00:11:55.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:55 smithi135 ceph-mon[80466]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:11:55.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:55 smithi135 ceph-mon[80466]: osd.1 [v2:172.21.15.26:6810/512757979,v1:172.21.15.26:6811/512757979] boot 2024-05-09T00:11:55.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:55 smithi135 ceph-mon[80466]: osdmap e58: 6 total, 6 up, 6 in 2024-05-09T00:11:55.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:55 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:11:55.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:55 smithi135 ceph-mon[80466]: osdmap e59: 6 total, 6 up, 6 in 2024-05-09T00:11:57.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:57 smithi026 ceph-mon[93667]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-05-09T00:11:57.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:57 smithi135 ceph-mon[80466]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-05-09T00:11:58.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:58 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:58.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:58 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2024-05-09T00:11:59.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:11:59 smithi026 ceph-mon[93667]: pgmap v77: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-05-09T00:11:59.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:11:59 smithi135 ceph-mon[80466]: pgmap v77: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-05-09T00:12:01.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:00 smithi026 ceph-mon[93667]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-05-09T00:12:01.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:00 smithi135 ceph-mon[80466]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-05-09T00:12:02.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:01 smithi026 ceph-mon[93667]: pgmap v78: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:02.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:01 smithi135 ceph-mon[80466]: pgmap v78: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:02.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.243+0000 7fb9328ad700 1 -- 172.21.15.26:0/1221725486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f8aa0 msgr2=0x7fb92c0f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.243+0000 7fb9328ad700 1 --2- 172.21.15.26:0/1221725486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f8aa0 0x7fb92c0f8f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb9140047f0 tx=0x7fb914009cb0).stop 2024-05-09T00:12:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.243+0000 7fb9328ad700 1 -- 172.21.15.26:0/1221725486 shutdown_connections 2024-05-09T00:12:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.243+0000 7fb9328ad700 1 --2- 172.21.15.26:0/1221725486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f8aa0 0x7fb92c0f8f00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.243+0000 7fb9328ad700 1 --2- 172.21.15.26:0/1221725486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c0f7800 0x7fb92c0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.244+0000 7fb9328ad700 1 -- 172.21.15.26:0/1221725486 >> 172.21.15.26:0/1221725486 conn(0x7fb92c0f2f80 msgr2=0x7fb92c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.244+0000 7fb9328ad700 1 -- 172.21.15.26:0/1221725486 shutdown_connections 2024-05-09T00:12:02.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.244+0000 7fb9328ad700 1 -- 172.21.15.26:0/1221725486 wait complete. 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.244+0000 7fb9328ad700 1 Processor -- start 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.244+0000 7fb9328ad700 1 -- start start 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb9328ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f7800 0x7fb92c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb9328ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c0f8aa0 0x7fb92c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb9328ad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c06cf80 con 0x7fb92c0f7800 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb9328ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c06b520 con 0x7fb92c0f8aa0 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb92bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f7800 0x7fb92c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb92bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f7800 0x7fb92c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47012/0 (socket says 172.21.15.26:47012) 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb92bfff700 1 -- 172.21.15.26:0/367767348 learned_addr learned my addr 172.21.15.26:0/367767348 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb92b7fe700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c0f8aa0 0x7fb92c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb92bfff700 1 -- 172.21.15.26:0/367767348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c0f8aa0 msgr2=0x7fb92c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb92bfff700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c0f8aa0 0x7fb92c06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb92bfff700 1 -- 172.21.15.26:0/367767348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914005040 con 0x7fb92c0f7800 2024-05-09T00:12:02.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb92bfff700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f7800 0x7fb92c06c9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb91c00e8c0 tx=0x7fb91c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.245+0000 7fb9297fa700 1 -- 172.21.15.26:0/367767348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91c007b40 con 0x7fb92c0f7800 2024-05-09T00:12:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.246+0000 7fb9297fa700 1 -- 172.21.15.26:0/367767348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb91c00f040 con 0x7fb92c0f7800 2024-05-09T00:12:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.246+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c06b7a0 con 0x7fb92c0f7800 2024-05-09T00:12:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.246+0000 7fb9297fa700 1 -- 172.21.15.26:0/367767348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91c014880 con 0x7fb92c0f7800 2024-05-09T00:12:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.246+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c06bd60 con 0x7fb92c0f7800 2024-05-09T00:12:02.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.247+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c0fffc0 con 0x7fb92c0f7800 2024-05-09T00:12:02.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.247+0000 7fb9297fa700 1 -- 172.21.15.26:0/367767348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb91c007ca0 con 0x7fb92c0f7800 2024-05-09T00:12:02.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.248+0000 7fb9297fa700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb91806caa0 0x7fb91806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.248+0000 7fb92b7fe700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb91806caa0 0x7fb91806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.248+0000 7fb9297fa700 1 -- 172.21.15.26:0/367767348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb91c08ba10 con 0x7fb92c0f7800 2024-05-09T00:12:02.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.248+0000 7fb92b7fe700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb91806caa0 0x7fb91806ef60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb9140047c0 tx=0x7fb914009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:02.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.252+0000 7fb9297fa700 1 -- 172.21.15.26:0/367767348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fb91c0595c0 con 0x7fb92c0f7800 2024-05-09T00:12:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.468+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb92c059120 con 0x7fb91806caa0 2024-05-09T00:12:02.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.469+0000 7fb9297fa700 1 -- 172.21.15.26:0/367767348 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb92c059120 con 0x7fb91806caa0 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.471+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb91806caa0 msgr2=0x7fb91806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.471+0000 7fb9328ad700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb91806caa0 0x7fb91806ef60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb9140047c0 tx=0x7fb914009cb0).stop 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f7800 msgr2=0x7fb92c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f7800 0x7fb92c06c9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb91c00e8c0 tx=0x7fb91c00b040).stop 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 shutdown_connections 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb91806caa0 0x7fb91806ef60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb92c0f7800 0x7fb92c06c9d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 --2- 172.21.15.26:0/367767348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb92c0f8aa0 0x7fb92c06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 >> 172.21.15.26:0/367767348 conn(0x7fb92c0f2f80 msgr2=0x7fb92c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 shutdown_connections 2024-05-09T00:12:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.472+0000 7fb9328ad700 1 -- 172.21.15.26:0/367767348 wait complete. 2024-05-09T00:12:02.480 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:12:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.574+0000 7f2039f99700 1 -- 172.21.15.26:0/480035151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20340fa950 msgr2=0x7f20340fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.574+0000 7f2039f99700 1 --2- 172.21.15.26:0/480035151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20340fa950 0x7f20340fcda0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f20240047f0 tx=0x7f2024009cb0).stop 2024-05-09T00:12:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.575+0000 7f2039f99700 1 -- 172.21.15.26:0/480035151 shutdown_connections 2024-05-09T00:12:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.575+0000 7f2039f99700 1 --2- 172.21.15.26:0/480035151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20340fa950 0x7f20340fcda0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.575+0000 7f2039f99700 1 --2- 172.21.15.26:0/480035151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2034061280 0x7f20340fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.575+0000 7f2039f99700 1 -- 172.21.15.26:0/480035151 >> 172.21.15.26:0/480035151 conn(0x7f20340f1e50 msgr2=0x7f20340f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.575+0000 7f2039f99700 1 -- 172.21.15.26:0/480035151 shutdown_connections 2024-05-09T00:12:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.575+0000 7f2039f99700 1 -- 172.21.15.26:0/480035151 wait complete. 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.575+0000 7f2039f99700 1 Processor -- start 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f2039f99700 1 -- start start 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f2039f99700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2034061280 0x7f2034107f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f2039f99700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fa950 0x7f2034108400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f2039f99700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20341089b0 con 0x7f2034061280 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f2039f99700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2034108af0 con 0x7f20340fa950 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f20337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2034061280 0x7f2034107f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f20337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2034061280 0x7f2034107f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47026/0 (socket says 172.21.15.26:47026) 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f20337fe700 1 -- 172.21.15.26:0/388031205 learned_addr learned my addr 172.21.15.26:0/388031205 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f2032ffd700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fa950 0x7f2034108400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f20337fe700 1 -- 172.21.15.26:0/388031205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fa950 msgr2=0x7f2034108400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f20337fe700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fa950 0x7f2034108400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f20337fe700 1 -- 172.21.15.26:0/388031205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024005040 con 0x7f2034061280 2024-05-09T00:12:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f2032ffd700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fa950 0x7f2034108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f20337fe700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2034061280 0x7f2034107f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f20280041d0 tx=0x7f2028009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.576+0000 7f2030ff9700 1 -- 172.21.15.26:0/388031205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2028002d90 con 0x7f2034061280 2024-05-09T00:12:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.577+0000 7f2030ff9700 1 -- 172.21.15.26:0/388031205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f202800f040 con 0x7f2034061280 2024-05-09T00:12:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.577+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203410d590 con 0x7f2034061280 2024-05-09T00:12:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.577+0000 7f2030ff9700 1 -- 172.21.15.26:0/388031205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202800d800 con 0x7f2034061280 2024-05-09T00:12:02.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.577+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203410db50 con 0x7f2034061280 2024-05-09T00:12:02.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.577+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20340fffb0 con 0x7f2034061280 2024-05-09T00:12:02.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.578+0000 7f2030ff9700 1 -- 172.21.15.26:0/388031205 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f202800dac0 con 0x7f2034061280 2024-05-09T00:12:02.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.578+0000 7f2030ff9700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f201c06caa0 0x7f201c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.578+0000 7f2030ff9700 1 -- 172.21.15.26:0/388031205 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f202808be00 con 0x7f2034061280 2024-05-09T00:12:02.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.579+0000 7f2032ffd700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f201c06caa0 0x7f201c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.579+0000 7f2032ffd700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f201c06caa0 0x7f201c06ef60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f20240043d0 tx=0x7f202400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:02.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.584+0000 7f2030ff9700 1 -- 172.21.15.26:0/388031205 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f20280599b0 con 0x7f2034061280 2024-05-09T00:12:02.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.799+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2034059120 con 0x7f201c06caa0 2024-05-09T00:12:02.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.800+0000 7f2030ff9700 1 -- 172.21.15.26:0/388031205 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2034059120 con 0x7f201c06caa0 2024-05-09T00:12:02.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f201c06caa0 msgr2=0x7f201c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f201c06caa0 0x7f201c06ef60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f20240043d0 tx=0x7f202400b040).stop 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2034061280 msgr2=0x7f2034107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2034061280 0x7f2034107f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f20280041d0 tx=0x7f2028009f60).stop 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 shutdown_connections 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f201c06caa0 0x7f201c06ef60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2034061280 0x7f2034107f10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 --2- 172.21.15.26:0/388031205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fa950 0x7f2034108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 >> 172.21.15.26:0/388031205 conn(0x7f20340f1e50 msgr2=0x7f20340f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 shutdown_connections 2024-05-09T00:12:02.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.803+0000 7f2039f99700 1 -- 172.21.15.26:0/388031205 wait complete. 2024-05-09T00:12:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.904+0000 7fc066368700 1 -- 172.21.15.26:0/2117130223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f8aa0 msgr2=0x7fc0600f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.904+0000 7fc066368700 1 --2- 172.21.15.26:0/2117130223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f8aa0 0x7fc0600f8f00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc0540047f0 tx=0x7fc054009cb0).stop 2024-05-09T00:12:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.904+0000 7fc066368700 1 -- 172.21.15.26:0/2117130223 shutdown_connections 2024-05-09T00:12:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.904+0000 7fc066368700 1 --2- 172.21.15.26:0/2117130223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f8aa0 0x7fc0600f8f00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.904+0000 7fc066368700 1 --2- 172.21.15.26:0/2117130223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0600f7800 0x7fc0600f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.904+0000 7fc066368700 1 -- 172.21.15.26:0/2117130223 >> 172.21.15.26:0/2117130223 conn(0x7fc0600f2f80 msgr2=0x7fc0600f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:02.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.904+0000 7fc066368700 1 -- 172.21.15.26:0/2117130223 shutdown_connections 2024-05-09T00:12:02.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.904+0000 7fc066368700 1 -- 172.21.15.26:0/2117130223 wait complete. 2024-05-09T00:12:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc066368700 1 Processor -- start 2024-05-09T00:12:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc066368700 1 -- start start 2024-05-09T00:12:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc066368700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f7800 0x7fc06006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc066368700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0600f8aa0 0x7fc06006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc066368700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06006cf80 con 0x7fc0600f7800 2024-05-09T00:12:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc066368700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06006b520 con 0x7fc0600f8aa0 2024-05-09T00:12:02.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc05ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f7800 0x7fc06006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc05ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f7800 0x7fc06006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47034/0 (socket says 172.21.15.26:47034) 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc05ffff700 1 -- 172.21.15.26:0/2124978648 learned_addr learned my addr 172.21.15.26:0/2124978648 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.905+0000 7fc05f7fe700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0600f8aa0 0x7fc06006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc05ffff700 1 -- 172.21.15.26:0/2124978648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0600f8aa0 msgr2=0x7fc06006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc05ffff700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0600f8aa0 0x7fc06006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc05ffff700 1 -- 172.21.15.26:0/2124978648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054005040 con 0x7fc0600f7800 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc05ffff700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f7800 0x7fc06006c9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc050002780 tx=0x7fc050009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc05d7fa700 1 -- 172.21.15.26:0/2124978648 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc050007b40 con 0x7fc0600f7800 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06006b7a0 con 0x7fc0600f7800 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc05d7fa700 1 -- 172.21.15.26:0/2124978648 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc05000f040 con 0x7fc0600f7800 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc05d7fa700 1 -- 172.21.15.26:0/2124978648 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc050014820 con 0x7fc0600f7800 2024-05-09T00:12:02.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.906+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06006bd60 con 0x7fc0600f7800 2024-05-09T00:12:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.907+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0600fffe0 con 0x7fc0600f7800 2024-05-09T00:12:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.907+0000 7fc05d7fa700 1 -- 172.21.15.26:0/2124978648 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc050009110 con 0x7fc0600f7800 2024-05-09T00:12:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.908+0000 7fc05d7fa700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc04806caa0 0x7fc04806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.908+0000 7fc05d7fa700 1 -- 172.21.15.26:0/2124978648 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc05008bc40 con 0x7fc0600f7800 2024-05-09T00:12:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.908+0000 7fc05f7fe700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc04806caa0 0x7fc04806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:02.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.908+0000 7fc05f7fe700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc04806caa0 0x7fc04806ef60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc054004f10 tx=0x7fc05400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:02.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:02.913+0000 7fc05d7fa700 1 -- 172.21.15.26:0/2124978648 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc0500597f0 con 0x7fc0600f7800 2024-05-09T00:12:03.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.118+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc060059120 con 0x7fc04806caa0 2024-05-09T00:12:03.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.127+0000 7fc05d7fa700 1 -- 172.21.15.26:0/2124978648 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc060059120 con 0x7fc04806caa0 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (4m) 13s ago 12m 23.8M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (77s) 13s ago 12m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (72s) 68s ago 12m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (3m) 13s ago 12m 49.5M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (7m) 13s ago 7m 15.6M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (7m) 13s ago 7m 154M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (7m) 68s ago 7m 14.5M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (7m) 68s ago 7m 14.6M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (3m) 13s ago 14m 497M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (2m) 68s ago 12m 449M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:12:03.126 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (2m) 13s ago 14m 43.8M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (118s) 68s ago 11m 39.2M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (3m) 13s ago 12m 16.4M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (3m) 68s ago 11m 22.4M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (52s) 13s ago 11m 99.0M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (18s) 13s ago 10m 11.4M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (10m) 13s ago 10m 212M 1911M 16.2.15-1-g8963e9de 727f386679cb 4031251069c6 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (9m) 68s ago 9m 286M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (9m) 68s ago 9m 250M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (9m) 68s ago 9m 239M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:12:03.127 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (2m) 68s ago 11m 70.1M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.129+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc04806caa0 msgr2=0x7fc04806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.129+0000 7fc066368700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc04806caa0 0x7fc04806ef60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc054004f10 tx=0x7fc05400b040).stop 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.129+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f7800 msgr2=0x7fc06006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.129+0000 7fc066368700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f7800 0x7fc06006c9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc050002780 tx=0x7fc050009ee0).stop 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.130+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 shutdown_connections 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.130+0000 7fc066368700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc04806caa0 0x7fc04806ef60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.130+0000 7fc066368700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0600f7800 0x7fc06006c9d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.130+0000 7fc066368700 1 --2- 172.21.15.26:0/2124978648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0600f8aa0 0x7fc06006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.130+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 >> 172.21.15.26:0/2124978648 conn(0x7fc0600f2f80 msgr2=0x7fc0600fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.130+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 shutdown_connections 2024-05-09T00:12:03.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.130+0000 7fc066368700 1 -- 172.21.15.26:0/2124978648 wait complete. 2024-05-09T00:12:03.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.230+0000 7f4c896fa700 1 -- 172.21.15.26:0/1980698130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f77e0 msgr2=0x7f4c840f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.230+0000 7f4c896fa700 1 --2- 172.21.15.26:0/1980698130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f77e0 0x7f4c840f7c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4c740047f0 tx=0x7f4c74009cb0).stop 2024-05-09T00:12:03.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.230+0000 7f4c896fa700 1 -- 172.21.15.26:0/1980698130 shutdown_connections 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.230+0000 7f4c896fa700 1 --2- 172.21.15.26:0/1980698130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c840f80f0 0x7f4c840f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.230+0000 7f4c896fa700 1 --2- 172.21.15.26:0/1980698130 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f77e0 0x7f4c840f7c00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.230+0000 7f4c896fa700 1 -- 172.21.15.26:0/1980698130 >> 172.21.15.26:0/1980698130 conn(0x7f4c840f2fc0 msgr2=0x7f4c840f5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.230+0000 7f4c896fa700 1 -- 172.21.15.26:0/1980698130 shutdown_connections 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.230+0000 7f4c896fa700 1 -- 172.21.15.26:0/1980698130 wait complete. 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c896fa700 1 Processor -- start 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c896fa700 1 -- start start 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c896fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c840f77e0 0x7f4c8406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c896fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f80f0 0x7f4c8406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c896fa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8406cf80 con 0x7f4c840f80f0 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c896fa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8406b520 con 0x7f4c840f77e0 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c827fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f80f0 0x7f4c8406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c827fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f80f0 0x7f4c8406b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47064/0 (socket says 172.21.15.26:47064) 2024-05-09T00:12:03.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c827fc700 1 -- 172.21.15.26:0/2530893596 learned_addr learned my addr 172.21.15.26:0/2530893596 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:03.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.231+0000 7f4c82ffd700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c840f77e0 0x7f4c8406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:03.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c827fc700 1 -- 172.21.15.26:0/2530893596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c840f77e0 msgr2=0x7f4c8406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c827fc700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c840f77e0 0x7f4c8406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c827fc700 1 -- 172.21.15.26:0/2530893596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c74005040 con 0x7f4c840f80f0 2024-05-09T00:12:03.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c827fc700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f80f0 0x7f4c8406b030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4c7800e910 tx=0x7f4c7800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:03.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c6bfff700 1 -- 172.21.15.26:0/2530893596 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c78007b40 con 0x7f4c840f80f0 2024-05-09T00:12:03.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c6bfff700 1 -- 172.21.15.26:0/2530893596 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c7800f040 con 0x7f4c840f80f0 2024-05-09T00:12:03.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8406b740 con 0x7f4c840f80f0 2024-05-09T00:12:03.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c6bfff700 1 -- 172.21.15.26:0/2530893596 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c78014920 con 0x7f4c840f80f0 2024-05-09T00:12:03.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.232+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8406bd00 con 0x7f4c840f80f0 2024-05-09T00:12:03.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.233+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c84100010 con 0x7f4c840f80f0 2024-05-09T00:12:03.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.233+0000 7f4c6bfff700 1 -- 172.21.15.26:0/2530893596 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4c78007ca0 con 0x7f4c840f80f0 2024-05-09T00:12:03.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.234+0000 7f4c6bfff700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4c6c06caa0 0x7f4c6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.234+0000 7f4c6bfff700 1 -- 172.21.15.26:0/2530893596 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4c7808b690 con 0x7f4c840f80f0 2024-05-09T00:12:03.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.234+0000 7f4c82ffd700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4c6c06caa0 0x7f4c6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:03.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.234+0000 7f4c82ffd700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4c6c06caa0 0x7f4c6c06ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4c740047c0 tx=0x7f4c74009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:03.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.239+0000 7f4c6bfff700 1 -- 172.21.15.26:0/2530893596 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f4c78059240 con 0x7f4c840f80f0 2024-05-09T00:12:03.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.524+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c840598f0 con 0x7f4c840f80f0 2024-05-09T00:12:03.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.524+0000 7f4c6bfff700 1 -- 172.21.15.26:0/2530893596 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f4c78058dd0 con 0x7f4c840f80f0 2024-05-09T00:12:03.521 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:12:03.521 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:12:03.521 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:12:03.521 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:12:03.521 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4, 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 8, 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 6 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:12:03.522 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:12:03.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4c6c06caa0 msgr2=0x7f4c6c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4c6c06caa0 0x7f4c6c06ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4c740047c0 tx=0x7f4c74009cb0).stop 2024-05-09T00:12:03.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f80f0 msgr2=0x7f4c8406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f80f0 0x7f4c8406b030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4c7800e910 tx=0x7f4c7800b040).stop 2024-05-09T00:12:03.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 shutdown_connections 2024-05-09T00:12:03.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4c6c06caa0 0x7f4c6c06ef60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c840f77e0 0x7f4c8406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 --2- 172.21.15.26:0/2530893596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c840f80f0 0x7f4c8406b030 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 >> 172.21.15.26:0/2530893596 conn(0x7f4c840f2fc0 msgr2=0x7f4c840fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:03.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 shutdown_connections 2024-05-09T00:12:03.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.525+0000 7f4c896fa700 1 -- 172.21.15.26:0/2530893596 wait complete. 2024-05-09T00:12:03.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.628+0000 7f6c05561700 1 -- 172.21.15.26:0/301265479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f5ad0 msgr2=0x7f6c000f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.628+0000 7f6c05561700 1 --2- 172.21.15.26:0/301265479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f5ad0 0x7f6c000f5ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6bf00047f0 tx=0x7f6bf0009cb0).stop 2024-05-09T00:12:03.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.628+0000 7f6c05561700 1 -- 172.21.15.26:0/301265479 shutdown_connections 2024-05-09T00:12:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.628+0000 7f6c05561700 1 --2- 172.21.15.26:0/301265479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000f6470 0x7f6c000f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.628+0000 7f6c05561700 1 --2- 172.21.15.26:0/301265479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f5ad0 0x7f6c000f5ef0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.628+0000 7f6c05561700 1 -- 172.21.15.26:0/301265479 >> 172.21.15.26:0/301265479 conn(0x7f6c000f1610 msgr2=0x7f6c000f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.628+0000 7f6c05561700 1 -- 172.21.15.26:0/301265479 shutdown_connections 2024-05-09T00:12:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.628+0000 7f6c05561700 1 -- 172.21.15.26:0/301265479 wait complete. 2024-05-09T00:12:03.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6c05561700 1 Processor -- start 2024-05-09T00:12:03.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6c05561700 1 -- start start 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6c05561700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000f5ad0 0x7f6c00108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6c05561700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f6470 0x7f6c00108510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6c05561700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00108ac0 con 0x7f6c000f6470 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6c05561700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00108c00 con 0x7f6c000f5ad0 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6bfe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f6470 0x7f6c00108510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6bfe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f6470 0x7f6c00108510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47084/0 (socket says 172.21.15.26:47084) 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.629+0000 7f6bfe7fc700 1 -- 172.21.15.26:0/4099437636 learned_addr learned my addr 172.21.15.26:0/4099437636 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6bfeffd700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000f5ad0 0x7f6c00108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6bfe7fc700 1 -- 172.21.15.26:0/4099437636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000f5ad0 msgr2=0x7f6c00108020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6bfe7fc700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000f5ad0 0x7f6c00108020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6bfe7fc700 1 -- 172.21.15.26:0/4099437636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0005040 con 0x7f6c000f6470 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6bfe7fc700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f6470 0x7f6c00108510 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6bf4002820 tx=0x7f6bf4009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6be7fff700 1 -- 172.21.15.26:0/4099437636 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf4007b40 con 0x7f6c000f6470 2024-05-09T00:12:03.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0010d6a0 con 0x7f6c000f6470 2024-05-09T00:12:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6be7fff700 1 -- 172.21.15.26:0/4099437636 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bf400f040 con 0x7f6c000f6470 2024-05-09T00:12:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6be7fff700 1 -- 172.21.15.26:0/4099437636 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf40148b0 con 0x7f6c000f6470 2024-05-09T00:12:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.630+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0010dc60 con 0x7f6c000f6470 2024-05-09T00:12:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.631+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c00100040 con 0x7f6c000f6470 2024-05-09T00:12:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.632+0000 7f6be7fff700 1 -- 172.21.15.26:0/4099437636 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6bf4007ca0 con 0x7f6c000f6470 2024-05-09T00:12:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.632+0000 7f6be7fff700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806caa0 0x7f6be806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.632+0000 7f6be7fff700 1 -- 172.21.15.26:0/4099437636 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6bf408b840 con 0x7f6c000f6470 2024-05-09T00:12:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.632+0000 7f6bfeffd700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806caa0 0x7f6be806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:03.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.633+0000 7f6bfeffd700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806caa0 0x7f6be806ef60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6bf0004f10 tx=0x7f6bf000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:03.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.637+0000 7f6be7fff700 1 -- 172.21.15.26:0/4099437636 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f6bf40593f0 con 0x7f6c000f6470 2024-05-09T00:12:03.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.884+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c00101eb0 con 0x7f6c000f6470 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.885+0000 7f6be7fff700 1 -- 172.21.15.26:0/4099437636 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f6bf4058f80 con 0x7f6c000f6470 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:12:03.882 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:12:03.883 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:12:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:12:03.885 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:12:03.885 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:12:03.885 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:12:03.885 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:12:03.885 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:12:03.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806caa0 msgr2=0x7f6be806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806caa0 0x7f6be806ef60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6bf0004f10 tx=0x7f6bf000b040).stop 2024-05-09T00:12:03.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f6470 msgr2=0x7f6c00108510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f6470 0x7f6c00108510 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6bf4002820 tx=0x7f6bf4009f20).stop 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 shutdown_connections 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806caa0 0x7f6be806ef60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000f5ad0 0x7f6c00108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 --2- 172.21.15.26:0/4099437636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000f6470 0x7f6c00108510 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 >> 172.21.15.26:0/4099437636 conn(0x7f6c000f1610 msgr2=0x7f6c000fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 shutdown_connections 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.887+0000 7f6c05561700 1 -- 172.21.15.26:0/4099437636 wait complete. 2024-05-09T00:12:03.887 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:12:03.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:03 smithi135 ceph-mon[80466]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:03.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:03 smithi135 ceph-mon[80466]: pgmap v79: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:03.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:03 smithi135 ceph-mon[80466]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:03.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:03 smithi135 ceph-mon[80466]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:03.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:03 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2530893596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:03.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 -- 172.21.15.26:0/2679933898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f7990 msgr2=0x7f9fd40f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 --2- 172.21.15.26:0/2679933898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f7990 0x7f9fd40f7df0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9fd00047f0 tx=0x7f9fd0009cb0).stop 2024-05-09T00:12:03.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 -- 172.21.15.26:0/2679933898 shutdown_connections 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 --2- 172.21.15.26:0/2679933898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f7990 0x7f9fd40f7df0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 --2- 172.21.15.26:0/2679933898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd40f66f0 0x7f9fd40f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 -- 172.21.15.26:0/2679933898 >> 172.21.15.26:0/2679933898 conn(0x7f9fd40f1e50 msgr2=0x7f9fd40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 -- 172.21.15.26:0/2679933898 shutdown_connections 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 -- 172.21.15.26:0/2679933898 wait complete. 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.990+0000 7f9fdc098700 1 Processor -- start 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fdc098700 1 -- start start 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fdc098700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f66f0 0x7f9fd4061050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fdc098700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd40f7990 0x7f9fd410cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fdc098700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd410d230 con 0x7f9fd40f66f0 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fdc098700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd410d370 con 0x7f9fd40f7990 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fd9e34700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f66f0 0x7f9fd4061050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fd9e34700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f66f0 0x7f9fd4061050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47104/0 (socket says 172.21.15.26:47104) 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fd9e34700 1 -- 172.21.15.26:0/1940526550 learned_addr learned my addr 172.21.15.26:0/1940526550 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fd9e34700 1 -- 172.21.15.26:0/1940526550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd40f7990 msgr2=0x7f9fd410cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fd9e34700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd40f7990 0x7f9fd410cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:12:03.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fd9e34700 1 -- 172.21.15.26:0/1940526550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0005040 con 0x7f9fd40f66f0 2024-05-09T00:12:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fd9e34700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f66f0 0x7f9fd4061050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f9fc8002820 tx=0x7f9fc8009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.991+0000 7f9fc6ffd700 1 -- 172.21.15.26:0/1940526550 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fc8002d60 con 0x7f9fd40f66f0 2024-05-09T00:12:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.992+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd410d5d0 con 0x7f9fd40f66f0 2024-05-09T00:12:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.992+0000 7f9fc6ffd700 1 -- 172.21.15.26:0/1940526550 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9fc800f040 con 0x7f9fd40f66f0 2024-05-09T00:12:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.992+0000 7f9fc6ffd700 1 -- 172.21.15.26:0/1940526550 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fc800d820 con 0x7f9fd40f66f0 2024-05-09T00:12:03.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.992+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd410db90 con 0x7f9fd40f66f0 2024-05-09T00:12:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.993+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd40feeb0 con 0x7f9fd40f66f0 2024-05-09T00:12:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.993+0000 7f9fc6ffd700 1 -- 172.21.15.26:0/1940526550 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9fc800dae0 con 0x7f9fd40f66f0 2024-05-09T00:12:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.993+0000 7f9fc6ffd700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9fc006ca30 0x7f9fc006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.993+0000 7f9fc6ffd700 1 -- 172.21.15.26:0/1940526550 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9fc808ba10 con 0x7f9fd40f66f0 2024-05-09T00:12:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.993+0000 7f9fd9633700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9fc006ca30 0x7f9fc006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:03.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.994+0000 7f9fd9633700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9fc006ca30 0x7f9fc006eef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9fd0013620 tx=0x7f9fd0009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:03.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:03.998+0000 7f9fc6ffd700 1 -- 172.21.15.26:0/1940526550 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f9fc80595c0 con 0x7f9fd40f66f0 2024-05-09T00:12:04.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:03 smithi026 ceph-mon[93667]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:04.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:03 smithi026 ceph-mon[93667]: pgmap v79: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:04.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:03 smithi026 ceph-mon[93667]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:04.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:03 smithi026 ceph-mon[93667]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:04.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:03 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2530893596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.220+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fd4059120 con 0x7f9fc006ca30 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.221+0000 7f9fc6ffd700 1 -- 172.21.15.26:0/1940526550 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9fd4059120 con 0x7f9fc006ca30 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:12:04.218 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:12:04.219 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:12:04.219 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "8/21 daemons upgraded", 2024-05-09T00:12:04.219 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T00:12:04.219 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:12:04.219 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:12:04.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9fc006ca30 msgr2=0x7f9fc006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9fc006ca30 0x7f9fc006eef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9fd0013620 tx=0x7f9fd0009cb0).stop 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f66f0 msgr2=0x7f9fd4061050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f66f0 0x7f9fd4061050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f9fc8002820 tx=0x7f9fc8009f00).stop 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 shutdown_connections 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9fc006ca30 0x7f9fc006eef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fd40f66f0 0x7f9fd4061050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 --2- 172.21.15.26:0/1940526550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fd40f7990 0x7f9fd410cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 >> 172.21.15.26:0/1940526550 conn(0x7f9fd40f1e50 msgr2=0x7f9fd40fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 shutdown_connections 2024-05-09T00:12:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.223+0000 7f9fdc098700 1 -- 172.21.15.26:0/1940526550 wait complete. 2024-05-09T00:12:04.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.326+0000 7f38d76b4700 1 -- 172.21.15.26:0/2202726414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 msgr2=0x7f38d00f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:04.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.326+0000 7f38d76b4700 1 --2- 172.21.15.26:0/2202726414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 0x7f38d00f8f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f38c00047f0 tx=0x7f38c0009cb0).stop 2024-05-09T00:12:04.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.326+0000 7f38d76b4700 1 -- 172.21.15.26:0/2202726414 shutdown_connections 2024-05-09T00:12:04.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.326+0000 7f38d76b4700 1 --2- 172.21.15.26:0/2202726414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 0x7f38d00f8f00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:04.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.326+0000 7f38d76b4700 1 --2- 172.21.15.26:0/2202726414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d00f7800 0x7f38d00f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:04.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.326+0000 7f38d76b4700 1 -- 172.21.15.26:0/2202726414 >> 172.21.15.26:0/2202726414 conn(0x7f38d00f2f80 msgr2=0x7f38d00f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:04.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.326+0000 7f38d76b4700 1 -- 172.21.15.26:0/2202726414 shutdown_connections 2024-05-09T00:12:04.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.326+0000 7f38d76b4700 1 -- 172.21.15.26:0/2202726414 wait complete. 2024-05-09T00:12:04.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d76b4700 1 Processor -- start 2024-05-09T00:12:04.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d76b4700 1 -- start start 2024-05-09T00:12:04.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d76b4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d00f7800 0x7f38d0107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:04.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d76b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 0x7f38d0108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:04.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d76b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0108a00 con 0x7f38d00f8aa0 2024-05-09T00:12:04.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d76b4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0108b40 con 0x7f38d00f7800 2024-05-09T00:12:04.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d4c4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 0x7f38d0108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:04.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d4c4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 0x7f38d0108450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:47130/0 (socket says 172.21.15.26:47130) 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d4c4f700 1 -- 172.21.15.26:0/3603589339 learned_addr learned my addr 172.21.15.26:0/3603589339 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d5450700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d00f7800 0x7f38d0107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d4c4f700 1 -- 172.21.15.26:0/3603589339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d00f7800 msgr2=0x7f38d0107f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d4c4f700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d00f7800 0x7f38d0107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d4c4f700 1 -- 172.21.15.26:0/3603589339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0005040 con 0x7f38d00f8aa0 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38d4c4f700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 0x7f38d0108450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f38c0013620 tx=0x7f38c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38c67fc700 1 -- 172.21.15.26:0/3603589339 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38c000e070 con 0x7f38d00f8aa0 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.327+0000 7f38c67fc700 1 -- 172.21.15.26:0/3603589339 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f38c0007e90 con 0x7f38d00f8aa0 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.328+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d010d580 con 0x7f38d00f8aa0 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.328+0000 7f38c67fc700 1 -- 172.21.15.26:0/3603589339 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38c0018070 con 0x7f38d00f8aa0 2024-05-09T00:12:04.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.328+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d010db40 con 0x7f38d00f8aa0 2024-05-09T00:12:04.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.329+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d00fffc0 con 0x7f38d00f8aa0 2024-05-09T00:12:04.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.329+0000 7f38c67fc700 1 -- 172.21.15.26:0/3603589339 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f38c001d420 con 0x7f38d00f8aa0 2024-05-09T00:12:04.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.329+0000 7f38c67fc700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f38bc06caa0 0x7f38bc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:04.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.330+0000 7f38c67fc700 1 -- 172.21.15.26:0/3603589339 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f38c008cb80 con 0x7f38d00f8aa0 2024-05-09T00:12:04.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.330+0000 7f38d5450700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f38bc06caa0 0x7f38bc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:04.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.330+0000 7f38d5450700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f38bc06caa0 0x7f38bc06ef60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f38cc009fd0 tx=0x7f38cc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.334+0000 7f38c67fc700 1 -- 172.21.15.26:0/3603589339 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f38c005a670 con 0x7f38d00f8aa0 2024-05-09T00:12:04.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.620+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f38d00598f0 con 0x7f38d00f8aa0 2024-05-09T00:12:04.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.620+0000 7f38c67fc700 1 -- 172.21.15.26:0/3603589339 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f38c005a200 con 0x7f38d00f8aa0 2024-05-09T00:12:04.617 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:12:04.617 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:12:04.618 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:12:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f38bc06caa0 msgr2=0x7f38bc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:04.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f38bc06caa0 0x7f38bc06ef60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f38cc009fd0 tx=0x7f38cc00b040).stop 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 msgr2=0x7f38d0108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 0x7f38d0108450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f38c0013620 tx=0x7f38c0009cb0).stop 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 shutdown_connections 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f38bc06caa0 0x7f38bc06ef60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d00f7800 0x7f38d0107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 --2- 172.21.15.26:0/3603589339 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38d00f8aa0 0x7f38d0108450 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 >> 172.21.15.26:0/3603589339 conn(0x7f38d00f2f80 msgr2=0x7f38d00fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 shutdown_connections 2024-05-09T00:12:04.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:04.622+0000 7f38d76b4700 1 -- 172.21.15.26:0/3603589339 wait complete. 2024-05-09T00:12:05.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:04 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/4099437636' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:12:05.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:04 smithi026 ceph-mon[93667]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:05.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:04 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3603589339' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:12:05.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:04 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/4099437636' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:12:05.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:04 smithi135 ceph-mon[80466]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:05.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:04 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3603589339' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:12:06.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:05 smithi026 ceph-mon[93667]: pgmap v80: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:06.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:05 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:06.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:05 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:12:06.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:05 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:06.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:05 smithi135 ceph-mon[80466]: pgmap v80: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:06.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:05 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:06.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:05 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:12:06.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:05 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:08.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:07 smithi026 ceph-mon[93667]: pgmap v81: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:08.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:07 smithi135 ceph-mon[80466]: pgmap v81: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:09.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:09 smithi026 ceph-mon[93667]: pgmap v82: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:09.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:09 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T00:12:09.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:09 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T00:12:09.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:09 smithi026 ceph-mon[93667]: Upgrade: osd.2 is safe to restart 2024-05-09T00:12:10.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:09 smithi135 ceph-mon[80466]: pgmap v82: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:10.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:09 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T00:12:10.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:09 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T00:12:10.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:09 smithi135 ceph-mon[80466]: Upgrade: osd.2 is safe to restart 2024-05-09T00:12:11.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:11 smithi026 ceph-mon[93667]: pgmap v83: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:11.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:11 smithi026 ceph-mon[93667]: Upgrade: Updating osd.2 2024-05-09T00:12:11.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:11 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:11.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:11 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:12:11.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:11 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:11.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:11 smithi026 ceph-mon[93667]: Deploying daemon osd.2 on smithi026 2024-05-09T00:12:12.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:11 smithi135 ceph-mon[80466]: pgmap v83: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:12.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:11 smithi135 ceph-mon[80466]: Upgrade: Updating osd.2 2024-05-09T00:12:12.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:11 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:12.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:11 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:12:12.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:11 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:12.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:11 smithi135 ceph-mon[80466]: Deploying daemon osd.2 on smithi026 2024-05-09T00:12:13.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:13 smithi026 ceph-mon[93667]: pgmap v84: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:14.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:13 smithi135 ceph-mon[80466]: pgmap v84: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:14.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:14 smithi026 systemd[1]: Stopping Ceph osd.2 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:12:14.847 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[65308]: debug 2024-05-09T00:12:14.446+0000 7fa19eaf9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-09T00:12:14.847 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[65308]: debug 2024-05-09T00:12:14.446+0000 7fa19eaf9700 -1 osd.2 59 *** Got signal Terminated *** 2024-05-09T00:12:14.847 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:14 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[65308]: debug 2024-05-09T00:12:14.446+0000 7fa19eaf9700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:12:15.146 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:14 smithi026 ceph-mon[93667]: osd.2 marked itself down and dead 2024-05-09T00:12:15.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:14 smithi135 ceph-mon[80466]: osd.2 marked itself down and dead 2024-05-09T00:12:15.647 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:15 smithi026 bash[109343]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2 2024-05-09T00:12:16.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:15 smithi026 ceph-mon[93667]: pgmap v85: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:16.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:15 smithi026 ceph-mon[93667]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:12:16.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:15 smithi026 ceph-mon[93667]: osdmap e60: 6 total, 5 up, 6 in 2024-05-09T00:12:16.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:15 smithi135 ceph-mon[80466]: pgmap v85: 65 pgs: 65 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:16.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:15 smithi135 ceph-mon[80466]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:12:16.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:15 smithi135 ceph-mon[80466]: osdmap e60: 6 total, 5 up, 6 in 2024-05-09T00:12:17.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:16 smithi026 ceph-mon[93667]: osdmap e61: 6 total, 5 up, 6 in 2024-05-09T00:12:17.147 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:16 smithi026 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.2.service: Succeeded. 2024-05-09T00:12:17.148 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:16 smithi026 systemd[1]: Stopped Ceph osd.2 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:12:17.148 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:17 smithi026 systemd[1]: Starting Ceph osd.2 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:12:17.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:16 smithi135 ceph-mon[80466]: osdmap e61: 6 total, 5 up, 6 in 2024-05-09T00:12:18.114 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:17 smithi026 ceph-mon[93667]: pgmap v88: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2024-05-09T00:12:18.115 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:17 smithi026 ceph-mon[93667]: Health check failed: Degraded data redundancy: 9/219 objects degraded (4.110%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:18.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:17 smithi135 ceph-mon[80466]: pgmap v88: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2024-05-09T00:12:18.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:17 smithi135 ceph-mon[80466]: Health check failed: Degraded data redundancy: 9/219 objects degraded (4.110%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:18.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:18 smithi026 bash[109617]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T00:12:18.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:18 smithi026 bash[109617]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T00:12:18.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:18 smithi026 bash[109617]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T00:12:18.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:18 smithi026 bash[109617]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T00:12:18.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:18 smithi026 bash[109617]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-09T00:12:18.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:18 smithi026 bash[109617]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T00:12:18.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:18 smithi026 bash[109617]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-09T00:12:19.647 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:19 smithi026 ceph-osd[109939]: -- 172.21.15.26:0/3521384049 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eb6a31f1e0 con 0x55eb6a2ef000 2024-05-09T00:12:19.647 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:19 smithi026 bash[109901]: 65c1e03662f96c4c4866412165dad94f08e1f3c8dfbc12f552e90ad70b21ff52 2024-05-09T00:12:19.647 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:19 smithi026 systemd[1]: Started Ceph osd.2 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:12:20.147 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:19 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[109916]: 2024-05-09T00:12:19.839+0000 7fda6ebc67c0 -1 Falling back to public interface 2024-05-09T00:12:20.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:19 smithi026 ceph-mon[93667]: pgmap v89: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 17/219 objects degraded (7.763%) 2024-05-09T00:12:20.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:19 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:20.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:19 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:20.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:19 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:20.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:19 smithi135 ceph-mon[80466]: pgmap v89: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 17/219 objects degraded (7.763%) 2024-05-09T00:12:20.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:19 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:20.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:19 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:20.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:19 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:21.892 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:21 smithi026 ceph-mon[93667]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:21.892 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:21.892 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:12:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:21 smithi135 ceph-mon[80466]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:21.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:12:23.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:23 smithi026 ceph-mon[93667]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:23.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:23 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 12 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:23.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:23 smithi135 ceph-mon[80466]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:23.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:23 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 12 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:25.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:25.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:25.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:25.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:25.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:25.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:25.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:25.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:26.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:26 smithi026 ceph-mon[93667]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:26.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:26 smithi135 ceph-mon[80466]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:27.897 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:27 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[109916]: 2024-05-09T00:12:27.613+0000 7fda6ebc67c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-05-09T00:12:28.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:28 smithi026 ceph-mon[93667]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:28.397 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:28 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[109916]: 2024-05-09T00:12:28.073+0000 7fda6ebc67c0 -1 osd.2 59 log_to_monitors true 2024-05-09T00:12:28.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:28 smithi135 ceph-mon[80466]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:12:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:12:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:29.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:29.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:29.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:29.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T00:12:29.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T00:12:29.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:29 smithi026 ceph-mon[93667]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-05-09T00:12:29.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:29.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:12:29.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:29.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T00:12:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:29 smithi135 ceph-mon[80466]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-05-09T00:12:30.147 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:12:29 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[109916]: 2024-05-09T00:12:29.858+0000 7fda5c017700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:12:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:30 smithi026 ceph-mon[93667]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:30 smithi026 ceph-mon[93667]: from='osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T00:12:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:30 smithi026 ceph-mon[93667]: osdmap e62: 6 total, 5 up, 6 in 2024-05-09T00:12:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:30 smithi026 ceph-mon[93667]: from='osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:12:30.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:30 smithi026 ceph-mon[93667]: from='osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118]' entity='osd.2' 2024-05-09T00:12:30.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:30 smithi135 ceph-mon[80466]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:30.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:30 smithi135 ceph-mon[80466]: from='osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T00:12:30.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:30 smithi135 ceph-mon[80466]: osdmap e62: 6 total, 5 up, 6 in 2024-05-09T00:12:30.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:30 smithi135 ceph-mon[80466]: from='osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2024-05-09T00:12:30.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:30 smithi135 ceph-mon[80466]: from='osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118]' entity='osd.2' 2024-05-09T00:12:31.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:31 smithi026 ceph-mon[93667]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:12:31.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:31 smithi026 ceph-mon[93667]: osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118] boot 2024-05-09T00:12:31.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:31 smithi026 ceph-mon[93667]: osdmap e63: 6 total, 6 up, 6 in 2024-05-09T00:12:31.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:12:31.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:31 smithi135 ceph-mon[80466]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:12:31.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:31 smithi135 ceph-mon[80466]: osd.2 [v2:172.21.15.26:6818/823482118,v1:172.21.15.26:6819/823482118] boot 2024-05-09T00:12:31.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:31 smithi135 ceph-mon[80466]: osdmap e63: 6 total, 6 up, 6 in 2024-05-09T00:12:31.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:12:32.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:32 smithi026 ceph-mon[93667]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:32.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:32 smithi026 ceph-mon[93667]: osdmap e64: 6 total, 6 up, 6 in 2024-05-09T00:12:32.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:32 smithi135 ceph-mon[80466]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T00:12:32.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:32 smithi135 ceph-mon[80466]: osdmap e64: 6 total, 6 up, 6 in 2024-05-09T00:12:33.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:33 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 21/219 objects degraded (9.589%), 8 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:33.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:33 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 21/219 objects degraded (9.589%), 8 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:34.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:34 smithi026 ceph-mon[93667]: pgmap v99: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2024-05-09T00:12:34.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:34 smithi135 ceph-mon[80466]: pgmap v99: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2024-05-09T00:12:34.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.739+0000 7f8e19486700 1 -- 172.21.15.26:0/4082191315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 msgr2=0x7f8e140f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:34.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.739+0000 7f8e19486700 1 --2- 172.21.15.26:0/4082191315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 0x7f8e140f7df0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8e040047f0 tx=0x7f8e04009cb0).stop 2024-05-09T00:12:34.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.739+0000 7f8e19486700 1 -- 172.21.15.26:0/4082191315 shutdown_connections 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.739+0000 7f8e19486700 1 --2- 172.21.15.26:0/4082191315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 0x7f8e140f7df0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.739+0000 7f8e19486700 1 --2- 172.21.15.26:0/4082191315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e140f66f0 0x7f8e140f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.739+0000 7f8e19486700 1 -- 172.21.15.26:0/4082191315 >> 172.21.15.26:0/4082191315 conn(0x7f8e140f1e50 msgr2=0x7f8e140f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.739+0000 7f8e19486700 1 -- 172.21.15.26:0/4082191315 shutdown_connections 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.739+0000 7f8e19486700 1 -- 172.21.15.26:0/4082191315 wait complete. 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e19486700 1 Processor -- start 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e19486700 1 -- start start 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e19486700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e140f66f0 0x7f8e1410a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e19486700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 0x7f8e1410a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e19486700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1410ac00 con 0x7f8e140f7990 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e19486700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1410ad40 con 0x7f8e140f66f0 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e127fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 0x7f8e1410a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e127fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 0x7f8e1410a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33484/0 (socket says 172.21.15.26:33484) 2024-05-09T00:12:34.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e127fc700 1 -- 172.21.15.26:0/1594842100 learned_addr learned my addr 172.21.15.26:0/1594842100 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.740+0000 7f8e12ffd700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e140f66f0 0x7f8e1410a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8e127fc700 1 -- 172.21.15.26:0/1594842100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e140f66f0 msgr2=0x7f8e1410a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8e127fc700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e140f66f0 0x7f8e1410a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8e127fc700 1 -- 172.21.15.26:0/1594842100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04005040 con 0x7f8e140f7990 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8e127fc700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 0x7f8e1410a650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8e04013620 tx=0x7f8e04009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8dfbfff700 1 -- 172.21.15.26:0/1594842100 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e0400e070 con 0x7f8e140f7990 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1410f780 con 0x7f8e140f7990 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8dfbfff700 1 -- 172.21.15.26:0/1594842100 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e04007e90 con 0x7f8e140f7990 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8dfbfff700 1 -- 172.21.15.26:0/1594842100 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e04018070 con 0x7f8e140f7990 2024-05-09T00:12:34.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.741+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1410fd40 con 0x7f8e140f7990 2024-05-09T00:12:34.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.742+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e140feeb0 con 0x7f8e140f7990 2024-05-09T00:12:34.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.743+0000 7f8dfbfff700 1 -- 172.21.15.26:0/1594842100 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8e0401d420 con 0x7f8e140f7990 2024-05-09T00:12:34.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.743+0000 7f8dfbfff700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8dfc06caa0 0x7f8dfc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:34.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.743+0000 7f8dfbfff700 1 -- 172.21.15.26:0/1594842100 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8e0408cb70 con 0x7f8e140f7990 2024-05-09T00:12:34.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.743+0000 7f8e12ffd700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8dfc06caa0 0x7f8dfc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:34.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.744+0000 7f8e12ffd700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8dfc06caa0 0x7f8dfc06ef60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8e140f77f0 tx=0x7f8e08009d80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:34.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.748+0000 7f8dfbfff700 1 -- 172.21.15.26:0/1594842100 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f8e0405a720 con 0x7f8e140f7990 2024-05-09T00:12:34.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.969+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e141103e0 con 0x7f8dfc06caa0 2024-05-09T00:12:34.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.970+0000 7f8dfbfff700 1 -- 172.21.15.26:0/1594842100 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8e141103e0 con 0x7f8dfc06caa0 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.972+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8dfc06caa0 msgr2=0x7f8dfc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.972+0000 7f8e19486700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8dfc06caa0 0x7f8dfc06ef60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8e140f77f0 tx=0x7f8e08009d80).stop 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.972+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 msgr2=0x7f8e1410a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.972+0000 7f8e19486700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 0x7f8e1410a650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8e04013620 tx=0x7f8e04009cb0).stop 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.972+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 shutdown_connections 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.972+0000 7f8e19486700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8dfc06caa0 0x7f8dfc06ef60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.972+0000 7f8e19486700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e140f66f0 0x7f8e1410a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.972+0000 7f8e19486700 1 --2- 172.21.15.26:0/1594842100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e140f7990 0x7f8e1410a650 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.973+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 >> 172.21.15.26:0/1594842100 conn(0x7f8e140f1e50 msgr2=0x7f8e14060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.973+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 shutdown_connections 2024-05-09T00:12:34.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:34.973+0000 7f8e19486700 1 -- 172.21.15.26:0/1594842100 wait complete. 2024-05-09T00:12:34.981 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:12:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.076+0000 7fc4aec63700 1 -- 172.21.15.26:0/3077921323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f66f0 msgr2=0x7fc4a80f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.076+0000 7fc4aec63700 1 --2- 172.21.15.26:0/3077921323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f66f0 0x7fc4a80f6b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc49c0047f0 tx=0x7fc49c009cb0).stop 2024-05-09T00:12:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 -- 172.21.15.26:0/3077921323 shutdown_connections 2024-05-09T00:12:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 --2- 172.21.15.26:0/3077921323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a80f7990 0x7fc4a80f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 --2- 172.21.15.26:0/3077921323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f66f0 0x7fc4a80f6b10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 -- 172.21.15.26:0/3077921323 >> 172.21.15.26:0/3077921323 conn(0x7fc4a80f1e50 msgr2=0x7fc4a80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 -- 172.21.15.26:0/3077921323 shutdown_connections 2024-05-09T00:12:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 -- 172.21.15.26:0/3077921323 wait complete. 2024-05-09T00:12:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 Processor -- start 2024-05-09T00:12:35.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 -- start start 2024-05-09T00:12:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a80f66f0 0x7fc4a8107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.077+0000 7fc4aec63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f7990 0x7fc4a8108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4aec63700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8108a40 con 0x7fc4a80f7990 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4aec63700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8108b80 con 0x7fc4a80f66f0 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f7990 0x7fc4a8108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f7990 0x7fc4a8108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33500/0 (socket says 172.21.15.26:33500) 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a7fff700 1 -- 172.21.15.26:0/2212156320 learned_addr learned my addr 172.21.15.26:0/2212156320 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4ac9ff700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a80f66f0 0x7fc4a8107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a7fff700 1 -- 172.21.15.26:0/2212156320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a80f66f0 msgr2=0x7fc4a8107fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a7fff700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a80f66f0 0x7fc4a8107fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a7fff700 1 -- 172.21.15.26:0/2212156320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c005040 con 0x7fc4a80f7990 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a7fff700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f7990 0x7fc4a8108490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc4940041d0 tx=0x7fc494009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a5ffb700 1 -- 172.21.15.26:0/2212156320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc494007b40 con 0x7fc4a80f7990 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a810d620 con 0x7fc4a80f7990 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a5ffb700 1 -- 172.21.15.26:0/2212156320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc49400f040 con 0x7fc4a80f7990 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.078+0000 7fc4a5ffb700 1 -- 172.21.15.26:0/2212156320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4940137d0 con 0x7fc4a80f7990 2024-05-09T00:12:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.079+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a810dbe0 con 0x7fc4a80f7990 2024-05-09T00:12:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.080+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a80feed0 con 0x7fc4a80f7990 2024-05-09T00:12:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.080+0000 7fc4a5ffb700 1 -- 172.21.15.26:0/2212156320 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc494007ca0 con 0x7fc4a80f7990 2024-05-09T00:12:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.080+0000 7fc4a5ffb700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc49806caa0 0x7fc49806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.080+0000 7fc4a5ffb700 1 -- 172.21.15.26:0/2212156320 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc49408b7d0 con 0x7fc4a80f7990 2024-05-09T00:12:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.080+0000 7fc4ac9ff700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc49806caa0 0x7fc49806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.081+0000 7fc4ac9ff700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc49806caa0 0x7fc49806ef60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc49c004f10 tx=0x7fc49c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.085+0000 7fc4a5ffb700 1 -- 172.21.15.26:0/2212156320 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc494059380 con 0x7fc4a80f7990 2024-05-09T00:12:35.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.309+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4a80fbdd0 con 0x7fc49806caa0 2024-05-09T00:12:35.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.311+0000 7fc4a5ffb700 1 -- 172.21.15.26:0/2212156320 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc4a80fbdd0 con 0x7fc49806caa0 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc49806caa0 msgr2=0x7fc49806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc49806caa0 0x7fc49806ef60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc49c004f10 tx=0x7fc49c00b040).stop 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f7990 msgr2=0x7fc4a8108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f7990 0x7fc4a8108490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc4940041d0 tx=0x7fc494009f60).stop 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 shutdown_connections 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc49806caa0 0x7fc49806ef60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4a80f66f0 0x7fc4a8107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 --2- 172.21.15.26:0/2212156320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4a80f7990 0x7fc4a8108490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 >> 172.21.15.26:0/2212156320 conn(0x7fc4a80f1e50 msgr2=0x7fc4a8060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 shutdown_connections 2024-05-09T00:12:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.313+0000 7fc4aec63700 1 -- 172.21.15.26:0/2212156320 wait complete. 2024-05-09T00:12:35.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.415+0000 7fbfea643700 1 -- 172.21.15.26:0/250995640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 msgr2=0x7fbfe40fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.415+0000 7fbfea643700 1 --2- 172.21.15.26:0/250995640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 0x7fbfe40fcdb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fbfd80047f0 tx=0x7fbfd8009cb0).stop 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.415+0000 7fbfea643700 1 -- 172.21.15.26:0/250995640 shutdown_connections 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.415+0000 7fbfea643700 1 --2- 172.21.15.26:0/250995640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 0x7fbfe40fcdb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.415+0000 7fbfea643700 1 --2- 172.21.15.26:0/250995640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe40611e0 0x7fbfe40fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.415+0000 7fbfea643700 1 -- 172.21.15.26:0/250995640 >> 172.21.15.26:0/250995640 conn(0x7fbfe40f1e50 msgr2=0x7fbfe40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.415+0000 7fbfea643700 1 -- 172.21.15.26:0/250995640 shutdown_connections 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.415+0000 7fbfea643700 1 -- 172.21.15.26:0/250995640 wait complete. 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.416+0000 7fbfea643700 1 Processor -- start 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.416+0000 7fbfea643700 1 -- start start 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.416+0000 7fbfea643700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe40611e0 0x7fbfe4107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.416+0000 7fbfea643700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 0x7fbfe4108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.416+0000 7fbfea643700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe41089f0 con 0x7fbfe40fa960 2024-05-09T00:12:35.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.416+0000 7fbfea643700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4108b30 con 0x7fbfe40611e0 2024-05-09T00:12:35.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.416+0000 7fbfe37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 0x7fbfe4108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 0x7fbfe4108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33506/0 (socket says 172.21.15.26:33506) 2024-05-09T00:12:35.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe37fe700 1 -- 172.21.15.26:0/2834863618 learned_addr learned my addr 172.21.15.26:0/2834863618 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:35.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe3fff700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe40611e0 0x7fbfe4107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe37fe700 1 -- 172.21.15.26:0/2834863618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe40611e0 msgr2=0x7fbfe4107f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe37fe700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe40611e0 0x7fbfe4107f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe37fe700 1 -- 172.21.15.26:0/2834863618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8005040 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe37fe700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 0x7fbfe4108440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fbfd800b120 tx=0x7fbfd8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe17fa700 1 -- 172.21.15.26:0/2834863618 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd800e030 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe410d570 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe17fa700 1 -- 172.21.15.26:0/2834863618 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbfd8007e90 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfe17fa700 1 -- 172.21.15.26:0/2834863618 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd8018070 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.417+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe410db30 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.418+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe40fffe0 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.419+0000 7fbfe17fa700 1 -- 172.21.15.26:0/2834863618 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbfd801d960 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.419+0000 7fbfe17fa700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbfcc06caa0 0x7fbfcc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.419+0000 7fbfe17fa700 1 -- 172.21.15.26:0/2834863618 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbfd808d330 con 0x7fbfe40fa960 2024-05-09T00:12:35.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.419+0000 7fbfe3fff700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbfcc06caa0 0x7fbfcc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.420+0000 7fbfe3fff700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbfcc06caa0 0x7fbfcc06ef60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbfd40041d0 tx=0x7fbfd4009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:35.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.424+0000 7fbfe17fa700 1 -- 172.21.15.26:0/2834863618 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fbfd805aee0 con 0x7fbfe40fa960 2024-05-09T00:12:35.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.633+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfe4059120 con 0x7fbfcc06caa0 2024-05-09T00:12:35.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.644+0000 7fbfe17fa700 1 -- 172.21.15.26:0/2834863618 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbfe4059120 con 0x7fbfcc06caa0 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (4m) 11s ago 13m 23.8M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (110s) 11s ago 13m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (105s) 101s ago 12m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (4m) 11s ago 13m 56.6M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (7m) 11s ago 7m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (8m) 11s ago 8m 154M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (7m) 101s ago 7m 14.5M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (7m) 101s ago 7m 14.6M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (3m) 11s ago 14m 503M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (3m) 101s ago 12m 449M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (2m) 11s ago 14m 45.0M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:12:35.643 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (2m) 101s ago 12m 39.2M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (4m) 11s ago 12m 19.5M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (4m) 101s ago 12m 22.4M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (85s) 11s ago 11m 99.8M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (51s) 11s ago 11m 100M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (16s) 11s ago 10m 10.5M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (10m) 101s ago 10m 286M 2251M 16.2.15-1-g8963e9de 727f386679cb bad62b7bf177 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (10m) 101s ago 10m 250M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (9m) 101s ago 9m 239M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:12:35.644 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (3m) 101s ago 12m 70.1M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.646+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbfcc06caa0 msgr2=0x7fbfcc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.646+0000 7fbfea643700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbfcc06caa0 0x7fbfcc06ef60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbfd40041d0 tx=0x7fbfd4009040).stop 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.646+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 msgr2=0x7fbfe4108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.646+0000 7fbfea643700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 0x7fbfe4108440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fbfd800b120 tx=0x7fbfd8009cb0).stop 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.647+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 shutdown_connections 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.647+0000 7fbfea643700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbfcc06caa0 0x7fbfcc06ef60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.647+0000 7fbfea643700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfe40611e0 0x7fbfe4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.647+0000 7fbfea643700 1 --2- 172.21.15.26:0/2834863618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfe40fa960 0x7fbfe4108440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.647+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 >> 172.21.15.26:0/2834863618 conn(0x7fbfe40f1e50 msgr2=0x7fbfe40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:35.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.647+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 shutdown_connections 2024-05-09T00:12:35.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.647+0000 7fbfea643700 1 -- 172.21.15.26:0/2834863618 wait complete. 2024-05-09T00:12:35.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:35 smithi026 ceph-mon[93667]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/219 objects degraded (9.589%), 8 pgs degraded) 2024-05-09T00:12:35.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:35 smithi135 ceph-mon[80466]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/219 objects degraded (9.589%), 8 pgs degraded) 2024-05-09T00:12:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.748+0000 7fb8989ce700 1 -- 172.21.15.26:0/1596324954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f8aa0 msgr2=0x7fb8940f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.748+0000 7fb8989ce700 1 --2- 172.21.15.26:0/1596324954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f8aa0 0x7fb8940f8f00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb8880047f0 tx=0x7fb888009cb0).stop 2024-05-09T00:12:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.748+0000 7fb8989ce700 1 -- 172.21.15.26:0/1596324954 shutdown_connections 2024-05-09T00:12:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.748+0000 7fb8989ce700 1 --2- 172.21.15.26:0/1596324954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f8aa0 0x7fb8940f8f00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.748+0000 7fb8989ce700 1 --2- 172.21.15.26:0/1596324954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8940f7800 0x7fb8940f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.748+0000 7fb8989ce700 1 -- 172.21.15.26:0/1596324954 >> 172.21.15.26:0/1596324954 conn(0x7fb8940f2f80 msgr2=0x7fb8940f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:35.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.748+0000 7fb8989ce700 1 -- 172.21.15.26:0/1596324954 shutdown_connections 2024-05-09T00:12:35.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.748+0000 7fb8989ce700 1 -- 172.21.15.26:0/1596324954 wait complete. 2024-05-09T00:12:35.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb8989ce700 1 Processor -- start 2024-05-09T00:12:35.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb8989ce700 1 -- start start 2024-05-09T00:12:35.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb8989ce700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f7800 0x7fb894107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb8989ce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8940f8aa0 0x7fb894108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb8989ce700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb894108a20 con 0x7fb8940f7800 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb8989ce700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb894108b60 con 0x7fb8940f8aa0 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb89259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f7800 0x7fb894107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb89259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f7800 0x7fb894107f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33522/0 (socket says 172.21.15.26:33522) 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb89259c700 1 -- 172.21.15.26:0/4141047765 learned_addr learned my addr 172.21.15.26:0/4141047765 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb891d9b700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8940f8aa0 0x7fb894108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb89259c700 1 -- 172.21.15.26:0/4141047765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8940f8aa0 msgr2=0x7fb894108470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb89259c700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8940f8aa0 0x7fb894108470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.749+0000 7fb89259c700 1 -- 172.21.15.26:0/4141047765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888005040 con 0x7fb8940f7800 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.750+0000 7fb89259c700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f7800 0x7fb894107f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb884002780 tx=0x7fb884009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.750+0000 7fb8837fe700 1 -- 172.21.15.26:0/4141047765 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb884007b40 con 0x7fb8940f7800 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.750+0000 7fb8837fe700 1 -- 172.21.15.26:0/4141047765 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb88400f040 con 0x7fb8940f7800 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.750+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89410d600 con 0x7fb8940f7800 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.750+0000 7fb8837fe700 1 -- 172.21.15.26:0/4141047765 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb884014820 con 0x7fb8940f7800 2024-05-09T00:12:35.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.750+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89410dbc0 con 0x7fb8940f7800 2024-05-09T00:12:35.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.751+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8940fffe0 con 0x7fb8940f7800 2024-05-09T00:12:35.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.751+0000 7fb8837fe700 1 -- 172.21.15.26:0/4141047765 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb884007ca0 con 0x7fb8940f7800 2024-05-09T00:12:35.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.752+0000 7fb8837fe700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb87c06caa0 0x7fb87c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:35.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.752+0000 7fb8837fe700 1 -- 172.21.15.26:0/4141047765 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb88408bc90 con 0x7fb8940f7800 2024-05-09T00:12:35.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.752+0000 7fb891d9b700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb87c06caa0 0x7fb87c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:35.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.752+0000 7fb891d9b700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb87c06caa0 0x7fb87c06ef60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb888004f10 tx=0x7fb88800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:35.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:35.756+0000 7fb8837fe700 1 -- 172.21.15.26:0/4141047765 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fb884059840 con 0x7fb8940f7800 2024-05-09T00:12:36.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.036+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb894101e50 con 0x7fb8940f7800 2024-05-09T00:12:36.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.036+0000 7fb8837fe700 1 -- 172.21.15.26:0/4141047765 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7fb8840593d0 con 0x7fb8940f7800 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3, 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 3 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:12:36.035 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:12:36.036 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:12:36.036 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:12:36.036 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:12:36.036 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 7, 2024-05-09T00:12:36.036 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 7 2024-05-09T00:12:36.036 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:12:36.036 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb87c06caa0 msgr2=0x7fb87c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb87c06caa0 0x7fb87c06ef60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb888004f10 tx=0x7fb88800b040).stop 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f7800 msgr2=0x7fb894107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f7800 0x7fb894107f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb884002780 tx=0x7fb884009ee0).stop 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 shutdown_connections 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb87c06caa0 0x7fb87c06ef60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8940f7800 0x7fb894107f80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 --2- 172.21.15.26:0/4141047765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8940f8aa0 0x7fb894108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 >> 172.21.15.26:0/4141047765 conn(0x7fb8940f2f80 msgr2=0x7fb8940fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 shutdown_connections 2024-05-09T00:12:36.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.039+0000 7fb8989ce700 1 -- 172.21.15.26:0/4141047765 wait complete. 2024-05-09T00:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 -- 172.21.15.26:0/3878030950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f8cb0 msgr2=0x7f78bc0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 --2- 172.21.15.26:0/3878030950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f8cb0 0x7f78bc0f9110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f78ac0047f0 tx=0x7f78ac009cb0).stop 2024-05-09T00:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 -- 172.21.15.26:0/3878030950 shutdown_connections 2024-05-09T00:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 --2- 172.21.15.26:0/3878030950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f8cb0 0x7f78bc0f9110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 --2- 172.21.15.26:0/3878030950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78bc0f7a10 0x7f78bc0f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 -- 172.21.15.26:0/3878030950 >> 172.21.15.26:0/3878030950 conn(0x7f78bc0f3150 msgr2=0x7f78bc0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 -- 172.21.15.26:0/3878030950 shutdown_connections 2024-05-09T00:12:36.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 -- 172.21.15.26:0/3878030950 wait complete. 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.140+0000 7f78c33ba700 1 Processor -- start 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c33ba700 1 -- start start 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c33ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f7a10 0x7f78bc10a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c33ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78bc0f8cb0 0x7f78bc10a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c33ba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc10ae40 con 0x7f78bc0f7a10 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c33ba700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc10af80 con 0x7f78bc0f8cb0 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c1156700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f7a10 0x7f78bc10a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c1156700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f7a10 0x7f78bc10a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33540/0 (socket says 172.21.15.26:33540) 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c1156700 1 -- 172.21.15.26:0/2556031312 learned_addr learned my addr 172.21.15.26:0/2556031312 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c0955700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78bc0f8cb0 0x7f78bc10a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c1156700 1 -- 172.21.15.26:0/2556031312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78bc0f8cb0 msgr2=0x7f78bc10a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c1156700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78bc0f8cb0 0x7f78bc10a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c1156700 1 -- 172.21.15.26:0/2556031312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac005040 con 0x7f78bc0f7a10 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c1156700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f7a10 0x7f78bc10a3a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f78b8002820 tx=0x7f78b8009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78b27fc700 1 -- 172.21.15.26:0/2556031312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b8002d60 con 0x7f78bc0f7a10 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78b27fc700 1 -- 172.21.15.26:0/2556031312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f78b800f040 con 0x7f78bc0f7a10 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.141+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc10fa20 con 0x7f78bc0f7a10 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.142+0000 7f78b27fc700 1 -- 172.21.15.26:0/2556031312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b800d820 con 0x7f78bc0f7a10 2024-05-09T00:12:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.142+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc10ffe0 con 0x7f78bc0f7a10 2024-05-09T00:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.142+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc05fb50 con 0x7f78bc0f7a10 2024-05-09T00:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.143+0000 7f78b27fc700 1 -- 172.21.15.26:0/2556031312 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f78b800da90 con 0x7f78bc0f7a10 2024-05-09T00:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.143+0000 7f78b27fc700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78a806ca80 0x7f78a806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.143+0000 7f78b27fc700 1 -- 172.21.15.26:0/2556031312 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f78b808b980 con 0x7f78bc0f7a10 2024-05-09T00:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.143+0000 7f78c0955700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78a806ca80 0x7f78a806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.144+0000 7f78c0955700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78a806ca80 0x7f78a806ef40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f78ac004f10 tx=0x7f78ac00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.148+0000 7f78b27fc700 1 -- 172.21.15.26:0/2556031312 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f78b8059530 con 0x7f78bc0f7a10 2024-05-09T00:12:36.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.394+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f78bc1001d0 con 0x7f78bc0f7a10 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.394+0000 7f78b27fc700 1 -- 172.21.15.26:0/2556031312 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f78b80590c0 con 0x7f78bc0f7a10 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:12:36.393 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:12:36.394 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:12:36.395 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:12:36.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78a806ca80 msgr2=0x7f78a806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78a806ca80 0x7f78a806ef40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f78ac004f10 tx=0x7f78ac00b040).stop 2024-05-09T00:12:36.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f7a10 msgr2=0x7f78bc10a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f7a10 0x7f78bc10a3a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f78b8002820 tx=0x7f78b8009f00).stop 2024-05-09T00:12:36.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 shutdown_connections 2024-05-09T00:12:36.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78a806ca80 0x7f78a806ef40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78bc0f7a10 0x7f78bc10a3a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 --2- 172.21.15.26:0/2556031312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78bc0f8cb0 0x7f78bc10a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.396+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 >> 172.21.15.26:0/2556031312 conn(0x7f78bc0f3150 msgr2=0x7f78bc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:36.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.397+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 shutdown_connections 2024-05-09T00:12:36.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.397+0000 7f78c33ba700 1 -- 172.21.15.26:0/2556031312 wait complete. 2024-05-09T00:12:36.397 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:12:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.499+0000 7f4bbf4df700 1 -- 172.21.15.26:0/846738933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f8cb0 msgr2=0x7f4bb80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.499+0000 7f4bbf4df700 1 --2- 172.21.15.26:0/846738933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f8cb0 0x7f4bb80f9110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4bb40047f0 tx=0x7f4bb4009cb0).stop 2024-05-09T00:12:36.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.499+0000 7f4bbf4df700 1 -- 172.21.15.26:0/846738933 shutdown_connections 2024-05-09T00:12:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.499+0000 7f4bbf4df700 1 --2- 172.21.15.26:0/846738933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f8cb0 0x7f4bb80f9110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.499+0000 7f4bbf4df700 1 --2- 172.21.15.26:0/846738933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb80f7a10 0x7f4bb80f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.499+0000 7f4bbf4df700 1 -- 172.21.15.26:0/846738933 >> 172.21.15.26:0/846738933 conn(0x7f4bb80f3150 msgr2=0x7f4bb80f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.499+0000 7f4bbf4df700 1 -- 172.21.15.26:0/846738933 shutdown_connections 2024-05-09T00:12:36.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.499+0000 7f4bbf4df700 1 -- 172.21.15.26:0/846738933 wait complete. 2024-05-09T00:12:36.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbf4df700 1 Processor -- start 2024-05-09T00:12:36.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbf4df700 1 -- start start 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbf4df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f7a10 0x7f4bb8108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbf4df700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb80f8cb0 0x7f4bb8108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbf4df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb8108c30 con 0x7f4bb80f7a10 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbf4df700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb8108d70 con 0x7f4bb80f8cb0 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbd27b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f7a10 0x7f4bb8108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbd27b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f7a10 0x7f4bb8108190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33554/0 (socket says 172.21.15.26:33554) 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbd27b700 1 -- 172.21.15.26:0/1660720000 learned_addr learned my addr 172.21.15.26:0/1660720000 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbca7a700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb80f8cb0 0x7f4bb8108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbd27b700 1 -- 172.21.15.26:0/1660720000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb80f8cb0 msgr2=0x7f4bb8108680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbd27b700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb80f8cb0 0x7f4bb8108680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbd27b700 1 -- 172.21.15.26:0/1660720000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4005040 con 0x7f4bb80f7a10 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.500+0000 7f4bbca7a700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb80f8cb0 0x7f4bb8108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.501+0000 7f4bbd27b700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f7a10 0x7f4bb8108190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4bac00c790 tx=0x7f4bac007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.501+0000 7f4baa7fc700 1 -- 172.21.15.26:0/1660720000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bac0106f0 con 0x7f4bb80f7a10 2024-05-09T00:12:36.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.501+0000 7f4baa7fc700 1 -- 172.21.15.26:0/1660720000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4bac010d00 con 0x7f4bb80f7a10 2024-05-09T00:12:36.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.501+0000 7f4baa7fc700 1 -- 172.21.15.26:0/1660720000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bac012e30 con 0x7f4bb80f7a10 2024-05-09T00:12:36.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.501+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb810d810 con 0x7f4bb80f7a10 2024-05-09T00:12:36.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.501+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb810ddd0 con 0x7f4bb80f7a10 2024-05-09T00:12:36.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.502+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb805fb50 con 0x7f4bb80f7a10 2024-05-09T00:12:36.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.502+0000 7f4baa7fc700 1 -- 172.21.15.26:0/1660720000 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4bac012400 con 0x7f4bb80f7a10 2024-05-09T00:12:36.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.503+0000 7f4baa7fc700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4ba406ca30 0x7f4ba406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.503+0000 7f4baa7fc700 1 -- 172.21.15.26:0/1660720000 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4bac08bd90 con 0x7f4bb80f7a10 2024-05-09T00:12:36.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.503+0000 7f4bbca7a700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4ba406ca30 0x7f4ba406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.503+0000 7f4bbca7a700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4ba406ca30 0x7f4ba406eef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4bb40043d0 tx=0x7f4bb400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:36.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.507+0000 7f4baa7fc700 1 -- 172.21.15.26:0/1660720000 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f4bac059940 con 0x7f4bb80f7a10 2024-05-09T00:12:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:36 smithi026 ceph-mon[93667]: pgmap v100: 65 pgs: 10 peering, 55 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:36 smithi026 ceph-mon[93667]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:36 smithi026 ceph-mon[93667]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:12:36.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:36 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/4141047765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:36.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:36 smithi135 ceph-mon[80466]: pgmap v100: 65 pgs: 10 peering, 55 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:36.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:36 smithi135 ceph-mon[80466]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:36.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:36 smithi135 ceph-mon[80466]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:36.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:36.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:12:36.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:36 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/4141047765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:12:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.726+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bb8059120 con 0x7f4ba406ca30 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.728+0000 7f4baa7fc700 1 -- 172.21.15.26:0/1660720000 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4bb8059120 con 0x7f4ba406ca30 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:12:36.726 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "9/21 daemons upgraded", 2024-05-09T00:12:36.727 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T00:12:36.727 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:12:36.727 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4ba406ca30 msgr2=0x7f4ba406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4ba406ca30 0x7f4ba406eef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4bb40043d0 tx=0x7f4bb400b040).stop 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f7a10 msgr2=0x7f4bb8108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f7a10 0x7f4bb8108190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4bac00c790 tx=0x7f4bac007f90).stop 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 shutdown_connections 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f4ba406ca30 0x7f4ba406eef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bb80f7a10 0x7f4bb8108190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 --2- 172.21.15.26:0/1660720000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4bb80f8cb0 0x7f4bb8108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 >> 172.21.15.26:0/1660720000 conn(0x7f4bb80f3150 msgr2=0x7f4bb80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 shutdown_connections 2024-05-09T00:12:36.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.730+0000 7f4bbf4df700 1 -- 172.21.15.26:0/1660720000 wait complete. 2024-05-09T00:12:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.831+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/3965713611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00611e0 msgr2=0x7fc5a00fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.831+0000 7fc5a4fa0700 1 --2- 172.21.15.26:0/3965713611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00611e0 0x7fc5a00fa470 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fc5900047f0 tx=0x7fc590009cb0).stop 2024-05-09T00:12:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.831+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/3965713611 shutdown_connections 2024-05-09T00:12:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.831+0000 7fc5a4fa0700 1 --2- 172.21.15.26:0/3965713611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00fa960 0x7fc5a00fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.831+0000 7fc5a4fa0700 1 --2- 172.21.15.26:0/3965713611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00611e0 0x7fc5a00fa470 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.831+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/3965713611 >> 172.21.15.26:0/3965713611 conn(0x7fc5a00f1e50 msgr2=0x7fc5a00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.831+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/3965713611 shutdown_connections 2024-05-09T00:12:36.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.831+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/3965713611 wait complete. 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.832+0000 7fc5a4fa0700 1 Processor -- start 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.832+0000 7fc5a4fa0700 1 -- start start 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.832+0000 7fc5a4fa0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00611e0 0x7fc5a0107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.832+0000 7fc5a4fa0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00fa960 0x7fc5a0108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.832+0000 7fc5a4fa0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a0108a10 con 0x7fc5a00fa960 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.832+0000 7fc5a4fa0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a0108b50 con 0x7fc5a00611e0 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.832+0000 7fc59dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00fa960 0x7fc5a0108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc59dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00fa960 0x7fc5a0108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:33562/0 (socket says 172.21.15.26:33562) 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc59dd9b700 1 -- 172.21.15.26:0/1038622766 learned_addr learned my addr 172.21.15.26:0/1038622766 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:12:36.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc59e59c700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00611e0 0x7fc5a0107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc59dd9b700 1 -- 172.21.15.26:0/1038622766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00611e0 msgr2=0x7fc5a0107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc59dd9b700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00611e0 0x7fc5a0107f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc59dd9b700 1 -- 172.21.15.26:0/1038622766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590005040 con 0x7fc5a00fa960 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc59dd9b700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00fa960 0x7fc5a0108460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc588002780 tx=0x7fc588009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc5977fe700 1 -- 172.21.15.26:0/1038622766 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc588007b40 con 0x7fc5a00fa960 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc5977fe700 1 -- 172.21.15.26:0/1038622766 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc58800f040 con 0x7fc5a00fa960 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a010d5f0 con 0x7fc5a00fa960 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc5977fe700 1 -- 172.21.15.26:0/1038622766 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc588014780 con 0x7fc5a00fa960 2024-05-09T00:12:36.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.833+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a010dbb0 con 0x7fc5a00fa960 2024-05-09T00:12:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.834+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a00ffff0 con 0x7fc5a00fa960 2024-05-09T00:12:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.835+0000 7fc5977fe700 1 -- 172.21.15.26:0/1038622766 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc588007ca0 con 0x7fc5a00fa960 2024-05-09T00:12:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.835+0000 7fc5977fe700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc58c06caa0 0x7fc58c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:12:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.835+0000 7fc5977fe700 1 -- 172.21.15.26:0/1038622766 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc58808bc00 con 0x7fc5a00fa960 2024-05-09T00:12:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.835+0000 7fc59e59c700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc58c06caa0 0x7fc58c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:36.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.836+0000 7fc59e59c700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc58c06caa0 0x7fc58c06ef60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc590004f10 tx=0x7fc59000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:36.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:36.840+0000 7fc5977fe700 1 -- 172.21.15.26:0/1038622766 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc588091020 con 0x7fc5a00fa960 2024-05-09T00:12:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.119+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc5a00598f0 con 0x7fc5a00fa960 2024-05-09T00:12:37.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.119+0000 7fc5977fe700 1 -- 172.21.15.26:0/1038622766 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc5880597b0 con 0x7fc5a00fa960 2024-05-09T00:12:37.118 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:12:37.118 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:12:37.118 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:12:37.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc58c06caa0 msgr2=0x7fc58c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc58c06caa0 0x7fc58c06ef60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc590004f10 tx=0x7fc59000b040).stop 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00fa960 msgr2=0x7fc5a0108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00fa960 0x7fc5a0108460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc588002780 tx=0x7fc588009ee0).stop 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 shutdown_connections 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc58c06caa0 0x7fc58c06ef60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5a00611e0 0x7fc5a0107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 --2- 172.21.15.26:0/1038622766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc5a00fa960 0x7fc5a0108460 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 >> 172.21.15.26:0/1038622766 conn(0x7fc5a00f1e50 msgr2=0x7fc5a00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 shutdown_connections 2024-05-09T00:12:37.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:12:37.121+0000 7fc5a4fa0700 1 -- 172.21.15.26:0/1038622766 wait complete. 2024-05-09T00:12:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:37 smithi026 ceph-mon[93667]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:37 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2556031312' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:12:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:37 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1038622766' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:12:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:37 smithi135 ceph-mon[80466]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:37 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2556031312' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:12:37.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:37 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1038622766' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:12:38.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:38 smithi026 ceph-mon[93667]: pgmap v101: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:38.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:38 smithi026 ceph-mon[93667]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:38.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:38 smithi135 ceph-mon[80466]: pgmap v101: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:38.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:38 smithi135 ceph-mon[80466]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:12:40.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:40 smithi026 ceph-mon[93667]: pgmap v102: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:40.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:40 smithi135 ceph-mon[80466]: pgmap v102: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:42.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:42 smithi026 ceph-mon[93667]: pgmap v103: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:42.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:42 smithi135 ceph-mon[80466]: pgmap v103: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:44 smithi135 ceph-mon[80466]: pgmap v104: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:44 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T00:12:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:44 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T00:12:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:44 smithi135 ceph-mon[80466]: Upgrade: osd.3 is safe to restart 2024-05-09T00:12:44.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:44 smithi026 ceph-mon[93667]: pgmap v104: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:44.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:44 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T00:12:44.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:44 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T00:12:44.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:44 smithi026 ceph-mon[93667]: Upgrade: osd.3 is safe to restart 2024-05-09T00:12:46.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:45 smithi026 ceph-mon[93667]: pgmap v105: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:46.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:45 smithi026 ceph-mon[93667]: Upgrade: Updating osd.3 2024-05-09T00:12:46.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:45 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:46.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:45 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:12:46.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:45 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:46.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:45 smithi026 ceph-mon[93667]: Deploying daemon osd.3 on smithi135 2024-05-09T00:12:46.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:45 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:46.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:45 smithi135 ceph-mon[80466]: pgmap v105: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:46.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:45 smithi135 ceph-mon[80466]: Upgrade: Updating osd.3 2024-05-09T00:12:46.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:45 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:46.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:45 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:12:46.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:45 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:46.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:45 smithi135 ceph-mon[80466]: Deploying daemon osd.3 on smithi135 2024-05-09T00:12:46.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:45 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:48.003 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:47 smithi135 ceph-mon[80466]: pgmap v106: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:48.003 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:47 smithi135 systemd[1]: Stopping Ceph osd.3 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:12:48.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:47 smithi026 ceph-mon[93667]: pgmap v106: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:48.400 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[49096]: debug 2024-05-09T00:12:48.004+0000 7ff22c4fb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-09T00:12:48.400 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[49096]: debug 2024-05-09T00:12:48.004+0000 7ff22c4fb700 -1 osd.3 64 *** Got signal Terminated *** 2024-05-09T00:12:48.400 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:48 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[49096]: debug 2024-05-09T00:12:48.004+0000 7ff22c4fb700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:12:49.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:48 smithi026 ceph-mon[93667]: osd.3 marked itself down and dead 2024-05-09T00:12:49.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:48 smithi135 ceph-mon[80466]: osd.3 marked itself down and dead 2024-05-09T00:12:49.649 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:49 smithi135 bash[87087]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3 2024-05-09T00:12:50.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:49 smithi026 ceph-mon[93667]: pgmap v107: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:50.514 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:49 smithi026 ceph-mon[93667]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:12:50.514 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:49 smithi026 ceph-mon[93667]: osdmap e65: 6 total, 5 up, 6 in 2024-05-09T00:12:50.521 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:49 smithi135 ceph-mon[80466]: pgmap v107: 65 pgs: 65 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:50.521 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:49 smithi135 ceph-mon[80466]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:12:50.521 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:49 smithi135 ceph-mon[80466]: osdmap e65: 6 total, 5 up, 6 in 2024-05-09T00:12:50.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:50 smithi135 ceph-mon[80466]: osdmap e66: 6 total, 5 up, 6 in 2024-05-09T00:12:50.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:50.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:12:51.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:50 smithi026 ceph-mon[93667]: osdmap e66: 6 total, 5 up, 6 in 2024-05-09T00:12:51.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:51.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:12:51.366 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:50 smithi135 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.3.service: Succeeded. 2024-05-09T00:12:51.367 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:50 smithi135 systemd[1]: Stopped Ceph osd.3 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:12:51.367 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:51 smithi135 systemd[1]: Starting Ceph osd.3 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:12:52.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:51 smithi026 ceph-mon[93667]: pgmap v110: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:52.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:51 smithi026 ceph-mon[93667]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T00:12:52.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:51 smithi135 ceph-mon[80466]: pgmap v110: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:12:52.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:51 smithi135 ceph-mon[80466]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T00:12:52.150 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:51 smithi135 bash[87364]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T00:12:52.150 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:51 smithi135 bash[87364]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T00:12:52.150 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:51 smithi135 bash[87364]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T00:12:52.150 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:51 smithi135 bash[87364]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T00:12:52.150 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:51 smithi135 bash[87364]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-05-09T00:12:52.153 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:51 smithi135 bash[87364]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T00:12:52.153 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:51 smithi135 bash[87364]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-09T00:12:53.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:52 smithi026 ceph-mon[93667]: Health check failed: Degraded data redundancy: 24/219 objects degraded (10.959%), 7 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:53.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:52 smithi135 ceph-mon[80466]: Health check failed: Degraded data redundancy: 24/219 objects degraded (10.959%), 7 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:53.150 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:53 smithi135 ceph-osd[87683]: -- 172.21.15.135:0/3972783965 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c99d7ab1e0 con 0x55c99d77ac00 2024-05-09T00:12:53.150 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:53 smithi135 bash[87645]: 6bc39713b177843c9cb1fb02df2337654110746873c005c1bd83e8d86cfc71a2 2024-05-09T00:12:53.150 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:53 smithi135 systemd[1]: Started Ceph osd.3 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:12:53.828 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:12:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:12:53.528+0000 7f209a3d27c0 -1 Falling back to public interface 2024-05-09T00:12:54.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:54 smithi026 ceph-mon[93667]: pgmap v111: 65 pgs: 7 active+undersized+degraded, 4 peering, 5 stale+active+clean, 11 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%) 2024-05-09T00:12:54.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:54.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:54.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:54.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:54 smithi135 ceph-mon[80466]: pgmap v111: 65 pgs: 7 active+undersized+degraded, 4 peering, 5 stale+active+clean, 11 active+undersized, 38 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%) 2024-05-09T00:12:54.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:54.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:54.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:55.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:55 smithi026 ceph-mon[93667]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T00:12:55.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:55 smithi135 ceph-mon[80466]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T00:12:56.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:56 smithi135 ceph-mon[80466]: pgmap v112: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:12:56.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:56 smithi026 ceph-mon[93667]: pgmap v112: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:12:57.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:57 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:57.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:57 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:57.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:57 smithi026 ceph-mon[93667]: pgmap v113: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:12:57.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:57 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:57.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:57 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:57.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:57 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:57.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:57 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:57.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:57 smithi135 ceph-mon[80466]: pgmap v113: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:12:57.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:57 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:57.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:57 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:12:58.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:58 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 49/219 objects degraded (22.374%), 17 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:58.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:58 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 49/219 objects degraded (22.374%), 17 pgs degraded (PG_DEGRADED) 2024-05-09T00:12:59.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:12:59 smithi026 ceph-mon[93667]: pgmap v114: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:12:59.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:12:59 smithi135 ceph-mon[80466]: pgmap v114: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:13:01.649 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:13:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:13:01.296+0000 7f209a3d27c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-05-09T00:13:01.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:01.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:01.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:01.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:13:01.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:01.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: pgmap v115: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:13:01.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:01.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:01.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:01.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:01.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T00:13:01.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T00:13:01.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:01 smithi135 ceph-mon[80466]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-05-09T00:13:01.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:01.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:01.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:01.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: pgmap v115: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T00:13:01.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:01 smithi026 ceph-mon[93667]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-05-09T00:13:02.149 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:13:01 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:13:01.871+0000 7f209a3d27c0 -1 osd.3 64 log_to_monitors true 2024-05-09T00:13:02.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:02 smithi026 ceph-mon[93667]: from='osd.3 [v2:172.21.15.135:6800/754743172,v1:172.21.15.135:6801/754743172]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:13:02.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:02 smithi026 ceph-mon[93667]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:13:02.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:02 smithi135 ceph-mon[80466]: from='osd.3 [v2:172.21.15.135:6800/754743172,v1:172.21.15.135:6801/754743172]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:13:02.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:02 smithi135 ceph-mon[80466]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:13:02.900 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:13:02 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:13:02.492+0000 7f208b82b700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:13:03.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:03 smithi026 ceph-mon[93667]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T00:13:03.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:03 smithi026 ceph-mon[93667]: osdmap e67: 6 total, 5 up, 6 in 2024-05-09T00:13:03.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:03 smithi026 ceph-mon[93667]: from='osd.3 [v2:172.21.15.135:6800/754743172,v1:172.21.15.135:6801/754743172]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:13:03.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:03 smithi026 ceph-mon[93667]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:13:03.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:03 smithi026 ceph-mon[93667]: pgmap v117: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:13:03.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:03 smithi135 ceph-mon[80466]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T00:13:03.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:03 smithi135 ceph-mon[80466]: osdmap e67: 6 total, 5 up, 6 in 2024-05-09T00:13:03.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:03 smithi135 ceph-mon[80466]: from='osd.3 [v2:172.21.15.135:6800/754743172,v1:172.21.15.135:6801/754743172]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:13:03.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:03 smithi135 ceph-mon[80466]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:13:03.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:03 smithi135 ceph-mon[80466]: pgmap v117: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-05-09T00:13:04.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:04 smithi026 ceph-mon[93667]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:13:04.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:04 smithi026 ceph-mon[93667]: osd.3 [v2:172.21.15.135:6800/754743172,v1:172.21.15.135:6801/754743172] boot 2024-05-09T00:13:04.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:04 smithi026 ceph-mon[93667]: osdmap e68: 6 total, 6 up, 6 in 2024-05-09T00:13:04.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:04 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:13:04.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:04 smithi026 ceph-mon[93667]: osdmap e69: 6 total, 6 up, 6 in 2024-05-09T00:13:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:04 smithi135 ceph-mon[80466]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:13:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:04 smithi135 ceph-mon[80466]: osd.3 [v2:172.21.15.135:6800/754743172,v1:172.21.15.135:6801/754743172] boot 2024-05-09T00:13:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:04 smithi135 ceph-mon[80466]: osdmap e68: 6 total, 6 up, 6 in 2024-05-09T00:13:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:04 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:13:04.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:04 smithi135 ceph-mon[80466]: osdmap e69: 6 total, 6 up, 6 in 2024-05-09T00:13:05.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:05 smithi026 ceph-mon[93667]: pgmap v120: 65 pgs: 10 peering, 11 active+undersized+degraded, 17 active+undersized, 27 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T00:13:05.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:05 smithi135 ceph-mon[80466]: pgmap v120: 65 pgs: 10 peering, 11 active+undersized+degraded, 17 active+undersized, 27 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T00:13:06.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:06 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:06.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:06.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:13:06.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:06 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:06.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:06.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:13:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.237+0000 7f24440f6700 1 -- 172.21.15.26:0/2844360165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 msgr2=0x7f243c0f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.237+0000 7f24440f6700 1 --2- 172.21.15.26:0/2844360165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 0x7f243c0f7e30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f24380047f0 tx=0x7f2438009cb0).stop 2024-05-09T00:13:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.237+0000 7f24440f6700 1 -- 172.21.15.26:0/2844360165 shutdown_connections 2024-05-09T00:13:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.237+0000 7f24440f6700 1 --2- 172.21.15.26:0/2844360165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0f8cb0 0x7f243c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:13:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.237+0000 7f24440f6700 1 --2- 172.21.15.26:0/2844360165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 0x7f243c0f7e30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.237+0000 7f24440f6700 1 -- 172.21.15.26:0/2844360165 >> 172.21.15.26:0/2844360165 conn(0x7f243c0f3150 msgr2=0x7f243c0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:07.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.237+0000 7f24440f6700 1 -- 172.21.15.26:0/2844360165 shutdown_connections 2024-05-09T00:13:07.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.237+0000 7f24440f6700 1 -- 172.21.15.26:0/2844360165 wait complete. 2024-05-09T00:13:07.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.238+0000 7f24440f6700 1 Processor -- start 2024-05-09T00:13:07.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.238+0000 7f24440f6700 1 -- start start 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f24440f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 0x7f243c108230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f24440f6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0f8cb0 0x7f243c108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f24440f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c108d60 con 0x7f243c0f7a10 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f24440f6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c108ea0 con 0x7f243c0f8cb0 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2441e92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 0x7f243c108230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2441e92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 0x7f243c108230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37880/0 (socket says 172.21.15.26:37880) 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2441e92700 1 -- 172.21.15.26:0/688833860 learned_addr learned my addr 172.21.15.26:0/688833860 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2441691700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0f8cb0 0x7f243c108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2441e92700 1 -- 172.21.15.26:0/688833860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0f8cb0 msgr2=0x7f243c108720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2441e92700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0f8cb0 0x7f243c108720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2441e92700 1 -- 172.21.15.26:0/688833860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2438005040 con 0x7f243c0f7a10 2024-05-09T00:13:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2441e92700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 0x7f243c108230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f243800b120 tx=0x7f2438009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2432ffd700 1 -- 172.21.15.26:0/688833860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f243800e030 con 0x7f243c0f7a10 2024-05-09T00:13:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c10d8e0 con 0x7f243c0f7a10 2024-05-09T00:13:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2432ffd700 1 -- 172.21.15.26:0/688833860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2438007e90 con 0x7f243c0f7a10 2024-05-09T00:13:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f2432ffd700 1 -- 172.21.15.26:0/688833860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2438018070 con 0x7f243c0f7a10 2024-05-09T00:13:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.239+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243c10ddc0 con 0x7f243c0f7a10 2024-05-09T00:13:07.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.240+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243c05fb50 con 0x7f243c0f7a10 2024-05-09T00:13:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.241+0000 7f2432ffd700 1 -- 172.21.15.26:0/688833860 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f243801d9d0 con 0x7f243c0f7a10 2024-05-09T00:13:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.241+0000 7f2432ffd700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f242806ca80 0x7f242806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.241+0000 7f2432ffd700 1 -- 172.21.15.26:0/688833860 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f243808d330 con 0x7f243c0f7a10 2024-05-09T00:13:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.241+0000 7f2441691700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f242806ca80 0x7f242806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.242+0000 7f2441691700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f242806ca80 0x7f242806ef40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f242c00b910 tx=0x7f242c008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:07.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.246+0000 7f2432ffd700 1 -- 172.21.15.26:0/688833860 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f243805aee0 con 0x7f243c0f7a10 2024-05-09T00:13:07.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.465+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f243c102240 con 0x7f242806ca80 2024-05-09T00:13:07.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.466+0000 7f2432ffd700 1 -- 172.21.15.26:0/688833860 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f243c102240 con 0x7f242806ca80 2024-05-09T00:13:07.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f242806ca80 msgr2=0x7f242806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f242806ca80 0x7f242806ef40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f242c00b910 tx=0x7f242c008040).stop 2024-05-09T00:13:07.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 msgr2=0x7f243c108230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 0x7f243c108230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f243800b120 tx=0x7f2438009cb0).stop 2024-05-09T00:13:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 shutdown_connections 2024-05-09T00:13:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f242806ca80 0x7f242806ef40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f243c0f7a10 0x7f243c108230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 --2- 172.21.15.26:0/688833860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0f8cb0 0x7f243c108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 >> 172.21.15.26:0/688833860 conn(0x7f243c0f3150 msgr2=0x7f243c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 shutdown_connections 2024-05-09T00:13:07.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.468+0000 7f24440f6700 1 -- 172.21.15.26:0/688833860 wait complete. 2024-05-09T00:13:07.476 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:13:07.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 -- 172.21.15.26:0/1168267254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 msgr2=0x7fa0d00f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 --2- 172.21.15.26:0/1168267254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 0x7fa0d00f7e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa0c00047f0 tx=0x7fa0c0009cb0).stop 2024-05-09T00:13:07.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 -- 172.21.15.26:0/1168267254 shutdown_connections 2024-05-09T00:13:07.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 --2- 172.21.15.26:0/1168267254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0d00f8cb0 0x7fa0d00f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 --2- 172.21.15.26:0/1168267254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 0x7fa0d00f7e30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 -- 172.21.15.26:0/1168267254 >> 172.21.15.26:0/1168267254 conn(0x7fa0d00f3150 msgr2=0x7fa0d00f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:07.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 -- 172.21.15.26:0/1168267254 shutdown_connections 2024-05-09T00:13:07.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 -- 172.21.15.26:0/1168267254 wait complete. 2024-05-09T00:13:07.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.572+0000 7fa0d580b700 1 Processor -- start 2024-05-09T00:13:07.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0d580b700 1 -- start start 2024-05-09T00:13:07.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0d580b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 0x7fa0d0108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0d580b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0d00f8cb0 0x7fa0d0108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0d580b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d0108c30 con 0x7fa0d00f7a10 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0d580b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d0108d70 con 0x7fa0d00f8cb0 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0ceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 0x7fa0d0108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0ceffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 0x7fa0d0108190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37904/0 (socket says 172.21.15.26:37904) 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0ceffd700 1 -- 172.21.15.26:0/2245639827 learned_addr learned my addr 172.21.15.26:0/2245639827 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0ceffd700 1 -- 172.21.15.26:0/2245639827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0d00f8cb0 msgr2=0x7fa0d0108680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0ceffd700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0d00f8cb0 0x7fa0d0108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0ceffd700 1 -- 172.21.15.26:0/2245639827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0005040 con 0x7fa0d00f7a10 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0ceffd700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 0x7fa0d0108190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa0c0013620 tx=0x7fa0c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.573+0000 7fa0b7fff700 1 -- 172.21.15.26:0/2245639827 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c000e070 con 0x7fa0d00f7a10 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.574+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d010d7b0 con 0x7fa0d00f7a10 2024-05-09T00:13:07.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.574+0000 7fa0b7fff700 1 -- 172.21.15.26:0/2245639827 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0c0007e90 con 0x7fa0d00f7a10 2024-05-09T00:13:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.574+0000 7fa0b7fff700 1 -- 172.21.15.26:0/2245639827 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c0018070 con 0x7fa0d00f7a10 2024-05-09T00:13:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.574+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d010dcf0 con 0x7fa0d00f7a10 2024-05-09T00:13:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.574+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d005fb50 con 0x7fa0d00f7a10 2024-05-09T00:13:07.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.575+0000 7fa0b7fff700 1 -- 172.21.15.26:0/2245639827 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa0c001d420 con 0x7fa0d00f7a10 2024-05-09T00:13:07.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.576+0000 7fa0b7fff700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa0b806caa0 0x7fa0b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.576+0000 7fa0ce7fc700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa0b806caa0 0x7fa0b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:07.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.576+0000 7fa0b7fff700 1 -- 172.21.15.26:0/2245639827 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa0c008ca80 con 0x7fa0d00f7a10 2024-05-09T00:13:07.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.576+0000 7fa0ce7fc700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa0b806caa0 0x7fa0b806ef60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa0c4009fd0 tx=0x7fa0c4009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.580+0000 7fa0b7fff700 1 -- 172.21.15.26:0/2245639827 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fa0c005a630 con 0x7fa0d00f7a10 2024-05-09T00:13:07.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.800+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0d01021b0 con 0x7fa0b806caa0 2024-05-09T00:13:07.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.801+0000 7fa0b7fff700 1 -- 172.21.15.26:0/2245639827 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa0d01021b0 con 0x7fa0b806caa0 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa0b806caa0 msgr2=0x7fa0b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa0b806caa0 0x7fa0b806ef60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa0c4009fd0 tx=0x7fa0c4009be0).stop 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 msgr2=0x7fa0d0108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 0x7fa0d0108190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa0c0013620 tx=0x7fa0c0009cb0).stop 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 shutdown_connections 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa0b806caa0 0x7fa0b806ef60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa0d00f7a10 0x7fa0d0108190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 --2- 172.21.15.26:0/2245639827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0d00f8cb0 0x7fa0d0108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 >> 172.21.15.26:0/2245639827 conn(0x7fa0d00f3150 msgr2=0x7fa0d00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:07.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.803+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 shutdown_connections 2024-05-09T00:13:07.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.804+0000 7fa0d580b700 1 -- 172.21.15.26:0/2245639827 wait complete. 2024-05-09T00:13:07.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:07 smithi026 ceph-mon[93667]: pgmap v121: 65 pgs: 10 peering, 9 active+undersized+degraded, 11 active+undersized, 35 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27/219 objects degraded (12.329%) 2024-05-09T00:13:07.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:07 smithi135 ceph-mon[80466]: pgmap v121: 65 pgs: 10 peering, 9 active+undersized+degraded, 11 active+undersized, 35 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27/219 objects degraded (12.329%) 2024-05-09T00:13:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.906+0000 7f0266e03700 1 -- 172.21.15.26:0/2333059904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02600fa9b0 msgr2=0x7f02600fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.906+0000 7f0266e03700 1 --2- 172.21.15.26:0/2333059904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02600fa9b0 0x7f02600fcda0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f024c0047f0 tx=0x7f024c009cb0).stop 2024-05-09T00:13:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.906+0000 7f0266e03700 1 -- 172.21.15.26:0/2333059904 shutdown_connections 2024-05-09T00:13:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.906+0000 7f0266e03700 1 --2- 172.21.15.26:0/2333059904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02600fa9b0 0x7f02600fcda0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.906+0000 7f0266e03700 1 --2- 172.21.15.26:0/2333059904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0260061220 0x7f02600fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:13:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.906+0000 7f0266e03700 1 -- 172.21.15.26:0/2333059904 >> 172.21.15.26:0/2333059904 conn(0x7f02600f1e50 msgr2=0x7f02600f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.906+0000 7f0266e03700 1 -- 172.21.15.26:0/2333059904 shutdown_connections 2024-05-09T00:13:07.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.906+0000 7f0266e03700 1 -- 172.21.15.26:0/2333059904 wait complete. 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0266e03700 1 Processor -- start 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0266e03700 1 -- start start 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0266e03700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0260061220 0x7f0260108010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0266e03700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600fa9b0 0x7f0260108500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0266e03700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0260108b40 con 0x7f0260061220 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0266e03700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0260108c80 con 0x7f02600fa9b0 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0264b9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0260061220 0x7f0260108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0264b9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0260061220 0x7f0260108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37918/0 (socket says 172.21.15.26:37918) 2024-05-09T00:13:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0264b9f700 1 -- 172.21.15.26:0/419655520 learned_addr learned my addr 172.21.15.26:0/419655520 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f025ffff700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600fa9b0 0x7f0260108500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0264b9f700 1 -- 172.21.15.26:0/419655520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600fa9b0 msgr2=0x7f0260108500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0264b9f700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600fa9b0 0x7f0260108500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f0264b9f700 1 -- 172.21.15.26:0/419655520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c005040 con 0x7f0260061220 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.907+0000 7f025ffff700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600fa9b0 0x7f0260108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.908+0000 7f0264b9f700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0260061220 0x7f0260108010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f025400b4b0 tx=0x7f02540090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.908+0000 7f025dffb700 1 -- 172.21.15.26:0/419655520 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0254002500 con 0x7f0260061220 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.908+0000 7f025dffb700 1 -- 172.21.15.26:0/419655520 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0254002b10 con 0x7f0260061220 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.908+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026010d720 con 0x7f0260061220 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.908+0000 7f025dffb700 1 -- 172.21.15.26:0/419655520 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0254012ca0 con 0x7f0260061220 2024-05-09T00:13:07.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.908+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026010dc60 con 0x7f0260061220 2024-05-09T00:13:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.909+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0260100030 con 0x7f0260061220 2024-05-09T00:13:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.910+0000 7f025dffb700 1 -- 172.21.15.26:0/419655520 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0254002660 con 0x7f0260061220 2024-05-09T00:13:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.910+0000 7f025dffb700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f025006caa0 0x7f025006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.910+0000 7f025dffb700 1 -- 172.21.15.26:0/419655520 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f025408c2d0 con 0x7f0260061220 2024-05-09T00:13:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.910+0000 7f025ffff700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f025006caa0 0x7f025006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.911+0000 7f025ffff700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f025006caa0 0x7f025006ef60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f024c0043d0 tx=0x7f024c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:07.914+0000 7f025dffb700 1 -- 172.21.15.26:0/419655520 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f0254059dc0 con 0x7f0260061220 2024-05-09T00:13:08.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.122+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0260059120 con 0x7f025006caa0 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.132+0000 7f025dffb700 1 -- 172.21.15.26:0/419655520 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0260059120 con 0x7f025006caa0 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (5m) 44s ago 13m 23.8M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (2m) 44s ago 13m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (2m) 11s ago 13m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (4m) 44s ago 13m 56.6M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (8m) 44s ago 8m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (8m) 44s ago 8m 154M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (8m) 11s ago 8m 15.0M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (8m) 11s ago 8m 15.1M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:13:08.131 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (4m) 44s ago 15m 503M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (3m) 11s ago 13m 451M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (3m) 44s ago 15m 45.0M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (3m) 11s ago 13m 40.1M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (4m) 44s ago 13m 19.5M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (4m) 11s ago 12m 23.5M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (117s) 44s ago 12m 99.8M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (83s) 44s ago 11m 100M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (49s) 44s ago 11m 10.5M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (15s) 11s ago 11m 11.5M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (10m) 11s ago 10m 251M 2251M 16.2.15-1-g8963e9de 727f386679cb 63a40ad31838 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (10m) 11s ago 10m 237M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:13:08.132 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (3m) 11s ago 12m 70.2M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:13:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.134+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f025006caa0 msgr2=0x7f025006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.134+0000 7f0266e03700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f025006caa0 0x7f025006ef60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f024c0043d0 tx=0x7f024c00b040).stop 2024-05-09T00:13:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.134+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0260061220 msgr2=0x7f0260108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.134+0000 7f0266e03700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0260061220 0x7f0260108010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f025400b4b0 tx=0x7f02540090f0).stop 2024-05-09T00:13:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.135+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 shutdown_connections 2024-05-09T00:13:08.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.135+0000 7f0266e03700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f025006caa0 0x7f025006ef60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.135+0000 7f0266e03700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0260061220 0x7f0260108010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.135+0000 7f0266e03700 1 --2- 172.21.15.26:0/419655520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02600fa9b0 0x7f0260108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.135+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 >> 172.21.15.26:0/419655520 conn(0x7f02600f1e50 msgr2=0x7f02600f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:08.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.135+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 shutdown_connections 2024-05-09T00:13:08.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.135+0000 7f0266e03700 1 -- 172.21.15.26:0/419655520 wait complete. 2024-05-09T00:13:08.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.235+0000 7f1a08404700 1 -- 172.21.15.26:0/4020889822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f8aa0 msgr2=0x7f1a000f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.235+0000 7f1a08404700 1 --2- 172.21.15.26:0/4020889822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f8aa0 0x7f1a000f8f00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f19f00047f0 tx=0x7f19f0009cb0).stop 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.235+0000 7f1a08404700 1 -- 172.21.15.26:0/4020889822 shutdown_connections 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.235+0000 7f1a08404700 1 --2- 172.21.15.26:0/4020889822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f8aa0 0x7f1a000f8f00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.235+0000 7f1a08404700 1 --2- 172.21.15.26:0/4020889822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a000f7800 0x7f1a000f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.235+0000 7f1a08404700 1 -- 172.21.15.26:0/4020889822 >> 172.21.15.26:0/4020889822 conn(0x7f1a000f2f80 msgr2=0x7f1a000f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.235+0000 7f1a08404700 1 -- 172.21.15.26:0/4020889822 shutdown_connections 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a08404700 1 -- 172.21.15.26:0/4020889822 wait complete. 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a08404700 1 Processor -- start 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a08404700 1 -- start start 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a08404700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f7800 0x7f1a0006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a08404700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a000f8aa0 0x7f1a0006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a08404700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0006cf80 con 0x7f1a000f7800 2024-05-09T00:13:08.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a08404700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0006b520 con 0x7f1a000f8aa0 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a061a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f7800 0x7f1a0006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a061a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f7800 0x7f1a0006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37938/0 (socket says 172.21.15.26:37938) 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.236+0000 7f1a061a0700 1 -- 172.21.15.26:0/898071703 learned_addr learned my addr 172.21.15.26:0/898071703 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f1a061a0700 1 -- 172.21.15.26:0/898071703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a000f8aa0 msgr2=0x7f1a0006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f1a0599f700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a000f8aa0 0x7f1a0006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f1a061a0700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a000f8aa0 0x7f1a0006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f1a061a0700 1 -- 172.21.15.26:0/898071703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0005040 con 0x7f1a000f7800 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f1a061a0700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f7800 0x7f1a0006c9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f19fc002820 tx=0x7f19fc009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f19f77fe700 1 -- 172.21.15.26:0/898071703 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19fc002d60 con 0x7f1a000f7800 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f19f77fe700 1 -- 172.21.15.26:0/898071703 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19fc00f040 con 0x7f1a000f7800 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0006b7a0 con 0x7f1a000f7800 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f19f77fe700 1 -- 172.21.15.26:0/898071703 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19fc00d820 con 0x7f1a000f7800 2024-05-09T00:13:08.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.237+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0006bd60 con 0x7f1a000f7800 2024-05-09T00:13:08.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.238+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a000fffc0 con 0x7f1a000f7800 2024-05-09T00:13:08.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.238+0000 7f19f77fe700 1 -- 172.21.15.26:0/898071703 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f19fc00da90 con 0x7f1a000f7800 2024-05-09T00:13:08.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.239+0000 7f19f77fe700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f19ec06ca80 0x7f19ec06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.239+0000 7f19f77fe700 1 -- 172.21.15.26:0/898071703 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f19fc08b930 con 0x7f1a000f7800 2024-05-09T00:13:08.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.239+0000 7f1a0599f700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f19ec06ca80 0x7f19ec06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.239+0000 7f1a0599f700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f19ec06ca80 0x7f19ec06ef40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f19f00043d0 tx=0x7f19f000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:08.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.244+0000 7f19f77fe700 1 -- 172.21.15.26:0/898071703 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f19fc0594e0 con 0x7f1a000f7800 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.526+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a00059990 con 0x7f1a000f7800 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.526+0000 7f19f77fe700 1 -- 172.21.15.26:0/898071703 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f19fc059070 con 0x7f1a000f7800 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:13:08.525 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2, 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 4 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6, 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 8 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:13:08.526 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:13:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f19ec06ca80 msgr2=0x7f19ec06ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f19ec06ca80 0x7f19ec06ef40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f19f00043d0 tx=0x7f19f000b040).stop 2024-05-09T00:13:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f7800 msgr2=0x7f1a0006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f7800 0x7f1a0006c9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f19fc002820 tx=0x7f19fc009f00).stop 2024-05-09T00:13:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 shutdown_connections 2024-05-09T00:13:08.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f19ec06ca80 0x7f19ec06ef40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a000f7800 0x7f1a0006c9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 --2- 172.21.15.26:0/898071703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a000f8aa0 0x7f1a0006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 >> 172.21.15.26:0/898071703 conn(0x7f1a000f2f80 msgr2=0x7f1a000fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 shutdown_connections 2024-05-09T00:13:08.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.529+0000 7f1a08404700 1 -- 172.21.15.26:0/898071703 wait complete. 2024-05-09T00:13:08.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.630+0000 7f9bd9886700 1 -- 172.21.15.26:0/3145329039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f7000 msgr2=0x7f9bd40f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.630+0000 7f9bd9886700 1 --2- 172.21.15.26:0/3145329039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f7000 0x7f9bd40f7a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f9bc80047f0 tx=0x7f9bc8009cb0).stop 2024-05-09T00:13:08.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.630+0000 7f9bd9886700 1 -- 172.21.15.26:0/3145329039 shutdown_connections 2024-05-09T00:13:08.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.630+0000 7f9bd9886700 1 --2- 172.21.15.26:0/3145329039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f7000 0x7f9bd40f7a30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.630+0000 7f9bd9886700 1 --2- 172.21.15.26:0/3145329039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bd40f66f0 0x7f9bd40f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:13:08.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.630+0000 7f9bd9886700 1 -- 172.21.15.26:0/3145329039 >> 172.21.15.26:0/3145329039 conn(0x7f9bd40f1ef0 msgr2=0x7f9bd40f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:08.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.630+0000 7f9bd9886700 1 -- 172.21.15.26:0/3145329039 shutdown_connections 2024-05-09T00:13:08.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.630+0000 7f9bd9886700 1 -- 172.21.15.26:0/3145329039 wait complete. 2024-05-09T00:13:08.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.631+0000 7f9bd9886700 1 Processor -- start 2024-05-09T00:13:08.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.631+0000 7f9bd9886700 1 -- start start 2024-05-09T00:13:08.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd9886700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66f0 0x7f9bd40615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd9886700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bd40f7000 0x7f9bd410ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd9886700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd410d300 con 0x7f9bd40f66f0 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd9886700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd410d440 con 0x7f9bd40f7000 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66f0 0x7f9bd40615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66f0 0x7f9bd40615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37954/0 (socket says 172.21.15.26:37954) 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd2ffd700 1 -- 172.21.15.26:0/787910930 learned_addr learned my addr 172.21.15.26:0/787910930 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd2ffd700 1 -- 172.21.15.26:0/787910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bd40f7000 msgr2=0x7f9bd410ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd27fc700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bd40f7000 0x7f9bd410ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd2ffd700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bd40f7000 0x7f9bd410ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd2ffd700 1 -- 172.21.15.26:0/787910930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8005040 con 0x7f9bd40f66f0 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd27fc700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bd40f7000 0x7f9bd410ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd2ffd700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66f0 0x7f9bd40615f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f9bc400b4b0 tx=0x7f9bc40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bbbfff700 1 -- 172.21.15.26:0/787910930 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4002500 con 0x7f9bd40f66f0 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd410d720 con 0x7f9bd40f66f0 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bbbfff700 1 -- 172.21.15.26:0/787910930 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9bc4002b10 con 0x7f9bd40f66f0 2024-05-09T00:13:08.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bbbfff700 1 -- 172.21.15.26:0/787910930 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4012cf0 con 0x7f9bd40f66f0 2024-05-09T00:13:08.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.632+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd410dc60 con 0x7f9bd40f66f0 2024-05-09T00:13:08.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.633+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd40fef60 con 0x7f9bd40f66f0 2024-05-09T00:13:08.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.634+0000 7f9bbbfff700 1 -- 172.21.15.26:0/787910930 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9bc4002660 con 0x7f9bd40f66f0 2024-05-09T00:13:08.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.635+0000 7f9bbbfff700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.635+0000 7f9bbbfff700 1 -- 172.21.15.26:0/787910930 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f9bc408c240 con 0x7f9bd40f66f0 2024-05-09T00:13:08.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.635+0000 7f9bd27fc700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.635+0000 7f9bd27fc700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9bc80043d0 tx=0x7f9bc800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:08.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.639+0000 7f9bbbfff700 1 -- 172.21.15.26:0/787910930 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f9bc4059d30 con 0x7f9bd40f66f0 2024-05-09T00:13:08.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.879+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9bd4059920 con 0x7f9bd40f66f0 2024-05-09T00:13:08.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.879+0000 7f9bbbfff700 1 -- 172.21.15.26:0/787910930 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f9bc40598c0 con 0x7f9bd40f66f0 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:13:08.878 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:13:08.879 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:13:08.880 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:13:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9bbc06caa0 msgr2=0x7f9bbc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9bc80043d0 tx=0x7f9bc800b040).stop 2024-05-09T00:13:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66f0 msgr2=0x7f9bd40615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66f0 0x7f9bd40615f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f9bc400b4b0 tx=0x7f9bc40090f0).stop 2024-05-09T00:13:08.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 shutdown_connections 2024-05-09T00:13:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40f66f0 0x7f9bd40615f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 --2- 172.21.15.26:0/787910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bd40f7000 0x7f9bd410ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 >> 172.21.15.26:0/787910930 conn(0x7f9bd40f1ef0 msgr2=0x7f9bd40fb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 shutdown_connections 2024-05-09T00:13:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.881+0000 7f9bd9886700 1 -- 172.21.15.26:0/787910930 wait complete. 2024-05-09T00:13:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:13:08.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:08 smithi026 ceph-mon[93667]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:08.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:08 smithi026 ceph-mon[93667]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:08.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:08 smithi026 ceph-mon[93667]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:08.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:08 smithi135 ceph-mon[80466]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:08.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:08 smithi135 ceph-mon[80466]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:08.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:08 smithi135 ceph-mon[80466]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:08.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.984+0000 7f8b06c63700 1 -- 172.21.15.26:0/3390262865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f7000 msgr2=0x7f8b000f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.984+0000 7f8b06c63700 1 --2- 172.21.15.26:0/3390262865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f7000 0x7f8b000f7a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8aec0047f0 tx=0x7f8aec009cb0).stop 2024-05-09T00:13:08.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.985+0000 7f8b06c63700 1 -- 172.21.15.26:0/3390262865 shutdown_connections 2024-05-09T00:13:08.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.985+0000 7f8b06c63700 1 --2- 172.21.15.26:0/3390262865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f7000 0x7f8b000f7a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.985+0000 7f8b06c63700 1 --2- 172.21.15.26:0/3390262865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f66f0 0x7f8b000f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:13:08.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.985+0000 7f8b06c63700 1 -- 172.21.15.26:0/3390262865 >> 172.21.15.26:0/3390262865 conn(0x7f8b000f1ef0 msgr2=0x7f8b000f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:08.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.985+0000 7f8b06c63700 1 -- 172.21.15.26:0/3390262865 shutdown_connections 2024-05-09T00:13:08.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.985+0000 7f8b06c63700 1 -- 172.21.15.26:0/3390262865 wait complete. 2024-05-09T00:13:08.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.985+0000 7f8b06c63700 1 Processor -- start 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.985+0000 7f8b06c63700 1 -- start start 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b06c63700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f66f0 0x7f8b000fa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b06c63700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7000 0x7f8b000f8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b06c63700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000f9260 con 0x7f8b000f66f0 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b06c63700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000f93a0 con 0x7f8b000f7000 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b049ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f66f0 0x7f8b000fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b049ff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f66f0 0x7f8b000fa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37962/0 (socket says 172.21.15.26:37962) 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b049ff700 1 -- 172.21.15.26:0/214966561 learned_addr learned my addr 172.21.15.26:0/214966561 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8afffff700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7000 0x7f8b000f8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b049ff700 1 -- 172.21.15.26:0/214966561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7000 msgr2=0x7f8b000f8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b049ff700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7000 0x7f8b000f8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:08.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b049ff700 1 -- 172.21.15.26:0/214966561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec005040 con 0x7f8b000f66f0 2024-05-09T00:13:08.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b049ff700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f66f0 0x7f8b000fa710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f8af400b4b0 tx=0x7f8af40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:08.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8afdffb700 1 -- 172.21.15.26:0/214966561 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8af4002500 con 0x7f8b000f66f0 2024-05-09T00:13:08.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8afdffb700 1 -- 172.21.15.26:0/214966561 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8af4002b10 con 0x7f8b000f66f0 2024-05-09T00:13:08.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8afdffb700 1 -- 172.21.15.26:0/214966561 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8af4012cf0 con 0x7f8b000f66f0 2024-05-09T00:13:08.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.986+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b000f9680 con 0x7f8b000f66f0 2024-05-09T00:13:08.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.987+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b000f9bc0 con 0x7f8b000f66f0 2024-05-09T00:13:08.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.988+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b000fef60 con 0x7f8b000f66f0 2024-05-09T00:13:08.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.988+0000 7f8afdffb700 1 -- 172.21.15.26:0/214966561 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8af4002660 con 0x7f8b000f66f0 2024-05-09T00:13:08.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.988+0000 7f8afdffb700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8af006caa0 0x7f8af006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:08.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.989+0000 7f8afdffb700 1 -- 172.21.15.26:0/214966561 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8af408be30 con 0x7f8b000f66f0 2024-05-09T00:13:08.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.989+0000 7f8afffff700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8af006caa0 0x7f8af006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:08.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.989+0000 7f8afffff700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8af006caa0 0x7f8af006ef60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8aec000c00 tx=0x7f8aec00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:08.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:08.993+0000 7f8afdffb700 1 -- 172.21.15.26:0/214966561 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f8af40599e0 con 0x7f8b000f66f0 2024-05-09T00:13:09.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.209+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b00110560 con 0x7f8af006caa0 2024-05-09T00:13:09.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.210+0000 7f8afdffb700 1 -- 172.21.15.26:0/214966561 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8b00110560 con 0x7f8af006caa0 2024-05-09T00:13:09.208 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:13:09.208 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:13:09.208 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "10/21 daemons upgraded", 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:13:09.209 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:13:09.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8af006caa0 msgr2=0x7f8af006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8af006caa0 0x7f8af006ef60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8aec000c00 tx=0x7f8aec00b040).stop 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f66f0 msgr2=0x7f8b000fa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f66f0 0x7f8b000fa710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f8af400b4b0 tx=0x7f8af40090f0).stop 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 shutdown_connections 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8af006caa0 0x7f8af006ef60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b000f66f0 0x7f8b000fa710 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 --2- 172.21.15.26:0/214966561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b000f7000 0x7f8b000f8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 >> 172.21.15.26:0/214966561 conn(0x7f8b000f1ef0 msgr2=0x7f8b00061340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 shutdown_connections 2024-05-09T00:13:09.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.212+0000 7f8b06c63700 1 -- 172.21.15.26:0/214966561 wait complete. 2024-05-09T00:13:09.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 -- 172.21.15.26:0/3060422275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 msgr2=0x7f5bb80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:09.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 --2- 172.21.15.26:0/3060422275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 0x7f5bb80f9110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f5bb40047f0 tx=0x7f5bb4009cb0).stop 2024-05-09T00:13:09.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 -- 172.21.15.26:0/3060422275 shutdown_connections 2024-05-09T00:13:09.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 --2- 172.21.15.26:0/3060422275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 0x7f5bb80f9110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 --2- 172.21.15.26:0/3060422275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb80f7a10 0x7f5bb80f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 -- 172.21.15.26:0/3060422275 >> 172.21.15.26:0/3060422275 conn(0x7f5bb80f3150 msgr2=0x7f5bb80f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:09.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 -- 172.21.15.26:0/3060422275 shutdown_connections 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 -- 172.21.15.26:0/3060422275 wait complete. 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 Processor -- start 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.314+0000 7f5bc050f700 1 -- start start 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bc050f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb80f7a10 0x7f5bb8108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bc050f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 0x7f5bb8108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bc050f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8108c30 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bc050f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8108d70 con 0x7f5bb80f7a10 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bbdaaa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 0x7f5bb8108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bbdaaa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 0x7f5bb8108680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37982/0 (socket says 172.21.15.26:37982) 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bbdaaa700 1 -- 172.21.15.26:0/79554342 learned_addr learned my addr 172.21.15.26:0/79554342 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:09.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bbe2ab700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb80f7a10 0x7f5bb8108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:09.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bbdaaa700 1 -- 172.21.15.26:0/79554342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb80f7a10 msgr2=0x7f5bb8108190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:09.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bbdaaa700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb80f7a10 0x7f5bb8108190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bbdaaa700 1 -- 172.21.15.26:0/79554342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4005040 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bbdaaa700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 0x7f5bb8108680 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f5bb4013620 tx=0x7f5bb4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:09.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bab7fe700 1 -- 172.21.15.26:0/79554342 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb400e070 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb810d7b0 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bab7fe700 1 -- 172.21.15.26:0/79554342 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5bb4007e90 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bab7fe700 1 -- 172.21.15.26:0/79554342 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb4018070 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.315+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb810dd70 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.316+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb805fb50 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.317+0000 7f5bab7fe700 1 -- 172.21.15.26:0/79554342 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5bb401d420 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.317+0000 7f5bab7fe700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5ba406caa0 0x7f5ba406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.317+0000 7f5bab7fe700 1 -- 172.21.15.26:0/79554342 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f5bb408caf0 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.317+0000 7f5bbe2ab700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5ba406caa0 0x7f5ba406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:09.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.318+0000 7f5bbe2ab700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5ba406caa0 0x7f5ba406ef60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5bb80f8b10 tx=0x7f5bac00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:09.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.322+0000 7f5bab7fe700 1 -- 172.21.15.26:0/79554342 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f5bb405a6a0 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.605+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5bb81001d0 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.605+0000 7f5bab7fe700 1 -- 172.21.15.26:0/79554342 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5bb405a230 con 0x7f5bb80f8cb0 2024-05-09T00:13:09.604 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:13:09.604 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:13:09.604 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5ba406caa0 msgr2=0x7f5ba406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5ba406caa0 0x7f5ba406ef60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5bb80f8b10 tx=0x7f5bac00b040).stop 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 msgr2=0x7f5bb8108680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 0x7f5bb8108680 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f5bb4013620 tx=0x7f5bb4009cb0).stop 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 shutdown_connections 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5ba406caa0 0x7f5ba406ef60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb80f7a10 0x7f5bb8108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 --2- 172.21.15.26:0/79554342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5bb80f8cb0 0x7f5bb8108680 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 >> 172.21.15.26:0/79554342 conn(0x7f5bb80f3150 msgr2=0x7f5bb80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 shutdown_connections 2024-05-09T00:13:09.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:09.607+0000 7f5bc050f700 1 -- 172.21.15.26:0/79554342 wait complete. 2024-05-09T00:13:09.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:09 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/898071703' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:09.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:09 smithi026 ceph-mon[93667]: pgmap v122: 65 pgs: 10 peering, 55 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:09.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:09 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/787910930' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:13:09.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:09 smithi026 ceph-mon[93667]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:09.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:09 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/898071703' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:09.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:09 smithi135 ceph-mon[80466]: pgmap v122: 65 pgs: 10 peering, 55 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:09.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:09 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/787910930' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:13:09.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:09 smithi135 ceph-mon[80466]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:10.763 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:10 smithi026 ceph-mon[93667]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/219 objects degraded (12.329%), 9 pgs degraded) 2024-05-09T00:13:10.763 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:10 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/79554342' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:13:10.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:10 smithi135 ceph-mon[80466]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/219 objects degraded (12.329%), 9 pgs degraded) 2024-05-09T00:13:10.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:10 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/79554342' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:13:11.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:11 smithi026 ceph-mon[93667]: pgmap v123: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:11.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:11 smithi135 ceph-mon[80466]: pgmap v123: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:13.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:13 smithi026 ceph-mon[93667]: pgmap v124: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:13.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:13 smithi135 ceph-mon[80466]: pgmap v124: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:15 smithi026 ceph-mon[93667]: pgmap v125: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:15.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:15 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T00:13:15.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:15 smithi135 ceph-mon[80466]: pgmap v125: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:15.899 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:15 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T00:13:16.740 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:16 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T00:13:16.741 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:16 smithi135 ceph-mon[80466]: Upgrade: osd.4 is safe to restart 2024-05-09T00:13:16.741 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:17.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:16 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T00:13:17.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:16 smithi026 ceph-mon[93667]: Upgrade: osd.4 is safe to restart 2024-05-09T00:13:17.147 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:18.361 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:18 smithi135 ceph-mon[80466]: pgmap v126: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:18.362 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:18 smithi135 ceph-mon[80466]: Upgrade: Updating osd.4 2024-05-09T00:13:18.362 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:18 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:18.362 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:18 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:13:18.362 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:18 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:18.362 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:18 smithi135 ceph-mon[80466]: Deploying daemon osd.4 on smithi135 2024-05-09T00:13:18.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:18 smithi026 ceph-mon[93667]: pgmap v126: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:18.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:18 smithi026 ceph-mon[93667]: Upgrade: Updating osd.4 2024-05-09T00:13:18.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:18 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:18.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:18 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:13:18.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:18 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:18 smithi026 ceph-mon[93667]: Deploying daemon osd.4 on smithi135 2024-05-09T00:13:20.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:20 smithi026 ceph-mon[93667]: pgmap v127: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:20 smithi135 ceph-mon[80466]: pgmap v127: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:20.400 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:19 smithi135 systemd[1]: Stopping Ceph osd.4 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:13:20.400 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[54512]: debug 2024-05-09T00:13:20.188+0000 7fd096687700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-09T00:13:20.400 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[54512]: debug 2024-05-09T00:13:20.188+0000 7fd096687700 -1 osd.4 69 *** Got signal Terminated *** 2024-05-09T00:13:20.400 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[54512]: debug 2024-05-09T00:13:20.188+0000 7fd096687700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:13:21.384 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:21 smithi135 ceph-mon[80466]: osd.4 marked itself down and dead 2024-05-09T00:13:21.384 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:21.384 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:13:21.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:21 smithi026 ceph-mon[93667]: osd.4 marked itself down and dead 2024-05-09T00:13:21.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:21.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:13:21.649 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:21 smithi135 bash[90999]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4 2024-05-09T00:13:22.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:22 smithi026 ceph-mon[93667]: pgmap v128: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:22.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:22 smithi026 ceph-mon[93667]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:13:22.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:22 smithi026 ceph-mon[93667]: osdmap e70: 6 total, 5 up, 6 in 2024-05-09T00:13:22.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:22 smithi135 ceph-mon[80466]: pgmap v128: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:22.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:22 smithi135 ceph-mon[80466]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:13:22.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:22 smithi135 ceph-mon[80466]: osdmap e70: 6 total, 5 up, 6 in 2024-05-09T00:13:23.177 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:23 smithi135 ceph-mon[80466]: osdmap e71: 6 total, 5 up, 6 in 2024-05-09T00:13:23.178 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:23 smithi135 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.4.service: Succeeded. 2024-05-09T00:13:23.178 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:23 smithi135 systemd[1]: Stopped Ceph osd.4 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:13:23.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:23 smithi026 ceph-mon[93667]: osdmap e71: 6 total, 5 up, 6 in 2024-05-09T00:13:23.501 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:23 smithi135 systemd[1]: Starting Ceph osd.4 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:13:24.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:24 smithi026 ceph-mon[93667]: pgmap v131: 65 pgs: 5 active+undersized+degraded, 5 peering, 4 stale+active+clean, 6 active+undersized, 45 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19/219 objects degraded (8.676%) 2024-05-09T00:13:24.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:24 smithi026 ceph-mon[93667]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T00:13:24.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:24 smithi026 ceph-mon[93667]: Health check failed: Degraded data redundancy: 19/219 objects degraded (8.676%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:24.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:24 smithi135 ceph-mon[80466]: pgmap v131: 65 pgs: 5 active+undersized+degraded, 5 peering, 4 stale+active+clean, 6 active+undersized, 45 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19/219 objects degraded (8.676%) 2024-05-09T00:13:24.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:24 smithi135 ceph-mon[80466]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T00:13:24.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:24 smithi135 ceph-mon[80466]: Health check failed: Degraded data redundancy: 19/219 objects degraded (8.676%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:24.400 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:24 smithi135 bash[91276]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T00:13:24.400 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:24 smithi135 bash[91276]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T00:13:24.400 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:24 smithi135 bash[91276]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T00:13:24.401 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:24 smithi135 bash[91276]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T00:13:24.401 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:24 smithi135 bash[91276]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-05-09T00:13:24.401 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:24 smithi135 bash[91276]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T00:13:24.401 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:24 smithi135 bash[91276]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-09T00:13:25.649 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:25 smithi135 ceph-osd[91572]: -- 172.21.15.135:0/173663209 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ad956d31e0 con 0x55ad956a3000 2024-05-09T00:13:25.650 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:25 smithi135 bash[91534]: a23ab54b22706a1820cbb77af876311d1d5dadff641202ed85cc0ab73a817a1d 2024-05-09T00:13:25.650 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:25 smithi135 systemd[1]: Started Ceph osd.4 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:13:26.311 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:13:25.943+0000 7fea97de57c0 -1 Falling back to public interface 2024-05-09T00:13:26.311 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:26 smithi135 ceph-mon[80466]: pgmap v132: 65 pgs: 13 active+undersized+degraded, 5 peering, 16 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T00:13:26.312 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:26 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:26.312 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:26 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:26.312 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:26 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:26.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:26 smithi026 ceph-mon[93667]: pgmap v132: 65 pgs: 13 active+undersized+degraded, 5 peering, 16 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T00:13:26.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:26 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:26.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:26 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:26.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:26 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:27.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:27 smithi026 ceph-mon[93667]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T00:13:27.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:27 smithi135 ceph-mon[80466]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T00:13:28.115 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:28 smithi135 ceph-mon[80466]: pgmap v133: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:28.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:28 smithi026 ceph-mon[93667]: pgmap v133: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:29 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 37/219 objects degraded (16.895%), 15 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:29.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:29.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:29 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 37/219 objects degraded (16.895%), 15 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:29.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:30.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:30 smithi026 ceph-mon[93667]: pgmap v134: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:30.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:30 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:30.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:30 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:30.399 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:30 smithi135 ceph-mon[80466]: pgmap v134: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:30.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:30 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:30.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:30 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:32.126 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:13:31.791+0000 7fea97de57c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-05-09T00:13:32.376 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:32 smithi135 ceph-mon[80466]: pgmap v135: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:32.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:32 smithi026 ceph-mon[93667]: pgmap v135: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:32.650 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:13:32.377+0000 7fea97de57c0 -1 osd.4 69 log_to_monitors true 2024-05-09T00:13:33.132 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:33 smithi135 ceph-mon[80466]: from='osd.4 [v2:172.21.15.135:6808/3603928216,v1:172.21.15.135:6809/3603928216]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:13:33.133 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:33 smithi135 ceph-mon[80466]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:13:33.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:33 smithi026 ceph-mon[93667]: from='osd.4 [v2:172.21.15.135:6808/3603928216,v1:172.21.15.135:6809/3603928216]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:13:33.395 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:33 smithi026 ceph-mon[93667]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:13:33.399 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:13:33 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:13:33.151+0000 7fea8923e700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:13:34.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: pgmap v136: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: osdmap e72: 6 total, 5 up, 6 in 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='osd.4 [v2:172.21.15.135:6808/3603928216,v1:172.21.15.135:6809/3603928216]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:34.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T00:13:34.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T00:13:34.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:34 smithi026 ceph-mon[93667]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: pgmap v136: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: osdmap e72: 6 total, 5 up, 6 in 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='osd.4 [v2:172.21.15.135:6808/3603928216,v1:172.21.15.135:6809/3603928216]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:34.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T00:13:34.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T00:13:34.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:34 smithi135 ceph-mon[80466]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-05-09T00:13:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:35 smithi026 ceph-mon[93667]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:13:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:35 smithi026 ceph-mon[93667]: osd.4 [v2:172.21.15.135:6808/3603928216,v1:172.21.15.135:6809/3603928216] boot 2024-05-09T00:13:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:35 smithi026 ceph-mon[93667]: osdmap e73: 6 total, 6 up, 6 in 2024-05-09T00:13:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:35 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:13:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:35 smithi135 ceph-mon[80466]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:13:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:35 smithi135 ceph-mon[80466]: osd.4 [v2:172.21.15.135:6808/3603928216,v1:172.21.15.135:6809/3603928216] boot 2024-05-09T00:13:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:35 smithi135 ceph-mon[80466]: osdmap e73: 6 total, 6 up, 6 in 2024-05-09T00:13:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:35 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:13:36.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:36 smithi026 ceph-mon[93667]: pgmap v139: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:36.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:36 smithi026 ceph-mon[93667]: osdmap e74: 6 total, 6 up, 6 in 2024-05-09T00:13:36.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:36.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:13:36.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:36 smithi135 ceph-mon[80466]: pgmap v139: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-05-09T00:13:36.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:36 smithi135 ceph-mon[80466]: osdmap e74: 6 total, 6 up, 6 in 2024-05-09T00:13:36.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:36.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:13:37.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:37 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 14 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:37.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:37 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 14 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:38.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:38 smithi026 ceph-mon[93667]: pgmap v141: 65 pgs: 14 active+undersized+degraded, 16 active+undersized, 35 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T00:13:38.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:38 smithi135 ceph-mon[80466]: pgmap v141: 65 pgs: 14 active+undersized+degraded, 16 active+undersized, 35 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T00:13:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.725+0000 7ffa489a1700 1 -- 172.21.15.26:0/2097615790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 msgr2=0x7ffa440f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.725+0000 7ffa489a1700 1 --2- 172.21.15.26:0/2097615790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 0x7ffa440f7e30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ffa340047f0 tx=0x7ffa34009cb0).stop 2024-05-09T00:13:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.725+0000 7ffa489a1700 1 -- 172.21.15.26:0/2097615790 shutdown_connections 2024-05-09T00:13:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.725+0000 7ffa489a1700 1 --2- 172.21.15.26:0/2097615790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440f8cb0 0x7ffa440f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.725+0000 7ffa489a1700 1 --2- 172.21.15.26:0/2097615790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 0x7ffa440f7e30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.725+0000 7ffa489a1700 1 -- 172.21.15.26:0/2097615790 >> 172.21.15.26:0/2097615790 conn(0x7ffa440f3150 msgr2=0x7ffa440f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.725+0000 7ffa489a1700 1 -- 172.21.15.26:0/2097615790 shutdown_connections 2024-05-09T00:13:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.725+0000 7ffa489a1700 1 -- 172.21.15.26:0/2097615790 wait complete. 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa489a1700 1 Processor -- start 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa489a1700 1 -- start start 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa489a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 0x7ffa441081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa489a1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440f8cb0 0x7ffa441086c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa489a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa44108c70 con 0x7ffa440f7a10 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa489a1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa44108db0 con 0x7ffa440f8cb0 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa4259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 0x7ffa441081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa4259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 0x7ffa441081d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60048/0 (socket says 172.21.15.26:60048) 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.726+0000 7ffa4259c700 1 -- 172.21.15.26:0/2862871687 learned_addr learned my addr 172.21.15.26:0/2862871687 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa41d9b700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440f8cb0 0x7ffa441086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa4259c700 1 -- 172.21.15.26:0/2862871687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440f8cb0 msgr2=0x7ffa441086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa4259c700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440f8cb0 0x7ffa441086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa4259c700 1 -- 172.21.15.26:0/2862871687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34005040 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa4259c700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 0x7ffa441081d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ffa34013620 tx=0x7ffa34009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa337fe700 1 -- 172.21.15.26:0/2862871687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa3400e070 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4410d7f0 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa337fe700 1 -- 172.21.15.26:0/2862871687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa34007e90 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa337fe700 1 -- 172.21.15.26:0/2862871687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa34018070 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.727+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4406af90 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.728+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4405fb50 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.729+0000 7ffa337fe700 1 -- 172.21.15.26:0/2862871687 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffa3401d420 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.729+0000 7ffa337fe700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ffa2c070eb0 0x7ffa2c073370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.729+0000 7ffa337fe700 1 -- 172.21.15.26:0/2862871687 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ffa3408c990 con 0x7ffa440f7a10 2024-05-09T00:13:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.729+0000 7ffa41d9b700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ffa2c070eb0 0x7ffa2c073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:39.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.730+0000 7ffa41d9b700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ffa2c070eb0 0x7ffa2c073370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ffa38004de0 tx=0x7ffa3800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.734+0000 7ffa337fe700 1 -- 172.21.15.26:0/2862871687 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7ffa3405a540 con 0x7ffa440f7a10 2024-05-09T00:13:39.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.953+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa44059120 con 0x7ffa2c070eb0 2024-05-09T00:13:39.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.954+0000 7ffa337fe700 1 -- 172.21.15.26:0/2862871687 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ffa44059120 con 0x7ffa2c070eb0 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ffa2c070eb0 msgr2=0x7ffa2c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ffa2c070eb0 0x7ffa2c073370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ffa38004de0 tx=0x7ffa3800b040).stop 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 msgr2=0x7ffa441081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 0x7ffa441081d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ffa34013620 tx=0x7ffa34009cb0).stop 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 shutdown_connections 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ffa2c070eb0 0x7ffa2c073370 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffa440f7a10 0x7ffa441081d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 --2- 172.21.15.26:0/2862871687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440f8cb0 0x7ffa441086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 >> 172.21.15.26:0/2862871687 conn(0x7ffa440f3150 msgr2=0x7ffa440fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 shutdown_connections 2024-05-09T00:13:39.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:39.956+0000 7ffa489a1700 1 -- 172.21.15.26:0/2862871687 wait complete. 2024-05-09T00:13:39.964 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:13:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.059+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/1967590306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 msgr2=0x7fdbc40fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.059+0000 7fdbcbe6c700 1 --2- 172.21.15.26:0/1967590306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 0x7fdbc40fcda0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fdbb80047f0 tx=0x7fdbb8009cb0).stop 2024-05-09T00:13:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.059+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/1967590306 shutdown_connections 2024-05-09T00:13:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.059+0000 7fdbcbe6c700 1 --2- 172.21.15.26:0/1967590306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 0x7fdbc40fcda0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.059+0000 7fdbcbe6c700 1 --2- 172.21.15.26:0/1967590306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc4061220 0x7fdbc40fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.059+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/1967590306 >> 172.21.15.26:0/1967590306 conn(0x7fdbc40f1e50 msgr2=0x7fdbc40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.059+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/1967590306 shutdown_connections 2024-05-09T00:13:40.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.059+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/1967590306 wait complete. 2024-05-09T00:13:40.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbcbe6c700 1 Processor -- start 2024-05-09T00:13:40.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbcbe6c700 1 -- start start 2024-05-09T00:13:40.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbcbe6c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc4061220 0x7fdbc4107f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbcbe6c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 0x7fdbc4108400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbcbe6c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc41089b0 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbcbe6c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4108af0 con 0x7fdbc4061220 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbc9407700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 0x7fdbc4108400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbc9407700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 0x7fdbc4108400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60072/0 (socket says 172.21.15.26:60072) 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbc9407700 1 -- 172.21.15.26:0/489289906 learned_addr learned my addr 172.21.15.26:0/489289906 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbc9407700 1 -- 172.21.15.26:0/489289906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc4061220 msgr2=0x7fdbc4107f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.060+0000 7fdbc9c08700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc4061220 0x7fdbc4107f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbc9407700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc4061220 0x7fdbc4107f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbc9407700 1 -- 172.21.15.26:0/489289906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8005040 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbc9c08700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc4061220 0x7fdbc4107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbc9407700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 0x7fdbc4108400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fdbb8013620 tx=0x7fdbb8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbb6ffd700 1 -- 172.21.15.26:0/489289906 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb800e070 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbb6ffd700 1 -- 172.21.15.26:0/489289906 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdbb8007e90 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc410d530 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbb6ffd700 1 -- 172.21.15.26:0/489289906 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb8018070 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.061+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc410daf0 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.062+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc40fffb0 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.062+0000 7fdbb6ffd700 1 -- 172.21.15.26:0/489289906 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdbb801d420 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.063+0000 7fdbb6ffd700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbb006caa0 0x7fdbb006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.063+0000 7fdbb6ffd700 1 -- 172.21.15.26:0/489289906 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fdbb808ca50 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.063+0000 7fdbc9c08700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbb006caa0 0x7fdbb006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.063+0000 7fdbc9c08700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbb006caa0 0x7fdbb006ef60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdbc0004c80 tx=0x7fdbc000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.067+0000 7fdbb6ffd700 1 -- 172.21.15.26:0/489289906 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fdbb805a600 con 0x7fdbc40fa9b0 2024-05-09T00:13:40.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.286+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbc4059120 con 0x7fdbb006caa0 2024-05-09T00:13:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.287+0000 7fdbb6ffd700 1 -- 172.21.15.26:0/489289906 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdbc4059120 con 0x7fdbb006caa0 2024-05-09T00:13:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbb006caa0 msgr2=0x7fdbb006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbb006caa0 0x7fdbb006ef60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdbc0004c80 tx=0x7fdbc000b040).stop 2024-05-09T00:13:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 msgr2=0x7fdbc4108400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 0x7fdbc4108400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fdbb8013620 tx=0x7fdbb8009cb0).stop 2024-05-09T00:13:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 shutdown_connections 2024-05-09T00:13:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdbb006caa0 0x7fdbb006ef60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbc4061220 0x7fdbc4107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 --2- 172.21.15.26:0/489289906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbc40fa9b0 0x7fdbc4108400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.289+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 >> 172.21.15.26:0/489289906 conn(0x7fdbc40f1e50 msgr2=0x7fdbc40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.290+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 shutdown_connections 2024-05-09T00:13:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.290+0000 7fdbcbe6c700 1 -- 172.21.15.26:0/489289906 wait complete. 2024-05-09T00:13:40.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.391+0000 7f514306b700 1 -- 172.21.15.26:0/3375652241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f8aa0 msgr2=0x7f513c0f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.391+0000 7f514306b700 1 --2- 172.21.15.26:0/3375652241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f8aa0 0x7f513c0f8f00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f51240047f0 tx=0x7f5124009cb0).stop 2024-05-09T00:13:40.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.391+0000 7f514306b700 1 -- 172.21.15.26:0/3375652241 shutdown_connections 2024-05-09T00:13:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.391+0000 7f514306b700 1 --2- 172.21.15.26:0/3375652241 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f8aa0 0x7f513c0f8f00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.391+0000 7f514306b700 1 --2- 172.21.15.26:0/3375652241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0f7800 0x7f513c0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.391+0000 7f514306b700 1 -- 172.21.15.26:0/3375652241 >> 172.21.15.26:0/3375652241 conn(0x7f513c0f2f80 msgr2=0x7f513c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.391+0000 7f514306b700 1 -- 172.21.15.26:0/3375652241 shutdown_connections 2024-05-09T00:13:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.391+0000 7f514306b700 1 -- 172.21.15.26:0/3375652241 wait complete. 2024-05-09T00:13:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f514306b700 1 Processor -- start 2024-05-09T00:13:40.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f514306b700 1 -- start start 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f514306b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f7800 0x7f513c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f514306b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0f8aa0 0x7f513c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f514306b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c06cf80 con 0x7f513c0f7800 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f514306b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c06b520 con 0x7f513c0f8aa0 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f5140e07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f7800 0x7f513c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f5140e07700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f7800 0x7f513c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60080/0 (socket says 172.21.15.26:60080) 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f5140e07700 1 -- 172.21.15.26:0/4010495315 learned_addr learned my addr 172.21.15.26:0/4010495315 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.392+0000 7f513bfff700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0f8aa0 0x7f513c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f5140e07700 1 -- 172.21.15.26:0/4010495315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0f8aa0 msgr2=0x7f513c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f5140e07700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0f8aa0 0x7f513c06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f5140e07700 1 -- 172.21.15.26:0/4010495315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124005040 con 0x7f513c0f7800 2024-05-09T00:13:40.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f5140e07700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f7800 0x7f513c06c9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f512c002820 tx=0x7f512c009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f5139ffb700 1 -- 172.21.15.26:0/4010495315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512c007b40 con 0x7f513c0f7800 2024-05-09T00:13:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f5139ffb700 1 -- 172.21.15.26:0/4010495315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f512c00f040 con 0x7f513c0f7800 2024-05-09T00:13:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c06b7a0 con 0x7f513c0f7800 2024-05-09T00:13:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f5139ffb700 1 -- 172.21.15.26:0/4010495315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512c014820 con 0x7f513c0f7800 2024-05-09T00:13:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.393+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c06bd60 con 0x7f513c0f7800 2024-05-09T00:13:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.394+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c0fffc0 con 0x7f513c0f7800 2024-05-09T00:13:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.395+0000 7f5139ffb700 1 -- 172.21.15.26:0/4010495315 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f512c009110 con 0x7f513c0f7800 2024-05-09T00:13:40.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.395+0000 7f5139ffb700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f512806caa0 0x7f512806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.395+0000 7f513bfff700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f512806caa0 0x7f512806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.395+0000 7f5139ffb700 1 -- 172.21.15.26:0/4010495315 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f512c08b800 con 0x7f513c0f7800 2024-05-09T00:13:40.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.396+0000 7f513bfff700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f512806caa0 0x7f512806ef60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5124004f10 tx=0x7f512400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.400+0000 7f5139ffb700 1 -- 172.21.15.26:0/4010495315 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f512c0593b0 con 0x7f513c0f7800 2024-05-09T00:13:40.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.607+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f513c059120 con 0x7f512806caa0 2024-05-09T00:13:40.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.617+0000 7f5139ffb700 1 -- 172.21.15.26:0/4010495315 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f513c059120 con 0x7f512806caa0 2024-05-09T00:13:40.614 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:13:40.614 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (5m) 76s ago 14m 23.8M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:13:40.614 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (2m) 76s ago 14m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (2m) 11s ago 13m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (5m) 76s ago 14m 56.6M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (8m) 76s ago 8m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (9m) 76s ago 9m 154M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (8m) 11s ago 8m 15.1M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (9m) 11s ago 9m 15.2M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (4m) 76s ago 15m 503M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (4m) 11s ago 13m 452M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (3m) 76s ago 15m 45.0M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (3m) 11s ago 13m 41.4M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (5m) 76s ago 14m 19.5M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (5m) 11s ago 13m 22.8M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (2m) 76s ago 13m 99.8M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (116s) 76s ago 12m 100M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:13:40.615 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (81s) 76s ago 11m 10.5M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:13:40.616 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (47s) 11s ago 11m 104M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:13:40.616 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (15s) 11s ago 11m 10.7M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 a23ab54b2270 2024-05-09T00:13:40.616 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (10m) 11s ago 10m 238M 2251M 16.2.15-1-g8963e9de 727f386679cb f2f43adc1b18 2024-05-09T00:13:40.616 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (4m) 11s ago 13m 72.3M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:13:40.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f512806caa0 msgr2=0x7f512806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f512806caa0 0x7f512806ef60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5124004f10 tx=0x7f512400b040).stop 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f7800 msgr2=0x7f513c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f7800 0x7f513c06c9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f512c002820 tx=0x7f512c009f00).stop 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 shutdown_connections 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f512806caa0 0x7f512806ef60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f513c0f7800 0x7f513c06c9d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 --2- 172.21.15.26:0/4010495315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f513c0f8aa0 0x7f513c06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 >> 172.21.15.26:0/4010495315 conn(0x7f513c0f2f80 msgr2=0x7f513c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 shutdown_connections 2024-05-09T00:13:40.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.619+0000 7f514306b700 1 -- 172.21.15.26:0/4010495315 wait complete. 2024-05-09T00:13:40.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:40 smithi026 ceph-mon[93667]: pgmap v142: 65 pgs: 4 active+undersized+degraded, 4 active+undersized, 57 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-05-09T00:13:40.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:40 smithi135 ceph-mon[80466]: pgmap v142: 65 pgs: 4 active+undersized+degraded, 4 active+undersized, 57 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-05-09T00:13:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/4188388692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f5ab0 msgr2=0x7f7eec0f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 --2- 172.21.15.26:0/4188388692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f5ab0 0x7f7eec0f5ed0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f7edc0047f0 tx=0x7f7edc009cb0).stop 2024-05-09T00:13:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/4188388692 shutdown_connections 2024-05-09T00:13:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 --2- 172.21.15.26:0/4188388692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eec0f6450 0x7f7eec0f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 --2- 172.21.15.26:0/4188388692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f5ab0 0x7f7eec0f5ed0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/4188388692 >> 172.21.15.26:0/4188388692 conn(0x7f7eec0f15d0 msgr2=0x7f7eec0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/4188388692 shutdown_connections 2024-05-09T00:13:40.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/4188388692 wait complete. 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 Processor -- start 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.720+0000 7f7ef3e8a700 1 -- start start 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef3e8a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eec0f5ab0 0x7f7eec0f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef3e8a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f6450 0x7f7eec0f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef3e8a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0f7040 con 0x7f7eec0f6450 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef3e8a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0f7180 con 0x7f7eec0f5ab0 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef1425700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f6450 0x7f7eec0f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef1425700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f6450 0x7f7eec0f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60090/0 (socket says 172.21.15.26:60090) 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef1425700 1 -- 172.21.15.26:0/159498989 learned_addr learned my addr 172.21.15.26:0/159498989 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef1425700 1 -- 172.21.15.26:0/159498989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eec0f5ab0 msgr2=0x7f7eec0f8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef1425700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eec0f5ab0 0x7f7eec0f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef1425700 1 -- 172.21.15.26:0/159498989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc005040 con 0x7f7eec0f6450 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef1425700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f6450 0x7f7eec0f6ae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f7ee800c790 tx=0x7f7ee8007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ee2ffd700 1 -- 172.21.15.26:0/159498989 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee80106f0 con 0x7f7eec0f6450 2024-05-09T00:13:40.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec0f7460 con 0x7f7eec0f6450 2024-05-09T00:13:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ee2ffd700 1 -- 172.21.15.26:0/159498989 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ee8010d00 con 0x7f7eec0f6450 2024-05-09T00:13:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ee2ffd700 1 -- 172.21.15.26:0/159498989 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee8012cf0 con 0x7f7eec0f6450 2024-05-09T00:13:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.721+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec110000 con 0x7f7eec0f6450 2024-05-09T00:13:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.723+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec046ce0 con 0x7f7eec0f6450 2024-05-09T00:13:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.723+0000 7f7ee2ffd700 1 -- 172.21.15.26:0/159498989 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7ee8012400 con 0x7f7eec0f6450 2024-05-09T00:13:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.723+0000 7f7ee2ffd700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7ed806caf0 0x7f7ed806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.724+0000 7f7ee2ffd700 1 -- 172.21.15.26:0/159498989 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f7ee808b6c0 con 0x7f7eec0f6450 2024-05-09T00:13:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.724+0000 7f7ef1c26700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7ed806caf0 0x7f7ed806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:40.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.724+0000 7f7ef1c26700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7ed806caf0 0x7f7ed806efb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7edc013620 tx=0x7f7edc009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:40.728+0000 7f7ee2ffd700 1 -- 172.21.15.26:0/159498989 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f7ee8055720 con 0x7f7eec0f6450 2024-05-09T00:13:41.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.008+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7eec101fc0 con 0x7f7eec0f6450 2024-05-09T00:13:41.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.008+0000 7f7ee2ffd700 1 -- 172.21.15.26:0/159498989 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7f7ee8058d40 con 0x7f7eec0f6450 2024-05-09T00:13:41.006 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:13:41.006 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:13:41.006 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:13:41.006 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 5 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 5, 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 9 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:13:41.007 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:13:41.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.010+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7ed806caf0 msgr2=0x7f7ed806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.010+0000 7f7ef3e8a700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7ed806caf0 0x7f7ed806efb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7edc013620 tx=0x7f7edc009cb0).stop 2024-05-09T00:13:41.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.010+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f6450 msgr2=0x7f7eec0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.010+0000 7f7ef3e8a700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f6450 0x7f7eec0f6ae0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f7ee800c790 tx=0x7f7ee8007f70).stop 2024-05-09T00:13:41.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.011+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 shutdown_connections 2024-05-09T00:13:41.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.011+0000 7f7ef3e8a700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7ed806caf0 0x7f7ed806efb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.011+0000 7f7ef3e8a700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7eec0f5ab0 0x7f7eec0f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:13:41.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.011+0000 7f7ef3e8a700 1 --2- 172.21.15.26:0/159498989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7eec0f6450 0x7f7eec0f6ae0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.011+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 >> 172.21.15.26:0/159498989 conn(0x7f7eec0f15d0 msgr2=0x7f7eec0fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:41.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.011+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 shutdown_connections 2024-05-09T00:13:41.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.011+0000 7f7ef3e8a700 1 -- 172.21.15.26:0/159498989 wait complete. 2024-05-09T00:13:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.112+0000 7faaee4f9700 1 -- 172.21.15.26:0/1262305968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 msgr2=0x7faae80f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.112+0000 7faaee4f9700 1 --2- 172.21.15.26:0/1262305968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 0x7faae80f7df0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7faadc0047f0 tx=0x7faadc009cb0).stop 2024-05-09T00:13:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.112+0000 7faaee4f9700 1 -- 172.21.15.26:0/1262305968 shutdown_connections 2024-05-09T00:13:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.112+0000 7faaee4f9700 1 --2- 172.21.15.26:0/1262305968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 0x7faae80f7df0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.112+0000 7faaee4f9700 1 --2- 172.21.15.26:0/1262305968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faae80f66f0 0x7faae80f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.112+0000 7faaee4f9700 1 -- 172.21.15.26:0/1262305968 >> 172.21.15.26:0/1262305968 conn(0x7faae80f1e50 msgr2=0x7faae80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.112+0000 7faaee4f9700 1 -- 172.21.15.26:0/1262305968 shutdown_connections 2024-05-09T00:13:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.112+0000 7faaee4f9700 1 -- 172.21.15.26:0/1262305968 wait complete. 2024-05-09T00:13:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faaee4f9700 1 Processor -- start 2024-05-09T00:13:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faaee4f9700 1 -- start start 2024-05-09T00:13:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faaee4f9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faae80f66f0 0x7faae8061060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faaee4f9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 0x7faae810ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faaee4f9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae810d360 con 0x7faae80f7990 2024-05-09T00:13:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faaee4f9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae810d4a0 con 0x7faae80f66f0 2024-05-09T00:13:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faae77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 0x7faae810ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faae77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 0x7faae810ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60100/0 (socket says 172.21.15.26:60100) 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faae77fe700 1 -- 172.21.15.26:0/3583466361 learned_addr learned my addr 172.21.15.26:0/3583466361 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faae7fff700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faae80f66f0 0x7faae8061060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.113+0000 7faae77fe700 1 -- 172.21.15.26:0/3583466361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faae80f66f0 msgr2=0x7faae8061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.114+0000 7faae77fe700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faae80f66f0 0x7faae8061060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.114+0000 7faae77fe700 1 -- 172.21.15.26:0/3583466361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc005040 con 0x7faae80f7990 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.114+0000 7faae77fe700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 0x7faae810ce70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7faadc000c00 tx=0x7faadc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.114+0000 7faae57fa700 1 -- 172.21.15.26:0/3583466361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faadc018070 con 0x7faae80f7990 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.114+0000 7faae57fa700 1 -- 172.21.15.26:0/3583466361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faadc007e90 con 0x7faae80f7990 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.114+0000 7faae57fa700 1 -- 172.21.15.26:0/3583466361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faadc01c380 con 0x7faae80f7990 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.114+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae810d6a0 con 0x7faae80f7990 2024-05-09T00:13:41.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.114+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae810dc00 con 0x7faae80f7990 2024-05-09T00:13:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.115+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae80feed0 con 0x7faae80f7990 2024-05-09T00:13:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.115+0000 7faae57fa700 1 -- 172.21.15.26:0/3583466361 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faadc0123c0 con 0x7faae80f7990 2024-05-09T00:13:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.116+0000 7faae57fa700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faad006caa0 0x7faad006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.116+0000 7faae57fa700 1 -- 172.21.15.26:0/3583466361 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6133+0+0 (secure 0 0 0) 0x7faadc08cae0 con 0x7faae80f7990 2024-05-09T00:13:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.116+0000 7faae7fff700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faad006caa0 0x7faad006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.116+0000 7faae7fff700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faad006caa0 0x7faad006ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7faae80f77f0 tx=0x7faad800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.120+0000 7faae57fa700 1 -- 172.21.15.26:0/3583466361 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7faadc05a750 con 0x7faae80f7990 2024-05-09T00:13:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.366+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faae80598f0 con 0x7faae80f7990 2024-05-09T00:13:41.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.367+0000 7faae57fa700 1 -- 172.21.15.26:0/3583466361 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1848 (secure 0 0 0) 0x7faadc05a2e0 con 0x7faae80f7990 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:e11 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 11 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:04:47.763524+0000 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:13:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14434} 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:13:41.366 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:14434} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.26:6826/3998166556,v1:172.21.15.26:6827/3998166556] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:14448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:13:41.367 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:13:41.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faad006caa0 msgr2=0x7faad006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faad006caa0 0x7faad006ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7faae80f77f0 tx=0x7faad800b040).stop 2024-05-09T00:13:41.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 msgr2=0x7faae810ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 0x7faae810ce70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7faadc000c00 tx=0x7faadc009cb0).stop 2024-05-09T00:13:41.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 shutdown_connections 2024-05-09T00:13:41.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7faad006caa0 0x7faad006ef60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faae80f66f0 0x7faae8061060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 --2- 172.21.15.26:0/3583466361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faae80f7990 0x7faae810ce70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 >> 172.21.15.26:0/3583466361 conn(0x7faae80f1e50 msgr2=0x7faae80fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:41.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 shutdown_connections 2024-05-09T00:13:41.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.369+0000 7faaee4f9700 1 -- 172.21.15.26:0/3583466361 wait complete. 2024-05-09T00:13:41.369 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.471+0000 7f8b52e36700 1 -- 172.21.15.26:0/55969699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f8aa0 msgr2=0x7f8b4c0f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.471+0000 7f8b52e36700 1 --2- 172.21.15.26:0/55969699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f8aa0 0x7f8b4c0f8f00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f8b380047f0 tx=0x7f8b38009cb0).stop 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.472+0000 7f8b52e36700 1 -- 172.21.15.26:0/55969699 shutdown_connections 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.472+0000 7f8b52e36700 1 --2- 172.21.15.26:0/55969699 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f8aa0 0x7f8b4c0f8f00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.472+0000 7f8b52e36700 1 --2- 172.21.15.26:0/55969699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b4c0f7800 0x7f8b4c0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.472+0000 7f8b52e36700 1 -- 172.21.15.26:0/55969699 >> 172.21.15.26:0/55969699 conn(0x7f8b4c0f2f80 msgr2=0x7f8b4c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.472+0000 7f8b52e36700 1 -- 172.21.15.26:0/55969699 shutdown_connections 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.472+0000 7f8b52e36700 1 -- 172.21.15.26:0/55969699 wait complete. 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.472+0000 7f8b52e36700 1 Processor -- start 2024-05-09T00:13:41.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.472+0000 7f8b52e36700 1 -- start start 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b52e36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f7800 0x7f8b4c107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b52e36700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b4c0f8aa0 0x7f8b4c108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b52e36700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c108a00 con 0x7f8b4c0f7800 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b52e36700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c108b40 con 0x7f8b4c0f8aa0 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b50bd2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f7800 0x7f8b4c107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b50bd2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f7800 0x7f8b4c107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50916/0 (socket says 172.21.15.26:50916) 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b50bd2700 1 -- 172.21.15.26:0/4106895184 learned_addr learned my addr 172.21.15.26:0/4106895184 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b4bfff700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b4c0f8aa0 0x7f8b4c108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b50bd2700 1 -- 172.21.15.26:0/4106895184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b4c0f8aa0 msgr2=0x7f8b4c108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b50bd2700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b4c0f8aa0 0x7f8b4c108450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b50bd2700 1 -- 172.21.15.26:0/4106895184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38005040 con 0x7f8b4c0f7800 2024-05-09T00:13:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b50bd2700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f7800 0x7f8b4c107f60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8b4000c790 tx=0x7f8b40007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b49ffb700 1 -- 172.21.15.26:0/4106895184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b400106f0 con 0x7f8b4c0f7800 2024-05-09T00:13:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b49ffb700 1 -- 172.21.15.26:0/4106895184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b40010d00 con 0x7f8b4c0f7800 2024-05-09T00:13:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c10d5e0 con 0x7f8b4c0f7800 2024-05-09T00:13:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.473+0000 7f8b49ffb700 1 -- 172.21.15.26:0/4106895184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b40012e30 con 0x7f8b4c0f7800 2024-05-09T00:13:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.474+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c10dba0 con 0x7f8b4c0f7800 2024-05-09T00:13:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.475+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c0fffc0 con 0x7f8b4c0f7800 2024-05-09T00:13:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.475+0000 7f8b49ffb700 1 -- 172.21.15.26:0/4106895184 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8b40012400 con 0x7f8b4c0f7800 2024-05-09T00:13:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.475+0000 7f8b49ffb700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8b3c06ca40 0x7f8b3c06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.476+0000 7f8b49ffb700 1 -- 172.21.15.26:0/4106895184 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8b4008bd90 con 0x7f8b4c0f7800 2024-05-09T00:13:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.476+0000 7f8b4bfff700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8b3c06ca40 0x7f8b3c06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.476+0000 7f8b4bfff700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8b3c06ca40 0x7f8b3c06ef00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f8b380043d0 tx=0x7f8b38009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.480+0000 7f8b49ffb700 1 -- 172.21.15.26:0/4106895184 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f8b40059940 con 0x7f8b4c0f7800 2024-05-09T00:13:41.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:41 smithi026 ceph-mon[93667]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:41.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:41 smithi026 ceph-mon[93667]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:41.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:41 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/159498989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:41.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:41 smithi135 ceph-mon[80466]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:41.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:41 smithi135 ceph-mon[80466]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:41.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:41 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/159498989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:13:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.701+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b4c059120 con 0x7f8b3c06ca40 2024-05-09T00:13:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.702+0000 7f8b49ffb700 1 -- 172.21.15.26:0/4106895184 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8b4c059120 con 0x7f8b3c06ca40 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "11/21 daemons upgraded", 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:13:41.700 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8b3c06ca40 msgr2=0x7f8b3c06ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8b3c06ca40 0x7f8b3c06ef00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f8b380043d0 tx=0x7f8b38009cb0).stop 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f7800 msgr2=0x7f8b4c107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f7800 0x7f8b4c107f60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8b4000c790 tx=0x7f8b40007f90).stop 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 shutdown_connections 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8b3c06ca40 0x7f8b3c06ef00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b4c0f7800 0x7f8b4c107f60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 --2- 172.21.15.26:0/4106895184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b4c0f8aa0 0x7f8b4c108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 >> 172.21.15.26:0/4106895184 conn(0x7f8b4c0f2f80 msgr2=0x7f8b4c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 shutdown_connections 2024-05-09T00:13:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.704+0000 7f8b52e36700 1 -- 172.21.15.26:0/4106895184 wait complete. 2024-05-09T00:13:41.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.805+0000 7f029643e700 1 -- 172.21.15.26:0/2832350519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0290061220 msgr2=0x7f02900fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.805+0000 7f029643e700 1 --2- 172.21.15.26:0/2832350519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0290061220 0x7f02900fa430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f02800047f0 tx=0x7f0280009cb0).stop 2024-05-09T00:13:41.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.805+0000 7f029643e700 1 -- 172.21.15.26:0/2832350519 shutdown_connections 2024-05-09T00:13:41.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.805+0000 7f029643e700 1 --2- 172.21.15.26:0/2832350519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02900fa9b0 0x7f02900fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.805+0000 7f029643e700 1 --2- 172.21.15.26:0/2832350519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0290061220 0x7f02900fa430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.805+0000 7f029643e700 1 -- 172.21.15.26:0/2832350519 >> 172.21.15.26:0/2832350519 conn(0x7f02900f1e50 msgr2=0x7f02900f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:41.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.805+0000 7f029643e700 1 -- 172.21.15.26:0/2832350519 shutdown_connections 2024-05-09T00:13:41.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.805+0000 7f029643e700 1 -- 172.21.15.26:0/2832350519 wait complete. 2024-05-09T00:13:41.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.806+0000 7f029643e700 1 Processor -- start 2024-05-09T00:13:41.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.806+0000 7f029643e700 1 -- start start 2024-05-09T00:13:41.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f029643e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0290061220 0x7f0290107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f029643e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02900fa9b0 0x7f0290108480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f029643e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0290108a30 con 0x7f02900fa9b0 2024-05-09T00:13:41.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f029643e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0290108b70 con 0x7f0290061220 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02900fa9b0 0x7f0290108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02900fa9b0 0x7f0290108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50942/0 (socket says 172.21.15.26:50942) 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028f7fe700 1 -- 172.21.15.26:0/122763832 learned_addr learned my addr 172.21.15.26:0/122763832 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028ffff700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0290061220 0x7f0290107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028f7fe700 1 -- 172.21.15.26:0/122763832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0290061220 msgr2=0x7f0290107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028f7fe700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0290061220 0x7f0290107f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028f7fe700 1 -- 172.21.15.26:0/122763832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280005040 con 0x7f02900fa9b0 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028f7fe700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02900fa9b0 0x7f0290108480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f0284002820 tx=0x7f0284009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.807+0000 7f028d7fa700 1 -- 172.21.15.26:0/122763832 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0284007b40 con 0x7f02900fa9b0 2024-05-09T00:13:41.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.808+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029010d610 con 0x7f02900fa9b0 2024-05-09T00:13:41.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.808+0000 7f028d7fa700 1 -- 172.21.15.26:0/122763832 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f028400f040 con 0x7f02900fa9b0 2024-05-09T00:13:41.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.808+0000 7f028d7fa700 1 -- 172.21.15.26:0/122763832 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02840148b0 con 0x7f02900fa9b0 2024-05-09T00:13:41.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.808+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029010dbd0 con 0x7f02900fa9b0 2024-05-09T00:13:41.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.809+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0290100000 con 0x7f02900fa9b0 2024-05-09T00:13:41.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.809+0000 7f028d7fa700 1 -- 172.21.15.26:0/122763832 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0284007ca0 con 0x7f02900fa9b0 2024-05-09T00:13:41.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.809+0000 7f028d7fa700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f027806cab0 0x7f027806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:13:41.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.810+0000 7f028d7fa700 1 -- 172.21.15.26:0/122763832 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f028408b840 con 0x7f02900fa9b0 2024-05-09T00:13:41.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.810+0000 7f028ffff700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f027806cab0 0x7f027806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:41.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.810+0000 7f028ffff700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f027806cab0 0x7f027806ef70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0280004f10 tx=0x7f0280009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:41.814+0000 7f028d7fa700 1 -- 172.21.15.26:0/122763832 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f02840593f0 con 0x7f02900fa9b0 2024-05-09T00:13:42.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.095+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0290101e70 con 0x7f02900fa9b0 2024-05-09T00:13:42.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.095+0000 7f028d7fa700 1 -- 172.21.15.26:0/122763832 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0284058f80 con 0x7f02900fa9b0 2024-05-09T00:13:42.093 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:13:42.093 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:13:42.093 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:13:42.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f027806cab0 msgr2=0x7f027806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f027806cab0 0x7f027806ef70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0280004f10 tx=0x7f0280009cb0).stop 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02900fa9b0 msgr2=0x7f0290108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02900fa9b0 0x7f0290108480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f0284002820 tx=0x7f0284009f20).stop 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 shutdown_connections 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f027806cab0 0x7f027806ef70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0290061220 0x7f0290107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 --2- 172.21.15.26:0/122763832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02900fa9b0 0x7f0290108480 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 >> 172.21.15.26:0/122763832 conn(0x7f02900f1e50 msgr2=0x7f02900f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 shutdown_connections 2024-05-09T00:13:42.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:13:42.097+0000 7f029643e700 1 -- 172.21.15.26:0/122763832 wait complete. 2024-05-09T00:13:42.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:42 smithi026 ceph-mon[93667]: pgmap v143: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:42.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:42 smithi026 ceph-mon[93667]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:42.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:42 smithi026 ceph-mon[93667]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 4 pgs degraded) 2024-05-09T00:13:42.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:42 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3583466361' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:13:42.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:42 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/122763832' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:13:42.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:42 smithi135 ceph-mon[80466]: pgmap v143: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:42 smithi135 ceph-mon[80466]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:42 smithi135 ceph-mon[80466]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 4 pgs degraded) 2024-05-09T00:13:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:42 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3583466361' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:13:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:42 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/122763832' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:13:43.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:43 smithi026 ceph-mon[93667]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:43.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:43 smithi135 ceph-mon[80466]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:13:44.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:44 smithi026 ceph-mon[93667]: pgmap v144: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:44.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:44 smithi135 ceph-mon[80466]: pgmap v144: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:46.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:46 smithi026 ceph-mon[93667]: pgmap v145: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:46.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:46.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:46 smithi135 ceph-mon[80466]: pgmap v145: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:46.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:48.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:48 smithi026 ceph-mon[93667]: pgmap v146: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:48.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:48 smithi135 ceph-mon[80466]: pgmap v146: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:49.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:49 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T00:13:49.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:49 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T00:13:49.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:49 smithi135 ceph-mon[80466]: Upgrade: osd.5 is safe to restart 2024-05-09T00:13:49.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:49 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T00:13:49.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:49 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T00:13:49.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:49 smithi026 ceph-mon[93667]: Upgrade: osd.5 is safe to restart 2024-05-09T00:13:50.618 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:50 smithi135 ceph-mon[80466]: pgmap v147: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:50.618 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:50.618 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:13:50.618 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:50.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:50 smithi026 ceph-mon[93667]: pgmap v147: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:50.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:50.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:13:50.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:51.588 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:51 smithi135 ceph-mon[80466]: Upgrade: Updating osd.5 2024-05-09T00:13:51.588 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:51 smithi135 ceph-mon[80466]: Deploying daemon osd.5 on smithi135 2024-05-09T00:13:51.588 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:51.588 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:13:51.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:51 smithi026 ceph-mon[93667]: Upgrade: Updating osd.5 2024-05-09T00:13:51.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:51 smithi026 ceph-mon[93667]: Deploying daemon osd.5 on smithi135 2024-05-09T00:13:51.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:51.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:13:52.491 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:52 smithi135 ceph-mon[80466]: pgmap v148: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:52.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:52 smithi026 ceph-mon[93667]: pgmap v148: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:53.150 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:52 smithi135 systemd[1]: Stopping Ceph osd.5 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:13:53.150 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[59897]: debug 2024-05-09T00:13:53.003+0000 7fbf2655c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-05-09T00:13:53.150 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[59897]: debug 2024-05-09T00:13:53.003+0000 7fbf2655c700 -1 osd.5 74 *** Got signal Terminated *** 2024-05-09T00:13:53.151 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:53 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[59897]: debug 2024-05-09T00:13:53.003+0000 7fbf2655c700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:13:53.557 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:53 smithi135 ceph-mon[80466]: osd.5 marked itself down and dead 2024-05-09T00:13:53.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:53 smithi026 ceph-mon[93667]: osd.5 marked itself down and dead 2024-05-09T00:13:53.900 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:53 smithi135 bash[95107]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5 2024-05-09T00:13:54.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:54 smithi026 ceph-mon[93667]: pgmap v149: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:54 smithi026 ceph-mon[93667]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:13:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:54 smithi026 ceph-mon[93667]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2024-05-09T00:13:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:54 smithi026 ceph-mon[93667]: osdmap e75: 6 total, 5 up, 6 in 2024-05-09T00:13:54.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:54 smithi135 ceph-mon[80466]: pgmap v149: 65 pgs: 65 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:54.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:54 smithi135 ceph-mon[80466]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T00:13:54.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:54 smithi135 ceph-mon[80466]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2024-05-09T00:13:54.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:54 smithi135 ceph-mon[80466]: osdmap e75: 6 total, 5 up, 6 in 2024-05-09T00:13:55.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:55 smithi135 ceph-mon[80466]: osdmap e76: 6 total, 5 up, 6 in 2024-05-09T00:13:55.400 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:55 smithi135 systemd[1]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.5.service: Succeeded. 2024-05-09T00:13:55.401 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:55 smithi135 systemd[1]: Stopped Ceph osd.5 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:13:55.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:55 smithi026 ceph-mon[93667]: osdmap e76: 6 total, 5 up, 6 in 2024-05-09T00:13:55.724 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:55 smithi135 systemd[1]: Starting Ceph osd.5 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:13:56.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:56 smithi026 ceph-mon[93667]: pgmap v152: 65 pgs: 8 peering, 9 stale+active+clean, 48 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:56.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:56 smithi026 ceph-mon[93667]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-05-09T00:13:56.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:56 smithi135 ceph-mon[80466]: pgmap v152: 65 pgs: 8 peering, 9 stale+active+clean, 48 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:56.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:56 smithi135 ceph-mon[80466]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-05-09T00:13:56.650 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:56 smithi135 bash[95382]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T00:13:56.650 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:56 smithi135 bash[95382]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T00:13:56.650 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:56 smithi135 bash[95382]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T00:13:56.650 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:56 smithi135 bash[95382]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T00:13:56.650 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:56 smithi135 bash[95382]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-05-09T00:13:56.650 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:56 smithi135 bash[95382]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T00:13:56.650 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:56 smithi135 bash[95382]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-09T00:13:57.497 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:57 smithi135 ceph-osd[95677]: -- 172.21.15.135:0/2211990777 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5605094f51e0 con 0x5605094c5000 2024-05-09T00:13:57.497 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:57 smithi135 bash[95639]: df906a6613b1e9ba6f69f0f5a32548f9c12b8429fda3899e4d08fef1b68348c8 2024-05-09T00:13:57.900 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:57 smithi135 systemd[1]: Started Ceph osd.5 for aa42787e-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:13:58.255 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:13:57 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:13:57.935+0000 7fc3ac5907c0 -1 Falling back to public interface 2024-05-09T00:13:58.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:58 smithi026 ceph-mon[93667]: pgmap v153: 65 pgs: 8 peering, 9 stale+active+clean, 48 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:58.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:58 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:58.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:58 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:58.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:58 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:58.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:58 smithi135 ceph-mon[80466]: pgmap v153: 65 pgs: 8 peering, 9 stale+active+clean, 48 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T00:13:58.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:58 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:58.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:58 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:13:58.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:58 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:59.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:13:59 smithi026 ceph-mon[93667]: Health check failed: Degraded data redundancy: 25/219 objects degraded (11.416%), 8 pgs degraded (PG_DEGRADED) 2024-05-09T00:13:59.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:13:59 smithi135 ceph-mon[80466]: Health check failed: Degraded data redundancy: 25/219 objects degraded (11.416%), 8 pgs degraded (PG_DEGRADED) 2024-05-09T00:14:00.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:00 smithi026 ceph-mon[93667]: pgmap v154: 65 pgs: 8 active+undersized+degraded, 8 peering, 12 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25/219 objects degraded (11.416%) 2024-05-09T00:14:00.649 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:00 smithi135 ceph-mon[80466]: pgmap v154: 65 pgs: 8 active+undersized+degraded, 8 peering, 12 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25/219 objects degraded (11.416%) 2024-05-09T00:14:02.326 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:02 smithi135 ceph-mon[80466]: pgmap v155: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T00:14:02.326 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:02 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:02.326 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:02 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:02.326 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:02 smithi135 ceph-mon[80466]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-05-09T00:14:02.326 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:02 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:02.326 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:02 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:02.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:02 smithi026 ceph-mon[93667]: pgmap v155: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T00:14:02.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:02 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:02.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:02 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:02.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:02 smithi026 ceph-mon[93667]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-05-09T00:14:02.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:02 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:02.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:02 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:03.295 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:14:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:14:03.145+0000 7fc3ac5907c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-05-09T00:14:03.900 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:14:03 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:14:03.647+0000 7fc3ac5907c0 -1 osd.5 74 log_to_monitors true 2024-05-09T00:14:04.330 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:14:04 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:14:04.027+0000 7fc39d9e9700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:14:04.330 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:04 smithi135 ceph-mon[80466]: pgmap v156: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T00:14:04.331 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:04 smithi135 ceph-mon[80466]: from='osd.5 [v2:172.21.15.135:6816/3179802514,v1:172.21.15.135:6817/3179802514]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:14:04.331 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:04 smithi135 ceph-mon[80466]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:14:04.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:04 smithi026 ceph-mon[93667]: pgmap v156: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 196 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T00:14:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:04 smithi026 ceph-mon[93667]: from='osd.5 [v2:172.21.15.135:6816/3179802514,v1:172.21.15.135:6817/3179802514]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:14:04.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:04 smithi026 ceph-mon[93667]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: osdmap e77: 6 total, 5 up, 6 in 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: from='osd.5 [v2:172.21.15.135:6816/3179802514,v1:172.21.15.135:6817/3179802514]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:05.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:05 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:05.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T00:14:05.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: osdmap e77: 6 total, 5 up, 6 in 2024-05-09T00:14:05.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: from='osd.5 [v2:172.21.15.135:6816/3179802514,v1:172.21.15.135:6817/3179802514]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:14:05.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-05-09T00:14:05.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:05.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:05.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:05.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:05.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:05 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:06.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: pgmap v158: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 196 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T00:14:06.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:14:06.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: osd.5 [v2:172.21.15.135:6816/3179802514,v1:172.21.15.135:6817/3179802514] boot 2024-05-09T00:14:06.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: osdmap e78: 6 total, 6 up, 6 in 2024-05-09T00:14:06.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:14:06.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all osd 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-09T00:14:06.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: Upgrade: Setting require_osd_release to 18 reef 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:14:06.400 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:06.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2024-05-09T00:14:06.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-05-09T00:14:06.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: osdmap e79: 6 total, 6 up, 6 in 2024-05-09T00:14:06.401 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.nhrcgk"]}]: dispatch 2024-05-09T00:14:06.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: pgmap v158: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 196 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: osd.5 [v2:172.21.15.135:6816/3179802514,v1:172.21.15.135:6817/3179802514] boot 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: osdmap e78: 6 total, 6 up, 6 in 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:06.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all osd 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-09T00:14:06.403 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: Upgrade: Setting require_osd_release to 18 reef 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: osdmap e79: 6 total, 6 up, 6 in 2024-05-09T00:14:06.404 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.nhrcgk"]}]: dispatch 2024-05-09T00:14:07.262 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:07 smithi026 ceph-mon[93667]: Upgrade: It appears safe to stop mds.cephfs.smithi026.nhrcgk 2024-05-09T00:14:07.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:07 smithi135 ceph-mon[80466]: Upgrade: It appears safe to stop mds.cephfs.smithi026.nhrcgk 2024-05-09T00:14:08.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:08 smithi026 ceph-mon[93667]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 196 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T00:14:08.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:08 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:08.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:08 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.nhrcgk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:14:08.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:08 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:08.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:08 smithi135 ceph-mon[80466]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 196 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T00:14:08.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:08 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:08.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:08 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.nhrcgk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:14:08.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:08 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:09.292 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:09 smithi026 ceph-mon[93667]: Upgrade: Updating mds.cephfs.smithi026.nhrcgk 2024-05-09T00:14:09.292 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:09 smithi026 ceph-mon[93667]: Deploying daemon mds.cephfs.smithi026.nhrcgk on smithi026 2024-05-09T00:14:09.293 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:09 smithi026 ceph-mon[93667]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 12 pgs degraded (PG_DEGRADED) 2024-05-09T00:14:09.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:09 smithi135 ceph-mon[80466]: Upgrade: Updating mds.cephfs.smithi026.nhrcgk 2024-05-09T00:14:09.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:09 smithi135 ceph-mon[80466]: Deploying daemon mds.cephfs.smithi026.nhrcgk on smithi026 2024-05-09T00:14:09.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:09 smithi135 ceph-mon[80466]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 12 pgs degraded (PG_DEGRADED) 2024-05-09T00:14:10.046 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:09 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[93644]: 2024-05-09T00:14:09.740+0000 7fe4684f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:10.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:10 smithi026 ceph-mon[93667]: pgmap v162: 65 pgs: 6 active+undersized+degraded, 11 active+undersized, 48 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-05-09T00:14:10.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:10 smithi026 ceph-mon[93667]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:14:10.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:10 smithi026 ceph-mon[93667]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:10.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:10 smithi026 ceph-mon[93667]: osdmap e80: 6 total, 6 up, 6 in 2024-05-09T00:14:10.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:10 smithi026 ceph-mon[93667]: Standby daemon mds.cephfs.smithi026.gbyppy assigned to filesystem cephfs as rank 0 2024-05-09T00:14:10.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:10 smithi026 ceph-mon[93667]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:14:10.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:10 smithi026 ceph-mon[93667]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T00:14:10.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:10 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi026.gbyppy=up:replay} 2 up:standby 2024-05-09T00:14:10.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:10 smithi135 ceph-mon[80466]: pgmap v162: 65 pgs: 6 active+undersized+degraded, 11 active+undersized, 48 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-05-09T00:14:10.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:10 smithi135 ceph-mon[80466]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:14:10.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:10 smithi135 ceph-mon[80466]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:10.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:10 smithi135 ceph-mon[80466]: osdmap e80: 6 total, 6 up, 6 in 2024-05-09T00:14:10.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:10 smithi135 ceph-mon[80466]: Standby daemon mds.cephfs.smithi026.gbyppy assigned to filesystem cephfs as rank 0 2024-05-09T00:14:10.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:10 smithi135 ceph-mon[80466]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:14:10.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:10 smithi135 ceph-mon[80466]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T00:14:10.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:10 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi026.gbyppy=up:replay} 2 up:standby 2024-05-09T00:14:11.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:11 smithi026 ceph-mon[93667]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/219 objects degraded (5.936%), 6 pgs degraded) 2024-05-09T00:14:11.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:11 smithi135 ceph-mon[80466]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/219 objects degraded (5.936%), 6 pgs degraded) 2024-05-09T00:14:12.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.203+0000 7f1b6249b700 1 -- 172.21.15.26:0/832090671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f66f0 msgr2=0x7f1b5c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.203+0000 7f1b6249b700 1 --2- 172.21.15.26:0/832090671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f66f0 0x7f1b5c0f6b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f1b4c0047f0 tx=0x7f1b4c009cb0).stop 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.203+0000 7f1b6249b700 1 -- 172.21.15.26:0/832090671 shutdown_connections 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.203+0000 7f1b6249b700 1 --2- 172.21.15.26:0/832090671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0f7990 0x7f1b5c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.203+0000 7f1b6249b700 1 --2- 172.21.15.26:0/832090671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f66f0 0x7f1b5c0f6b10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.203+0000 7f1b6249b700 1 -- 172.21.15.26:0/832090671 >> 172.21.15.26:0/832090671 conn(0x7f1b5c0f1e50 msgr2=0x7f1b5c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.203+0000 7f1b6249b700 1 -- 172.21.15.26:0/832090671 shutdown_connections 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.203+0000 7f1b6249b700 1 -- 172.21.15.26:0/832090671 wait complete. 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b6249b700 1 Processor -- start 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b6249b700 1 -- start start 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b6249b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0f66f0 0x7f1b5c0fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b6249b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f7990 0x7f1b5c0f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b6249b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0fac20 con 0x7f1b5c0f7990 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b6249b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0f91c0 con 0x7f1b5c0f66f0 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b5b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f7990 0x7f1b5c0f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b5b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f7990 0x7f1b5c0f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51504/0 (socket says 172.21.15.26:51504) 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.204+0000 7f1b5b7fe700 1 -- 172.21.15.26:0/2100157151 learned_addr learned my addr 172.21.15.26:0/2100157151 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b5bfff700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0f66f0 0x7f1b5c0fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b5b7fe700 1 -- 172.21.15.26:0/2100157151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0f66f0 msgr2=0x7f1b5c0fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b5b7fe700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0f66f0 0x7f1b5c0fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b5b7fe700 1 -- 172.21.15.26:0/2100157151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c005040 con 0x7f1b5c0f7990 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b5b7fe700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f7990 0x7f1b5c0f8cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f1b500041d0 tx=0x7f1b50009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:12.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b597fa700 1 -- 172.21.15.26:0/2100157151 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b50002d90 con 0x7f1b5c0f7990 2024-05-09T00:14:12.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b597fa700 1 -- 172.21.15.26:0/2100157151 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b5000f040 con 0x7f1b5c0f7990 2024-05-09T00:14:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5c0f9440 con 0x7f1b5c0f7990 2024-05-09T00:14:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b597fa700 1 -- 172.21.15.26:0/2100157151 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b5000d800 con 0x7f1b5c0f7990 2024-05-09T00:14:12.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.205+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c0f9a00 con 0x7f1b5c0f7990 2024-05-09T00:14:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.206+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5c0feeb0 con 0x7f1b5c0f7990 2024-05-09T00:14:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.207+0000 7f1b597fa700 1 -- 172.21.15.26:0/2100157151 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1b50007b40 con 0x7f1b5c0f7990 2024-05-09T00:14:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.208+0000 7f1b597fa700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406caa0 0x7f1b4406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.208+0000 7f1b597fa700 1 -- 172.21.15.26:0/2100157151 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1b5008c010 con 0x7f1b5c0f7990 2024-05-09T00:14:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.208+0000 7f1b5bfff700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406caa0 0x7f1b4406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.208+0000 7f1b5bfff700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406caa0 0x7f1b4406ef60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1b4c004f10 tx=0x7f1b4c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:12.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.216+0000 7f1b597fa700 1 -- 172.21.15.26:0/2100157151 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f1b50059bf0 con 0x7f1b5c0f7990 2024-05-09T00:14:12.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:12 smithi026 ceph-mon[93667]: pgmap v164: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:14:12.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:12 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:14:12.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:12 smithi135 ceph-mon[80466]: pgmap v164: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:14:12.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:12 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:14:12.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.435+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b5c0fbdd0 con 0x7f1b4406caa0 2024-05-09T00:14:12.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.437+0000 7f1b597fa700 1 -- 172.21.15.26:0/2100157151 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1b5c0fbdd0 con 0x7f1b4406caa0 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406caa0 msgr2=0x7f1b4406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406caa0 0x7f1b4406ef60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1b4c004f10 tx=0x7f1b4c00b040).stop 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f7990 msgr2=0x7f1b5c0f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f7990 0x7f1b5c0f8cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f1b500041d0 tx=0x7f1b50009f60).stop 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 shutdown_connections 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1b4406caa0 0x7f1b4406ef60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0f66f0 0x7f1b5c0fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 --2- 172.21.15.26:0/2100157151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b5c0f7990 0x7f1b5c0f8cd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 >> 172.21.15.26:0/2100157151 conn(0x7f1b5c0f1e50 msgr2=0x7f1b5c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 shutdown_connections 2024-05-09T00:14:12.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.439+0000 7f1b6249b700 1 -- 172.21.15.26:0/2100157151 wait complete. 2024-05-09T00:14:12.448 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.543+0000 7f8f946eb700 1 -- 172.21.15.26:0/3987315364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 msgr2=0x7f8f8c0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.543+0000 7f8f946eb700 1 --2- 172.21.15.26:0/3987315364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 0x7f8f8c0fcda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f8f7c0047f0 tx=0x7f8f7c009cb0).stop 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.543+0000 7f8f946eb700 1 -- 172.21.15.26:0/3987315364 shutdown_connections 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.543+0000 7f8f946eb700 1 --2- 172.21.15.26:0/3987315364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 0x7f8f8c0fcda0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.543+0000 7f8f946eb700 1 --2- 172.21.15.26:0/3987315364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f8c061280 0x7f8f8c0fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.543+0000 7f8f946eb700 1 -- 172.21.15.26:0/3987315364 >> 172.21.15.26:0/3987315364 conn(0x7f8f8c0f1e50 msgr2=0x7f8f8c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.543+0000 7f8f946eb700 1 -- 172.21.15.26:0/3987315364 shutdown_connections 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.543+0000 7f8f946eb700 1 -- 172.21.15.26:0/3987315364 wait complete. 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f946eb700 1 Processor -- start 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f946eb700 1 -- start start 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f946eb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f8c061280 0x7f8f8c0f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f946eb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 0x7f8f8c0f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f946eb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0f67c0 con 0x7f8f8c0fa950 2024-05-09T00:14:12.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f946eb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0f6900 con 0x7f8f8c061280 2024-05-09T00:14:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f91c86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 0x7f8f8c0f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f91c86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 0x7f8f8c0f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51532/0 (socket says 172.21.15.26:51532) 2024-05-09T00:14:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.544+0000 7f8f91c86700 1 -- 172.21.15.26:0/566041505 learned_addr learned my addr 172.21.15.26:0/566041505 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f92487700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f8c061280 0x7f8f8c0f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f91c86700 1 -- 172.21.15.26:0/566041505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f8c061280 msgr2=0x7f8f8c0f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f91c86700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f8c061280 0x7f8f8c0f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f91c86700 1 -- 172.21.15.26:0/566041505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c005040 con 0x7f8f8c0fa950 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f91c86700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 0x7f8f8c0f62d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f8f7c013620 tx=0x7f8f7c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f837fe700 1 -- 172.21.15.26:0/566041505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f7c00e030 con 0x7f8f8c0fa950 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f837fe700 1 -- 172.21.15.26:0/566041505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f7c007e90 con 0x7f8f8c0fa950 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c0f6b80 con 0x7f8f8c0fa950 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f837fe700 1 -- 172.21.15.26:0/566041505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f7c018070 con 0x7f8f8c0fa950 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.545+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c0f7060 con 0x7f8f8c0fa950 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.546+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c100030 con 0x7f8f8c0fa950 2024-05-09T00:14:12.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.547+0000 7f8f837fe700 1 -- 172.21.15.26:0/566041505 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8f7c01d9d0 con 0x7f8f8c0fa950 2024-05-09T00:14:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.547+0000 7f8f837fe700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f7806cab0 0x7f8f7806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.547+0000 7f8f837fe700 1 -- 172.21.15.26:0/566041505 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8f7c08d2d0 con 0x7f8f8c0fa950 2024-05-09T00:14:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.547+0000 7f8f92487700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f7806cab0 0x7f8f7806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.548+0000 7f8f92487700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f7806cab0 0x7f8f7806ef70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8f8800b910 tx=0x7f8f88008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:12.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.552+0000 7f8f837fe700 1 -- 172.21.15.26:0/566041505 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f8f7c05ae30 con 0x7f8f8c0fa950 2024-05-09T00:14:12.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.796+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f8c059120 con 0x7f8f7806cab0 2024-05-09T00:14:12.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.797+0000 7f8f837fe700 1 -- 172.21.15.26:0/566041505 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8f8c059120 con 0x7f8f7806cab0 2024-05-09T00:14:12.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f7806cab0 msgr2=0x7f8f7806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f7806cab0 0x7f8f7806ef70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8f8800b910 tx=0x7f8f88008040).stop 2024-05-09T00:14:12.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 msgr2=0x7f8f8c0f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 0x7f8f8c0f62d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f8f7c013620 tx=0x7f8f7c009cb0).stop 2024-05-09T00:14:12.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 shutdown_connections 2024-05-09T00:14:12.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f7806cab0 0x7f8f7806ef70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f8c061280 0x7f8f8c0f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 --2- 172.21.15.26:0/566041505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f8c0fa950 0x7f8f8c0f62d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 >> 172.21.15.26:0/566041505 conn(0x7f8f8c0f1e50 msgr2=0x7f8f8c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:12.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 shutdown_connections 2024-05-09T00:14:12.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.799+0000 7f8f946eb700 1 -- 172.21.15.26:0/566041505 wait complete. 2024-05-09T00:14:12.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.902+0000 7f15d1e89700 1 -- 172.21.15.26:0/1181871413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc0fcd20 msgr2=0x7f15cc0ff110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.902+0000 7f15d1e89700 1 --2- 172.21.15.26:0/1181871413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc0fcd20 0x7f15cc0ff110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f15c00047f0 tx=0x7f15c0009cb0).stop 2024-05-09T00:14:12.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.903+0000 7f15d1e89700 1 -- 172.21.15.26:0/1181871413 shutdown_connections 2024-05-09T00:14:12.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.903+0000 7f15d1e89700 1 --2- 172.21.15.26:0/1181871413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc0fcd20 0x7f15cc0ff110 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.903+0000 7f15d1e89700 1 --2- 172.21.15.26:0/1181871413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15cc061220 0x7f15cc0fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.903+0000 7f15d1e89700 1 -- 172.21.15.26:0/1181871413 >> 172.21.15.26:0/1181871413 conn(0x7f15cc0f1e50 msgr2=0x7f15cc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.903+0000 7f15d1e89700 1 -- 172.21.15.26:0/1181871413 shutdown_connections 2024-05-09T00:14:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.903+0000 7f15d1e89700 1 -- 172.21.15.26:0/1181871413 wait complete. 2024-05-09T00:14:12.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.903+0000 7f15d1e89700 1 Processor -- start 2024-05-09T00:14:12.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15d1e89700 1 -- start start 2024-05-09T00:14:12.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15d1e89700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc061220 0x7f15cc10a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15d1e89700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15cc0fcd20 0x7f15cc10a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15d1e89700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc10ac40 con 0x7f15cc061220 2024-05-09T00:14:12.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15d1e89700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc10ad80 con 0x7f15cc0fcd20 2024-05-09T00:14:12.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc061220 0x7f15cc10a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc061220 0x7f15cc10a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51556/0 (socket says 172.21.15.26:51556) 2024-05-09T00:14:12.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15cb7fe700 1 -- 172.21.15.26:0/2222511516 learned_addr learned my addr 172.21.15.26:0/2222511516 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:12.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15caffd700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15cc0fcd20 0x7f15cc10a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15cb7fe700 1 -- 172.21.15.26:0/2222511516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15cc0fcd20 msgr2=0x7f15cc10a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15cb7fe700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15cc0fcd20 0x7f15cc10a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.904+0000 7f15cb7fe700 1 -- 172.21.15.26:0/2222511516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0005040 con 0x7f15cc061220 2024-05-09T00:14:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.905+0000 7f15cb7fe700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc061220 0x7f15cc10a1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f15bc00c790 tx=0x7f15bc00caa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.905+0000 7f15c8ff9700 1 -- 172.21.15.26:0/2222511516 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15bc00e680 con 0x7f15cc061220 2024-05-09T00:14:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.905+0000 7f15c8ff9700 1 -- 172.21.15.26:0/2222511516 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15bc00ec90 con 0x7f15cc061220 2024-05-09T00:14:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.905+0000 7f15c8ff9700 1 -- 172.21.15.26:0/2222511516 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15bc012de0 con 0x7f15cc061220 2024-05-09T00:14:12.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.905+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc10f820 con 0x7f15cc061220 2024-05-09T00:14:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.905+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc10fde0 con 0x7f15cc061220 2024-05-09T00:14:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.906+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc1021d0 con 0x7f15cc061220 2024-05-09T00:14:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.906+0000 7f15c8ff9700 1 -- 172.21.15.26:0/2222511516 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f15bc00e7e0 con 0x7f15cc061220 2024-05-09T00:14:12.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.907+0000 7f15c8ff9700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f15b406caa0 0x7f15b406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.907+0000 7f15c8ff9700 1 -- 172.21.15.26:0/2222511516 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f15bc08b610 con 0x7f15cc061220 2024-05-09T00:14:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.907+0000 7f15caffd700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f15b406caa0 0x7f15b406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:12.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.908+0000 7f15caffd700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f15b406caa0 0x7f15b406ef60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f15c0004f10 tx=0x7f15c000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:12.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:12.911+0000 7f15c8ff9700 1 -- 172.21.15.26:0/2222511516 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f15bc059170 con 0x7f15cc061220 2024-05-09T00:14:13.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.125+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f15cc059120 con 0x7f15b406caa0 2024-05-09T00:14:13.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.135+0000 7f15c8ff9700 1 -- 172.21.15.26:0/2222511516 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f15cc059120 con 0x7f15b406caa0 2024-05-09T00:14:13.133 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (6m) 109s ago 14m 23.8M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (3m) 109s ago 14m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (3m) 12s ago 14m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (5m) 109s ago 14m 56.6M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (9m) 109s ago 9m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 062bfce6ee16 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (9m) 109s ago 9m 154M - 16.2.15-1-g8963e9de 727f386679cb 6fb92d9fdb6e 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (9m) 12s ago 9m 15.3M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (9m) 12s ago 9m 15.3M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (5m) 109s ago 16m 503M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (4m) 12s ago 14m 452M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (4m) 109s ago 16m 45.0M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (4m) 12s ago 14m 42.5M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:14:13.134 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (5m) 109s ago 14m 19.5M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (5m) 12s ago 13m 23.0M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (3m) 109s ago 13m 99.8M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (2m) 109s ago 13m 100M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (114s) 109s ago 12m 10.5M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (80s) 12s ago 12m 106M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (48s) 12s ago 11m 99.8M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 a23ab54b2270 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (16s) 12s ago 11m 10.6M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 df906a6613b1 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (4m) 12s ago 13m 72.4M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:14:13.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f15b406caa0 msgr2=0x7f15b406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f15b406caa0 0x7f15b406ef60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f15c0004f10 tx=0x7f15c000b040).stop 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc061220 msgr2=0x7f15cc10a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc061220 0x7f15cc10a1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f15bc00c790 tx=0x7f15bc00caa0).stop 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 shutdown_connections 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f15b406caa0 0x7f15b406ef60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15cc061220 0x7f15cc10a1a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 --2- 172.21.15.26:0/2222511516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15cc0fcd20 0x7f15cc10a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 >> 172.21.15.26:0/2222511516 conn(0x7f15cc0f1e50 msgr2=0x7f15cc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 shutdown_connections 2024-05-09T00:14:13.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.137+0000 7f15d1e89700 1 -- 172.21.15.26:0/2222511516 wait complete. 2024-05-09T00:14:13.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.254+0000 7fea5fc57700 1 -- 172.21.15.26:0/2416315393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 msgr2=0x7fea580fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.254+0000 7fea5fc57700 1 --2- 172.21.15.26:0/2416315393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 0x7fea580fcda0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fea480047f0 tx=0x7fea48009cb0).stop 2024-05-09T00:14:13.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.254+0000 7fea5fc57700 1 -- 172.21.15.26:0/2416315393 shutdown_connections 2024-05-09T00:14:13.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.254+0000 7fea5fc57700 1 --2- 172.21.15.26:0/2416315393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 0x7fea580fcda0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.254+0000 7fea5fc57700 1 --2- 172.21.15.26:0/2416315393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea58061280 0x7fea580fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.254+0000 7fea5fc57700 1 -- 172.21.15.26:0/2416315393 >> 172.21.15.26:0/2416315393 conn(0x7fea580f1e50 msgr2=0x7fea580f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:13.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.254+0000 7fea5fc57700 1 -- 172.21.15.26:0/2416315393 shutdown_connections 2024-05-09T00:14:13.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.254+0000 7fea5fc57700 1 -- 172.21.15.26:0/2416315393 wait complete. 2024-05-09T00:14:13.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5fc57700 1 Processor -- start 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5fc57700 1 -- start start 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5fc57700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea58061280 0x7fea58107f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5fc57700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 0x7fea58108400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5fc57700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea581089b0 con 0x7fea580fa950 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5fc57700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea58108af0 con 0x7fea58061280 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5d1f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 0x7fea58108400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5d1f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 0x7fea58108400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51584/0 (socket says 172.21.15.26:51584) 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5d1f2700 1 -- 172.21.15.26:0/64772506 learned_addr learned my addr 172.21.15.26:0/64772506 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.255+0000 7fea5d9f3700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea58061280 0x7fea58107f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea5d1f2700 1 -- 172.21.15.26:0/64772506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea58061280 msgr2=0x7fea58107f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea5d1f2700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea58061280 0x7fea58107f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea5d1f2700 1 -- 172.21.15.26:0/64772506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48005040 con 0x7fea580fa950 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea5d1f2700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 0x7fea58108400 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fea48013620 tx=0x7fea48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea4effd700 1 -- 172.21.15.26:0/64772506 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea4800e070 con 0x7fea580fa950 2024-05-09T00:14:13.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5810d530 con 0x7fea580fa950 2024-05-09T00:14:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea4effd700 1 -- 172.21.15.26:0/64772506 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea48007e90 con 0x7fea580fa950 2024-05-09T00:14:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5810daf0 con 0x7fea580fa950 2024-05-09T00:14:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.256+0000 7fea4effd700 1 -- 172.21.15.26:0/64772506 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea48018070 con 0x7fea580fa950 2024-05-09T00:14:13.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.257+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea580fffb0 con 0x7fea580fa950 2024-05-09T00:14:13.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.258+0000 7fea4effd700 1 -- 172.21.15.26:0/64772506 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fea4801d420 con 0x7fea580fa950 2024-05-09T00:14:13.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.259+0000 7fea4effd700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fea4406caa0 0x7fea4406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:13.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.259+0000 7fea4effd700 1 -- 172.21.15.26:0/64772506 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fea4808c9d0 con 0x7fea580fa950 2024-05-09T00:14:13.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.259+0000 7fea5d9f3700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fea4406caa0 0x7fea4406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:13.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.259+0000 7fea5d9f3700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fea4406caa0 0x7fea4406ef60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fea54004dc0 tx=0x7fea5400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:13.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.263+0000 7fea4effd700 1 -- 172.21.15.26:0/64772506 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fea4805a530 con 0x7fea580fa950 2024-05-09T00:14:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.546+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fea58101e20 con 0x7fea580fa950 2024-05-09T00:14:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.546+0000 7fea4effd700 1 -- 172.21.15.26:0/64772506 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7fea4805a0c0 con 0x7fea580fa950 2024-05-09T00:14:13.545 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:14:13.545 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 6 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3, 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 10 2024-05-09T00:14:13.546 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:14:13.547 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:14:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.548+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fea4406caa0 msgr2=0x7fea4406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.548+0000 7fea5fc57700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fea4406caa0 0x7fea4406ef60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fea54004dc0 tx=0x7fea5400b040).stop 2024-05-09T00:14:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 msgr2=0x7fea58108400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 0x7fea58108400 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fea48013620 tx=0x7fea48009cb0).stop 2024-05-09T00:14:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 shutdown_connections 2024-05-09T00:14:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fea4406caa0 0x7fea4406ef60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea58061280 0x7fea58107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 --2- 172.21.15.26:0/64772506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea580fa950 0x7fea58108400 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 >> 172.21.15.26:0/64772506 conn(0x7fea580f1e50 msgr2=0x7fea580f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 shutdown_connections 2024-05-09T00:14:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.549+0000 7fea5fc57700 1 -- 172.21.15.26:0/64772506 wait complete. 2024-05-09T00:14:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.652+0000 7f86442a2700 1 -- 172.21.15.26:0/3926276200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c0fa9b0 msgr2=0x7f863c0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.652+0000 7f86442a2700 1 --2- 172.21.15.26:0/3926276200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c0fa9b0 0x7f863c0fcda0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f862c0047f0 tx=0x7f862c009cb0).stop 2024-05-09T00:14:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.652+0000 7f86442a2700 1 -- 172.21.15.26:0/3926276200 shutdown_connections 2024-05-09T00:14:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.652+0000 7f86442a2700 1 --2- 172.21.15.26:0/3926276200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c0fa9b0 0x7f863c0fcda0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.652+0000 7f86442a2700 1 --2- 172.21.15.26:0/3926276200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c061220 0x7f863c0fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.652+0000 7f86442a2700 1 -- 172.21.15.26:0/3926276200 >> 172.21.15.26:0/3926276200 conn(0x7f863c0f1e50 msgr2=0x7f863c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.652+0000 7f86442a2700 1 -- 172.21.15.26:0/3926276200 shutdown_connections 2024-05-09T00:14:13.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.652+0000 7f86442a2700 1 -- 172.21.15.26:0/3926276200 wait complete. 2024-05-09T00:14:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f86442a2700 1 Processor -- start 2024-05-09T00:14:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f86442a2700 1 -- start start 2024-05-09T00:14:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f86442a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c061220 0x7f863c0f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f86442a2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c0fa9b0 0x7f863c0f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f86442a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0f8280 con 0x7f863c061220 2024-05-09T00:14:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f86442a2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0f6820 con 0x7f863c0fa9b0 2024-05-09T00:14:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f864203e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c061220 0x7f863c0f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:13.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f864203e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c061220 0x7f863c0f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51602/0 (socket says 172.21.15.26:51602) 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f864203e700 1 -- 172.21.15.26:0/1752415763 learned_addr learned my addr 172.21.15.26:0/1752415763 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f864183d700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c0fa9b0 0x7f863c0f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f864203e700 1 -- 172.21.15.26:0/1752415763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c0fa9b0 msgr2=0x7f863c0f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f864203e700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c0fa9b0 0x7f863c0f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.653+0000 7f864203e700 1 -- 172.21.15.26:0/1752415763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c005040 con 0x7f863c061220 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.654+0000 7f864203e700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c061220 0x7f863c0f7cd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f86380041d0 tx=0x7f8638009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.654+0000 7f8633779700 1 -- 172.21.15.26:0/1752415763 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8638007b40 con 0x7f863c061220 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.654+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c0f6aa0 con 0x7f863c061220 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.654+0000 7f8633779700 1 -- 172.21.15.26:0/1752415763 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f863800f040 con 0x7f863c061220 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.654+0000 7f8633779700 1 -- 172.21.15.26:0/1752415763 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f863800d800 con 0x7f863c061220 2024-05-09T00:14:13.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.654+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c0f7060 con 0x7f863c061220 2024-05-09T00:14:13.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.655+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c0fffd0 con 0x7f863c061220 2024-05-09T00:14:13.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.655+0000 7f8633779700 1 -- 172.21.15.26:0/1752415763 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8638007ca0 con 0x7f863c061220 2024-05-09T00:14:13.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.656+0000 7f8633779700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f862806caa0 0x7f862806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:13.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.656+0000 7f8633779700 1 -- 172.21.15.26:0/1752415763 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f863808b8b0 con 0x7f863c061220 2024-05-09T00:14:13.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.656+0000 7f864183d700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f862806caa0 0x7f862806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:13.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.656+0000 7f864183d700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f862806caa0 0x7f862806ef60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f862c004f10 tx=0x7f862c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:13.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.661+0000 7f8633779700 1 -- 172.21.15.26:0/1752415763 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f8638059410 con 0x7f863c061220 2024-05-09T00:14:13.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.903+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f863c0598f0 con 0x7f863c061220 2024-05-09T00:14:13.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.903+0000 7f8633779700 1 -- 172.21.15.26:0/1752415763 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1673 (secure 0 0 0) 0x7f8638058fa0 con 0x7f863c061220 2024-05-09T00:14:13.902 INFO:teuthology.orchestra.run.smithi026.stdout:e13 2024-05-09T00:14:13.902 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 13 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:14:09.752417+0000 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:14:13.903 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 80 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=14448} 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:14:13.904 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:14:13.905 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{0:14448} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:14:13.905 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:14:13.905 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:14:13.905 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:14:13.905 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:14:13.905 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:14:13.905 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:14:13.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.905+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f862806caa0 msgr2=0x7f862806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.905+0000 7f86442a2700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f862806caa0 0x7f862806ef60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f862c004f10 tx=0x7f862c00b040).stop 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.905+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c061220 msgr2=0x7f863c0f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.905+0000 7f86442a2700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c061220 0x7f863c0f7cd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f86380041d0 tx=0x7f8638009f60).stop 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.906+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 shutdown_connections 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.906+0000 7f86442a2700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f862806caa0 0x7f862806ef60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.906+0000 7f86442a2700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f863c061220 0x7f863c0f7cd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.906+0000 7f86442a2700 1 --2- 172.21.15.26:0/1752415763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f863c0fa9b0 0x7f863c0f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.906+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 >> 172.21.15.26:0/1752415763 conn(0x7f863c0f1e50 msgr2=0x7f863c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.906+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 shutdown_connections 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:13.906+0000 7f86442a2700 1 -- 172.21.15.26:0/1752415763 wait complete. 2024-05-09T00:14:13.906 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 13 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.009+0000 7fc6c2894700 1 -- 172.21.15.26:0/694571846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f8720 msgr2=0x7fc6bc0ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.009+0000 7fc6c2894700 1 --2- 172.21.15.26:0/694571846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f8720 0x7fc6bc0ff0b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc6b00047f0 tx=0x7fc6b0009cb0).stop 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.009+0000 7fc6c2894700 1 -- 172.21.15.26:0/694571846 shutdown_connections 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.009+0000 7fc6c2894700 1 --2- 172.21.15.26:0/694571846 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f8720 0x7fc6bc0ff0b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.009+0000 7fc6c2894700 1 --2- 172.21.15.26:0/694571846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6bc0f7d80 0x7fc6bc0f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.009+0000 7fc6c2894700 1 -- 172.21.15.26:0/694571846 >> 172.21.15.26:0/694571846 conn(0x7fc6bc0f15d0 msgr2=0x7fc6bc0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.010+0000 7fc6c2894700 1 -- 172.21.15.26:0/694571846 shutdown_connections 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.010+0000 7fc6c2894700 1 -- 172.21.15.26:0/694571846 wait complete. 2024-05-09T00:14:14.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.010+0000 7fc6c2894700 1 Processor -- start 2024-05-09T00:14:14.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.010+0000 7fc6c2894700 1 -- start start 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6c2894700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f7d80 0x7fc6bc10a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6c2894700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6bc0f8720 0x7fc6bc10a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6c2894700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc10ac10 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6c2894700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc10ad50 con 0x7fc6bc0f8720 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f7d80 0x7fc6bc10a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f7d80 0x7fc6bc10a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51622/0 (socket says 172.21.15.26:51622) 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bbfff700 1 -- 172.21.15.26:0/2684393796 learned_addr learned my addr 172.21.15.26:0/2684393796 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bb7fe700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6bc0f8720 0x7fc6bc10a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bbfff700 1 -- 172.21.15.26:0/2684393796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6bc0f8720 msgr2=0x7fc6bc10a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bbfff700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6bc0f8720 0x7fc6bc10a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bbfff700 1 -- 172.21.15.26:0/2684393796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0005040 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bb7fe700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6bc0f8720 0x7fc6bc10a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6bbfff700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f7d80 0x7fc6bc10a170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc6ac0041d0 tx=0x7fc6ac009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6b97fa700 1 -- 172.21.15.26:0/2684393796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6ac002d90 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6b97fa700 1 -- 172.21.15.26:0/2684393796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6ac00f040 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc10f7f0 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.011+0000 7fc6b97fa700 1 -- 172.21.15.26:0/2684393796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6ac00d800 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.012+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc10fdb0 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.013+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc1021e0 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.013+0000 7fc6b97fa700 1 -- 172.21.15.26:0/2684393796 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc6ac00da90 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.014+0000 7fc6b97fa700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6a406caa0 0x7fc6a406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.014+0000 7fc6b97fa700 1 -- 172.21.15.26:0/2684393796 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc6ac08bd80 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.014+0000 7fc6bb7fe700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6a406caa0 0x7fc6a406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.014+0000 7fc6bb7fe700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6a406caa0 0x7fc6a406ef60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc6b0004f10 tx=0x7fc6b000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:14.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.023+0000 7fc6b97fa700 1 -- 172.21.15.26:0/2684393796 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc6ac0598e0 con 0x7fc6bc0f7d80 2024-05-09T00:14:14.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.253+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6bc059120 con 0x7fc6a406caa0 2024-05-09T00:14:14.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.255+0000 7fc6b97fa700 1 -- 172.21.15.26:0/2684393796 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc6bc059120 con 0x7fc6a406caa0 2024-05-09T00:14:14.253 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "osd", 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "12/21 daemons upgraded", 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:14:14.254 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6a406caa0 msgr2=0x7fc6a406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6a406caa0 0x7fc6a406ef60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc6b0004f10 tx=0x7fc6b000b040).stop 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f7d80 msgr2=0x7fc6bc10a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f7d80 0x7fc6bc10a170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc6ac0041d0 tx=0x7fc6ac009f60).stop 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 shutdown_connections 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc6a406caa0 0x7fc6a406ef60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6bc0f7d80 0x7fc6bc10a170 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 --2- 172.21.15.26:0/2684393796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6bc0f8720 0x7fc6bc10a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 >> 172.21.15.26:0/2684393796 conn(0x7fc6bc0f15d0 msgr2=0x7fc6bc0f39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 shutdown_connections 2024-05-09T00:14:14.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.257+0000 7fc6c2894700 1 -- 172.21.15.26:0/2684393796 wait complete. 2024-05-09T00:14:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 -- 172.21.15.26:0/1338867163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f7d20 msgr2=0x7fcac00f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 --2- 172.21.15.26:0/1338867163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f7d20 0x7fcac00f8140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fcabc0047f0 tx=0x7fcabc009cb0).stop 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 -- 172.21.15.26:0/1338867163 shutdown_connections 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 --2- 172.21.15.26:0/1338867163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac00f6a20 0x7fcac00f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 --2- 172.21.15.26:0/1338867163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f7d20 0x7fcac00f8140 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 -- 172.21.15.26:0/1338867163 >> 172.21.15.26:0/1338867163 conn(0x7fcac00f1610 msgr2=0x7fcac00f3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 -- 172.21.15.26:0/1338867163 shutdown_connections 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 -- 172.21.15.26:0/1338867163 wait complete. 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.360+0000 7fcac82e9700 1 Processor -- start 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac82e9700 1 -- start start 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac82e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f6a20 0x7fcac0108030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac82e9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac00f7d20 0x7fcac0108520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac82e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0108b60 con 0x7fcac00f6a20 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac82e9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0108ca0 con 0x7fcac00f7d20 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac6085700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f6a20 0x7fcac0108030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac6085700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f6a20 0x7fcac0108030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51638/0 (socket says 172.21.15.26:51638) 2024-05-09T00:14:14.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac6085700 1 -- 172.21.15.26:0/2492393645 learned_addr learned my addr 172.21.15.26:0/2492393645 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:14.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac6085700 1 -- 172.21.15.26:0/2492393645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac00f7d20 msgr2=0x7fcac0108520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac5884700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac00f7d20 0x7fcac0108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac6085700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac00f7d20 0x7fcac0108520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac6085700 1 -- 172.21.15.26:0/2492393645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc005040 con 0x7fcac00f6a20 2024-05-09T00:14:14.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac5884700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac00f7d20 0x7fcac0108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.361+0000 7fcac6085700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f6a20 0x7fcac0108030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fcabc013620 tx=0x7fcabc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.362+0000 7fcab7779700 1 -- 172.21.15.26:0/2492393645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcabc00e030 con 0x7fcac00f6a20 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.362+0000 7fcab7779700 1 -- 172.21.15.26:0/2492393645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcabc007e90 con 0x7fcac00f6a20 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.362+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac010d6e0 con 0x7fcac00f6a20 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.362+0000 7fcab7779700 1 -- 172.21.15.26:0/2492393645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcabc018070 con 0x7fcac00f6a20 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.362+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac010dbc0 con 0x7fcac00f6a20 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.363+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac00fef60 con 0x7fcac00f6a20 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.363+0000 7fcab7779700 1 -- 172.21.15.26:0/2492393645 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcabc01d9d0 con 0x7fcac00f6a20 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.364+0000 7fcab7779700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcaac06ca90 0x7fcaac06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:14.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.364+0000 7fcab7779700 1 -- 172.21.15.26:0/2492393645 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fcabc08d330 con 0x7fcac00f6a20 2024-05-09T00:14:14.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.368+0000 7fcac5884700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcaac06ca90 0x7fcaac06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:14.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.368+0000 7fcac5884700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcaac06ca90 0x7fcaac06ef50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fcac00f7af0 tx=0x7fcab0008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:14.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.368+0000 7fcab7779700 1 -- 172.21.15.26:0/2492393645 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fcabc05af50 con 0x7fcac00f6a20 2024-05-09T00:14:14.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:14 smithi026 ceph-mon[93667]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:14.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:14 smithi026 ceph-mon[93667]: pgmap v165: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 1 op/s 2024-05-09T00:14:14.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:14 smithi026 ceph-mon[93667]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:14.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:14 smithi026 ceph-mon[93667]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:14.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:14 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/64772506' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:14.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:14 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1752415763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:14:14.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:14 smithi135 ceph-mon[80466]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:14.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:14 smithi135 ceph-mon[80466]: pgmap v165: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 1 op/s 2024-05-09T00:14:14.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:14 smithi135 ceph-mon[80466]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:14.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:14 smithi135 ceph-mon[80466]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:14.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:14 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/64772506' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:14.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:14 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1752415763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:14:14.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.666+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcac010e4f0 con 0x7fcac00f6a20 2024-05-09T00:14:14.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.666+0000 7fcab7779700 1 -- 172.21.15.26:0/2492393645 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7fcabc05aae0 con 0x7fcac00f6a20 2024-05-09T00:14:14.667 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-05-09T00:14:14.667 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-05-09T00:14:14.667 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs is degraded 2024-05-09T00:14:14.667 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:14:14.667 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:14:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcaac06ca90 msgr2=0x7fcaac06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcaac06ca90 0x7fcaac06ef50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fcac00f7af0 tx=0x7fcab0008040).stop 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f6a20 msgr2=0x7fcac0108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f6a20 0x7fcac0108030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fcabc013620 tx=0x7fcabc009cb0).stop 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 shutdown_connections 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcaac06ca90 0x7fcaac06ef50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcac00f6a20 0x7fcac0108030 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 --2- 172.21.15.26:0/2492393645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac00f7d20 0x7fcac0108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.668+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 >> 172.21.15.26:0/2492393645 conn(0x7fcac00f1610 msgr2=0x7fcac00f6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.669+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 shutdown_connections 2024-05-09T00:14:14.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:14.669+0000 7fcac82e9700 1 -- 172.21.15.26:0/2492393645 wait complete. 2024-05-09T00:14:15.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:15 smithi026 ceph-mon[93667]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:15.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:15 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2492393645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:14:15.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:15 smithi135 ceph-mon[80466]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:15.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:15 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2492393645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:14:16.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:16 smithi026 ceph-mon[93667]: pgmap v166: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T00:14:16.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:16 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:16.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:16 smithi135 ceph-mon[80466]: pgmap v166: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T00:14:16.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:16 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:18.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:18 smithi026 ceph-mon[93667]: pgmap v167: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T00:14:18.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:18 smithi135 ceph-mon[80466]: pgmap v167: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T00:14:20.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:20 smithi026 ceph-mon[93667]: pgmap v168: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T00:14:20.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:20 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] up:reconnect 2024-05-09T00:14:20.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:20 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi026.gbyppy=up:reconnect} 2 up:standby 2024-05-09T00:14:20.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:20 smithi026 ceph-mon[93667]: reconnect by client.14496 v1:192.168.0.1:0/3285800047 after 0.00399994 2024-05-09T00:14:20.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:20 smithi026 ceph-mon[93667]: reconnect by client.14502 v1:172.21.15.135:0/1350715060 after 0.00399994 2024-05-09T00:14:20.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:20.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:20.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:20 smithi135 ceph-mon[80466]: pgmap v168: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T00:14:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:20 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] up:reconnect 2024-05-09T00:14:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:20 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi026.gbyppy=up:reconnect} 2 up:standby 2024-05-09T00:14:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:20 smithi135 ceph-mon[80466]: reconnect by client.14496 v1:192.168.0.1:0/3285800047 after 0.00399994 2024-05-09T00:14:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:20 smithi135 ceph-mon[80466]: reconnect by client.14502 v1:172.21.15.135:0/1350715060 after 0.00399994 2024-05-09T00:14:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:20.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:21.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:21 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] up:rejoin 2024-05-09T00:14:21.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:21 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] up:boot 2024-05-09T00:14:21.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:21 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi026.gbyppy=up:rejoin} 3 up:standby 2024-05-09T00:14:21.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:14:21.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:21 smithi026 ceph-mon[93667]: daemon mds.cephfs.smithi026.gbyppy is now active in filesystem cephfs as rank 0 2024-05-09T00:14:21.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:21.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:14:21.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:21 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] up:rejoin 2024-05-09T00:14:21.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:21 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] up:boot 2024-05-09T00:14:21.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:21 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi026.gbyppy=up:rejoin} 3 up:standby 2024-05-09T00:14:21.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:14:21.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:21 smithi135 ceph-mon[80466]: daemon mds.cephfs.smithi026.gbyppy is now active in filesystem cephfs as rank 0 2024-05-09T00:14:21.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:21.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:14:22.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:22 smithi026 ceph-mon[93667]: pgmap v169: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T00:14:22.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:22 smithi026 ceph-mon[93667]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:14:22.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:22 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] up:active 2024-05-09T00:14:22.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:22 smithi026 ceph-mon[93667]: fsmap cephfs:1 {0=cephfs.smithi026.gbyppy=up:active} 3 up:standby 2024-05-09T00:14:22.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:22 smithi135 ceph-mon[80466]: pgmap v169: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T00:14:22.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:22 smithi135 ceph-mon[80466]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:14:22.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:22 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.26:6828/3575480423,v1:172.21.15.26:6829/3575480423] up:active 2024-05-09T00:14:22.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:22 smithi135 ceph-mon[80466]: fsmap cephfs:1 {0=cephfs.smithi026.gbyppy=up:active} 3 up:standby 2024-05-09T00:14:24.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:24 smithi026 ceph-mon[93667]: pgmap v170: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T00:14:24.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:24 smithi135 ceph-mon[80466]: pgmap v170: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T00:14:25.627 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:25.627 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:25.627 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:25.627 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:25.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:25.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:25.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:25.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:26.617 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:26 smithi026 ceph-mon[93667]: pgmap v171: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-05-09T00:14:26.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:26 smithi135 ceph-mon[80466]: pgmap v171: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-05-09T00:14:28.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:28 smithi026 ceph-mon[93667]: pgmap v172: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:28.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:28 smithi135 ceph-mon[80466]: pgmap v172: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: pgmap v173: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: Detected new or changed devices on smithi026 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:30.142 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:30.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:30.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.gbyppy"]}]: dispatch 2024-05-09T00:14:30.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:29 smithi026 ceph-mon[93667]: Upgrade: It appears safe to stop mds.cephfs.smithi026.gbyppy 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: pgmap v173: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: Detected new or changed devices on smithi026 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi026.gbyppy"]}]: dispatch 2024-05-09T00:14:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:29 smithi135 ceph-mon[80466]: Upgrade: It appears safe to stop mds.cephfs.smithi026.gbyppy 2024-05-09T00:14:32.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:32 smithi026 ceph-mon[93667]: pgmap v174: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:32.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:32 smithi026 ceph-mon[93667]: Upgrade: Updating mds.cephfs.smithi026.gbyppy 2024-05-09T00:14:32.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:32 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:32.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:32 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.gbyppy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:14:32.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:32 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:32.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:32 smithi026 ceph-mon[93667]: Deploying daemon mds.cephfs.smithi026.gbyppy on smithi026 2024-05-09T00:14:32.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:32 smithi135 ceph-mon[80466]: pgmap v174: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:32.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:32 smithi135 ceph-mon[80466]: Upgrade: Updating mds.cephfs.smithi026.gbyppy 2024-05-09T00:14:32.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:32 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:32.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:32 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi026.gbyppy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:14:32.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:32 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:32.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:32 smithi135 ceph-mon[80466]: Deploying daemon mds.cephfs.smithi026.gbyppy on smithi026 2024-05-09T00:14:34.341 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:34 smithi026 ceph-mon[93667]: pgmap v175: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T00:14:34.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:34 smithi135 ceph-mon[80466]: pgmap v175: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T00:14:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:35 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[93644]: 2024-05-09T00:14:35.034+0000 7fe4684f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:35 smithi026 ceph-mon[93667]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:14:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:35 smithi026 ceph-mon[93667]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:35 smithi026 ceph-mon[93667]: osdmap e81: 6 total, 6 up, 6 in 2024-05-09T00:14:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:35 smithi026 ceph-mon[93667]: Standby daemon mds.cephfs.smithi135.lzxgvd assigned to filesystem cephfs as rank 0 2024-05-09T00:14:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:35 smithi026 ceph-mon[93667]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:14:35.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:35 smithi026 ceph-mon[93667]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T00:14:35.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:35 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi135.lzxgvd=up:replay} 2 up:standby 2024-05-09T00:14:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:35 smithi135 ceph-mon[80466]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:14:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:35 smithi135 ceph-mon[80466]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:35 smithi135 ceph-mon[80466]: osdmap e81: 6 total, 6 up, 6 in 2024-05-09T00:14:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:35 smithi135 ceph-mon[80466]: Standby daemon mds.cephfs.smithi135.lzxgvd assigned to filesystem cephfs as rank 0 2024-05-09T00:14:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:35 smithi135 ceph-mon[80466]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:14:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:35 smithi135 ceph-mon[80466]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T00:14:35.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:35 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi135.lzxgvd=up:replay} 2 up:standby 2024-05-09T00:14:36.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:36 smithi026 ceph-mon[93667]: pgmap v176: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-05-09T00:14:36.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:14:36.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:36 smithi135 ceph-mon[80466]: pgmap v176: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-05-09T00:14:36.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:14:38.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:38 smithi026 ceph-mon[93667]: pgmap v178: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:14:38.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:38 smithi135 ceph-mon[80466]: pgmap v178: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:14:40.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:40 smithi026 ceph-mon[93667]: pgmap v179: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 1 op/s 2024-05-09T00:14:40.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:40 smithi135 ceph-mon[80466]: pgmap v179: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 1 op/s 2024-05-09T00:14:42.343 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:42 smithi026 ceph-mon[93667]: pgmap v180: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T00:14:42.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:42 smithi135 ceph-mon[80466]: pgmap v180: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T00:14:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:44 smithi135 ceph-mon[80466]: pgmap v181: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T00:14:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:44 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:44.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:44 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:44.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:44 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:44.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:44 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.26:6828/666863957,v1:172.21.15.26:6829/666863957] up:boot 2024-05-09T00:14:44.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:44 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] up:reconnect 2024-05-09T00:14:44.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:44 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi135.lzxgvd=up:reconnect} 3 up:standby 2024-05-09T00:14:44.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:44 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:14:44.620 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:44 smithi026 ceph-mon[93667]: pgmap v181: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T00:14:44.620 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:44 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:44.621 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:44 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:44.621 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:44 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:44.621 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:44 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.26:6828/666863957,v1:172.21.15.26:6829/666863957] up:boot 2024-05-09T00:14:44.621 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:44 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] up:reconnect 2024-05-09T00:14:44.621 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:44 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi135.lzxgvd=up:reconnect} 3 up:standby 2024-05-09T00:14:44.621 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:44 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.780+0000 7fcf8e434700 1 -- 172.21.15.26:0/3636410040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f7990 msgr2=0x7fcf880f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.780+0000 7fcf8e434700 1 --2- 172.21.15.26:0/3636410040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f7990 0x7fcf880f7df0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fcf700047f0 tx=0x7fcf70009cb0).stop 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.780+0000 7fcf8e434700 1 -- 172.21.15.26:0/3636410040 shutdown_connections 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.780+0000 7fcf8e434700 1 --2- 172.21.15.26:0/3636410040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f7990 0x7fcf880f7df0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.780+0000 7fcf8e434700 1 --2- 172.21.15.26:0/3636410040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf880f66f0 0x7fcf880f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.780+0000 7fcf8e434700 1 -- 172.21.15.26:0/3636410040 >> 172.21.15.26:0/3636410040 conn(0x7fcf880f1e50 msgr2=0x7fcf880f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.780+0000 7fcf8e434700 1 -- 172.21.15.26:0/3636410040 shutdown_connections 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.780+0000 7fcf8e434700 1 -- 172.21.15.26:0/3636410040 wait complete. 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf8e434700 1 Processor -- start 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf8e434700 1 -- start start 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf8e434700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f66f0 0x7fcf88061050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf8e434700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf880f7990 0x7fcf8810cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf8e434700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8810d230 con 0x7fcf880f66f0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf8e434700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8810d370 con 0x7fcf880f7990 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf87fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f66f0 0x7fcf88061050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf87fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f66f0 0x7fcf88061050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35430/0 (socket says 172.21.15.26:35430) 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf87fff700 1 -- 172.21.15.26:0/814551531 learned_addr learned my addr 172.21.15.26:0/814551531 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf7ffff700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf880f7990 0x7fcf8810cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf87fff700 1 -- 172.21.15.26:0/814551531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf880f7990 msgr2=0x7fcf8810cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf87fff700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf880f7990 0x7fcf8810cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.781+0000 7fcf87fff700 1 -- 172.21.15.26:0/814551531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf70005040 con 0x7fcf880f66f0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.782+0000 7fcf87fff700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f66f0 0x7fcf88061050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fcf7800c790 tx=0x7fcf78007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.782+0000 7fcf85ffb700 1 -- 172.21.15.26:0/814551531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf7800e680 con 0x7fcf880f66f0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.782+0000 7fcf85ffb700 1 -- 172.21.15.26:0/814551531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf7800ec90 con 0x7fcf880f66f0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.782+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8810d5d0 con 0x7fcf880f66f0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.782+0000 7fcf85ffb700 1 -- 172.21.15.26:0/814551531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf78012da0 con 0x7fcf880f66f0 2024-05-09T00:14:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.782+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8810db90 con 0x7fcf880f66f0 2024-05-09T00:14:44.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.783+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf880feeb0 con 0x7fcf880f66f0 2024-05-09T00:14:44.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.783+0000 7fcf85ffb700 1 -- 172.21.15.26:0/814551531 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcf7800e7e0 con 0x7fcf880f66f0 2024-05-09T00:14:44.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.784+0000 7fcf85ffb700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcf7406caa0 0x7fcf7406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.784+0000 7fcf85ffb700 1 -- 172.21.15.26:0/814551531 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6309+0+0 (secure 0 0 0) 0x7fcf7808b5a0 con 0x7fcf880f66f0 2024-05-09T00:14:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.784+0000 7fcf7ffff700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcf7406caa0 0x7fcf7406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.784+0000 7fcf7ffff700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcf7406caa0 0x7fcf7406ef60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fcf70004f10 tx=0x7fcf7000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:44.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:44.788+0000 7fcf85ffb700 1 -- 172.21.15.26:0/814551531 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fcf78059150 con 0x7fcf880f66f0 2024-05-09T00:14:45.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.009+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf88059120 con 0x7fcf7406caa0 2024-05-09T00:14:45.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.011+0000 7fcf85ffb700 1 -- 172.21.15.26:0/814551531 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcf88059120 con 0x7fcf7406caa0 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcf7406caa0 msgr2=0x7fcf7406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcf7406caa0 0x7fcf7406ef60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fcf70004f10 tx=0x7fcf7000b040).stop 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f66f0 msgr2=0x7fcf88061050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f66f0 0x7fcf88061050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fcf7800c790 tx=0x7fcf78007f90).stop 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 shutdown_connections 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcf7406caa0 0x7fcf7406ef60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf880f66f0 0x7fcf88061050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 --2- 172.21.15.26:0/814551531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf880f7990 0x7fcf8810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 >> 172.21.15.26:0/814551531 conn(0x7fcf880f1e50 msgr2=0x7fcf880fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 shutdown_connections 2024-05-09T00:14:45.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.013+0000 7fcf8e434700 1 -- 172.21.15.26:0/814551531 wait complete. 2024-05-09T00:14:45.021 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:14:45.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.124+0000 7f8458b24700 1 -- 172.21.15.26:0/2240752053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f6a20 msgr2=0x7f84540f6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.124+0000 7f8458b24700 1 --2- 172.21.15.26:0/2240752053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f6a20 0x7f84540f6ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f84480047f0 tx=0x7f8448009cb0).stop 2024-05-09T00:14:45.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.124+0000 7f8458b24700 1 -- 172.21.15.26:0/2240752053 shutdown_connections 2024-05-09T00:14:45.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.124+0000 7f8458b24700 1 --2- 172.21.15.26:0/2240752053 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f6a20 0x7f84540f6ea0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.124+0000 7f8458b24700 1 --2- 172.21.15.26:0/2240752053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84540f7d20 0x7f84540f8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.124+0000 7f8458b24700 1 -- 172.21.15.26:0/2240752053 >> 172.21.15.26:0/2240752053 conn(0x7f84540f1610 msgr2=0x7f84540f3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:45.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.124+0000 7f8458b24700 1 -- 172.21.15.26:0/2240752053 shutdown_connections 2024-05-09T00:14:45.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.124+0000 7f8458b24700 1 -- 172.21.15.26:0/2240752053 wait complete. 2024-05-09T00:14:45.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.125+0000 7f8458b24700 1 Processor -- start 2024-05-09T00:14:45.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.125+0000 7f8458b24700 1 -- start start 2024-05-09T00:14:45.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.125+0000 7f8458b24700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84540f6a20 0x7f84540f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.125+0000 7f8458b24700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f7d20 0x7f845410cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.125+0000 7f8458b24700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845410d290 con 0x7f84540f7d20 2024-05-09T00:14:45.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8458b24700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845410d3d0 con 0x7f84540f6a20 2024-05-09T00:14:45.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8451d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f7d20 0x7f845410cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8451d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f7d20 0x7f845410cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35444/0 (socket says 172.21.15.26:35444) 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8451d9b700 1 -- 172.21.15.26:0/832735454 learned_addr learned my addr 172.21.15.26:0/832735454 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f845259c700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84540f6a20 0x7f84540f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8451d9b700 1 -- 172.21.15.26:0/832735454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84540f6a20 msgr2=0x7f84540f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8451d9b700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84540f6a20 0x7f84540f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8451d9b700 1 -- 172.21.15.26:0/832735454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448005040 con 0x7f84540f7d20 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8451d9b700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f7d20 0x7f845410cda0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f8448000c00 tx=0x7f8448009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f84437fe700 1 -- 172.21.15.26:0/832735454 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844800e030 con 0x7f84540f7d20 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f84437fe700 1 -- 172.21.15.26:0/832735454 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8448007e90 con 0x7f84540f7d20 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845410d5d0 con 0x7f84540f7d20 2024-05-09T00:14:45.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.126+0000 7f84437fe700 1 -- 172.21.15.26:0/832735454 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8448018070 con 0x7f84540f7d20 2024-05-09T00:14:45.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.127+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845410dab0 con 0x7f84540f7d20 2024-05-09T00:14:45.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.127+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84540feed0 con 0x7f84540f7d20 2024-05-09T00:14:45.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.128+0000 7f84437fe700 1 -- 172.21.15.26:0/832735454 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f844801d420 con 0x7f84540f7d20 2024-05-09T00:14:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.128+0000 7f84437fe700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f843c06cab0 0x7f843c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.129+0000 7f84437fe700 1 -- 172.21.15.26:0/832735454 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6309+0+0 (secure 0 0 0) 0x7f844808d160 con 0x7f84540f7d20 2024-05-09T00:14:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.129+0000 7f845259c700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f843c06cab0 0x7f843c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.129+0000 7f845259c700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f843c06cab0 0x7f843c06ef70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8454060690 tx=0x7f844400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:45.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.137+0000 7f84437fe700 1 -- 172.21.15.26:0/832735454 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f844805ac60 con 0x7f84540f7d20 2024-05-09T00:14:45.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.360+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8454059120 con 0x7f843c06cab0 2024-05-09T00:14:45.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.361+0000 7f84437fe700 1 -- 172.21.15.26:0/832735454 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8454059120 con 0x7f843c06cab0 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f843c06cab0 msgr2=0x7f843c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f843c06cab0 0x7f843c06ef70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8454060690 tx=0x7f844400b040).stop 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f7d20 msgr2=0x7f845410cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f7d20 0x7f845410cda0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f8448000c00 tx=0x7f8448009cb0).stop 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 shutdown_connections 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f843c06cab0 0x7f843c06ef70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84540f6a20 0x7f84540f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 --2- 172.21.15.26:0/832735454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f84540f7d20 0x7f845410cda0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 >> 172.21.15.26:0/832735454 conn(0x7f84540f1610 msgr2=0x7f84540fb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 shutdown_connections 2024-05-09T00:14:45.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.364+0000 7f8458b24700 1 -- 172.21.15.26:0/832735454 wait complete. 2024-05-09T00:14:45.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.472+0000 7f48e7248700 1 -- 172.21.15.26:0/583033750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 msgr2=0x7f48e00f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.472+0000 7f48e7248700 1 --2- 172.21.15.26:0/583033750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 0x7f48e00f7df0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f48cc0047f0 tx=0x7f48cc009cb0).stop 2024-05-09T00:14:45.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.472+0000 7f48e7248700 1 -- 172.21.15.26:0/583033750 shutdown_connections 2024-05-09T00:14:45.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.472+0000 7f48e7248700 1 --2- 172.21.15.26:0/583033750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 0x7f48e00f7df0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.472+0000 7f48e7248700 1 --2- 172.21.15.26:0/583033750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48e00f66f0 0x7f48e00f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:14:45.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.472+0000 7f48e7248700 1 -- 172.21.15.26:0/583033750 >> 172.21.15.26:0/583033750 conn(0x7f48e00f1e50 msgr2=0x7f48e00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:45.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.472+0000 7f48e7248700 1 -- 172.21.15.26:0/583033750 shutdown_connections 2024-05-09T00:14:45.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.472+0000 7f48e7248700 1 -- 172.21.15.26:0/583033750 wait complete. 2024-05-09T00:14:45.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48e7248700 1 Processor -- start 2024-05-09T00:14:45.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48e7248700 1 -- start start 2024-05-09T00:14:45.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48e7248700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48e00f66f0 0x7f48e0061060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48e7248700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 0x7f48e010cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48e7248700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e010d2e0 con 0x7f48e00f7990 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48e7248700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e010d420 con 0x7f48e00f66f0 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48dffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 0x7f48e010cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48dffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 0x7f48e010cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35466/0 (socket says 172.21.15.26:35466) 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48dffff700 1 -- 172.21.15.26:0/494117092 learned_addr learned my addr 172.21.15.26:0/494117092 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.473+0000 7f48e4fe4700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48e00f66f0 0x7f48e0061060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48dffff700 1 -- 172.21.15.26:0/494117092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48e00f66f0 msgr2=0x7f48e0061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48dffff700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48e00f66f0 0x7f48e0061060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48dffff700 1 -- 172.21.15.26:0/494117092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc005040 con 0x7f48e00f7990 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48dffff700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 0x7f48e010cdf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f48cc00b120 tx=0x7f48cc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48ddffb700 1 -- 172.21.15.26:0/494117092 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48cc00e030 con 0x7f48e00f7990 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48ddffb700 1 -- 172.21.15.26:0/494117092 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f48cc007e90 con 0x7f48e00f7990 2024-05-09T00:14:45.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e010d6a0 con 0x7f48e00f7990 2024-05-09T00:14:45.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48ddffb700 1 -- 172.21.15.26:0/494117092 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48cc018070 con 0x7f48e00f7990 2024-05-09T00:14:45.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.474+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e010db80 con 0x7f48e00f7990 2024-05-09T00:14:45.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.475+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00fef50 con 0x7f48e00f7990 2024-05-09T00:14:45.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.476+0000 7f48ddffb700 1 -- 172.21.15.26:0/494117092 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f48cc01d420 con 0x7f48e00f7990 2024-05-09T00:14:45.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.476+0000 7f48ddffb700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f48d006caa0 0x7f48d006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.476+0000 7f48ddffb700 1 -- 172.21.15.26:0/494117092 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6309+0+0 (secure 0 0 0) 0x7f48cc08d2c0 con 0x7f48e00f7990 2024-05-09T00:14:45.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.476+0000 7f48e4fe4700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f48d006caa0 0x7f48d006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.477+0000 7f48e4fe4700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f48d006caa0 0x7f48d006ef60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f48d4006fd0 tx=0x7f48d4009060).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:45.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.481+0000 7f48ddffb700 1 -- 172.21.15.26:0/494117092 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f48cc05adc0 con 0x7f48e00f7990 2024-05-09T00:14:45.647 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:45 smithi026 ceph-mon[93667]: reconnect by client.14502 v1:172.21.15.135:0/1350715060 after 0.00399991 2024-05-09T00:14:45.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:45 smithi026 ceph-mon[93667]: reconnect by client.14496 v1:192.168.0.1:0/3285800047 after 0.00599987 2024-05-09T00:14:45.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:45 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] up:rejoin 2024-05-09T00:14:45.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:45 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi135.lzxgvd=up:rejoin} 3 up:standby 2024-05-09T00:14:45.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:45 smithi026 ceph-mon[93667]: daemon mds.cephfs.smithi135.lzxgvd is now active in filesystem cephfs as rank 0 2024-05-09T00:14:45.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:45 smithi135 ceph-mon[80466]: reconnect by client.14502 v1:172.21.15.135:0/1350715060 after 0.00399991 2024-05-09T00:14:45.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:45 smithi135 ceph-mon[80466]: reconnect by client.14496 v1:192.168.0.1:0/3285800047 after 0.00599987 2024-05-09T00:14:45.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:45 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] up:rejoin 2024-05-09T00:14:45.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:45 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi135.lzxgvd=up:rejoin} 3 up:standby 2024-05-09T00:14:45.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:45 smithi135 ceph-mon[80466]: daemon mds.cephfs.smithi135.lzxgvd is now active in filesystem cephfs as rank 0 2024-05-09T00:14:45.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.688+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f48e0059120 con 0x7f48d006caa0 2024-05-09T00:14:45.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.698+0000 7f48ddffb700 1 -- 172.21.15.26:0/494117092 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f48e0059120 con 0x7f48d006caa0 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (6m) 21s ago 15m 23.8M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (4m) 21s ago 15m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (3m) 44s ago 14m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (6m) 21s ago 15m 55.3M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 starting - - - - 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (26s) 21s ago 10m 11.0M - 18.2.2-1322-gd21e4f96 af23193ff691 4083eb8ff427 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (10m) 44s ago 10m 15.3M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (10m) 44s ago 10m 15.3M - 16.2.15-1-g8963e9de 727f386679cb 4b3daec57b1b 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (5m) 21s ago 16m 506M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (5m) 44s ago 14m 452M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (5m) 21s ago 16m 49.6M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:14:45.696 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (4m) 44s ago 14m 42.5M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (6m) 21s ago 15m 25.4M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (6m) 44s ago 14m 23.0M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (3m) 21s ago 14m 108M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (3m) 21s ago 13m 112M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (2m) 21s ago 13m 103M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (113s) 44s ago 12m 106M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (80s) 44s ago 12m 99.8M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 a23ab54b2270 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (48s) 44s ago 11m 10.6M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 df906a6613b1 2024-05-09T00:14:45.697 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (5m) 44s ago 14m 72.4M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f48d006caa0 msgr2=0x7f48d006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f48d006caa0 0x7f48d006ef60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f48d4006fd0 tx=0x7f48d4009060).stop 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 msgr2=0x7f48e010cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 0x7f48e010cdf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f48cc00b120 tx=0x7f48cc009cb0).stop 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 shutdown_connections 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f48d006caa0 0x7f48d006ef60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48e00f66f0 0x7f48e0061060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 --2- 172.21.15.26:0/494117092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48e00f7990 0x7f48e010cdf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 >> 172.21.15.26:0/494117092 conn(0x7f48e00f1e50 msgr2=0x7f48e00fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 shutdown_connections 2024-05-09T00:14:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.700+0000 7f48e7248700 1 -- 172.21.15.26:0/494117092 wait complete. 2024-05-09T00:14:45.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.800+0000 7fbe81247700 1 -- 172.21.15.26:0/1063944748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f79a0 msgr2=0x7fbe7c0f7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.800+0000 7fbe81247700 1 --2- 172.21.15.26:0/1063944748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f79a0 0x7fbe7c0f7e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbe6c0047f0 tx=0x7fbe6c009cb0).stop 2024-05-09T00:14:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.801+0000 7fbe81247700 1 -- 172.21.15.26:0/1063944748 shutdown_connections 2024-05-09T00:14:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.801+0000 7fbe81247700 1 --2- 172.21.15.26:0/1063944748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f79a0 0x7fbe7c0f7e00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.801+0000 7fbe81247700 1 --2- 172.21.15.26:0/1063944748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f6700 0x7fbe7c0f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.801+0000 7fbe81247700 1 -- 172.21.15.26:0/1063944748 >> 172.21.15.26:0/1063944748 conn(0x7fbe7c0f1e60 msgr2=0x7fbe7c0f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.801+0000 7fbe81247700 1 -- 172.21.15.26:0/1063944748 shutdown_connections 2024-05-09T00:14:45.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.801+0000 7fbe81247700 1 -- 172.21.15.26:0/1063944748 wait complete. 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.801+0000 7fbe81247700 1 Processor -- start 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe81247700 1 -- start start 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe81247700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f6700 0x7fbe7c107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe81247700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f79a0 0x7fbe7c108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe81247700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c1089f0 con 0x7fbe7c0f6700 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe81247700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c108b30 con 0x7fbe7c0f79a0 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe7ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f6700 0x7fbe7c107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe7ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f6700 0x7fbe7c107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35472/0 (socket says 172.21.15.26:35472) 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe7ad9d700 1 -- 172.21.15.26:0/2764636616 learned_addr learned my addr 172.21.15.26:0/2764636616 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:45.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe7a59c700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f79a0 0x7fbe7c108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe7ad9d700 1 -- 172.21.15.26:0/2764636616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f79a0 msgr2=0x7fbe7c108440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe7ad9d700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f79a0 0x7fbe7c108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe7ad9d700 1 -- 172.21.15.26:0/2764636616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c005040 con 0x7fbe7c0f6700 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe7ad9d700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f6700 0x7fbe7c107f50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fbe64002820 tx=0x7fbe64009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.802+0000 7fbe73fff700 1 -- 172.21.15.26:0/2764636616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe64002d60 con 0x7fbe7c0f6700 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.803+0000 7fbe73fff700 1 -- 172.21.15.26:0/2764636616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe6400f040 con 0x7fbe7c0f6700 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.803+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c10d5d0 con 0x7fbe7c0f6700 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.803+0000 7fbe73fff700 1 -- 172.21.15.26:0/2764636616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe6400d820 con 0x7fbe7c0f6700 2024-05-09T00:14:45.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.803+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c10db90 con 0x7fbe7c0f6700 2024-05-09T00:14:45.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.803+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c0feec0 con 0x7fbe7c0f6700 2024-05-09T00:14:45.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.804+0000 7fbe73fff700 1 -- 172.21.15.26:0/2764636616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbe6400dae0 con 0x7fbe7c0f6700 2024-05-09T00:14:45.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.804+0000 7fbe73fff700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbe6806ca30 0x7fbe6806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:45.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.805+0000 7fbe73fff700 1 -- 172.21.15.26:0/2764636616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6309+0+0 (secure 0 0 0) 0x7fbe6408bb20 con 0x7fbe7c0f6700 2024-05-09T00:14:45.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.805+0000 7fbe7a59c700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbe6806ca30 0x7fbe6806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:45.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.805+0000 7fbe7a59c700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbe6806ca30 0x7fbe6806eef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbe6c0043d0 tx=0x7fbe6c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:45.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:45.809+0000 7fbe73fff700 1 -- 172.21.15.26:0/2764636616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fbe64059620 con 0x7fbe7c0f6700 2024-05-09T00:14:46.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.106+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe7c10e5a0 con 0x7fbe7c0f6700 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.106+0000 7fbe73fff700 1 -- 172.21.15.26:0/2764636616 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7fbe640591b0 con 0x7fbe7c0f6700 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:14:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 6 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2, 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2, 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 12 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:14:46.106 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbe6806ca30 msgr2=0x7fbe6806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbe6806ca30 0x7fbe6806eef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbe6c0043d0 tx=0x7fbe6c00b040).stop 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f6700 msgr2=0x7fbe7c107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f6700 0x7fbe7c107f50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fbe64002820 tx=0x7fbe64009f00).stop 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 shutdown_connections 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbe6806ca30 0x7fbe6806eef0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c0f6700 0x7fbe7c107f50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 --2- 172.21.15.26:0/2764636616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7c0f79a0 0x7fbe7c108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 >> 172.21.15.26:0/2764636616 conn(0x7fbe7c0f1e60 msgr2=0x7fbe7c060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:46.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 shutdown_connections 2024-05-09T00:14:46.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.108+0000 7fbe81247700 1 -- 172.21.15.26:0/2764636616 wait complete. 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.214+0000 7efbfa93c700 1 -- 172.21.15.26:0/1006994600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f7a10 msgr2=0x7efbf40f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.214+0000 7efbfa93c700 1 --2- 172.21.15.26:0/1006994600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f7a10 0x7efbf40f7e30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7efbe40047f0 tx=0x7efbe4009cb0).stop 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.214+0000 7efbfa93c700 1 -- 172.21.15.26:0/1006994600 shutdown_connections 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.214+0000 7efbfa93c700 1 --2- 172.21.15.26:0/1006994600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbf40f8cb0 0x7efbf40f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.214+0000 7efbfa93c700 1 --2- 172.21.15.26:0/1006994600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f7a10 0x7efbf40f7e30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.214+0000 7efbfa93c700 1 -- 172.21.15.26:0/1006994600 >> 172.21.15.26:0/1006994600 conn(0x7efbf40f3150 msgr2=0x7efbf40f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.214+0000 7efbfa93c700 1 -- 172.21.15.26:0/1006994600 shutdown_connections 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.214+0000 7efbfa93c700 1 -- 172.21.15.26:0/1006994600 wait complete. 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbfa93c700 1 Processor -- start 2024-05-09T00:14:46.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbfa93c700 1 -- start start 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbfa93c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbf40f7a10 0x7efbf406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbfa93c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f8cb0 0x7efbf406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbfa93c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf406cf80 con 0x7efbf40f8cb0 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbfa93c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf406b520 con 0x7efbf40f7a10 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbf37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f8cb0 0x7efbf406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbf37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f8cb0 0x7efbf406b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35494/0 (socket says 172.21.15.26:35494) 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbf37fe700 1 -- 172.21.15.26:0/3062426111 learned_addr learned my addr 172.21.15.26:0/3062426111 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.215+0000 7efbf3fff700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbf40f7a10 0x7efbf406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbf37fe700 1 -- 172.21.15.26:0/3062426111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbf40f7a10 msgr2=0x7efbf406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbf37fe700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbf40f7a10 0x7efbf406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbf37fe700 1 -- 172.21.15.26:0/3062426111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe4005040 con 0x7efbf40f8cb0 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbf37fe700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f8cb0 0x7efbf406b030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efbe80041d0 tx=0x7efbe8009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbf17fa700 1 -- 172.21.15.26:0/3062426111 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbe8007b40 con 0x7efbf40f8cb0 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf406b7a0 con 0x7efbf40f8cb0 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbf17fa700 1 -- 172.21.15.26:0/3062426111 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efbe800f040 con 0x7efbf40f8cb0 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbf17fa700 1 -- 172.21.15.26:0/3062426111 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbe80147b0 con 0x7efbf40f8cb0 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.216+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf406bd60 con 0x7efbf40f8cb0 2024-05-09T00:14:46.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.217+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf405fb50 con 0x7efbf40f8cb0 2024-05-09T00:14:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.218+0000 7efbf17fa700 1 -- 172.21.15.26:0/3062426111 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efbe8014a50 con 0x7efbf40f8cb0 2024-05-09T00:14:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.218+0000 7efbf17fa700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efbdc06cab0 0x7efbdc06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.218+0000 7efbf17fa700 1 -- 172.21.15.26:0/3062426111 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6309+0+0 (secure 0 0 0) 0x7efbe808be20 con 0x7efbf40f8cb0 2024-05-09T00:14:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.218+0000 7efbf3fff700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efbdc06cab0 0x7efbdc06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.219+0000 7efbf3fff700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efbdc06cab0 0x7efbdc06ef70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7efbe40047c0 tx=0x7efbe4009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:46.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.223+0000 7efbf17fa700 1 -- 172.21.15.26:0/3062426111 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7efbe8059990 con 0x7efbf40f8cb0 2024-05-09T00:14:46.397 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:46 smithi026 ceph-mon[93667]: pgmap v182: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-05-09T00:14:46.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:46 smithi026 ceph-mon[93667]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:46.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:46 smithi026 ceph-mon[93667]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:46.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:46 smithi026 ceph-mon[93667]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:14:46.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:46 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] up:active 2024-05-09T00:14:46.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:46 smithi026 ceph-mon[93667]: fsmap cephfs:1 {0=cephfs.smithi135.lzxgvd=up:active} 3 up:standby 2024-05-09T00:14:46.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:46 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2764636616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:46.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:46 smithi135 ceph-mon[80466]: pgmap v182: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-05-09T00:14:46.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:46 smithi135 ceph-mon[80466]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:46.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:46 smithi135 ceph-mon[80466]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:46.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:46 smithi135 ceph-mon[80466]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:14:46.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:46 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] up:active 2024-05-09T00:14:46.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:46 smithi135 ceph-mon[80466]: fsmap cephfs:1 {0=cephfs.smithi135.lzxgvd=up:active} 3 up:standby 2024-05-09T00:14:46.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:46 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2764636616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.466+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efbf4102110 con 0x7efbf40f8cb0 2024-05-09T00:14:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.466+0000 7efbf17fa700 1 -- 172.21.15.26:0/3062426111 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1849 (secure 0 0 0) 0x7efbe8059520 con 0x7efbf40f8cb0 2024-05-09T00:14:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:e21 2024-05-09T00:14:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:14:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:14:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:14:46.464 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 21 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:14:46.091517+0000 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:14:46.465 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 81 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=24287} 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:14:46.466 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:14:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{0:24287} state up:active seq 155 join_fscid=1 addr [v2:172.21.15.135:6824/1248766098,v1:172.21.15.135:6825/1248766098] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:14:46.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:14:46.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:14:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:14:46.467 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:14:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:24301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:14:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{-1:34400} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:14:46.467 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/666863957,v1:172.21.15.26:6829/666863957] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efbdc06cab0 msgr2=0x7efbdc06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efbdc06cab0 0x7efbdc06ef70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7efbe40047c0 tx=0x7efbe4009cb0).stop 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f8cb0 msgr2=0x7efbf406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f8cb0 0x7efbf406b030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efbe80041d0 tx=0x7efbe8009f60).stop 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 shutdown_connections 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efbdc06cab0 0x7efbdc06ef70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbf40f7a10 0x7efbf406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 --2- 172.21.15.26:0/3062426111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efbf40f8cb0 0x7efbf406b030 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 >> 172.21.15.26:0/3062426111 conn(0x7efbf40f3150 msgr2=0x7efbf40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 shutdown_connections 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.468+0000 7efbfa93c700 1 -- 172.21.15.26:0/3062426111 wait complete. 2024-05-09T00:14:46.468 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2024-05-09T00:14:46.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.571+0000 7f73c238a700 1 -- 172.21.15.26:0/3690438228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f7a10 msgr2=0x7f73bc0f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.571+0000 7f73c238a700 1 --2- 172.21.15.26:0/3690438228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f7a10 0x7f73bc0f7e30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f73ac0047f0 tx=0x7f73ac009cb0).stop 2024-05-09T00:14:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.571+0000 7f73c238a700 1 -- 172.21.15.26:0/3690438228 shutdown_connections 2024-05-09T00:14:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.571+0000 7f73c238a700 1 --2- 172.21.15.26:0/3690438228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0f8cb0 0x7f73bc0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.571+0000 7f73c238a700 1 --2- 172.21.15.26:0/3690438228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f7a10 0x7f73bc0f7e30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.571+0000 7f73c238a700 1 -- 172.21.15.26:0/3690438228 >> 172.21.15.26:0/3690438228 conn(0x7f73bc0f3150 msgr2=0x7f73bc0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.571+0000 7f73c238a700 1 -- 172.21.15.26:0/3690438228 shutdown_connections 2024-05-09T00:14:46.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.572+0000 7f73c238a700 1 -- 172.21.15.26:0/3690438228 wait complete. 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.572+0000 7f73c238a700 1 Processor -- start 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.572+0000 7f73c238a700 1 -- start start 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.572+0000 7f73c238a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0f7a10 0x7f73bc06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.572+0000 7f73c238a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f8cb0 0x7f73bc06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.572+0000 7f73c238a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc06cf80 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.572+0000 7f73c238a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc06b520 con 0x7f73bc0f7a10 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f8cb0 0x7f73bc06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73bb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f8cb0 0x7f73bc06b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35512/0 (socket says 172.21.15.26:35512) 2024-05-09T00:14:46.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73bb7fe700 1 -- 172.21.15.26:0/2141361072 learned_addr learned my addr 172.21.15.26:0/2141361072 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73bbfff700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0f7a10 0x7f73bc06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73bb7fe700 1 -- 172.21.15.26:0/2141361072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0f7a10 msgr2=0x7f73bc06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73bb7fe700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0f7a10 0x7f73bc06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73bb7fe700 1 -- 172.21.15.26:0/2141361072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac005040 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73bb7fe700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f8cb0 0x7f73bc06b030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f73b00041d0 tx=0x7f73b0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73b97fa700 1 -- 172.21.15.26:0/2141361072 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73b0007b40 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73b97fa700 1 -- 172.21.15.26:0/2141361072 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73b000f040 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc06b7a0 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73b97fa700 1 -- 172.21.15.26:0/2141361072 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73b00137d0 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.573+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc06bd60 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.574+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc05fb50 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.575+0000 7f73b97fa700 1 -- 172.21.15.26:0/2141361072 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f73b0007ca0 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.575+0000 7f73b97fa700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f73a406caa0 0x7f73a406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.575+0000 7f73b97fa700 1 -- 172.21.15.26:0/2141361072 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6309+0+0 (secure 0 0 0) 0x7f73b008b810 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.575+0000 7f73bbfff700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f73a406caa0 0x7f73a406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.576+0000 7f73bbfff700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f73a406caa0 0x7f73a406ef60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f73ac004f10 tx=0x7f73ac00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:46.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.580+0000 7f73b97fa700 1 -- 172.21.15.26:0/2141361072 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f73b0059310 con 0x7f73bc0f8cb0 2024-05-09T00:14:46.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.819+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73bc1021a0 con 0x7f73a406caa0 2024-05-09T00:14:46.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.821+0000 7f73b97fa700 1 -- 172.21.15.26:0/2141361072 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f73bc1021a0 con 0x7f73a406caa0 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "osd", 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "13/21 daemons upgraded", 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:14:46.819 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f73a406caa0 msgr2=0x7f73a406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f73a406caa0 0x7f73a406ef60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f73ac004f10 tx=0x7f73ac00b040).stop 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f8cb0 msgr2=0x7f73bc06b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f8cb0 0x7f73bc06b030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f73b00041d0 tx=0x7f73b0009f60).stop 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 shutdown_connections 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f73a406caa0 0x7f73a406ef60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73bc0f7a10 0x7f73bc06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 --2- 172.21.15.26:0/2141361072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73bc0f8cb0 0x7f73bc06b030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 >> 172.21.15.26:0/2141361072 conn(0x7f73bc0f3150 msgr2=0x7f73bc0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 shutdown_connections 2024-05-09T00:14:46.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.824+0000 7f73c238a700 1 -- 172.21.15.26:0/2141361072 wait complete. 2024-05-09T00:14:46.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 -- 172.21.15.26:0/961903453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 msgr2=0x7f0ac00fa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 --2- 172.21.15.26:0/961903453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 0x7f0ac00fa450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f0ab00047f0 tx=0x7f0ab0009cb0).stop 2024-05-09T00:14:46.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 -- 172.21.15.26:0/961903453 shutdown_connections 2024-05-09T00:14:46.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 --2- 172.21.15.26:0/961903453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ac00fa940 0x7f0ac00fcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 --2- 172.21.15.26:0/961903453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 0x7f0ac00fa450 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 -- 172.21.15.26:0/961903453 >> 172.21.15.26:0/961903453 conn(0x7f0ac00f1eb0 msgr2=0x7f0ac00f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:46.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 -- 172.21.15.26:0/961903453 shutdown_connections 2024-05-09T00:14:46.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 -- 172.21.15.26:0/961903453 wait complete. 2024-05-09T00:14:46.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.935+0000 7f0ac55c5700 1 Processor -- start 2024-05-09T00:14:46.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0ac55c5700 1 -- start start 2024-05-09T00:14:46.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0ac55c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 0x7f0ac0108110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0ac55c5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ac00fa940 0x7f0ac0108600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0ac55c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0108bb0 con 0x7f0ac0061790 2024-05-09T00:14:46.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0ac55c5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0108cf0 con 0x7f0ac00fa940 2024-05-09T00:14:46.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0abeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 0x7f0ac0108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0abeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 0x7f0ac0108110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35534/0 (socket says 172.21.15.26:35534) 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0abeffd700 1 -- 172.21.15.26:0/553544054 learned_addr learned my addr 172.21.15.26:0/553544054 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0abe7fc700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ac00fa940 0x7f0ac0108600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0abeffd700 1 -- 172.21.15.26:0/553544054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ac00fa940 msgr2=0x7f0ac0108600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0abeffd700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ac00fa940 0x7f0ac0108600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.936+0000 7f0abeffd700 1 -- 172.21.15.26:0/553544054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab0005040 con 0x7f0ac0061790 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.937+0000 7f0abeffd700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 0x7f0ac0108110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f0ab0000c00 tx=0x7f0ab0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.937+0000 7f0aa7fff700 1 -- 172.21.15.26:0/553544054 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab0018070 con 0x7f0ac0061790 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.937+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac010d730 con 0x7f0ac0061790 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.937+0000 7f0aa7fff700 1 -- 172.21.15.26:0/553544054 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ab0007e90 con 0x7f0ac0061790 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.937+0000 7f0aa7fff700 1 -- 172.21.15.26:0/553544054 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab00123c0 con 0x7f0ac0061790 2024-05-09T00:14:46.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.937+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac010dcf0 con 0x7f0ac0061790 2024-05-09T00:14:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.938+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac00fffb0 con 0x7f0ac0061790 2024-05-09T00:14:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.939+0000 7f0aa7fff700 1 -- 172.21.15.26:0/553544054 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0ab001d420 con 0x7f0ac0061790 2024-05-09T00:14:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.939+0000 7f0aa7fff700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f0aa806caa0 0x7f0aa806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:14:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.939+0000 7f0aa7fff700 1 -- 172.21.15.26:0/553544054 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6309+0+0 (secure 0 0 0) 0x7f0ab008ca60 con 0x7f0ac0061790 2024-05-09T00:14:46.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.939+0000 7f0abe7fc700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f0aa806caa0 0x7f0aa806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:46.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.940+0000 7f0abe7fc700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f0aa806caa0 0x7f0aa806ef60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0ab40092f0 tx=0x7f0ab400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:46.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:46.944+0000 7f0aa7fff700 1 -- 172.21.15.26:0/553544054 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f0ab005a560 con 0x7f0ac0061790 2024-05-09T00:14:47.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.238+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0ac0101e20 con 0x7f0ac0061790 2024-05-09T00:14:47.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.238+0000 7f0aa7fff700 1 -- 172.21.15.26:0/553544054 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0ab005a0f0 con 0x7f0ac0061790 2024-05-09T00:14:47.236 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:14:47.236 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:14:47.236 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:14:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f0aa806caa0 msgr2=0x7f0aa806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f0aa806caa0 0x7f0aa806ef60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f0ab40092f0 tx=0x7f0ab400b040).stop 2024-05-09T00:14:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 msgr2=0x7f0ac0108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 0x7f0ac0108110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f0ab0000c00 tx=0x7f0ab0009cb0).stop 2024-05-09T00:14:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 shutdown_connections 2024-05-09T00:14:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f0aa806caa0 0x7f0aa806ef60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:47.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ac0061790 0x7f0ac0108110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 --2- 172.21.15.26:0/553544054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ac00fa940 0x7f0ac0108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:14:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 >> 172.21.15.26:0/553544054 conn(0x7f0ac00f1eb0 msgr2=0x7f0ac00f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 shutdown_connections 2024-05-09T00:14:47.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:14:47.240+0000 7f0ac55c5700 1 -- 172.21.15.26:0/553544054 wait complete. 2024-05-09T00:14:47.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:47 smithi026 ceph-mon[93667]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:47.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:47 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3062426111' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:14:47.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:47 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:47.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:47 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:47.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:47 smithi135 ceph-mon[80466]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:47.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:47 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3062426111' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:14:47.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:47 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:47.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:47 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:48.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:48 smithi026 ceph-mon[93667]: pgmap v183: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-09T00:14:48.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:48 smithi026 ceph-mon[93667]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:48.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:48 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/553544054' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:14:48.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:48 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:48.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:48 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:48.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:48 smithi135 ceph-mon[80466]: pgmap v183: 65 pgs: 65 active+clean; 196 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-09T00:14:48.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:48 smithi135 ceph-mon[80466]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:48.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:48 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/553544054' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:14:48.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:48 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:48.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:48 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:50.641 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:50 smithi026 ceph-mon[93667]: pgmap v184: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 6 op/s 2024-05-09T00:14:50.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:50 smithi135 ceph-mon[80466]: pgmap v184: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 6 op/s 2024-05-09T00:14:51.897 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:51 smithi026 ceph-mon[93667]: pgmap v185: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-05-09T00:14:51.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:51.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:14:51.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:51.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:51.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:51.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:51.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:51.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:51 smithi135 ceph-mon[80466]: pgmap v185: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-05-09T00:14:51.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:51.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:14:51.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:51.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:51.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:51.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:51.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:52.778 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:52 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:52.778 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:52 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:52.778 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:52 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:52.778 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:52 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:52.778 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:52 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:52.778 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:52 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi135.lzxgvd"]}]: dispatch 2024-05-09T00:14:52.779 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:52 smithi135 ceph-mon[80466]: Upgrade: It appears safe to stop mds.cephfs.smithi135.lzxgvd 2024-05-09T00:14:52.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:52 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:52.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:52 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:52.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:52 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:52.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:52 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:52.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:52 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:14:52.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:52 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi135.lzxgvd"]}]: dispatch 2024-05-09T00:14:52.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:52 smithi026 ceph-mon[93667]: Upgrade: It appears safe to stop mds.cephfs.smithi135.lzxgvd 2024-05-09T00:14:54.551 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:54 smithi135 ceph-mon[80466]: pgmap v186: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:54.551 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:54 smithi135 ceph-mon[80466]: Upgrade: Updating mds.cephfs.smithi135.lzxgvd 2024-05-09T00:14:54.551 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:54.551 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lzxgvd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:14:54.551 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:54.551 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:54 smithi135 ceph-mon[80466]: Deploying daemon mds.cephfs.smithi135.lzxgvd on smithi135 2024-05-09T00:14:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:54 smithi026 ceph-mon[93667]: pgmap v186: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:54 smithi026 ceph-mon[93667]: Upgrade: Updating mds.cephfs.smithi135.lzxgvd 2024-05-09T00:14:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:14:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lzxgvd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:14:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:54 smithi026 ceph-mon[93667]: Deploying daemon mds.cephfs.smithi135.lzxgvd on smithi135 2024-05-09T00:14:55.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[93644]: 2024-05-09T00:14:54.999+0000 7fe4684f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:55.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:55 smithi026 ceph-mon[93667]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:14:55.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:55 smithi026 ceph-mon[93667]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:55.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:55 smithi026 ceph-mon[93667]: osdmap e82: 6 total, 6 up, 6 in 2024-05-09T00:14:55.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:55 smithi026 ceph-mon[93667]: Standby daemon mds.cephfs.smithi135.hcciyw assigned to filesystem cephfs as rank 0 2024-05-09T00:14:55.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:55 smithi026 ceph-mon[93667]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:14:55.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:55 smithi026 ceph-mon[93667]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T00:14:55.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:55 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi135.hcciyw=up:replay} 2 up:standby 2024-05-09T00:14:55.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:55 smithi135 ceph-mon[80466]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:14:55.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:55 smithi135 ceph-mon[80466]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:14:55.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:55 smithi135 ceph-mon[80466]: osdmap e82: 6 total, 6 up, 6 in 2024-05-09T00:14:55.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:55 smithi135 ceph-mon[80466]: Standby daemon mds.cephfs.smithi135.hcciyw assigned to filesystem cephfs as rank 0 2024-05-09T00:14:55.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:55 smithi135 ceph-mon[80466]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:14:55.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:55 smithi135 ceph-mon[80466]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T00:14:55.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:55 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi135.hcciyw=up:replay} 2 up:standby 2024-05-09T00:14:55.401 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:14:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:14:55.024+0000 7f2074ffe700 -1 bdev(0x55c99e57c000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-05-09T00:14:55.401 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:14:55 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:14:55.025+0000 7f20727f9700 -1 bdev(0x55c99e57c000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-05-09T00:14:56.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:56 smithi026 ceph-mon[93667]: pgmap v187: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:56.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:56 smithi135 ceph-mon[80466]: pgmap v187: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:14:57.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:57 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:14:57.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:57 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:14:58.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:14:58 smithi026 ceph-mon[93667]: pgmap v189: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-09T00:14:58.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:14:58 smithi135 ceph-mon[80466]: pgmap v189: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-09T00:15:00.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:00 smithi026 ceph-mon[93667]: pgmap v190: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-05-09T00:15:00.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:00 smithi135 ceph-mon[80466]: pgmap v190: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-05-09T00:15:02.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:02 smithi026 ceph-mon[93667]: pgmap v191: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T00:15:02.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:02 smithi135 ceph-mon[80466]: pgmap v191: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-05-09T00:15:04.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:04 smithi026 ceph-mon[93667]: pgmap v192: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T00:15:04.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:04 smithi135 ceph-mon[80466]: pgmap v192: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T00:15:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:06 smithi026 ceph-mon[93667]: pgmap v193: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-05-09T00:15:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:06 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] up:reconnect 2024-05-09T00:15:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:06 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi135.hcciyw=up:reconnect} 2 up:standby 2024-05-09T00:15:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:06 smithi026 ceph-mon[93667]: reconnect by client.14502 v1:172.21.15.135:0/1350715060 after 0.00399991 2024-05-09T00:15:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:06 smithi026 ceph-mon[93667]: reconnect by client.14496 v1:192.168.0.1:0/3285800047 after 0.00399991 2024-05-09T00:15:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:15:06.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:06 smithi135 ceph-mon[80466]: pgmap v193: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-05-09T00:15:06.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:06 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] up:reconnect 2024-05-09T00:15:06.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:06 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi135.hcciyw=up:reconnect} 2 up:standby 2024-05-09T00:15:06.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:06 smithi135 ceph-mon[80466]: reconnect by client.14502 v1:172.21.15.135:0/1350715060 after 0.00399991 2024-05-09T00:15:06.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:06 smithi135 ceph-mon[80466]: reconnect by client.14496 v1:192.168.0.1:0/3285800047 after 0.00399991 2024-05-09T00:15:06.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:06.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:15:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:07 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] up:rejoin 2024-05-09T00:15:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:07 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi135.hcciyw=up:rejoin} 2 up:standby 2024-05-09T00:15:07.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:07 smithi026 ceph-mon[93667]: daemon mds.cephfs.smithi135.hcciyw is now active in filesystem cephfs as rank 0 2024-05-09T00:15:07.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:07 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] up:rejoin 2024-05-09T00:15:07.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:07 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi135.hcciyw=up:rejoin} 2 up:standby 2024-05-09T00:15:07.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:07 smithi135 ceph-mon[80466]: daemon mds.cephfs.smithi135.hcciyw is now active in filesystem cephfs as rank 0 2024-05-09T00:15:08.527 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:08 smithi135 ceph-mon[80466]: pgmap v194: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-09T00:15:08.527 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:08 smithi135 ceph-mon[80466]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:15:08.527 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:08 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] up:active 2024-05-09T00:15:08.527 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:08 smithi135 ceph-mon[80466]: fsmap cephfs:1 {0=cephfs.smithi135.hcciyw=up:active} 2 up:standby 2024-05-09T00:15:08.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:08 smithi026 ceph-mon[93667]: pgmap v194: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-05-09T00:15:08.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:08 smithi026 ceph-mon[93667]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:15:08.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:08 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] up:active 2024-05-09T00:15:08.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:08 smithi026 ceph-mon[93667]: fsmap cephfs:1 {0=cephfs.smithi135.hcciyw=up:active} 2 up:standby 2024-05-09T00:15:10.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:10 smithi026 ceph-mon[93667]: pgmap v195: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 6 op/s 2024-05-09T00:15:10.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:10 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:10.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:10 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:10.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:10 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.135:6824/2979557079,v1:172.21.15.135:6825/2979557079] up:boot 2024-05-09T00:15:10.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:10 smithi026 ceph-mon[93667]: fsmap cephfs:1 {0=cephfs.smithi135.hcciyw=up:active} 3 up:standby 2024-05-09T00:15:10.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:10 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:15:10.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:10 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:10.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:10 smithi135 ceph-mon[80466]: pgmap v195: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 6 op/s 2024-05-09T00:15:10.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:10 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:10.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:10 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:10.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:10 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.135:6824/2979557079,v1:172.21.15.135:6825/2979557079] up:boot 2024-05-09T00:15:10.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:10 smithi135 ceph-mon[80466]: fsmap cephfs:1 {0=cephfs.smithi135.hcciyw=up:active} 3 up:standby 2024-05-09T00:15:10.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:10 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:15:10.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:10 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:12.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:12 smithi026 ceph-mon[93667]: pgmap v196: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T00:15:12.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:12 smithi135 ceph-mon[80466]: pgmap v196: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T00:15:14.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:13 smithi135 ceph-mon[80466]: pgmap v197: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T00:15:14.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:13 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:14.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:13 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:14.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:13 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:14.147 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:13 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:14.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:13 smithi026 ceph-mon[93667]: pgmap v197: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T00:15:14.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:13 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:14.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:13 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:14.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:13 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:14.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:13 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:16.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:15 smithi026 ceph-mon[93667]: pgmap v198: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:15:16.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:15 smithi135 ceph-mon[80466]: pgmap v198: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 -- 172.21.15.26:0/3200351088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 msgr2=0x7f1c7c0f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 --2- 172.21.15.26:0/3200351088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 0x7f1c7c0f7c20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f1c780047f0 tx=0x7f1c78009cb0).stop 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 -- 172.21.15.26:0/3200351088 shutdown_connections 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 --2- 172.21.15.26:0/3200351088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c0f8aa0 0x7f1c7c0f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 --2- 172.21.15.26:0/3200351088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 0x7f1c7c0f7c20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 -- 172.21.15.26:0/3200351088 >> 172.21.15.26:0/3200351088 conn(0x7f1c7c0f2f80 msgr2=0x7f1c7c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 -- 172.21.15.26:0/3200351088 shutdown_connections 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 -- 172.21.15.26:0/3200351088 wait complete. 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 Processor -- start 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.354+0000 7f1c83267700 1 -- start start 2024-05-09T00:15:17.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c83267700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 0x7f1c7c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c83267700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c0f8aa0 0x7f1c7c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c83267700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c06cf80 con 0x7f1c7c0f7800 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c83267700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c06b520 con 0x7f1c7c0f8aa0 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c81003700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 0x7f1c7c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c81003700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 0x7f1c7c06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57584/0 (socket says 172.21.15.26:57584) 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c81003700 1 -- 172.21.15.26:0/874005720 learned_addr learned my addr 172.21.15.26:0/874005720 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c80802700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c0f8aa0 0x7f1c7c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c81003700 1 -- 172.21.15.26:0/874005720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c0f8aa0 msgr2=0x7f1c7c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c81003700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c0f8aa0 0x7f1c7c06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c81003700 1 -- 172.21.15.26:0/874005720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78005040 con 0x7f1c7c0f7800 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c81003700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 0x7f1c7c06c9d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1c78013560 tx=0x7f1c78009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c6e777700 1 -- 172.21.15.26:0/874005720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c78018070 con 0x7f1c7c0f7800 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c6e777700 1 -- 172.21.15.26:0/874005720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c78007e90 con 0x7f1c7c0f7800 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.355+0000 7f1c6e777700 1 -- 172.21.15.26:0/874005720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c7801c5e0 con 0x7f1c7c0f7800 2024-05-09T00:15:17.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.356+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c06b740 con 0x7f1c7c0f7800 2024-05-09T00:15:17.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.356+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c06bc50 con 0x7f1c7c0f7800 2024-05-09T00:15:17.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.357+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c047540 con 0x7f1c7c0f7800 2024-05-09T00:15:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.357+0000 7f1c6e777700 1 -- 172.21.15.26:0/874005720 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1c780123c0 con 0x7f1c7c0f7800 2024-05-09T00:15:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.358+0000 7f1c6e777700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1c6806caa0 0x7f1c6806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.358+0000 7f1c80802700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1c6806caa0 0x7f1c6806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.358+0000 7f1c6e777700 1 -- 172.21.15.26:0/874005720 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6395+0+0 (secure 0 0 0) 0x7f1c7808ccd0 con 0x7f1c7c0f7800 2024-05-09T00:15:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.358+0000 7f1c80802700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1c6806caa0 0x7f1c6806ef60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1c700092f0 tx=0x7f1c7000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.362+0000 7f1c6e777700 1 -- 172.21.15.26:0/874005720 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f1c7805a840 con 0x7f1c7c0f7800 2024-05-09T00:15:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.580+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c7c059120 con 0x7f1c6806caa0 2024-05-09T00:15:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.581+0000 7f1c6e777700 1 -- 172.21.15.26:0/874005720 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1c7c059120 con 0x7f1c6806caa0 2024-05-09T00:15:17.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1c6806caa0 msgr2=0x7f1c6806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1c6806caa0 0x7f1c6806ef60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1c700092f0 tx=0x7f1c7000b040).stop 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 msgr2=0x7f1c7c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 0x7f1c7c06c9d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1c78013560 tx=0x7f1c78009cb0).stop 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 shutdown_connections 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f1c6806caa0 0x7f1c6806ef60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c7c0f7800 0x7f1c7c06c9d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 --2- 172.21.15.26:0/874005720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c7c0f8aa0 0x7f1c7c06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 >> 172.21.15.26:0/874005720 conn(0x7f1c7c0f2f80 msgr2=0x7f1c7c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 shutdown_connections 2024-05-09T00:15:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.583+0000 7f1c83267700 1 -- 172.21.15.26:0/874005720 wait complete. 2024-05-09T00:15:17.593 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:15:17.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.686+0000 7ff7d4602700 1 -- 172.21.15.26:0/2479860965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 msgr2=0x7ff7cc0f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:17.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.686+0000 7ff7d4602700 1 --2- 172.21.15.26:0/2479860965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 0x7ff7cc0f5f30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ff7bc0047f0 tx=0x7ff7bc009cb0).stop 2024-05-09T00:15:17.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.686+0000 7ff7d4602700 1 -- 172.21.15.26:0/2479860965 shutdown_connections 2024-05-09T00:15:17.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.686+0000 7ff7d4602700 1 --2- 172.21.15.26:0/2479860965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc0f64b0 0x7ff7cc0f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.686+0000 7ff7d4602700 1 --2- 172.21.15.26:0/2479860965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 0x7ff7cc0f5f30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.686+0000 7ff7d4602700 1 -- 172.21.15.26:0/2479860965 >> 172.21.15.26:0/2479860965 conn(0x7ff7cc0f1610 msgr2=0x7ff7cc0f3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.686+0000 7ff7d4602700 1 -- 172.21.15.26:0/2479860965 shutdown_connections 2024-05-09T00:15:17.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.686+0000 7ff7d4602700 1 -- 172.21.15.26:0/2479860965 wait complete. 2024-05-09T00:15:17.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d4602700 1 Processor -- start 2024-05-09T00:15:17.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d4602700 1 -- start start 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d4602700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 0x7ff7cc108070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d4602700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc0f64b0 0x7ff7cc108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d4602700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc108ba0 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d4602700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc108ce0 con 0x7ff7cc0f64b0 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d239e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 0x7ff7cc108070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d239e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 0x7ff7cc108070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57596/0 (socket says 172.21.15.26:57596) 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d239e700 1 -- 172.21.15.26:0/361794658 learned_addr learned my addr 172.21.15.26:0/361794658 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d1b9d700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc0f64b0 0x7ff7cc108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d239e700 1 -- 172.21.15.26:0/361794658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc0f64b0 msgr2=0x7ff7cc108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d239e700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc0f64b0 0x7ff7cc108560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.687+0000 7ff7d239e700 1 -- 172.21.15.26:0/361794658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc005040 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.688+0000 7ff7d239e700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 0x7ff7cc108070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff7bc00b120 tx=0x7ff7bc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.688+0000 7ff7c37fe700 1 -- 172.21.15.26:0/361794658 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7bc00e030 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.688+0000 7ff7c37fe700 1 -- 172.21.15.26:0/361794658 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff7bc007e90 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.688+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc10d720 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.688+0000 7ff7c37fe700 1 -- 172.21.15.26:0/361794658 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7bc018070 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.688+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc10dc00 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.689+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc100060 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.689+0000 7ff7c37fe700 1 -- 172.21.15.26:0/361794658 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff7bc01d420 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.690+0000 7ff7c37fe700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff7b806ca80 0x7ff7b806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:17.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.690+0000 7ff7c37fe700 1 -- 172.21.15.26:0/361794658 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6395+0+0 (secure 0 0 0) 0x7ff7bc08d3b0 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.690+0000 7ff7d1b9d700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff7b806ca80 0x7ff7b806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:17.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.690+0000 7ff7d1b9d700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff7b806ca80 0x7ff7b806ef40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff7c8006fd0 tx=0x7ff7c8009060).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:17.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.694+0000 7ff7c37fe700 1 -- 172.21.15.26:0/361794658 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7ff7bc05ae60 con 0x7ff7cc0f5b10 2024-05-09T00:15:17.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.912+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7cc059120 con 0x7ff7b806ca80 2024-05-09T00:15:17.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.913+0000 7ff7c37fe700 1 -- 172.21.15.26:0/361794658 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff7cc059120 con 0x7ff7b806ca80 2024-05-09T00:15:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff7b806ca80 msgr2=0x7ff7b806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff7b806ca80 0x7ff7b806ef40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff7c8006fd0 tx=0x7ff7c8009060).stop 2024-05-09T00:15:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 msgr2=0x7ff7cc108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 0x7ff7cc108070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff7bc00b120 tx=0x7ff7bc009cb0).stop 2024-05-09T00:15:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 shutdown_connections 2024-05-09T00:15:17.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff7b806ca80 0x7ff7b806ef40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7cc0f5b10 0x7ff7cc108070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 --2- 172.21.15.26:0/361794658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7cc0f64b0 0x7ff7cc108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 >> 172.21.15.26:0/361794658 conn(0x7ff7cc0f1610 msgr2=0x7ff7cc0fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 shutdown_connections 2024-05-09T00:15:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:17.915+0000 7ff7d4602700 1 -- 172.21.15.26:0/361794658 wait complete. 2024-05-09T00:15:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.017+0000 7f33d0493700 1 -- 172.21.15.26:0/2097128401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f7a10 msgr2=0x7f33c80f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.017+0000 7f33d0493700 1 --2- 172.21.15.26:0/2097128401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f7a10 0x7f33c80f7e30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f33c40047f0 tx=0x7f33c4009cb0).stop 2024-05-09T00:15:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.017+0000 7f33d0493700 1 -- 172.21.15.26:0/2097128401 shutdown_connections 2024-05-09T00:15:18.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.017+0000 7f33d0493700 1 --2- 172.21.15.26:0/2097128401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33c80f8cb0 0x7f33c80f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.017+0000 7f33d0493700 1 --2- 172.21.15.26:0/2097128401 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f7a10 0x7f33c80f7e30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.017+0000 7f33d0493700 1 -- 172.21.15.26:0/2097128401 >> 172.21.15.26:0/2097128401 conn(0x7f33c80f3150 msgr2=0x7f33c80f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:18.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.017+0000 7f33d0493700 1 -- 172.21.15.26:0/2097128401 shutdown_connections 2024-05-09T00:15:18.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.017+0000 7f33d0493700 1 -- 172.21.15.26:0/2097128401 wait complete. 2024-05-09T00:15:18.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33d0493700 1 Processor -- start 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33d0493700 1 -- start start 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33d0493700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33c80f7a10 0x7f33c806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33d0493700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f8cb0 0x7f33c806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33d0493700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c806cf80 con 0x7f33c80f8cb0 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33d0493700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c806b520 con 0x7f33c80f7a10 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33cda2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f8cb0 0x7f33c806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33cda2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f8cb0 0x7f33c806b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57610/0 (socket says 172.21.15.26:57610) 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33cda2e700 1 -- 172.21.15.26:0/1215275226 learned_addr learned my addr 172.21.15.26:0/1215275226 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33ce22f700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33c80f7a10 0x7f33c806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33cda2e700 1 -- 172.21.15.26:0/1215275226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33c80f7a10 msgr2=0x7f33c806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33cda2e700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33c80f7a10 0x7f33c806c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.018+0000 7f33cda2e700 1 -- 172.21.15.26:0/1215275226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4005040 con 0x7f33c80f8cb0 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.019+0000 7f33cda2e700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f8cb0 0x7f33c806b030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f33bc00e8f0 tx=0x7f33bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:18.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.019+0000 7f33bb7fe700 1 -- 172.21.15.26:0/1215275226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33bc00ee90 con 0x7f33c80f8cb0 2024-05-09T00:15:18.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.019+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c806b7a0 con 0x7f33c80f8cb0 2024-05-09T00:15:18.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.019+0000 7f33bb7fe700 1 -- 172.21.15.26:0/1215275226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f33bc00f040 con 0x7f33c80f8cb0 2024-05-09T00:15:18.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.019+0000 7f33bb7fe700 1 -- 172.21.15.26:0/1215275226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33bc00c8a0 con 0x7f33c80f8cb0 2024-05-09T00:15:18.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.019+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c806bd60 con 0x7f33c80f8cb0 2024-05-09T00:15:18.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.020+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c805fb50 con 0x7f33c80f8cb0 2024-05-09T00:15:18.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.020+0000 7f33bb7fe700 1 -- 172.21.15.26:0/1215275226 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f33bc007b40 con 0x7f33c80f8cb0 2024-05-09T00:15:18.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.021+0000 7f33bb7fe700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f33b406caa0 0x7f33b406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.021+0000 7f33bb7fe700 1 -- 172.21.15.26:0/1215275226 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6395+0+0 (secure 0 0 0) 0x7f33bc08bb10 con 0x7f33c80f8cb0 2024-05-09T00:15:18.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.021+0000 7f33ce22f700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f33b406caa0 0x7f33b406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.021+0000 7f33ce22f700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f33b406caa0 0x7f33b406ef60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f33c4004e60 tx=0x7f33c400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:18.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.025+0000 7f33bb7fe700 1 -- 172.21.15.26:0/1215275226 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f33bc0595c0 con 0x7f33c80f8cb0 2024-05-09T00:15:18.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: pgmap v199: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T00:15:18.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: Detected new or changed devices on smithi135 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi135.hcciyw"]}]: dispatch 2024-05-09T00:15:18.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:17 smithi135 ceph-mon[80466]: Upgrade: It appears safe to stop mds.cephfs.smithi135.hcciyw 2024-05-09T00:15:18.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.233+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f33c8102150 con 0x7f33b406caa0 2024-05-09T00:15:18.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.243+0000 7f33bb7fe700 1 -- 172.21.15.26:0/1215275226 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f33c8102150 con 0x7f33b406caa0 2024-05-09T00:15:18.242 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:15:18.242 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (7m) 31s ago 16m 23.9M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (4m) 31s ago 15m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (4m) 5s ago 15m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (6m) 31s ago 15m 55.4M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (35s) 31s ago 10m 12.6M - 18.2.2-1322-gd21e4f96 af23193ff691 d186720df096 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (59s) 31s ago 10m 12.4M - 18.2.2-1322-gd21e4f96 af23193ff691 4083eb8ff427 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (10m) 5s ago 10m 90.6M - 16.2.15-1-g8963e9de 727f386679cb 5a74c070d941 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (9s) 5s ago 10m 14.8M - 18.2.2-1322-gd21e4f96 af23193ff691 20dc7cc555ea 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (6m) 31s ago 17m 507M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (5m) 5s ago 15m 452M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (5m) 31s ago 17m 50.3M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (5m) 5s ago 15m 45.6M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (6m) 31s ago 15m 25.9M - 1.3.1 1dbe0e931976 7e91ab9785cf 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (6m) 5s ago 15m 25.2M - 1.3.1 1dbe0e931976 9f6868e3d7fa 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (4m) 31s ago 14m 109M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (3m) 31s ago 14m 115M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:15:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (2m) 31s ago 13m 103M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:15:18.244 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (2m) 5s ago 13m 121M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:15:18.244 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (113s) 5s ago 12m 103M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 a23ab54b2270 2024-05-09T00:15:18.244 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (81s) 5s ago 12m 99.1M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 df906a6613b1 2024-05-09T00:15:18.244 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (5m) 5s ago 14m 74.5M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:15:18.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f33b406caa0 msgr2=0x7f33b406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f33b406caa0 0x7f33b406ef60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f33c4004e60 tx=0x7f33c400b040).stop 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f8cb0 msgr2=0x7f33c806b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f8cb0 0x7f33c806b030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f33bc00e8f0 tx=0x7f33bc00b040).stop 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 shutdown_connections 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f33b406caa0 0x7f33b406ef60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33c80f7a10 0x7f33c806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 --2- 172.21.15.26:0/1215275226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c80f8cb0 0x7f33c806b030 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.245+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 >> 172.21.15.26:0/1215275226 conn(0x7f33c80f3150 msgr2=0x7f33c80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.246+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 shutdown_connections 2024-05-09T00:15:18.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.246+0000 7f33d0493700 1 -- 172.21.15.26:0/1215275226 wait complete. 2024-05-09T00:15:18.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.346+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2652291932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 msgr2=0x7fcfc00fa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.346+0000 7fcfc7b16700 1 --2- 172.21.15.26:0/2652291932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 0x7fcfc00fa450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fcfbc0047f0 tx=0x7fcfbc009cb0).stop 2024-05-09T00:15:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.346+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2652291932 shutdown_connections 2024-05-09T00:15:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.346+0000 7fcfc7b16700 1 --2- 172.21.15.26:0/2652291932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00fa9d0 0x7fcfc00fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.346+0000 7fcfc7b16700 1 --2- 172.21.15.26:0/2652291932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 0x7fcfc00fa450 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.346+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2652291932 >> 172.21.15.26:0/2652291932 conn(0x7fcfc00f1e90 msgr2=0x7fcfc00f42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.346+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2652291932 shutdown_connections 2024-05-09T00:15:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.346+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2652291932 wait complete. 2024-05-09T00:15:18.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.347+0000 7fcfc7b16700 1 Processor -- start 2024-05-09T00:15:18.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.347+0000 7fcfc7b16700 1 -- start start 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc7b16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 0x7fcfc01080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc7b16700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00fa9d0 0x7fcfc01085b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc7b16700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0108b60 con 0x7fcfc0061260 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc7b16700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0108ca0 con 0x7fcfc00fa9d0 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc58b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 0x7fcfc01080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc58b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 0x7fcfc01080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57632/0 (socket says 172.21.15.26:57632) 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc58b2700 1 -- 172.21.15.26:0/2696536493 learned_addr learned my addr 172.21.15.26:0/2696536493 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc50b1700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00fa9d0 0x7fcfc01085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc58b2700 1 -- 172.21.15.26:0/2696536493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00fa9d0 msgr2=0x7fcfc01085b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc58b2700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00fa9d0 0x7fcfc01085b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc58b2700 1 -- 172.21.15.26:0/2696536493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc005040 con 0x7fcfc0061260 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc58b2700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 0x7fcfc01080c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fcfbc013560 tx=0x7fcfbc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfb2ffd700 1 -- 172.21.15.26:0/2696536493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfbc018070 con 0x7fcfc0061260 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc010d6e0 con 0x7fcfc0061260 2024-05-09T00:15:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfb2ffd700 1 -- 172.21.15.26:0/2696536493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcfbc007e90 con 0x7fcfc0061260 2024-05-09T00:15:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfb2ffd700 1 -- 172.21.15.26:0/2696536493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfbc01c380 con 0x7fcfc0061260 2024-05-09T00:15:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.348+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc010dca0 con 0x7fcfc0061260 2024-05-09T00:15:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.349+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc0100020 con 0x7fcfc0061260 2024-05-09T00:15:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.350+0000 7fcfb2ffd700 1 -- 172.21.15.26:0/2696536493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcfbc0123c0 con 0x7fcfc0061260 2024-05-09T00:15:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.350+0000 7fcfb2ffd700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfac06caa0 0x7fcfac06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.350+0000 7fcfb2ffd700 1 -- 172.21.15.26:0/2696536493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6395+0+0 (secure 0 0 0) 0x7fcfbc08cc10 con 0x7fcfc0061260 2024-05-09T00:15:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.350+0000 7fcfc50b1700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfac06caa0 0x7fcfac06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.351+0000 7fcfc50b1700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfac06caa0 0x7fcfac06ef60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fcfc0061030 tx=0x7fcfb400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:18.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.355+0000 7fcfb2ffd700 1 -- 172.21.15.26:0/2696536493 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fcfbc05a6c0 con 0x7fcfc0061260 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: pgmap v199: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: Detected new or changed devices on smithi135 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:18.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:18.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:18.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:18.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi135.hcciyw"]}]: dispatch 2024-05-09T00:15:18.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:17 smithi026 ceph-mon[93667]: Upgrade: It appears safe to stop mds.cephfs.smithi135.hcciyw 2024-05-09T00:15:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.636+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcfc00598f0 con 0x7fcfc0061260 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.637+0000 7fcfb2ffd700 1 -- 172.21.15.26:0/2696536493 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+847 (secure 0 0 0) 0x7fcfbc05a250 con 0x7fcfc0061260 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 6 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:15:18.636 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:15:18.637 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-05-09T00:15:18.637 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 3 2024-05-09T00:15:18.637 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:15:18.637 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:15:18.637 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-05-09T00:15:18.637 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 13 2024-05-09T00:15:18.637 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:15:18.637 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfac06caa0 msgr2=0x7fcfac06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfac06caa0 0x7fcfac06ef60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fcfc0061030 tx=0x7fcfb400b040).stop 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 msgr2=0x7fcfc01080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 0x7fcfc01080c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fcfbc013560 tx=0x7fcfbc009cb0).stop 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 shutdown_connections 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfac06caa0 0x7fcfac06ef60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc0061260 0x7fcfc01080c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 --2- 172.21.15.26:0/2696536493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc00fa9d0 0x7fcfc01085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 >> 172.21.15.26:0/2696536493 conn(0x7fcfc00f1e90 msgr2=0x7fcfc00f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 shutdown_connections 2024-05-09T00:15:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.639+0000 7fcfc7b16700 1 -- 172.21.15.26:0/2696536493 wait complete. 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.740+0000 7fe44f398700 1 -- 172.21.15.26:0/978601242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 msgr2=0x7fe4480f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.740+0000 7fe44f398700 1 --2- 172.21.15.26:0/978601242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 0x7fe4480f7df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe4380047f0 tx=0x7fe438009cb0).stop 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.740+0000 7fe44f398700 1 -- 172.21.15.26:0/978601242 shutdown_connections 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.740+0000 7fe44f398700 1 --2- 172.21.15.26:0/978601242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 0x7fe4480f7df0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.740+0000 7fe44f398700 1 --2- 172.21.15.26:0/978601242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4480f66f0 0x7fe4480f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.740+0000 7fe44f398700 1 -- 172.21.15.26:0/978601242 >> 172.21.15.26:0/978601242 conn(0x7fe4480f1e50 msgr2=0x7fe4480f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44f398700 1 -- 172.21.15.26:0/978601242 shutdown_connections 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44f398700 1 -- 172.21.15.26:0/978601242 wait complete. 2024-05-09T00:15:18.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44f398700 1 Processor -- start 2024-05-09T00:15:18.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44f398700 1 -- start start 2024-05-09T00:15:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44f398700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4480f66f0 0x7fe4480fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44f398700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 0x7fe4480f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44f398700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480fac20 con 0x7fe4480f7990 2024-05-09T00:15:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44f398700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480f91c0 con 0x7fe4480f66f0 2024-05-09T00:15:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44c933700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 0x7fe4480f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44c933700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 0x7fe4480f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57640/0 (socket says 172.21.15.26:57640) 2024-05-09T00:15:18.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44d134700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4480f66f0 0x7fe4480fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.741+0000 7fe44c933700 1 -- 172.21.15.26:0/2589471133 learned_addr learned my addr 172.21.15.26:0/2589471133 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe44c933700 1 -- 172.21.15.26:0/2589471133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4480f66f0 msgr2=0x7fe4480fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe44c933700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4480f66f0 0x7fe4480fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe44c933700 1 -- 172.21.15.26:0/2589471133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe438005040 con 0x7fe4480f7990 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe44c933700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 0x7fe4480f8cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe438013620 tx=0x7fe438009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe43e7fc700 1 -- 172.21.15.26:0/2589471133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe43800e030 con 0x7fe4480f7990 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe43e7fc700 1 -- 172.21.15.26:0/2589471133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe438007e90 con 0x7fe4480f7990 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4480f93e0 con 0x7fe4480f7990 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe43e7fc700 1 -- 172.21.15.26:0/2589471133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe438018070 con 0x7fe4480f7990 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.742+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4480f98c0 con 0x7fe4480f7990 2024-05-09T00:15:18.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.743+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4480f9b30 con 0x7fe4480f7990 2024-05-09T00:15:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.744+0000 7fe43e7fc700 1 -- 172.21.15.26:0/2589471133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe43801d420 con 0x7fe4480f7990 2024-05-09T00:15:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.744+0000 7fe43e7fc700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe43406cab0 0x7fe43406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.744+0000 7fe43e7fc700 1 -- 172.21.15.26:0/2589471133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6395+0+0 (secure 0 0 0) 0x7fe43808d190 con 0x7fe4480f7990 2024-05-09T00:15:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.744+0000 7fe44d134700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe43406cab0 0x7fe43406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:18.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.745+0000 7fe44d134700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe43406cab0 0x7fe43406ef70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe4480f77f0 tx=0x7fe44400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.749+0000 7fe43e7fc700 1 -- 172.21.15.26:0/2589471133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fe43805ac40 con 0x7fe4480f7990 2024-05-09T00:15:18.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.996+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4480feeb0 con 0x7fe4480f7990 2024-05-09T00:15:18.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.996+0000 7fe43e7fc700 1 -- 172.21.15.26:0/2589471133 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1849 (secure 0 0 0) 0x7fe43805a7d0 con 0x7fe4480f7990 2024-05-09T00:15:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:e27 2024-05-09T00:15:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:15:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:15:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:15:18.996 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:15:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:15:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:15:18.997 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 26 2024-05-09T00:15:18.997 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:15:18.997 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:15:18.997 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:15:07.221934+0000 2024-05-09T00:15:18.997 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:15:18.997 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:15:18.997 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:15:18.998 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:15:18.998 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:15:18.998 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:15:18.998 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:15:18.998 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:15:18.998 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 82 2024-05-09T00:15:18.999 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:15:18.999 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:15:18.999 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:15:18.999 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=24301} 2024-05-09T00:15:18.999 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:15:18.999 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:15:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:15:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:15:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:15:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:15:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:15:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:15:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:15:19.001 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{0:24301} state up:active seq 159 join_fscid=1 addr [v2:172.21.15.135:6826/3735682126,v1:172.21.15.135:6827/3735682126] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:15:19.001 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:15:19.001 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:15:19.001 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:15:19.001 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:15:19.001 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{-1:34400} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:15:19.001 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/666863957,v1:172.21.15.26:6829/666863957] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:15:19.002 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/2979557079,v1:172.21.15.135:6825/2979557079] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:15:19.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe43406cab0 msgr2=0x7fe43406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe43406cab0 0x7fe43406ef70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe4480f77f0 tx=0x7fe44400b040).stop 2024-05-09T00:15:19.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 msgr2=0x7fe4480f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 0x7fe4480f8cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe438013620 tx=0x7fe438009cb0).stop 2024-05-09T00:15:19.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 shutdown_connections 2024-05-09T00:15:19.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe43406cab0 0x7fe43406ef70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4480f66f0 0x7fe4480fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 --2- 172.21.15.26:0/2589471133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4480f7990 0x7fe4480f8cd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 >> 172.21.15.26:0/2589471133 conn(0x7fe4480f1e50 msgr2=0x7fe448060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:19.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 shutdown_connections 2024-05-09T00:15:19.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:18.999+0000 7fe44f398700 1 -- 172.21.15.26:0/2589471133 wait complete. 2024-05-09T00:15:19.005 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 27 2024-05-09T00:15:19.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.102+0000 7f88c4345700 1 -- 172.21.15.26:0/3011185052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc061280 msgr2=0x7f88bc0fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.102+0000 7f88c4345700 1 --2- 172.21.15.26:0/3011185052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc061280 0x7f88bc0fa3d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f88b8009b60 tx=0x7f88b8004d10).stop 2024-05-09T00:15:19.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.102+0000 7f88c4345700 1 -- 172.21.15.26:0/3011185052 shutdown_connections 2024-05-09T00:15:19.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.102+0000 7f88c4345700 1 --2- 172.21.15.26:0/3011185052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88bc0fa950 0x7f88bc0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.102+0000 7f88c4345700 1 --2- 172.21.15.26:0/3011185052 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc061280 0x7f88bc0fa3d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.102+0000 7f88c4345700 1 -- 172.21.15.26:0/3011185052 >> 172.21.15.26:0/3011185052 conn(0x7f88bc0f1e50 msgr2=0x7f88bc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:19.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.102+0000 7f88c4345700 1 -- 172.21.15.26:0/3011185052 shutdown_connections 2024-05-09T00:15:19.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.102+0000 7f88c4345700 1 -- 172.21.15.26:0/3011185052 wait complete. 2024-05-09T00:15:19.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c4345700 1 Processor -- start 2024-05-09T00:15:19.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c4345700 1 -- start start 2024-05-09T00:15:19.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c4345700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88bc061280 0x7f88bc107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:19.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c4345700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0fa950 0x7f88bc1084e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:19.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c4345700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc108a90 con 0x7f88bc0fa950 2024-05-09T00:15:19.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c4345700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc108bd0 con 0x7f88bc061280 2024-05-09T00:15:19.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c18e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0fa950 0x7f88bc1084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:19.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c18e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0fa950 0x7f88bc1084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57660/0 (socket says 172.21.15.26:57660) 2024-05-09T00:15:19.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c18e0700 1 -- 172.21.15.26:0/2348637030 learned_addr learned my addr 172.21.15.26:0/2348637030 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:19.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c20e1700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88bc061280 0x7f88bc107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:19.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c18e0700 1 -- 172.21.15.26:0/2348637030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88bc061280 msgr2=0x7f88bc107ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c18e0700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88bc061280 0x7f88bc107ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c18e0700 1 -- 172.21.15.26:0/2348637030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80097c0 con 0x7f88bc0fa950 2024-05-09T00:15:19.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.103+0000 7f88c18e0700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0fa950 0x7f88bc1084e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f88ac00e940 tx=0x7f88ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:19.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.104+0000 7f88b37fe700 1 -- 172.21.15.26:0/2348637030 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ac007b40 con 0x7f88bc0fa950 2024-05-09T00:15:19.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.104+0000 7f88b37fe700 1 -- 172.21.15.26:0/2348637030 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88ac00f040 con 0x7f88bc0fa950 2024-05-09T00:15:19.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.104+0000 7f88b37fe700 1 -- 172.21.15.26:0/2348637030 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ac0148e0 con 0x7f88bc0fa950 2024-05-09T00:15:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.104+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc10d670 con 0x7f88bc0fa950 2024-05-09T00:15:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.104+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc10dbb0 con 0x7f88bc0fa950 2024-05-09T00:15:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.105+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc100000 con 0x7f88bc0fa950 2024-05-09T00:15:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.105+0000 7f88b37fe700 1 -- 172.21.15.26:0/2348637030 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f88ac007ca0 con 0x7f88bc0fa950 2024-05-09T00:15:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.106+0000 7f88b37fe700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f88a806caa0 0x7f88a806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:19.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.106+0000 7f88b37fe700 1 -- 172.21.15.26:0/2348637030 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6395+0+0 (secure 0 0 0) 0x7f88ac08b7c0 con 0x7f88bc0fa950 2024-05-09T00:15:19.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.106+0000 7f88c20e1700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f88a806caa0 0x7f88a806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:19.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.106+0000 7f88c20e1700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f88a806caa0 0x7f88a806ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f88b8003380 tx=0x7f88b8004d10).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:19.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.110+0000 7f88b37fe700 1 -- 172.21.15.26:0/2348637030 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f88ac059270 con 0x7f88bc0fa950 2024-05-09T00:15:19.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:18 smithi135 ceph-mon[80466]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:19.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:18 smithi135 ceph-mon[80466]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:19.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:18 smithi135 ceph-mon[80466]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:18 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:18 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.hcciyw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:15:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:18 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:18 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2696536493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:19.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.328+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88bc059120 con 0x7f88a806caa0 2024-05-09T00:15:19.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.330+0000 7f88b37fe700 1 -- 172.21.15.26:0/2348637030 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f88bc059120 con 0x7f88a806caa0 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr", 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "osd", 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "mon" 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "15/21 daemons upgraded", 2024-05-09T00:15:19.329 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T00:15:19.330 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:15:19.330 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f88a806caa0 msgr2=0x7f88a806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f88a806caa0 0x7f88a806ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f88b8003380 tx=0x7f88b8004d10).stop 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0fa950 msgr2=0x7f88bc1084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0fa950 0x7f88bc1084e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f88ac00e940 tx=0x7f88ac00b040).stop 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 shutdown_connections 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f88a806caa0 0x7f88a806ef60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88bc061280 0x7f88bc107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 --2- 172.21.15.26:0/2348637030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88bc0fa950 0x7f88bc1084e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 >> 172.21.15.26:0/2348637030 conn(0x7f88bc0f1e50 msgr2=0x7f88bc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 shutdown_connections 2024-05-09T00:15:19.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.332+0000 7f88c4345700 1 -- 172.21.15.26:0/2348637030 wait complete. 2024-05-09T00:15:19.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:18 smithi026 ceph-mon[93667]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:19.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:18 smithi026 ceph-mon[93667]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:19.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:18 smithi026 ceph-mon[93667]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:19.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:18 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:19.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:18 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.hcciyw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:15:19.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:18 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:19.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:18 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2696536493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.433+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/1182583244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f7800 msgr2=0x7fcfc80f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.433+0000 7fcfcfcf7700 1 --2- 172.21.15.26:0/1182583244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f7800 0x7fcfc80f7c20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fcfc40047f0 tx=0x7fcfc4009cb0).stop 2024-05-09T00:15:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.433+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/1182583244 shutdown_connections 2024-05-09T00:15:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.433+0000 7fcfcfcf7700 1 --2- 172.21.15.26:0/1182583244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc80f8aa0 0x7fcfc80f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.433+0000 7fcfcfcf7700 1 --2- 172.21.15.26:0/1182583244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f7800 0x7fcfc80f7c20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.433+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/1182583244 >> 172.21.15.26:0/1182583244 conn(0x7fcfc80f2f80 msgr2=0x7fcfc80f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:19.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/1182583244 shutdown_connections 2024-05-09T00:15:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/1182583244 wait complete. 2024-05-09T00:15:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcfcf7700 1 Processor -- start 2024-05-09T00:15:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcfcf7700 1 -- start start 2024-05-09T00:15:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcfcf7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc80f7800 0x7fcfc8108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcfcf7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f8aa0 0x7fcfc8108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcfcf7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc8108ae0 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcfcf7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc8108c20 con 0x7fcfc80f7800 2024-05-09T00:15:19.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.434+0000 7fcfcd292700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f8aa0 0x7fcfc8108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcd292700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f8aa0 0x7fcfc8108530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57670/0 (socket says 172.21.15.26:57670) 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcd292700 1 -- 172.21.15.26:0/3947615324 learned_addr learned my addr 172.21.15.26:0/3947615324 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcda93700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc80f7800 0x7fcfc8108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcd292700 1 -- 172.21.15.26:0/3947615324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc80f7800 msgr2=0x7fcfc8108040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcd292700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc80f7800 0x7fcfc8108040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcd292700 1 -- 172.21.15.26:0/3947615324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4005040 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcd292700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f8aa0 0x7fcfc8108530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fcfb800e8f0 tx=0x7fcfb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfbeffd700 1 -- 172.21.15.26:0/3947615324 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb800ee90 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc810d6c0 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfbeffd700 1 -- 172.21.15.26:0/3947615324 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcfb800f040 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfbeffd700 1 -- 172.21.15.26:0/3947615324 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb800c930 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.435+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc810dc80 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.436+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc80fffc0 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.437+0000 7fcfbeffd700 1 -- 172.21.15.26:0/3947615324 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcfb8007b40 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.437+0000 7fcfbeffd700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfb406caa0 0x7fcfb406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:19.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.437+0000 7fcfbeffd700 1 -- 172.21.15.26:0/3947615324 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6395+0+0 (secure 0 0 0) 0x7fcfb808bad0 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.437+0000 7fcfcda93700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfb406caa0 0x7fcfb406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:19.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.438+0000 7fcfcda93700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfb406caa0 0x7fcfb406ef60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fcfc4004e60 tx=0x7fcfc400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:19.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.442+0000 7fcfbeffd700 1 -- 172.21.15.26:0/3947615324 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fcfb8059580 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.722+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcfc80598f0 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.723+0000 7fcfbeffd700 1 -- 172.21.15.26:0/3947615324 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fcfb8059110 con 0x7fcfc80f8aa0 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfb406caa0 msgr2=0x7fcfb406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfb406caa0 0x7fcfb406ef60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fcfc4004e60 tx=0x7fcfc400b040).stop 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f8aa0 msgr2=0x7fcfc8108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f8aa0 0x7fcfc8108530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fcfb800e8f0 tx=0x7fcfb800b040).stop 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 shutdown_connections 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcfb406caa0 0x7fcfb406ef60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfc80f7800 0x7fcfc8108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 --2- 172.21.15.26:0/3947615324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfc80f8aa0 0x7fcfc8108530 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 >> 172.21.15.26:0/3947615324 conn(0x7fcfc80f2f80 msgr2=0x7fcfc80fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 shutdown_connections 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:19.725+0000 7fcfcfcf7700 1 -- 172.21.15.26:0/3947615324 wait complete. 2024-05-09T00:15:20.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:19 smithi135 ceph-mon[80466]: Upgrade: Updating mds.cephfs.smithi135.hcciyw 2024-05-09T00:15:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:19 smithi135 ceph-mon[80466]: Deploying daemon mds.cephfs.smithi135.hcciyw on smithi135 2024-05-09T00:15:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:19 smithi135 ceph-mon[80466]: pgmap v200: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T00:15:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:19 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2589471133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:15:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:19 smithi135 ceph-mon[80466]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:19 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3947615324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:15:20.319 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:19 smithi026 ceph-mon[93667]: Upgrade: Updating mds.cephfs.smithi135.hcciyw 2024-05-09T00:15:20.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:19 smithi026 ceph-mon[93667]: Deploying daemon mds.cephfs.smithi135.hcciyw on smithi135 2024-05-09T00:15:20.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:19 smithi026 ceph-mon[93667]: pgmap v200: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T00:15:20.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:19 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2589471133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:15:20.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:19 smithi026 ceph-mon[93667]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:20.320 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:19 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3947615324' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:15:20.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[93644]: 2024-05-09T00:15:20.320+0000 7fe4684f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:15:20.651 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:15:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:15:20.349+0000 7f2076801700 -1 bdev(0x55c99e57c000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-05-09T00:15:21.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-mon[93667]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:15:21.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-mon[93667]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:15:21.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-mon[93667]: osdmap e83: 6 total, 6 up, 6 in 2024-05-09T00:15:21.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-mon[93667]: Standby daemon mds.cephfs.smithi026.nhrcgk assigned to filesystem cephfs as rank 0 2024-05-09T00:15:21.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-mon[93667]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:15:21.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-mon[93667]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T00:15:21.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi026.nhrcgk=up:replay} 2 up:standby 2024-05-09T00:15:21.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:20 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:15:21.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:20 smithi135 ceph-mon[80466]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:15:21.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:20 smithi135 ceph-mon[80466]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:15:21.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:20 smithi135 ceph-mon[80466]: osdmap e83: 6 total, 6 up, 6 in 2024-05-09T00:15:21.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:20 smithi135 ceph-mon[80466]: Standby daemon mds.cephfs.smithi026.nhrcgk assigned to filesystem cephfs as rank 0 2024-05-09T00:15:21.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:20 smithi135 ceph-mon[80466]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:15:21.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:20 smithi135 ceph-mon[80466]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T00:15:21.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:20 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi026.nhrcgk=up:replay} 2 up:standby 2024-05-09T00:15:21.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:20 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:15:22.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:22 smithi026 ceph-mon[93667]: pgmap v202: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2024-05-09T00:15:22.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:22 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:15:22.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:22 smithi135 ceph-mon[80466]: pgmap v202: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2024-05-09T00:15:22.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:22 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:15:24.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:24 smithi026 ceph-mon[93667]: pgmap v203: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-05-09T00:15:24.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:24 smithi135 ceph-mon[80466]: pgmap v203: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-05-09T00:15:26.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:26 smithi026 ceph-mon[93667]: pgmap v204: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-05-09T00:15:26.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:26 smithi135 ceph-mon[80466]: pgmap v204: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-05-09T00:15:28.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:28 smithi135 ceph-mon[80466]: pgmap v205: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-05-09T00:15:28.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:28 smithi026 ceph-mon[93667]: pgmap v205: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-05-09T00:15:30.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:29 smithi026 ceph-mon[93667]: pgmap v206: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-05-09T00:15:30.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:30.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:30.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:30.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:29 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.135:6826/918815670,v1:172.21.15.135:6827/918815670] up:boot 2024-05-09T00:15:30.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:29 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] up:reconnect 2024-05-09T00:15:30.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:29 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi026.nhrcgk=up:reconnect} 3 up:standby 2024-05-09T00:15:30.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:15:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:29 smithi135 ceph-mon[80466]: pgmap v206: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-05-09T00:15:30.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:29 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.135:6826/918815670,v1:172.21.15.135:6827/918815670] up:boot 2024-05-09T00:15:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:29 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] up:reconnect 2024-05-09T00:15:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:29 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi026.nhrcgk=up:reconnect} 3 up:standby 2024-05-09T00:15:30.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:15:31.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:30 smithi026 ceph-mon[93667]: reconnect by client.14496 v1:192.168.0.1:0/3285800047 after 0.00399994 2024-05-09T00:15:31.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:30 smithi026 ceph-mon[93667]: reconnect by client.14502 v1:172.21.15.135:0/1350715060 after 0.00499993 2024-05-09T00:15:31.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:30 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] up:rejoin 2024-05-09T00:15:31.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:30 smithi026 ceph-mon[93667]: fsmap cephfs:1/1 {0=cephfs.smithi026.nhrcgk=up:rejoin} 3 up:standby 2024-05-09T00:15:31.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:30 smithi026 ceph-mon[93667]: daemon mds.cephfs.smithi026.nhrcgk is now active in filesystem cephfs as rank 0 2024-05-09T00:15:31.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:30 smithi135 ceph-mon[80466]: reconnect by client.14496 v1:192.168.0.1:0/3285800047 after 0.00399994 2024-05-09T00:15:31.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:30 smithi135 ceph-mon[80466]: reconnect by client.14502 v1:172.21.15.135:0/1350715060 after 0.00499993 2024-05-09T00:15:31.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:30 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] up:rejoin 2024-05-09T00:15:31.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:30 smithi135 ceph-mon[80466]: fsmap cephfs:1/1 {0=cephfs.smithi026.nhrcgk=up:rejoin} 3 up:standby 2024-05-09T00:15:31.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:30 smithi135 ceph-mon[80466]: daemon mds.cephfs.smithi026.nhrcgk is now active in filesystem cephfs as rank 0 2024-05-09T00:15:32.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:31 smithi026 ceph-mon[93667]: pgmap v207: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-05-09T00:15:32.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:31 smithi026 ceph-mon[93667]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:15:32.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:31 smithi026 ceph-mon[93667]: mds.? [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] up:active 2024-05-09T00:15:32.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:31 smithi026 ceph-mon[93667]: fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:15:32.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:32.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:31 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:32.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:31 smithi135 ceph-mon[80466]: pgmap v207: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-05-09T00:15:32.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:31 smithi135 ceph-mon[80466]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:15:32.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:31 smithi135 ceph-mon[80466]: mds.? [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] up:active 2024-05-09T00:15:32.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:31 smithi135 ceph-mon[80466]: fsmap cephfs:1 {0=cephfs.smithi026.nhrcgk=up:active} 3 up:standby 2024-05-09T00:15:32.150 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:32.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:31 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:33.504 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:33 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:33.504 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:33 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:33.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:33 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:33.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:33 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:34.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:34 smithi026 ceph-mon[93667]: pgmap v208: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T00:15:34.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:34 smithi135 ceph-mon[80466]: pgmap v208: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T00:15:36.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: pgmap v209: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T00:15:36.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi026.gbyppy"}]': finished 2024-05-09T00:15:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi026.nhrcgk"}]': finished 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.hcciyw"}]': finished 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.lzxgvd"}]': finished 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: pgmap v209: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi026.gbyppy"}]: dispatch 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi026.gbyppy"}]': finished 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi026.nhrcgk"}]: dispatch 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi026.nhrcgk"}]': finished 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.hcciyw"}]: dispatch 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.hcciyw"}]': finished 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.lzxgvd"}]: dispatch 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.lzxgvd"}]': finished 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.653 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.654 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.654 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.654 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.654 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.654 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.654 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:36.654 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:36.654 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:37.497 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:37 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all mds 2024-05-09T00:15:37.497 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:37 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all rgw 2024-05-09T00:15:37.498 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:37 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T00:15:37.498 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:37 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T00:15:37.498 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:37 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all iscsi 2024-05-09T00:15:37.498 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:37 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all nfs 2024-05-09T00:15:37.498 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:37 smithi026 ceph-mon[93667]: Upgrade: Setting container_image for all nvmeof 2024-05-09T00:15:37.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:37 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all mds 2024-05-09T00:15:37.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:37 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all rgw 2024-05-09T00:15:37.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:37 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T00:15:37.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:37 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T00:15:37.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:37 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all iscsi 2024-05-09T00:15:37.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:37 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all nfs 2024-05-09T00:15:37.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:37 smithi135 ceph-mon[80466]: Upgrade: Setting container_image for all nvmeof 2024-05-09T00:15:38.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:38 smithi026 ceph-mon[93667]: pgmap v210: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T00:15:38.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:38 smithi135 ceph-mon[80466]: pgmap v210: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T00:15:39.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:39 smithi026 ceph-mon[93667]: Upgrade: Updating node-exporter.smithi026 (1/2) 2024-05-09T00:15:39.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:39 smithi026 ceph-mon[93667]: Deploying daemon node-exporter.smithi026 on smithi026 2024-05-09T00:15:39.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:39 smithi135 ceph-mon[80466]: Upgrade: Updating node-exporter.smithi026 (1/2) 2024-05-09T00:15:39.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:39 smithi135 ceph-mon[80466]: Deploying daemon node-exporter.smithi026 on smithi026 2024-05-09T00:15:40.764 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:40 smithi026 ceph-mon[93667]: pgmap v211: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T00:15:40.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:40 smithi135 ceph-mon[80466]: pgmap v211: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T00:15:42.730 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:42 smithi026 ceph-mon[93667]: pgmap v212: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-05-09T00:15:42.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:42 smithi135 ceph-mon[80466]: pgmap v212: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-05-09T00:15:44.020 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:43 smithi135 ceph-mon[80466]: pgmap v213: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T00:15:44.021 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:43 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:44.021 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:43 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:44.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:43 smithi026 ceph-mon[93667]: pgmap v213: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T00:15:44.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:43 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:44.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:43 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:45.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:44 smithi026 ceph-mon[93667]: Upgrade: Updating node-exporter.smithi135 (2/2) 2024-05-09T00:15:45.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:44 smithi026 ceph-mon[93667]: Deploying daemon node-exporter.smithi135 on smithi135 2024-05-09T00:15:45.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:44 smithi135 ceph-mon[80466]: Upgrade: Updating node-exporter.smithi135 (2/2) 2024-05-09T00:15:45.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:44 smithi135 ceph-mon[80466]: Deploying daemon node-exporter.smithi135 on smithi135 2024-05-09T00:15:46.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:45 smithi135 ceph-mon[80466]: pgmap v214: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-05-09T00:15:46.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:45 smithi026 ceph-mon[93667]: pgmap v214: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-05-09T00:15:48.290 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:47 smithi135 ceph-mon[80466]: pgmap v215: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-09T00:15:48.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:47 smithi026 ceph-mon[93667]: pgmap v215: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-09T00:15:49.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.844+0000 7f1262a1f700 1 -- 172.21.15.26:0/275940624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 msgr2=0x7f125c0fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:49.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.844+0000 7f1262a1f700 1 --2- 172.21.15.26:0/275940624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 0x7f125c0fa3d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f124c0047f0 tx=0x7f124c009cb0).stop 2024-05-09T00:15:49.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.844+0000 7f1262a1f700 1 -- 172.21.15.26:0/275940624 shutdown_connections 2024-05-09T00:15:49.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.844+0000 7f1262a1f700 1 --2- 172.21.15.26:0/275940624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125c0fa950 0x7f125c0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:49.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.844+0000 7f1262a1f700 1 --2- 172.21.15.26:0/275940624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 0x7f125c0fa3d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:49.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.844+0000 7f1262a1f700 1 -- 172.21.15.26:0/275940624 >> 172.21.15.26:0/275940624 conn(0x7f125c0f1e50 msgr2=0x7f125c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:49.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.844+0000 7f1262a1f700 1 -- 172.21.15.26:0/275940624 shutdown_connections 2024-05-09T00:15:49.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.844+0000 7f1262a1f700 1 -- 172.21.15.26:0/275940624 wait complete. 2024-05-09T00:15:49.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.845+0000 7f1262a1f700 1 Processor -- start 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.845+0000 7f1262a1f700 1 -- start start 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.845+0000 7f1262a1f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 0x7f125c10a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.845+0000 7f1262a1f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125c0fa950 0x7f125c10a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.845+0000 7f1262a1f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c10abe0 con 0x7f125c061280 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.845+0000 7f1262a1f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c10ad20 con 0x7f125c0fa950 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.845+0000 7f125bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 0x7f125c10a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f125bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 0x7f125c10a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53740/0 (socket says 172.21.15.26:53740) 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f125bfff700 1 -- 172.21.15.26:0/4021669180 learned_addr learned my addr 172.21.15.26:0/4021669180 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f125b7fe700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125c0fa950 0x7f125c10a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f125bfff700 1 -- 172.21.15.26:0/4021669180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125c0fa950 msgr2=0x7f125c10a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:49.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f125bfff700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125c0fa950 0x7f125c10a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:49.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f125bfff700 1 -- 172.21.15.26:0/4021669180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c005040 con 0x7f125c061280 2024-05-09T00:15:49.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f125bfff700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 0x7f125c10a140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f124c013620 tx=0x7f124c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:49.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f12597fa700 1 -- 172.21.15.26:0/4021669180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124c00e070 con 0x7f125c061280 2024-05-09T00:15:49.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c10f760 con 0x7f125c061280 2024-05-09T00:15:49.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f12597fa700 1 -- 172.21.15.26:0/4021669180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f124c007e90 con 0x7f125c061280 2024-05-09T00:15:49.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f12597fa700 1 -- 172.21.15.26:0/4021669180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124c018070 con 0x7f125c061280 2024-05-09T00:15:49.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.846+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c10fd20 con 0x7f125c061280 2024-05-09T00:15:49.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.847+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c0fffe0 con 0x7f125c061280 2024-05-09T00:15:49.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.848+0000 7f12597fa700 1 -- 172.21.15.26:0/4021669180 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f124c01d420 con 0x7f125c061280 2024-05-09T00:15:49.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.848+0000 7f12597fa700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f124406caa0 0x7f124406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:49.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.848+0000 7f12597fa700 1 -- 172.21.15.26:0/4021669180 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f124c08cc50 con 0x7f125c061280 2024-05-09T00:15:49.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.848+0000 7f125b7fe700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f124406caa0 0x7f124406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:49.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.848+0000 7f125b7fe700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f124406caa0 0x7f124406ef60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f125c061050 tx=0x7f125000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:49.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:49.853+0000 7f12597fa700 1 -- 172.21.15.26:0/4021669180 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f124c05a6a0 con 0x7f125c061280 2024-05-09T00:15:50.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.073+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f125c0f68e0 con 0x7f124406caa0 2024-05-09T00:15:50.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.074+0000 7f12597fa700 1 -- 172.21.15.26:0/4021669180 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f125c0f68e0 con 0x7f124406caa0 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.076+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f124406caa0 msgr2=0x7f124406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.076+0000 7f1262a1f700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f124406caa0 0x7f124406ef60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f125c061050 tx=0x7f125000b040).stop 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.076+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 msgr2=0x7f125c10a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.076+0000 7f1262a1f700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 0x7f125c10a140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f124c013620 tx=0x7f124c009cb0).stop 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.077+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 shutdown_connections 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.077+0000 7f1262a1f700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f124406caa0 0x7f124406ef60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.077+0000 7f1262a1f700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f125c061280 0x7f125c10a140 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.077+0000 7f1262a1f700 1 --2- 172.21.15.26:0/4021669180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125c0fa950 0x7f125c10a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.077+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 >> 172.21.15.26:0/4021669180 conn(0x7f125c0f1e50 msgr2=0x7f125c0f61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.077+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 shutdown_connections 2024-05-09T00:15:50.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.077+0000 7f1262a1f700 1 -- 172.21.15.26:0/4021669180 wait complete. 2024-05-09T00:15:50.085 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.180+0000 7fc79e9e9700 1 -- 172.21.15.26:0/3638774815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 msgr2=0x7fc7980fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.180+0000 7fc79e9e9700 1 --2- 172.21.15.26:0/3638774815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 0x7fc7980fa470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc7880047f0 tx=0x7fc788009cb0).stop 2024-05-09T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.181+0000 7fc79e9e9700 1 -- 172.21.15.26:0/3638774815 shutdown_connections 2024-05-09T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.181+0000 7fc79e9e9700 1 --2- 172.21.15.26:0/3638774815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7980fa960 0x7fc7980fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.181+0000 7fc79e9e9700 1 --2- 172.21.15.26:0/3638774815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 0x7fc7980fa470 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.181+0000 7fc79e9e9700 1 -- 172.21.15.26:0/3638774815 >> 172.21.15.26:0/3638774815 conn(0x7fc7980f1e50 msgr2=0x7fc7980f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.181+0000 7fc79e9e9700 1 -- 172.21.15.26:0/3638774815 shutdown_connections 2024-05-09T00:15:50.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.181+0000 7fc79e9e9700 1 -- 172.21.15.26:0/3638774815 wait complete. 2024-05-09T00:15:50.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.181+0000 7fc79e9e9700 1 Processor -- start 2024-05-09T00:15:50.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc79e9e9700 1 -- start start 2024-05-09T00:15:50.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc79e9e9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 0x7fc798108090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc79e9e9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7980fa960 0x7fc798108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc79e9e9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798108b30 con 0x7fc7980611e0 2024-05-09T00:15:50.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc79e9e9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798108c70 con 0x7fc7980fa960 2024-05-09T00:15:50.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc797fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 0x7fc798108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:50.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc797fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 0x7fc798108090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53766/0 (socket says 172.21.15.26:53766) 2024-05-09T00:15:50.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc797fff700 1 -- 172.21.15.26:0/2612266667 learned_addr learned my addr 172.21.15.26:0/2612266667 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:50.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc7977fe700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7980fa960 0x7fc798108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:50.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc797fff700 1 -- 172.21.15.26:0/2612266667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7980fa960 msgr2=0x7fc798108580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc797fff700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7980fa960 0x7fc798108580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.182+0000 7fc797fff700 1 -- 172.21.15.26:0/2612266667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788005040 con 0x7fc7980611e0 2024-05-09T00:15:50.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.183+0000 7fc797fff700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 0x7fc798108090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fc788000c00 tx=0x7fc788009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:50.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.183+0000 7fc7957fa700 1 -- 172.21.15.26:0/2612266667 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc788018070 con 0x7fc7980611e0 2024-05-09T00:15:50.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.183+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79810d6b0 con 0x7fc7980611e0 2024-05-09T00:15:50.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.183+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79810dc70 con 0x7fc7980611e0 2024-05-09T00:15:50.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.183+0000 7fc7957fa700 1 -- 172.21.15.26:0/2612266667 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc788007e90 con 0x7fc7980611e0 2024-05-09T00:15:50.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.183+0000 7fc7957fa700 1 -- 172.21.15.26:0/2612266667 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc788012620 con 0x7fc7980611e0 2024-05-09T00:15:50.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.185+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc784005150 con 0x7fc7980611e0 2024-05-09T00:15:50.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.185+0000 7fc7957fa700 1 -- 172.21.15.26:0/2612266667 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc78801d9d0 con 0x7fc7980611e0 2024-05-09T00:15:50.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.185+0000 7fc7957fa700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc78006cb80 0x7fc78006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.185+0000 7fc7957fa700 1 -- 172.21.15.26:0/2612266667 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fc78808cd10 con 0x7fc7980611e0 2024-05-09T00:15:50.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.185+0000 7fc7977fe700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc78006cb80 0x7fc78006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:50.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.186+0000 7fc7977fe700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc78006cb80 0x7fc78006f040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc798060fb0 tx=0x7fc78c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:50.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.190+0000 7fc7957fa700 1 -- 172.21.15.26:0/2612266667 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc78805a6a0 con 0x7fc7980611e0 2024-05-09T00:15:50.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:50 smithi026 ceph-mon[93667]: pgmap v216: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-09T00:15:50.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:50.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:50.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:50 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:50.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:50 smithi135 ceph-mon[80466]: pgmap v216: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-09T00:15:50.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:50.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:50.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:50 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:50.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.425+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc784000bf0 con 0x7fc78006cb80 2024-05-09T00:15:50.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.426+0000 7fc7957fa700 1 -- 172.21.15.26:0/2612266667 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fc784000bf0 con 0x7fc78006cb80 2024-05-09T00:15:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc78006cb80 msgr2=0x7fc78006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc78006cb80 0x7fc78006f040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc798060fb0 tx=0x7fc78c00b040).stop 2024-05-09T00:15:50.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 msgr2=0x7fc798108090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 0x7fc798108090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fc788000c00 tx=0x7fc788009cb0).stop 2024-05-09T00:15:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 shutdown_connections 2024-05-09T00:15:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc78006cb80 0x7fc78006f040 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7980611e0 0x7fc798108090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 --2- 172.21.15.26:0/2612266667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7980fa960 0x7fc798108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 >> 172.21.15.26:0/2612266667 conn(0x7fc7980f1e50 msgr2=0x7fc7980f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 shutdown_connections 2024-05-09T00:15:50.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.428+0000 7fc79e9e9700 1 -- 172.21.15.26:0/2612266667 wait complete. 2024-05-09T00:15:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.534+0000 7f7a0583d700 1 -- 172.21.15.26:0/1037210279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 msgr2=0x7f7a000ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.534+0000 7f7a0583d700 1 --2- 172.21.15.26:0/1037210279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 0x7f7a000ff130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f79f4004820 tx=0x7f79f4009cb0).stop 2024-05-09T00:15:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.534+0000 7f7a0583d700 1 -- 172.21.15.26:0/1037210279 shutdown_connections 2024-05-09T00:15:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.534+0000 7f7a0583d700 1 --2- 172.21.15.26:0/1037210279 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 0x7f7a000ff130 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.534+0000 7f7a0583d700 1 --2- 172.21.15.26:0/1037210279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a00061200 0x7f7a000fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:15:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.534+0000 7f7a0583d700 1 -- 172.21.15.26:0/1037210279 >> 172.21.15.26:0/1037210279 conn(0x7f7a000f1e50 msgr2=0x7f7a000f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:50.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.535+0000 7f7a0583d700 1 -- 172.21.15.26:0/1037210279 shutdown_connections 2024-05-09T00:15:50.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.535+0000 7f7a0583d700 1 -- 172.21.15.26:0/1037210279 wait complete. 2024-05-09T00:15:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.535+0000 7f7a0583d700 1 Processor -- start 2024-05-09T00:15:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f7a0583d700 1 -- start start 2024-05-09T00:15:50.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f7a0583d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a00061200 0x7f7a0010a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f7a0583d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 0x7f7a0010a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f7a0583d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0010ad30 con 0x7f7a000fcd40 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f7a0583d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0010ae70 con 0x7f7a00061200 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f79fe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 0x7f7a0010a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f79fe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 0x7f7a0010a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53782/0 (socket says 172.21.15.26:53782) 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f79fe7fc700 1 -- 172.21.15.26:0/1635806708 learned_addr learned my addr 172.21.15.26:0/1635806708 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f79fe7fc700 1 -- 172.21.15.26:0/1635806708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a00061200 msgr2=0x7f7a0010a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f79fe7fc700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a00061200 0x7f7a0010a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.536+0000 7f79fe7fc700 1 -- 172.21.15.26:0/1635806708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4005040 con 0x7f7a000fcd40 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.537+0000 7f79fe7fc700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 0x7f7a0010a6f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f79f4004f00 tx=0x7f79f4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.537+0000 7f79e7fff700 1 -- 172.21.15.26:0/1635806708 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f400e030 con 0x7f7a000fcd40 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.537+0000 7f79e7fff700 1 -- 172.21.15.26:0/1635806708 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79f4007e90 con 0x7f7a000fcd40 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.537+0000 7f79e7fff700 1 -- 172.21.15.26:0/1635806708 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f4018070 con 0x7f7a000fcd40 2024-05-09T00:15:50.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.537+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0010f8b0 con 0x7f7a000fcd40 2024-05-09T00:15:50.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.537+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0010fd90 con 0x7f7a000fcd40 2024-05-09T00:15:50.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.538+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a00102240 con 0x7f7a000fcd40 2024-05-09T00:15:50.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.539+0000 7f79e7fff700 1 -- 172.21.15.26:0/1635806708 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f79f401da40 con 0x7f7a000fcd40 2024-05-09T00:15:50.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.539+0000 7f79e7fff700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f79e806ca70 0x7f79e806ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.539+0000 7f79e7fff700 1 -- 172.21.15.26:0/1635806708 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f79f408d470 con 0x7f7a000fcd40 2024-05-09T00:15:50.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.539+0000 7f79feffd700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f79e806ca70 0x7f79e806ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:50.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.540+0000 7f79feffd700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f79e806ca70 0x7f79e806ef30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f79f0009700 tx=0x7f79f0006c30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:50.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.549+0000 7f79e7fff700 1 -- 172.21.15.26:0/1635806708 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f79f405ae00 con 0x7f7a000fcd40 2024-05-09T00:15:50.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.773+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a00059120 con 0x7f79e806ca70 2024-05-09T00:15:50.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.782+0000 7f79e7fff700 1 -- 172.21.15.26:0/1635806708 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7a00059120 con 0x7f79e806ca70 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (7m) 63s ago 16m 23.9M - 0.23.0 ba2b418f427c 472e9e920843 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (5m) 63s ago 16m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (5m) 19s ago 15m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (7m) 63s ago 16m 55.4M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (68s) 63s ago 11m 12.6M - 18.2.2-1322-gd21e4f96 af23193ff691 d186720df096 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (91s) 63s ago 11m 12.4M - 18.2.2-1322-gd21e4f96 af23193ff691 4083eb8ff427 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (22s) 19s ago 11m 10.3M - 18.2.2-1322-gd21e4f96 af23193ff691 8f7df1307719 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (42s) 19s ago 11m 14.9M - 18.2.2-1322-gd21e4f96 af23193ff691 20dc7cc555ea 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (7m) 63s ago 17m 507M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (6m) 19s ago 15m 452M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:15:50.781 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (6m) 63s ago 18m 50.3M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (5m) 19s ago 15m 43.3M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 starting - - - - 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 starting - - - - 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (4m) 63s ago 15m 109M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (4m) 63s ago 14m 115M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (3m) 63s ago 14m 103M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (2m) 19s ago 13m 122M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (2m) 19s ago 13m 103M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 a23ab54b2270 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (113s) 19s ago 12m 99.6M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 df906a6613b1 2024-05-09T00:15:50.782 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (6m) 19s ago 15m 74.5M - 2.33.4 514e6a882f6e b2f3f00c6795 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.784+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f79e806ca70 msgr2=0x7f79e806ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.784+0000 7f7a0583d700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f79e806ca70 0x7f79e806ef30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f79f0009700 tx=0x7f79f0006c30).stop 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.784+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 msgr2=0x7f7a0010a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.784+0000 7f7a0583d700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 0x7f7a0010a6f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f79f4004f00 tx=0x7f79f4009cb0).stop 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.785+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 shutdown_connections 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.785+0000 7f7a0583d700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f79e806ca70 0x7f79e806ef30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.785+0000 7f7a0583d700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a00061200 0x7f7a0010a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.785+0000 7f7a0583d700 1 --2- 172.21.15.26:0/1635806708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a000fcd40 0x7f7a0010a6f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.785+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 >> 172.21.15.26:0/1635806708 conn(0x7f7a000f1e50 msgr2=0x7f7a000f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:50.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.785+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 shutdown_connections 2024-05-09T00:15:50.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.785+0000 7f7a0583d700 1 -- 172.21.15.26:0/1635806708 wait complete. 2024-05-09T00:15:50.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.886+0000 7f78eb57b700 1 -- 172.21.15.26:0/3564764729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f66f0 msgr2=0x7f78e40f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.886+0000 7f78eb57b700 1 --2- 172.21.15.26:0/3564764729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f66f0 0x7f78e40f6b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f78e00047f0 tx=0x7f78e0009cb0).stop 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.886+0000 7f78eb57b700 1 -- 172.21.15.26:0/3564764729 shutdown_connections 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.886+0000 7f78eb57b700 1 --2- 172.21.15.26:0/3564764729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78e40f7990 0x7f78e40f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.886+0000 7f78eb57b700 1 --2- 172.21.15.26:0/3564764729 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f66f0 0x7f78e40f6b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.886+0000 7f78eb57b700 1 -- 172.21.15.26:0/3564764729 >> 172.21.15.26:0/3564764729 conn(0x7f78e40f1e50 msgr2=0x7f78e40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.886+0000 7f78eb57b700 1 -- 172.21.15.26:0/3564764729 shutdown_connections 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.886+0000 7f78eb57b700 1 -- 172.21.15.26:0/3564764729 wait complete. 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78eb57b700 1 Processor -- start 2024-05-09T00:15:50.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78eb57b700 1 -- start start 2024-05-09T00:15:50.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78eb57b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78e40f66f0 0x7f78e4107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78eb57b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f7990 0x7f78e4108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78eb57b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4108a10 con 0x7f78e40f7990 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78eb57b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4108b50 con 0x7f78e40f66f0 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78e8b16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f7990 0x7f78e4108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78e8b16700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f7990 0x7f78e4108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53800/0 (socket says 172.21.15.26:53800) 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78e8b16700 1 -- 172.21.15.26:0/2350044332 learned_addr learned my addr 172.21.15.26:0/2350044332 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78e9317700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78e40f66f0 0x7f78e4107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78e8b16700 1 -- 172.21.15.26:0/2350044332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78e40f66f0 msgr2=0x7f78e4107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78e8b16700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78e40f66f0 0x7f78e4107f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78e8b16700 1 -- 172.21.15.26:0/2350044332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0005040 con 0x7f78e40f7990 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.887+0000 7f78e8b16700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f7990 0x7f78e4108460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f78d80041d0 tx=0x7f78d8009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.888+0000 7f78d67fc700 1 -- 172.21.15.26:0/2350044332 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d8007b40 con 0x7f78e40f7990 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.888+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e410d5f0 con 0x7f78e40f7990 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.888+0000 7f78d67fc700 1 -- 172.21.15.26:0/2350044332 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f78d800f040 con 0x7f78e40f7990 2024-05-09T00:15:50.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.888+0000 7f78d67fc700 1 -- 172.21.15.26:0/2350044332 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d80147b0 con 0x7f78e40f7990 2024-05-09T00:15:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.888+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e410dbb0 con 0x7f78e40f7990 2024-05-09T00:15:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.889+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e40feeb0 con 0x7f78e40f7990 2024-05-09T00:15:50.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.889+0000 7f78d67fc700 1 -- 172.21.15.26:0/2350044332 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f78d8009110 con 0x7f78e40f7990 2024-05-09T00:15:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.890+0000 7f78d67fc700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78d006caa0 0x7f78d006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.890+0000 7f78d67fc700 1 -- 172.21.15.26:0/2350044332 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f78d808bf30 con 0x7f78e40f7990 2024-05-09T00:15:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.890+0000 7f78e9317700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78d006caa0 0x7f78d006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:50.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.890+0000 7f78e9317700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78d006caa0 0x7f78d006ef60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f78e0004f10 tx=0x7f78e000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:50.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:50.894+0000 7f78d67fc700 1 -- 172.21.15.26:0/2350044332 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f78d80bf570 con 0x7f78e40f7990 2024-05-09T00:15:51.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.199+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f78e410e530 con 0x7f78e40f7990 2024-05-09T00:15:51.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.200+0000 7f78d67fc700 1 -- 172.21.15.26:0/2350044332 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f78d8059980 con 0x7f78e40f7990 2024-05-09T00:15:51.198 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:15:51.198 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:15:51.198 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 6 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 4 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 14 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:15:51.199 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:15:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78d006caa0 msgr2=0x7f78d006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78d006caa0 0x7f78d006ef60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f78e0004f10 tx=0x7f78e000b040).stop 2024-05-09T00:15:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f7990 msgr2=0x7f78e4108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f7990 0x7f78e4108460 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f78d80041d0 tx=0x7f78d8009f60).stop 2024-05-09T00:15:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 shutdown_connections 2024-05-09T00:15:51.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f78d006caa0 0x7f78d006ef60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78e40f66f0 0x7f78e4107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 --2- 172.21.15.26:0/2350044332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78e40f7990 0x7f78e4108460 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 >> 172.21.15.26:0/2350044332 conn(0x7f78e40f1e50 msgr2=0x7f78e4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 shutdown_connections 2024-05-09T00:15:51.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.202+0000 7f78eb57b700 1 -- 172.21.15.26:0/2350044332 wait complete. 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.304+0000 7f72fd4b3700 1 -- 172.21.15.26:0/4096810212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 msgr2=0x7f72f80f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.304+0000 7f72fd4b3700 1 --2- 172.21.15.26:0/4096810212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 0x7f72f80f7df0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f72e00047f0 tx=0x7f72e0009cb0).stop 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.304+0000 7f72fd4b3700 1 -- 172.21.15.26:0/4096810212 shutdown_connections 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.304+0000 7f72fd4b3700 1 --2- 172.21.15.26:0/4096810212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 0x7f72f80f7df0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.304+0000 7f72fd4b3700 1 --2- 172.21.15.26:0/4096810212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72f80f66f0 0x7f72f80f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.304+0000 7f72fd4b3700 1 -- 172.21.15.26:0/4096810212 >> 172.21.15.26:0/4096810212 conn(0x7f72f80f1e50 msgr2=0x7f72f80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.304+0000 7f72fd4b3700 1 -- 172.21.15.26:0/4096810212 shutdown_connections 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.304+0000 7f72fd4b3700 1 -- 172.21.15.26:0/4096810212 wait complete. 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72fd4b3700 1 Processor -- start 2024-05-09T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72fd4b3700 1 -- start start 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72fd4b3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72f80f66f0 0x7f72f8107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72fd4b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 0x7f72f8108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72fd4b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8108a10 con 0x7f72f80f7990 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72fd4b3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8108b50 con 0x7f72f80f66f0 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 0x7f72f8108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72f67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 0x7f72f8108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53820/0 (socket says 172.21.15.26:53820) 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72f67fc700 1 -- 172.21.15.26:0/2025821013 learned_addr learned my addr 172.21.15.26:0/2025821013 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72f6ffd700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72f80f66f0 0x7f72f8107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72f67fc700 1 -- 172.21.15.26:0/2025821013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72f80f66f0 msgr2=0x7f72f8107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72f67fc700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72f80f66f0 0x7f72f8107f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.305+0000 7f72f67fc700 1 -- 172.21.15.26:0/2025821013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0005040 con 0x7f72f80f7990 2024-05-09T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.306+0000 7f72f67fc700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 0x7f72f8108460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f72e000b120 tx=0x7f72e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.306+0000 7f72effff700 1 -- 172.21.15.26:0/2025821013 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e000e030 con 0x7f72f80f7990 2024-05-09T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.306+0000 7f72effff700 1 -- 172.21.15.26:0/2025821013 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f72e0007e90 con 0x7f72f80f7990 2024-05-09T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.306+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f810d590 con 0x7f72f80f7990 2024-05-09T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.306+0000 7f72effff700 1 -- 172.21.15.26:0/2025821013 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e0018070 con 0x7f72f80f7990 2024-05-09T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.306+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f810db50 con 0x7f72f80f7990 2024-05-09T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.307+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f80feed0 con 0x7f72f80f7990 2024-05-09T00:15:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.307+0000 7f72effff700 1 -- 172.21.15.26:0/2025821013 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f72e001d420 con 0x7f72f80f7990 2024-05-09T00:15:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.308+0000 7f72effff700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f72e406caa0 0x7f72e406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.308+0000 7f72effff700 1 -- 172.21.15.26:0/2025821013 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f72e008d430 con 0x7f72f80f7990 2024-05-09T00:15:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.308+0000 7f72f6ffd700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f72e406caa0 0x7f72e406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.308+0000 7f72f6ffd700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f72e406caa0 0x7f72e406ef60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f72f0004550 tx=0x7f72f0007d50).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.312+0000 7f72effff700 1 -- 172.21.15.26:0/2025821013 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f72e005ae80 con 0x7f72f80f7990 2024-05-09T00:15:51.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:51 smithi026 ceph-mon[93667]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:51.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:51 smithi026 ceph-mon[93667]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:51.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:15:51.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:51 smithi135 ceph-mon[80466]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:51.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:51 smithi135 ceph-mon[80466]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:51.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:15:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.570+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f72f810e1e0 con 0x7f72f80f7990 2024-05-09T00:15:51.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.571+0000 7f72effff700 1 -- 172.21.15.26:0/2025821013 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f72f810e1e0 con 0x7f72f80f7990 2024-05-09T00:15:51.569 INFO:teuthology.orchestra.run.smithi026.stdout:e32 2024-05-09T00:15:51.569 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:15:51.569 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:15:51.569 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:15:51.569 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 32 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:15:31.347544+0000 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:15:51.570 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 83 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=34400} 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:15:51.571 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:15:51.572 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:34400} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:15:51.572 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:15:51.572 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:15:51.572 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:15:51.572 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:15:51.572 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/666863957,v1:172.21.15.26:6829/666863957] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:15:51.572 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/2979557079,v1:172.21.15.135:6825/2979557079] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:15:51.572 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/918815670,v1:172.21.15.135:6827/918815670] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f72e406caa0 msgr2=0x7f72e406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f72e406caa0 0x7f72e406ef60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f72f0004550 tx=0x7f72f0007d50).stop 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 msgr2=0x7f72f8108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 0x7f72f8108460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f72e000b120 tx=0x7f72e0009cb0).stop 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 shutdown_connections 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f72e406caa0 0x7f72e406ef60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72f80f66f0 0x7f72f8107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 --2- 172.21.15.26:0/2025821013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f72f80f7990 0x7f72f8108460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 >> 172.21.15.26:0/2025821013 conn(0x7f72f80f1e50 msgr2=0x7f72f8060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 shutdown_connections 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.573+0000 7f72fd4b3700 1 -- 172.21.15.26:0/2025821013 wait complete. 2024-05-09T00:15:51.573 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2024-05-09T00:15:51.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.677+0000 7f74c9748700 1 -- 172.21.15.26:0/3530236888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40fa950 msgr2=0x7f74c40fcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.677+0000 7f74c9748700 1 --2- 172.21.15.26:0/3530236888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40fa950 0x7f74c40fcd40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f74ac0047f0 tx=0x7f74ac009cb0).stop 2024-05-09T00:15:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.677+0000 7f74c9748700 1 -- 172.21.15.26:0/3530236888 shutdown_connections 2024-05-09T00:15:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.677+0000 7f74c9748700 1 --2- 172.21.15.26:0/3530236888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40fa950 0x7f74c40fcd40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.677+0000 7f74c9748700 1 --2- 172.21.15.26:0/3530236888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74c40617b0 0x7f74c40fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.677+0000 7f74c9748700 1 -- 172.21.15.26:0/3530236888 >> 172.21.15.26:0/3530236888 conn(0x7f74c40f1ec0 msgr2=0x7f74c40f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.677+0000 7f74c9748700 1 -- 172.21.15.26:0/3530236888 shutdown_connections 2024-05-09T00:15:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.677+0000 7f74c9748700 1 -- 172.21.15.26:0/3530236888 wait complete. 2024-05-09T00:15:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c9748700 1 Processor -- start 2024-05-09T00:15:51.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c9748700 1 -- start start 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c9748700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40617b0 0x7f74c4108110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c9748700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74c40fa950 0x7f74c4108600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c9748700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4108bb0 con 0x7f74c40617b0 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c9748700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4108cf0 con 0x7f74c40fa950 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40617b0 0x7f74c4108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40617b0 0x7f74c4108110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40366/0 (socket says 172.21.15.26:40366) 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c2ffd700 1 -- 172.21.15.26:0/4016595190 learned_addr learned my addr 172.21.15.26:0/4016595190 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c2ffd700 1 -- 172.21.15.26:0/4016595190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74c40fa950 msgr2=0x7f74c4108600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c2ffd700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74c40fa950 0x7f74c4108600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.678+0000 7f74c2ffd700 1 -- 172.21.15.26:0/4016595190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac005040 con 0x7f74c40617b0 2024-05-09T00:15:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.679+0000 7f74c2ffd700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40617b0 0x7f74c4108110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f74b400e910 tx=0x7f74b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.679+0000 7f74bbfff700 1 -- 172.21.15.26:0/4016595190 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b400ee50 con 0x7f74c40617b0 2024-05-09T00:15:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.679+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c410d790 con 0x7f74c40617b0 2024-05-09T00:15:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.679+0000 7f74bbfff700 1 -- 172.21.15.26:0/4016595190 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74b400f040 con 0x7f74c40617b0 2024-05-09T00:15:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.679+0000 7f74bbfff700 1 -- 172.21.15.26:0/4016595190 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b400c810 con 0x7f74c40617b0 2024-05-09T00:15:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.679+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c410dd50 con 0x7f74c40617b0 2024-05-09T00:15:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.680+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c40fffd0 con 0x7f74c40617b0 2024-05-09T00:15:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.680+0000 7f74bbfff700 1 -- 172.21.15.26:0/4016595190 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f74b4007b40 con 0x7f74c40617b0 2024-05-09T00:15:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.681+0000 7f74bbfff700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f74b006caa0 0x7f74b006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.681+0000 7f74c27fc700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f74b006caa0 0x7f74b006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.681+0000 7f74bbfff700 1 -- 172.21.15.26:0/4016595190 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f74b408b8d0 con 0x7f74c40617b0 2024-05-09T00:15:51.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.681+0000 7f74c27fc700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f74b006caa0 0x7f74b006ef60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f74ac004e60 tx=0x7f74ac009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:51.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.685+0000 7f74bbfff700 1 -- 172.21.15.26:0/4016595190 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f74b4059320 con 0x7f74c40617b0 2024-05-09T00:15:51.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.915+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74c4059120 con 0x7f74b006caa0 2024-05-09T00:15:51.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.916+0000 7f74bbfff700 1 -- 172.21.15.26:0/4016595190 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f74c4059120 con 0x7f74b006caa0 2024-05-09T00:15:51.914 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "mds", 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "mon", 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "osd", 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr" 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "16/21 daemons upgraded", 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading node-exporter daemons", 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:15:51.915 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f74b006caa0 msgr2=0x7f74b006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f74b006caa0 0x7f74b006ef60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f74ac004e60 tx=0x7f74ac009cb0).stop 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40617b0 msgr2=0x7f74c4108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40617b0 0x7f74c4108110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f74b400e910 tx=0x7f74b400b040).stop 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 shutdown_connections 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f74b006caa0 0x7f74b006ef60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74c40617b0 0x7f74c4108110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 --2- 172.21.15.26:0/4016595190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74c40fa950 0x7f74c4108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.919+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 >> 172.21.15.26:0/4016595190 conn(0x7f74c40f1ec0 msgr2=0x7f74c40f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.920+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 shutdown_connections 2024-05-09T00:15:51.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:51.920+0000 7f74c9748700 1 -- 172.21.15.26:0/4016595190 wait complete. 2024-05-09T00:15:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.031+0000 7f39a045e700 1 -- 172.21.15.26:0/295492357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f8ab0 msgr2=0x7f39980f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.031+0000 7f39a045e700 1 --2- 172.21.15.26:0/295492357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f8ab0 0x7f39980f8f10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f398c0047f0 tx=0x7f398c009cb0).stop 2024-05-09T00:15:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.031+0000 7f39a045e700 1 -- 172.21.15.26:0/295492357 shutdown_connections 2024-05-09T00:15:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.031+0000 7f39a045e700 1 --2- 172.21.15.26:0/295492357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f8ab0 0x7f39980f8f10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.031+0000 7f39a045e700 1 --2- 172.21.15.26:0/295492357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39980f7810 0x7f39980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.031+0000 7f39a045e700 1 -- 172.21.15.26:0/295492357 >> 172.21.15.26:0/295492357 conn(0x7f39980f2f50 msgr2=0x7f39980f5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.031+0000 7f39a045e700 1 -- 172.21.15.26:0/295492357 shutdown_connections 2024-05-09T00:15:52.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.031+0000 7f39a045e700 1 -- 172.21.15.26:0/295492357 wait complete. 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f39a045e700 1 Processor -- start 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f39a045e700 1 -- start start 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f39a045e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f7810 0x7f3998108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f39a045e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39980f8ab0 0x7f3998108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f39a045e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3998108b20 con 0x7f39980f7810 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f39a045e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3998108c60 con 0x7f39980f8ab0 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f399e1fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f7810 0x7f3998108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f399e1fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f7810 0x7f3998108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40392/0 (socket says 172.21.15.26:40392) 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f399e1fa700 1 -- 172.21.15.26:0/2326847606 learned_addr learned my addr 172.21.15.26:0/2326847606 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f399d9f9700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39980f8ab0 0x7f3998108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f399e1fa700 1 -- 172.21.15.26:0/2326847606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39980f8ab0 msgr2=0x7f3998108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:52.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f399e1fa700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39980f8ab0 0x7f3998108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.032+0000 7f399e1fa700 1 -- 172.21.15.26:0/2326847606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c005040 con 0x7f39980f7810 2024-05-09T00:15:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.033+0000 7f399e1fa700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f7810 0x7f3998108080 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f399000e8c0 tx=0x7f399000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.033+0000 7f39977fe700 1 -- 172.21.15.26:0/2326847606 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3990007b40 con 0x7f39980f7810 2024-05-09T00:15:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.033+0000 7f39977fe700 1 -- 172.21.15.26:0/2326847606 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f399000f040 con 0x7f39980f7810 2024-05-09T00:15:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.033+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399810d700 con 0x7f39980f7810 2024-05-09T00:15:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.033+0000 7f39977fe700 1 -- 172.21.15.26:0/2326847606 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3990014880 con 0x7f39980f7810 2024-05-09T00:15:52.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.033+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399810dcc0 con 0x7f39980f7810 2024-05-09T00:15:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.034+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39980fffd0 con 0x7f39980f7810 2024-05-09T00:15:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.034+0000 7f39977fe700 1 -- 172.21.15.26:0/2326847606 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3990007ca0 con 0x7f39980f7810 2024-05-09T00:15:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.035+0000 7f39977fe700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f398006caa0 0x7f398006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:15:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.035+0000 7f39977fe700 1 -- 172.21.15.26:0/2326847606 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f399008ba90 con 0x7f39980f7810 2024-05-09T00:15:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.035+0000 7f399d9f9700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f398006caa0 0x7f398006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:52.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.035+0000 7f399d9f9700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f398006caa0 0x7f398006ef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f398c0047c0 tx=0x7f398c009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:52.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.039+0000 7f39977fe700 1 -- 172.21.15.26:0/2326847606 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f39900594e0 con 0x7f39980f7810 2024-05-09T00:15:52.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.345+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3998101e40 con 0x7f39980f7810 2024-05-09T00:15:52.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.346+0000 7f39977fe700 1 -- 172.21.15.26:0/2326847606 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f39900190e0 con 0x7f39980f7810 2024-05-09T00:15:52.344 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:15:52.345 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:15:52.345 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:15:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f398006caa0 msgr2=0x7f398006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f398006caa0 0x7f398006ef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f398c0047c0 tx=0x7f398c009cb0).stop 2024-05-09T00:15:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f7810 msgr2=0x7f3998108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:52.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f7810 0x7f3998108080 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f399000e8c0 tx=0x7f399000b040).stop 2024-05-09T00:15:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 shutdown_connections 2024-05-09T00:15:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f398006caa0 0x7f398006ef60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39980f7810 0x7f3998108080 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 --2- 172.21.15.26:0/2326847606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39980f8ab0 0x7f3998108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:15:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 >> 172.21.15.26:0/2326847606 conn(0x7f39980f2f50 msgr2=0x7f39980fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 shutdown_connections 2024-05-09T00:15:52.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:15:52.348+0000 7f39a045e700 1 -- 172.21.15.26:0/2326847606 wait complete. 2024-05-09T00:15:52.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:52 smithi026 ceph-mon[93667]: pgmap v217: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-09T00:15:52.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:52 smithi026 ceph-mon[93667]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:52.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:52 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2350044332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:52.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:52 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2025821013' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:15:52.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:52 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:52.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:52 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:52.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:52 smithi135 ceph-mon[80466]: pgmap v217: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-05-09T00:15:52.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:52 smithi135 ceph-mon[80466]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:52.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:52 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2350044332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:15:52.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:52 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2025821013' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:15:52.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:52 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:52.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:52 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:53.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:53 smithi026 ceph-mon[93667]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:53.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:53 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2326847606' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:15:53.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:53 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:53.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:53 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:53.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:53 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:53.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:53 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:53.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:53 smithi135 ceph-mon[80466]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:15:53.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:53 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2326847606' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:15:53.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:53 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:53.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:53 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:53.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:53 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:53.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:53 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:54.446 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:54 smithi135 ceph-mon[80466]: pgmap v218: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:15:54.446 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:54.446 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:54 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:54 smithi026 ceph-mon[93667]: pgmap v218: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:15:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:54 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:56.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:56 smithi135 ceph-mon[80466]: pgmap v219: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:15:56.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:56 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:56.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:56 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:56.503 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:56 smithi026 ceph-mon[93667]: pgmap v219: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:15:56.503 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:56 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:56.503 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:56 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:15:58.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:15:58 smithi026 ceph-mon[93667]: pgmap v220: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:15:58.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:15:58 smithi135 ceph-mon[80466]: pgmap v220: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:00.462 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: pgmap v221: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:00.462 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:00.462 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:00.462 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.463 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.464 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.464 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:00 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: pgmap v221: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:00.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:00.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:00.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:00 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:02.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:02 smithi135 ceph-mon[80466]: pgmap v222: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:02.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:02 smithi026 ceph-mon[93667]: pgmap v222: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:03.542 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:03 smithi135 ceph-mon[80466]: Upgrade: Updating prometheus.smithi135 2024-05-09T00:16:03.543 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:03 smithi135 ceph-mon[80466]: Deploying daemon prometheus.smithi135 on smithi135 2024-05-09T00:16:03.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:03 smithi026 ceph-mon[93667]: Upgrade: Updating prometheus.smithi135 2024-05-09T00:16:03.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:03 smithi026 ceph-mon[93667]: Deploying daemon prometheus.smithi135 on smithi135 2024-05-09T00:16:04.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:04 smithi135 ceph-mon[80466]: pgmap v223: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:04.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:04 smithi026 ceph-mon[93667]: pgmap v223: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:06.563 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:06 smithi135 ceph-mon[80466]: pgmap v224: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:06.563 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:16:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:06 smithi026 ceph-mon[93667]: pgmap v224: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:16:08.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:07 smithi135 ceph-mon[80466]: pgmap v225: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:08.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:08.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:08.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:07 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:08.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:07 smithi026 ceph-mon[93667]: pgmap v225: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:08.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:08.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:08.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:07 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:10.803 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:10 smithi135 ceph-mon[80466]: pgmap v226: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:10.803 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:10 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:10.803 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:10 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:10.803 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:10 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:10.803 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:10 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:10.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:10 smithi026 ceph-mon[93667]: pgmap v226: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:10.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:10 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:10.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:10 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:10.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:10 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:10.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:10 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:12.855 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:12 smithi135 ceph-mon[80466]: pgmap v227: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:12.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:12 smithi026 ceph-mon[93667]: pgmap v227: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:14.589 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: pgmap v228: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:14.589 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.590 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.591 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.591 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.591 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.591 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.591 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.591 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.591 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:14 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: pgmap v228: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:14.903 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:14 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:15.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:15 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:16:15.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:15 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T00:16:16.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:16 smithi026 ceph-mon[93667]: pgmap v229: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:16.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:16 smithi026 ceph-mon[93667]: Upgrade: Updating alertmanager.smithi026 2024-05-09T00:16:16.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:16 smithi026 ceph-mon[93667]: Deploying daemon alertmanager.smithi026 on smithi026 2024-05-09T00:16:16.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:16 smithi135 ceph-mon[80466]: pgmap v229: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:16.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:16 smithi135 ceph-mon[80466]: Upgrade: Updating alertmanager.smithi026 2024-05-09T00:16:16.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:16 smithi135 ceph-mon[80466]: Deploying daemon alertmanager.smithi026 on smithi026 2024-05-09T00:16:18.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:18 smithi026 ceph-mon[93667]: pgmap v230: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:18.902 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:18 smithi135 ceph-mon[80466]: pgmap v230: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:20.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:20 smithi026 ceph-mon[93667]: pgmap v231: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:20.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:20 smithi135 ceph-mon[80466]: pgmap v231: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:21.889 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:16:21.890 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:21.890 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:21.890 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:21.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:16:21.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:21.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:21.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 -- 172.21.15.26:0/2937104330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 msgr2=0x7fcbb80fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 --2- 172.21.15.26:0/2937104330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 0x7fcbb80fcda0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fcba80047f0 tx=0x7fcba8009cb0).stop 2024-05-09T00:16:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 -- 172.21.15.26:0/2937104330 shutdown_connections 2024-05-09T00:16:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 --2- 172.21.15.26:0/2937104330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 0x7fcbb80fcda0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 --2- 172.21.15.26:0/2937104330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbb8061280 0x7fcbb80fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 -- 172.21.15.26:0/2937104330 >> 172.21.15.26:0/2937104330 conn(0x7fcbb80f1e50 msgr2=0x7fcbb80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 -- 172.21.15.26:0/2937104330 shutdown_connections 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 -- 172.21.15.26:0/2937104330 wait complete. 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 Processor -- start 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.454+0000 7fcbbf885700 1 -- start start 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbf885700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbb8061280 0x7fcbb80f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbf885700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 0x7fcbb80f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbf885700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80f8220 con 0x7fcbb80fa950 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbf885700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80f67c0 con 0x7fcbb8061280 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbce20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 0x7fcbb80f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbce20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 0x7fcbb80f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60140/0 (socket says 172.21.15.26:60140) 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbce20700 1 -- 172.21.15.26:0/2745383160 learned_addr learned my addr 172.21.15.26:0/2745383160 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:22.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbd621700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbb8061280 0x7fcbb80f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbce20700 1 -- 172.21.15.26:0/2745383160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbb8061280 msgr2=0x7fcbb80f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbce20700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbb8061280 0x7fcbb80f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbce20700 1 -- 172.21.15.26:0/2745383160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8005040 con 0x7fcbb80fa950 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbce20700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 0x7fcbb80f62d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fcba8013560 tx=0x7fcba8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbae7fc700 1 -- 172.21.15.26:0/2745383160 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba8018070 con 0x7fcbb80fa950 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbae7fc700 1 -- 172.21.15.26:0/2745383160 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcba8007e90 con 0x7fcbb80fa950 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb80f69e0 con 0x7fcbb80fa950 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.455+0000 7fcbae7fc700 1 -- 172.21.15.26:0/2745383160 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba801c380 con 0x7fcbb80fa950 2024-05-09T00:16:22.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.456+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb80f6f40 con 0x7fcbb80fa950 2024-05-09T00:16:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.456+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb8047540 con 0x7fcbb80fa950 2024-05-09T00:16:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.457+0000 7fcbae7fc700 1 -- 172.21.15.26:0/2745383160 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcba80123c0 con 0x7fcbb80fa950 2024-05-09T00:16:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.457+0000 7fcbae7fc700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcba406caa0 0x7fcba406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.457+0000 7fcbae7fc700 1 -- 172.21.15.26:0/2745383160 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fcba808cc60 con 0x7fcbb80fa950 2024-05-09T00:16:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.457+0000 7fcbbd621700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcba406caa0 0x7fcba406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:22.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.458+0000 7fcbbd621700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcba406caa0 0x7fcba406ef60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fcbb40048b0 tx=0x7fcbb400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:22.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.462+0000 7fcbae7fc700 1 -- 172.21.15.26:0/2745383160 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fcba805a6b0 con 0x7fcbb80fa950 2024-05-09T00:16:22.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.684+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbb8102010 con 0x7fcba406caa0 2024-05-09T00:16:22.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.685+0000 7fcbae7fc700 1 -- 172.21.15.26:0/2745383160 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fcbb400f040 con 0x7fcba406caa0 2024-05-09T00:16:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcba406caa0 msgr2=0x7fcba406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcba406caa0 0x7fcba406ef60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fcbb40048b0 tx=0x7fcbb400b040).stop 2024-05-09T00:16:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 msgr2=0x7fcbb80f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 0x7fcbb80f62d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fcba8013560 tx=0x7fcba8009cb0).stop 2024-05-09T00:16:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 shutdown_connections 2024-05-09T00:16:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcba406caa0 0x7fcba406ef60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbb8061280 0x7fcbb80f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 --2- 172.21.15.26:0/2745383160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbb80fa950 0x7fcbb80f62d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 >> 172.21.15.26:0/2745383160 conn(0x7fcbb80f1e50 msgr2=0x7fcbb80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 shutdown_connections 2024-05-09T00:16:22.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.688+0000 7fcbbf885700 1 -- 172.21.15.26:0/2745383160 wait complete. 2024-05-09T00:16:22.697 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 -- 172.21.15.26:0/2692488814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 msgr2=0x7efe240f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 --2- 172.21.15.26:0/2692488814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 0x7efe240f6b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7efe1c009b60 tx=0x7efe1c004d10).stop 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 -- 172.21.15.26:0/2692488814 shutdown_connections 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 --2- 172.21.15.26:0/2692488814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe240f7990 0x7efe240f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 --2- 172.21.15.26:0/2692488814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 0x7efe240f6b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 -- 172.21.15.26:0/2692488814 >> 172.21.15.26:0/2692488814 conn(0x7efe240f1e50 msgr2=0x7efe240f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 -- 172.21.15.26:0/2692488814 shutdown_connections 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 -- 172.21.15.26:0/2692488814 wait complete. 2024-05-09T00:16:22.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 Processor -- start 2024-05-09T00:16:22.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.791+0000 7efe2b1cd700 1 -- start start 2024-05-09T00:16:22.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe2b1cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 0x7efe24107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:22.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe2b1cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe240f7990 0x7efe24108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:22.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe2b1cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24108a40 con 0x7efe240f66f0 2024-05-09T00:16:22.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe2b1cd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24108b80 con 0x7efe240f7990 2024-05-09T00:16:22.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe28f69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 0x7efe24107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:22.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe28f69700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 0x7efe24107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60168/0 (socket says 172.21.15.26:60168) 2024-05-09T00:16:22.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe28f69700 1 -- 172.21.15.26:0/3215501037 learned_addr learned my addr 172.21.15.26:0/3215501037 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:22.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe23fff700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe240f7990 0x7efe24108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe28f69700 1 -- 172.21.15.26:0/3215501037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe240f7990 msgr2=0x7efe24108490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe28f69700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe240f7990 0x7efe24108490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe28f69700 1 -- 172.21.15.26:0/3215501037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c0097c0 con 0x7efe240f66f0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe23fff700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe240f7990 0x7efe24108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe28f69700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 0x7efe24107fa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7efe1c000f80 tx=0x7efe1c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe21ffb700 1 -- 172.21.15.26:0/3215501037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1c00e070 con 0x7efe240f66f0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe21ffb700 1 -- 172.21.15.26:0/3215501037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe1c01e8d0 con 0x7efe240f66f0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2410d5c0 con 0x7efe240f66f0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.792+0000 7efe21ffb700 1 -- 172.21.15.26:0/3215501037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1c019070 con 0x7efe240f66f0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.793+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2410db80 con 0x7efe240f66f0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.794+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe240feed0 con 0x7efe240f66f0 2024-05-09T00:16:22.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.794+0000 7efe21ffb700 1 -- 172.21.15.26:0/3215501037 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efe1c01ea40 con 0x7efe240f66f0 2024-05-09T00:16:22.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.795+0000 7efe21ffb700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efe1006caa0 0x7efe1006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:22.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.795+0000 7efe21ffb700 1 -- 172.21.15.26:0/3215501037 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7efe1c08d320 con 0x7efe240f66f0 2024-05-09T00:16:22.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.795+0000 7efe23fff700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efe1006caa0 0x7efe1006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:22.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.795+0000 7efe23fff700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efe1006caa0 0x7efe1006ef60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7efe0c004ca0 tx=0x7efe0c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:22.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:22.799+0000 7efe21ffb700 1 -- 172.21.15.26:0/3215501037 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7efe1c05ad70 con 0x7efe240f66f0 2024-05-09T00:16:22.898 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:22 smithi026 ceph-mon[93667]: pgmap v232: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:22.900 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:22 smithi135 ceph-mon[80466]: pgmap v232: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:23.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.022+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe2410e210 con 0x7efe1006caa0 2024-05-09T00:16:23.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.023+0000 7efe21ffb700 1 -- 172.21.15.26:0/3215501037 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7efe2410e210 con 0x7efe1006caa0 2024-05-09T00:16:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.025+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efe1006caa0 msgr2=0x7efe1006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.025+0000 7efe2b1cd700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efe1006caa0 0x7efe1006ef60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7efe0c004ca0 tx=0x7efe0c00b040).stop 2024-05-09T00:16:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.025+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 msgr2=0x7efe24107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.025+0000 7efe2b1cd700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 0x7efe24107fa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7efe1c000f80 tx=0x7efe1c004d10).stop 2024-05-09T00:16:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.025+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 shutdown_connections 2024-05-09T00:16:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.025+0000 7efe2b1cd700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7efe1006caa0 0x7efe1006ef60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.025+0000 7efe2b1cd700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe240f66f0 0x7efe24107fa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.026+0000 7efe2b1cd700 1 --2- 172.21.15.26:0/3215501037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe240f7990 0x7efe24108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.026+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 >> 172.21.15.26:0/3215501037 conn(0x7efe240f1e50 msgr2=0x7efe24060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:23.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.026+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 shutdown_connections 2024-05-09T00:16:23.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.026+0000 7efe2b1cd700 1 -- 172.21.15.26:0/3215501037 wait complete. 2024-05-09T00:16:23.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.131+0000 7fca4aff7700 1 -- 172.21.15.26:0/2538017036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440611e0 msgr2=0x7fca440fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.131+0000 7fca4aff7700 1 --2- 172.21.15.26:0/2538017036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440611e0 0x7fca440fa470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fca380047f0 tx=0x7fca38009cb0).stop 2024-05-09T00:16:23.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.131+0000 7fca4aff7700 1 -- 172.21.15.26:0/2538017036 shutdown_connections 2024-05-09T00:16:23.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.131+0000 7fca4aff7700 1 --2- 172.21.15.26:0/2538017036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca440fa960 0x7fca440fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.131+0000 7fca4aff7700 1 --2- 172.21.15.26:0/2538017036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440611e0 0x7fca440fa470 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.131+0000 7fca4aff7700 1 -- 172.21.15.26:0/2538017036 >> 172.21.15.26:0/2538017036 conn(0x7fca440f1e50 msgr2=0x7fca440f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:23.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.131+0000 7fca4aff7700 1 -- 172.21.15.26:0/2538017036 shutdown_connections 2024-05-09T00:16:23.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.131+0000 7fca4aff7700 1 -- 172.21.15.26:0/2538017036 wait complete. 2024-05-09T00:16:23.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.132+0000 7fca4aff7700 1 Processor -- start 2024-05-09T00:16:23.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.132+0000 7fca4aff7700 1 -- start start 2024-05-09T00:16:23.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca4aff7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca440611e0 0x7fca44107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca4aff7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440fa960 0x7fca44108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca4aff7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44108a10 con 0x7fca440fa960 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca4aff7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44108b50 con 0x7fca440611e0 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca43fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440fa960 0x7fca44108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca43fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440fa960 0x7fca44108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60184/0 (socket says 172.21.15.26:60184) 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca43fff700 1 -- 172.21.15.26:0/2053954896 learned_addr learned my addr 172.21.15.26:0/2053954896 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca48d93700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca440611e0 0x7fca44107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca43fff700 1 -- 172.21.15.26:0/2053954896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca440611e0 msgr2=0x7fca44107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca43fff700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca440611e0 0x7fca44107f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca43fff700 1 -- 172.21.15.26:0/2053954896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38005040 con 0x7fca440fa960 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca48d93700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca440611e0 0x7fca44107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca43fff700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440fa960 0x7fca44108460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fca3000c710 tx=0x7fca30007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.133+0000 7fca41ffb700 1 -- 172.21.15.26:0/2053954896 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca3000e680 con 0x7fca440fa960 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.134+0000 7fca41ffb700 1 -- 172.21.15.26:0/2053954896 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca3000ec90 con 0x7fca440fa960 2024-05-09T00:16:23.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.134+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4410d5f0 con 0x7fca440fa960 2024-05-09T00:16:23.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.134+0000 7fca41ffb700 1 -- 172.21.15.26:0/2053954896 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca30013cd0 con 0x7fca440fa960 2024-05-09T00:16:23.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.134+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4410dbb0 con 0x7fca440fa960 2024-05-09T00:16:23.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.135+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca440ffff0 con 0x7fca440fa960 2024-05-09T00:16:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.135+0000 7fca41ffb700 1 -- 172.21.15.26:0/2053954896 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fca3000e7e0 con 0x7fca440fa960 2024-05-09T00:16:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.136+0000 7fca41ffb700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fca3406cab0 0x7fca3406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.136+0000 7fca41ffb700 1 -- 172.21.15.26:0/2053954896 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fca3008c230 con 0x7fca440fa960 2024-05-09T00:16:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.136+0000 7fca48d93700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fca3406cab0 0x7fca3406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.136+0000 7fca48d93700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fca3406cab0 0x7fca3406ef70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fca38004f10 tx=0x7fca38009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:23.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.141+0000 7fca41ffb700 1 -- 172.21.15.26:0/2053954896 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fca30059c80 con 0x7fca440fa960 2024-05-09T00:16:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.364+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fca44059120 con 0x7fca3406cab0 2024-05-09T00:16:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.375+0000 7fca41ffb700 1 -- 172.21.15.26:0/2053954896 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fca44059120 con 0x7fca3406cab0 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 starting - - - - 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (5m) 30s ago 17m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (5m) 13s ago 16m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (8m) 30s ago 16m 56.9M - 8.3.5 dad864ee21e9 b583be22b2ba 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (100s) 30s ago 11m 14.2M - 18.2.2-1322-gd21e4f96 af23193ff691 d186720df096 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (2m) 30s ago 11m 81.8M - 18.2.2-1322-gd21e4f96 af23193ff691 4083eb8ff427 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (55s) 13s ago 11m 11.8M - 18.2.2-1322-gd21e4f96 af23193ff691 8f7df1307719 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (74s) 13s ago 11m 15.1M - 18.2.2-1322-gd21e4f96 af23193ff691 20dc7cc555ea 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (7m) 30s ago 18m 509M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:16:23.375 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (6m) 13s ago 16m 453M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (6m) 30s ago 18m 53.2M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (6m) 13s ago 16m 43.7M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (41s) 30s ago 16m 8568k - 1.5.0 0da6a335fe13 b8ba8105dfb9 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (34s) 13s ago 16m 8434k - 1.5.0 0da6a335fe13 8668fc4ddeef 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 30s ago 15m 111M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (4m) 30s ago 15m 117M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (4m) 30s ago 14m 104M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (3m) 13s ago 14m 122M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (2m) 13s ago 13m 103M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 a23ab54b2270 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (2m) 13s ago 13m 100M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 df906a6613b1 2024-05-09T00:16:23.376 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (17s) 13s ago 15m 42.0M - 2.43.0 a07b618ecd1d a2baf25b6557 2024-05-09T00:16:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fca3406cab0 msgr2=0x7fca3406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fca3406cab0 0x7fca3406ef70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fca38004f10 tx=0x7fca38009cb0).stop 2024-05-09T00:16:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440fa960 msgr2=0x7fca44108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440fa960 0x7fca44108460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fca3000c710 tx=0x7fca30007ec0).stop 2024-05-09T00:16:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 shutdown_connections 2024-05-09T00:16:23.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fca3406cab0 0x7fca3406ef70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca440611e0 0x7fca44107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 --2- 172.21.15.26:0/2053954896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca440fa960 0x7fca44108460 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 >> 172.21.15.26:0/2053954896 conn(0x7fca440f1e50 msgr2=0x7fca440f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:23.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 shutdown_connections 2024-05-09T00:16:23.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.378+0000 7fca4aff7700 1 -- 172.21.15.26:0/2053954896 wait complete. 2024-05-09T00:16:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 -- 172.21.15.26:0/3161891164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f8e40 msgr2=0x7f11380f9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 --2- 172.21.15.26:0/3161891164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f8e40 0x7f11380f9260 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f11340047f0 tx=0x7f1134009cb0).stop 2024-05-09T00:16:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 -- 172.21.15.26:0/3161891164 shutdown_connections 2024-05-09T00:16:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 --2- 172.21.15.26:0/3161891164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11380f9750 0x7f11380f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 --2- 172.21.15.26:0/3161891164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f8e40 0x7f11380f9260 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 -- 172.21.15.26:0/3161891164 >> 172.21.15.26:0/3161891164 conn(0x7f11380f1680 msgr2=0x7f11380f3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:23.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 -- 172.21.15.26:0/3161891164 shutdown_connections 2024-05-09T00:16:23.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 -- 172.21.15.26:0/3161891164 wait complete. 2024-05-09T00:16:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 Processor -- start 2024-05-09T00:16:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 -- start start 2024-05-09T00:16:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.498+0000 7f113f7e3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11380f8e40 0x7f11380f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113f7e3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f9750 0x7f11380f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113f7e3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380f8ae0 con 0x7f11380f9750 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113f7e3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380f7080 con 0x7f11380f8e40 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113cd7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f9750 0x7f11380f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113cd7e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f9750 0x7f11380f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60204/0 (socket says 172.21.15.26:60204) 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113cd7e700 1 -- 172.21.15.26:0/1497713857 learned_addr learned my addr 172.21.15.26:0/1497713857 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113d57f700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11380f8e40 0x7f11380f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113cd7e700 1 -- 172.21.15.26:0/1497713857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11380f8e40 msgr2=0x7f11380f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113cd7e700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11380f8e40 0x7f11380f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113cd7e700 1 -- 172.21.15.26:0/1497713857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134005040 con 0x7f11380f9750 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113cd7e700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f9750 0x7f11380f6b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f11280041d0 tx=0x7f1128009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f112e7fc700 1 -- 172.21.15.26:0/1497713857 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1128002d90 con 0x7f11380f9750 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f112e7fc700 1 -- 172.21.15.26:0/1497713857 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f112800f040 con 0x7f11380f9750 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f112e7fc700 1 -- 172.21.15.26:0/1497713857 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112800d800 con 0x7f11380f9750 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11380f7300 con 0x7f11380f9750 2024-05-09T00:16:23.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.499+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11380f7870 con 0x7f11380f9750 2024-05-09T00:16:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.500+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11380ffff0 con 0x7f11380f9750 2024-05-09T00:16:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.501+0000 7f112e7fc700 1 -- 172.21.15.26:0/1497713857 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f112800dac0 con 0x7f11380f9750 2024-05-09T00:16:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.501+0000 7f112e7fc700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f112406caa0 0x7f112406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.501+0000 7f113d57f700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f112406caa0 0x7f112406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.501+0000 7f112e7fc700 1 -- 172.21.15.26:0/1497713857 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f112808bf00 con 0x7f11380f9750 2024-05-09T00:16:23.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.502+0000 7f113d57f700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f112406caa0 0x7f112406ef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1134004f10 tx=0x7f113400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:23.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.506+0000 7f112e7fc700 1 -- 172.21.15.26:0/1497713857 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f1128059950 con 0x7f11380f9750 2024-05-09T00:16:23.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.791+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f11380598f0 con 0x7f11380f9750 2024-05-09T00:16:23.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.791+0000 7f112e7fc700 1 -- 172.21.15.26:0/1497713857 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f11280594e0 con 0x7f11380f9750 2024-05-09T00:16:23.791 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:16:23.791 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:16:23.791 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:16:23.791 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:16:23.791 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:16:23.791 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 6 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 4 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 14 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:16:23.792 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:16:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.793+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f112406caa0 msgr2=0x7f112406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.793+0000 7f113f7e3700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f112406caa0 0x7f112406ef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1134004f10 tx=0x7f113400b040).stop 2024-05-09T00:16:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.793+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f9750 msgr2=0x7f11380f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.793+0000 7f113f7e3700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f9750 0x7f11380f6b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f11280041d0 tx=0x7f1128009f60).stop 2024-05-09T00:16:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.793+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 shutdown_connections 2024-05-09T00:16:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.794+0000 7f113f7e3700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f112406caa0 0x7f112406ef60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.794+0000 7f113f7e3700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11380f8e40 0x7f11380f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.794+0000 7f113f7e3700 1 --2- 172.21.15.26:0/1497713857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11380f9750 0x7f11380f6b90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.794+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 >> 172.21.15.26:0/1497713857 conn(0x7f11380f1680 msgr2=0x7f11380fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.794+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 shutdown_connections 2024-05-09T00:16:23.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.794+0000 7f113f7e3700 1 -- 172.21.15.26:0/1497713857 wait complete. 2024-05-09T00:16:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.895+0000 7fad201da700 1 -- 172.21.15.26:0/1547041082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 msgr2=0x7fad180f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.895+0000 7fad201da700 1 --2- 172.21.15.26:0/1547041082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 0x7fad180f7df0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fad080047f0 tx=0x7fad08009cb0).stop 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.895+0000 7fad201da700 1 -- 172.21.15.26:0/1547041082 shutdown_connections 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.895+0000 7fad201da700 1 --2- 172.21.15.26:0/1547041082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 0x7fad180f7df0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 --2- 172.21.15.26:0/1547041082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad180f66f0 0x7fad180f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 -- 172.21.15.26:0/1547041082 >> 172.21.15.26:0/1547041082 conn(0x7fad180f1e50 msgr2=0x7fad180f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 -- 172.21.15.26:0/1547041082 shutdown_connections 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 -- 172.21.15.26:0/1547041082 wait complete. 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 Processor -- start 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 -- start start 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad180f66f0 0x7fad18060ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 0x7fad1810f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18108ba0 con 0x7fad180f7990 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.896+0000 7fad201da700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1810f6b0 con 0x7fad180f66f0 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad1d775700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 0x7fad1810f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad1d775700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 0x7fad1810f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60230/0 (socket says 172.21.15.26:60230) 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad1d775700 1 -- 172.21.15.26:0/2033123384 learned_addr learned my addr 172.21.15.26:0/2033123384 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad1df76700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad180f66f0 0x7fad18060ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad1d775700 1 -- 172.21.15.26:0/2033123384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad180f66f0 msgr2=0x7fad18060ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad1d775700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad180f66f0 0x7fad18060ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad1d775700 1 -- 172.21.15.26:0/2033123384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08005040 con 0x7fad180f7990 2024-05-09T00:16:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad1d775700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 0x7fad1810f1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fad0800b120 tx=0x7fad08009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad0effd700 1 -- 172.21.15.26:0/2033123384 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0800e030 con 0x7fad180f7990 2024-05-09T00:16:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad0effd700 1 -- 172.21.15.26:0/2033123384 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad08007e90 con 0x7fad180f7990 2024-05-09T00:16:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1810f7f0 con 0x7fad180f7990 2024-05-09T00:16:23.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.897+0000 7fad0effd700 1 -- 172.21.15.26:0/2033123384 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad08018070 con 0x7fad180f7990 2024-05-09T00:16:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.898+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1810fd20 con 0x7fad180f7990 2024-05-09T00:16:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.899+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad180feed0 con 0x7fad180f7990 2024-05-09T00:16:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.899+0000 7fad0effd700 1 -- 172.21.15.26:0/2033123384 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fad0801d420 con 0x7fad180f7990 2024-05-09T00:16:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.900+0000 7fad0effd700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fad0406caa0 0x7fad0406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.900+0000 7fad0effd700 1 -- 172.21.15.26:0/2033123384 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fad0808cfb0 con 0x7fad180f7990 2024-05-09T00:16:23.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.900+0000 7fad1df76700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fad0406caa0 0x7fad0406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:23.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.900+0000 7fad1df76700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fad0406caa0 0x7fad0406ef60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fad140041d0 tx=0x7fad14009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:23.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:23.904+0000 7fad0effd700 1 -- 172.21.15.26:0/2033123384 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fad0805a9e0 con 0x7fad180f7990 2024-05-09T00:16:24.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.172+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fad18100d40 con 0x7fad180f7990 2024-05-09T00:16:24.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.172+0000 7fad0effd700 1 -- 172.21.15.26:0/2033123384 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fad0805a570 con 0x7fad180f7990 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:e32 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 32 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:15:31.347544+0000 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:16:24.172 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 83 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=34400} 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:16:24.173 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:34400} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:16:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:16:24.175 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:16:24.175 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/666863957,v1:172.21.15.26:6829/666863957] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:16:24.175 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/2979557079,v1:172.21.15.135:6825/2979557079] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:16:24.175 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/918815670,v1:172.21.15.135:6827/918815670] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fad0406caa0 msgr2=0x7fad0406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fad0406caa0 0x7fad0406ef60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fad140041d0 tx=0x7fad14009040).stop 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 msgr2=0x7fad1810f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 0x7fad1810f1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fad0800b120 tx=0x7fad08009cb0).stop 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 shutdown_connections 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fad0406caa0 0x7fad0406ef60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad180f66f0 0x7fad18060ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 --2- 172.21.15.26:0/2033123384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad180f7990 0x7fad1810f1c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 >> 172.21.15.26:0/2033123384 conn(0x7fad180f1e50 msgr2=0x7fad180fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 shutdown_connections 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.174+0000 7fad201da700 1 -- 172.21.15.26:0/2033123384 wait complete. 2024-05-09T00:16:24.176 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2024-05-09T00:16:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.280+0000 7f70f205c700 1 -- 172.21.15.26:0/1012769142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f7810 msgr2=0x7f70ec0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.280+0000 7f70f205c700 1 --2- 172.21.15.26:0/1012769142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f7810 0x7f70ec0f7c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f70dc0047f0 tx=0x7f70dc009cb0).stop 2024-05-09T00:16:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.280+0000 7f70f205c700 1 -- 172.21.15.26:0/1012769142 shutdown_connections 2024-05-09T00:16:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.280+0000 7f70f205c700 1 --2- 172.21.15.26:0/1012769142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec0f8ab0 0x7f70ec0f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.280+0000 7f70f205c700 1 --2- 172.21.15.26:0/1012769142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f7810 0x7f70ec0f7c30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.280+0000 7f70f205c700 1 -- 172.21.15.26:0/1012769142 >> 172.21.15.26:0/1012769142 conn(0x7f70ec0f2f50 msgr2=0x7f70ec0f5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.280+0000 7f70f205c700 1 -- 172.21.15.26:0/1012769142 shutdown_connections 2024-05-09T00:16:24.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.280+0000 7f70f205c700 1 -- 172.21.15.26:0/1012769142 wait complete. 2024-05-09T00:16:24.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70f205c700 1 Processor -- start 2024-05-09T00:16:24.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70f205c700 1 -- start start 2024-05-09T00:16:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70f205c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec0f7810 0x7f70ec06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:24.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70f205c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f8ab0 0x7f70ec06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70f205c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec06cf80 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70f205c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec06b520 con 0x7f70ec0f7810 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f8ab0 0x7f70ec06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f8ab0 0x7f70ec06b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60240/0 (socket says 172.21.15.26:60240) 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70eaffd700 1 -- 172.21.15.26:0/2350403752 learned_addr learned my addr 172.21.15.26:0/2350403752 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.281+0000 7f70eb7fe700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec0f7810 0x7f70ec06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70eaffd700 1 -- 172.21.15.26:0/2350403752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec0f7810 msgr2=0x7f70ec06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70eaffd700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec0f7810 0x7f70ec06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70eaffd700 1 -- 172.21.15.26:0/2350403752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc005040 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70eaffd700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f8ab0 0x7f70ec06b030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f70e000e8f0 tx=0x7f70e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70e8ff9700 1 -- 172.21.15.26:0/2350403752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e0007b40 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec06b7a0 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70e8ff9700 1 -- 172.21.15.26:0/2350403752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70e000f040 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70e8ff9700 1 -- 172.21.15.26:0/2350403752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e0014880 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.282+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec06bd60 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.283+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec0fffd0 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.284+0000 7f70e8ff9700 1 -- 172.21.15.26:0/2350403752 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f70e0009090 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.285+0000 7f70e8ff9700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f70d406caa0 0x7f70d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.285+0000 7f70e8ff9700 1 -- 172.21.15.26:0/2350403752 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f70e008c230 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.285+0000 7f70eb7fe700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f70d406caa0 0x7f70d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.285+0000 7f70eb7fe700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f70d406caa0 0x7f70d406ef60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f70dc0047c0 tx=0x7f70dc009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:24.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.289+0000 7f70e8ff9700 1 -- 172.21.15.26:0/2350403752 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f70e0059d40 con 0x7f70ec0f8ab0 2024-05-09T00:16:24.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.508+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70ec059120 con 0x7f70d406caa0 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.510+0000 7f70e8ff9700 1 -- 172.21.15.26:0/2350403752 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f70ec059120 con 0x7f70d406caa0 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985", 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": true, 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [ 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stdout: "mds", 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2024-05-09T00:16:24.509 INFO:teuthology.orchestra.run.smithi026.stdout: "mon", 2024-05-09T00:16:24.510 INFO:teuthology.orchestra.run.smithi026.stdout: "osd", 2024-05-09T00:16:24.510 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr" 2024-05-09T00:16:24.510 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2024-05-09T00:16:24.510 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": "16/21 daemons upgraded", 2024-05-09T00:16:24.510 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "Currently upgrading alertmanager daemons", 2024-05-09T00:16:24.510 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:16:24.510 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:16:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f70d406caa0 msgr2=0x7f70d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f70d406caa0 0x7f70d406ef60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f70dc0047c0 tx=0x7f70dc009cb0).stop 2024-05-09T00:16:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f8ab0 msgr2=0x7f70ec06b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f8ab0 0x7f70ec06b030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f70e000e8f0 tx=0x7f70e000b040).stop 2024-05-09T00:16:24.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 shutdown_connections 2024-05-09T00:16:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f70d406caa0 0x7f70d406ef60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec0f7810 0x7f70ec06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 --2- 172.21.15.26:0/2350403752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ec0f8ab0 0x7f70ec06b030 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 >> 172.21.15.26:0/2350403752 conn(0x7f70ec0f2f50 msgr2=0x7f70ec0fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 shutdown_connections 2024-05-09T00:16:24.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.512+0000 7f70f205c700 1 -- 172.21.15.26:0/2350403752 wait complete. 2024-05-09T00:16:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.615+0000 7f29b3905700 1 -- 172.21.15.26:0/4150964890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f7a10 msgr2=0x7f29ac0f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.615+0000 7f29b3905700 1 --2- 172.21.15.26:0/4150964890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f7a10 0x7f29ac0f7e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f29a80047f0 tx=0x7f29a8009cb0).stop 2024-05-09T00:16:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.615+0000 7f29b3905700 1 -- 172.21.15.26:0/4150964890 shutdown_connections 2024-05-09T00:16:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.615+0000 7f29b3905700 1 --2- 172.21.15.26:0/4150964890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29ac0f8cb0 0x7f29ac0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.615+0000 7f29b3905700 1 --2- 172.21.15.26:0/4150964890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f7a10 0x7f29ac0f7e30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.615+0000 7f29b3905700 1 -- 172.21.15.26:0/4150964890 >> 172.21.15.26:0/4150964890 conn(0x7f29ac0f3150 msgr2=0x7f29ac0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.615+0000 7f29b3905700 1 -- 172.21.15.26:0/4150964890 shutdown_connections 2024-05-09T00:16:24.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.615+0000 7f29b3905700 1 -- 172.21.15.26:0/4150964890 wait complete. 2024-05-09T00:16:24.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b3905700 1 Processor -- start 2024-05-09T00:16:24.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b3905700 1 -- start start 2024-05-09T00:16:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b3905700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29ac0f7a10 0x7f29ac1082e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b3905700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f8cb0 0x7f29ac1087d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b3905700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac108d80 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b3905700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac108ec0 con 0x7f29ac0f7a10 2024-05-09T00:16:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b0ea0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f8cb0 0x7f29ac1087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b0ea0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f8cb0 0x7f29ac1087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60258/0 (socket says 172.21.15.26:60258) 2024-05-09T00:16:24.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b0ea0700 1 -- 172.21.15.26:0/3853961841 learned_addr learned my addr 172.21.15.26:0/3853961841 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b16a1700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29ac0f7a10 0x7f29ac1082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b0ea0700 1 -- 172.21.15.26:0/3853961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29ac0f7a10 msgr2=0x7f29ac1082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.616+0000 7f29b0ea0700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29ac0f7a10 0x7f29ac1082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.617+0000 7f29b0ea0700 1 -- 172.21.15.26:0/3853961841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a8005040 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.617+0000 7f29b0ea0700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f8cb0 0x7f29ac1087d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f299c00e910 tx=0x7f299c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.617+0000 7f29a27fc700 1 -- 172.21.15.26:0/3853961841 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299c007b40 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.617+0000 7f29a27fc700 1 -- 172.21.15.26:0/3853961841 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f299c00f040 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.617+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac10d960 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.617+0000 7f29a27fc700 1 -- 172.21.15.26:0/3853961841 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299c014920 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.617+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac10df20 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.618+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac05fb50 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.618+0000 7f29a27fc700 1 -- 172.21.15.26:0/3853961841 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f299c007ca0 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.619+0000 7f29a27fc700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f299806caa0 0x7f299806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:24.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.619+0000 7f29a27fc700 1 -- 172.21.15.26:0/3853961841 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f299c08b7f0 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.619+0000 7f29b16a1700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f299806caa0 0x7f299806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:24.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.619+0000 7f29b16a1700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f299806caa0 0x7f299806ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f29a80047c0 tx=0x7f29a8009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:24.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.623+0000 7f29a27fc700 1 -- 172.21.15.26:0/3853961841 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f299c059240 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:24 smithi026 ceph-mon[93667]: pgmap v233: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:24.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:24 smithi026 ceph-mon[93667]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:24.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:24 smithi026 ceph-mon[93667]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:24.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:24 smithi026 ceph-mon[93667]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:24.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:24 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1497713857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:24.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:24 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2033123384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:16:24.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:24 smithi135 ceph-mon[80466]: pgmap v233: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:24.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:24 smithi135 ceph-mon[80466]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:24.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:24 smithi135 ceph-mon[80466]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:24.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:24 smithi135 ceph-mon[80466]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:24.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:24 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1497713857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:24.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:24 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2033123384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:16:24.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.948+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f29ac10daf0 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.948+0000 7f29a27fc700 1 -- 172.21.15.26:0/3853961841 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f29ac10daf0 con 0x7f29ac0f8cb0 2024-05-09T00:16:24.948 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:16:24.948 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:16:24.948 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.950+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f299806caa0 msgr2=0x7f299806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.950+0000 7f29b3905700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f299806caa0 0x7f299806ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f29a80047c0 tx=0x7f29a8009cb0).stop 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.950+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f8cb0 msgr2=0x7f29ac1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.950+0000 7f29b3905700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f8cb0 0x7f29ac1087d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f299c00e910 tx=0x7f299c00b040).stop 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.950+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 shutdown_connections 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.950+0000 7f29b3905700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f299806caa0 0x7f299806ef60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.950+0000 7f29b3905700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29ac0f7a10 0x7f29ac1082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.951+0000 7f29b3905700 1 --2- 172.21.15.26:0/3853961841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ac0f8cb0 0x7f29ac1087d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:24.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.951+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 >> 172.21.15.26:0/3853961841 conn(0x7f29ac0f3150 msgr2=0x7f29ac0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:24.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.951+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 shutdown_connections 2024-05-09T00:16:24.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:24.951+0000 7f29b3905700 1 -- 172.21.15.26:0/3853961841 wait complete. 2024-05-09T00:16:26.335 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:25 smithi026 ceph-mon[93667]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:26.336 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:25 smithi026 ceph-mon[93667]: pgmap v234: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:26.336 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:26.336 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:25 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3853961841' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:16:26.336 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:26.336 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:26.336 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:25 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:26.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:25 smithi135 ceph-mon[80466]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:26.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:25 smithi135 ceph-mon[80466]: pgmap v234: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:26.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:26.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:25 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3853961841' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:16:26.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:26.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:26.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:25 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:28.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:27 smithi026 ceph-mon[93667]: pgmap v235: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:28.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:27 smithi135 ceph-mon[80466]: pgmap v235: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: pgmap v236: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.367 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.368 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:29 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: pgmap v236: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:30.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:30.402 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:29 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:31.018 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:30 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:16:31.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:30 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T00:16:32.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:31 smithi026 ceph-mon[93667]: pgmap v237: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:32.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:31 smithi135 ceph-mon[80466]: pgmap v237: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:33.230 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:32 smithi026 ceph-mon[93667]: Upgrade: Updating grafana.smithi026 2024-05-09T00:16:33.230 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:32 smithi026 ceph-mon[93667]: Deploying daemon grafana.smithi026 on smithi026 2024-05-09T00:16:33.400 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:32 smithi135 ceph-mon[80466]: Upgrade: Updating grafana.smithi026 2024-05-09T00:16:33.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:32 smithi135 ceph-mon[80466]: Deploying daemon grafana.smithi026 on smithi026 2024-05-09T00:16:34.314 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:34 smithi026 ceph-mon[93667]: pgmap v238: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:34.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:34 smithi135 ceph-mon[80466]: pgmap v238: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:36.458 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:36 smithi026 ceph-mon[93667]: pgmap v239: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:36.458 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:16:36.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:36 smithi135 ceph-mon[80466]: pgmap v239: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:36.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:16:37.797 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:37 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:37.797 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:37 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:37.797 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:37 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:37.797 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:37 smithi026 ceph-mon[93667]: pgmap v240: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:37.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:37 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:37.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:37 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:37.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:37 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:37.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:37 smithi135 ceph-mon[80466]: pgmap v240: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:40.148 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:39 smithi026 ceph-mon[93667]: pgmap v241: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:40.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:39 smithi135 ceph-mon[80466]: pgmap v241: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:41.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:41.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:41.644 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:41.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:41 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:41.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:41.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:41.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:41.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:41 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:42.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:42 smithi026 ceph-mon[93667]: pgmap v242: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:42.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:42 smithi135 ceph-mon[80466]: pgmap v242: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:44.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:44 smithi026 ceph-mon[93667]: pgmap v243: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:44.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:44 smithi135 ceph-mon[80466]: pgmap v243: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: pgmap v244: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.650 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: Upgrade: Finalizing container_image settings 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T00:16:46.651 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T00:16:46.652 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-05-09T00:16:46.653 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: Upgrade: Complete! 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.654 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.656 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: pgmap v244: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:46.656 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.656 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.656 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:46.656 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:46.656 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:16:46.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T00:16:46.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:46.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.658 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.658 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.658 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.658 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.658 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.658 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.658 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.659 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.659 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.659 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.659 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.659 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.659 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.660 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:16:46.660 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: Upgrade: Finalizing container_image settings 2024-05-09T00:16:46.660 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.660 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T00:16:46.660 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T00:16:46.660 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.660 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T00:16:46.661 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T00:16:46.661 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-09T00:16:46.661 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T00:16:46.661 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-05-09T00:16:46.661 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T00:16:46.661 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-09T00:16:46.661 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T00:16:46.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T00:16:46.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T00:16:46.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T00:16:46.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T00:16:46.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T00:16:46.663 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T00:16:46.663 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T00:16:46.663 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T00:16:46.663 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T00:16:46.663 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T00:16:46.663 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T00:16:46.664 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.664 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.664 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.664 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.664 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.664 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: Upgrade: Complete! 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:16:46.665 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:16:46.666 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:16:46.666 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:46.666 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:16:48.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:48 smithi026 ceph-mon[93667]: pgmap v245: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:48.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:48 smithi135 ceph-mon[80466]: pgmap v245: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:50.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:50 smithi026 ceph-mon[93667]: pgmap v246: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:50.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:50 smithi135 ceph-mon[80466]: pgmap v246: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:51.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:16:51.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:16:52.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:52 smithi026 ceph-mon[93667]: pgmap v247: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:52.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:52 smithi135 ceph-mon[80466]: pgmap v247: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:54 smithi026 ceph-mon[93667]: pgmap v248: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:54.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:54 smithi135 ceph-mon[80466]: pgmap v248: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:55.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.070+0000 7fcefd3fe700 1 -- 172.21.15.26:0/1714069320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 msgr2=0x7fcef80f8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.070+0000 7fcefd3fe700 1 --2- 172.21.15.26:0/1714069320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 0x7fcef80f8bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fceec0047f0 tx=0x7fceec009cb0).stop 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.070+0000 7fcefd3fe700 1 -- 172.21.15.26:0/1714069320 shutdown_connections 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.070+0000 7fcefd3fe700 1 --2- 172.21.15.26:0/1714069320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 0x7fcef80f8bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.070+0000 7fcefd3fe700 1 --2- 172.21.15.26:0/1714069320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcef80f5ad0 0x7fcef80f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.070+0000 7fcefd3fe700 1 -- 172.21.15.26:0/1714069320 >> 172.21.15.26:0/1714069320 conn(0x7fcef80f1610 msgr2=0x7fcef80f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.070+0000 7fcefd3fe700 1 -- 172.21.15.26:0/1714069320 shutdown_connections 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.070+0000 7fcefd3fe700 1 -- 172.21.15.26:0/1714069320 wait complete. 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcefd3fe700 1 Processor -- start 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcefd3fe700 1 -- start start 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcefd3fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcef80f5ad0 0x7fcef8108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcefd3fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 0x7fcef8108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcefd3fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8108b20 con 0x7fcef80f6470 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcefd3fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8108c60 con 0x7fcef80f5ad0 2024-05-09T00:16:55.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcef67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 0x7fcef8108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcef67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 0x7fcef8108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45452/0 (socket says 172.21.15.26:45452) 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcef67fc700 1 -- 172.21.15.26:0/3203107094 learned_addr learned my addr 172.21.15.26:0/3203107094 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcef6ffd700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcef80f5ad0 0x7fcef8108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcef67fc700 1 -- 172.21.15.26:0/3203107094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcef80f5ad0 msgr2=0x7fcef8108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.071+0000 7fcef67fc700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcef80f5ad0 0x7fcef8108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.072+0000 7fcef67fc700 1 -- 172.21.15.26:0/3203107094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec005040 con 0x7fcef80f6470 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.072+0000 7fcef67fc700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 0x7fcef8108570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fceec000c00 tx=0x7fceec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.072+0000 7fcedffff700 1 -- 172.21.15.26:0/3203107094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceec018070 con 0x7fcef80f6470 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.072+0000 7fcedffff700 1 -- 172.21.15.26:0/3203107094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fceec007e90 con 0x7fcef80f6470 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.072+0000 7fcedffff700 1 -- 172.21.15.26:0/3203107094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceec012620 con 0x7fcef80f6470 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.072+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef810d6a0 con 0x7fcef80f6470 2024-05-09T00:16:55.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.072+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef810dc60 con 0x7fcef80f6470 2024-05-09T00:16:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.073+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef80ffff0 con 0x7fcef80f6470 2024-05-09T00:16:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.073+0000 7fcedffff700 1 -- 172.21.15.26:0/3203107094 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fceec01d960 con 0x7fcef80f6470 2024-05-09T00:16:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.074+0000 7fcedffff700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcee006cab0 0x7fcee006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.074+0000 7fcef6ffd700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcee006cab0 0x7fcee006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.074+0000 7fcedffff700 1 -- 172.21.15.26:0/3203107094 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fceec08cb60 con 0x7fcef80f6470 2024-05-09T00:16:55.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.075+0000 7fcef6ffd700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcee006cab0 0x7fcee006ef70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fcef8060880 tx=0x7fcee800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:55.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.079+0000 7fcedffff700 1 -- 172.21.15.26:0/3203107094 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fceec05a660 con 0x7fcef80f6470 2024-05-09T00:16:55.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.297+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcef8059120 con 0x7fcee006cab0 2024-05-09T00:16:55.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.298+0000 7fcedffff700 1 -- 172.21.15.26:0/3203107094 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fcef8059120 con 0x7fcee006cab0 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcee006cab0 msgr2=0x7fcee006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcee006cab0 0x7fcee006ef70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fcef8060880 tx=0x7fcee800b040).stop 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 msgr2=0x7fcef8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 0x7fcef8108570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fceec000c00 tx=0x7fceec009cb0).stop 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 shutdown_connections 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fcee006cab0 0x7fcee006ef70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcef80f5ad0 0x7fcef8108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 --2- 172.21.15.26:0/3203107094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcef80f6470 0x7fcef8108570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.300+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 >> 172.21.15.26:0/3203107094 conn(0x7fcef80f1610 msgr2=0x7fcef80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:55.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.301+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 shutdown_connections 2024-05-09T00:16:55.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:55.301+0000 7fcefd3fe700 1 -- 172.21.15.26:0/3203107094 wait complete. 2024-05-09T00:16:56.077 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph orch ps' 2024-05-09T00:16:56.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:56 smithi026 ceph-mon[93667]: pgmap v249: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:56.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:56 smithi026 ceph-mon[93667]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:56.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:56 smithi135 ceph-mon[80466]: pgmap v249: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:56.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:56 smithi135 ceph-mon[80466]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:58.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.075+0000 7eff6312e700 1 -- 172.21.15.26:0/3169340270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 msgr2=0x7eff5c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:58.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.075+0000 7eff6312e700 1 --2- 172.21.15.26:0/3169340270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 0x7eff5c101910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7eff480047f0 tx=0x7eff48009cb0).stop 2024-05-09T00:16:58.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.075+0000 7eff6312e700 1 -- 172.21.15.26:0/3169340270 shutdown_connections 2024-05-09T00:16:58.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.075+0000 7eff6312e700 1 --2- 172.21.15.26:0/3169340270 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 0x7eff5c101910 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.075+0000 7eff6312e700 1 --2- 172.21.15.26:0/3169340270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff5c0f88a0 0x7eff5c0f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.075+0000 7eff6312e700 1 -- 172.21.15.26:0/3169340270 >> 172.21.15.26:0/3169340270 conn(0x7eff5c070590 msgr2=0x7eff5c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.075+0000 7eff6312e700 1 -- 172.21.15.26:0/3169340270 shutdown_connections 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.075+0000 7eff6312e700 1 -- 172.21.15.26:0/3169340270 wait complete. 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff6312e700 1 Processor -- start 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff6312e700 1 -- start start 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff6312e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff5c0f88a0 0x7eff5c0f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff6312e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 0x7eff5c0f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff6312e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0f7230 con 0x7eff5c0f9200 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff6312e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0f7370 con 0x7eff5c0f88a0 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 0x7eff5c0f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 0x7eff5c0f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45476/0 (socket says 172.21.15.26:45476) 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff5bfff700 1 -- 172.21.15.26:0/1223649820 learned_addr learned my addr 172.21.15.26:0/1223649820 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.076+0000 7eff60eca700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff5c0f88a0 0x7eff5c0f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:58.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff5bfff700 1 -- 172.21.15.26:0/1223649820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff5c0f88a0 msgr2=0x7eff5c0f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:58.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff5bfff700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff5c0f88a0 0x7eff5c0f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:58.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff5bfff700 1 -- 172.21.15.26:0/1223649820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48005040 con 0x7eff5c0f9200 2024-05-09T00:16:58.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff5bfff700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 0x7eff5c0f6d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7eff4800b120 tx=0x7eff48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:58.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff59ffb700 1 -- 172.21.15.26:0/1223649820 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff4800e030 con 0x7eff5c0f9200 2024-05-09T00:16:58.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff59ffb700 1 -- 172.21.15.26:0/1223649820 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff48007e90 con 0x7eff5c0f9200 2024-05-09T00:16:58.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c0f75c0 con 0x7eff5c0f9200 2024-05-09T00:16:58.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff59ffb700 1 -- 172.21.15.26:0/1223649820 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff48018070 con 0x7eff5c0f9200 2024-05-09T00:16:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.077+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c1146a0 con 0x7eff5c0f9200 2024-05-09T00:16:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.078+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c05f590 con 0x7eff5c0f9200 2024-05-09T00:16:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.079+0000 7eff59ffb700 1 -- 172.21.15.26:0/1223649820 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7eff4801d420 con 0x7eff5c0f9200 2024-05-09T00:16:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.079+0000 7eff59ffb700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7eff4c06caa0 0x7eff4c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:16:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.079+0000 7eff59ffb700 1 -- 172.21.15.26:0/1223649820 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7eff4808d2a0 con 0x7eff5c0f9200 2024-05-09T00:16:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.079+0000 7eff60eca700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7eff4c06caa0 0x7eff4c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:16:58.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.080+0000 7eff60eca700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7eff4c06caa0 0x7eff4c06ef60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7eff500041d0 tx=0x7eff50009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:16:58.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.083+0000 7eff59ffb700 1 -- 172.21.15.26:0/1223649820 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7eff48057260 con 0x7eff5c0f9200 2024-05-09T00:16:58.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.291+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7eff5c0f81d0 con 0x7eff4c06caa0 2024-05-09T00:16:58.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.301+0000 7eff59ffb700 1 -- 172.21.15.26:0/1223649820 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7eff5c0f81d0 con 0x7eff4c06caa0 2024-05-09T00:16:58.299 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:16:58.299 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (37s) 17s ago 17m 16.4M - 0.25.0 c8568f914cd2 4fcde5f5dfbd 2024-05-09T00:16:58.299 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (6m) 17s ago 17m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:16:58.299 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (6m) 48s ago 17m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:16:58.299 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (22s) 17s ago 17m 40.3M - 9.4.7 954c08fa6188 a919b7671b5a 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (2m) 17s ago 12m 14.5M - 18.2.2-1322-gd21e4f96 af23193ff691 d186720df096 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (2m) 17s ago 12m 81.8M - 18.2.2-1322-gd21e4f96 af23193ff691 4083eb8ff427 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (89s) 48s ago 12m 11.8M - 18.2.2-1322-gd21e4f96 af23193ff691 8f7df1307719 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (109s) 48s ago 12m 15.1M - 18.2.2-1322-gd21e4f96 af23193ff691 20dc7cc555ea 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (8m) 17s ago 18m 511M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (7m) 48s ago 16m 453M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (7m) 17s ago 19m 63.7M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (6m) 48s ago 16m 43.7M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (76s) 17s ago 17m 12.3M - 1.5.0 0da6a335fe13 b8ba8105dfb9 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (69s) 48s ago 16m 8434k - 1.5.0 0da6a335fe13 8668fc4ddeef 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 17s ago 16m 111M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (5m) 17s ago 15m 118M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (4m) 17s ago 15m 105M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (4m) 48s ago 14m 122M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:16:58.300 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (3m) 48s ago 14m 103M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 a23ab54b2270 2024-05-09T00:16:58.301 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (3m) 48s ago 13m 100M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 df906a6613b1 2024-05-09T00:16:58.301 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (52s) 48s ago 16m 42.0M - 2.43.0 a07b618ecd1d a2baf25b6557 2024-05-09T00:16:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7eff4c06caa0 msgr2=0x7eff4c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7eff4c06caa0 0x7eff4c06ef60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7eff500041d0 tx=0x7eff50009040).stop 2024-05-09T00:16:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 msgr2=0x7eff5c0f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:16:58.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 0x7eff5c0f6d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7eff4800b120 tx=0x7eff48009cb0).stop 2024-05-09T00:16:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 shutdown_connections 2024-05-09T00:16:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7eff4c06caa0 0x7eff4c06ef60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff5c0f88a0 0x7eff5c0f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 --2- 172.21.15.26:0/1223649820 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff5c0f9200 0x7eff5c0f6d40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:16:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 >> 172.21.15.26:0/1223649820 conn(0x7eff5c070590 msgr2=0x7eff5c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:16:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 shutdown_connections 2024-05-09T00:16:58.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:16:58.303+0000 7eff6312e700 1 -- 172.21.15.26:0/1223649820 wait complete. 2024-05-09T00:16:58.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:58 smithi026 ceph-mon[93667]: pgmap v250: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:58.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:58 smithi135 ceph-mon[80466]: pgmap v250: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:16:59.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph orch upgrade status' 2024-05-09T00:16:59.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:16:59 smithi026 ceph-mon[93667]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:16:59.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:16:59 smithi135 ceph-mon[80466]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:17:00.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:00 smithi026 ceph-mon[93667]: pgmap v251: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:00.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:00 smithi135 ceph-mon[80466]: pgmap v251: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:01.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.203+0000 7f8cd063b700 1 -- 172.21.15.26:0/2994582436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fda50 msgr2=0x7f8cc80fde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.203+0000 7f8cd063b700 1 --2- 172.21.15.26:0/2994582436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fda50 0x7f8cc80fde30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8cc40047f0 tx=0x7f8cc4009cb0).stop 2024-05-09T00:17:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.203+0000 7f8cd063b700 1 -- 172.21.15.26:0/2994582436 shutdown_connections 2024-05-09T00:17:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.203+0000 7f8cd063b700 1 --2- 172.21.15.26:0/2994582436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc80fe3b0 0x7f8cc80f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.203+0000 7f8cd063b700 1 --2- 172.21.15.26:0/2994582436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fda50 0x7f8cc80fde30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.203+0000 7f8cd063b700 1 -- 172.21.15.26:0/2994582436 >> 172.21.15.26:0/2994582436 conn(0x7f8cc806ce50 msgr2=0x7f8cc806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:01.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.203+0000 7f8cd063b700 1 -- 172.21.15.26:0/2994582436 shutdown_connections 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.203+0000 7f8cd063b700 1 -- 172.21.15.26:0/2994582436 wait complete. 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8cd063b700 1 Processor -- start 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8cd063b700 1 -- start start 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8cd063b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc80fda50 0x7f8cc8110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8cd063b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fe3b0 0x7f8cc8110750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8cd063b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc8110d50 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8cd063b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc8110e90 con 0x7f8cc80fda50 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8ccdbd6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fe3b0 0x7f8cc8110750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8ccdbd6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fe3b0 0x7f8cc8110750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:45490/0 (socket says 172.21.15.26:45490) 2024-05-09T00:17:01.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8ccdbd6700 1 -- 172.21.15.26:0/3897452956 learned_addr learned my addr 172.21.15.26:0/3897452956 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8cce3d7700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc80fda50 0x7f8cc8110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8ccdbd6700 1 -- 172.21.15.26:0/3897452956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc80fda50 msgr2=0x7f8cc8110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8ccdbd6700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc80fda50 0x7f8cc8110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8ccdbd6700 1 -- 172.21.15.26:0/3897452956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4005040 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8ccdbd6700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fe3b0 0x7f8cc8110750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8cb80041d0 tx=0x7f8cb8009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.204+0000 7f8cbf7fe700 1 -- 172.21.15.26:0/3897452956 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb8002d90 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.205+0000 7f8cbf7fe700 1 -- 172.21.15.26:0/3897452956 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8cb800f040 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.205+0000 7f8cbf7fe700 1 -- 172.21.15.26:0/3897452956 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb800d800 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.205+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc810a520 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.205+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc810aa60 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.206+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc8047540 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.206+0000 7f8cbf7fe700 1 -- 172.21.15.26:0/3897452956 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8cb800da70 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.207+0000 7f8cbf7fe700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8cb406caa0 0x7f8cb406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:01.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.207+0000 7f8cbf7fe700 1 -- 172.21.15.26:0/3897452956 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f8cb808be30 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.207+0000 7f8cce3d7700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8cb406caa0 0x7f8cb406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:01.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.207+0000 7f8cce3d7700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8cb406caa0 0x7f8cb406ef60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f8cc4004f10 tx=0x7f8cc400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:01.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.211+0000 7f8cbf7fe700 1 -- 172.21.15.26:0/3897452956 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f8cb8059880 con 0x7f8cc80fe3b0 2024-05-09T00:17:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.431+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cc810ad30 con 0x7f8cb406caa0 2024-05-09T00:17:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.432+0000 7f8cbf7fe700 1 -- 172.21.15.26:0/3897452956 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8cc810ad30 con 0x7f8cb406caa0 2024-05-09T00:17:01.430 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:17:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "target_image": null, 2024-05-09T00:17:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "in_progress": false, 2024-05-09T00:17:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "which": "", 2024-05-09T00:17:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "services_complete": [], 2024-05-09T00:17:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "progress": null, 2024-05-09T00:17:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "message": "", 2024-05-09T00:17:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "is_paused": false 2024-05-09T00:17:01.431 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8cb406caa0 msgr2=0x7f8cb406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8cb406caa0 0x7f8cb406ef60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f8cc4004f10 tx=0x7f8cc400b040).stop 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fe3b0 msgr2=0x7f8cc8110750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fe3b0 0x7f8cc8110750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8cb80041d0 tx=0x7f8cb8009f60).stop 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 shutdown_connections 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8cb406caa0 0x7f8cb406ef60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc80fda50 0x7f8cc8110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 --2- 172.21.15.26:0/3897452956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc80fe3b0 0x7f8cc8110750 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:01.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 >> 172.21.15.26:0/3897452956 conn(0x7f8cc806ce50 msgr2=0x7f8cc80f78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:01.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 shutdown_connections 2024-05-09T00:17:01.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:01.434+0000 7f8cd063b700 1 -- 172.21.15.26:0/3897452956 wait complete. 2024-05-09T00:17:02.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph health detail' 2024-05-09T00:17:02.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:02 smithi026 ceph-mon[93667]: pgmap v252: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:02.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:02 smithi026 ceph-mon[93667]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:17:02.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:02 smithi135 ceph-mon[80466]: pgmap v252: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:02.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:02 smithi135 ceph-mon[80466]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:17:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.216+0000 7f2ff61de700 1 -- 172.21.15.26:0/1301045107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 msgr2=0x7f2ff0101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.216+0000 7f2ff61de700 1 --2- 172.21.15.26:0/1301045107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 0x7f2ff0101910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f2fd80047f0 tx=0x7f2fd8009cb0).stop 2024-05-09T00:17:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.216+0000 7f2ff61de700 1 -- 172.21.15.26:0/1301045107 shutdown_connections 2024-05-09T00:17:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.216+0000 7f2ff61de700 1 --2- 172.21.15.26:0/1301045107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 0x7f2ff0101910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.216+0000 7f2ff61de700 1 --2- 172.21.15.26:0/1301045107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ff00f88a0 0x7f2ff00f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.216+0000 7f2ff61de700 1 -- 172.21.15.26:0/1301045107 >> 172.21.15.26:0/1301045107 conn(0x7f2ff0070590 msgr2=0x7f2ff00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.216+0000 7f2ff61de700 1 -- 172.21.15.26:0/1301045107 shutdown_connections 2024-05-09T00:17:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.216+0000 7f2ff61de700 1 -- 172.21.15.26:0/1301045107 wait complete. 2024-05-09T00:17:04.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2ff61de700 1 Processor -- start 2024-05-09T00:17:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2ff61de700 1 -- start start 2024-05-09T00:17:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2ff61de700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ff00f88a0 0x7f2ff010e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2ff61de700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 0x7f2ff010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2ff61de700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff010eb80 con 0x7f2ff00f9200 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2ff61de700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff010ecc0 con 0x7f2ff00f88a0 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2feeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 0x7f2ff010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2feeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 0x7f2ff010e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42670/0 (socket says 172.21.15.26:42670) 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2feeffd700 1 -- 172.21.15.26:0/3202387567 learned_addr learned my addr 172.21.15.26:0/3202387567 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2fef7fe700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ff00f88a0 0x7f2ff010e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2feeffd700 1 -- 172.21.15.26:0/3202387567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ff00f88a0 msgr2=0x7f2ff010e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.217+0000 7f2feeffd700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ff00f88a0 0x7f2ff010e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.218+0000 7f2feeffd700 1 -- 172.21.15.26:0/3202387567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8005040 con 0x7f2ff00f9200 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.218+0000 7f2feeffd700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 0x7f2ff010e580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f2fd8005010 tx=0x7f2fd8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.218+0000 7f2fecff9700 1 -- 172.21.15.26:0/3202387567 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd800e030 con 0x7f2ff00f9200 2024-05-09T00:17:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.218+0000 7f2fecff9700 1 -- 172.21.15.26:0/3202387567 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2fd8007e90 con 0x7f2ff00f9200 2024-05-09T00:17:04.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.218+0000 7f2fecff9700 1 -- 172.21.15.26:0/3202387567 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd8018070 con 0x7f2ff00f9200 2024-05-09T00:17:04.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.218+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff01082f0 con 0x7f2ff00f9200 2024-05-09T00:17:04.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.218+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff01087d0 con 0x7f2ff00f9200 2024-05-09T00:17:04.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.219+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff005f590 con 0x7f2ff00f9200 2024-05-09T00:17:04.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.220+0000 7f2fecff9700 1 -- 172.21.15.26:0/3202387567 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2fd801d6e0 con 0x7f2ff00f9200 2024-05-09T00:17:04.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.220+0000 7f2fecff9700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2fdc06caa0 0x7f2fdc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:04.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.220+0000 7f2fecff9700 1 -- 172.21.15.26:0/3202387567 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f2fd808d290 con 0x7f2ff00f9200 2024-05-09T00:17:04.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.220+0000 7f2fef7fe700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2fdc06caa0 0x7f2fdc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:04.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.221+0000 7f2fef7fe700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2fdc06caa0 0x7f2fdc06ef60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f2fe0004be0 tx=0x7f2fe000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.224+0000 7f2fecff9700 1 -- 172.21.15.26:0/3202387567 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f2fd805ad60 con 0x7f2ff00f9200 2024-05-09T00:17:04.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.505+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2ff0047540 con 0x7f2ff00f9200 2024-05-09T00:17:04.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.505+0000 7f2fecff9700 1 -- 172.21.15.26:0/3202387567 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2fd805a8f0 con 0x7f2ff00f9200 2024-05-09T00:17:04.504 INFO:teuthology.orchestra.run.smithi026.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T00:17:04.505 INFO:teuthology.orchestra.run.smithi026.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T00:17:04.505 INFO:teuthology.orchestra.run.smithi026.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T00:17:04.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.508+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2fdc06caa0 msgr2=0x7f2fdc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.508+0000 7f2ff61de700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2fdc06caa0 0x7f2fdc06ef60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f2fe0004be0 tx=0x7f2fe000b040).stop 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.508+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 msgr2=0x7f2ff010e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.508+0000 7f2ff61de700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 0x7f2ff010e580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f2fd8005010 tx=0x7f2fd8009cb0).stop 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.509+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 shutdown_connections 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.509+0000 7f2ff61de700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2fdc06caa0 0x7f2fdc06ef60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.509+0000 7f2ff61de700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ff00f88a0 0x7f2ff010e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.509+0000 7f2ff61de700 1 --2- 172.21.15.26:0/3202387567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ff00f9200 0x7f2ff010e580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.509+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 >> 172.21.15.26:0/3202387567 conn(0x7f2ff0070590 msgr2=0x7f2ff00fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.509+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 shutdown_connections 2024-05-09T00:17:04.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:04.509+0000 7f2ff61de700 1 -- 172.21.15.26:0/3202387567 wait complete. 2024-05-09T00:17:04.532 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:04 smithi026 ceph-mon[93667]: pgmap v253: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:04.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:04 smithi135 ceph-mon[80466]: pgmap v253: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:05.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph versions' 2024-05-09T00:17:05.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:05 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3202387567' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:17:05.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:05 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3202387567' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T00:17:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:06 smithi026 ceph-mon[93667]: pgmap v254: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:17:06.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:06 smithi135 ceph-mon[80466]: pgmap v254: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:06.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:17:07.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 -- 172.21.15.26:0/1197924567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 msgr2=0x7feb4c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:07.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 --2- 172.21.15.26:0/1197924567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 0x7feb4c101910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7feb480047f0 tx=0x7feb48009cb0).stop 2024-05-09T00:17:07.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 -- 172.21.15.26:0/1197924567 shutdown_connections 2024-05-09T00:17:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 --2- 172.21.15.26:0/1197924567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 0x7feb4c101910 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 --2- 172.21.15.26:0/1197924567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c0f88a0 0x7feb4c0f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 -- 172.21.15.26:0/1197924567 >> 172.21.15.26:0/1197924567 conn(0x7feb4c070590 msgr2=0x7feb4c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 -- 172.21.15.26:0/1197924567 shutdown_connections 2024-05-09T00:17:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 -- 172.21.15.26:0/1197924567 wait complete. 2024-05-09T00:17:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.224+0000 7feb53a06700 1 Processor -- start 2024-05-09T00:17:07.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb53a06700 1 -- start start 2024-05-09T00:17:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb53a06700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c0f88a0 0x7feb4c10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb53a06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 0x7feb4c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb53a06700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c10eb70 con 0x7feb4c0f9200 2024-05-09T00:17:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb53a06700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c10ecb0 con 0x7feb4c0f88a0 2024-05-09T00:17:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb50fa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 0x7feb4c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb50fa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 0x7feb4c10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42680/0 (socket says 172.21.15.26:42680) 2024-05-09T00:17:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb50fa1700 1 -- 172.21.15.26:0/1937395384 learned_addr learned my addr 172.21.15.26:0/1937395384 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:17:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb517a2700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c0f88a0 0x7feb4c10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb50fa1700 1 -- 172.21.15.26:0/1937395384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c0f88a0 msgr2=0x7feb4c10e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb50fa1700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c0f88a0 0x7feb4c10e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb50fa1700 1 -- 172.21.15.26:0/1937395384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48005040 con 0x7feb4c0f9200 2024-05-09T00:17:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb517a2700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c0f88a0 0x7feb4c10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:17:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb50fa1700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 0x7feb4c10e570 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7feb4800b120 tx=0x7feb48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.225+0000 7feb3e7fc700 1 -- 172.21.15.26:0/1937395384 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb4800e030 con 0x7feb4c0f9200 2024-05-09T00:17:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.226+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c1082e0 con 0x7feb4c0f9200 2024-05-09T00:17:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.226+0000 7feb3e7fc700 1 -- 172.21.15.26:0/1937395384 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb48007e90 con 0x7feb4c0f9200 2024-05-09T00:17:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.226+0000 7feb3e7fc700 1 -- 172.21.15.26:0/1937395384 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb48018070 con 0x7feb4c0f9200 2024-05-09T00:17:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.226+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c1087c0 con 0x7feb4c0f9200 2024-05-09T00:17:07.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.227+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c05f590 con 0x7feb4c0f9200 2024-05-09T00:17:07.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.228+0000 7feb3e7fc700 1 -- 172.21.15.26:0/1937395384 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7feb4801d420 con 0x7feb4c0f9200 2024-05-09T00:17:07.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.228+0000 7feb3e7fc700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb3806caa0 0x7feb3806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:17:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.228+0000 7feb3e7fc700 1 -- 172.21.15.26:0/1937395384 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7feb4808d680 con 0x7feb4c0f9200 2024-05-09T00:17:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.228+0000 7feb517a2700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb3806caa0 0x7feb3806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:17:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.228+0000 7feb517a2700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb3806caa0 0x7feb3806ef60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7feb400041d0 tx=0x7feb40009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:17:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.232+0000 7feb3e7fc700 1 -- 172.21.15.26:0/1937395384 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7feb4805b0d0 con 0x7feb4c0f9200 2024-05-09T00:17:07.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.517+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb4c047540 con 0x7feb4c0f9200 2024-05-09T00:17:07.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.517+0000 7feb3e7fc700 1 -- 172.21.15.26:0/1937395384 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7feb4805ac60 con 0x7feb4c0f9200 2024-05-09T00:17:07.516 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:17:07.516 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:17:07.516 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:17:07.516 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:17:07.516 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:17:07.516 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 6 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 4 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 14 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:17:07.517 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:17:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.519+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb3806caa0 msgr2=0x7feb3806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.519+0000 7feb53a06700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb3806caa0 0x7feb3806ef60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7feb400041d0 tx=0x7feb40009040).stop 2024-05-09T00:17:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.519+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 msgr2=0x7feb4c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:17:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.519+0000 7feb53a06700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 0x7feb4c10e570 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7feb4800b120 tx=0x7feb48009cb0).stop 2024-05-09T00:17:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.519+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 shutdown_connections 2024-05-09T00:17:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.520+0000 7feb53a06700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feb3806caa0 0x7feb3806ef60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:07.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.520+0000 7feb53a06700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb4c0f88a0 0x7feb4c10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:07.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.520+0000 7feb53a06700 1 --2- 172.21.15.26:0/1937395384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb4c0f9200 0x7feb4c10e570 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:17:07.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.520+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 >> 172.21.15.26:0/1937395384 conn(0x7feb4c070590 msgr2=0x7feb4c0fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:17:07.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.520+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 shutdown_connections 2024-05-09T00:17:07.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:17:07.520+0000 7feb53a06700 1 -- 172.21.15.26:0/1937395384 wait complete. 2024-05-09T00:17:08.172 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-05-09T00:17:08.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:08 smithi026 ceph-mon[93667]: pgmap v255: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:08.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:08 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1937395384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:17:08.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:08 smithi135 ceph-mon[80466]: pgmap v255: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:08.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:08 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1937395384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:17:10.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:10 smithi026 ceph-mon[93667]: pgmap v256: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:wait for servicemap items w/ changing names to refresh 2024-05-09T00:17:10.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:10 smithi135 ceph-mon[80466]: pgmap v256: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:11.171 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'sleep 60' 2024-05-09T00:17:12.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:12 smithi026 ceph-mon[93667]: pgmap v257: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:12.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:12 smithi135 ceph-mon[80466]: pgmap v257: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:14.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:14 smithi026 ceph-mon[93667]: pgmap v258: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:14.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:14 smithi135 ceph-mon[80466]: pgmap v258: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:16.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:16 smithi026 ceph-mon[93667]: pgmap v259: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:16.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:16 smithi135 ceph-mon[80466]: pgmap v259: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:18.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:18 smithi026 ceph-mon[93667]: pgmap v260: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:18.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:18 smithi135 ceph-mon[80466]: pgmap v260: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:20.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:20 smithi026 ceph-mon[93667]: pgmap v261: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:20.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:20 smithi135 ceph-mon[80466]: pgmap v261: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:21.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:17:21.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:17:22.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:22 smithi026 ceph-mon[93667]: pgmap v262: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:22.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:22 smithi135 ceph-mon[80466]: pgmap v262: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:24.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:24 smithi026 ceph-mon[93667]: pgmap v263: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:24.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:24 smithi135 ceph-mon[80466]: pgmap v263: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:26.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:26 smithi026 ceph-mon[93667]: pgmap v264: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:26.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:26 smithi135 ceph-mon[80466]: pgmap v264: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:28.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:28 smithi026 ceph-mon[93667]: pgmap v265: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:28.650 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:28 smithi135 ceph-mon[80466]: pgmap v265: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:30.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:30 smithi026 ceph-mon[93667]: pgmap v266: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:30.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:30 smithi135 ceph-mon[80466]: pgmap v266: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:32.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:32 smithi026 ceph-mon[93667]: pgmap v267: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:32.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:32 smithi135 ceph-mon[80466]: pgmap v267: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:34.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:34 smithi026 ceph-mon[93667]: pgmap v268: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:34.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:34 smithi135 ceph-mon[80466]: pgmap v268: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:36.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:36 smithi026 ceph-mon[93667]: pgmap v269: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:36.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:17:36.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:36 smithi135 ceph-mon[80466]: pgmap v269: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:36.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:17:38.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:38 smithi026 ceph-mon[93667]: pgmap v270: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:38.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:38 smithi135 ceph-mon[80466]: pgmap v270: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:40.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:40 smithi026 ceph-mon[93667]: pgmap v271: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:40.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:40 smithi135 ceph-mon[80466]: pgmap v271: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:42.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:42 smithi026 ceph-mon[93667]: pgmap v272: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:42.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:42 smithi135 ceph-mon[80466]: pgmap v272: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:44.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:44 smithi026 ceph-mon[93667]: pgmap v273: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:44.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:44 smithi135 ceph-mon[80466]: pgmap v273: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:46.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:46 smithi026 ceph-mon[93667]: pgmap v274: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:46.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:17:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:17:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:17:46.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:46 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:17:46.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:46 smithi135 ceph-mon[80466]: pgmap v274: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:46.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:17:46.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:17:46.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:17:46.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:46 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' 2024-05-09T00:17:48.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:48 smithi026 ceph-mon[93667]: pgmap v275: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:48.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:48 smithi135 ceph-mon[80466]: pgmap v275: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:50.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:50 smithi026 ceph-mon[93667]: pgmap v276: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:50.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:50 smithi135 ceph-mon[80466]: pgmap v276: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:51.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:51 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:17:51.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:51 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:17:52.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:52 smithi026 ceph-mon[93667]: pgmap v277: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:52.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:52 smithi135 ceph-mon[80466]: pgmap v277: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:54.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:54 smithi026 ceph-mon[93667]: pgmap v278: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:54.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:54 smithi135 ceph-mon[80466]: pgmap v278: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:56.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:56 smithi026 ceph-mon[93667]: pgmap v279: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:56.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:56 smithi135 ceph-mon[80466]: pgmap v279: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:58.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:17:58 smithi026 ceph-mon[93667]: pgmap v280: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:17:58.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:17:58 smithi135 ceph-mon[80466]: pgmap v280: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:00.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:00 smithi026 ceph-mon[93667]: pgmap v281: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:00.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:00 smithi135 ceph-mon[80466]: pgmap v281: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:02.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:02 smithi026 ceph-mon[93667]: pgmap v282: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:02.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:02 smithi135 ceph-mon[80466]: pgmap v282: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:04.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:04 smithi026 ceph-mon[93667]: pgmap v283: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:04.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:04 smithi135 ceph-mon[80466]: pgmap v283: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:06 smithi026 ceph-mon[93667]: pgmap v284: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:06.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:06 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:18:06.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:06 smithi135 ceph-mon[80466]: pgmap v284: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:06.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:06 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:18:08.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:08 smithi026 ceph-mon[93667]: pgmap v285: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:08.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:08 smithi135 ceph-mon[80466]: pgmap v285: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:10.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:10 smithi026 ceph-mon[93667]: pgmap v286: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:10.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:10 smithi135 ceph-mon[80466]: pgmap v286: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:12.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:12 smithi026 ceph-mon[93667]: pgmap v287: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:12.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:12 smithi135 ceph-mon[80466]: pgmap v287: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:14.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph orch ps' 2024-05-09T00:18:14.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:14 smithi026 ceph-mon[93667]: pgmap v288: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:14.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:14 smithi135 ceph-mon[80466]: pgmap v288: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.438+0000 7f0338b11700 1 -- 172.21.15.26:0/4137030872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fe270 msgr2=0x7f03340f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.438+0000 7f0338b11700 1 --2- 172.21.15.26:0/4137030872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fe270 0x7f03340f7a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f03280047f0 tx=0x7f0328009cb0).stop 2024-05-09T00:18:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.438+0000 7f0338b11700 1 -- 172.21.15.26:0/4137030872 shutdown_connections 2024-05-09T00:18:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.438+0000 7f0338b11700 1 --2- 172.21.15.26:0/4137030872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fe270 0x7f03340f7a50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.438+0000 7f0338b11700 1 --2- 172.21.15.26:0/4137030872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03340fd910 0x7f03340fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:16.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.438+0000 7f0338b11700 1 -- 172.21.15.26:0/4137030872 >> 172.21.15.26:0/4137030872 conn(0x7f03340f3510 msgr2=0x7f03340f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.438+0000 7f0338b11700 1 -- 172.21.15.26:0/4137030872 shutdown_connections 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.438+0000 7f0338b11700 1 -- 172.21.15.26:0/4137030872 wait complete. 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f0338b11700 1 Processor -- start 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f0338b11700 1 -- start start 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f0338b11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fd910 0x7f033406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f0338b11700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03340fe270 0x7f033406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f0338b11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033406bab0 con 0x7f03340fd910 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f0338b11700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033406bbf0 con 0x7f03340fe270 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f033259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fd910 0x7f033406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f033259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fd910 0x7f033406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37746/0 (socket says 172.21.15.26:37746) 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f033259c700 1 -- 172.21.15.26:0/1506552777 learned_addr learned my addr 172.21.15.26:0/1506552777 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f0331d9b700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03340fe270 0x7f033406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f033259c700 1 -- 172.21.15.26:0/1506552777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03340fe270 msgr2=0x7f033406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:16.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f033259c700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03340fe270 0x7f033406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.439+0000 7f033259c700 1 -- 172.21.15.26:0/1506552777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328005040 con 0x7f03340fd910 2024-05-09T00:18:16.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.440+0000 7f033259c700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fd910 0x7f033406b0d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f032400c790 tx=0x7f0324004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.440+0000 7f03237fe700 1 -- 172.21.15.26:0/1506552777 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03240106f0 con 0x7f03340fd910 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.440+0000 7f03237fe700 1 -- 172.21.15.26:0/1506552777 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0324010d00 con 0x7f03340fd910 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.440+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033406bea0 con 0x7f03340fd910 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.440+0000 7f03237fe700 1 -- 172.21.15.26:0/1506552777 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0324012da0 con 0x7f03340fd910 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.440+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03341146b0 con 0x7f03340fd910 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.441+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0334060650 con 0x7f03340fd910 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.441+0000 7f03237fe700 1 -- 172.21.15.26:0/1506552777 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0324012400 con 0x7f03340fd910 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.442+0000 7f03237fe700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f031c06caa0 0x7f031c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.442+0000 7f03237fe700 1 -- 172.21.15.26:0/1506552777 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f032408b7b0 con 0x7f03340fd910 2024-05-09T00:18:16.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.442+0000 7f0331d9b700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f031c06caa0 0x7f031c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:16.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.442+0000 7f0331d9b700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f031c06caa0 0x7f031c06ef60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0328004f10 tx=0x7f032800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:16.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.446+0000 7f03237fe700 1 -- 172.21.15.26:0/1506552777 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f0324055770 con 0x7f03340fd910 2024-05-09T00:18:16.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:16 smithi026 ceph-mon[93667]: pgmap v289: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:16.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:16 smithi135 ceph-mon[80466]: pgmap v289: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:16.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.656+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 --> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0334059120 con 0x7f031c06caa0 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.666+0000 7f03237fe700 1 -- 172.21.15.26:0/1506552777 <== mgr.34102 v2:172.21.15.26:6800/205101372 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0334059120 con 0x7f031c06caa0 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:alertmanager.smithi026 smithi026 *:9093,9094 running (116s) 96s ago 18m 16.4M - 0.25.0 c8568f914cd2 4fcde5f5dfbd 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi026 smithi026 running (7m) 96s ago 18m 6651k - 18.2.2-1322-gd21e4f96 af23193ff691 73a04ad0bb49 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:crash.smithi135 smithi135 running (7m) 2m ago 18m 6647k - 18.2.2-1322-gd21e4f96 af23193ff691 afa99c3191ed 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:grafana.smithi026 smithi026 *:3000 running (100s) 96s ago 18m 40.3M - 9.4.7 954c08fa6188 a919b7671b5a 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.gbyppy smithi026 running (3m) 96s ago 13m 14.5M - 18.2.2-1322-gd21e4f96 af23193ff691 d186720df096 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi026.nhrcgk smithi026 running (3m) 96s ago 13m 81.8M - 18.2.2-1322-gd21e4f96 af23193ff691 4083eb8ff427 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.hcciyw smithi135 running (2m) 2m ago 13m 11.8M - 18.2.2-1322-gd21e4f96 af23193ff691 8f7df1307719 2024-05-09T00:18:16.665 INFO:teuthology.orchestra.run.smithi026.stdout:mds.cephfs.smithi135.lzxgvd smithi135 running (3m) 2m ago 13m 15.1M - 18.2.2-1322-gd21e4f96 af23193ff691 20dc7cc555ea 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi026.brymfp smithi026 *:8443,9283,8765 running (9m) 96s ago 20m 511M - 18.2.2-1322-gd21e4f96 af23193ff691 3c9cd08ef4d5 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.smithi135.kkrhgf smithi135 *:8443,9283,8765 running (8m) 2m ago 18m 453M - 18.2.2-1322-gd21e4f96 af23193ff691 cdd20d29e969 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi026 smithi026 running (8m) 96s ago 20m 63.7M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 4c64ed5c2c41 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:mon.smithi135 smithi135 running (8m) 2m ago 18m 43.7M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 f09e06117134 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi026 smithi026 *:9100 running (2m) 96s ago 18m 12.3M - 1.5.0 0da6a335fe13 b8ba8105dfb9 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:node-exporter.smithi135 smithi135 *:9100 running (2m) 2m ago 18m 8434k - 1.5.0 0da6a335fe13 8668fc4ddeef 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (7m) 96s ago 17m 111M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 443f82cb22bd 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi026 running (6m) 96s ago 17m 118M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 ec17e8a4a4e9 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi026 running (5m) 96s ago 16m 105M 1911M 18.2.2-1322-gd21e4f96 af23193ff691 65c1e03662f9 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi135 running (5m) 2m ago 16m 122M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 6bc39713b177 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi135 running (4m) 2m ago 15m 103M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 a23ab54b2270 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi135 running (4m) 2m ago 15m 100M 2251M 18.2.2-1322-gd21e4f96 af23193ff691 df906a6613b1 2024-05-09T00:18:16.666 INFO:teuthology.orchestra.run.smithi026.stdout:prometheus.smithi135 smithi135 *:9095 running (2m) 2m ago 17m 42.0M - 2.43.0 a07b618ecd1d a2baf25b6557 2024-05-09T00:18:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f031c06caa0 msgr2=0x7f031c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f031c06caa0 0x7f031c06ef60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0328004f10 tx=0x7f032800b040).stop 2024-05-09T00:18:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fd910 msgr2=0x7f033406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fd910 0x7f033406b0d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f032400c790 tx=0x7f0324004330).stop 2024-05-09T00:18:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 shutdown_connections 2024-05-09T00:18:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f031c06caa0 0x7f031c06ef60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:16.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03340fd910 0x7f033406b0d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:16.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 --2- 172.21.15.26:0/1506552777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03340fe270 0x7f033406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:16.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 >> 172.21.15.26:0/1506552777 conn(0x7f03340f3510 msgr2=0x7f03340fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:16.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 shutdown_connections 2024-05-09T00:18:16.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:16.668+0000 7f0338b11700 1 -- 172.21.15.26:0/1506552777 wait complete. 2024-05-09T00:18:17.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph versions' 2024-05-09T00:18:18.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:18 smithi026 ceph-mon[93667]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:18:18.399 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:18 smithi026 ceph-mon[93667]: pgmap v290: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:18.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:18 smithi135 ceph-mon[80466]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:18:18.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:18 smithi135 ceph-mon[80466]: pgmap v290: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:19.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.549+0000 7f55b867d700 1 -- 172.21.15.26:0/2561552027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 msgr2=0x7f55b00fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:19.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.549+0000 7f55b867d700 1 --2- 172.21.15.26:0/2561552027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 0x7f55b00fcbd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f55ac0047f0 tx=0x7f55ac009cb0).stop 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.549+0000 7f55b867d700 1 -- 172.21.15.26:0/2561552027 shutdown_connections 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.549+0000 7f55b867d700 1 --2- 172.21.15.26:0/2561552027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b00fd150 0x7f55b00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.549+0000 7f55b867d700 1 --2- 172.21.15.26:0/2561552027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 0x7f55b00fcbd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.549+0000 7f55b867d700 1 -- 172.21.15.26:0/2561552027 >> 172.21.15.26:0/2561552027 conn(0x7f55b0070590 msgr2=0x7f55b00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.549+0000 7f55b867d700 1 -- 172.21.15.26:0/2561552027 shutdown_connections 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.549+0000 7f55b867d700 1 -- 172.21.15.26:0/2561552027 wait complete. 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b867d700 1 Processor -- start 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b867d700 1 -- start start 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b867d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 0x7f55b01090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b867d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b00fd150 0x7f55b01095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b867d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0109ad0 con 0x7f55b00fc7f0 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b867d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0109c10 con 0x7f55b00fd150 2024-05-09T00:18:19.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b6419700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 0x7f55b01090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b6419700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 0x7f55b01090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37760/0 (socket says 172.21.15.26:37760) 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.550+0000 7f55b6419700 1 -- 172.21.15.26:0/744308431 learned_addr learned my addr 172.21.15.26:0/744308431 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55b5c18700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b00fd150 0x7f55b01095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55b6419700 1 -- 172.21.15.26:0/744308431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b00fd150 msgr2=0x7f55b01095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55b6419700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b00fd150 0x7f55b01095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55b6419700 1 -- 172.21.15.26:0/744308431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac005040 con 0x7f55b00fc7f0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55b6419700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 0x7f55b01090f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f55ac0043a0 tx=0x7f55ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55a77fe700 1 -- 172.21.15.26:0/744308431 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55ac00e030 con 0x7f55b00fc7f0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55a77fe700 1 -- 172.21.15.26:0/744308431 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f55ac007e90 con 0x7f55b00fc7f0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b0109e60 con 0x7f55b00fc7f0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55a77fe700 1 -- 172.21.15.26:0/744308431 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55ac018070 con 0x7f55b00fc7f0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.551+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b0112450 con 0x7f55b00fc7f0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.552+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b005f590 con 0x7f55b00fc7f0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.552+0000 7f55a77fe700 1 -- 172.21.15.26:0/744308431 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f55ac009590 con 0x7f55b00fc7f0 2024-05-09T00:18:19.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.553+0000 7f55a77fe700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f559c06cab0 0x7f559c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:19.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.553+0000 7f55a77fe700 1 -- 172.21.15.26:0/744308431 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f55ac08d090 con 0x7f55b00fc7f0 2024-05-09T00:18:19.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.553+0000 7f55b5c18700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f559c06cab0 0x7f559c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:19.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.553+0000 7f55b5c18700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f559c06cab0 0x7f559c06ef70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f55b0060ee0 tx=0x7f55a000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:19.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.557+0000 7f55a77fe700 1 -- 172.21.15.26:0/744308431 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f55ac057050 con 0x7f55b00fc7f0 2024-05-09T00:18:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.834+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f55b0047540 con 0x7f55b00fc7f0 2024-05-09T00:18:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.835+0000 7f55a77fe700 1 -- 172.21.15.26:0/744308431 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f55ac05a670 con 0x7f55b00fc7f0 2024-05-09T00:18:19.835 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-05-09T00:18:19.835 INFO:teuthology.orchestra.run.smithi026.stdout: "mon": { 2024-05-09T00:18:19.835 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr": { 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 2 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: "osd": { 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 6 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 4 2024-05-09T00:18:19.836 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-05-09T00:18:19.837 INFO:teuthology.orchestra.run.smithi026.stdout: "overall": { 2024-05-09T00:18:19.837 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)": 14 2024-05-09T00:18:19.837 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-05-09T00:18:19.837 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-05-09T00:18:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f559c06cab0 msgr2=0x7f559c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f559c06cab0 0x7f559c06ef70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f55b0060ee0 tx=0x7f55a000b040).stop 2024-05-09T00:18:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 msgr2=0x7f55b01090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 0x7f55b01090f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f55ac0043a0 tx=0x7f55ac009cb0).stop 2024-05-09T00:18:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 shutdown_connections 2024-05-09T00:18:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f559c06cab0 0x7f559c06ef70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55b00fc7f0 0x7f55b01090f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 --2- 172.21.15.26:0/744308431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55b00fd150 0x7f55b01095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 >> 172.21.15.26:0/744308431 conn(0x7f55b0070590 msgr2=0x7f55b00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 shutdown_connections 2024-05-09T00:18:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:19.837+0000 7f55b867d700 1 -- 172.21.15.26:0/744308431 wait complete. 2024-05-09T00:18:20.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:20 smithi026 ceph-mon[93667]: pgmap v291: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:20.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:20 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/744308431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:18:20.454 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-05-09T00:18:20.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:20 smithi135 ceph-mon[80466]: pgmap v291: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:20.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:20 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/744308431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:18:21.565 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:21 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:18:21.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:21 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:18:22.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.418+0000 7f17e3025700 1 -- 172.21.15.26:0/2520585091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 msgr2=0x7f17dc0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:22.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.418+0000 7f17e3025700 1 --2- 172.21.15.26:0/2520585091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 0x7f17dc0f7a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f17c80047f0 tx=0x7f17c8009cb0).stop 2024-05-09T00:18:22.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.418+0000 7f17e3025700 1 -- 172.21.15.26:0/2520585091 shutdown_connections 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 --2- 172.21.15.26:0/2520585091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 0x7f17dc0f7a50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 --2- 172.21.15.26:0/2520585091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17dc0fd910 0x7f17dc0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 -- 172.21.15.26:0/2520585091 >> 172.21.15.26:0/2520585091 conn(0x7f17dc0f3530 msgr2=0x7f17dc0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 -- 172.21.15.26:0/2520585091 shutdown_connections 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 -- 172.21.15.26:0/2520585091 wait complete. 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 Processor -- start 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 -- start start 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17dc0fd910 0x7f17dc10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 0x7f17dc10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc10eae0 con 0x7f17dc0fe270 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17e3025700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc10ec20 con 0x7f17dc0fd910 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.419+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 0x7f17dc10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 0x7f17dc10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50794/0 (socket says 172.21.15.26:50794) 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17dbfff700 1 -- 172.21.15.26:0/1011405355 learned_addr learned my addr 172.21.15.26:0/1011405355 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:22.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17e0dc1700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17dc0fd910 0x7f17dc10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17dbfff700 1 -- 172.21.15.26:0/1011405355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17dc0fd910 msgr2=0x7f17dc10dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17dbfff700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17dc0fd910 0x7f17dc10dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17dbfff700 1 -- 172.21.15.26:0/1011405355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c8005040 con 0x7f17dc0fe270 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17dbfff700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 0x7f17dc10e4e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f17c80099f0 tx=0x7f17c8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17d9ffb700 1 -- 172.21.15.26:0/1011405355 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17c800e030 con 0x7f17dc0fe270 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17d9ffb700 1 -- 172.21.15.26:0/1011405355 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f17c8007e90 con 0x7f17dc0fe270 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc108250 con 0x7f17dc0fe270 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17d9ffb700 1 -- 172.21.15.26:0/1011405355 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17c8018070 con 0x7f17dc0fe270 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.420+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc1087b0 con 0x7f17dc0fe270 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.421+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc05f570 con 0x7f17dc0fe270 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.422+0000 7f17d9ffb700 1 -- 172.21.15.26:0/1011405355 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f17c801d420 con 0x7f17dc0fe270 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.422+0000 7f17d9ffb700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f17cc06caa0 0x7f17cc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:22.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.422+0000 7f17d9ffb700 1 -- 172.21.15.26:0/1011405355 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f17c808d350 con 0x7f17dc0fe270 2024-05-09T00:18:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.422+0000 7f17e0dc1700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f17cc06caa0 0x7f17cc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.423+0000 7f17e0dc1700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f17cc06caa0 0x7f17cc06ef60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f17d0004b60 tx=0x7f17d0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:22.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.427+0000 7f17d9ffb700 1 -- 172.21.15.26:0/1011405355 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f17c805ada0 con 0x7f17dc0fe270 2024-05-09T00:18:22.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:22 smithi026 ceph-mon[93667]: pgmap v292: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:22.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:22 smithi135 ceph-mon[80466]: pgmap v292: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:22.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.709+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f17dc047540 con 0x7f17dc0fe270 2024-05-09T00:18:22.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.709+0000 7f17d9ffb700 1 -- 172.21.15.26:0/1011405355 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f17c805a930 con 0x7f17dc0fe270 2024-05-09T00:18:22.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.711+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f17cc06caa0 msgr2=0x7f17cc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:22.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.711+0000 7f17e3025700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f17cc06caa0 0x7f17cc06ef60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f17d0004b60 tx=0x7f17d0009040).stop 2024-05-09T00:18:22.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 msgr2=0x7f17dc10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:22.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 0x7f17dc10e4e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f17c80099f0 tx=0x7f17c8009cb0).stop 2024-05-09T00:18:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 shutdown_connections 2024-05-09T00:18:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f17cc06caa0 0x7f17cc06ef60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17dc0fd910 0x7f17dc10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 --2- 172.21.15.26:0/1011405355 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0fe270 0x7f17dc10e4e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 >> 172.21.15.26:0/1011405355 conn(0x7f17dc0f3530 msgr2=0x7f17dc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 shutdown_connections 2024-05-09T00:18:22.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:22.712+0000 7f17e3025700 1 -- 172.21.15.26:0/1011405355 wait complete. 2024-05-09T00:18:22.721 INFO:teuthology.orchestra.run.smithi026.stdout:true 2024-05-09T00:18:23.398 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:23 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1011405355' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:18:23.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -e sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-05-09T00:18:23.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:23 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1011405355' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:18:24.612 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:24 smithi026 ceph-mon[93667]: pgmap v293: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:24.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:24 smithi135 ceph-mon[80466]: pgmap v293: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.508+0000 7fe97cfed700 1 -- 172.21.15.26:0/1026211353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fd150 msgr2=0x7fe9780f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.508+0000 7fe97cfed700 1 --2- 172.21.15.26:0/1026211353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fd150 0x7fe9780f6930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fe96c0047f0 tx=0x7fe96c009cb0).stop 2024-05-09T00:18:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.509+0000 7fe97cfed700 1 -- 172.21.15.26:0/1026211353 shutdown_connections 2024-05-09T00:18:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.509+0000 7fe97cfed700 1 --2- 172.21.15.26:0/1026211353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fd150 0x7fe9780f6930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.509+0000 7fe97cfed700 1 --2- 172.21.15.26:0/1026211353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9780fc7f0 0x7fe9780fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.509+0000 7fe97cfed700 1 -- 172.21.15.26:0/1026211353 >> 172.21.15.26:0/1026211353 conn(0x7fe978070590 msgr2=0x7fe9780f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.509+0000 7fe97cfed700 1 -- 172.21.15.26:0/1026211353 shutdown_connections 2024-05-09T00:18:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.509+0000 7fe97cfed700 1 -- 172.21.15.26:0/1026211353 wait complete. 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.509+0000 7fe97cfed700 1 Processor -- start 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.509+0000 7fe97cfed700 1 -- start start 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97cfed700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fc7f0 0x7fe97810e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97cfed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9780fd150 0x7fe97810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97cfed700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97810eb90 con 0x7fe9780fc7f0 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97cfed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97810ecd0 con 0x7fe9780fd150 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fc7f0 0x7fe97810e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fc7f0 0x7fe97810e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50822/0 (socket says 172.21.15.26:50822) 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97659c700 1 -- 172.21.15.26:0/171955616 learned_addr learned my addr 172.21.15.26:0/171955616 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe975d9b700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9780fd150 0x7fe97810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97659c700 1 -- 172.21.15.26:0/171955616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9780fd150 msgr2=0x7fe97810e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97659c700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9780fd150 0x7fe97810e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97659c700 1 -- 172.21.15.26:0/171955616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c005040 con 0x7fe9780fc7f0 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe97659c700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fc7f0 0x7fe97810e0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe96800e8f0 tx=0x7fe96800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe9677fe700 1 -- 172.21.15.26:0/171955616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe968007b40 con 0x7fe9780fc7f0 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.510+0000 7fe9677fe700 1 -- 172.21.15.26:0/171955616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe96800f040 con 0x7fe9780fc7f0 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.511+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9781083a0 con 0x7fe9780fc7f0 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.511+0000 7fe9677fe700 1 -- 172.21.15.26:0/171955616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe968014880 con 0x7fe9780fc7f0 2024-05-09T00:18:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.511+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe978108960 con 0x7fe9780fc7f0 2024-05-09T00:18:25.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.512+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97805f590 con 0x7fe9780fc7f0 2024-05-09T00:18:25.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.512+0000 7fe9677fe700 1 -- 172.21.15.26:0/171955616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe968014ab0 con 0x7fe9780fc7f0 2024-05-09T00:18:25.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.512+0000 7fe9677fe700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe96006caa0 0x7fe96006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:25.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.513+0000 7fe9677fe700 1 -- 172.21.15.26:0/171955616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fe96808ba60 con 0x7fe9780fc7f0 2024-05-09T00:18:25.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.513+0000 7fe975d9b700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe96006caa0 0x7fe96006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:25.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.513+0000 7fe975d9b700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe96006caa0 0x7fe96006ef60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe978109a20 tx=0x7fe96c009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:25.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.517+0000 7fe9677fe700 1 -- 172.21.15.26:0/171955616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fe968055a20 con 0x7fe9780fc7f0 2024-05-09T00:18:25.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.796+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe978047540 con 0x7fe9780fc7f0 2024-05-09T00:18:25.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.797+0000 7fe9677fe700 1 -- 172.21.15.26:0/171955616 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe968059040 con 0x7fe9780fc7f0 2024-05-09T00:18:25.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe96006caa0 msgr2=0x7fe96006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:25.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe96006caa0 0x7fe96006ef60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe978109a20 tx=0x7fe96c009cb0).stop 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fc7f0 msgr2=0x7fe97810e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fc7f0 0x7fe97810e0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe96800e8f0 tx=0x7fe96800b040).stop 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 shutdown_connections 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe96006caa0 0x7fe96006ef60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9780fc7f0 0x7fe97810e0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 --2- 172.21.15.26:0/171955616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9780fd150 0x7fe97810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 >> 172.21.15.26:0/171955616 conn(0x7fe978070590 msgr2=0x7fe978060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 shutdown_connections 2024-05-09T00:18:25.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:25.799+0000 7fe97cfed700 1 -- 172.21.15.26:0/171955616 wait complete. 2024-05-09T00:18:25.808 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)" 2024-05-09T00:18:26.428 DEBUG:teuthology.parallel:result is None 2024-05-09T00:18:26.428 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:18:26.440 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:18:26.440 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aa42787e-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T00:18:26.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:26 smithi026 ceph-mon[93667]: pgmap v294: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:26.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:26 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/171955616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:18:26.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:26 smithi135 ceph-mon[80466]: pgmap v294: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:26.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:26 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/171955616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T00:18:28.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.329+0000 7fe30c2ac700 1 -- 172.21.15.26:0/1838473068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fe250 msgr2=0x7fe3040f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:28.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.329+0000 7fe30c2ac700 1 --2- 172.21.15.26:0/1838473068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fe250 0x7fe3040f7a30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe2f40047f0 tx=0x7fe2f4009cb0).stop 2024-05-09T00:18:28.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.329+0000 7fe30c2ac700 1 -- 172.21.15.26:0/1838473068 shutdown_connections 2024-05-09T00:18:28.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.329+0000 7fe30c2ac700 1 --2- 172.21.15.26:0/1838473068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fe250 0x7fe3040f7a30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:28.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.329+0000 7fe30c2ac700 1 --2- 172.21.15.26:0/1838473068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040fd8f0 0x7fe3040fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:28.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.329+0000 7fe30c2ac700 1 -- 172.21.15.26:0/1838473068 >> 172.21.15.26:0/1838473068 conn(0x7fe3040f34b0 msgr2=0x7fe3040f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:28.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.329+0000 7fe30c2ac700 1 -- 172.21.15.26:0/1838473068 shutdown_connections 2024-05-09T00:18:28.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.329+0000 7fe30c2ac700 1 -- 172.21.15.26:0/1838473068 wait complete. 2024-05-09T00:18:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30c2ac700 1 Processor -- start 2024-05-09T00:18:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30c2ac700 1 -- start start 2024-05-09T00:18:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30c2ac700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fd8f0 0x7fe30410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30c2ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040fe250 0x7fe30410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30c2ac700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30410eb70 con 0x7fe3040fd8f0 2024-05-09T00:18:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30c2ac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30410ecb0 con 0x7fe3040fe250 2024-05-09T00:18:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30a048700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fd8f0 0x7fe30410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30a048700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fd8f0 0x7fe30410e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50832/0 (socket says 172.21.15.26:50832) 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe30a048700 1 -- 172.21.15.26:0/2822989071 learned_addr learned my addr 172.21.15.26:0/2822989071 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.330+0000 7fe309847700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040fe250 0x7fe30410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe30a048700 1 -- 172.21.15.26:0/2822989071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040fe250 msgr2=0x7fe30410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe30a048700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040fe250 0x7fe30410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe30a048700 1 -- 172.21.15.26:0/2822989071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4005040 con 0x7fe3040fd8f0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe309847700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040fe250 0x7fe30410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe30a048700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fd8f0 0x7fe30410e080 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fe30000dad0 tx=0x7fe300004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe2fb779700 1 -- 172.21.15.26:0/2822989071 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe30000b750 con 0x7fe3040fd8f0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe2fb779700 1 -- 172.21.15.26:0/2822989071 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe30000f040 con 0x7fe3040fd8f0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe304108340 con 0x7fe3040fd8f0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe2fb779700 1 -- 172.21.15.26:0/2822989071 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe300013ce0 con 0x7fe3040fd8f0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.331+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe304108880 con 0x7fe3040fd8f0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.332+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30405f590 con 0x7fe3040fd8f0 2024-05-09T00:18:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.333+0000 7fe2fb779700 1 -- 172.21.15.26:0/2822989071 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe30000b8b0 con 0x7fe3040fd8f0 2024-05-09T00:18:28.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.333+0000 7fe2fb779700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe2f006cab0 0x7fe2f006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:28.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.333+0000 7fe2fb779700 1 -- 172.21.15.26:0/2822989071 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fe30008b970 con 0x7fe3040fd8f0 2024-05-09T00:18:28.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.333+0000 7fe309847700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe2f006cab0 0x7fe2f006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:28.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.333+0000 7fe309847700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe2f006cab0 0x7fe2f006ef70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe3041099c0 tx=0x7fe2f4009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.338+0000 7fe2fb779700 1 -- 172.21.15.26:0/2822989071 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fe300059470 con 0x7fe3040fd8f0 2024-05-09T00:18:28.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.580+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe3041097a0 con 0x7fe3040fd8f0 2024-05-09T00:18:28.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.580+0000 7fe2fb779700 1 -- 172.21.15.26:0/2822989071 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fe300059000 con 0x7fe3040fd8f0 2024-05-09T00:18:28.580 INFO:teuthology.orchestra.run.smithi026.stdout:e32 2024-05-09T00:18:28.580 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:18:28.580 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:18:28.580 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 32 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-05-09T00:04:31.151983+0000 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2024-05-09T00:15:31.347544+0000 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 60 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:max_xattr_size 65536 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2024-05-09T00:18:28.581 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 83 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 1 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:in 0 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=34400} 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data enabled 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 1 2024-05-09T00:18:28.582 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.nhrcgk{0:34400} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.26:6826/1939439669,v1:172.21.15.26:6827/1939439669] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:18:28.583 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:28.583 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:28.583 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2024-05-09T00:18:28.583 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:28.583 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi026.gbyppy{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.26:6828/666863957,v1:172.21.15.26:6829/666863957] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:18:28.583 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.lzxgvd{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/2979557079,v1:172.21.15.135:6825/2979557079] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:18:28.583 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.cephfs.smithi135.hcciyw{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/918815670,v1:172.21.15.135:6827/918815670] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe2f006cab0 msgr2=0x7fe2f006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe2f006cab0 0x7fe2f006ef70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe3041099c0 tx=0x7fe2f4009cb0).stop 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fd8f0 msgr2=0x7fe30410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fd8f0 0x7fe30410e080 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fe30000dad0 tx=0x7fe300004ee0).stop 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 shutdown_connections 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe2f006cab0 0x7fe2f006ef70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3040fd8f0 0x7fe30410e080 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 --2- 172.21.15.26:0/2822989071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3040fe250 0x7fe30410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:28.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 >> 172.21.15.26:0/2822989071 conn(0x7fe3040f34b0 msgr2=0x7fe3040fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:28.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.582+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 shutdown_connections 2024-05-09T00:18:28.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:28.583+0000 7fe30c2ac700 1 -- 172.21.15.26:0/2822989071 wait complete. 2024-05-09T00:18:28.585 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2024-05-09T00:18:28.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:28 smithi026 ceph-mon[93667]: pgmap v295: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:28.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:28 smithi135 ceph-mon[80466]: pgmap v295: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:29.296 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-05-09T00:18:29.307 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.434+0000 7fef39d97700 1 -- 172.21.15.26:0/1544699067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fd840 msgr2=0x7fef340fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.434+0000 7fef39d97700 1 --2- 172.21.15.26:0/1544699067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fd840 0x7fef340fdc20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fef1c0047f0 tx=0x7fef1c009cb0).stop 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.434+0000 7fef39d97700 1 -- 172.21.15.26:0/1544699067 shutdown_connections 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.434+0000 7fef39d97700 1 --2- 172.21.15.26:0/1544699067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef340fe1a0 0x7fef340f7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.434+0000 7fef39d97700 1 --2- 172.21.15.26:0/1544699067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fd840 0x7fef340fdc20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.434+0000 7fef39d97700 1 -- 172.21.15.26:0/1544699067 >> 172.21.15.26:0/1544699067 conn(0x7fef340f3400 msgr2=0x7fef340f5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.434+0000 7fef39d97700 1 -- 172.21.15.26:0/1544699067 shutdown_connections 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.434+0000 7fef39d97700 1 -- 172.21.15.26:0/1544699067 wait complete. 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef39d97700 1 Processor -- start 2024-05-09T00:18:29.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef39d97700 1 -- start start 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef39d97700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef340fd840 0x7fef3410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef39d97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fe1a0 0x7fef3410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef39d97700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3410eb20 con 0x7fef340fe1a0 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef39d97700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3410ec60 con 0x7fef340fd840 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef32ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fe1a0 0x7fef3410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef32ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fe1a0 0x7fef3410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50856/0 (socket says 172.21.15.26:50856) 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef32ffd700 1 -- 172.21.15.26:0/55787444 learned_addr learned my addr 172.21.15.26:0/55787444 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef337fe700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef340fd840 0x7fef3410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef32ffd700 1 -- 172.21.15.26:0/55787444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef340fd840 msgr2=0x7fef3410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef32ffd700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef340fd840 0x7fef3410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef32ffd700 1 -- 172.21.15.26:0/55787444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c005040 con 0x7fef340fe1a0 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.435+0000 7fef337fe700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef340fd840 0x7fef3410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.436+0000 7fef32ffd700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fe1a0 0x7fef3410e520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fef2400e8c0 tx=0x7fef2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.436+0000 7fef30ff9700 1 -- 172.21.15.26:0/55787444 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef2400ee60 con 0x7fef340fe1a0 2024-05-09T00:18:29.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.436+0000 7fef30ff9700 1 -- 172.21.15.26:0/55787444 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef2400f040 con 0x7fef340fe1a0 2024-05-09T00:18:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.436+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef34108290 con 0x7fef340fe1a0 2024-05-09T00:18:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.436+0000 7fef30ff9700 1 -- 172.21.15.26:0/55787444 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef2400c810 con 0x7fef340fe1a0 2024-05-09T00:18:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.436+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef34108850 con 0x7fef340fe1a0 2024-05-09T00:18:29.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.437+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3405f340 con 0x7fef340fe1a0 2024-05-09T00:18:29.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.437+0000 7fef30ff9700 1 -- 172.21.15.26:0/55787444 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fef24007b40 con 0x7fef340fe1a0 2024-05-09T00:18:29.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.438+0000 7fef30ff9700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fef2006caa0 0x7fef2006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:29.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.438+0000 7fef30ff9700 1 -- 172.21.15.26:0/55787444 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fef2408ba30 con 0x7fef340fe1a0 2024-05-09T00:18:29.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.438+0000 7fef337fe700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fef2006caa0 0x7fef2006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:29.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.438+0000 7fef337fe700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fef2006caa0 0x7fef2006ef60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fef1c004e60 tx=0x7fef1c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:29.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.442+0000 7fef30ff9700 1 -- 172.21.15.26:0/55787444 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fef24059480 con 0x7fef340fe1a0 2024-05-09T00:18:29.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.641+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef340ffb90 con 0x7fef340fe1a0 2024-05-09T00:18:29.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.643+0000 7fef30ff9700 1 -- 172.21.15.26:0/55787444 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16506 (secure 0 0 0) 0x7fef24059010 con 0x7fef340fe1a0 2024-05-09T00:18:29.643 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:29.643 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:57:45.460652+0000","modified":"2024-05-09T00:15:20.321566+0000","last_up_change":"2024-05-09T00:14:05.009670+0000","last_in_change":"2024-05-09T00:02:49.885020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:01:47.922598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-05-09T00:04:30.085512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-05-09T00:04:30.572779+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e406a7e-5ec2-4f17-9308-640a499d3012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6803","nonce":2546986802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6805","nonce":2546986802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6809","nonce":2546986802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6807","nonce":2546986802}]},"public_addr":"172.21.15.26:6803/2546986802","cluster_addr":"172.21.15.26:6805/2546986802","heartbeat_back_addr":"172.21.15.26:6809/2546986802","heartbeat_front_addr":"172.21.15.26:6807/2546986802","state":["exists","up"]},{"osd":1,"uuid":"6f0691b3-17ca-4f90-88ce-13f4e115a987","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6811","nonce":512757979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6813","nonce":512757979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6817","nonce":512757979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6815","nonce":512757979}]},"public_addr":"172.21.15.26:6811/512757979","cluster_addr":"172.21.15.26:6813/512757979","heartbeat_back_addr":"172.21.15.26:6817/512757979","heartbeat_front_addr":"172.21.15.26:6815/512757979","state":["exists","up"]},{"osd":2,"uuid":"3eaa1376-f58f-4e84-970a-f7805331d339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6819","nonce":823482118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6821","nonce":823482118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6825","nonce":823482118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6823","nonce":823482118}]},"public_addr":"172.21.15.26:6819/823482118","cluster_addr":"172.21.15.26:6821/823482118","heartbeat_back_addr":"172.21.15.26:6825/823482118","heartbeat_front_addr":"172.21.15.26:6823/823482118","state":["exists","up"]},{"osd":3,"uuid":"9018149e-e25f-4d5c-8749-0feaffaa31e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6801","nonce":754743172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6803","nonce":754743172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6807","nonce":754743172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6805","nonce":754743172}]},"public_addr":"172.21.15.135:6801/754743172","cluster_addr":"172.21.15.135:6803/754743172","heartbeat_back_addr":"172.21.15.135:6807/754743172","heartbeat_front_addr":"172.21.15.135:6805/754743172","state":["exists","up"]},{"osd":4,"uuid":"90bd084e-4ae6-4fa0-9a79-221a26a1183c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6809","nonce":3603928216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6811","nonce":3603928216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6815","nonce":3603928216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6813","nonce":3603928216}]},"public_addr":"172.21.15.135:6809/3603928216","cluster_addr":"172.21.15.135:6811/3603928216","heartbeat_back_addr":"172.21.15.135:6815/3603928216","heartbeat_front_addr":"172.21.15.135:6813/3603928216","state":["exists","up"]},{"osd":5,"uuid":"b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6817","nonce":3179802514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6819","nonce":3179802514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6823","nonce":3179802514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6821","nonce":3179802514}]},"public_addr":"172.21.15.135:6817/3179802514","cluster_addr":"172.21.15.135:6819/3179802514","heartbeat_back_addr":"172.21.15.135:6823/3179802514","heartbeat_front_addr":"172.21.15.135:6821/3179802514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:41.148461+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:16.974271+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:45.884445+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:11.410167+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:40.468724+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:03:06.902797+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6826/3735682126":"2024-05-10T00:15:20.321533+0000","172.21.15.26:6829/3575480423":"2024-05-10T00:14:35.034063+0000","172.21.15.135:0/1041849259":"2024-05-10T00:09:04.054022+0000","172.21.15.26:6801/3278576613":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2070328984":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/109142730":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6828/3575480423":"2024-05-10T00:14:35.034063+0000","172.21.15.26:6801/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.135:6829/2528047954":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/334581542":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/1959910794":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/2652974841":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2682720248":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/925863937":"2024-05-09T23:59:44.498405+0000","172.21.15.26:0/3104174095":"2024-05-09T23:58:50.299227+0000","172.21.15.135:0/2238459121":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/965450412":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.135:0/3433942163":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/4163858233":"2024-05-09T23:58:18.405305+0000","172.21.15.26:6801/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.135:6828/2528047954":"2024-05-10T00:09:04.054022+0000","172.21.15.135:0/388038356":"2024-05-10T00:09:04.054022+0000","172.21.15.26:6800/3278576613":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2204010739":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/367563552":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/4159573253":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/1550333540":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6800/3811609814":"2024-05-10T00:09:50.526257+0000","172.21.15.135:6827/3735682126":"2024-05-10T00:15:20.321533+0000","172.21.15.26:6801/3811609814":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6827/3998166556":"2024-05-10T00:14:09.741454+0000","172.21.15.26:6826/3998166556":"2024-05-10T00:14:09.741454+0000","172.21.15.135:6824/1248766098":"2024-05-10T00:14:55.000511+0000","172.21.15.135:6825/1248766098":"2024-05-10T00:14:55.000511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fef2006caa0 msgr2=0x7fef2006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fef2006caa0 0x7fef2006ef60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fef1c004e60 tx=0x7fef1c00b040).stop 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fe1a0 msgr2=0x7fef3410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fe1a0 0x7fef3410e520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fef2400e8c0 tx=0x7fef2400b040).stop 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 shutdown_connections 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fef2006caa0 0x7fef2006ef60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef340fd840 0x7fef3410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 --2- 172.21.15.26:0/55787444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef340fe1a0 0x7fef3410e520 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 >> 172.21.15.26:0/55787444 conn(0x7fef340f3400 msgr2=0x7fef340fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 shutdown_connections 2024-05-09T00:18:29.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.645+0000 7fef39d97700 1 -- 172.21.15.26:0/55787444 wait complete. 2024-05-09T00:18:29.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:29 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2822989071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:18:29.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:29 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2822989071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:18:29.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T00:01:47.922598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-05-09T00:04:30.085512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-05-09T00:04:30.572779+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:18:29.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:18:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2118244900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f67e0 msgr2=0x7f8f940f6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 --2- 172.21.15.26:0/2118244900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f67e0 0x7f8f940f6bc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f8f880047f0 tx=0x7f8f88009cb0).stop 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2118244900 shutdown_connections 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 --2- 172.21.15.26:0/2118244900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f940f70b0 0x7f8f94103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 --2- 172.21.15.26:0/2118244900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f67e0 0x7f8f940f6bc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2118244900 >> 172.21.15.26:0/2118244900 conn(0x7f8f9406c760 msgr2=0x7f8f9406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2118244900 shutdown_connections 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2118244900 wait complete. 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 Processor -- start 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.781+0000 7f8f9b0ec700 1 -- start start 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f9b0ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f940f67e0 0x7f8f941100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f9b0ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f70b0 0x7f8f941105b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f9b0ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94110bb0 con 0x7f8f940f70b0 2024-05-09T00:18:29.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f9b0ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94110cf0 con 0x7f8f940f67e0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f70b0 0x7f8f941105b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f93fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f70b0 0x7f8f941105b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50882/0 (socket says 172.21.15.26:50882) 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f93fff700 1 -- 172.21.15.26:0/2999778283 learned_addr learned my addr 172.21.15.26:0/2999778283 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f98e88700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f940f67e0 0x7f8f941100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f93fff700 1 -- 172.21.15.26:0/2999778283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f940f67e0 msgr2=0x7f8f941100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f93fff700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f940f67e0 0x7f8f941100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f93fff700 1 -- 172.21.15.26:0/2999778283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88005040 con 0x7f8f940f70b0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f93fff700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f70b0 0x7f8f941105b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f8f80002770 tx=0x7f8f80002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f91ffb700 1 -- 172.21.15.26:0/2999778283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f80002d80 con 0x7f8f940f70b0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f91ffb700 1 -- 172.21.15.26:0/2999778283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f8000f040 con 0x7f8f940f70b0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9410a380 con 0x7f8f940f70b0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f91ffb700 1 -- 172.21.15.26:0/2999778283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8000d800 con 0x7f8f940f70b0 2024-05-09T00:18:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.782+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9410a940 con 0x7f8f940f70b0 2024-05-09T00:18:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.783+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9405f380 con 0x7f8f940f70b0 2024-05-09T00:18:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.784+0000 7f8f91ffb700 1 -- 172.21.15.26:0/2999778283 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8f80009110 con 0x7f8f940f70b0 2024-05-09T00:18:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.784+0000 7f8f91ffb700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f8406cab0 0x7f8f8406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.784+0000 7f8f91ffb700 1 -- 172.21.15.26:0/2999778283 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f8f8008ba10 con 0x7f8f940f70b0 2024-05-09T00:18:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.784+0000 7f8f98e88700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f8406cab0 0x7f8f8406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:29.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.785+0000 7f8f98e88700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f8406cab0 0x7f8f8406ef70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8f88000c00 tx=0x7f8f88009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:29.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.789+0000 7f8f91ffb700 1 -- 172.21.15.26:0/2999778283 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f8f80059460 con 0x7f8f940f70b0 2024-05-09T00:18:29.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.984+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f94101400 con 0x7f8f940f70b0 2024-05-09T00:18:29.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.984+0000 7f8f91ffb700 1 -- 172.21.15.26:0/2999778283 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f80058ff0 con 0x7f8f940f70b0 2024-05-09T00:18:29.984 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-05-09T00:18:29.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.986+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f8406cab0 msgr2=0x7f8f8406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.986+0000 7f8f9b0ec700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f8406cab0 0x7f8f8406ef70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8f88000c00 tx=0x7f8f88009cb0).stop 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.986+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f70b0 msgr2=0x7f8f941105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.986+0000 7f8f9b0ec700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f70b0 0x7f8f941105b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f8f80002770 tx=0x7f8f80002b30).stop 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.986+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 shutdown_connections 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.987+0000 7f8f9b0ec700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f8f8406cab0 0x7f8f8406ef70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.987+0000 7f8f9b0ec700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f940f67e0 0x7f8f941100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.987+0000 7f8f9b0ec700 1 --2- 172.21.15.26:0/2999778283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f940f70b0 0x7f8f941105b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.987+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 >> 172.21.15.26:0/2999778283 conn(0x7f8f9406c760 msgr2=0x7f8f940f56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.987+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 shutdown_connections 2024-05-09T00:18:29.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:29.987+0000 7f8f9b0ec700 1 -- 172.21.15.26:0/2999778283 wait complete. 2024-05-09T00:18:29.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-05-09T00:18:30.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.123+0000 7fb480ec8700 1 -- 172.21.15.26:0/4267943669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fc830 msgr2=0x7fb47c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.123+0000 7fb480ec8700 1 --2- 172.21.15.26:0/4267943669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fc830 0x7fb47c0fcc10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fb46c0047f0 tx=0x7fb46c009cb0).stop 2024-05-09T00:18:30.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.123+0000 7fb480ec8700 1 -- 172.21.15.26:0/4267943669 shutdown_connections 2024-05-09T00:18:30.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.123+0000 7fb480ec8700 1 --2- 172.21.15.26:0/4267943669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb47c0fd100 0x7fb47c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.123+0000 7fb480ec8700 1 --2- 172.21.15.26:0/4267943669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fc830 0x7fb47c0fcc10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.123+0000 7fb480ec8700 1 -- 172.21.15.26:0/4267943669 >> 172.21.15.26:0/4267943669 conn(0x7fb47c06c760 msgr2=0x7fb47c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:30.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.124+0000 7fb480ec8700 1 -- 172.21.15.26:0/4267943669 shutdown_connections 2024-05-09T00:18:30.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.124+0000 7fb480ec8700 1 -- 172.21.15.26:0/4267943669 wait complete. 2024-05-09T00:18:30.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.124+0000 7fb480ec8700 1 Processor -- start 2024-05-09T00:18:30.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.124+0000 7fb480ec8700 1 -- start start 2024-05-09T00:18:30.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.124+0000 7fb480ec8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb47c0fc830 0x7fb47c110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.124+0000 7fb480ec8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fd100 0x7fb47c110610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.124+0000 7fb480ec8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c110c10 con 0x7fb47c0fd100 2024-05-09T00:18:30.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.124+0000 7fb480ec8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c110d50 con 0x7fb47c0fc830 2024-05-09T00:18:30.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb479d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fd100 0x7fb47c110610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb479d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fd100 0x7fb47c110610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50902/0 (socket says 172.21.15.26:50902) 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb479d9b700 1 -- 172.21.15.26:0/123981497 learned_addr learned my addr 172.21.15.26:0/123981497 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb47a59c700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb47c0fc830 0x7fb47c110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb479d9b700 1 -- 172.21.15.26:0/123981497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb47c0fc830 msgr2=0x7fb47c110120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb479d9b700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb47c0fc830 0x7fb47c110120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb479d9b700 1 -- 172.21.15.26:0/123981497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c005040 con 0x7fb47c0fd100 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb479d9b700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fd100 0x7fb47c110610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fb4700041d0 tx=0x7fb470009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb46b7fe700 1 -- 172.21.15.26:0/123981497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb470007b40 con 0x7fb47c0fd100 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c10a450 con 0x7fb47c0fd100 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb46b7fe700 1 -- 172.21.15.26:0/123981497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb47000f040 con 0x7fb47c0fd100 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb46b7fe700 1 -- 172.21.15.26:0/123981497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4700147b0 con 0x7fb47c0fd100 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.125+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c10aa10 con 0x7fb47c0fd100 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.126+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47c05f380 con 0x7fb47c0fd100 2024-05-09T00:18:30.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.127+0000 7fb46b7fe700 1 -- 172.21.15.26:0/123981497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb470009110 con 0x7fb47c0fd100 2024-05-09T00:18:30.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.127+0000 7fb46b7fe700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb46406caa0 0x7fb46406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.127+0000 7fb46b7fe700 1 -- 172.21.15.26:0/123981497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fb47008beb0 con 0x7fb47c0fd100 2024-05-09T00:18:30.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.127+0000 7fb47a59c700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb46406caa0 0x7fb46406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.128+0000 7fb47a59c700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb46406caa0 0x7fb46406ef60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb46c004f10 tx=0x7fb46c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.132+0000 7fb46b7fe700 1 -- 172.21.15.26:0/123981497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fb470059900 con 0x7fb47c0fd100 2024-05-09T00:18:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.330+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fb47c05eec0 con 0x7fb47c0fd100 2024-05-09T00:18:30.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.331+0000 7fb46b7fe700 1 -- 172.21.15.26:0/123981497 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb470059490 con 0x7fb47c0fd100 2024-05-09T00:18:30.331 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb46406caa0 msgr2=0x7fb46406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb46406caa0 0x7fb46406ef60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb46c004f10 tx=0x7fb46c00b040).stop 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fd100 msgr2=0x7fb47c110610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fd100 0x7fb47c110610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fb4700041d0 tx=0x7fb470009f60).stop 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 shutdown_connections 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb46406caa0 0x7fb46406ef60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb47c0fc830 0x7fb47c110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 --2- 172.21.15.26:0/123981497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb47c0fd100 0x7fb47c110610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 >> 172.21.15.26:0/123981497 conn(0x7fb47c06c760 msgr2=0x7fb47c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:30.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 shutdown_connections 2024-05-09T00:18:30.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.333+0000 7fb480ec8700 1 -- 172.21.15.26:0/123981497 wait complete. 2024-05-09T00:18:30.345 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-05-09T00:18:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.469+0000 7f33a8f33700 1 -- 172.21.15.26:0/280473490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fe250 msgr2=0x7f33a40f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.469+0000 7f33a8f33700 1 --2- 172.21.15.26:0/280473490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fe250 0x7f33a40f7a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f33940047f0 tx=0x7f3394009cb0).stop 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.469+0000 7f33a8f33700 1 -- 172.21.15.26:0/280473490 shutdown_connections 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.469+0000 7f33a8f33700 1 --2- 172.21.15.26:0/280473490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fe250 0x7f33a40f7a30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.469+0000 7f33a8f33700 1 --2- 172.21.15.26:0/280473490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a40fd8f0 0x7f33a40fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.469+0000 7f33a8f33700 1 -- 172.21.15.26:0/280473490 >> 172.21.15.26:0/280473490 conn(0x7f33a40f34d0 msgr2=0x7f33a40f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.469+0000 7f33a8f33700 1 -- 172.21.15.26:0/280473490 shutdown_connections 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.469+0000 7f33a8f33700 1 -- 172.21.15.26:0/280473490 wait complete. 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a8f33700 1 Processor -- start 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a8f33700 1 -- start start 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a8f33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fd8f0 0x7f33a410e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a8f33700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a40fe250 0x7f33a410e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a8f33700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a410eb80 con 0x7f33a40fd8f0 2024-05-09T00:18:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a8f33700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a410ecc0 con 0x7f33a40fe250 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fd8f0 0x7f33a410e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fd8f0 0x7f33a410e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50916/0 (socket says 172.21.15.26:50916) 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a259c700 1 -- 172.21.15.26:0/2377215651 learned_addr learned my addr 172.21.15.26:0/2377215651 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a1d9b700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a40fe250 0x7f33a410e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a259c700 1 -- 172.21.15.26:0/2377215651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a40fe250 msgr2=0x7f33a410e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a259c700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a40fe250 0x7f33a410e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a259c700 1 -- 172.21.15.26:0/2377215651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394005040 con 0x7f33a40fd8f0 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33a259c700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fd8f0 0x7f33a410e090 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f339800e8f0 tx=0x7f339800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.470+0000 7f33937fe700 1 -- 172.21.15.26:0/2377215651 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3398007b40 con 0x7f33a40fd8f0 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.471+0000 7f33937fe700 1 -- 172.21.15.26:0/2377215651 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f339800f040 con 0x7f33a40fd8f0 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.471+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a4108350 con 0x7f33a40fd8f0 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.471+0000 7f33937fe700 1 -- 172.21.15.26:0/2377215651 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3398014880 con 0x7f33a40fd8f0 2024-05-09T00:18:30.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.471+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a4108910 con 0x7f33a40fd8f0 2024-05-09T00:18:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.471+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a405f360 con 0x7f33a40fd8f0 2024-05-09T00:18:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.472+0000 7f33937fe700 1 -- 172.21.15.26:0/2377215651 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3398014b00 con 0x7f33a40fd8f0 2024-05-09T00:18:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.472+0000 7f33937fe700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f338c06caa0 0x7f338c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.473+0000 7f33937fe700 1 -- 172.21.15.26:0/2377215651 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f339808bab0 con 0x7f33a40fd8f0 2024-05-09T00:18:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.473+0000 7f33a1d9b700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f338c06caa0 0x7f338c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.473+0000 7f33a1d9b700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f338c06caa0 0x7f338c06ef60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f33a41099d0 tx=0x7f3394009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.477+0000 7f33937fe700 1 -- 172.21.15.26:0/2377215651 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f3398059500 con 0x7f33a40fd8f0 2024-05-09T00:18:30.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:30 smithi026 ceph-mon[93667]: pgmap v296: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:30.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:30 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/55787444' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:18:30.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:30 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2999778283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:18:30.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:30 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/123981497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-09T00:18:30.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:30 smithi135 ceph-mon[80466]: pgmap v296: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:30.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:30 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/55787444' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:18:30.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:30 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2999778283' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:18:30.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:30 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/123981497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-09T00:18:30.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.677+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f33a405eec0 con 0x7f33a40fd8f0 2024-05-09T00:18:30.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.678+0000 7f33937fe700 1 -- 172.21.15.26:0/2377215651 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f33a405eec0 con 0x7f33a40fd8f0 2024-05-09T00:18:30.677 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f338c06caa0 msgr2=0x7f338c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f338c06caa0 0x7f338c06ef60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f33a41099d0 tx=0x7f3394009cb0).stop 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fd8f0 msgr2=0x7f33a410e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fd8f0 0x7f33a410e090 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f339800e8f0 tx=0x7f339800b040).stop 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 shutdown_connections 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f338c06caa0 0x7f338c06ef60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33a40fd8f0 0x7f33a410e090 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 --2- 172.21.15.26:0/2377215651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a40fe250 0x7f33a410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 >> 172.21.15.26:0/2377215651 conn(0x7f33a40f34d0 msgr2=0x7f33a40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:30.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 shutdown_connections 2024-05-09T00:18:30.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.680+0000 7f33a8f33700 1 -- 172.21.15.26:0/2377215651 wait complete. 2024-05-09T00:18:30.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:18:30.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.812+0000 7ff74294d700 1 -- 172.21.15.26:0/3233152533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 msgr2=0x7ff73c0fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.812+0000 7ff74294d700 1 --2- 172.21.15.26:0/3233152533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 0x7ff73c0fcb10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7ff72c0047f0 tx=0x7ff72c009cb0).stop 2024-05-09T00:18:30.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.812+0000 7ff74294d700 1 -- 172.21.15.26:0/3233152533 shutdown_connections 2024-05-09T00:18:30.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.812+0000 7ff74294d700 1 --2- 172.21.15.26:0/3233152533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c0fd090 0x7ff73c0f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.812+0000 7ff74294d700 1 --2- 172.21.15.26:0/3233152533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 0x7ff73c0fcb10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.812+0000 7ff74294d700 1 -- 172.21.15.26:0/3233152533 >> 172.21.15.26:0/3233152533 conn(0x7ff73c06c760 msgr2=0x7ff73c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.812+0000 7ff74294d700 1 -- 172.21.15.26:0/3233152533 shutdown_connections 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.812+0000 7ff74294d700 1 -- 172.21.15.26:0/3233152533 wait complete. 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.813+0000 7ff74294d700 1 Processor -- start 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.813+0000 7ff74294d700 1 -- start start 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.813+0000 7ff74294d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 0x7ff73c10dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.813+0000 7ff74294d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c0fd090 0x7ff73c10e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.813+0000 7ff74294d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c10e9d0 con 0x7ff73c0fc730 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.813+0000 7ff74294d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c10eb10 con 0x7ff73c0fd090 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.813+0000 7ff73bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 0x7ff73c10dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.813+0000 7ff73bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 0x7ff73c10dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50928/0 (socket says 172.21.15.26:50928) 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff73bfff700 1 -- 172.21.15.26:0/3966616139 learned_addr learned my addr 172.21.15.26:0/3966616139 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff73b7fe700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c0fd090 0x7ff73c10e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff73bfff700 1 -- 172.21.15.26:0/3966616139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c0fd090 msgr2=0x7ff73c10e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff73bfff700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c0fd090 0x7ff73c10e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff73bfff700 1 -- 172.21.15.26:0/3966616139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c005040 con 0x7ff73c0fc730 2024-05-09T00:18:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff73bfff700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 0x7ff73c10dee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff72c00b120 tx=0x7ff72c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff7397fa700 1 -- 172.21.15.26:0/3966616139 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72c00e030 con 0x7ff73c0fc730 2024-05-09T00:18:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff7397fa700 1 -- 172.21.15.26:0/3966616139 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff72c007e90 con 0x7ff73c0fc730 2024-05-09T00:18:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73c108140 con 0x7ff73c0fc730 2024-05-09T00:18:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff7397fa700 1 -- 172.21.15.26:0/3966616139 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72c018070 con 0x7ff73c0fc730 2024-05-09T00:18:30.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.814+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c1086a0 con 0x7ff73c0fc730 2024-05-09T00:18:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.815+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c05f380 con 0x7ff73c0fc730 2024-05-09T00:18:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.816+0000 7ff7397fa700 1 -- 172.21.15.26:0/3966616139 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff72c01d420 con 0x7ff73c0fc730 2024-05-09T00:18:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.816+0000 7ff7397fa700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff72406caa0 0x7ff72406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.816+0000 7ff7397fa700 1 -- 172.21.15.26:0/3966616139 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7ff72c08d2a0 con 0x7ff73c0fc730 2024-05-09T00:18:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.816+0000 7ff73b7fe700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff72406caa0 0x7ff72406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:30.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.816+0000 7ff73b7fe700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff72406caa0 0x7ff72406ef60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff73c109820 tx=0x7ff730009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:30.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:30.820+0000 7ff7397fa700 1 -- 172.21.15.26:0/3966616139 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7ff72c05acf0 con 0x7ff73c0fc730 2024-05-09T00:18:31.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.066+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff73c05eec0 con 0x7ff73c0fc730 2024-05-09T00:18:31.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.066+0000 7ff7397fa700 1 -- 172.21.15.26:0/3966616139 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4826 (secure 0 0 0) 0x7ff72c05a880 con 0x7ff73c0fc730 2024-05-09T00:18:31.066 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:31.067 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":44299,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/2979557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2979557079},{"type":"v1","addr":"172.21.15.135:6825","nonce":2979557079}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/918815670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":918815670},{"type":"v1","addr":"172.21.15.135:6827","nonce":918815670}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:31.347544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":0,"incarnation":29,"state":"up:active","state_seq":21,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff72406caa0 msgr2=0x7ff72406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff72406caa0 0x7ff72406ef60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff73c109820 tx=0x7ff730009040).stop 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 msgr2=0x7ff73c10dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 0x7ff73c10dee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff72c00b120 tx=0x7ff72c009cb0).stop 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 shutdown_connections 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7ff72406caa0 0x7ff72406ef60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff73c0fc730 0x7ff73c10dee0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 --2- 172.21.15.26:0/3966616139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c0fd090 0x7ff73c10e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 >> 172.21.15.26:0/3966616139 conn(0x7ff73c06c760 msgr2=0x7ff73c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 shutdown_connections 2024-05-09T00:18:31.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.069+0000 7ff74294d700 1 -- 172.21.15.26:0/3966616139 wait complete. 2024-05-09T00:18:31.070 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2024-05-09T00:18:31.081 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 1, 'flags': 18} 2024-05-09T00:18:31.081 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 12 2024-05-09T00:18:31.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.203+0000 7feee936f700 1 -- 172.21.15.26:0/2179501776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 msgr2=0x7feee40f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.203+0000 7feee936f700 1 --2- 172.21.15.26:0/2179501776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 0x7feee40f8dd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7feecc0047f0 tx=0x7feecc009cb0).stop 2024-05-09T00:18:31.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.203+0000 7feee936f700 1 -- 172.21.15.26:0/2179501776 shutdown_connections 2024-05-09T00:18:31.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.203+0000 7feee936f700 1 --2- 172.21.15.26:0/2179501776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee40f92c0 0x7feee4101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.203+0000 7feee936f700 1 --2- 172.21.15.26:0/2179501776 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 0x7feee40f8dd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.203+0000 7feee936f700 1 -- 172.21.15.26:0/2179501776 >> 172.21.15.26:0/2179501776 conn(0x7feee406c760 msgr2=0x7feee406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:31.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.203+0000 7feee936f700 1 -- 172.21.15.26:0/2179501776 shutdown_connections 2024-05-09T00:18:31.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.203+0000 7feee936f700 1 -- 172.21.15.26:0/2179501776 wait complete. 2024-05-09T00:18:31.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee936f700 1 Processor -- start 2024-05-09T00:18:31.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee936f700 1 -- start start 2024-05-09T00:18:31.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee936f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 0x7feee40f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee936f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee40f92c0 0x7feee40f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee936f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40f7380 con 0x7feee40f89f0 2024-05-09T00:18:31.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee936f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40f74c0 con 0x7feee40f92c0 2024-05-09T00:18:31.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 0x7feee40f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 0x7feee40f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50958/0 (socket says 172.21.15.26:50958) 2024-05-09T00:18:31.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee2ffd700 1 -- 172.21.15.26:0/3879996343 learned_addr learned my addr 172.21.15.26:0/3879996343 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee27fc700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee40f92c0 0x7feee40f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee2ffd700 1 -- 172.21.15.26:0/3879996343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee40f92c0 msgr2=0x7feee40f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee2ffd700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee40f92c0 0x7feee40f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee2ffd700 1 -- 172.21.15.26:0/3879996343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc005040 con 0x7feee40f89f0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee27fc700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee40f92c0 0x7feee40f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.204+0000 7feee2ffd700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 0x7feee40f69a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7feecc009380 tx=0x7feecc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.205+0000 7feedbfff700 1 -- 172.21.15.26:0/3879996343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feecc00e030 con 0x7feee40f89f0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.205+0000 7feedbfff700 1 -- 172.21.15.26:0/3879996343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feecc007e90 con 0x7feee40f89f0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.205+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40f7770 con 0x7feee40f89f0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.205+0000 7feedbfff700 1 -- 172.21.15.26:0/3879996343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feecc018070 con 0x7feee40f89f0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.205+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee4114630 con 0x7feee40f89f0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.206+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee405f380 con 0x7feee40f89f0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.206+0000 7feedbfff700 1 -- 172.21.15.26:0/3879996343 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7feecc01d420 con 0x7feee40f89f0 2024-05-09T00:18:31.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.206+0000 7feedbfff700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feed006cab0 0x7feed006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.207+0000 7feedbfff700 1 -- 172.21.15.26:0/3879996343 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7feecc08d200 con 0x7feee40f89f0 2024-05-09T00:18:31.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.207+0000 7feee27fc700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feed006cab0 0x7feed006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.207+0000 7feee27fc700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feed006cab0 0x7feed006ef70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7feee40f8140 tx=0x7feed4009d60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:31.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.211+0000 7feedbfff700 1 -- 172.21.15.26:0/3879996343 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7feecc057280 con 0x7feee40f89f0 2024-05-09T00:18:31.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.458+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 12, "format": "json"} v 0) v1 -- 0x7feee40f7f20 con 0x7feee40f89f0 2024-05-09T00:18:31.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.459+0000 7feedbfff700 1 -- 172.21.15.26:0/3879996343 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 12, "format": "json"}]=0 dumped fsmap epoch 12 v32) v1 ==== 107+0+4039 (secure 0 0 0) 0x7feecc05a8a0 con 0x7feee40f89f0 2024-05-09T00:18:31.459 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:31.459 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/3575480423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3575480423},{"type":"v1","addr":"172.21.15.26:6829","nonce":3575480423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:09.741871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:31.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feed006cab0 msgr2=0x7feed006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feed006cab0 0x7feed006ef70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7feee40f8140 tx=0x7feed4009d60).stop 2024-05-09T00:18:31.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 msgr2=0x7feee40f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 0x7feee40f69a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7feecc009380 tx=0x7feecc009cb0).stop 2024-05-09T00:18:31.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 shutdown_connections 2024-05-09T00:18:31.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7feed006cab0 0x7feed006ef70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee40f89f0 0x7feee40f69a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 --2- 172.21.15.26:0/3879996343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feee40f92c0 0x7feee40f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 >> 172.21.15.26:0/3879996343 conn(0x7feee406c760 msgr2=0x7feee40fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 shutdown_connections 2024-05-09T00:18:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.461+0000 7feee936f700 1 -- 172.21.15.26:0/3879996343 wait complete. 2024-05-09T00:18:31.462 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 12 2024-05-09T00:18:31.473 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.595+0000 7f7469311700 1 -- 172.21.15.26:0/1690352789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 msgr2=0x7f74640f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.595+0000 7f7469311700 1 --2- 172.21.15.26:0/1690352789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 0x7f74640f5f70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f74580047f0 tx=0x7f7458009cb0).stop 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.595+0000 7f7469311700 1 -- 172.21.15.26:0/1690352789 shutdown_connections 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.595+0000 7f7469311700 1 --2- 172.21.15.26:0/1690352789 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 0x7f74640f5f70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.595+0000 7f7469311700 1 --2- 172.21.15.26:0/1690352789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74640fd930 0x7f74640fdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.595+0000 7f7469311700 1 -- 172.21.15.26:0/1690352789 >> 172.21.15.26:0/1690352789 conn(0x7f746406cea0 msgr2=0x7f746406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.595+0000 7f7469311700 1 -- 172.21.15.26:0/1690352789 shutdown_connections 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.595+0000 7f7469311700 1 -- 172.21.15.26:0/1690352789 wait complete. 2024-05-09T00:18:31.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f7469311700 1 Processor -- start 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f7469311700 1 -- start start 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f7469311700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74640fd930 0x7f74640f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f7469311700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 0x7f74640f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f7469311700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640f7c20 con 0x7f74640fe290 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f7469311700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640f7d60 con 0x7f74640fd930 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f74627fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 0x7f74640f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f74627fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 0x7f74640f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55480/0 (socket says 172.21.15.26:55480) 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.596+0000 7f74627fc700 1 -- 172.21.15.26:0/3837651578 learned_addr learned my addr 172.21.15.26:0/3837651578 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f7462ffd700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74640fd930 0x7f74640f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f74627fc700 1 -- 172.21.15.26:0/3837651578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74640fd930 msgr2=0x7f74640f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f74627fc700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74640fd930 0x7f74640f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f74627fc700 1 -- 172.21.15.26:0/3837651578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7458005040 con 0x7f74640fe290 2024-05-09T00:18:31.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f74627fc700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 0x7f74640f7730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7458005010 tx=0x7f7458009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f744bfff700 1 -- 172.21.15.26:0/3837651578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745800e030 con 0x7f74640fe290 2024-05-09T00:18:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74640f7fb0 con 0x7f74640fe290 2024-05-09T00:18:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f744bfff700 1 -- 172.21.15.26:0/3837651578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7458007e90 con 0x7f74640fe290 2024-05-09T00:18:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f744bfff700 1 -- 172.21.15.26:0/3837651578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7458018070 con 0x7f74640fe290 2024-05-09T00:18:31.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.597+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7464114690 con 0x7f74640fe290 2024-05-09T00:18:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.598+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746405fb30 con 0x7f74640fe290 2024-05-09T00:18:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.598+0000 7f744bfff700 1 -- 172.21.15.26:0/3837651578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f745801d420 con 0x7f74640fe290 2024-05-09T00:18:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.599+0000 7f744bfff700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f744c06ca30 0x7f744c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.599+0000 7f744bfff700 1 -- 172.21.15.26:0/3837651578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f745808d230 con 0x7f74640fe290 2024-05-09T00:18:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.599+0000 7f7462ffd700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f744c06ca30 0x7f744c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.599+0000 7f7462ffd700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f744c06ca30 0x7f744c06eef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7454009170 tx=0x7f7454009d60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:31.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.603+0000 7f744bfff700 1 -- 172.21.15.26:0/3837651578 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f74580571f0 con 0x7f74640fe290 2024-05-09T00:18:31.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:31 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2377215651' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-09T00:18:31.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:31 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3966616139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:18:31.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:31 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2377215651' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-09T00:18:31.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:31 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3966616139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.849+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7f74640f8750 con 0x7f74640fe290 2024-05-09T00:18:31.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.850+0000 7f744bfff700 1 -- 172.21.15.26:0/3837651578 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v32) v1 ==== 107+0+4051 (secure 0 0 0) 0x7f745805a810 con 0x7f74640fe290 2024-05-09T00:18:31.850 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:31.850 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:09.752417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14448":{"gid":14448,"name":"cephfs.smithi026.gbyppy","rank":0,"incarnation":13,"state":"up:replay","state_seq":1,"addr":"172.21.15.26:6829/3575480423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3575480423},{"type":"v1","addr":"172.21.15.26:6829","nonce":3575480423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:31.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f744c06ca30 msgr2=0x7f744c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f744c06ca30 0x7f744c06eef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7454009170 tx=0x7f7454009d60).stop 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 msgr2=0x7f74640f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 0x7f74640f7730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7458005010 tx=0x7f7458009cb0).stop 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 shutdown_connections 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f744c06ca30 0x7f744c06eef0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74640fd930 0x7f74640f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 --2- 172.21.15.26:0/3837651578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74640fe290 0x7f74640f7730 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.852+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 >> 172.21.15.26:0/3837651578 conn(0x7f746406cea0 msgr2=0x7f7464100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.853+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 shutdown_connections 2024-05-09T00:18:31.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.853+0000 7f7469311700 1 -- 172.21.15.26:0/3837651578 wait complete. 2024-05-09T00:18:31.854 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 13 2024-05-09T00:18:31.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-05-09T00:18:31.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 -- 172.21.15.26:0/3237764947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 msgr2=0x7fc2100f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 --2- 172.21.15.26:0/3237764947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 0x7fc2100f6930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fc20c0047f0 tx=0x7fc20c009cb0).stop 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 -- 172.21.15.26:0/3237764947 shutdown_connections 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 --2- 172.21.15.26:0/3237764947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 0x7fc2100f6930 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 --2- 172.21.15.26:0/3237764947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2100fc830 0x7fc2100fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 -- 172.21.15.26:0/3237764947 >> 172.21.15.26:0/3237764947 conn(0x7fc21006c760 msgr2=0x7fc21006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 -- 172.21.15.26:0/3237764947 shutdown_connections 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 -- 172.21.15.26:0/3237764947 wait complete. 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.987+0000 7fc217ad0700 1 Processor -- start 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc217ad0700 1 -- start start 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc217ad0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2100fc830 0x7fc210109200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc217ad0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 0x7fc2101096f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc217ad0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc210109be0 con 0x7fc2100fd100 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc217ad0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc210109d20 con 0x7fc2100fc830 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc21506b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 0x7fc2101096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc21506b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 0x7fc2101096f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55496/0 (socket says 172.21.15.26:55496) 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc21506b700 1 -- 172.21.15.26:0/1889859763 learned_addr learned my addr 172.21.15.26:0/1889859763 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc21586c700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2100fc830 0x7fc210109200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc21506b700 1 -- 172.21.15.26:0/1889859763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2100fc830 msgr2=0x7fc210109200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc21506b700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2100fc830 0x7fc210109200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc21506b700 1 -- 172.21.15.26:0/1889859763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c005040 con 0x7fc2100fd100 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc21506b700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 0x7fc2101096f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fc20c009380 tx=0x7fc20c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc206f78700 1 -- 172.21.15.26:0/1889859763 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc20c018070 con 0x7fc2100fd100 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc206f78700 1 -- 172.21.15.26:0/1889859763 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc20c007e90 con 0x7fc2100fd100 2024-05-09T00:18:31.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc206f78700 1 -- 172.21.15.26:0/1889859763 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc20c0123c0 con 0x7fc2100fd100 2024-05-09T00:18:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.988+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc210109f70 con 0x7fc2100fd100 2024-05-09T00:18:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.989+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc210112500 con 0x7fc2100fd100 2024-05-09T00:18:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.990+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21005f380 con 0x7fc2100fd100 2024-05-09T00:18:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.990+0000 7fc206f78700 1 -- 172.21.15.26:0/1889859763 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc20c01d420 con 0x7fc2100fd100 2024-05-09T00:18:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.990+0000 7fc206f78700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc1fc06caa0 0x7fc1fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.991+0000 7fc206f78700 1 -- 172.21.15.26:0/1889859763 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fc20c08caa0 con 0x7fc2100fd100 2024-05-09T00:18:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.991+0000 7fc21586c700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc1fc06caa0 0x7fc1fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.991+0000 7fc21586c700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc1fc06caa0 0x7fc1fc06ef60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc2000048b0 tx=0x7fc20000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:31.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:31.995+0000 7fc206f78700 1 -- 172.21.15.26:0/1889859763 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fc20c056a60 con 0x7fc2100fd100 2024-05-09T00:18:32.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.240+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7fc2100feb60 con 0x7fc2100fd100 2024-05-09T00:18:32.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.240+0000 7fc206f78700 1 -- 172.21.15.26:0/1889859763 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v32) v1 ==== 107+0+4056 (secure 0 0 0) 0x7fc20c01d6d0 con 0x7fc2100fd100 2024-05-09T00:18:32.240 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:32.240 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:19.112631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14448":{"gid":14448,"name":"cephfs.smithi026.gbyppy","rank":0,"incarnation":13,"state":"up:reconnect","state_seq":146,"addr":"172.21.15.26:6829/3575480423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3575480423},{"type":"v1","addr":"172.21.15.26:6829","nonce":3575480423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.242+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc1fc06caa0 msgr2=0x7fc1fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.242+0000 7fc217ad0700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc1fc06caa0 0x7fc1fc06ef60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc2000048b0 tx=0x7fc20000b040).stop 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.242+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 msgr2=0x7fc2101096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.242+0000 7fc217ad0700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 0x7fc2101096f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fc20c009380 tx=0x7fc20c009cb0).stop 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.243+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 shutdown_connections 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.243+0000 7fc217ad0700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fc1fc06caa0 0x7fc1fc06ef60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.243+0000 7fc217ad0700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2100fc830 0x7fc210109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.243+0000 7fc217ad0700 1 --2- 172.21.15.26:0/1889859763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100fd100 0x7fc2101096f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.243+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 >> 172.21.15.26:0/1889859763 conn(0x7fc21006c760 msgr2=0x7fc2100fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.243+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 shutdown_connections 2024-05-09T00:18:32.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.243+0000 7fc217ad0700 1 -- 172.21.15.26:0/1889859763 wait complete. 2024-05-09T00:18:32.244 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 14 2024-05-09T00:18:32.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-05-09T00:18:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.376+0000 7f7c22d86700 1 -- 172.21.15.26:0/2358399524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 msgr2=0x7f7c1c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.376+0000 7f7c22d86700 1 --2- 172.21.15.26:0/2358399524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 0x7f7c1c0fdcd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f7c100047f0 tx=0x7f7c10009cb0).stop 2024-05-09T00:18:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.376+0000 7f7c22d86700 1 -- 172.21.15.26:0/2358399524 shutdown_connections 2024-05-09T00:18:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.376+0000 7f7c22d86700 1 --2- 172.21.15.26:0/2358399524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c1c0fe250 0x7f7c1c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.376+0000 7f7c22d86700 1 --2- 172.21.15.26:0/2358399524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 0x7f7c1c0fdcd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.376+0000 7f7c22d86700 1 -- 172.21.15.26:0/2358399524 >> 172.21.15.26:0/2358399524 conn(0x7f7c1c0f34d0 msgr2=0x7f7c1c0f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:32.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.376+0000 7f7c22d86700 1 -- 172.21.15.26:0/2358399524 shutdown_connections 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.376+0000 7f7c22d86700 1 -- 172.21.15.26:0/2358399524 wait complete. 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c22d86700 1 Processor -- start 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c22d86700 1 -- start start 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c22d86700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 0x7f7c1c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c22d86700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c1c0fe250 0x7f7c1c1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c22d86700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c110cc0 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c22d86700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c110e00 con 0x7f7c1c0fe250 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c20b22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 0x7f7c1c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c20b22700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 0x7f7c1c1101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55512/0 (socket says 172.21.15.26:55512) 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c20b22700 1 -- 172.21.15.26:0/3523118253 learned_addr learned my addr 172.21.15.26:0/3523118253 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.377+0000 7f7c1bfff700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c1c0fe250 0x7f7c1c1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.378+0000 7f7c20b22700 1 -- 172.21.15.26:0/3523118253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c1c0fe250 msgr2=0x7f7c1c1106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:32.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.378+0000 7f7c20b22700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c1c0fe250 0x7f7c1c1106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.378+0000 7f7c20b22700 1 -- 172.21.15.26:0/3523118253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10005040 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.378+0000 7f7c20b22700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 0x7f7c1c1101d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7c1000b120 tx=0x7f7c10009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:32.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.380+0000 7f7c19ffb700 1 -- 172.21.15.26:0/3523118253 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c1000e030 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.380+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1c10a430 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.380+0000 7f7c19ffb700 1 -- 172.21.15.26:0/3523118253 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c10007e90 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.380+0000 7f7c19ffb700 1 -- 172.21.15.26:0/3523118253 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c10018070 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.380+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1c10a990 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.381+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1c05f360 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.381+0000 7f7c19ffb700 1 -- 172.21.15.26:0/3523118253 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7c1001d420 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.382+0000 7f7c19ffb700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7c0c06caa0 0x7f7c0c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.382+0000 7f7c19ffb700 1 -- 172.21.15.26:0/3523118253 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f7c1008d2a0 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.382+0000 7f7c1bfff700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7c0c06caa0 0x7f7c0c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:32.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.382+0000 7f7c1bfff700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7c0c06caa0 0x7f7c0c06ef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7c1c10bb10 tx=0x7f7c08009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:32.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.386+0000 7f7c19ffb700 1 -- 172.21.15.26:0/3523118253 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f7c1005acf0 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.632+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f7c1c10b8f0 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.633+0000 7f7c19ffb700 1 -- 172.21.15.26:0/3523118253 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v32) v1 ==== 107+0+4832 (secure 0 0 0) 0x7f7c1005a880 con 0x7f7c1c0fd8f0 2024-05-09T00:18:32.633 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:32.633 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:20.116877+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14448":{"gid":14448,"name":"cephfs.smithi026.gbyppy","rank":0,"incarnation":13,"state":"up:rejoin","state_seq":147,"addr":"172.21.15.26:6829/3575480423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3575480423},{"type":"v1","addr":"172.21.15.26:6829","nonce":3575480423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:32.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7c0c06caa0 msgr2=0x7f7c0c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:32.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7c0c06caa0 0x7f7c0c06ef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7c1c10bb10 tx=0x7f7c08009040).stop 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 msgr2=0x7f7c1c1101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 0x7f7c1c1101d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7c1000b120 tx=0x7f7c10009cb0).stop 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 shutdown_connections 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7c0c06caa0 0x7f7c0c06ef60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c1c0fd8f0 0x7f7c1c1101d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 --2- 172.21.15.26:0/3523118253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c1c0fe250 0x7f7c1c1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 >> 172.21.15.26:0/3523118253 conn(0x7f7c1c0f34d0 msgr2=0x7f7c1c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 shutdown_connections 2024-05-09T00:18:32.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.635+0000 7f7c22d86700 1 -- 172.21.15.26:0/3523118253 wait complete. 2024-05-09T00:18:32.637 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 15 2024-05-09T00:18:32.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:32 smithi026 ceph-mon[93667]: pgmap v297: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:32.645 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:32 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3879996343' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 12, "format": "json"}]: dispatch 2024-05-09T00:18:32.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:32 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3837651578' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-05-09T00:18:32.646 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:32 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1889859763' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-05-09T00:18:32.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-05-09T00:18:32.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:32 smithi135 ceph-mon[80466]: pgmap v297: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:32.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:32 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3879996343' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 12, "format": "json"}]: dispatch 2024-05-09T00:18:32.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:32 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3837651578' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-05-09T00:18:32.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:32 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1889859763' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-05-09T00:18:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.768+0000 7fd914f3b700 1 -- 172.21.15.26:0/2864626221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 msgr2=0x7fd9100f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.768+0000 7fd914f3b700 1 --2- 172.21.15.26:0/2864626221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 0x7fd9100f6930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fd8f80047f0 tx=0x7fd8f8009cb0).stop 2024-05-09T00:18:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.768+0000 7fd914f3b700 1 -- 172.21.15.26:0/2864626221 shutdown_connections 2024-05-09T00:18:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.768+0000 7fd914f3b700 1 --2- 172.21.15.26:0/2864626221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 0x7fd9100f6930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.768+0000 7fd914f3b700 1 --2- 172.21.15.26:0/2864626221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9100fc830 0x7fd9100fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.768+0000 7fd914f3b700 1 -- 172.21.15.26:0/2864626221 >> 172.21.15.26:0/2864626221 conn(0x7fd91006c760 msgr2=0x7fd91006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.768+0000 7fd914f3b700 1 -- 172.21.15.26:0/2864626221 shutdown_connections 2024-05-09T00:18:32.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.768+0000 7fd914f3b700 1 -- 172.21.15.26:0/2864626221 wait complete. 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd914f3b700 1 Processor -- start 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd914f3b700 1 -- start start 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd914f3b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9100fc830 0x7fd9100f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd914f3b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 0x7fd9100f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd914f3b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100f8f20 con 0x7fd9100fd100 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd914f3b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100f9060 con 0x7fd9100fc830 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd90dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 0x7fd9100f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd90dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 0x7fd9100f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55526/0 (socket says 172.21.15.26:55526) 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd90dd9b700 1 -- 172.21.15.26:0/1120751986 learned_addr learned my addr 172.21.15.26:0/1120751986 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.769+0000 7fd90e59c700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9100fc830 0x7fd9100f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd90dd9b700 1 -- 172.21.15.26:0/1120751986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9100fc830 msgr2=0x7fd9100f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:32.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd90dd9b700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9100fc830 0x7fd9100f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd90dd9b700 1 -- 172.21.15.26:0/1120751986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8005040 con 0x7fd9100fd100 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd90e59c700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9100fc830 0x7fd9100f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd90dd9b700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 0x7fd9100f8a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fd8f8005010 tx=0x7fd8f8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd9077fe700 1 -- 172.21.15.26:0/1120751986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f800e030 con 0x7fd9100fd100 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd9077fe700 1 -- 172.21.15.26:0/1120751986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd8f8007e90 con 0x7fd9100fd100 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9100f92b0 con 0x7fd9100fd100 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd9077fe700 1 -- 172.21.15.26:0/1120751986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f8018070 con 0x7fd9100fd100 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.770+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9101145d0 con 0x7fd9100fd100 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.771+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91005f380 con 0x7fd9100fd100 2024-05-09T00:18:32.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.771+0000 7fd9077fe700 1 -- 172.21.15.26:0/1120751986 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd8f801d420 con 0x7fd9100fd100 2024-05-09T00:18:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.772+0000 7fd9077fe700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fd8fc06caa0 0x7fd8fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.772+0000 7fd9077fe700 1 -- 172.21.15.26:0/1120751986 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fd8f808d210 con 0x7fd9100fd100 2024-05-09T00:18:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.772+0000 7fd90e59c700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fd8fc06caa0 0x7fd8fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:32.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.772+0000 7fd90e59c700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fd8fc06caa0 0x7fd8fc06ef60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd900009250 tx=0x7fd900009d60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:32.776+0000 7fd9077fe700 1 -- 172.21.15.26:0/1120751986 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fd8f8057290 con 0x7fd9100fd100 2024-05-09T00:18:33.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.022+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fd910114c30 con 0x7fd9100fd100 2024-05-09T00:18:33.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.022+0000 7fd9077fe700 1 -- 172.21.15.26:0/1120751986 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v32) v1 ==== 107+0+4832 (secure 0 0 0) 0x7fd8f805a8b0 con 0x7fd9100fd100 2024-05-09T00:18:33.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:33.022 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:21.122007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14448":{"gid":14448,"name":"cephfs.smithi026.gbyppy","rank":0,"incarnation":13,"state":"up:active","state_seq":148,"addr":"172.21.15.26:6829/3575480423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3575480423},{"type":"v1","addr":"172.21.15.26:6829","nonce":3575480423}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fd8fc06caa0 msgr2=0x7fd8fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fd8fc06caa0 0x7fd8fc06ef60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd900009250 tx=0x7fd900009d60).stop 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 msgr2=0x7fd9100f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 0x7fd9100f8a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fd8f8005010 tx=0x7fd8f8009cb0).stop 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 shutdown_connections 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fd8fc06caa0 0x7fd8fc06ef60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9100fc830 0x7fd9100f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 --2- 172.21.15.26:0/1120751986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9100fd100 0x7fd9100f8a30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 >> 172.21.15.26:0/1120751986 conn(0x7fd91006c760 msgr2=0x7fd910060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 shutdown_connections 2024-05-09T00:18:33.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.025+0000 7fd914f3b700 1 -- 172.21.15.26:0/1120751986 wait complete. 2024-05-09T00:18:33.026 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 16 2024-05-09T00:18:33.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-05-09T00:18:33.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.159+0000 7fadf3d95700 1 -- 172.21.15.26:0/3930374865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f92c0 msgr2=0x7fadec101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.159+0000 7fadf3d95700 1 --2- 172.21.15.26:0/3930374865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f92c0 0x7fadec101a60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fade00047f0 tx=0x7fade0009cb0).stop 2024-05-09T00:18:33.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.159+0000 7fadf3d95700 1 -- 172.21.15.26:0/3930374865 shutdown_connections 2024-05-09T00:18:33.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.159+0000 7fadf3d95700 1 --2- 172.21.15.26:0/3930374865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f92c0 0x7fadec101a60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.159+0000 7fadf3d95700 1 --2- 172.21.15.26:0/3930374865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadec0f89f0 0x7fadec0f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.159+0000 7fadf3d95700 1 -- 172.21.15.26:0/3930374865 >> 172.21.15.26:0/3930374865 conn(0x7fadec06c760 msgr2=0x7fadec06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:33.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.159+0000 7fadf3d95700 1 -- 172.21.15.26:0/3930374865 shutdown_connections 2024-05-09T00:18:33.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.159+0000 7fadf3d95700 1 -- 172.21.15.26:0/3930374865 wait complete. 2024-05-09T00:18:33.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf3d95700 1 Processor -- start 2024-05-09T00:18:33.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf3d95700 1 -- start start 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf3d95700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f89f0 0x7fadec10dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf3d95700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadec0f92c0 0x7fadec10e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf3d95700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec10eac0 con 0x7fadec0f89f0 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf3d95700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec10ec00 con 0x7fadec0f92c0 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf1b31700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f89f0 0x7fadec10dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf1b31700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f89f0 0x7fadec10dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55546/0 (socket says 172.21.15.26:55546) 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf1b31700 1 -- 172.21.15.26:0/2624173135 learned_addr learned my addr 172.21.15.26:0/2624173135 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf1b31700 1 -- 172.21.15.26:0/2624173135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadec0f92c0 msgr2=0x7fadec10e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf1b31700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadec0f92c0 0x7fadec10e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:18:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.160+0000 7fadf1b31700 1 -- 172.21.15.26:0/2624173135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0005040 con 0x7fadec0f89f0 2024-05-09T00:18:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.161+0000 7fadf1b31700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f89f0 0x7fadec10dfd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7faddc00c740 tx=0x7faddc007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.161+0000 7fadeaffd700 1 -- 172.21.15.26:0/2624173135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faddc00e680 con 0x7fadec0f89f0 2024-05-09T00:18:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.161+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec108290 con 0x7fadec0f89f0 2024-05-09T00:18:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.161+0000 7fadeaffd700 1 -- 172.21.15.26:0/2624173135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faddc00ec90 con 0x7fadec0f89f0 2024-05-09T00:18:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.161+0000 7fadeaffd700 1 -- 172.21.15.26:0/2624173135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faddc013d60 con 0x7fadec0f89f0 2024-05-09T00:18:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.161+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec1087d0 con 0x7fadec0f89f0 2024-05-09T00:18:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.162+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec05f380 con 0x7fadec0f89f0 2024-05-09T00:18:33.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.162+0000 7fadeaffd700 1 -- 172.21.15.26:0/2624173135 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faddc00e7e0 con 0x7fadec0f89f0 2024-05-09T00:18:33.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.163+0000 7fadeaffd700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fadd406caa0 0x7fadd406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.163+0000 7fadeaffd700 1 -- 172.21.15.26:0/2624173135 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7faddc08c1b0 con 0x7fadec0f89f0 2024-05-09T00:18:33.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.163+0000 7fadf1330700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fadd406caa0 0x7fadd406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:33.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.163+0000 7fadf1330700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fadd406caa0 0x7fadd406ef60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fadec109910 tx=0x7fade0009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.167+0000 7fadeaffd700 1 -- 172.21.15.26:0/2624173135 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7faddc059c00 con 0x7fadec0f89f0 2024-05-09T00:18:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.417+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fadec0fefa0 con 0x7fadec0f89f0 2024-05-09T00:18:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.418+0000 7fadeaffd700 1 -- 172.21.15.26:0/2624173135 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v32) v1 ==== 107+0+4040 (secure 0 0 0) 0x7faddc059790 con 0x7fadec0f89f0 2024-05-09T00:18:33.418 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:33.418 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:35.034562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fadd406caa0 msgr2=0x7fadd406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fadd406caa0 0x7fadd406ef60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fadec109910 tx=0x7fade0009cb0).stop 2024-05-09T00:18:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f89f0 msgr2=0x7fadec10dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f89f0 0x7fadec10dfd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7faddc00c740 tx=0x7faddc007ef0).stop 2024-05-09T00:18:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 shutdown_connections 2024-05-09T00:18:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fadd406caa0 0x7fadd406ef60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadec0f89f0 0x7fadec10dfd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 --2- 172.21.15.26:0/2624173135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadec0f92c0 0x7fadec10e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-05-09T00:18:33.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 >> 172.21.15.26:0/2624173135 conn(0x7fadec06c760 msgr2=0x7fadec0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:33.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 shutdown_connections 2024-05-09T00:18:33.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.420+0000 7fadf3d95700 1 -- 172.21.15.26:0/2624173135 wait complete. 2024-05-09T00:18:33.421 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 17 2024-05-09T00:18:33.432 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-05-09T00:18:33.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.553+0000 7f233958a700 1 -- 172.21.15.26:0/1315045343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fbfa0 msgr2=0x7f23340fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.553+0000 7f233958a700 1 --2- 172.21.15.26:0/1315045343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fbfa0 0x7f23340fc380 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f23240047f0 tx=0x7f2324009cb0).stop 2024-05-09T00:18:33.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.553+0000 7f233958a700 1 -- 172.21.15.26:0/1315045343 shutdown_connections 2024-05-09T00:18:33.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.553+0000 7f233958a700 1 --2- 172.21.15.26:0/1315045343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23340fc900 0x7f23340f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.553+0000 7f233958a700 1 --2- 172.21.15.26:0/1315045343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fbfa0 0x7f23340fc380 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.553+0000 7f233958a700 1 -- 172.21.15.26:0/1315045343 >> 172.21.15.26:0/1315045343 conn(0x7f233406cea0 msgr2=0x7f233406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:33.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.553+0000 7f233958a700 1 -- 172.21.15.26:0/1315045343 shutdown_connections 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.553+0000 7f233958a700 1 -- 172.21.15.26:0/1315045343 wait complete. 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f233958a700 1 Processor -- start 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f233958a700 1 -- start start 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f233958a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23340fbfa0 0x7f23340fcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f233958a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fc900 0x7f23340fd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f233958a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23340fd960 con 0x7f23340fc900 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f233958a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23340fdaa0 con 0x7f23340fbfa0 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f23327fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fc900 0x7f23340fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f23327fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fc900 0x7f23340fd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55570/0 (socket says 172.21.15.26:55570) 2024-05-09T00:18:33.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.554+0000 7f23327fc700 1 -- 172.21.15.26:0/1116945928 learned_addr learned my addr 172.21.15.26:0/1116945928 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f2332ffd700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23340fbfa0 0x7f23340fcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f23327fc700 1 -- 172.21.15.26:0/1116945928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23340fbfa0 msgr2=0x7f23340fcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f23327fc700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23340fbfa0 0x7f23340fcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f23327fc700 1 -- 172.21.15.26:0/1116945928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324005040 con 0x7f23340fc900 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f2332ffd700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23340fbfa0 0x7f23340fcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f23327fc700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fc900 0x7f23340fd470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2328004850 tx=0x7f232800c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f231bfff700 1 -- 172.21.15.26:0/1116945928 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f232800f040 con 0x7f23340fc900 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f231bfff700 1 -- 172.21.15.26:0/1116945928 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f232800dbf0 con 0x7f23340fc900 2024-05-09T00:18:33.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23340fdd50 con 0x7f23340fc900 2024-05-09T00:18:33.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f231bfff700 1 -- 172.21.15.26:0/1116945928 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2328014bd0 con 0x7f23340fc900 2024-05-09T00:18:33.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.555+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2334114600 con 0x7f23340fc900 2024-05-09T00:18:33.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.556+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233405fb30 con 0x7f23340fc900 2024-05-09T00:18:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.557+0000 7f231bfff700 1 -- 172.21.15.26:0/1116945928 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f232800d740 con 0x7f23340fc900 2024-05-09T00:18:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.557+0000 7f231bfff700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f231c06caa0 0x7f231c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.557+0000 7f231bfff700 1 -- 172.21.15.26:0/1116945928 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f232808c090 con 0x7f23340fc900 2024-05-09T00:18:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.557+0000 7f2332ffd700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f231c06caa0 0x7f231c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:33.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.557+0000 7f2332ffd700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f231c06caa0 0x7f231c06ef60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f23240047c0 tx=0x7f232400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.562+0000 7f231bfff700 1 -- 172.21.15.26:0/1116945928 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f2328056050 con 0x7f23340fc900 2024-05-09T00:18:33.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:33 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3523118253' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-05-09T00:18:33.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:33 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1120751986' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-05-09T00:18:33.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:33 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3523118253' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-05-09T00:18:33.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:33 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1120751986' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-05-09T00:18:33.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.812+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f23341024f0 con 0x7f23340fc900 2024-05-09T00:18:33.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.812+0000 7f231bfff700 1 -- 172.21.15.26:0/1116945928 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v32) v1 ==== 107+0+4052 (secure 0 0 0) 0x7f2328059670 con 0x7f23340fc900 2024-05-09T00:18:33.812 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:33.812 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:35.040966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":0,"incarnation":18,"state":"up:replay","state_seq":1,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.814+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f231c06caa0 msgr2=0x7f231c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.814+0000 7f233958a700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f231c06caa0 0x7f231c06ef60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f23240047c0 tx=0x7f232400b040).stop 2024-05-09T00:18:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.814+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fc900 msgr2=0x7f23340fd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.814+0000 7f233958a700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fc900 0x7f23340fd470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2328004850 tx=0x7f232800c040).stop 2024-05-09T00:18:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.815+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 shutdown_connections 2024-05-09T00:18:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.815+0000 7f233958a700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f231c06caa0 0x7f231c06ef60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.815+0000 7f233958a700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23340fbfa0 0x7f23340fcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.815+0000 7f233958a700 1 --2- 172.21.15.26:0/1116945928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23340fc900 0x7f23340fd470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.815+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 >> 172.21.15.26:0/1116945928 conn(0x7f233406cea0 msgr2=0x7f23340ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:33.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.815+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 shutdown_connections 2024-05-09T00:18:33.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.815+0000 7f233958a700 1 -- 172.21.15.26:0/1116945928 wait complete. 2024-05-09T00:18:33.816 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2024-05-09T00:18:33.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-05-09T00:18:33.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.947+0000 7f602f03b700 1 -- 172.21.15.26:0/3967011563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 msgr2=0x7f60280fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.947+0000 7f602f03b700 1 --2- 172.21.15.26:0/3967011563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 0x7f60280fcc10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f601c0047f0 tx=0x7f601c009cb0).stop 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.947+0000 7f602f03b700 1 -- 172.21.15.26:0/3967011563 shutdown_connections 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.947+0000 7f602f03b700 1 --2- 172.21.15.26:0/3967011563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60280fd100 0x7f60280f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.947+0000 7f602f03b700 1 --2- 172.21.15.26:0/3967011563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 0x7f60280fcc10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.947+0000 7f602f03b700 1 -- 172.21.15.26:0/3967011563 >> 172.21.15.26:0/3967011563 conn(0x7f602806c760 msgr2=0x7f602806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.947+0000 7f602f03b700 1 -- 172.21.15.26:0/3967011563 shutdown_connections 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.947+0000 7f602f03b700 1 -- 172.21.15.26:0/3967011563 wait complete. 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602f03b700 1 Processor -- start 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602f03b700 1 -- start start 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602f03b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 0x7f602810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602f03b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60280fd100 0x7f602810e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602f03b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602810ea60 con 0x7f60280fc830 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602f03b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602810eba0 con 0x7f60280fd100 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602cdd7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 0x7f602810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602cdd7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 0x7f602810df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55590/0 (socket says 172.21.15.26:55590) 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f602cdd7700 1 -- 172.21.15.26:0/1736100196 learned_addr learned my addr 172.21.15.26:0/1736100196 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.948+0000 7f6027fff700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60280fd100 0x7f602810e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f602cdd7700 1 -- 172.21.15.26:0/1736100196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60280fd100 msgr2=0x7f602810e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f602cdd7700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60280fd100 0x7f602810e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f602cdd7700 1 -- 172.21.15.26:0/1736100196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c005040 con 0x7f60280fc830 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f6027fff700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60280fd100 0x7f602810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f602cdd7700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 0x7f602810df70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f601c005010 tx=0x7f601c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f6025ffb700 1 -- 172.21.15.26:0/1736100196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601c00e030 con 0x7f60280fc830 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f6025ffb700 1 -- 172.21.15.26:0/1736100196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f601c007e90 con 0x7f60280fc830 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60281081d0 con 0x7f60280fc830 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f6025ffb700 1 -- 172.21.15.26:0/1736100196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601c018070 con 0x7f60280fc830 2024-05-09T00:18:33.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.949+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6028108730 con 0x7f60280fc830 2024-05-09T00:18:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.950+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602805f380 con 0x7f60280fc830 2024-05-09T00:18:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.950+0000 7f6025ffb700 1 -- 172.21.15.26:0/1736100196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f601c01d420 con 0x7f60280fc830 2024-05-09T00:18:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.951+0000 7f6025ffb700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f601806ca30 0x7f601806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.951+0000 7f6025ffb700 1 -- 172.21.15.26:0/1736100196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f601c08d2d0 con 0x7f60280fc830 2024-05-09T00:18:33.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.951+0000 7f6027fff700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f601806ca30 0x7f601806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:33.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.951+0000 7f6027fff700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f601806ca30 0x7f601806eef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f60281098b0 tx=0x7f6014009d60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:33.955+0000 7f6025ffb700 1 -- 172.21.15.26:0/1736100196 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f601c05ad20 con 0x7f60280fc830 2024-05-09T00:18:34.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.202+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f6028108dc0 con 0x7f60280fc830 2024-05-09T00:18:34.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.202+0000 7f6025ffb700 1 -- 172.21.15.26:0/1736100196 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v32) v1 ==== 107+0+4833 (secure 0 0 0) 0x7f601c05a8b0 con 0x7f60280fc830 2024-05-09T00:18:34.202 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:34.202 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:44.088927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":153,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:34.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.204+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f601806ca30 msgr2=0x7f601806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.204+0000 7f602f03b700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f601806ca30 0x7f601806eef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f60281098b0 tx=0x7f6014009d60).stop 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.204+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 msgr2=0x7f602810df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.204+0000 7f602f03b700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 0x7f602810df70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f601c005010 tx=0x7f601c009cb0).stop 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.205+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 shutdown_connections 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.205+0000 7f602f03b700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f601806ca30 0x7f601806eef0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.205+0000 7f602f03b700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60280fc830 0x7f602810df70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.205+0000 7f602f03b700 1 --2- 172.21.15.26:0/1736100196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60280fd100 0x7f602810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.205+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 >> 172.21.15.26:0/1736100196 conn(0x7f602806c760 msgr2=0x7f6028060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.205+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 shutdown_connections 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.205+0000 7f602f03b700 1 -- 172.21.15.26:0/1736100196 wait complete. 2024-05-09T00:18:34.205 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-05-09T00:18:34.217 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-05-09T00:18:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.337+0000 7fa1f1375700 1 -- 172.21.15.26:0/1903397173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fe1d0 msgr2=0x7fa1ec0f5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.337+0000 7fa1f1375700 1 --2- 172.21.15.26:0/1903397173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fe1d0 0x7fa1ec0f5f40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fa1dc0047f0 tx=0x7fa1dc009cb0).stop 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.338+0000 7fa1f1375700 1 -- 172.21.15.26:0/1903397173 shutdown_connections 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.338+0000 7fa1f1375700 1 --2- 172.21.15.26:0/1903397173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fe1d0 0x7fa1ec0f5f40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.338+0000 7fa1f1375700 1 --2- 172.21.15.26:0/1903397173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ec0fd870 0x7fa1ec0fdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.338+0000 7fa1f1375700 1 -- 172.21.15.26:0/1903397173 >> 172.21.15.26:0/1903397173 conn(0x7fa1ec06bdc0 msgr2=0x7fa1ec06c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.338+0000 7fa1f1375700 1 -- 172.21.15.26:0/1903397173 shutdown_connections 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.338+0000 7fa1f1375700 1 -- 172.21.15.26:0/1903397173 wait complete. 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.338+0000 7fa1f1375700 1 Processor -- start 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.338+0000 7fa1f1375700 1 -- start start 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1f1375700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fd870 0x7fa1ec0f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1f1375700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ec0fe1d0 0x7fa1ec0f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1f1375700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0f7bf0 con 0x7fa1ec0fd870 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1f1375700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0f7d30 con 0x7fa1ec0fe1d0 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fd870 0x7fa1ec0f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fd870 0x7fa1ec0f7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55620/0 (socket says 172.21.15.26:55620) 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1eaffd700 1 -- 172.21.15.26:0/3203633836 learned_addr learned my addr 172.21.15.26:0/3203633836 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1ea7fc700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ec0fe1d0 0x7fa1ec0f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1eaffd700 1 -- 172.21.15.26:0/3203633836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ec0fe1d0 msgr2=0x7fa1ec0f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1eaffd700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ec0fe1d0 0x7fa1ec0f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1eaffd700 1 -- 172.21.15.26:0/3203633836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc005040 con 0x7fa1ec0fd870 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1eaffd700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fd870 0x7fa1ec0f7210 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fa1e00041d0 tx=0x7fa1e0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1d3fff700 1 -- 172.21.15.26:0/3203633836 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e0002d90 con 0x7fa1ec0fd870 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1d3fff700 1 -- 172.21.15.26:0/3203633836 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa1e000f040 con 0x7fa1ec0fd870 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ec0f7fe0 con 0x7fa1ec0fd870 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1d3fff700 1 -- 172.21.15.26:0/3203633836 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e000d800 con 0x7fa1ec0fd870 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.339+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec114640 con 0x7fa1ec0fd870 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.340+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ec05fb30 con 0x7fa1ec0fd870 2024-05-09T00:18:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.341+0000 7fa1d3fff700 1 -- 172.21.15.26:0/3203633836 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa1e000dac0 con 0x7fa1ec0fd870 2024-05-09T00:18:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.341+0000 7fa1d3fff700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa1d406caa0 0x7fa1d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.341+0000 7fa1d3fff700 1 -- 172.21.15.26:0/3203633836 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fa1e008bfc0 con 0x7fa1ec0fd870 2024-05-09T00:18:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.341+0000 7fa1ea7fc700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa1d406caa0 0x7fa1d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.342+0000 7fa1ea7fc700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa1d406caa0 0x7fa1d406ef60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fa1dc004f10 tx=0x7fa1dc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.346+0000 7fa1d3fff700 1 -- 172.21.15.26:0/3203633836 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fa1e00bf570 con 0x7fa1ec0fd870 2024-05-09T00:18:34.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.593+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fa1ec104640 con 0x7fa1ec0fd870 2024-05-09T00:18:34.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.594+0000 7fa1d3fff700 1 -- 172.21.15.26:0/3203633836 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v32) v1 ==== 107+0+4830 (secure 0 0 0) 0x7fa1e0055ec0 con 0x7fa1ec0fd870 2024-05-09T00:18:34.599 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:34.600 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:45.090365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":154,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa1d406caa0 msgr2=0x7fa1d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa1d406caa0 0x7fa1d406ef60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fa1dc004f10 tx=0x7fa1dc00b040).stop 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fd870 msgr2=0x7fa1ec0f7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fd870 0x7fa1ec0f7210 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fa1e00041d0 tx=0x7fa1e0009f60).stop 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 shutdown_connections 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa1d406caa0 0x7fa1d406ef60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1ec0fd870 0x7fa1ec0f7210 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 --2- 172.21.15.26:0/3203633836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1ec0fe1d0 0x7fa1ec0f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 >> 172.21.15.26:0/3203633836 conn(0x7fa1ec06bdc0 msgr2=0x7fa1ec100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 shutdown_connections 2024-05-09T00:18:34.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.596+0000 7fa1f1375700 1 -- 172.21.15.26:0/3203633836 wait complete. 2024-05-09T00:18:34.603 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 20 2024-05-09T00:18:34.608 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:34 smithi026 ceph-mon[93667]: pgmap v298: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:34.608 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:34 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2624173135' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-05-09T00:18:34.608 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:34 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1116945928' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-05-09T00:18:34.608 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:34 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1736100196' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-05-09T00:18:34.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-05-09T00:18:34.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:34 smithi135 ceph-mon[80466]: pgmap v298: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:34.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:34 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2624173135' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-05-09T00:18:34.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:34 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1116945928' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-05-09T00:18:34.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:34 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1736100196' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-05-09T00:18:34.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 -- 172.21.15.26:0/3133783468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 msgr2=0x7fbe040f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 --2- 172.21.15.26:0/3133783468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 0x7fbe040f8dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fbdf40047f0 tx=0x7fbdf4009cb0).stop 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 -- 172.21.15.26:0/3133783468 shutdown_connections 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 --2- 172.21.15.26:0/3133783468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe040f92c0 0x7fbe04101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 --2- 172.21.15.26:0/3133783468 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 0x7fbe040f8dd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 -- 172.21.15.26:0/3133783468 >> 172.21.15.26:0/3133783468 conn(0x7fbe0406c760 msgr2=0x7fbe0406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 -- 172.21.15.26:0/3133783468 shutdown_connections 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 -- 172.21.15.26:0/3133783468 wait complete. 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.741+0000 7fbe0be0c700 1 Processor -- start 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe0be0c700 1 -- start start 2024-05-09T00:18:36.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe0be0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 0x7fbe0410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe0be0c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe040f92c0 0x7fbe0410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe0be0c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0410eae0 con 0x7fbe040f89f0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe0be0c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0410ec20 con 0x7fbe040f92c0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe09ba8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 0x7fbe0410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe09ba8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 0x7fbe0410dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55632/0 (socket says 172.21.15.26:55632) 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe09ba8700 1 -- 172.21.15.26:0/1060806813 learned_addr learned my addr 172.21.15.26:0/1060806813 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe093a7700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe040f92c0 0x7fbe0410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe09ba8700 1 -- 172.21.15.26:0/1060806813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe040f92c0 msgr2=0x7fbe0410e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe09ba8700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe040f92c0 0x7fbe0410e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe09ba8700 1 -- 172.21.15.26:0/1060806813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4005040 con 0x7fbe040f89f0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbe09ba8700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 0x7fbe0410dff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fbdf4009310 tx=0x7fbdf4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbdfaffd700 1 -- 172.21.15.26:0/1060806813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf400e030 con 0x7fbe040f89f0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.742+0000 7fbdfaffd700 1 -- 172.21.15.26:0/1060806813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbdf4007e90 con 0x7fbe040f89f0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.743+0000 7fbdfaffd700 1 -- 172.21.15.26:0/1060806813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf4018070 con 0x7fbe040f89f0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.743+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe041082b0 con 0x7fbe040f89f0 2024-05-09T00:18:36.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.743+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe041087f0 con 0x7fbe040f89f0 2024-05-09T00:18:36.138 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:35 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3203633836' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-05-09T00:18:36.138 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:35 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1060806813' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-05-09T00:18:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.744+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0405f380 con 0x7fbe040f89f0 2024-05-09T00:18:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.744+0000 7fbdfaffd700 1 -- 172.21.15.26:0/1060806813 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbdf401d420 con 0x7fbe040f89f0 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.744+0000 7fbdfaffd700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbdf006caa0 0x7fbdf006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.744+0000 7fbdfaffd700 1 -- 172.21.15.26:0/1060806813 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fbdf408d380 con 0x7fbe040f89f0 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.744+0000 7fbe093a7700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbdf006caa0 0x7fbdf006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.745+0000 7fbe093a7700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbdf006caa0 0x7fbdf006ef60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fbe04109930 tx=0x7fbe00009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.749+0000 7fbdfaffd700 1 -- 172.21.15.26:0/1060806813 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fbdf405add0 con 0x7fbe040f89f0 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.994+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fbe04109770 con 0x7fbe040f89f0 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.994+0000 7fbdfaffd700 1 -- 172.21.15.26:0/1060806813 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v32) v1 ==== 107+0+4830 (secure 0 0 0) 0x7fbdf405a960 con 0x7fbe040f89f0 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:36.140 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:46.091517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.lzxgvd","rank":0,"incarnation":18,"state":"up:active","state_seq":155,"addr":"172.21.15.135:6825/1248766098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1248766098},{"type":"v1","addr":"172.21.15.135:6825","nonce":1248766098}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.996+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbdf006caa0 msgr2=0x7fbdf006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.996+0000 7fbe0be0c700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbdf006caa0 0x7fbdf006ef60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fbe04109930 tx=0x7fbe00009040).stop 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.996+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 msgr2=0x7fbe0410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.996+0000 7fbe0be0c700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 0x7fbe0410dff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fbdf4009310 tx=0x7fbdf4009cb0).stop 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.996+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 shutdown_connections 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.996+0000 7fbe0be0c700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbdf006caa0 0x7fbdf006ef60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.996+0000 7fbe0be0c700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe040f89f0 0x7fbe0410dff0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.996+0000 7fbe0be0c700 1 --2- 172.21.15.26:0/1060806813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe040f92c0 0x7fbe0410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.997+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 >> 172.21.15.26:0/1060806813 conn(0x7fbe0406c760 msgr2=0x7fbe040fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.997+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 shutdown_connections 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:34.997+0000 7fbe0be0c700 1 -- 172.21.15.26:0/1060806813 wait complete. 2024-05-09T00:18:36.142 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 21 2024-05-09T00:18:36.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-05-09T00:18:36.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:35 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3203633836' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-05-09T00:18:36.143 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:35 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1060806813' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-05-09T00:18:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.279+0000 7fa2c35fb700 1 -- 172.21.15.26:0/242708022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fc830 msgr2=0x7fa2bc0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.279+0000 7fa2c35fb700 1 --2- 172.21.15.26:0/242708022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fc830 0x7fa2bc0fcc10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fa2b80047f0 tx=0x7fa2b8009cb0).stop 2024-05-09T00:18:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.279+0000 7fa2c35fb700 1 -- 172.21.15.26:0/242708022 shutdown_connections 2024-05-09T00:18:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.279+0000 7fa2c35fb700 1 --2- 172.21.15.26:0/242708022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc0fd100 0x7fa2bc0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.279+0000 7fa2c35fb700 1 --2- 172.21.15.26:0/242708022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fc830 0x7fa2bc0fcc10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.279+0000 7fa2c35fb700 1 -- 172.21.15.26:0/242708022 >> 172.21.15.26:0/242708022 conn(0x7fa2bc06c760 msgr2=0x7fa2bc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.279+0000 7fa2c35fb700 1 -- 172.21.15.26:0/242708022 shutdown_connections 2024-05-09T00:18:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.279+0000 7fa2c35fb700 1 -- 172.21.15.26:0/242708022 wait complete. 2024-05-09T00:18:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c35fb700 1 Processor -- start 2024-05-09T00:18:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c35fb700 1 -- start start 2024-05-09T00:18:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c35fb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc0fc830 0x7fa2bc109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c35fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fd100 0x7fa2bc109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c35fb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc109b40 con 0x7fa2bc0fd100 2024-05-09T00:18:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c35fb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc109c80 con 0x7fa2bc0fc830 2024-05-09T00:18:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c0b96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fd100 0x7fa2bc109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c0b96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fd100 0x7fa2bc109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55654/0 (socket says 172.21.15.26:55654) 2024-05-09T00:18:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.280+0000 7fa2c0b96700 1 -- 172.21.15.26:0/972247247 learned_addr learned my addr 172.21.15.26:0/972247247 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2c1397700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc0fc830 0x7fa2bc109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2c0b96700 1 -- 172.21.15.26:0/972247247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc0fc830 msgr2=0x7fa2bc109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2c0b96700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc0fc830 0x7fa2bc109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2c0b96700 1 -- 172.21.15.26:0/972247247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8005040 con 0x7fa2bc0fd100 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2c0b96700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fd100 0x7fa2bc109650 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fa2ac00e8f0 tx=0x7fa2ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2b27fc700 1 -- 172.21.15.26:0/972247247 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2ac00ee90 con 0x7fa2bc0fd100 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2b27fc700 1 -- 172.21.15.26:0/972247247 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2ac00f040 con 0x7fa2bc0fd100 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc109f30 con 0x7fa2bc0fd100 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2b27fc700 1 -- 172.21.15.26:0/972247247 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2ac00c8a0 con 0x7fa2bc0fd100 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.281+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc112550 con 0x7fa2bc0fd100 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.282+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc05f380 con 0x7fa2bc0fd100 2024-05-09T00:18:36.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.283+0000 7fa2b27fc700 1 -- 172.21.15.26:0/972247247 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa2ac007b40 con 0x7fa2bc0fd100 2024-05-09T00:18:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.283+0000 7fa2b27fc700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa2a806cab0 0x7fa2a806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.283+0000 7fa2b27fc700 1 -- 172.21.15.26:0/972247247 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fa2ac08ba90 con 0x7fa2bc0fd100 2024-05-09T00:18:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.283+0000 7fa2c1397700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa2a806cab0 0x7fa2a806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.283+0000 7fa2c1397700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa2a806cab0 0x7fa2a806ef70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fa2b8009ee0 tx=0x7fa2b800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:36.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.287+0000 7fa2b27fc700 1 -- 172.21.15.26:0/972247247 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fa2ac055a50 con 0x7fa2bc0fd100 2024-05-09T00:18:36.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.535+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fa2bc0f9960 con 0x7fa2bc0fd100 2024-05-09T00:18:36.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.536+0000 7fa2b27fc700 1 -- 172.21.15.26:0/972247247 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v32) v1 ==== 107+0+4035 (secure 0 0 0) 0x7fa2ac059070 con 0x7fa2bc0fd100 2024-05-09T00:18:36.536 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:36.536 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:55.001075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa2a806cab0 msgr2=0x7fa2a806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa2a806cab0 0x7fa2a806ef70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fa2b8009ee0 tx=0x7fa2b800b040).stop 2024-05-09T00:18:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fd100 msgr2=0x7fa2bc109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fd100 0x7fa2bc109650 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fa2ac00e8f0 tx=0x7fa2ac00b040).stop 2024-05-09T00:18:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 shutdown_connections 2024-05-09T00:18:36.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa2a806cab0 0x7fa2a806ef70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2bc0fc830 0x7fa2bc109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 --2- 172.21.15.26:0/972247247 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc0fd100 0x7fa2bc109650 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 >> 172.21.15.26:0/972247247 conn(0x7fa2bc06c760 msgr2=0x7fa2bc0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 shutdown_connections 2024-05-09T00:18:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.538+0000 7fa2c35fb700 1 -- 172.21.15.26:0/972247247 wait complete. 2024-05-09T00:18:36.539 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 22 2024-05-09T00:18:36.549 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:36 smithi026 ceph-mon[93667]: pgmap v299: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:36.549 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:36 smithi026 ceph-mon[93667]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:18:36.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-05-09T00:18:36.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:36 smithi135 ceph-mon[80466]: pgmap v299: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:36.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:36 smithi135 ceph-mon[80466]: from='mgr.34102 172.21.15.26:0/2838723835' entity='mgr.smithi026.brymfp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T00:18:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.671+0000 7fdb1ad41700 1 -- 172.21.15.26:0/1837219376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 msgr2=0x7fdb140f8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.671+0000 7fdb1ad41700 1 --2- 172.21.15.26:0/1837219376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 0x7fdb140f8e70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fdb080047f0 tx=0x7fdb08009cb0).stop 2024-05-09T00:18:36.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 -- 172.21.15.26:0/1837219376 shutdown_connections 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 --2- 172.21.15.26:0/1837219376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb140f93f0 0x7fdb14101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 --2- 172.21.15.26:0/1837219376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 0x7fdb140f8e70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 -- 172.21.15.26:0/1837219376 >> 172.21.15.26:0/1837219376 conn(0x7fdb140f2580 msgr2=0x7fdb140f49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 -- 172.21.15.26:0/1837219376 shutdown_connections 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 -- 172.21.15.26:0/1837219376 wait complete. 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 Processor -- start 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 -- start start 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 0x7fdb1410e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb140f93f0 0x7fdb1410e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1410ee30 con 0x7fdb140f8a90 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.672+0000 7fdb1ad41700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1410ef70 con 0x7fdb140f93f0 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb18add700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 0x7fdb1410e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb18add700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 0x7fdb1410e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55684/0 (socket says 172.21.15.26:55684) 2024-05-09T00:18:36.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb18add700 1 -- 172.21.15.26:0/2649520986 learned_addr learned my addr 172.21.15.26:0/2649520986 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb13fff700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb140f93f0 0x7fdb1410e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb18add700 1 -- 172.21.15.26:0/2649520986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb140f93f0 msgr2=0x7fdb1410e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb18add700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb140f93f0 0x7fdb1410e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb18add700 1 -- 172.21.15.26:0/2649520986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08005040 con 0x7fdb140f8a90 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb13fff700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb140f93f0 0x7fdb1410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb18add700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 0x7fdb1410e340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fdb0800b120 tx=0x7fdb08009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb11ffb700 1 -- 172.21.15.26:0/2649520986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0800e030 con 0x7fdb140f8a90 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb11ffb700 1 -- 172.21.15.26:0/2649520986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb08007e90 con 0x7fdb140f8a90 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb141085a0 con 0x7fdb140f8a90 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb11ffb700 1 -- 172.21.15.26:0/2649520986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb08018070 con 0x7fdb140f8a90 2024-05-09T00:18:36.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.673+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb14108a80 con 0x7fdb140f8a90 2024-05-09T00:18:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.674+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb140603f0 con 0x7fdb140f8a90 2024-05-09T00:18:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.675+0000 7fdb11ffb700 1 -- 172.21.15.26:0/2649520986 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdb0801d420 con 0x7fdb140f8a90 2024-05-09T00:18:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.675+0000 7fdb11ffb700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdb0406caa0 0x7fdb0406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.675+0000 7fdb11ffb700 1 -- 172.21.15.26:0/2649520986 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fdb0808d420 con 0x7fdb140f8a90 2024-05-09T00:18:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.675+0000 7fdb13fff700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdb0406caa0 0x7fdb0406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:36.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.676+0000 7fdb13fff700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdb0406caa0 0x7fdb0406ef60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdb14109c80 tx=0x7fdb00009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:36.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.680+0000 7fdb11ffb700 1 -- 172.21.15.26:0/2649520986 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fdb0805adb0 con 0x7fdb140f8a90 2024-05-09T00:18:36.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.927+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fdb1405f0f0 con 0x7fdb140f8a90 2024-05-09T00:18:36.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.927+0000 7fdb11ffb700 1 -- 172.21.15.26:0/2649520986 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v32) v1 ==== 107+0+4046 (secure 0 0 0) 0x7fdb0805a940 con 0x7fdb140f8a90 2024-05-09T00:18:36.927 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:36.927 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:14:55.008761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":0,"incarnation":23,"state":"up:replay","state_seq":1,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:36.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.929+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdb0406caa0 msgr2=0x7fdb0406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.929+0000 7fdb1ad41700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdb0406caa0 0x7fdb0406ef60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdb14109c80 tx=0x7fdb00009040).stop 2024-05-09T00:18:36.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.929+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 msgr2=0x7fdb1410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.929+0000 7fdb1ad41700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 0x7fdb1410e340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fdb0800b120 tx=0x7fdb08009cb0).stop 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.929+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 shutdown_connections 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.929+0000 7fdb1ad41700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdb0406caa0 0x7fdb0406ef60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.929+0000 7fdb1ad41700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb140f8a90 0x7fdb1410e340 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.929+0000 7fdb1ad41700 1 --2- 172.21.15.26:0/2649520986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb140f93f0 0x7fdb1410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.930+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 >> 172.21.15.26:0/2649520986 conn(0x7fdb140f2580 msgr2=0x7fdb140ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.930+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 shutdown_connections 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:36.930+0000 7fdb1ad41700 1 -- 172.21.15.26:0/2649520986 wait complete. 2024-05-09T00:18:36.930 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2024-05-09T00:18:36.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-05-09T00:18:37.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 -- 172.21.15.26:0/3228165222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 msgr2=0x7f6c000f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 --2- 172.21.15.26:0/3228165222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 0x7f6c000f6930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f6bf00047f0 tx=0x7f6bf0009cb0).stop 2024-05-09T00:18:37.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 -- 172.21.15.26:0/3228165222 shutdown_connections 2024-05-09T00:18:37.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 --2- 172.21.15.26:0/3228165222 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 0x7f6c000f6930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 --2- 172.21.15.26:0/3228165222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000fc830 0x7f6c000fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 -- 172.21.15.26:0/3228165222 >> 172.21.15.26:0/3228165222 conn(0x7f6c0006c760 msgr2=0x7f6c0006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:37.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 -- 172.21.15.26:0/3228165222 shutdown_connections 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 -- 172.21.15.26:0/3228165222 wait complete. 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.063+0000 7f6c05296700 1 Processor -- start 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6c05296700 1 -- start start 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6c05296700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000fc830 0x7f6c0010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6c05296700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 0x7f6c0010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6c05296700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0010eab0 con 0x7f6c000fd100 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6c05296700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0010ebf0 con 0x7f6c000fc830 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 0x7f6c0010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfe7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 0x7f6c0010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55710/0 (socket says 172.21.15.26:55710) 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfe7fc700 1 -- 172.21.15.26:0/3673713507 learned_addr learned my addr 172.21.15.26:0/3673713507 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfeffd700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000fc830 0x7f6c0010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfe7fc700 1 -- 172.21.15.26:0/3673713507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000fc830 msgr2=0x7f6c0010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfe7fc700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000fc830 0x7f6c0010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfe7fc700 1 -- 172.21.15.26:0/3673713507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0005040 con 0x7f6c000fd100 2024-05-09T00:18:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfeffd700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000fc830 0x7f6c0010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6bfe7fc700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 0x7f6c0010e4b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f6bf0005010 tx=0x7f6bf0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6be7fff700 1 -- 172.21.15.26:0/3673713507 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf000e030 con 0x7f6c000fd100 2024-05-09T00:18:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.064+0000 7f6be7fff700 1 -- 172.21.15.26:0/3673713507 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bf0007e90 con 0x7f6c000fd100 2024-05-09T00:18:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.065+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c00108220 con 0x7f6c000fd100 2024-05-09T00:18:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.065+0000 7f6be7fff700 1 -- 172.21.15.26:0/3673713507 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf0018070 con 0x7f6c000fd100 2024-05-09T00:18:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.065+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c00108780 con 0x7f6c000fd100 2024-05-09T00:18:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.066+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0005f380 con 0x7f6c000fd100 2024-05-09T00:18:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.066+0000 7f6be7fff700 1 -- 172.21.15.26:0/3673713507 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6bf001d420 con 0x7f6c000fd100 2024-05-09T00:18:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.067+0000 7f6be7fff700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806ca30 0x7f6be806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.067+0000 7f6bfeffd700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806ca30 0x7f6be806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.067+0000 7f6be7fff700 1 -- 172.21.15.26:0/3673713507 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f6bf008d2d0 con 0x7f6c000fd100 2024-05-09T00:18:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.067+0000 7f6bfeffd700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806ca30 0x7f6be806eef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f6bf4004c80 tx=0x7f6bf400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.071+0000 7f6be7fff700 1 -- 172.21.15.26:0/3673713507 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f6bf005ad20 con 0x7f6c000fd100 2024-05-09T00:18:37.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.314+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f6c0005eec0 con 0x7f6c000fd100 2024-05-09T00:18:37.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.314+0000 7f6be7fff700 1 -- 172.21.15.26:0/3673713507 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v32) v1 ==== 107+0+4051 (secure 0 0 0) 0x7f6bf005a8b0 con 0x7f6c000fd100 2024-05-09T00:18:37.315 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:37.316 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:05.211594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":157,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:37.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806ca30 msgr2=0x7f6be806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806ca30 0x7f6be806eef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f6bf4004c80 tx=0x7f6bf400b040).stop 2024-05-09T00:18:37.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 msgr2=0x7f6c0010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 0x7f6c0010e4b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f6bf0005010 tx=0x7f6bf0009cb0).stop 2024-05-09T00:18:37.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 shutdown_connections 2024-05-09T00:18:37.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6be806ca30 0x7f6be806eef0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c000fc830 0x7f6c0010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 --2- 172.21.15.26:0/3673713507 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c000fd100 0x7f6c0010e4b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 >> 172.21.15.26:0/3673713507 conn(0x7f6c0006c760 msgr2=0x7f6c00060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:37.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 shutdown_connections 2024-05-09T00:18:37.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.317+0000 7f6c05296700 1 -- 172.21.15.26:0/3673713507 wait complete. 2024-05-09T00:18:37.319 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 24 2024-05-09T00:18:37.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-05-09T00:18:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.451+0000 7fdd59de7700 1 -- 172.21.15.26:0/1496207799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 msgr2=0x7fdd540fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.451+0000 7fdd59de7700 1 --2- 172.21.15.26:0/1496207799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 0x7fdd540fcb50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fdd440047f0 tx=0x7fdd44009cb0).stop 2024-05-09T00:18:37.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.451+0000 7fdd59de7700 1 -- 172.21.15.26:0/1496207799 shutdown_connections 2024-05-09T00:18:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.451+0000 7fdd59de7700 1 --2- 172.21.15.26:0/1496207799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd540fd0d0 0x7fdd540f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.451+0000 7fdd59de7700 1 --2- 172.21.15.26:0/1496207799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 0x7fdd540fcb50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.451+0000 7fdd59de7700 1 -- 172.21.15.26:0/1496207799 >> 172.21.15.26:0/1496207799 conn(0x7fdd5406c6c0 msgr2=0x7fdd5406cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:37.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.451+0000 7fdd59de7700 1 -- 172.21.15.26:0/1496207799 shutdown_connections 2024-05-09T00:18:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.451+0000 7fdd59de7700 1 -- 172.21.15.26:0/1496207799 wait complete. 2024-05-09T00:18:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.452+0000 7fdd59de7700 1 Processor -- start 2024-05-09T00:18:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.452+0000 7fdd59de7700 1 -- start start 2024-05-09T00:18:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.452+0000 7fdd59de7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 0x7fdd5410df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.452+0000 7fdd59de7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd540fd0d0 0x7fdd5410e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.452+0000 7fdd59de7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5410ea50 con 0x7fdd540fc770 2024-05-09T00:18:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.452+0000 7fdd59de7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5410eb90 con 0x7fdd540fd0d0 2024-05-09T00:18:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.452+0000 7fdd537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 0x7fdd5410df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 0x7fdd5410df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55726/0 (socket says 172.21.15.26:55726) 2024-05-09T00:18:37.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd537fe700 1 -- 172.21.15.26:0/3222266113 learned_addr learned my addr 172.21.15.26:0/3222266113 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd52ffd700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd540fd0d0 0x7fdd5410e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd537fe700 1 -- 172.21.15.26:0/3222266113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd540fd0d0 msgr2=0x7fdd5410e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd537fe700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd540fd0d0 0x7fdd5410e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd537fe700 1 -- 172.21.15.26:0/3222266113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44005040 con 0x7fdd540fc770 2024-05-09T00:18:37.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd537fe700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 0x7fdd5410df60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fdd4400b120 tx=0x7fdd44009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd50ff9700 1 -- 172.21.15.26:0/3222266113 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd4400e030 con 0x7fdd540fc770 2024-05-09T00:18:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd50ff9700 1 -- 172.21.15.26:0/3222266113 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd44007e90 con 0x7fdd540fc770 2024-05-09T00:18:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd541081c0 con 0x7fdd540fc770 2024-05-09T00:18:37.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd50ff9700 1 -- 172.21.15.26:0/3222266113 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd44018070 con 0x7fdd540fc770 2024-05-09T00:18:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.453+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd54108720 con 0x7fdd540fc770 2024-05-09T00:18:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.454+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5405f380 con 0x7fdd540fc770 2024-05-09T00:18:37.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.454+0000 7fdd50ff9700 1 -- 172.21.15.26:0/3222266113 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdd4401d420 con 0x7fdd540fc770 2024-05-09T00:18:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.455+0000 7fdd50ff9700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdd3c06caa0 0x7fdd3c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.455+0000 7fdd50ff9700 1 -- 172.21.15.26:0/3222266113 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fdd4408d360 con 0x7fdd540fc770 2024-05-09T00:18:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.455+0000 7fdd52ffd700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdd3c06caa0 0x7fdd3c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.455+0000 7fdd52ffd700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdd3c06caa0 0x7fdd3c06ef60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fdd541098a0 tx=0x7fdd48009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.459+0000 7fdd50ff9700 1 -- 172.21.15.26:0/3222266113 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fdd4405adb0 con 0x7fdd540fc770 2024-05-09T00:18:37.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:37 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/972247247' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-05-09T00:18:37.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:37 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2649520986' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-05-09T00:18:37.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:37 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3673713507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-05-09T00:18:37.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:37 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/972247247' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-05-09T00:18:37.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:37 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2649520986' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-05-09T00:18:37.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:37 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3673713507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-05-09T00:18:37.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.702+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fdd541096e0 con 0x7fdd540fc770 2024-05-09T00:18:37.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.703+0000 7fdd50ff9700 1 -- 172.21.15.26:0/3222266113 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v32) v1 ==== 107+0+4048 (secure 0 0 0) 0x7fdd4405a940 con 0x7fdd540fc770 2024-05-09T00:18:37.705 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:37.705 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:06.216024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":158,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:37.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdd3c06caa0 msgr2=0x7fdd3c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdd3c06caa0 0x7fdd3c06ef60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fdd541098a0 tx=0x7fdd48009040).stop 2024-05-09T00:18:37.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 msgr2=0x7fdd5410df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 0x7fdd5410df60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fdd4400b120 tx=0x7fdd44009cb0).stop 2024-05-09T00:18:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 shutdown_connections 2024-05-09T00:18:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdd3c06caa0 0x7fdd3c06ef60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd540fc770 0x7fdd5410df60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 --2- 172.21.15.26:0/3222266113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd540fd0d0 0x7fdd5410e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 >> 172.21.15.26:0/3222266113 conn(0x7fdd5406c6c0 msgr2=0x7fdd54060d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:37.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 shutdown_connections 2024-05-09T00:18:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.705+0000 7fdd59de7700 1 -- 172.21.15.26:0/3222266113 wait complete. 2024-05-09T00:18:37.709 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 25 2024-05-09T00:18:37.717 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-05-09T00:18:37.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.839+0000 7f5fc21dd700 1 -- 172.21.15.26:0/2739046550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fc830 msgr2=0x7f5fbc0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.839+0000 7f5fc21dd700 1 --2- 172.21.15.26:0/2739046550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fc830 0x7f5fbc0fcc10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f5fac0047f0 tx=0x7f5fac009cb0).stop 2024-05-09T00:18:37.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.839+0000 7f5fc21dd700 1 -- 172.21.15.26:0/2739046550 shutdown_connections 2024-05-09T00:18:37.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.839+0000 7f5fc21dd700 1 --2- 172.21.15.26:0/2739046550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fbc0fd100 0x7f5fbc0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.839+0000 7f5fc21dd700 1 --2- 172.21.15.26:0/2739046550 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fc830 0x7f5fbc0fcc10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.839+0000 7f5fc21dd700 1 -- 172.21.15.26:0/2739046550 >> 172.21.15.26:0/2739046550 conn(0x7f5fbc06c760 msgr2=0x7f5fbc06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:37.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.839+0000 7f5fc21dd700 1 -- 172.21.15.26:0/2739046550 shutdown_connections 2024-05-09T00:18:37.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.839+0000 7f5fc21dd700 1 -- 172.21.15.26:0/2739046550 wait complete. 2024-05-09T00:18:37.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fc21dd700 1 Processor -- start 2024-05-09T00:18:37.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fc21dd700 1 -- start start 2024-05-09T00:18:37.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fc21dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fbc0fc830 0x7f5fbc106e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fc21dd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fd100 0x7f5fbc107350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fc21dd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc061500 con 0x7f5fbc0fd100 2024-05-09T00:18:37.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fc21dd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc107840 con 0x7f5fbc0fc830 2024-05-09T00:18:37.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fd100 0x7f5fbc107350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fd100 0x7f5fbc107350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55756/0 (socket says 172.21.15.26:55756) 2024-05-09T00:18:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fbaffd700 1 -- 172.21.15.26:0/829599256 learned_addr learned my addr 172.21.15.26:0/829599256 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fbb7fe700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fbc0fc830 0x7f5fbc106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fbaffd700 1 -- 172.21.15.26:0/829599256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fbc0fc830 msgr2=0x7f5fbc106e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.840+0000 7f5fbaffd700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fbc0fc830 0x7f5fbc106e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:37.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.841+0000 7f5fbaffd700 1 -- 172.21.15.26:0/829599256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac005040 con 0x7f5fbc0fd100 2024-05-09T00:18:37.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.841+0000 7f5fbaffd700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fd100 0x7f5fbc107350 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f5fb000c740 tx=0x7f5fb0007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.841+0000 7f5fb8ff9700 1 -- 172.21.15.26:0/829599256 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fb000e680 con 0x7f5fbc0fd100 2024-05-09T00:18:37.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.841+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc107b20 con 0x7f5fbc0fd100 2024-05-09T00:18:37.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.841+0000 7f5fb8ff9700 1 -- 172.21.15.26:0/829599256 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5fb000ec90 con 0x7f5fbc0fd100 2024-05-09T00:18:37.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.841+0000 7f5fb8ff9700 1 -- 172.21.15.26:0/829599256 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fb0013d60 con 0x7f5fbc0fd100 2024-05-09T00:18:37.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.841+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc114690 con 0x7f5fbc0fd100 2024-05-09T00:18:37.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.842+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fbc05f380 con 0x7f5fbc0fd100 2024-05-09T00:18:37.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.842+0000 7f5fb8ff9700 1 -- 172.21.15.26:0/829599256 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5fb000e7e0 con 0x7f5fbc0fd100 2024-05-09T00:18:37.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.843+0000 7f5fb8ff9700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5fa406caa0 0x7f5fa406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:37.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.843+0000 7f5fb8ff9700 1 -- 172.21.15.26:0/829599256 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f5fb008c1b0 con 0x7f5fbc0fd100 2024-05-09T00:18:37.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.843+0000 7f5fbb7fe700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5fa406caa0 0x7f5fa406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:37.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.843+0000 7f5fbb7fe700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5fa406caa0 0x7f5fa406ef60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f5fac004f10 tx=0x7f5fac00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:37.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:37.847+0000 7f5fb8ff9700 1 -- 172.21.15.26:0/829599256 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f5fb0059c00 con 0x7f5fbc0fd100 2024-05-09T00:18:38.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.094+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f5fbc0f9960 con 0x7f5fbc0fd100 2024-05-09T00:18:38.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.094+0000 7f5fb8ff9700 1 -- 172.21.15.26:0/829599256 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v32) v1 ==== 107+0+4048 (secure 0 0 0) 0x7f5fb0059790 con 0x7f5fbc0fd100 2024-05-09T00:18:38.094 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:38.094 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:07.221934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":0,"incarnation":23,"state":"up:active","state_seq":159,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5fa406caa0 msgr2=0x7f5fa406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5fa406caa0 0x7f5fa406ef60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f5fac004f10 tx=0x7f5fac00b040).stop 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fd100 msgr2=0x7f5fbc107350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fd100 0x7f5fbc107350 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f5fb000c740 tx=0x7f5fb0007ef0).stop 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 shutdown_connections 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5fa406caa0 0x7f5fa406ef60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fbc0fc830 0x7f5fbc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 --2- 172.21.15.26:0/829599256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fbc0fd100 0x7f5fbc107350 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 >> 172.21.15.26:0/829599256 conn(0x7f5fbc06c760 msgr2=0x7f5fbc0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 shutdown_connections 2024-05-09T00:18:38.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.097+0000 7f5fc21dd700 1 -- 172.21.15.26:0/829599256 wait complete. 2024-05-09T00:18:38.098 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 26 2024-05-09T00:18:38.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 -- 172.21.15.26:0/3316897886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 msgr2=0x7f7f680fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 --2- 172.21.15.26:0/3316897886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 0x7f7f680fcc10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f7f580047f0 tx=0x7f7f58009cb0).stop 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 -- 172.21.15.26:0/3316897886 shutdown_connections 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 --2- 172.21.15.26:0/3316897886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f680fd100 0x7f7f680f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 --2- 172.21.15.26:0/3316897886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 0x7f7f680fcc10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 -- 172.21.15.26:0/3316897886 >> 172.21.15.26:0/3316897886 conn(0x7f7f6806c760 msgr2=0x7f7f6806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 -- 172.21.15.26:0/3316897886 shutdown_connections 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 -- 172.21.15.26:0/3316897886 wait complete. 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.230+0000 7f7f6cc77700 1 Processor -- start 2024-05-09T00:18:38.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6cc77700 1 -- start start 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6cc77700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 0x7f7f680fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6cc77700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f680fd100 0x7f7f680fdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6cc77700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680fe160 con 0x7f7f680fc830 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6cc77700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680fe2a0 con 0x7f7f680fd100 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 0x7f7f680fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 0x7f7f680fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55778/0 (socket says 172.21.15.26:55778) 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6659c700 1 -- 172.21.15.26:0/1132574400 learned_addr learned my addr 172.21.15.26:0/1132574400 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6659c700 1 -- 172.21.15.26:0/1132574400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f680fd100 msgr2=0x7f7f680fdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f65d9b700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f680fd100 0x7f7f680fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6659c700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f680fd100 0x7f7f680fdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6659c700 1 -- 172.21.15.26:0/1132574400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f58005040 con 0x7f7f680fc830 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f65d9b700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f680fd100 0x7f7f680fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:38.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.231+0000 7f7f6659c700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 0x7f7f680fd780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f7f5800b120 tx=0x7f7f58009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.232+0000 7f7f577fe700 1 -- 172.21.15.26:0/1132574400 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f5800e030 con 0x7f7f680fc830 2024-05-09T00:18:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.232+0000 7f7f577fe700 1 -- 172.21.15.26:0/1132574400 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f58007e90 con 0x7f7f680fc830 2024-05-09T00:18:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.232+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f680fe4f0 con 0x7f7f680fc830 2024-05-09T00:18:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.232+0000 7f7f577fe700 1 -- 172.21.15.26:0/1132574400 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f58018070 con 0x7f7f680fc830 2024-05-09T00:18:38.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.232+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f681145a0 con 0x7f7f680fc830 2024-05-09T00:18:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.233+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6805f380 con 0x7f7f680fc830 2024-05-09T00:18:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.233+0000 7f7f577fe700 1 -- 172.21.15.26:0/1132574400 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7f58009710 con 0x7f7f680fc830 2024-05-09T00:18:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.233+0000 7f7f577fe700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7f5006caa0 0x7f7f5006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.234+0000 7f7f577fe700 1 -- 172.21.15.26:0/1132574400 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f7f5808d320 con 0x7f7f680fc830 2024-05-09T00:18:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.234+0000 7f7f65d9b700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7f5006caa0 0x7f7f5006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.234+0000 7f7f65d9b700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7f5006caa0 0x7f7f5006ef60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f7f680fef20 tx=0x7f7f5c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.238+0000 7f7f577fe700 1 -- 172.21.15.26:0/1132574400 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f7f580572e0 con 0x7f7f680fc830 2024-05-09T00:18:38.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.481+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f7f68114cc0 con 0x7f7f680fc830 2024-05-09T00:18:38.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.481+0000 7f7f577fe700 1 -- 172.21.15.26:0/1132574400 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v32) v1 ==== 107+0+4830 (secure 0 0 0) 0x7f7f5805a900 con 0x7f7f680fc830 2024-05-09T00:18:38.481 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:38.481 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":44299,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/2979557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2979557079},{"type":"v1","addr":"172.21.15.135:6825","nonce":2979557079}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:07.221934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24301":{"gid":24301,"name":"cephfs.smithi135.hcciyw","rank":0,"incarnation":23,"state":"up:active","state_seq":159,"addr":"172.21.15.135:6827/3735682126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3735682126},{"type":"v1","addr":"172.21.15.135:6827","nonce":3735682126}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7f5006caa0 msgr2=0x7f7f5006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7f5006caa0 0x7f7f5006ef60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f7f680fef20 tx=0x7f7f5c009040).stop 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 msgr2=0x7f7f680fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 0x7f7f680fd780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f7f5800b120 tx=0x7f7f58009cb0).stop 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 shutdown_connections 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f7f5006caa0 0x7f7f5006ef60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f680fc830 0x7f7f680fd780 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 --2- 172.21.15.26:0/1132574400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f680fd100 0x7f7f680fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 >> 172.21.15.26:0/1132574400 conn(0x7f7f6806c760 msgr2=0x7f7f68060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 shutdown_connections 2024-05-09T00:18:38.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.484+0000 7f7f6cc77700 1 -- 172.21.15.26:0/1132574400 wait complete. 2024-05-09T00:18:38.485 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 27 2024-05-09T00:18:38.496 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-05-09T00:18:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.617+0000 7f35af396700 1 -- 172.21.15.26:0/1869928370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 msgr2=0x7f35a80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.617+0000 7f35af396700 1 --2- 172.21.15.26:0/1869928370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 0x7f35a80f6930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f35980047f0 tx=0x7f3598009cb0).stop 2024-05-09T00:18:38.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 -- 172.21.15.26:0/1869928370 shutdown_connections 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 --2- 172.21.15.26:0/1869928370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 0x7f35a80f6930 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 --2- 172.21.15.26:0/1869928370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a80fc830 0x7f35a80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 -- 172.21.15.26:0/1869928370 >> 172.21.15.26:0/1869928370 conn(0x7f35a806c760 msgr2=0x7f35a806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 -- 172.21.15.26:0/1869928370 shutdown_connections 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 -- 172.21.15.26:0/1869928370 wait complete. 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 Processor -- start 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 -- start start 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.618+0000 7f35af396700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a80fc830 0x7f35a810ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35af396700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 0x7f35a810d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35af396700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a810d7c0 con 0x7f35a80fd100 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35af396700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a810d900 con 0x7f35a80fc830 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35ac931700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 0x7f35a810d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35ac931700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 0x7f35a810d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55786/0 (socket says 172.21.15.26:55786) 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35ac931700 1 -- 172.21.15.26:0/2017410755 learned_addr learned my addr 172.21.15.26:0/2017410755 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35ad132700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a80fc830 0x7f35a810ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35ac931700 1 -- 172.21.15.26:0/2017410755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a80fc830 msgr2=0x7f35a810ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35ac931700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a80fc830 0x7f35a810ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35ac931700 1 -- 172.21.15.26:0/2017410755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598005040 con 0x7f35a80fd100 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35ac931700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 0x7f35a810d1c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f3598009380 tx=0x7f3598009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f359e7fc700 1 -- 172.21.15.26:0/2017410755 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359800e070 con 0x7f35a80fd100 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f359e7fc700 1 -- 172.21.15.26:0/2017410755 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3598007e90 con 0x7f35a80fd100 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a8107140 con 0x7f35a80fd100 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f359e7fc700 1 -- 172.21.15.26:0/2017410755 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3598018070 con 0x7f35a80fd100 2024-05-09T00:18:38.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.619+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a8107620 con 0x7f35a80fd100 2024-05-09T00:18:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.620+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a805f380 con 0x7f35a80fd100 2024-05-09T00:18:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.621+0000 7f359e7fc700 1 -- 172.21.15.26:0/2017410755 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f359801dbb0 con 0x7f35a80fd100 2024-05-09T00:18:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.621+0000 7f359e7fc700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f359406caa0 0x7f359406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.621+0000 7f359e7fc700 1 -- 172.21.15.26:0/2017410755 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f359808cfe0 con 0x7f35a80fd100 2024-05-09T00:18:38.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.621+0000 7f35ad132700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f359406caa0 0x7f359406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:38.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.622+0000 7f35ad132700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f359406caa0 0x7f359406ef60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f35a4004b60 tx=0x7f35a4009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:38.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.625+0000 7f359e7fc700 1 -- 172.21.15.26:0/2017410755 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f359805aa30 con 0x7f35a80fd100 2024-05-09T00:18:38.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:38 smithi026 ceph-mon[93667]: pgmap v300: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:38.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:38 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3222266113' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-05-09T00:18:38.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:38 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/829599256' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-05-09T00:18:38.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:38 smithi135 ceph-mon[80466]: pgmap v300: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:38.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:38 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3222266113' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-05-09T00:18:38.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:38 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/829599256' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-05-09T00:18:38.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.872+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f35a8103570 con 0x7f35a80fd100 2024-05-09T00:18:38.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.872+0000 7f359e7fc700 1 -- 172.21.15.26:0/2017410755 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v32) v1 ==== 107+0+4035 (secure 0 0 0) 0x7f359805a5c0 con 0x7f35a80fd100 2024-05-09T00:18:38.872 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:38.872 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":44299,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/2979557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2979557079},{"type":"v1","addr":"172.21.15.135:6825","nonce":2979557079}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:20.321984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f359406caa0 msgr2=0x7f359406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f359406caa0 0x7f359406ef60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f35a4004b60 tx=0x7f35a4009040).stop 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 msgr2=0x7f35a810d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 0x7f35a810d1c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f3598009380 tx=0x7f3598009cb0).stop 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 shutdown_connections 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f359406caa0 0x7f359406ef60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35a80fc830 0x7f35a810ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 --2- 172.21.15.26:0/2017410755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35a80fd100 0x7f35a810d1c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 >> 172.21.15.26:0/2017410755 conn(0x7f35a806c760 msgr2=0x7f35a80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 shutdown_connections 2024-05-09T00:18:38.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:38.875+0000 7f35af396700 1 -- 172.21.15.26:0/2017410755 wait complete. 2024-05-09T00:18:38.876 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 28 2024-05-09T00:18:38.887 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-05-09T00:18:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2832611984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fd100 msgr2=0x7f6e8c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 --2- 172.21.15.26:0/2832611984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fd100 0x7f6e8c0f6930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f6e800047f0 tx=0x7f6e80009cb0).stop 2024-05-09T00:18:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2832611984 shutdown_connections 2024-05-09T00:18:39.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 --2- 172.21.15.26:0/2832611984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fd100 0x7f6e8c0f6930 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 --2- 172.21.15.26:0/2832611984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8c0fc830 0x7f6e8c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2832611984 >> 172.21.15.26:0/2832611984 conn(0x7f6e8c06c760 msgr2=0x7f6e8c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2832611984 shutdown_connections 2024-05-09T00:18:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2832611984 wait complete. 2024-05-09T00:18:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.008+0000 7f6e91b5c700 1 Processor -- start 2024-05-09T00:18:39.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e91b5c700 1 -- start start 2024-05-09T00:18:39.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e91b5c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fc830 0x7f6e8c109090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e91b5c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8c0fd100 0x7f6e8c109580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e91b5c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c109a70 con 0x7f6e8c0fc830 2024-05-09T00:18:39.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e91b5c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c109bb0 con 0x7f6e8c0fd100 2024-05-09T00:18:39.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fc830 0x7f6e8c109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fc830 0x7f6e8c109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55794/0 (socket says 172.21.15.26:55794) 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8b7fe700 1 -- 172.21.15.26:0/2770684214 learned_addr learned my addr 172.21.15.26:0/2770684214 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8affd700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8c0fd100 0x7f6e8c109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8b7fe700 1 -- 172.21.15.26:0/2770684214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8c0fd100 msgr2=0x7f6e8c109580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8b7fe700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8c0fd100 0x7f6e8c109580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8b7fe700 1 -- 172.21.15.26:0/2770684214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80005040 con 0x7f6e8c0fc830 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8affd700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8c0fd100 0x7f6e8c109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.009+0000 7f6e8b7fe700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fc830 0x7f6e8c109090 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f6e7c00c740 tx=0x7f6e7c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.010+0000 7f6e88ff9700 1 -- 172.21.15.26:0/2770684214 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7c00e680 con 0x7f6e8c0fc830 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.010+0000 7f6e88ff9700 1 -- 172.21.15.26:0/2770684214 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e7c00ec90 con 0x7f6e8c0fc830 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.010+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c109e60 con 0x7f6e8c0fc830 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.010+0000 7f6e88ff9700 1 -- 172.21.15.26:0/2770684214 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7c013d60 con 0x7f6e8c0fc830 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.010+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c112450 con 0x7f6e8c0fc830 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.011+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c05f380 con 0x7f6e8c0fc830 2024-05-09T00:18:39.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.011+0000 7f6e88ff9700 1 -- 172.21.15.26:0/2770684214 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6e7c00e7e0 con 0x7f6e8c0fc830 2024-05-09T00:18:39.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.012+0000 7f6e88ff9700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6e7406caa0 0x7f6e7406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.012+0000 7f6e88ff9700 1 -- 172.21.15.26:0/2770684214 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f6e7c08c190 con 0x7f6e8c0fc830 2024-05-09T00:18:39.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.012+0000 7f6e8affd700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6e7406caa0 0x7f6e7406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.012+0000 7f6e8affd700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6e7406caa0 0x7f6e7406ef60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6e800043d0 tx=0x7f6e8000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:39.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.016+0000 7f6e88ff9700 1 -- 172.21.15.26:0/2770684214 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f6e7c056150 con 0x7f6e8c0fc830 2024-05-09T00:18:39.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.261+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f6e8c05eec0 con 0x7f6e8c0fc830 2024-05-09T00:18:39.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.261+0000 7f6e88ff9700 1 -- 172.21.15.26:0/2770684214 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v32) v1 ==== 107+0+4046 (secure 0 0 0) 0x7f6e7c059770 con 0x7f6e8c0fc830 2024-05-09T00:18:39.262 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:39.262 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":44299,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/2979557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2979557079},{"type":"v1","addr":"172.21.15.135:6825","nonce":2979557079}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:20.329015+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6e7406caa0 msgr2=0x7f6e7406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6e7406caa0 0x7f6e7406ef60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f6e800043d0 tx=0x7f6e8000b040).stop 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fc830 msgr2=0x7f6e8c109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fc830 0x7f6e8c109090 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f6e7c00c740 tx=0x7f6e7c007ef0).stop 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 shutdown_connections 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6e7406caa0 0x7f6e7406ef60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e8c0fc830 0x7f6e8c109090 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 --2- 172.21.15.26:0/2770684214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8c0fd100 0x7f6e8c109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 >> 172.21.15.26:0/2770684214 conn(0x7f6e8c06c760 msgr2=0x7f6e8c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 shutdown_connections 2024-05-09T00:18:39.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.264+0000 7f6e91b5c700 1 -- 172.21.15.26:0/2770684214 wait complete. 2024-05-09T00:18:39.265 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 29 2024-05-09T00:18:39.276 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-05-09T00:18:39.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.398+0000 7f371171e700 1 -- 172.21.15.26:0/3682777479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 msgr2=0x7f370c0f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.398+0000 7f371171e700 1 --2- 172.21.15.26:0/3682777479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 0x7f370c0f8dd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f36fc0047f0 tx=0x7f36fc009cb0).stop 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.398+0000 7f371171e700 1 -- 172.21.15.26:0/3682777479 shutdown_connections 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.398+0000 7f371171e700 1 --2- 172.21.15.26:0/3682777479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f370c0f92c0 0x7f370c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.398+0000 7f371171e700 1 --2- 172.21.15.26:0/3682777479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 0x7f370c0f8dd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.398+0000 7f371171e700 1 -- 172.21.15.26:0/3682777479 >> 172.21.15.26:0/3682777479 conn(0x7f370c06c760 msgr2=0x7f370c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.398+0000 7f371171e700 1 -- 172.21.15.26:0/3682777479 shutdown_connections 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.398+0000 7f371171e700 1 -- 172.21.15.26:0/3682777479 wait complete. 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f371171e700 1 Processor -- start 2024-05-09T00:18:39.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f371171e700 1 -- start start 2024-05-09T00:18:39.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f371171e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 0x7f370c10e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f371171e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f370c0f92c0 0x7f370c10e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f371171e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c10ebd0 con 0x7f370c0f89f0 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f371171e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c10ed10 con 0x7f370c0f92c0 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f370affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 0x7f370c10e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f370affd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 0x7f370c10e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55810/0 (socket says 172.21.15.26:55810) 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f370affd700 1 -- 172.21.15.26:0/3782174810 learned_addr learned my addr 172.21.15.26:0/3782174810 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.399+0000 7f370a7fc700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f370c0f92c0 0x7f370c10e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.400+0000 7f370affd700 1 -- 172.21.15.26:0/3782174810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f370c0f92c0 msgr2=0x7f370c10e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.400+0000 7f370affd700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f370c0f92c0 0x7f370c10e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.400+0000 7f370affd700 1 -- 172.21.15.26:0/3782174810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc005040 con 0x7f370c0f89f0 2024-05-09T00:18:39.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.400+0000 7f370affd700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 0x7f370c10e0e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f36fc009380 tx=0x7f36fc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:39.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.401+0000 7f36f3fff700 1 -- 172.21.15.26:0/3782174810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36fc018070 con 0x7f370c0f89f0 2024-05-09T00:18:39.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.401+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c1083a0 con 0x7f370c0f89f0 2024-05-09T00:18:39.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.401+0000 7f36f3fff700 1 -- 172.21.15.26:0/3782174810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36fc007e90 con 0x7f370c0f89f0 2024-05-09T00:18:39.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.401+0000 7f36f3fff700 1 -- 172.21.15.26:0/3782174810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36fc01c380 con 0x7f370c0f89f0 2024-05-09T00:18:39.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.401+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c1088e0 con 0x7f370c0f89f0 2024-05-09T00:18:39.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.402+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c05f380 con 0x7f370c0f89f0 2024-05-09T00:18:39.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.403+0000 7f36f3fff700 1 -- 172.21.15.26:0/3782174810 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f36fc0123c0 con 0x7f370c0f89f0 2024-05-09T00:18:39.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.403+0000 7f36f3fff700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f36f406cab0 0x7f36f406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.403+0000 7f36f3fff700 1 -- 172.21.15.26:0/3782174810 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f36fc08cc90 con 0x7f370c0f89f0 2024-05-09T00:18:39.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.403+0000 7f370a7fc700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f36f406cab0 0x7f36f406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.403+0000 7f370a7fc700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f36f406cab0 0x7f36f406ef70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f370c109a20 tx=0x7f370000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.408+0000 7f36f3fff700 1 -- 172.21.15.26:0/3782174810 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f36fc05a6e0 con 0x7f370c0f89f0 2024-05-09T00:18:39.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:39 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1132574400' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-05-09T00:18:39.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:39 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2017410755' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-05-09T00:18:39.649 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:39 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2770684214' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-05-09T00:18:39.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.651+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f370c109820 con 0x7f370c0f89f0 2024-05-09T00:18:39.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:39 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1132574400' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-05-09T00:18:39.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:39 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2017410755' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-05-09T00:18:39.652 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:39 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2770684214' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-05-09T00:18:39.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.652+0000 7f36f3fff700 1 -- 172.21.15.26:0/3782174810 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v32) v1 ==== 107+0+4829 (secure 0 0 0) 0x7f36fc05a270 con 0x7f370c0f89f0 2024-05-09T00:18:39.652 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:39.652 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":44299,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/2979557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2979557079},{"type":"v1","addr":"172.21.15.135:6825","nonce":2979557079}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/918815670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":918815670},{"type":"v1","addr":"172.21.15.135:6827","nonce":918815670}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:29.341944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:39.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f36f406cab0 msgr2=0x7f36f406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f36f406cab0 0x7f36f406ef70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f370c109a20 tx=0x7f370000b040).stop 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 msgr2=0x7f370c10e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 0x7f370c10e0e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f36fc009380 tx=0x7f36fc009cb0).stop 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 shutdown_connections 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f36f406cab0 0x7f36f406ef70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f370c0f89f0 0x7f370c10e0e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 --2- 172.21.15.26:0/3782174810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f370c0f92c0 0x7f370c10e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 >> 172.21.15.26:0/3782174810 conn(0x7f370c06c760 msgr2=0x7f370c100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 shutdown_connections 2024-05-09T00:18:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.654+0000 7f371171e700 1 -- 172.21.15.26:0/3782174810 wait complete. 2024-05-09T00:18:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 30 2024-05-09T00:18:39.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-05-09T00:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.788+0000 7fdc99434700 1 -- 172.21.15.26:0/2101234255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 msgr2=0x7fdc940f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.788+0000 7fdc99434700 1 --2- 172.21.15.26:0/2101234255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 0x7fdc940f6930 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fdc840047f0 tx=0x7fdc84009cb0).stop 2024-05-09T00:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.788+0000 7fdc99434700 1 -- 172.21.15.26:0/2101234255 shutdown_connections 2024-05-09T00:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.788+0000 7fdc99434700 1 --2- 172.21.15.26:0/2101234255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 0x7fdc940f6930 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.788+0000 7fdc99434700 1 --2- 172.21.15.26:0/2101234255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc940fc830 0x7fdc940fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.788+0000 7fdc99434700 1 -- 172.21.15.26:0/2101234255 >> 172.21.15.26:0/2101234255 conn(0x7fdc9406c760 msgr2=0x7fdc9406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:39.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.788+0000 7fdc99434700 1 -- 172.21.15.26:0/2101234255 shutdown_connections 2024-05-09T00:18:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.788+0000 7fdc99434700 1 -- 172.21.15.26:0/2101234255 wait complete. 2024-05-09T00:18:39.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc99434700 1 Processor -- start 2024-05-09T00:18:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc99434700 1 -- start start 2024-05-09T00:18:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc99434700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc940fc830 0x7fdc94109220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc99434700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 0x7fdc94109710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc99434700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94109c00 con 0x7fdc940fd100 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc99434700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94109d40 con 0x7fdc940fc830 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 0x7fdc94109710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 0x7fdc94109710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55818/0 (socket says 172.21.15.26:55818) 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc927fc700 1 -- 172.21.15.26:0/3603565818 learned_addr learned my addr 172.21.15.26:0/3603565818 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.789+0000 7fdc92ffd700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc940fc830 0x7fdc94109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc927fc700 1 -- 172.21.15.26:0/3603565818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc940fc830 msgr2=0x7fdc94109220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc927fc700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc940fc830 0x7fdc94109220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc927fc700 1 -- 172.21.15.26:0/3603565818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84005040 con 0x7fdc940fd100 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc927fc700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 0x7fdc94109710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fdc84009380 tx=0x7fdc84009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc7bfff700 1 -- 172.21.15.26:0/3603565818 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc84018070 con 0x7fdc940fd100 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc94109f90 con 0x7fdc940fd100 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc7bfff700 1 -- 172.21.15.26:0/3603565818 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc84007e90 con 0x7fdc940fd100 2024-05-09T00:18:39.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc7bfff700 1 -- 172.21.15.26:0/3603565818 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc840123c0 con 0x7fdc940fd100 2024-05-09T00:18:39.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.790+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc94112520 con 0x7fdc940fd100 2024-05-09T00:18:39.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.791+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9405f380 con 0x7fdc940fd100 2024-05-09T00:18:39.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.791+0000 7fdc7bfff700 1 -- 172.21.15.26:0/3603565818 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdc8401d420 con 0x7fdc940fd100 2024-05-09T00:18:39.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.792+0000 7fdc7bfff700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:39.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.792+0000 7fdc7bfff700 1 -- 172.21.15.26:0/3603565818 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fdc8408cb50 con 0x7fdc940fd100 2024-05-09T00:18:39.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.792+0000 7fdc92ffd700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:39.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.792+0000 7fdc92ffd700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdc880048b0 tx=0x7fdc8800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:39.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:39.796+0000 7fdc7bfff700 1 -- 172.21.15.26:0/3603565818 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fdc84056b10 con 0x7fdc940fd100 2024-05-09T00:18:40.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.041+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fdc940feb60 con 0x7fdc940fd100 2024-05-09T00:18:40.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.042+0000 7fdc7bfff700 1 -- 172.21.15.26:0/3603565818 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v32) v1 ==== 107+0+4826 (secure 0 0 0) 0x7fdc8401d6d0 con 0x7fdc940fd100 2024-05-09T00:18:40.042 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:40.042 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi026.gbyppy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6829/666863957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":666863957},{"type":"v1","addr":"172.21.15.26:6829","nonce":666863957}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":44299,"name":"cephfs.smithi135.lzxgvd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/2979557079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2979557079},{"type":"v1","addr":"172.21.15.135:6825","nonce":2979557079}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi135.hcciyw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/918815670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":918815670},{"type":"v1","addr":"172.21.15.135:6827","nonce":918815670}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T00:04:31.151983+0000","modified":"2024-05-09T00:15:30.345949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi026.nhrcgk","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.26:6827/1939439669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":1939439669},{"type":"v1","addr":"172.21.15.26:6827","nonce":1939439669}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-09T00:18:40.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdc7c06caa0 msgr2=0x7fdc7c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdc880048b0 tx=0x7fdc8800b040).stop 2024-05-09T00:18:40.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 msgr2=0x7fdc94109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 0x7fdc94109710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fdc84009380 tx=0x7fdc84009cb0).stop 2024-05-09T00:18:40.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 shutdown_connections 2024-05-09T00:18:40.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc940fc830 0x7fdc94109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 --2- 172.21.15.26:0/3603565818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdc940fd100 0x7fdc94109710 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 >> 172.21.15.26:0/3603565818 conn(0x7fdc9406c760 msgr2=0x7fdc940fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:40.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 shutdown_connections 2024-05-09T00:18:40.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.044+0000 7fdc99434700 1 -- 172.21.15.26:0/3603565818 wait complete. 2024-05-09T00:18:40.045 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 31 2024-05-09T00:18:40.056 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-09T00:18:40.068 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-09T00:18:40.069 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-09T00:18:40.069 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:18:40.088 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-05-09T00:18:40.088 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:18:40.149 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.309+0000 7f2ad908e700 1 -- 172.21.15.26:0/4188103743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 msgr2=0x7f2ad40fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.309+0000 7f2ad908e700 1 --2- 172.21.15.26:0/4188103743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 0x7f2ad40fcb10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f2ac80047f0 tx=0x7f2ac8009cb0).stop 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.309+0000 7f2ad908e700 1 -- 172.21.15.26:0/4188103743 shutdown_connections 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.309+0000 7f2ad908e700 1 --2- 172.21.15.26:0/4188103743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ad40fd090 0x7f2ad40f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.309+0000 7f2ad908e700 1 --2- 172.21.15.26:0/4188103743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 0x7f2ad40fcb10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.309+0000 7f2ad908e700 1 -- 172.21.15.26:0/4188103743 >> 172.21.15.26:0/4188103743 conn(0x7f2ad406c760 msgr2=0x7f2ad406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.309+0000 7f2ad908e700 1 -- 172.21.15.26:0/4188103743 shutdown_connections 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.309+0000 7f2ad908e700 1 -- 172.21.15.26:0/4188103743 wait complete. 2024-05-09T00:18:40.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad908e700 1 Processor -- start 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad908e700 1 -- start start 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad908e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 0x7f2ad410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad908e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ad40fd090 0x7f2ad410e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad908e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad410ea10 con 0x7f2ad40fc730 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad908e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad410eb50 con 0x7f2ad40fd090 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 0x7f2ad410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 0x7f2ad410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55828/0 (socket says 172.21.15.26:55828) 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad2d9d700 1 -- 172.21.15.26:0/152250273 learned_addr learned my addr 172.21.15.26:0/152250273 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad259c700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ad40fd090 0x7f2ad410e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad2d9d700 1 -- 172.21.15.26:0/152250273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ad40fd090 msgr2=0x7f2ad410e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad2d9d700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ad40fd090 0x7f2ad410e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.310+0000 7f2ad2d9d700 1 -- 172.21.15.26:0/152250273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8005040 con 0x7f2ad40fc730 2024-05-09T00:18:40.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.311+0000 7f2ad2d9d700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 0x7f2ad410df20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2ac8005010 tx=0x7f2ac8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.311+0000 7f2abbfff700 1 -- 172.21.15.26:0/152250273 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac800e030 con 0x7f2ad40fc730 2024-05-09T00:18:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.311+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad4108180 con 0x7f2ad40fc730 2024-05-09T00:18:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.311+0000 7f2abbfff700 1 -- 172.21.15.26:0/152250273 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ac8007e90 con 0x7f2ad40fc730 2024-05-09T00:18:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.311+0000 7f2abbfff700 1 -- 172.21.15.26:0/152250273 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac8018070 con 0x7f2ad40fc730 2024-05-09T00:18:40.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.311+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad41086e0 con 0x7f2ad40fc730 2024-05-09T00:18:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.312+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad405f380 con 0x7f2ad40fc730 2024-05-09T00:18:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.312+0000 7f2abbfff700 1 -- 172.21.15.26:0/152250273 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2ac801d670 con 0x7f2ad40fc730 2024-05-09T00:18:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.313+0000 7f2abbfff700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2abc06caa0 0x7f2abc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.313+0000 7f2abbfff700 1 -- 172.21.15.26:0/152250273 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f2ac808d130 con 0x7f2ad40fc730 2024-05-09T00:18:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.313+0000 7f2ad259c700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2abc06caa0 0x7f2abc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.313+0000 7f2ad259c700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2abc06caa0 0x7f2abc06ef60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f2ad4109860 tx=0x7f2ac400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:40.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.317+0000 7f2abbfff700 1 -- 172.21.15.26:0/152250273 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f2ac805ab80 con 0x7f2ad40fc730 2024-05-09T00:18:40.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.523+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad405eec0 con 0x7f2ad40fc730 2024-05-09T00:18:40.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.524+0000 7f2abbfff700 1 -- 172.21.15.26:0/152250273 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16506 (secure 0 0 0) 0x7f2ac805a710 con 0x7f2ad40fc730 2024-05-09T00:18:40.524 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:40.524 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:57:45.460652+0000","modified":"2024-05-09T00:15:20.321566+0000","last_up_change":"2024-05-09T00:14:05.009670+0000","last_in_change":"2024-05-09T00:02:49.885020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:01:47.922598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-05-09T00:04:30.085512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-05-09T00:04:30.572779+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e406a7e-5ec2-4f17-9308-640a499d3012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6803","nonce":2546986802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6805","nonce":2546986802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6809","nonce":2546986802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6807","nonce":2546986802}]},"public_addr":"172.21.15.26:6803/2546986802","cluster_addr":"172.21.15.26:6805/2546986802","heartbeat_back_addr":"172.21.15.26:6809/2546986802","heartbeat_front_addr":"172.21.15.26:6807/2546986802","state":["exists","up"]},{"osd":1,"uuid":"6f0691b3-17ca-4f90-88ce-13f4e115a987","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6811","nonce":512757979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6813","nonce":512757979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6817","nonce":512757979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6815","nonce":512757979}]},"public_addr":"172.21.15.26:6811/512757979","cluster_addr":"172.21.15.26:6813/512757979","heartbeat_back_addr":"172.21.15.26:6817/512757979","heartbeat_front_addr":"172.21.15.26:6815/512757979","state":["exists","up"]},{"osd":2,"uuid":"3eaa1376-f58f-4e84-970a-f7805331d339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6819","nonce":823482118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6821","nonce":823482118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6825","nonce":823482118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6823","nonce":823482118}]},"public_addr":"172.21.15.26:6819/823482118","cluster_addr":"172.21.15.26:6821/823482118","heartbeat_back_addr":"172.21.15.26:6825/823482118","heartbeat_front_addr":"172.21.15.26:6823/823482118","state":["exists","up"]},{"osd":3,"uuid":"9018149e-e25f-4d5c-8749-0feaffaa31e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6801","nonce":754743172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6803","nonce":754743172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6807","nonce":754743172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6805","nonce":754743172}]},"public_addr":"172.21.15.135:6801/754743172","cluster_addr":"172.21.15.135:6803/754743172","heartbeat_back_addr":"172.21.15.135:6807/754743172","heartbeat_front_addr":"172.21.15.135:6805/754743172","state":["exists","up"]},{"osd":4,"uuid":"90bd084e-4ae6-4fa0-9a79-221a26a1183c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6809","nonce":3603928216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6811","nonce":3603928216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6815","nonce":3603928216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6813","nonce":3603928216}]},"public_addr":"172.21.15.135:6809/3603928216","cluster_addr":"172.21.15.135:6811/3603928216","heartbeat_back_addr":"172.21.15.135:6815/3603928216","heartbeat_front_addr":"172.21.15.135:6813/3603928216","state":["exists","up"]},{"osd":5,"uuid":"b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6817","nonce":3179802514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6819","nonce":3179802514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6823","nonce":3179802514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6821","nonce":3179802514}]},"public_addr":"172.21.15.135:6817/3179802514","cluster_addr":"172.21.15.135:6819/3179802514","heartbeat_back_addr":"172.21.15.135:6823/3179802514","heartbeat_front_addr":"172.21.15.135:6821/3179802514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:41.148461+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:16.974271+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:45.884445+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:11.410167+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:40.468724+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:03:06.902797+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6826/3735682126":"2024-05-10T00:15:20.321533+0000","172.21.15.26:6829/3575480423":"2024-05-10T00:14:35.034063+0000","172.21.15.135:0/1041849259":"2024-05-10T00:09:04.054022+0000","172.21.15.26:6801/3278576613":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2070328984":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/109142730":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6828/3575480423":"2024-05-10T00:14:35.034063+0000","172.21.15.26:6801/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.135:6829/2528047954":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/334581542":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/1959910794":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/2652974841":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2682720248":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/925863937":"2024-05-09T23:59:44.498405+0000","172.21.15.26:0/3104174095":"2024-05-09T23:58:50.299227+0000","172.21.15.135:0/2238459121":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/965450412":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.135:0/3433942163":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/4163858233":"2024-05-09T23:58:18.405305+0000","172.21.15.26:6801/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.135:6828/2528047954":"2024-05-10T00:09:04.054022+0000","172.21.15.135:0/388038356":"2024-05-10T00:09:04.054022+0000","172.21.15.26:6800/3278576613":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2204010739":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/367563552":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/4159573253":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/1550333540":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6800/3811609814":"2024-05-10T00:09:50.526257+0000","172.21.15.135:6827/3735682126":"2024-05-10T00:15:20.321533+0000","172.21.15.26:6801/3811609814":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6827/3998166556":"2024-05-10T00:14:09.741454+0000","172.21.15.26:6826/3998166556":"2024-05-10T00:14:09.741454+0000","172.21.15.135:6824/1248766098":"2024-05-10T00:14:55.000511+0000","172.21.15.135:6825/1248766098":"2024-05-10T00:14:55.000511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:18:40.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.526+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2abc06caa0 msgr2=0x7f2abc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.526+0000 7f2ad908e700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2abc06caa0 0x7f2abc06ef60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f2ad4109860 tx=0x7f2ac400b040).stop 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.526+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 msgr2=0x7f2ad410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.526+0000 7f2ad908e700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 0x7f2ad410df20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2ac8005010 tx=0x7f2ac8009cb0).stop 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.527+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 shutdown_connections 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.527+0000 7f2ad908e700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f2abc06caa0 0x7f2abc06ef60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.527+0000 7f2ad908e700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ad40fc730 0x7f2ad410df20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.527+0000 7f2ad908e700 1 --2- 172.21.15.26:0/152250273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ad40fd090 0x7f2ad410e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.527+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 >> 172.21.15.26:0/152250273 conn(0x7f2ad406c760 msgr2=0x7f2ad4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.527+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 shutdown_connections 2024-05-09T00:18:40.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.527+0000 7f2ad908e700 1 -- 172.21.15.26:0/152250273 wait complete. 2024-05-09T00:18:40.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T00:01:47.922598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-05-09T00:04:30.085512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-05-09T00:04:30.572779+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:18:40.539 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:18:40.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:40 smithi135 ceph-mon[80466]: pgmap v301: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:40.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:40 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3782174810' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-05-09T00:18:40.651 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:40 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3603565818' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-05-09T00:18:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.662+0000 7fbd63888700 1 -- 172.21.15.26:0/963582143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fe250 msgr2=0x7fbd5c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.662+0000 7fbd63888700 1 --2- 172.21.15.26:0/963582143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fe250 0x7fbd5c0f7a30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fbd580047f0 tx=0x7fbd58009cb0).stop 2024-05-09T00:18:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.662+0000 7fbd63888700 1 -- 172.21.15.26:0/963582143 shutdown_connections 2024-05-09T00:18:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.662+0000 7fbd63888700 1 --2- 172.21.15.26:0/963582143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fe250 0x7fbd5c0f7a30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.662+0000 7fbd63888700 1 --2- 172.21.15.26:0/963582143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c0fd8f0 0x7fbd5c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-05-09T00:18:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.662+0000 7fbd63888700 1 -- 172.21.15.26:0/963582143 >> 172.21.15.26:0/963582143 conn(0x7fbd5c0f34d0 msgr2=0x7fbd5c0f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.662+0000 7fbd63888700 1 -- 172.21.15.26:0/963582143 shutdown_connections 2024-05-09T00:18:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.662+0000 7fbd63888700 1 -- 172.21.15.26:0/963582143 wait complete. 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd63888700 1 Processor -- start 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd63888700 1 -- start start 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd63888700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fd8f0 0x7fbd5c10e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd63888700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c0fe250 0x7fbd5c10e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd63888700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c10ebf0 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd63888700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c108210 con 0x7fbd5c0fe250 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd61624700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fd8f0 0x7fbd5c10e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd61624700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fd8f0 0x7fbd5c10e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55858/0 (socket says 172.21.15.26:55858) 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.663+0000 7fbd61624700 1 -- 172.21.15.26:0/2291026526 learned_addr learned my addr 172.21.15.26:0/2291026526 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd60e23700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c0fe250 0x7fbd5c10e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd61624700 1 -- 172.21.15.26:0/2291026526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c0fe250 msgr2=0x7fbd5c10e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd61624700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c0fe250 0x7fbd5c10e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd61624700 1 -- 172.21.15.26:0/2291026526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58005040 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd60e23700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c0fe250 0x7fbd5c10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd61624700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fd8f0 0x7fbd5c10e070 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fbd4c00b4b0 tx=0x7fbd4c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd527fc700 1 -- 172.21.15.26:0/2291026526 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd4c002500 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd527fc700 1 -- 172.21.15.26:0/2291026526 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd4c002b10 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5c1084c0 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd527fc700 1 -- 172.21.15.26:0/2291026526 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd4c012cf0 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.664+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c108a00 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.665+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5c05f360 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.665+0000 7fbd527fc700 1 -- 172.21.15.26:0/2291026526 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbd4c002660 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.666+0000 7fbd527fc700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbd4806caa0 0x7fbd4806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:40.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.666+0000 7fbd527fc700 1 -- 172.21.15.26:0/2291026526 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fbd4c08bec0 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.666+0000 7fbd60e23700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbd4806caa0 0x7fbd4806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:40.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.666+0000 7fbd60e23700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbd4806caa0 0x7fbd4806ef60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fbd580043d0 tx=0x7fbd5800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:40.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.670+0000 7fbd527fc700 1 -- 172.21.15.26:0/2291026526 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fbd4c059910 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.764 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:40 smithi026 ceph-mon[93667]: pgmap v301: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:40.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:40 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3782174810' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-05-09T00:18:40.765 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:40 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3603565818' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-05-09T00:18:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.871+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd5c1096f0 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.871+0000 7fbd527fc700 1 -- 172.21.15.26:0/2291026526 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd4c0594a0 con 0x7fbd5c0fd8f0 2024-05-09T00:18:40.871 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-05-09T00:18:40.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbd4806caa0 msgr2=0x7fbd4806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbd4806caa0 0x7fbd4806ef60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fbd580043d0 tx=0x7fbd5800b040).stop 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fd8f0 msgr2=0x7fbd5c10e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fd8f0 0x7fbd5c10e070 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fbd4c00b4b0 tx=0x7fbd4c0090f0).stop 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 shutdown_connections 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fbd4806caa0 0x7fbd4806ef60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd5c0fd8f0 0x7fbd5c10e070 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 --2- 172.21.15.26:0/2291026526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd5c0fe250 0x7fbd5c10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 >> 172.21.15.26:0/2291026526 conn(0x7fbd5c0f34d0 msgr2=0x7fbd5c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.873+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 shutdown_connections 2024-05-09T00:18:40.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:40.874+0000 7fbd63888700 1 -- 172.21.15.26:0/2291026526 wait complete. 2024-05-09T00:18:40.885 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-05-09T00:18:41.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 -- 172.21.15.26:0/4002690451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fc830 msgr2=0x7f71f80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 --2- 172.21.15.26:0/4002690451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fc830 0x7f71f80fcc10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f71e80047f0 tx=0x7f71e8009cb0).stop 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 -- 172.21.15.26:0/4002690451 shutdown_connections 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 --2- 172.21.15.26:0/4002690451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80fd100 0x7f71f80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 --2- 172.21.15.26:0/4002690451 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fc830 0x7f71f80fcc10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 -- 172.21.15.26:0/4002690451 >> 172.21.15.26:0/4002690451 conn(0x7f71f806c760 msgr2=0x7f71f806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 -- 172.21.15.26:0/4002690451 shutdown_connections 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 -- 172.21.15.26:0/4002690451 wait complete. 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 Processor -- start 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 -- start start 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80fc830 0x7f71f8109070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.010+0000 7f71fe138700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fd100 0x7f71f8109560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71fe138700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f8109a50 con 0x7f71f80fd100 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71fe138700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f8109b90 con 0x7f71f80fc830 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fd100 0x7f71f8109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71effff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fd100 0x7f71f8109560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55876/0 (socket says 172.21.15.26:55876) 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71effff700 1 -- 172.21.15.26:0/1145042133 learned_addr learned my addr 172.21.15.26:0/1145042133 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71f77fe700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80fc830 0x7f71f8109070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71effff700 1 -- 172.21.15.26:0/1145042133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80fc830 msgr2=0x7f71f8109070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71effff700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80fc830 0x7f71f8109070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71effff700 1 -- 172.21.15.26:0/1145042133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8005040 con 0x7f71f80fd100 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71effff700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fd100 0x7f71f8109560 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f71e00041d0 tx=0x7f71e0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71f57fa700 1 -- 172.21.15.26:0/1145042133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e0002d90 con 0x7f71f80fd100 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71f57fa700 1 -- 172.21.15.26:0/1145042133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71e000f040 con 0x7f71f80fd100 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f8109e40 con 0x7f71f80fd100 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71f57fa700 1 -- 172.21.15.26:0/1145042133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e000d800 con 0x7f71f80fd100 2024-05-09T00:18:41.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.011+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f8112430 con 0x7f71f80fd100 2024-05-09T00:18:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.012+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f805f380 con 0x7f71f80fd100 2024-05-09T00:18:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.013+0000 7f71f57fa700 1 -- 172.21.15.26:0/1145042133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f71e000da70 con 0x7f71f80fd100 2024-05-09T00:18:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.013+0000 7f71f57fa700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f71e406caa0 0x7f71e406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.013+0000 7f71f57fa700 1 -- 172.21.15.26:0/1145042133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f71e008be30 con 0x7f71f80fd100 2024-05-09T00:18:41.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.013+0000 7f71f77fe700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f71e406caa0 0x7f71e406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.014+0000 7f71f77fe700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f71e406caa0 0x7f71e406ef60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f71e8004540 tx=0x7f71e800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.018+0000 7f71f57fa700 1 -- 172.21.15.26:0/1145042133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f71e0055df0 con 0x7f71f80fd100 2024-05-09T00:18:41.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.216+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f71f80f9960 con 0x7f71f80fd100 2024-05-09T00:18:41.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.217+0000 7f71f57fa700 1 -- 172.21.15.26:0/1145042133 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f71e0059410 con 0x7f71f80fd100 2024-05-09T00:18:41.217 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-05-09T00:18:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f71e406caa0 msgr2=0x7f71e406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f71e406caa0 0x7f71e406ef60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f71e8004540 tx=0x7f71e800b040).stop 2024-05-09T00:18:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fd100 msgr2=0x7f71f8109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fd100 0x7f71f8109560 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f71e00041d0 tx=0x7f71e0009f60).stop 2024-05-09T00:18:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 shutdown_connections 2024-05-09T00:18:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f71e406caa0 0x7f71e406ef60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71f80fc830 0x7f71f8109070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 --2- 172.21.15.26:0/1145042133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71f80fd100 0x7f71f8109560 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 >> 172.21.15.26:0/1145042133 conn(0x7f71f806c760 msgr2=0x7f71f80ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 shutdown_connections 2024-05-09T00:18:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.219+0000 7f71fe138700 1 -- 172.21.15.26:0/1145042133 wait complete. 2024-05-09T00:18:41.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-05-09T00:18:41.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.354+0000 7fe439fb5700 1 -- 172.21.15.26:0/586098314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 msgr2=0x7fe4340f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.354+0000 7fe439fb5700 1 --2- 172.21.15.26:0/586098314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 0x7fe4340f6930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fe4280047f0 tx=0x7fe428009cb0).stop 2024-05-09T00:18:41.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.354+0000 7fe439fb5700 1 -- 172.21.15.26:0/586098314 shutdown_connections 2024-05-09T00:18:41.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.354+0000 7fe439fb5700 1 --2- 172.21.15.26:0/586098314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 0x7fe4340f6930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.354+0000 7fe439fb5700 1 --2- 172.21.15.26:0/586098314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4340fc830 0x7fe4340fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.354+0000 7fe439fb5700 1 -- 172.21.15.26:0/586098314 >> 172.21.15.26:0/586098314 conn(0x7fe43406c760 msgr2=0x7fe43406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.354+0000 7fe439fb5700 1 -- 172.21.15.26:0/586098314 shutdown_connections 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.354+0000 7fe439fb5700 1 -- 172.21.15.26:0/586098314 wait complete. 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.355+0000 7fe439fb5700 1 Processor -- start 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.355+0000 7fe439fb5700 1 -- start start 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.355+0000 7fe439fb5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4340fc830 0x7fe43410cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.355+0000 7fe439fb5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 0x7fe43410d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.355+0000 7fe439fb5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43410d990 con 0x7fe4340fd100 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.355+0000 7fe439fb5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43410dad0 con 0x7fe4340fc830 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe432ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 0x7fe43410d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe432ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 0x7fe43410d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55894/0 (socket says 172.21.15.26:55894) 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe432ffd700 1 -- 172.21.15.26:0/4030236497 learned_addr learned my addr 172.21.15.26:0/4030236497 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe4337fe700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4340fc830 0x7fe43410cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe432ffd700 1 -- 172.21.15.26:0/4030236497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4340fc830 msgr2=0x7fe43410cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe432ffd700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4340fc830 0x7fe43410cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe432ffd700 1 -- 172.21.15.26:0/4030236497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe428005040 con 0x7fe4340fd100 2024-05-09T00:18:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe432ffd700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 0x7fe43410d390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fe428005010 tx=0x7fe428009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe430ff9700 1 -- 172.21.15.26:0/4030236497 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42800e030 con 0x7fe4340fd100 2024-05-09T00:18:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe434107100 con 0x7fe4340fd100 2024-05-09T00:18:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe430ff9700 1 -- 172.21.15.26:0/4030236497 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe428007e90 con 0x7fe4340fd100 2024-05-09T00:18:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe430ff9700 1 -- 172.21.15.26:0/4030236497 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe428018070 con 0x7fe4340fd100 2024-05-09T00:18:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.356+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe434107660 con 0x7fe4340fd100 2024-05-09T00:18:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.357+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43405f380 con 0x7fe4340fd100 2024-05-09T00:18:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.358+0000 7fe430ff9700 1 -- 172.21.15.26:0/4030236497 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe42801d420 con 0x7fe4340fd100 2024-05-09T00:18:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.358+0000 7fe430ff9700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe41c06ca30 0x7fe41c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.358+0000 7fe430ff9700 1 -- 172.21.15.26:0/4030236497 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fe42808d240 con 0x7fe4340fd100 2024-05-09T00:18:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.358+0000 7fe4337fe700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe41c06ca30 0x7fe41c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.359+0000 7fe4337fe700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe41c06ca30 0x7fe41c06eef0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe424004dc0 tx=0x7fe42400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.363+0000 7fe430ff9700 1 -- 172.21.15.26:0/4030236497 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fe42805abd0 con 0x7fe4340fd100 2024-05-09T00:18:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.561+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fe43405eec0 con 0x7fe4340fd100 2024-05-09T00:18:41.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.561+0000 7fe430ff9700 1 -- 172.21.15.26:0/4030236497 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe42801d6d0 con 0x7fe4340fd100 2024-05-09T00:18:41.561 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-05-09T00:18:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.563+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe41c06ca30 msgr2=0x7fe41c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe41c06ca30 0x7fe41c06eef0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe424004dc0 tx=0x7fe42400b040).stop 2024-05-09T00:18:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 msgr2=0x7fe43410d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 0x7fe43410d390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fe428005010 tx=0x7fe428009cb0).stop 2024-05-09T00:18:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 shutdown_connections 2024-05-09T00:18:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fe41c06ca30 0x7fe41c06eef0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4340fc830 0x7fe43410cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 --2- 172.21.15.26:0/4030236497 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4340fd100 0x7fe43410d390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 >> 172.21.15.26:0/4030236497 conn(0x7fe43406c760 msgr2=0x7fe4340fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 shutdown_connections 2024-05-09T00:18:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.564+0000 7fe439fb5700 1 -- 172.21.15.26:0/4030236497 wait complete. 2024-05-09T00:18:41.574 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:41 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/152250273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:18:41.575 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:41 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/2291026526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:18:41.575 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:41 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1145042133' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-09T00:18:41.576 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T00:18:41.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.697+0000 7fb095165700 1 -- 172.21.15.26:0/653681328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fd8f0 msgr2=0x7fb0900fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.697+0000 7fb095165700 1 --2- 172.21.15.26:0/653681328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fd8f0 0x7fb0900fdcd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fb0800047f0 tx=0x7fb080009cb0).stop 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.697+0000 7fb095165700 1 -- 172.21.15.26:0/653681328 shutdown_connections 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.697+0000 7fb095165700 1 --2- 172.21.15.26:0/653681328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0900fe250 0x7fb0900f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.697+0000 7fb095165700 1 --2- 172.21.15.26:0/653681328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fd8f0 0x7fb0900fdcd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.697+0000 7fb095165700 1 -- 172.21.15.26:0/653681328 >> 172.21.15.26:0/653681328 conn(0x7fb0900f34d0 msgr2=0x7fb0900f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.697+0000 7fb095165700 1 -- 172.21.15.26:0/653681328 shutdown_connections 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.697+0000 7fb095165700 1 -- 172.21.15.26:0/653681328 wait complete. 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.698+0000 7fb095165700 1 Processor -- start 2024-05-09T00:18:41.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.698+0000 7fb095165700 1 -- start start 2024-05-09T00:18:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.698+0000 7fb095165700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0900fd8f0 0x7fb09010dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.698+0000 7fb095165700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fe250 0x7fb09010e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.698+0000 7fb095165700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09010eac0 con 0x7fb0900fe250 2024-05-09T00:18:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.698+0000 7fb095165700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09010ec00 con 0x7fb0900fd8f0 2024-05-09T00:18:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.698+0000 7fb08e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fe250 0x7fb09010e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.698+0000 7fb08e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fe250 0x7fb09010e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41230/0 (socket says 172.21.15.26:41230) 2024-05-09T00:18:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb08e59c700 1 -- 172.21.15.26:0/3652250938 learned_addr learned my addr 172.21.15.26:0/3652250938 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb08ed9d700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0900fd8f0 0x7fb09010dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb08e59c700 1 -- 172.21.15.26:0/3652250938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0900fd8f0 msgr2=0x7fb09010dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb08e59c700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0900fd8f0 0x7fb09010dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb08e59c700 1 -- 172.21.15.26:0/3652250938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080005040 con 0x7fb0900fe250 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb08e59c700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fe250 0x7fb09010e4c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fb08400c790 tx=0x7fb084007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb077fff700 1 -- 172.21.15.26:0/3652250938 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08400e680 con 0x7fb0900fe250 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb090108290 con 0x7fb0900fe250 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb077fff700 1 -- 172.21.15.26:0/3652250938 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb08400ec90 con 0x7fb0900fe250 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb077fff700 1 -- 172.21.15.26:0/3652250938 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb084012c70 con 0x7fb0900fe250 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.699+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb090108850 con 0x7fb0900fe250 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.700+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09005f360 con 0x7fb0900fe250 2024-05-09T00:18:41.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.701+0000 7fb077fff700 1 -- 172.21.15.26:0/3652250938 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb08400e7e0 con 0x7fb0900fe250 2024-05-09T00:18:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.701+0000 7fb077fff700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb07806caa0 0x7fb07806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.701+0000 7fb077fff700 1 -- 172.21.15.26:0/3652250938 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fb08408b7c0 con 0x7fb0900fe250 2024-05-09T00:18:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.701+0000 7fb08ed9d700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb07806caa0 0x7fb07806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:41.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.701+0000 7fb08ed9d700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb07806caa0 0x7fb07806ef60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb080007cf0 tx=0x7fb08000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.705+0000 7fb077fff700 1 -- 172.21.15.26:0/3652250938 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fb084059210 con 0x7fb0900fe250 2024-05-09T00:18:41.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:41 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/152250273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:18:41.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:41 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/2291026526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:18:41.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:41 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1145042133' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-09T00:18:41.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.921+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb09005eec0 con 0x7fb0900fe250 2024-05-09T00:18:41.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.921+0000 7fb077fff700 1 -- 172.21.15.26:0/3652250938 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 38 entries v83) v1 ==== 81+0+2268 (secure 0 0 0) 0x7fb084058da0 con 0x7fb0900fe250 2024-05-09T00:18:41.921 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6826/3735682126 2024-05-10T00:15:20.321533+0000 2024-05-09T00:18:41.921 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6829/3575480423 2024-05-10T00:14:35.034063+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:0/1041849259 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/3278576613 2024-05-10T00:06:45.286075+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2070328984 2024-05-10T00:06:45.286075+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/109142730 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6828/3575480423 2024-05-10T00:14:35.034063+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/1390633078 2024-05-09T23:58:18.405305+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6829/2528047954 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/334581542 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/1959910794 2024-05-09T23:58:50.299227+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/1390633078 2024-05-09T23:58:18.405305+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2652974841 2024-05-10T00:06:45.286075+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2682720248 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/925863937 2024-05-09T23:59:44.498405+0000 2024-05-09T00:18:41.922 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3104174095 2024-05-09T23:58:50.299227+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:0/2238459121 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/965450412 2024-05-09T23:59:44.498405+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/2916145691 2024-05-09T23:59:44.498405+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/2916145691 2024-05-09T23:59:44.498405+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/3965746041 2024-05-09T23:58:50.299227+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:0/3433942163 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/4163858233 2024-05-09T23:58:18.405305+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/3965746041 2024-05-09T23:58:50.299227+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6828/2528047954 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:0/388038356 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/3278576613 2024-05-10T00:06:45.286075+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2204010739 2024-05-09T23:58:18.405305+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/367563552 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/4159573253 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:41.923 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/1550333540 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:41.924 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/3811609814 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:41.924 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6827/3735682126 2024-05-10T00:15:20.321533+0000 2024-05-09T00:18:41.924 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/3811609814 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:41.924 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6827/3998166556 2024-05-10T00:14:09.741454+0000 2024-05-09T00:18:41.924 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6826/3998166556 2024-05-10T00:14:09.741454+0000 2024-05-09T00:18:41.924 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6824/1248766098 2024-05-10T00:14:55.000511+0000 2024-05-09T00:18:41.924 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6825/1248766098 2024-05-10T00:14:55.000511+0000 2024-05-09T00:18:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb07806caa0 msgr2=0x7fb07806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb07806caa0 0x7fb07806ef60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb080007cf0 tx=0x7fb08000b040).stop 2024-05-09T00:18:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fe250 msgr2=0x7fb09010e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fe250 0x7fb09010e4c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fb08400c790 tx=0x7fb084007f70).stop 2024-05-09T00:18:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 shutdown_connections 2024-05-09T00:18:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fb07806caa0 0x7fb07806ef60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0900fd8f0 0x7fb09010dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 --2- 172.21.15.26:0/3652250938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0900fe250 0x7fb09010e4c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.923+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 >> 172.21.15.26:0/3652250938 conn(0x7fb0900f34d0 msgr2=0x7fb0900fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.924+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 shutdown_connections 2024-05-09T00:18:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:41.924+0000 7fb095165700 1 -- 172.21.15.26:0/3652250938 wait complete. 2024-05-09T00:18:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:listed 38 entries 2024-05-09T00:18:41.935 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T00:18:41.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:41.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-09T00:18:41.974 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:18:41.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:41.974 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T00:18:42.058 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T00:18:42.058 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:18:42.082 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T00:18:42.082 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:18:42.144 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.265+0000 7f6525549700 1 -- 172.21.15.26:0/3316721871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f8a90 msgr2=0x7f65200f8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.265+0000 7f6525549700 1 --2- 172.21.15.26:0/3316721871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f8a90 0x7f65200f8e70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f65100047f0 tx=0x7f6510009cb0).stop 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.265+0000 7f6525549700 1 -- 172.21.15.26:0/3316721871 shutdown_connections 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.265+0000 7f6525549700 1 --2- 172.21.15.26:0/3316721871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65200f93f0 0x7f6520101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.265+0000 7f6525549700 1 --2- 172.21.15.26:0/3316721871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f8a90 0x7f65200f8e70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.265+0000 7f6525549700 1 -- 172.21.15.26:0/3316721871 >> 172.21.15.26:0/3316721871 conn(0x7f65200f25c0 msgr2=0x7f65200f49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.265+0000 7f6525549700 1 -- 172.21.15.26:0/3316721871 shutdown_connections 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.265+0000 7f6525549700 1 -- 172.21.15.26:0/3316721871 wait complete. 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.266+0000 7f6525549700 1 Processor -- start 2024-05-09T00:18:42.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.266+0000 7f6525549700 1 -- start start 2024-05-09T00:18:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.266+0000 7f6525549700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65200f8a90 0x7f652010e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.266+0000 7f6525549700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f93f0 0x7f652010e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.266+0000 7f6525549700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652010ec60 con 0x7f65200f93f0 2024-05-09T00:18:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.266+0000 7f6525549700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652010eda0 con 0x7f65200f8a90 2024-05-09T00:18:42.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f651e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f93f0 0x7f652010e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f651e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f93f0 0x7f652010e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41246/0 (socket says 172.21.15.26:41246) 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f651e7fc700 1 -- 172.21.15.26:0/1361909647 learned_addr learned my addr 172.21.15.26:0/1361909647 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f651effd700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65200f8a90 0x7f652010e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f651e7fc700 1 -- 172.21.15.26:0/1361909647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65200f8a90 msgr2=0x7f652010e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f651e7fc700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65200f8a90 0x7f652010e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f651e7fc700 1 -- 172.21.15.26:0/1361909647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6510005040 con 0x7f65200f93f0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f651e7fc700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f93f0 0x7f652010e660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f6514002770 tx=0x7f6514002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f6507fff700 1 -- 172.21.15.26:0/1361909647 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6514002d80 con 0x7f65200f93f0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f6507fff700 1 -- 172.21.15.26:0/1361909647 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f651400f040 con 0x7f65200f93f0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6520108430 con 0x7f65200f93f0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f6507fff700 1 -- 172.21.15.26:0/1361909647 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f651400d800 con 0x7f65200f93f0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.267+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6520108970 con 0x7f65200f93f0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.268+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65200603c0 con 0x7f65200f93f0 2024-05-09T00:18:42.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.269+0000 7f6507fff700 1 -- 172.21.15.26:0/1361909647 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6514007b40 con 0x7f65200f93f0 2024-05-09T00:18:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.269+0000 7f6507fff700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f650806cab0 0x7f650806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.269+0000 7f6507fff700 1 -- 172.21.15.26:0/1361909647 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f651408ba10 con 0x7f65200f93f0 2024-05-09T00:18:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.269+0000 7f651effd700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f650806cab0 0x7f650806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.270+0000 7f651effd700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f650806cab0 0x7f650806ef70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f65100047c0 tx=0x7f6510009cb0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:42.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.273+0000 7f6507fff700 1 -- 172.21.15.26:0/1361909647 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f6514059460 con 0x7f65200f93f0 2024-05-09T00:18:42.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.476+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65201098b0 con 0x7f65200f93f0 2024-05-09T00:18:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.477+0000 7f6507fff700 1 -- 172.21.15.26:0/1361909647 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16506 (secure 0 0 0) 0x7f6514058ff0 con 0x7f65200f93f0 2024-05-09T00:18:42.477 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-05-09T00:18:42.477 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"aa42787e-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:57:45.460652+0000","modified":"2024-05-09T00:15:20.321566+0000","last_up_change":"2024-05-09T00:14:05.009670+0000","last_in_change":"2024-05-09T00:02:49.885020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:01:47.922598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-05-09T00:04:30.085512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-05-09T00:04:30.572779+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e406a7e-5ec2-4f17-9308-640a499d3012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6803","nonce":2546986802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6805","nonce":2546986802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6809","nonce":2546986802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2546986802},{"type":"v1","addr":"172.21.15.26:6807","nonce":2546986802}]},"public_addr":"172.21.15.26:6803/2546986802","cluster_addr":"172.21.15.26:6805/2546986802","heartbeat_back_addr":"172.21.15.26:6809/2546986802","heartbeat_front_addr":"172.21.15.26:6807/2546986802","state":["exists","up"]},{"osd":1,"uuid":"6f0691b3-17ca-4f90-88ce-13f4e115a987","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6811","nonce":512757979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6813","nonce":512757979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6817","nonce":512757979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":512757979},{"type":"v1","addr":"172.21.15.26:6815","nonce":512757979}]},"public_addr":"172.21.15.26:6811/512757979","cluster_addr":"172.21.15.26:6813/512757979","heartbeat_back_addr":"172.21.15.26:6817/512757979","heartbeat_front_addr":"172.21.15.26:6815/512757979","state":["exists","up"]},{"osd":2,"uuid":"3eaa1376-f58f-4e84-970a-f7805331d339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6819","nonce":823482118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6821","nonce":823482118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6825","nonce":823482118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":823482118},{"type":"v1","addr":"172.21.15.26:6823","nonce":823482118}]},"public_addr":"172.21.15.26:6819/823482118","cluster_addr":"172.21.15.26:6821/823482118","heartbeat_back_addr":"172.21.15.26:6825/823482118","heartbeat_front_addr":"172.21.15.26:6823/823482118","state":["exists","up"]},{"osd":3,"uuid":"9018149e-e25f-4d5c-8749-0feaffaa31e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6801","nonce":754743172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6803","nonce":754743172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6807","nonce":754743172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":754743172},{"type":"v1","addr":"172.21.15.135:6805","nonce":754743172}]},"public_addr":"172.21.15.135:6801/754743172","cluster_addr":"172.21.15.135:6803/754743172","heartbeat_back_addr":"172.21.15.135:6807/754743172","heartbeat_front_addr":"172.21.15.135:6805/754743172","state":["exists","up"]},{"osd":4,"uuid":"90bd084e-4ae6-4fa0-9a79-221a26a1183c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6809","nonce":3603928216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6811","nonce":3603928216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6815","nonce":3603928216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3603928216},{"type":"v1","addr":"172.21.15.135:6813","nonce":3603928216}]},"public_addr":"172.21.15.135:6809/3603928216","cluster_addr":"172.21.15.135:6811/3603928216","heartbeat_back_addr":"172.21.15.135:6815/3603928216","heartbeat_front_addr":"172.21.15.135:6813/3603928216","state":["exists","up"]},{"osd":5,"uuid":"b0ec1b17-3ac1-4ed8-9adf-8c3fa69e5fcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6817","nonce":3179802514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6819","nonce":3179802514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6823","nonce":3179802514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3179802514},{"type":"v1","addr":"172.21.15.135:6821","nonce":3179802514}]},"public_addr":"172.21.15.135:6817/3179802514","cluster_addr":"172.21.15.135:6819/3179802514","heartbeat_back_addr":"172.21.15.135:6823/3179802514","heartbeat_front_addr":"172.21.15.135:6821/3179802514","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:41.148461+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:16.974271+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:45.884445+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:11.410167+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:02:40.468724+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:03:06.902797+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6826/3735682126":"2024-05-10T00:15:20.321533+0000","172.21.15.26:6829/3575480423":"2024-05-10T00:14:35.034063+0000","172.21.15.135:0/1041849259":"2024-05-10T00:09:04.054022+0000","172.21.15.26:6801/3278576613":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2070328984":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/109142730":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6828/3575480423":"2024-05-10T00:14:35.034063+0000","172.21.15.26:6801/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.135:6829/2528047954":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/334581542":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/1959910794":"2024-05-09T23:58:50.299227+0000","172.21.15.26:6800/1390633078":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/2652974841":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2682720248":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/925863937":"2024-05-09T23:59:44.498405+0000","172.21.15.26:0/3104174095":"2024-05-09T23:58:50.299227+0000","172.21.15.135:0/2238459121":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/965450412":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6801/2916145691":"2024-05-09T23:59:44.498405+0000","172.21.15.26:6800/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.135:0/3433942163":"2024-05-10T00:09:04.054022+0000","172.21.15.26:0/4163858233":"2024-05-09T23:58:18.405305+0000","172.21.15.26:6801/3965746041":"2024-05-09T23:58:50.299227+0000","172.21.15.135:6828/2528047954":"2024-05-10T00:09:04.054022+0000","172.21.15.135:0/388038356":"2024-05-10T00:09:04.054022+0000","172.21.15.26:6800/3278576613":"2024-05-10T00:06:45.286075+0000","172.21.15.26:0/2204010739":"2024-05-09T23:58:18.405305+0000","172.21.15.26:0/367563552":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/4159573253":"2024-05-10T00:09:50.526257+0000","172.21.15.26:0/1550333540":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6800/3811609814":"2024-05-10T00:09:50.526257+0000","172.21.15.135:6827/3735682126":"2024-05-10T00:15:20.321533+0000","172.21.15.26:6801/3811609814":"2024-05-10T00:09:50.526257+0000","172.21.15.26:6827/3998166556":"2024-05-10T00:14:09.741454+0000","172.21.15.26:6826/3998166556":"2024-05-10T00:14:09.741454+0000","172.21.15.135:6824/1248766098":"2024-05-10T00:14:55.000511+0000","172.21.15.135:6825/1248766098":"2024-05-10T00:14:55.000511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:18:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f650806cab0 msgr2=0x7f650806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f650806cab0 0x7f650806ef70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f65100047c0 tx=0x7f6510009cb0).stop 2024-05-09T00:18:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f93f0 msgr2=0x7f652010e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f93f0 0x7f652010e660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f6514002770 tx=0x7f6514002b30).stop 2024-05-09T00:18:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 shutdown_connections 2024-05-09T00:18:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f650806cab0 0x7f650806ef70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65200f8a90 0x7f652010e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 --2- 172.21.15.26:0/1361909647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65200f93f0 0x7f652010e660 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 >> 172.21.15.26:0/1361909647 conn(0x7f65200f25c0 msgr2=0x7f65200fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:42.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 shutdown_connections 2024-05-09T00:18:42.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.479+0000 7f6525549700 1 -- 172.21.15.26:0/1361909647 wait complete. 2024-05-09T00:18:42.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T00:01:47.922598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-05-09T00:04:30.085512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-05-09T00:04:30.572779+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:18:42.492 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:18:42.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.615+0000 7f5de0ae1700 1 -- 172.21.15.26:0/4053137663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fe230 msgr2=0x7f5ddc0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.615+0000 7f5de0ae1700 1 --2- 172.21.15.26:0/4053137663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fe230 0x7f5ddc0f7a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f5dc40047f0 tx=0x7f5dc4009cb0).stop 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.615+0000 7f5de0ae1700 1 -- 172.21.15.26:0/4053137663 shutdown_connections 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.615+0000 7f5de0ae1700 1 --2- 172.21.15.26:0/4053137663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fe230 0x7f5ddc0f7a10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.615+0000 7f5de0ae1700 1 --2- 172.21.15.26:0/4053137663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ddc0fd8d0 0x7f5ddc0fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.615+0000 7f5de0ae1700 1 -- 172.21.15.26:0/4053137663 >> 172.21.15.26:0/4053137663 conn(0x7f5ddc0f3490 msgr2=0x7f5ddc0f58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.615+0000 7f5de0ae1700 1 -- 172.21.15.26:0/4053137663 shutdown_connections 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.615+0000 7f5de0ae1700 1 -- 172.21.15.26:0/4053137663 wait complete. 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5de0ae1700 1 Processor -- start 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5de0ae1700 1 -- start start 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5de0ae1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fd8d0 0x7f5ddc10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5de0ae1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ddc0fe230 0x7f5ddc10e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5de0ae1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc10eab0 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5de0ae1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc10ebf0 con 0x7f5ddc0fe230 2024-05-09T00:18:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fd8d0 0x7f5ddc10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fd8d0 0x7f5ddc10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41250/0 (socket says 172.21.15.26:41250) 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5dda59c700 1 -- 172.21.15.26:0/3189277442 learned_addr learned my addr 172.21.15.26:0/3189277442 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.616+0000 7f5dd3fff700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ddc0fe230 0x7f5ddc10e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5dda59c700 1 -- 172.21.15.26:0/3189277442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ddc0fe230 msgr2=0x7f5ddc10e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5dda59c700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ddc0fe230 0x7f5ddc10e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5dda59c700 1 -- 172.21.15.26:0/3189277442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4005040 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5dda59c700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fd8d0 0x7f5ddc10dfc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f5dcc00c790 tx=0x7f5dcc00caa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5dd37fe700 1 -- 172.21.15.26:0/3189277442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dcc00e680 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc1082f0 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5dd37fe700 1 -- 172.21.15.26:0/3189277442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5dcc00ec90 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5dd37fe700 1 -- 172.21.15.26:0/3189277442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dcc012de0 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.617+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc108830 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.618+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc0606d0 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.618+0000 7f5dd37fe700 1 -- 172.21.15.26:0/3189277442 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5dcc00e7e0 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.619+0000 7f5dd37fe700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5dc806caa0 0x7f5dc806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.619+0000 7f5dd37fe700 1 -- 172.21.15.26:0/3189277442 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f5dcc08b780 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.619+0000 7f5dd3fff700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5dc806caa0 0x7f5dc806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.619+0000 7f5dd3fff700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5dc806caa0 0x7f5dc806ef60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5ddc109900 tx=0x7f5dc400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:42.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.623+0000 7f5dd37fe700 1 -- 172.21.15.26:0/3189277442 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f5dcc0591d0 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.821+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ddc109740 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.822+0000 7f5dd37fe700 1 -- 172.21.15.26:0/3189277442 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5dcc058d60 con 0x7f5ddc0fd8d0 2024-05-09T00:18:42.822 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-05-09T00:18:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5dc806caa0 msgr2=0x7f5dc806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5dc806caa0 0x7f5dc806ef60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5ddc109900 tx=0x7f5dc400b040).stop 2024-05-09T00:18:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fd8d0 msgr2=0x7f5ddc10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fd8d0 0x7f5ddc10dfc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f5dcc00c790 tx=0x7f5dcc00caa0).stop 2024-05-09T00:18:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 shutdown_connections 2024-05-09T00:18:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f5dc806caa0 0x7f5dc806ef60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ddc0fd8d0 0x7f5ddc10dfc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 --2- 172.21.15.26:0/3189277442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ddc0fe230 0x7f5ddc10e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 >> 172.21.15.26:0/3189277442 conn(0x7f5ddc0f3490 msgr2=0x7f5ddc0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 shutdown_connections 2024-05-09T00:18:42.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.824+0000 7f5de0ae1700 1 -- 172.21.15.26:0/3189277442 wait complete. 2024-05-09T00:18:42.834 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:42 smithi026 ceph-mon[93667]: pgmap v302: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:42.835 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:42 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/4030236497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-09T00:18:42.835 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:42 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3652250938' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T00:18:42.836 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-05-09T00:18:42.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:42 smithi135 ceph-mon[80466]: pgmap v302: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:18:42.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:42 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/4030236497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-09T00:18:42.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:42 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3652250938' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T00:18:42.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 -- 172.21.15.26:0/2468686109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fc830 msgr2=0x7fa4100fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 --2- 172.21.15.26:0/2468686109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fc830 0x7fa4100fcc10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fa4040047f0 tx=0x7fa404009cb0).stop 2024-05-09T00:18:42.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 -- 172.21.15.26:0/2468686109 shutdown_connections 2024-05-09T00:18:42.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 --2- 172.21.15.26:0/2468686109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100fd100 0x7fa4100f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 --2- 172.21.15.26:0/2468686109 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fc830 0x7fa4100fcc10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 -- 172.21.15.26:0/2468686109 >> 172.21.15.26:0/2468686109 conn(0x7fa41006c760 msgr2=0x7fa41006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:42.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 -- 172.21.15.26:0/2468686109 shutdown_connections 2024-05-09T00:18:42.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 -- 172.21.15.26:0/2468686109 wait complete. 2024-05-09T00:18:42.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.959+0000 7fa415100700 1 Processor -- start 2024-05-09T00:18:42.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa415100700 1 -- start start 2024-05-09T00:18:42.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa415100700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100fc830 0x7fa41010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa415100700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fd100 0x7fa41010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa415100700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41010eb70 con 0x7fa4100fd100 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa415100700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41010ecb0 con 0x7fa4100fc830 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa40e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fd100 0x7fa41010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa40e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fd100 0x7fa41010e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41264/0 (socket says 172.21.15.26:41264) 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa40e59c700 1 -- 172.21.15.26:0/597295258 learned_addr learned my addr 172.21.15.26:0/597295258 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa40ed9d700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100fc830 0x7fa41010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa40e59c700 1 -- 172.21.15.26:0/597295258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100fc830 msgr2=0x7fa41010e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa40e59c700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100fc830 0x7fa41010e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa40e59c700 1 -- 172.21.15.26:0/597295258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404005040 con 0x7fa4100fd100 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.960+0000 7fa40e59c700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fd100 0x7fa41010e570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fa40000e8f0 tx=0x7fa40000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.961+0000 7fa3f7fff700 1 -- 172.21.15.26:0/597295258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa40000ee90 con 0x7fa4100fd100 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.961+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa410108340 con 0x7fa4100fd100 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.961+0000 7fa3f7fff700 1 -- 172.21.15.26:0/597295258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa40000f040 con 0x7fa4100fd100 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.961+0000 7fa3f7fff700 1 -- 172.21.15.26:0/597295258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa40000c8a0 con 0x7fa4100fd100 2024-05-09T00:18:42.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.961+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa410108900 con 0x7fa4100fd100 2024-05-09T00:18:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.962+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41005f380 con 0x7fa4100fd100 2024-05-09T00:18:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.962+0000 7fa3f7fff700 1 -- 172.21.15.26:0/597295258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa400007b40 con 0x7fa4100fd100 2024-05-09T00:18:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.963+0000 7fa3f7fff700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa3f806caa0 0x7fa3f806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.963+0000 7fa3f7fff700 1 -- 172.21.15.26:0/597295258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fa40008bb70 con 0x7fa4100fd100 2024-05-09T00:18:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.963+0000 7fa40ed9d700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa3f806caa0 0x7fa3f806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:42.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.963+0000 7fa40ed9d700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa3f806caa0 0x7fa3f806ef60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fa404004e60 tx=0x7fa40400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:42.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:42.967+0000 7fa3f7fff700 1 -- 172.21.15.26:0/597295258 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fa4000595c0 con 0x7fa4100fd100 2024-05-09T00:18:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.165+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa41005eec0 con 0x7fa4100fd100 2024-05-09T00:18:43.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.165+0000 7fa3f7fff700 1 -- 172.21.15.26:0/597295258 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa400059150 con 0x7fa4100fd100 2024-05-09T00:18:43.166 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa3f806caa0 msgr2=0x7fa3f806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa3f806caa0 0x7fa3f806ef60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fa404004e60 tx=0x7fa40400b040).stop 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fd100 msgr2=0x7fa41010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fd100 0x7fa41010e570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fa40000e8f0 tx=0x7fa40000b040).stop 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 shutdown_connections 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa3f806caa0 0x7fa3f806ef60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4100fc830 0x7fa41010e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 --2- 172.21.15.26:0/597295258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4100fd100 0x7fa41010e570 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 >> 172.21.15.26:0/597295258 conn(0x7fa41006c760 msgr2=0x7fa410060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 shutdown_connections 2024-05-09T00:18:43.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.168+0000 7fa415100700 1 -- 172.21.15.26:0/597295258 wait complete. 2024-05-09T00:18:43.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.303+0000 7fa260ffd700 1 -- 172.21.15.26:0/437378229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fd100 msgr2=0x7fa25c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.303+0000 7fa260ffd700 1 --2- 172.21.15.26:0/437378229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fd100 0x7fa25c0f6930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fa24c0047f0 tx=0x7fa24c009cb0).stop 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.303+0000 7fa260ffd700 1 -- 172.21.15.26:0/437378229 shutdown_connections 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.303+0000 7fa260ffd700 1 --2- 172.21.15.26:0/437378229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fd100 0x7fa25c0f6930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.303+0000 7fa260ffd700 1 --2- 172.21.15.26:0/437378229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa25c0fc830 0x7fa25c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.303+0000 7fa260ffd700 1 -- 172.21.15.26:0/437378229 >> 172.21.15.26:0/437378229 conn(0x7fa25c06c760 msgr2=0x7fa25c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.303+0000 7fa260ffd700 1 -- 172.21.15.26:0/437378229 shutdown_connections 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.303+0000 7fa260ffd700 1 -- 172.21.15.26:0/437378229 wait complete. 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa260ffd700 1 Processor -- start 2024-05-09T00:18:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa260ffd700 1 -- start start 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa260ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fc830 0x7fa25c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa260ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa25c0fd100 0x7fa25c10e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa260ffd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c10eab0 con 0x7fa25c0fc830 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa260ffd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c10ebf0 con 0x7fa25c0fd100 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa25a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fc830 0x7fa25c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa25a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fc830 0x7fa25c10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41282/0 (socket says 172.21.15.26:41282) 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa25a59c700 1 -- 172.21.15.26:0/190234422 learned_addr learned my addr 172.21.15.26:0/190234422 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa259d9b700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa25c0fd100 0x7fa25c10e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa25a59c700 1 -- 172.21.15.26:0/190234422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa25c0fd100 msgr2=0x7fa25c10e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa25a59c700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa25c0fd100 0x7fa25c10e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa25a59c700 1 -- 172.21.15.26:0/190234422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c005040 con 0x7fa25c0fc830 2024-05-09T00:18:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.304+0000 7fa25a59c700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fc830 0x7fa25c10dfc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fa24400c790 tx=0x7fa24400cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.305+0000 7fa2537fe700 1 -- 172.21.15.26:0/190234422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2440106f0 con 0x7fa25c0fc830 2024-05-09T00:18:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.305+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c108280 con 0x7fa25c0fc830 2024-05-09T00:18:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.305+0000 7fa2537fe700 1 -- 172.21.15.26:0/190234422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa244010d00 con 0x7fa25c0fc830 2024-05-09T00:18:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.305+0000 7fa2537fe700 1 -- 172.21.15.26:0/190234422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa244012e50 con 0x7fa25c0fc830 2024-05-09T00:18:43.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.305+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c108840 con 0x7fa25c0fc830 2024-05-09T00:18:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.306+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c05f380 con 0x7fa25c0fc830 2024-05-09T00:18:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.306+0000 7fa2537fe700 1 -- 172.21.15.26:0/190234422 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa244010850 con 0x7fa25c0fc830 2024-05-09T00:18:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.306+0000 7fa2537fe700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa24806caa0 0x7fa24806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.307+0000 7fa2537fe700 1 -- 172.21.15.26:0/190234422 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7fa24408b7f0 con 0x7fa25c0fc830 2024-05-09T00:18:43.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.307+0000 7fa259d9b700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa24806caa0 0x7fa24806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.307+0000 7fa259d9b700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa24806caa0 0x7fa24806ef60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa24c004f10 tx=0x7fa24c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:43.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.311+0000 7fa2537fe700 1 -- 172.21.15.26:0/190234422 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7fa244059240 con 0x7fa25c0fc830 2024-05-09T00:18:43.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.510+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa25c05eec0 con 0x7fa25c0fc830 2024-05-09T00:18:43.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.510+0000 7fa2537fe700 1 -- 172.21.15.26:0/190234422 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa244058dd0 con 0x7fa25c0fc830 2024-05-09T00:18:43.510 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-05-09T00:18:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa24806caa0 msgr2=0x7fa24806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa24806caa0 0x7fa24806ef60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa24c004f10 tx=0x7fa24c00b040).stop 2024-05-09T00:18:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fc830 msgr2=0x7fa25c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fc830 0x7fa25c10dfc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fa24400c790 tx=0x7fa24400cb50).stop 2024-05-09T00:18:43.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 shutdown_connections 2024-05-09T00:18:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7fa24806caa0 0x7fa24806ef60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa25c0fc830 0x7fa25c10dfc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 --2- 172.21.15.26:0/190234422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa25c0fd100 0x7fa25c10e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 >> 172.21.15.26:0/190234422 conn(0x7fa25c06c760 msgr2=0x7fa25c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 shutdown_connections 2024-05-09T00:18:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.512+0000 7fa260ffd700 1 -- 172.21.15.26:0/190234422 wait complete. 2024-05-09T00:18:43.523 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:43 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/1361909647' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:18:43.523 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:43 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/3189277442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:18:43.523 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:43 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/597295258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-09T00:18:43.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.646+0000 7f6a6aaff700 1 -- 172.21.15.26:0/3105805356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f92c0 msgr2=0x7f6a64101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.646+0000 7f6a6aaff700 1 --2- 172.21.15.26:0/3105805356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f92c0 0x7f6a64101a60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f6a500047f0 tx=0x7f6a50009cb0).stop 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.646+0000 7f6a6aaff700 1 -- 172.21.15.26:0/3105805356 shutdown_connections 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.646+0000 7f6a6aaff700 1 --2- 172.21.15.26:0/3105805356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f92c0 0x7f6a64101a60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.646+0000 7f6a6aaff700 1 --2- 172.21.15.26:0/3105805356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a640f89f0 0x7f6a640f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.646+0000 7f6a6aaff700 1 -- 172.21.15.26:0/3105805356 >> 172.21.15.26:0/3105805356 conn(0x7f6a6406c760 msgr2=0x7f6a6406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.646+0000 7f6a6aaff700 1 -- 172.21.15.26:0/3105805356 shutdown_connections 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.646+0000 7f6a6aaff700 1 -- 172.21.15.26:0/3105805356 wait complete. 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6aaff700 1 Processor -- start 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6aaff700 1 -- start start 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6aaff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f89f0 0x7f6a6410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6aaff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a640f92c0 0x7f6a6410e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6aaff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6410eac0 con 0x7f6a640f89f0 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6aaff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6410ec00 con 0x7f6a640f92c0 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6889b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f89f0 0x7f6a6410dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6889b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f89f0 0x7f6a6410dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41300/0 (socket says 172.21.15.26:41300) 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6889b700 1 -- 172.21.15.26:0/776014787 learned_addr learned my addr 172.21.15.26:0/776014787 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a63fff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a640f92c0 0x7f6a6410e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6889b700 1 -- 172.21.15.26:0/776014787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a640f92c0 msgr2=0x7f6a6410e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6889b700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a640f92c0 0x7f6a6410e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6889b700 1 -- 172.21.15.26:0/776014787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50005040 con 0x7f6a640f89f0 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a63fff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a640f92c0 0x7f6a6410e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.647+0000 7f6a6889b700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f89f0 0x7f6a6410dfd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f6a580041d0 tx=0x7f6a58009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.648+0000 7f6a61ffb700 1 -- 172.21.15.26:0/776014787 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a58002d90 con 0x7f6a640f89f0 2024-05-09T00:18:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.648+0000 7f6a61ffb700 1 -- 172.21.15.26:0/776014787 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a5800f040 con 0x7f6a640f89f0 2024-05-09T00:18:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.648+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a64108290 con 0x7f6a640f89f0 2024-05-09T00:18:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.648+0000 7f6a61ffb700 1 -- 172.21.15.26:0/776014787 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a5800d800 con 0x7f6a640f89f0 2024-05-09T00:18:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.648+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a641087d0 con 0x7f6a640f89f0 2024-05-09T00:18:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.649+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6405f380 con 0x7f6a640f89f0 2024-05-09T00:18:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.649+0000 7f6a61ffb700 1 -- 172.21.15.26:0/776014787 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6a5800da70 con 0x7f6a640f89f0 2024-05-09T00:18:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.649+0000 7f6a61ffb700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6a5406caa0 0x7f6a5406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-05-09T00:18:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.650+0000 7f6a61ffb700 1 -- 172.21.15.26:0/776014787 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6481+0+0 (secure 0 0 0) 0x7f6a5808be30 con 0x7f6a640f89f0 2024-05-09T00:18:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.650+0000 7f6a63fff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6a5406caa0 0x7f6a5406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:18:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.650+0000 7f6a63fff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6a5406caa0 0x7f6a5406ef60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6a50009ee0 tx=0x7f6a5000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:18:43.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.654+0000 7f6a61ffb700 1 -- 172.21.15.26:0/776014787 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181593 (secure 0 0 0) 0x7f6a58059880 con 0x7f6a640f89f0 2024-05-09T00:18:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.868+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a6405eec0 con 0x7f6a640f89f0 2024-05-09T00:18:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.868+0000 7f6a61ffb700 1 -- 172.21.15.26:0/776014787 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 38 entries v83) v1 ==== 81+0+2268 (secure 0 0 0) 0x7f6a58059410 con 0x7f6a640f89f0 2024-05-09T00:18:43.868 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6826/3735682126 2024-05-10T00:15:20.321533+0000 2024-05-09T00:18:43.868 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6829/3575480423 2024-05-10T00:14:35.034063+0000 2024-05-09T00:18:43.868 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:0/1041849259 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:43.868 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/3278576613 2024-05-10T00:06:45.286075+0000 2024-05-09T00:18:43.868 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2070328984 2024-05-10T00:06:45.286075+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/109142730 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6828/3575480423 2024-05-10T00:14:35.034063+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/1390633078 2024-05-09T23:58:18.405305+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6829/2528047954 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/334581542 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/1959910794 2024-05-09T23:58:50.299227+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/1390633078 2024-05-09T23:58:18.405305+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2652974841 2024-05-10T00:06:45.286075+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2682720248 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/925863937 2024-05-09T23:59:44.498405+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3104174095 2024-05-09T23:58:50.299227+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:0/2238459121 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:43.869 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/965450412 2024-05-09T23:59:44.498405+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/2916145691 2024-05-09T23:59:44.498405+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/2916145691 2024-05-09T23:59:44.498405+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/3965746041 2024-05-09T23:58:50.299227+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:0/3433942163 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/4163858233 2024-05-09T23:58:18.405305+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/3965746041 2024-05-09T23:58:50.299227+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6828/2528047954 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:0/388038356 2024-05-10T00:09:04.054022+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/3278576613 2024-05-10T00:06:45.286075+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2204010739 2024-05-09T23:58:18.405305+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/367563552 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/4159573253 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:43.870 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/1550333540 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:43.871 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/3811609814 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:43.871 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6827/3735682126 2024-05-10T00:15:20.321533+0000 2024-05-09T00:18:43.871 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/3811609814 2024-05-10T00:09:50.526257+0000 2024-05-09T00:18:43.871 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6827/3998166556 2024-05-10T00:14:09.741454+0000 2024-05-09T00:18:43.871 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6826/3998166556 2024-05-10T00:14:09.741454+0000 2024-05-09T00:18:43.871 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6824/1248766098 2024-05-10T00:14:55.000511+0000 2024-05-09T00:18:43.871 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.135:6825/1248766098 2024-05-10T00:14:55.000511+0000 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6a5406caa0 msgr2=0x7f6a5406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6a5406caa0 0x7f6a5406ef60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6a50009ee0 tx=0x7f6a5000b040).stop 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f89f0 msgr2=0x7f6a6410dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f89f0 0x7f6a6410dfd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f6a580041d0 tx=0x7f6a58009f60).stop 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 shutdown_connections 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:6800/205101372,v1:172.21.15.26:6801/205101372] conn(0x7f6a5406caa0 0x7f6a5406ef60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a640f89f0 0x7f6a6410dfd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 --2- 172.21.15.26:0/776014787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a640f92c0 0x7f6a6410e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 >> 172.21.15.26:0/776014787 conn(0x7f6a6406c760 msgr2=0x7f6a640fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 shutdown_connections 2024-05-09T00:18:43.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-05-09T00:18:43.870+0000 7f6a6aaff700 1 -- 172.21.15.26:0/776014787 wait complete. 2024-05-09T00:18:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:listed 38 entries 2024-05-09T00:18:43.882 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-09T00:18:43.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:43.882 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-09T00:18:43.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:43 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/1361909647' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:18:43.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:43 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/3189277442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:18:43.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:43 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/597295258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-05-09T00:18:43.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T00:18:43.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:43.934 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-09T00:18:44.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:44.155 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-05-09T00:18:44.175 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T00:18:44.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:44.175 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T00:18:44.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:44.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-05-09T00:18:44.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:44.337 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-09T00:18:44.360 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-09T00:18:44.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:44.361 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T00:18:44.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:18:44.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-09T00:18:44.537 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-09T00:18:44.548 INFO:tasks.cephadm:Teardown begin 2024-05-09T00:18:44.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:18:44.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:44 smithi026 ceph-mon[93667]: pgmap v303: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:18:44.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:44 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/190234422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-09T00:18:44.577 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:44 smithi026 ceph-mon[93667]: from='client.? 172.21.15.26:0/776014787' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T00:18:44.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:18:44.611 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-09T00:18:44.611 DEBUG:teuthology.orchestra.run.smithi026:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T00:18:44.638 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T00:18:44.669 INFO:tasks.cephadm:Stopping all daemons... 2024-05-09T00:18:44.670 INFO:tasks.cephadm.mon.smithi026:Stopping mon.smithi026... 2024-05-09T00:18:44.670 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi026 2024-05-09T00:18:44.899 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:44 smithi026 systemd[1]: Stopping Ceph mon.smithi026 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:18:44.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:44 smithi135 ceph-mon[80466]: pgmap v303: 65 pgs: 65 active+clean; 196 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T00:18:44.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:44 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/190234422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-05-09T00:18:44.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:44 smithi135 ceph-mon[80466]: from='client.? 172.21.15.26:0/776014787' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T00:18:45.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[93644]: 2024-05-09T00:18:44.947+0000 7fe46dcfc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi026 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:18:45.304 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:44 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026[93644]: 2024-05-09T00:18:44.947+0000 7fe46dcfc700 -1 mon.smithi026@0(leader) e3 *** Got Signal Terminated *** 2024-05-09T00:18:45.648 INFO:journalctl@ceph.mon.smithi026.smithi026.stdout:May 09 00:18:45 smithi026 bash[146168]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi026 2024-05-09T00:18:45.767 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi026.service' 2024-05-09T00:18:45.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:18:45.818 INFO:tasks.cephadm.mon.smithi026:Stopped mon.smithi026 2024-05-09T00:18:45.818 INFO:tasks.cephadm.mon.smithi135:Stopping mon.smithi135... 2024-05-09T00:18:45.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi135 2024-05-09T00:18:46.110 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:45 smithi135 systemd[1]: Stopping Ceph mon.smithi135 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:18:46.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:46 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[80443]: 2024-05-09T00:18:46.109+0000 7f69f7b41700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi135 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:18:46.401 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:46 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135[80443]: 2024-05-09T00:18:46.109+0000 7f69f7b41700 -1 mon.smithi135@1(peon) e3 *** Got Signal Terminated *** 2024-05-09T00:18:46.901 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:May 09 00:18:46 smithi135 bash[120267]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-mon-smithi135 2024-05-09T00:18:47.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@mon.smithi135.service' 2024-05-09T00:18:47.217 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:18:47.217 INFO:tasks.cephadm.mon.smithi135:Stopped mon.smithi135 2024-05-09T00:18:47.217 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-09T00:18:47.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.0 2024-05-09T00:18:47.521 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:18:47 smithi026 systemd[1]: Stopping Ceph osd.0 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:18:47.898 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:18:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[101375]: 2024-05-09T00:18:47.521+0000 7fed3e2bb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:18:47.899 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:18:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[101375]: 2024-05-09T00:18:47.521+0000 7fed3e2bb700 -1 osd.0 83 *** Got signal Terminated *** 2024-05-09T00:18:47.899 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:18:47 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0[101375]: 2024-05-09T00:18:47.521+0000 7fed3e2bb700 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:18:53.649 INFO:journalctl@ceph.osd.0.smithi026.stdout:May 09 00:18:53 smithi026 bash[146325]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-0 2024-05-09T00:18:55.118 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.0.service' 2024-05-09T00:18:55.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:18:55.165 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-09T00:18:55.165 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-09T00:18:55.165 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.1 2024-05-09T00:18:55.399 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:18:55 smithi026 systemd[1]: Stopping Ceph osd.1 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:18:55.899 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:18:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[105540]: 2024-05-09T00:18:55.428+0000 7f7a16fae700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:18:55.899 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:18:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[105540]: 2024-05-09T00:18:55.428+0000 7f7a16fae700 -1 osd.1 83 *** Got signal Terminated *** 2024-05-09T00:18:55.899 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:18:55 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1[105540]: 2024-05-09T00:18:55.428+0000 7f7a16fae700 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:19:01.649 INFO:journalctl@ceph.osd.1.smithi026.stdout:May 09 00:19:01 smithi026 bash[146603]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-1 2024-05-09T00:19:02.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.1.service' 2024-05-09T00:19:03.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:19:03.000 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-09T00:19:03.000 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-09T00:19:03.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.2 2024-05-09T00:19:03.316 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:19:03 smithi026 systemd[1]: Stopping Ceph osd.2 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:19:03.649 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:19:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[109916]: 2024-05-09T00:19:03.317+0000 7fda64a2b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:19:03.649 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:19:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[109916]: 2024-05-09T00:19:03.317+0000 7fda64a2b700 -1 osd.2 83 *** Got signal Terminated *** 2024-05-09T00:19:03.649 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:19:03 smithi026 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2[109916]: 2024-05-09T00:19:03.317+0000 7fda64a2b700 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:19:09.399 INFO:journalctl@ceph.osd.2.smithi026.stdout:May 09 00:19:09 smithi026 bash[146873]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-2 2024-05-09T00:19:11.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.2.service' 2024-05-09T00:19:11.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:19:11.127 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-09T00:19:11.127 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-09T00:19:11.127 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.3 2024-05-09T00:19:11.470 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:19:11 smithi135 systemd[1]: Stopping Ceph osd.3 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:19:11.901 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:19:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:19:11.470+0000 7f2090237700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:19:11.901 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:19:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:19:11.470+0000 7f2090237700 -1 osd.3 83 *** Got signal Terminated *** 2024-05-09T00:19:11.901 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:19:11 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3[87660]: 2024-05-09T00:19:11.470+0000 7f2090237700 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:19:13.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:13 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:13.295+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:14.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:14.258+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:14.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:14 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:14.288+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:15.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:15.217+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:15.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:15 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:15.249+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:16.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:16.209+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:16.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:16 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:16.246+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:17.651 INFO:journalctl@ceph.osd.3.smithi135.stdout:May 09 00:19:17 smithi135 bash[120426]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-3 2024-05-09T00:19:17.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:17.256+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:17.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:17 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:17.238+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:18.597 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:18.259+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:18.597 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:18 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:18.236+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:19.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.3.service' 2024-05-09T00:19:19.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:19:19.193 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-09T00:19:19.193 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-09T00:19:19.193 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.4 2024-05-09T00:19:19.401 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:19.241+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:19.401 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:19.222+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:19.402 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:19 smithi135 systemd[1]: Stopping Ceph osd.4 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:19:19.901 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:19.518+0000 7fea8dc4a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:19:19.901 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:19.518+0000 7fea8dc4a700 -1 osd.4 83 *** Got signal Terminated *** 2024-05-09T00:19:19.902 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:19 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:19.518+0000 7fea8dc4a700 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:19:20.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:20.222+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:20.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:20 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:20.222+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:21.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:21.204+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:21.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:21 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:21.183+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:22.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:22.211+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:22.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:22.211+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:57.723544+0000 front 2024-05-09T00:18:57.723500+0000 (oldest deadline 2024-05-09T00:19:21.823559+0000) 2024-05-09T00:19:22.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:22 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:22.213+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:23.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:23.195+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:23.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:23.195+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:57.723544+0000 front 2024-05-09T00:18:57.723500+0000 (oldest deadline 2024-05-09T00:19:21.823559+0000) 2024-05-09T00:19:23.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:23.252+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:23.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:23 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:23.252+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:24.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:24.212+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:51.923007+0000 front 2024-05-09T00:18:51.922933+0000 (oldest deadline 2024-05-09T00:19:13.022743+0000) 2024-05-09T00:19:24.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4[91549]: 2024-05-09T00:19:24.212+0000 7fea8aa41700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:57.723544+0000 front 2024-05-09T00:18:57.723500+0000 (oldest deadline 2024-05-09T00:19:21.823559+0000) 2024-05-09T00:19:24.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:24.244+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:24.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:24 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:24.244+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:25.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:May 09 00:19:25 smithi135 bash[120692]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-4 2024-05-09T00:19:25.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:25.273+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:25.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:25 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:25.273+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:26.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:26 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:26.306+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:26.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:26 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:26.306+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:27.030 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.4.service' 2024-05-09T00:19:27.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:19:27.073 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-09T00:19:27.073 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-09T00:19:27.073 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.5 2024-05-09T00:19:27.287 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:27 smithi135 systemd[1]: Stopping Ceph osd.5 for aa42787e-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:19:27.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:27.287+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:27.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:27.287+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:27.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:27.397+0000 7fc3a23f5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:19:27.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:27.397+0000 7fc3a23f5700 -1 osd.5 83 *** Got signal Terminated *** 2024-05-09T00:19:27.652 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:27 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:27.397+0000 7fc3a23f5700 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:19:28.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:28.323+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:28.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:28 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:28.323+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:29.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:29.315+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:29.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:29 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:29.315+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:30.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:30.293+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:30.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:30 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:30.293+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:31.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:31.338+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:31.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:31 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:31.338+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:32.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:32.367+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2024-05-09T00:18:50.992653+0000 front 2024-05-09T00:18:50.992708+0000 (oldest deadline 2024-05-09T00:19:13.292474+0000) 2024-05-09T00:19:32.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:32 smithi135 ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5[95654]: 2024-05-09T00:19:32.367+0000 7fc39f1ec700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.26:6814 osd.1 since back 2024-05-09T00:18:59.693742+0000 front 2024-05-09T00:18:59.693807+0000 (oldest deadline 2024-05-09T00:19:23.193758+0000) 2024-05-09T00:19:33.401 INFO:journalctl@ceph.osd.5.smithi135.stdout:May 09 00:19:33 smithi135 bash[120958]: ceph-aa42787e-0d96-11ef-bc97-c7b262605968-osd-5 2024-05-09T00:19:34.732 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aa42787e-0d96-11ef-bc97-c7b262605968@osd.5.service' 2024-05-09T00:19:34.778 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:19:34.779 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-09T00:19:34.779 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid aa42787e-0d96-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T00:19:56.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid aa42787e-0d96-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T00:20:09.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:20:09.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:20:09.891 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-09T00:20:09.893 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187/remote/smithi026/crash 2024-05-09T00:20:09.894 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/crash -- . 2024-05-09T00:20:09.932 INFO:teuthology.orchestra.run.smithi026.stderr:tar: /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T00:20:09.933 INFO:teuthology.orchestra.run.smithi026.stderr:tar: Error is not recoverable: exiting now 2024-05-09T00:20:09.934 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187/remote/smithi135/crash 2024-05-09T00:20:09.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/crash -- . 2024-05-09T00:20:09.961 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T00:20:09.961 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-05-09T00:20:09.962 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-09T00:20:09.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-05-09T00:20:10.008 INFO:teuthology.orchestra.run.smithi026.stderr:grep: /var/log/ceph/aa42787e-0d96-11ef-bc97-c7b262605968/ceph.log: No such file or directory 2024-05-09T00:20:10.010 INFO:tasks.cephadm:Compressing logs... 2024-05-09T00:20:10.010 DEBUG:teuthology.orchestra.run.smithi026:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:20:10.052 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:20:10.079 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-09T00:20:10.080 INFO:teuthology.orchestra.run.smithi026.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-09T00:22:31.599 INFO:tasks.cephadm:Archiving logs... 2024-05-09T00:22:31.600 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187/remote/smithi026/log 2024-05-09T00:22:31.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T00:22:48.764 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187/remote/smithi135/log 2024-05-09T00:22:48.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T00:22:52.212 INFO:tasks.cephadm:Removing cluster... 2024-05-09T00:22:52.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid aa42787e-0d96-11ef-bc97-c7b262605968 --force 2024-05-09T00:22:52.823 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid aa42787e-0d96-11ef-bc97-c7b262605968 --force 2024-05-09T00:22:53.303 INFO:tasks.cephadm:Removing cephadm ... 2024-05-09T00:22:53.303 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T00:22:53.324 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T00:22:53.342 INFO:tasks.cephadm:Teardown complete 2024-05-09T00:22:53.343 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T00:22:53.354 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T00:22:53.354 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T00:22:53.367 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T00:22:53.464 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T00:22:53.475 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T00:22:53.475 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:22:53.477 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:22:53.493 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2024-05-09T00:22:53.494 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2024-05-09T00:22:53.497 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:22:53.497 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-05-09T00:22:53.498 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +845us[ +792us] +/- 44ms 2024-05-09T00:22:53.498 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -940us[ -993us] +/- 50ms 2024-05-09T00:22:53.498 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -160us[ -214us] +/- 67ms 2024-05-09T00:22:53.498 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:22:53.499 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:22:53.499 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-09T00:22:53.500 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +848us[ +802us] +/- 44ms 2024-05-09T00:22:53.500 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -933us[ -980us] +/- 50ms 2024-05-09T00:22:53.500 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -150us[ -196us] +/- 67ms 2024-05-09T00:22:53.500 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:22:53.500 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T00:22:53.511 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T00:22:53.511 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T00:22:53.542 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T00:22:53.616 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T00:22:53.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-09T00:22:53.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:22:53.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-09T00:22:53.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:22:53.751 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T00:22:53.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T00:22:53.792 INFO:teuthology.task.internal:Duration was 2643.432716 seconds 2024-05-09T00:22:53.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T00:22:53.825 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T00:22:53.826 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T00:22:53.828 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T00:22:53.875 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:22:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:22:54.163 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T00:22:54.163 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-05-09T00:22:54.163 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T00:22:54.186 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T00:22:54.187 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T00:22:54.211 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T00:22:54.211 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:22:54.230 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:22:54.309 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T00:22:54.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T00:22:54.312 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T00:22:54.437 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T00:22:54.452 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T00:22:54.453 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T00:22:54.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T00:22:54.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T00:22:54.520 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:22:54.523 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:22:54.549 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-05-09T00:22:54.575 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-05-09T00:22:54.588 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:22:54.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:22:54.620 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:22:54.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:22:54.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T00:22:54.674 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T00:22:54.675 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187/remote/smithi026 2024-05-09T00:22:54.675 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T00:22:54.723 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698187/remote/smithi135 2024-05-09T00:22:54.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T00:22:54.764 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T00:22:54.765 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T00:22:54.767 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T00:22:54.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T00:22:54.827 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T00:22:54.828 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T00:22:54.860 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T00:22:54.860 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T00:22:54.862 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T00:22:54.879 INFO:teuthology.orchestra.run.smithi026.stdout: 525651 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 00:22 /home/ubuntu/cephtest 2024-05-09T00:22:54.880 INFO:teuthology.orchestra.run.smithi135.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 00:22 /home/ubuntu/cephtest 2024-05-09T00:22:54.882 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T00:22:54.901 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T00:22:54.973 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2643.432715654373 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T00:22:54.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T00:22:55.054 INFO:teuthology.run:pass